2023-07-05T18:44:05.490 INFO:root:teuthology version: 0.0.1.dev140+gb53f236 2023-07-05T18:44:05.491 DEBUG:teuthology.run:Teuthology command: teuthology --archive /home/teuthworker/archive/rishabh-2023-07-05_18:32:52-fs-wip-rishabh-CephManager-in-CephFSTestCase-testing-default-smithi/7327386 --description fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/xfstests-dev} --name rishabh-2023-07-05_18:32:52-fs-wip-rishabh-CephManager-in-CephFSTestCase-testing-default-smithi --owner scheduled_rishabh@teuthology --verbose -- /home/teuthworker/archive/rishabh-2023-07-05_18:32:52-fs-wip-rishabh-CephManager-in-CephFSTestCase-testing-default-smithi/7327386/orig.config.yaml 2023-07-05T18:44:05.534 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-05T18:44:05.630 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/rishabh-2023-07-05_18:32:52-fs-wip-rishabh-CephManager-in-CephFSTestCase-testing-default-smithi/7327386 branch: wip-rishabh-CephManager-in-CephFSTestCase description: fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/xfstests-dev} email: null first_in_suite: false job_id: '7327386' kernel: client: sha1: distro flavor: default kdb: true sha1: 84139c18d56f518615369e8310ae4ecf07a36dcd ktype: distro last_in_suite: false log-rotate: ceph-mds: 10G ceph-osd: 10G machine_type: smithi name: rishabh-2023-07-05_18:32:52-fs-wip-rishabh-CephManager-in-CephFSTestCase-testing-default-smithi no_nested_subset: false nuke-on-error: true openstack: - volumes: count: 4 size: 20 - machine: disk: 200 os_type: rhel os_version: '8.6' overrides: admin_socket: branch: wip-rishabh-CephManager-in-CephFSTestCase ceph: conf: client: client mount timeout: 600 debug client: 20 debug ms: 1 pid file: '' rados mon op timeout: 900 rados osd op timeout: 900 global: ms die on skipped message: false mds: debug mds: 20 debug mds balancer: 20 debug ms: 1 mds debug frag: true mds debug scatterstat: true mds op complaint time: 180 mds verify scatter: true osd op complaint time: 180 rados mon op timeout: 900 rados osd op timeout: 900 mgr: debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon op complaint time: 120 osd: bdev async discard: true bdev enable discard: true bluestore allocator: bitmap bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug ms: 1 debug osd: 20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore osd op complaint time: 180 flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - overall HEALTH_ - \(FS_DEGRADED\) - \(MDS_FAILED\) - \(MDS_DEGRADED\) - \(FS_WITH_FAILED_MDS\) - \(MDS_DAMAGE\) - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - \(FS_INLINE_DATA_DEPRECATED\) - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding sha1: 0a781ef0807ae9473fb1306ef07036226ca4f1a6 ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: osd default pool size: 2 osd: bdev async discard: true bdev enable discard: true bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs install: ceph: flavor: default sha1: 0a781ef0807ae9473fb1306ef07036226ca4f1a6 kclient: syntax: v1 selinux: whitelist: - scontext=system_u:system_r:logrotate_t:s0 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: wip-rishabh-CephManager-in-CephFSTestCase sha1: 0a781ef0807ae9473fb1306ef07036226ca4f1a6 owner: scheduled_rishabh@teuthology priority: 80 repo: https://git.ceph.com/ceph-ci.git roles: - - mon.a - mgr.y - mds.a - mds.c - osd.0 - osd.1 - osd.2 - osd.3 - client.0 - client.2 - - mon.b - mon.c - mgr.x - mds.b - mds.d - osd.4 - osd.5 - osd.6 - osd.7 - client.1 - client.3 sha1: 0a781ef0807ae9473fb1306ef07036226ca4f1a6 sleep_before_teardown: 0 suite: fs suite_branch: wip-rishabh-CephManager-in-CephFSTestCase suite_path: /home/teuthworker/src/git.ceph.com_ceph-c_0a781ef0807ae9473fb1306ef07036226ca4f1a6/qa suite_relpath: qa suite_repo: https://git.ceph.com/ceph-ci.git suite_sha1: 0a781ef0807ae9473fb1306ef07036226ca4f1a6 syslog: ignorelist: - WARNING*.*check_session_state - WARNING*.*__ceph_remove_cap targets: smithi046.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCpUxo5ay/ucdkX9rleNMm8Ofp24XRXUtJPOK3Ji3XBpTiUgmmwneaY6316+3CG+k4K0p3IebanuyTvZApjm02/dNCvu8yD3rjEpWVgIuqYH8O3lEdN9DXcCX+7xHJE0m18+ZPsJQVsNrNJxY+5zqyNnBc8jpZq2LStsWwPOKPWhauANRkOBFSGDoLppWZbLx/yJs+R0qoNLLK9LpKQTUnqsapXvbD27OpPahzj/qbNxFPPyY6XrrldZ6qEO+EjJOujFLH3gzv0kJu10DCuzxrpz6ston4RPi1O3GgcHnF4Mqr/W9VwZ94UTMh+k4dIFRVqJEKrcwRHa5kFsvH/WhVx0Ygr/MiV/Q86mmV7JT+/MpzIRTtWyei5L9IBeZIE9cwzj+mOk6SD/t1roIVEGVV/uF2AyFDVBPr6F8oZ822OGpUyyaDsWTitPNdTX4TC3zdSrLc9tyDa1P74eH/ZLeTSf+C6pM/cepOhQaa6XzpDiPSuJUm9HOQxUlEAvcqa7Ac= smithi073.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCpUxo5ay/ucdkX9rleNMm8Ofp24XRXUtJPOK3Ji3XBpTiUgmmwneaY6316+3CG+k4K0p3IebanuyTvZApjm02/dNCvu8yD3rjEpWVgIuqYH8O3lEdN9DXcCX+7xHJE0m18+ZPsJQVsNrNJxY+5zqyNnBc8jpZq2LStsWwPOKPWhauANRkOBFSGDoLppWZbLx/yJs+R0qoNLLK9LpKQTUnqsapXvbD27OpPahzj/qbNxFPPyY6XrrldZ6qEO+EjJOujFLH3gzv0kJu10DCuzxrpz6ston4RPi1O3GgcHnF4Mqr/W9VwZ94UTMh+k4dIFRVqJEKrcwRHa5kFsvH/WhVx0Ygr/MiV/Q86mmV7JT+/MpzIRTtWyei5L9IBeZIE9cwzj+mOk6SD/t1roIVEGVV/uF2AyFDVBPr6F8oZ822OGpUyyaDsWTitPNdTX4TC3zdSrLc9tyDa1P74eH/ZLeTSf+C6pM/cepOhQaa6XzpDiPSuJUm9HOQxUlEAvcqa7Ac= tasks: - install: extra_packages: deb: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror rpm: - python3-cephfs - cephfs-top - cephfs-mirror extra_system_packages: deb: - bison - flex - libelf-dev - libssl-dev - network-manager - iproute2 - util-linux - dump - indent - libaio-dev - libtool-bin - uuid-dev - xfslibs-dev - postgresql - postgresql-client - postgresql-common - postgresql-contrib rpm: - bison - flex - elfutils-libelf-devel - openssl-devel - NetworkManager - iproute - util-linux - libacl-devel - libaio-devel - libattr-devel - libtool - libuuid-devel - xfsdump - xfsprogs - xfsprogs-devel - libaio-devel - libtool - libuuid-devel - xfsprogs-devel - postgresql - postgresql-server - postgresql-contrib - ceph: null - kclient: null - cephfs_test_runner: fail_on_skip: false modules: - tasks.cephfs.tests_from_xfstests_dev teuthology: fragments_dropped: [] meta: {} postmerge: - local function is_kupstream() return yaml.ktype == 'upstream' end - local function is_kdistro() return yaml.ktype == 'distro' end - local function is_fuse() return false end - local function syntax_version() return yaml.overrides.kclient.syntax end teuthology_branch: main teuthology_sha1: b53f236c1077f1d295baafb9e0ca9a4b447019d7 timestamp: 2023-07-05_18:32:52 tube: smithi user: rishabh verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.23459 2023-07-05T18:44:05.630 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/git.ceph.com_ceph-c_0a781ef0807ae9473fb1306ef07036226ca4f1a6/qa; will attempt to use it 2023-07-05T18:44:05.631 INFO:teuthology.run:Found tasks at /home/teuthworker/src/git.ceph.com_ceph-c_0a781ef0807ae9473fb1306ef07036226ca4f1a6/qa/tasks 2023-07-05T18:44:05.631 INFO:teuthology.run_tasks:Running task internal.check_packages... 2023-07-05T18:44:05.633 INFO:teuthology.task.internal:Checking packages... 2023-07-05T18:44:05.662 INFO:teuthology.task.internal:Checking packages for os_type 'rhel', flavor 'default' and ceph hash '0a781ef0807ae9473fb1306ef07036226ca4f1a6' 2023-07-05T18:44:05.663 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2023-07-05T18:44:05.663 INFO:teuthology.packaging:ref: None 2023-07-05T18:44:05.663 INFO:teuthology.packaging:tag: None 2023-07-05T18:44:05.664 INFO:teuthology.packaging:branch: wip-rishabh-CephManager-in-CephFSTestCase 2023-07-05T18:44:05.664 INFO:teuthology.packaging:sha1: 0a781ef0807ae9473fb1306ef07036226ca4f1a6 2023-07-05T18:44:05.664 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&ref=wip-rishabh-CephManager-in-CephFSTestCase 2023-07-05T18:44:06.048 INFO:teuthology.task.internal:Found packages for ceph version 18.0.0-4488.g0a781ef0 2023-07-05T18:44:06.048 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2023-07-05T18:44:06.054 INFO:teuthology.task.internal:no buildpackages task found 2023-07-05T18:44:06.055 INFO:teuthology.run_tasks:Running task internal.save_config... 2023-07-05T18:44:06.096 INFO:teuthology.task.internal:Saving configuration 2023-07-05T18:44:06.112 INFO:teuthology.run_tasks:Running task internal.check_lock... 2023-07-05T18:44:06.127 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-07-05T18:44:06.152 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi046.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/rishabh-2023-07-05_18:32:52-fs-wip-rishabh-CephManager-in-CephFSTestCase-testing-default-smithi/7327386', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-07-05 18:34:17.702604', 'locked_by': 'scheduled_rishabh@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLVvN3+LmzPZ4ixiwyCkS3KZLZ9R6MOPm+kPtaJbl8fExpzbk8TudXCcJWHBL7DGPWFvye2jT6sei9eiX0EUQYs='} 2023-07-05T18:44:06.176 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi073.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/rishabh-2023-07-05_18:32:52-fs-wip-rishabh-CephManager-in-CephFSTestCase-testing-default-smithi/7327386', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-07-05 18:34:17.704380', 'locked_by': 'scheduled_rishabh@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLVvN3+LmzPZ4ixiwyCkS3KZLZ9R6MOPm+kPtaJbl8fExpzbk8TudXCcJWHBL7DGPWFvye2jT6sei9eiX0EUQYs='} 2023-07-05T18:44:06.177 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2023-07-05T18:44:06.182 INFO:teuthology.task.internal:roles: ubuntu@smithi046.front.sepia.ceph.com - ['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'client.2'] 2023-07-05T18:44:06.183 INFO:teuthology.task.internal:roles: ubuntu@smithi073.front.sepia.ceph.com - ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'client.3'] 2023-07-05T18:44:06.183 INFO:teuthology.run_tasks:Running task console_log... 2023-07-05T18:44:06.281 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7fafe1068280>, signals=[15]) 2023-07-05T18:44:06.282 INFO:teuthology.run_tasks:Running task internal.connect... 2023-07-05T18:44:06.289 INFO:teuthology.task.internal:Opening connections... 2023-07-05T18:44:06.289 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi046.front.sepia.ceph.com 2023-07-05T18:44:06.291 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi046.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-05T18:44:06.360 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi073.front.sepia.ceph.com 2023-07-05T18:44:06.361 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi073.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-05T18:44:06.427 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2023-07-05T18:44:06.433 DEBUG:teuthology.orchestra.run.smithi046:> uname -m 2023-07-05T18:44:06.454 INFO:teuthology.orchestra.run.smithi046.stdout:x86_64 2023-07-05T18:44:06.454 DEBUG:teuthology.orchestra.run.smithi046:> cat /etc/os-release 2023-07-05T18:44:06.513 INFO:teuthology.orchestra.run.smithi046.stdout:NAME="Red Hat Enterprise Linux" 2023-07-05T18:44:06.513 INFO:teuthology.orchestra.run.smithi046.stdout:VERSION="8.6 (Ootpa)" 2023-07-05T18:44:06.513 INFO:teuthology.orchestra.run.smithi046.stdout:ID="rhel" 2023-07-05T18:44:06.513 INFO:teuthology.orchestra.run.smithi046.stdout:ID_LIKE="fedora" 2023-07-05T18:44:06.513 INFO:teuthology.orchestra.run.smithi046.stdout:VERSION_ID="8.6" 2023-07-05T18:44:06.514 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM_ID="platform:el8" 2023-07-05T18:44:06.514 INFO:teuthology.orchestra.run.smithi046.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-07-05T18:44:06.514 INFO:teuthology.orchestra.run.smithi046.stdout:ANSI_COLOR="0;31" 2023-07-05T18:44:06.514 INFO:teuthology.orchestra.run.smithi046.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-07-05T18:44:06.514 INFO:teuthology.orchestra.run.smithi046.stdout:HOME_URL="https://www.redhat.com/" 2023-07-05T18:44:06.514 INFO:teuthology.orchestra.run.smithi046.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-07-05T18:44:06.514 INFO:teuthology.orchestra.run.smithi046.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-07-05T18:44:06.514 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T18:44:06.515 INFO:teuthology.orchestra.run.smithi046.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-07-05T18:44:06.515 INFO:teuthology.orchestra.run.smithi046.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-07-05T18:44:06.515 INFO:teuthology.orchestra.run.smithi046.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-07-05T18:44:06.515 INFO:teuthology.orchestra.run.smithi046.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-07-05T18:44:06.516 INFO:teuthology.lock.ops:Updating smithi046.front.sepia.ceph.com on lock server 2023-07-05T18:44:06.540 DEBUG:teuthology.orchestra.run.smithi073:> uname -m 2023-07-05T18:44:06.559 INFO:teuthology.orchestra.run.smithi073.stdout:x86_64 2023-07-05T18:44:06.560 DEBUG:teuthology.orchestra.run.smithi073:> cat /etc/os-release 2023-07-05T18:44:06.617 INFO:teuthology.orchestra.run.smithi073.stdout:NAME="Red Hat Enterprise Linux" 2023-07-05T18:44:06.618 INFO:teuthology.orchestra.run.smithi073.stdout:VERSION="8.6 (Ootpa)" 2023-07-05T18:44:06.618 INFO:teuthology.orchestra.run.smithi073.stdout:ID="rhel" 2023-07-05T18:44:06.618 INFO:teuthology.orchestra.run.smithi073.stdout:ID_LIKE="fedora" 2023-07-05T18:44:06.618 INFO:teuthology.orchestra.run.smithi073.stdout:VERSION_ID="8.6" 2023-07-05T18:44:06.618 INFO:teuthology.orchestra.run.smithi073.stdout:PLATFORM_ID="platform:el8" 2023-07-05T18:44:06.618 INFO:teuthology.orchestra.run.smithi073.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-07-05T18:44:06.619 INFO:teuthology.orchestra.run.smithi073.stdout:ANSI_COLOR="0;31" 2023-07-05T18:44:06.619 INFO:teuthology.orchestra.run.smithi073.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-07-05T18:44:06.619 INFO:teuthology.orchestra.run.smithi073.stdout:HOME_URL="https://www.redhat.com/" 2023-07-05T18:44:06.619 INFO:teuthology.orchestra.run.smithi073.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-07-05T18:44:06.619 INFO:teuthology.orchestra.run.smithi073.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-07-05T18:44:06.619 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-07-05T18:44:06.619 INFO:teuthology.orchestra.run.smithi073.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-07-05T18:44:06.619 INFO:teuthology.orchestra.run.smithi073.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-07-05T18:44:06.620 INFO:teuthology.orchestra.run.smithi073.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-07-05T18:44:06.620 INFO:teuthology.orchestra.run.smithi073.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-07-05T18:44:06.620 INFO:teuthology.lock.ops:Updating smithi073.front.sepia.ceph.com on lock server 2023-07-05T18:44:06.640 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2023-07-05T18:44:06.649 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2023-07-05T18:44:06.686 INFO:teuthology.task.internal:Checking for old test directory... 2023-07-05T18:44:06.686 DEBUG:teuthology.orchestra.run.smithi046:> test '!' -e /home/ubuntu/cephtest 2023-07-05T18:44:06.689 DEBUG:teuthology.orchestra.run.smithi073:> test '!' -e /home/ubuntu/cephtest 2023-07-05T18:44:06.706 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2023-07-05T18:44:06.719 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2023-07-05T18:44:06.719 DEBUG:teuthology.orchestra.run.smithi046:> test -z $(ls -A /var/lib/ceph) 2023-07-05T18:44:06.748 DEBUG:teuthology.orchestra.run.smithi073:> test -z $(ls -A /var/lib/ceph) 2023-07-05T18:44:06.775 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2023-07-05T18:44:06.835 INFO:teuthology.run_tasks:Running task kernel... 2023-07-05T18:44:06.850 INFO:teuthology.task.kernel:normalize config orig: {'client': {'sha1': 'distro'}, 'flavor': 'default', 'kdb': True, 'sha1': '84139c18d56f518615369e8310ae4ecf07a36dcd'} 2023-07-05T18:44:06.851 INFO:teuthology.task.kernel:normalize config final: {'client.0': {'sha1': 'distro'}, 'client.2': {'sha1': 'distro'}, 'client.1': {'sha1': 'distro'}, 'client.3': {'sha1': 'distro'}} 2023-07-05T18:44:06.851 INFO:teuthology.task.kernel:config {'client.0': {'sha1': 'distro'}, 'client.1': {'sha1': 'distro'}}, timeout 300 2023-07-05T18:44:06.851 DEBUG:teuthology.orchestra.run.smithi046:> test -f /run/.containerenv -o -f /.dockerenv 2023-07-05T18:44:06.852 DEBUG:teuthology.orchestra.run.smithi073:> test -f /run/.containerenv -o -f /.dockerenv 2023-07-05T18:44:06.870 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-07-05T18:44:06.870 DEBUG:teuthology.orchestra.run.smithi073:> uname -r 2023-07-05T18:44:06.871 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-07-05T18:44:06.872 DEBUG:teuthology.orchestra.run.smithi046:> uname -r 2023-07-05T18:44:06.928 INFO:teuthology.orchestra.run.smithi073.stdout:4.18.0-372.9.1.el8.x86_64 2023-07-05T18:44:06.928 INFO:teuthology.task.kernel:Running kernel on smithi073: 4.18.0-372.9.1.el8.x86_64 2023-07-05T18:44:06.929 DEBUG:teuthology.orchestra.run.smithi073:> sudo yum install -y kernel 2023-07-05T18:44:06.931 INFO:teuthology.orchestra.run.smithi046.stdout:4.18.0-372.9.1.el8.x86_64 2023-07-05T18:44:06.931 INFO:teuthology.task.kernel:Running kernel on smithi046: 4.18.0-372.9.1.el8.x86_64 2023-07-05T18:44:06.932 DEBUG:teuthology.orchestra.run.smithi046:> sudo yum install -y kernel 2023-07-05T18:44:08.164 INFO:teuthology.orchestra.run.smithi046.stdout:Updating Subscription Management repositories. 2023-07-05T18:44:08.164 INFO:teuthology.orchestra.run.smithi046.stdout:Unable to read consumer identity 2023-07-05T18:44:08.184 INFO:teuthology.orchestra.run.smithi073.stdout:Updating Subscription Management repositories. 2023-07-05T18:44:08.184 INFO:teuthology.orchestra.run.smithi073.stdout:Unable to read consumer identity 2023-07-05T18:44:12.027 INFO:teuthology.orchestra.run.smithi046.stdout:Copr repo for python3-asyncssh owned by ceph 1.3 kB/s | 3.5 kB 00:02 2023-07-05T18:44:12.058 INFO:teuthology.orchestra.run.smithi073.stdout:Copr repo for python3-asyncssh owned by ceph 1.3 kB/s | 3.5 kB 00:02 2023-07-05T18:44:14.853 INFO:teuthology.orchestra.run.smithi046.stdout:Extra Packages for Enterprise Linux 5.6 MB/s | 16 MB 00:02 2023-07-05T18:44:14.933 INFO:teuthology.orchestra.run.smithi073.stdout:Extra Packages for Enterprise Linux 5.5 MB/s | 16 MB 00:02 2023-07-05T18:44:18.458 INFO:teuthology.orchestra.run.smithi073.stdout:lab-extras 201 kB/s | 24 kB 00:00 2023-07-05T18:44:18.461 INFO:teuthology.orchestra.run.smithi046.stdout:lab-extras 457 kB/s | 24 kB 00:00 2023-07-05T18:44:19.161 INFO:teuthology.orchestra.run.smithi073.stdout:Package kernel-4.18.0-372.9.1.el8.x86_64 is already installed. 2023-07-05T18:44:19.172 INFO:teuthology.orchestra.run.smithi046.stdout:Package kernel-4.18.0-372.9.1.el8.x86_64 is already installed. 2023-07-05T18:44:19.217 INFO:teuthology.orchestra.run.smithi046.stdout:Dependencies resolved. 2023-07-05T18:44:19.218 INFO:teuthology.orchestra.run.smithi046.stdout:Nothing to do. 2023-07-05T18:44:19.218 INFO:teuthology.orchestra.run.smithi046.stdout:Complete! 2023-07-05T18:44:19.219 INFO:teuthology.orchestra.run.smithi073.stdout:Dependencies resolved. 2023-07-05T18:44:19.220 INFO:teuthology.orchestra.run.smithi073.stdout:Nothing to do. 2023-07-05T18:44:19.220 INFO:teuthology.orchestra.run.smithi073.stdout:Complete! 2023-07-05T18:44:19.338 DEBUG:teuthology.orchestra.run.smithi046:> echo no | sudo yum reinstall kernel || true 2023-07-05T18:44:19.341 DEBUG:teuthology.orchestra.run.smithi073:> echo no | sudo yum reinstall kernel || true 2023-07-05T18:44:19.710 INFO:teuthology.orchestra.run.smithi073.stdout:Updating Subscription Management repositories. 2023-07-05T18:44:19.711 INFO:teuthology.orchestra.run.smithi073.stdout:Unable to read consumer identity 2023-07-05T18:44:19.727 INFO:teuthology.orchestra.run.smithi046.stdout:Updating Subscription Management repositories. 2023-07-05T18:44:19.727 INFO:teuthology.orchestra.run.smithi046.stdout:Unable to read consumer identity 2023-07-05T18:44:19.965 INFO:teuthology.orchestra.run.smithi073.stdout:Last metadata expiration check: 0:00:01 ago on Wed 05 Jul 2023 06:44:18 PM UTC. 2023-07-05T18:44:19.996 INFO:teuthology.orchestra.run.smithi046.stdout:Last metadata expiration check: 0:00:01 ago on Wed 05 Jul 2023 06:44:18 PM UTC. 2023-07-05T18:44:20.008 INFO:teuthology.orchestra.run.smithi073.stdout:Installed package kernel-4.18.0-372.9.1.el8.x86_64 (from anaconda) not available. 2023-07-05T18:44:20.038 INFO:teuthology.orchestra.run.smithi046.stdout:Installed package kernel-4.18.0-372.9.1.el8.x86_64 (from anaconda) not available. 2023-07-05T18:44:20.054 INFO:teuthology.orchestra.run.smithi073.stderr:Error: No packages marked for reinstall. 2023-07-05T18:44:20.080 INFO:teuthology.orchestra.run.smithi046.stderr:Error: No packages marked for reinstall. 2023-07-05T18:44:20.099 DEBUG:teuthology.orchestra.run.smithi073:> sudo yum reinstall -y kernel || true 2023-07-05T18:44:20.128 DEBUG:teuthology.orchestra.run.smithi046:> sudo yum reinstall -y kernel || true 2023-07-05T18:44:20.427 INFO:teuthology.orchestra.run.smithi073.stdout:Updating Subscription Management repositories. 2023-07-05T18:44:20.427 INFO:teuthology.orchestra.run.smithi073.stdout:Unable to read consumer identity 2023-07-05T18:44:20.477 INFO:teuthology.orchestra.run.smithi046.stdout:Updating Subscription Management repositories. 2023-07-05T18:44:20.477 INFO:teuthology.orchestra.run.smithi046.stdout:Unable to read consumer identity 2023-07-05T18:44:20.676 INFO:teuthology.orchestra.run.smithi073.stdout:Last metadata expiration check: 0:00:02 ago on Wed 05 Jul 2023 06:44:18 PM UTC. 2023-07-05T18:44:20.718 INFO:teuthology.orchestra.run.smithi073.stdout:Installed package kernel-4.18.0-372.9.1.el8.x86_64 (from anaconda) not available. 2023-07-05T18:44:20.739 INFO:teuthology.orchestra.run.smithi046.stdout:Last metadata expiration check: 0:00:02 ago on Wed 05 Jul 2023 06:44:18 PM UTC. 2023-07-05T18:44:20.744 INFO:teuthology.orchestra.run.smithi073.stderr:Error: No packages marked for reinstall. 2023-07-05T18:44:20.782 INFO:teuthology.orchestra.run.smithi046.stdout:Installed package kernel-4.18.0-372.9.1.el8.x86_64 (from anaconda) not available. 2023-07-05T18:44:20.790 DEBUG:teuthology.orchestra.run.smithi073:> rpm -q kernel | sort -rV | head -n 1 2023-07-05T18:44:20.808 INFO:teuthology.orchestra.run.smithi046.stderr:Error: No packages marked for reinstall. 2023-07-05T18:44:20.855 DEBUG:teuthology.orchestra.run.smithi046:> rpm -q kernel | sort -rV | head -n 1 2023-07-05T18:44:20.870 INFO:teuthology.orchestra.run.smithi073.stdout:kernel-4.18.0-372.9.1.el8.x86_64 2023-07-05T18:44:20.870 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 4.18.0-372.9.1.el8.x86_64 2023-07-05T18:44:20.870 INFO:teuthology.task.kernel:Newest distro kernel installed and running 2023-07-05T18:44:20.870 DEBUG:teuthology.parallel:result is None 2023-07-05T18:44:20.937 INFO:teuthology.orchestra.run.smithi046.stdout:kernel-4.18.0-372.9.1.el8.x86_64 2023-07-05T18:44:20.937 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 4.18.0-372.9.1.el8.x86_64 2023-07-05T18:44:20.938 INFO:teuthology.task.kernel:Newest distro kernel installed and running 2023-07-05T18:44:20.938 DEBUG:teuthology.parallel:result is None 2023-07-05T18:44:20.938 INFO:teuthology.run_tasks:Running task internal.base... 2023-07-05T18:44:20.950 INFO:teuthology.task.internal:Creating test directory... 2023-07-05T18:44:20.950 DEBUG:teuthology.orchestra.run.smithi046:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2023-07-05T18:44:20.952 DEBUG:teuthology.orchestra.run.smithi073:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2023-07-05T18:44:20.968 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2023-07-05T18:44:20.976 INFO:teuthology.run_tasks:Running task internal.archive... 2023-07-05T18:44:21.009 INFO:teuthology.task.internal:Creating archive directory... 2023-07-05T18:44:21.010 DEBUG:teuthology.orchestra.run.smithi046:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2023-07-05T18:44:21.011 DEBUG:teuthology.orchestra.run.smithi073:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2023-07-05T18:44:21.037 INFO:teuthology.run_tasks:Running task internal.coredump... 2023-07-05T18:44:21.043 INFO:teuthology.task.internal:Enabling coredump saving... 2023-07-05T18:44:21.043 DEBUG:teuthology.orchestra.run.smithi046:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2023-07-05T18:44:21.075 DEBUG:teuthology.orchestra.run.smithi073:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2023-07-05T18:44:21.109 INFO:teuthology.orchestra.run.smithi073.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-07-05T18:44:21.114 INFO:teuthology.orchestra.run.smithi046.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-07-05T18:44:21.120 INFO:teuthology.orchestra.run.smithi073.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-07-05T18:44:21.125 INFO:teuthology.orchestra.run.smithi046.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-07-05T18:44:21.126 INFO:teuthology.run_tasks:Running task internal.sudo... 2023-07-05T18:44:21.133 INFO:teuthology.task.internal:Configuring sudo... 2023-07-05T18:44:21.133 DEBUG:teuthology.orchestra.run.smithi046:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2023-07-05T18:44:21.169 DEBUG:teuthology.orchestra.run.smithi073:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2023-07-05T18:44:21.195 INFO:teuthology.run_tasks:Running task internal.syslog... 2023-07-05T18:44:21.203 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2023-07-05T18:44:21.204 DEBUG:teuthology.orchestra.run.smithi046:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2023-07-05T18:44:21.235 DEBUG:teuthology.orchestra.run.smithi073:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2023-07-05T18:44:21.251 DEBUG:teuthology.orchestra.run.smithi046:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2023-07-05T18:44:21.341 DEBUG:teuthology.orchestra.run.smithi046:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2023-07-05T18:44:21.382 DEBUG:teuthology.orchestra.run.smithi046:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2023-07-05T18:44:21.467 DEBUG:teuthology.orchestra.run.smithi046:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2023-07-05T18:44:21.507 DEBUG:teuthology.orchestra.run.smithi046:> set -ex 2023-07-05T18:44:21.508 DEBUG:teuthology.orchestra.run.smithi046:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2023-07-05T18:44:21.575 DEBUG:teuthology.orchestra.run.smithi073:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2023-07-05T18:44:21.621 DEBUG:teuthology.orchestra.run.smithi073:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2023-07-05T18:44:21.673 DEBUG:teuthology.orchestra.run.smithi073:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2023-07-05T18:44:21.761 DEBUG:teuthology.orchestra.run.smithi073:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2023-07-05T18:44:21.798 DEBUG:teuthology.orchestra.run.smithi073:> set -ex 2023-07-05T18:44:21.799 DEBUG:teuthology.orchestra.run.smithi073:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2023-07-05T18:44:21.865 DEBUG:teuthology.orchestra.run.smithi046:> sudo service rsyslog restart 2023-07-05T18:44:21.867 DEBUG:teuthology.orchestra.run.smithi073:> sudo service rsyslog restart 2023-07-05T18:44:21.918 INFO:teuthology.orchestra.run.smithi046.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-07-05T18:44:21.969 INFO:teuthology.orchestra.run.smithi073.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-07-05T18:44:22.406 INFO:teuthology.run_tasks:Running task internal.timer... 2023-07-05T18:44:22.414 INFO:teuthology.task.internal:Starting timer... 2023-07-05T18:44:22.414 INFO:teuthology.run_tasks:Running task pcp... 2023-07-05T18:44:22.483 INFO:teuthology.run_tasks:Running task selinux... 2023-07-05T18:44:22.512 DEBUG:teuthology.task:Applying overrides for task selinux: {'whitelist': ['scontext=system_u:system_r:logrotate_t:s0']} 2023-07-05T18:44:22.513 DEBUG:teuthology.orchestra.run.smithi046:> sudo service auditd rotate 2023-07-05T18:44:22.568 INFO:teuthology.orchestra.run.smithi046.stdout:Rotating logs: 2023-07-05T18:44:22.569 DEBUG:teuthology.orchestra.run.smithi073:> sudo service auditd rotate 2023-07-05T18:44:22.631 INFO:teuthology.orchestra.run.smithi073.stdout:Rotating logs: 2023-07-05T18:44:22.632 DEBUG:teuthology.task.selinux:Getting current SELinux state 2023-07-05T18:44:22.633 DEBUG:teuthology.orchestra.run.smithi046:> /usr/sbin/getenforce 2023-07-05T18:44:22.662 INFO:teuthology.orchestra.run.smithi046.stdout:Permissive 2023-07-05T18:44:22.662 DEBUG:teuthology.orchestra.run.smithi073:> /usr/sbin/getenforce 2023-07-05T18:44:22.682 INFO:teuthology.orchestra.run.smithi073.stdout:Permissive 2023-07-05T18:44:22.683 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi046.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi073.front.sepia.ceph.com': 'permissive'} 2023-07-05T18:44:22.683 DEBUG:teuthology.orchestra.run.smithi046:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-07-05T18:44:22.730 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-07-05T18:44:22.730 DEBUG:teuthology.orchestra.run.smithi073:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-07-05T18:44:22.758 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-07-05T18:44:22.758 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2023-07-05T18:44:22.758 DEBUG:teuthology.orchestra.run.smithi046:> sudo /usr/sbin/setenforce permissive 2023-07-05T18:44:22.798 DEBUG:teuthology.orchestra.run.smithi073:> sudo /usr/sbin/setenforce permissive 2023-07-05T18:44:22.824 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2023-07-05T18:44:22.834 INFO:teuthology.repo_utils:/home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main was just updated or references a specific commit; assuming it is current 2023-07-05T18:44:22.834 INFO:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2023-07-05T18:44:22.853 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2023-07-05T18:44:22.855 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi046.front.sepia.ceph.com,smithi073.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2023-07-05T18:52:57.072 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi046.front.sepia.ceph.com'), Remote(name='ubuntu@smithi073.front.sepia.ceph.com')] 2023-07-05T18:52:57.073 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi046.front.sepia.ceph.com' 2023-07-05T18:52:57.074 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi046.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-05T18:52:57.143 DEBUG:teuthology.orchestra.run.smithi046:> true 2023-07-05T18:52:57.215 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi046.front.sepia.ceph.com' 2023-07-05T18:52:57.215 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi073.front.sepia.ceph.com' 2023-07-05T18:52:57.216 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi073.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-05T18:52:57.285 DEBUG:teuthology.orchestra.run.smithi073:> true 2023-07-05T18:52:57.354 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi073.front.sepia.ceph.com' 2023-07-05T18:52:57.354 INFO:teuthology.run_tasks:Running task clock... 2023-07-05T18:52:57.364 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2023-07-05T18:52:57.365 INFO:teuthology.orchestra.run:Running command with timeout 360 2023-07-05T18:52:57.365 DEBUG:teuthology.orchestra.run.smithi046:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-07-05T18:52:57.369 INFO:teuthology.orchestra.run:Running command with timeout 360 2023-07-05T18:52:57.370 DEBUG:teuthology.orchestra.run.smithi073:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-07-05T18:52:57.403 INFO:teuthology.orchestra.run.smithi046.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2023-07-05T18:52:57.419 INFO:teuthology.orchestra.run.smithi046.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2023-07-05T18:52:57.426 INFO:teuthology.orchestra.run.smithi073.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2023-07-05T18:52:57.440 INFO:teuthology.orchestra.run.smithi073.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2023-07-05T18:52:57.491 INFO:teuthology.orchestra.run.smithi046.stderr:sudo: ntpd: command not found 2023-07-05T18:52:57.503 INFO:teuthology.orchestra.run.smithi046.stdout:506 Cannot talk to daemon 2023-07-05T18:52:57.508 INFO:teuthology.orchestra.run.smithi073.stderr:sudo: ntpd: command not found 2023-07-05T18:52:57.519 INFO:teuthology.orchestra.run.smithi073.stdout:506 Cannot talk to daemon 2023-07-05T18:52:57.520 INFO:teuthology.orchestra.run.smithi046.stderr:Failed to start ntp.service: Unit ntp.service not found. 2023-07-05T18:52:57.533 INFO:teuthology.orchestra.run.smithi073.stderr:Failed to start ntp.service: Unit ntp.service not found. 2023-07-05T18:52:57.535 INFO:teuthology.orchestra.run.smithi046.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2023-07-05T18:52:57.546 INFO:teuthology.orchestra.run.smithi073.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2023-07-05T18:52:57.609 INFO:teuthology.orchestra.run.smithi073.stderr:bash: ntpq: command not found 2023-07-05T18:52:57.610 INFO:teuthology.orchestra.run.smithi046.stderr:bash: ntpq: command not found 2023-07-05T18:52:57.617 INFO:teuthology.orchestra.run.smithi046.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-07-05T18:52:57.617 INFO:teuthology.orchestra.run.smithi046.stdout:=============================================================================== 2023-07-05T18:52:57.617 INFO:teuthology.orchestra.run.smithi046.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-07-05T18:52:57.617 INFO:teuthology.orchestra.run.smithi046.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-07-05T18:52:57.618 INFO:teuthology.orchestra.run.smithi046.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-07-05T18:52:57.618 INFO:teuthology.orchestra.run.smithi046.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-07-05T18:52:57.618 INFO:teuthology.orchestra.run.smithi073.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-07-05T18:52:57.618 INFO:teuthology.orchestra.run.smithi073.stdout:=============================================================================== 2023-07-05T18:52:57.619 INFO:teuthology.orchestra.run.smithi073.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-07-05T18:52:57.619 INFO:teuthology.orchestra.run.smithi073.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-07-05T18:52:57.619 INFO:teuthology.orchestra.run.smithi073.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-07-05T18:52:57.619 INFO:teuthology.orchestra.run.smithi073.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-07-05T18:52:57.619 INFO:teuthology.run_tasks:Running task install... 2023-07-05T18:52:57.630 DEBUG:teuthology.task.install:project ceph 2023-07-05T18:52:57.631 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': '0a781ef0807ae9473fb1306ef07036226ca4f1a6'}} 2023-07-05T18:52:57.631 DEBUG:teuthology.task.install:config {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': '0a781ef0807ae9473fb1306ef07036226ca4f1a6'} 2023-07-05T18:52:57.631 INFO:teuthology.task.install:Using flavor: default 2023-07-05T18:52:57.639 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2023-07-05T18:52:57.640 INFO:teuthology.task.install:extra packages: {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']} 2023-07-05T18:52:57.640 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '0a781ef0807ae9473fb1306ef07036226ca4f1a6', 'tag': None, 'wait_for_package': False} 2023-07-05T18:52:57.641 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=0a781ef0807ae9473fb1306ef07036226ca4f1a6 2023-07-05T18:52:57.643 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '0a781ef0807ae9473fb1306ef07036226ca4f1a6', 'tag': None, 'wait_for_package': False} 2023-07-05T18:52:57.643 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=0a781ef0807ae9473fb1306ef07036226ca4f1a6 2023-07-05T18:52:57.788 INFO:teuthology.task.install.rpm:Pulling from https://4.chacra.ceph.com/r/ceph/wip-rishabh-CephManager-in-CephFSTestCase/0a781ef0807ae9473fb1306ef07036226ca4f1a6/centos/8/flavors/default/ 2023-07-05T18:52:57.788 INFO:teuthology.task.install.rpm:Package version is 18.0.0-4488.g0a781ef0 2023-07-05T18:52:57.868 INFO:teuthology.task.install.rpm:Pulling from https://4.chacra.ceph.com/r/ceph/wip-rishabh-CephManager-in-CephFSTestCase/0a781ef0807ae9473fb1306ef07036226ca4f1a6/centos/8/flavors/default/ 2023-07-05T18:52:57.868 INFO:teuthology.task.install.rpm:Package version is 18.0.0-4488.g0a781ef0 2023-07-05T18:52:57.984 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://4.chacra.ceph.com/r/ceph/wip-rishabh-CephManager-in-CephFSTestCase/0a781ef0807ae9473fb1306ef07036226ca4f1a6/centos/8/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://4.chacra.ceph.com/r/ceph/wip-rishabh-CephManager-in-CephFSTestCase/0a781ef0807ae9473fb1306ef07036226ca4f1a6/centos/8/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://4.chacra.ceph.com/r/ceph/wip-rishabh-CephManager-in-CephFSTestCase/0a781ef0807ae9473fb1306ef07036226ca4f1a6/centos/8/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2023-07-05T18:52:57.985 DEBUG:teuthology.orchestra.run.smithi046:> set -ex 2023-07-05T18:52:57.985 DEBUG:teuthology.orchestra.run.smithi046:> sudo dd of=/etc/yum.repos.d/ceph.repo 2023-07-05T18:52:58.016 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2023-07-05T18:52:58.017 DEBUG:teuthology.orchestra.run.smithi046:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/0a781ef0807ae9473fb1306ef07036226ca4f1a6/;g' /etc/yum.repos.d/ceph.repo ; fi 2023-07-05T18:52:58.051 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://4.chacra.ceph.com/r/ceph/wip-rishabh-CephManager-in-CephFSTestCase/0a781ef0807ae9473fb1306ef07036226ca4f1a6/centos/8/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://4.chacra.ceph.com/r/ceph/wip-rishabh-CephManager-in-CephFSTestCase/0a781ef0807ae9473fb1306ef07036226ca4f1a6/centos/8/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://4.chacra.ceph.com/r/ceph/wip-rishabh-CephManager-in-CephFSTestCase/0a781ef0807ae9473fb1306ef07036226ca4f1a6/centos/8/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2023-07-05T18:52:58.051 DEBUG:teuthology.orchestra.run.smithi073:> set -ex 2023-07-05T18:52:58.052 DEBUG:teuthology.orchestra.run.smithi073:> sudo dd of=/etc/yum.repos.d/ceph.repo 2023-07-05T18:52:58.079 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2023-07-05T18:52:58.080 DEBUG:teuthology.orchestra.run.smithi073:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/0a781ef0807ae9473fb1306ef07036226ca4f1a6/;g' /etc/yum.repos.d/ceph.repo ; fi 2023-07-05T18:52:58.088 DEBUG:teuthology.orchestra.run.smithi046:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2023-07-05T18:52:58.148 DEBUG:teuthology.orchestra.run.smithi073:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2023-07-05T18:52:58.170 DEBUG:teuthology.orchestra.run.smithi046:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2023-07-05T18:52:58.225 DEBUG:teuthology.orchestra.run.smithi073:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2023-07-05T18:52:58.238 INFO:teuthology.orchestra.run.smithi046.stdout:check_obsoletes = 1 2023-07-05T18:52:58.240 DEBUG:teuthology.orchestra.run.smithi046:> sudo yum clean all 2023-07-05T18:52:58.293 INFO:teuthology.orchestra.run.smithi073.stdout:check_obsoletes = 1 2023-07-05T18:52:58.294 DEBUG:teuthology.orchestra.run.smithi073:> sudo yum clean all 2023-07-05T18:52:58.633 INFO:teuthology.orchestra.run.smithi046.stdout:Updating Subscription Management repositories. 2023-07-05T18:52:58.665 INFO:teuthology.orchestra.run.smithi073.stdout:Updating Subscription Management repositories. 2023-07-05T18:52:59.083 INFO:teuthology.orchestra.run.smithi073.stdout:44 files removed 2023-07-05T18:52:59.096 INFO:teuthology.orchestra.run.smithi046.stdout:44 files removed 2023-07-05T18:52:59.131 DEBUG:teuthology.orchestra.run.smithi073:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2023-07-05T18:52:59.143 DEBUG:teuthology.orchestra.run.smithi046:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2023-07-05T18:52:59.462 INFO:teuthology.orchestra.run.smithi073.stdout:Updating Subscription Management repositories. 2023-07-05T18:52:59.493 INFO:teuthology.orchestra.run.smithi046.stdout:Updating Subscription Management repositories. 2023-07-05T18:53:00.901 INFO:teuthology.orchestra.run.smithi046.stdout:ceph packages for x86_64 82 kB/s | 81 kB 00:00 2023-07-05T18:53:01.196 INFO:teuthology.orchestra.run.smithi073.stdout:ceph packages for x86_64 62 kB/s | 81 kB 00:01 2023-07-05T18:53:01.319 INFO:teuthology.orchestra.run.smithi046.stdout:ceph noarch packages 25 kB/s | 9.4 kB 00:00 2023-07-05T18:53:01.571 INFO:teuthology.orchestra.run.smithi073.stdout:ceph noarch packages 28 kB/s | 9.4 kB 00:00 2023-07-05T18:53:01.686 INFO:teuthology.orchestra.run.smithi046.stdout:ceph source packages 4.3 kB/s | 1.5 kB 00:00 2023-07-05T18:53:01.964 INFO:teuthology.orchestra.run.smithi073.stdout:ceph source packages 4.0 kB/s | 1.5 kB 00:00 2023-07-05T18:53:04.312 INFO:teuthology.orchestra.run.smithi046.stdout:Copr repo for python3-asyncssh owned by ceph 1.3 kB/s | 3.5 kB 00:02 2023-07-05T18:53:04.573 INFO:teuthology.orchestra.run.smithi073.stdout:Copr repo for python3-asyncssh owned by ceph 1.3 kB/s | 3.5 kB 00:02 2023-07-05T18:53:05.448 INFO:teuthology.orchestra.run.smithi046.stdout:Extra Packages for Enterprise Linux 14 MB/s | 16 MB 00:01 2023-07-05T18:53:09.113 INFO:teuthology.orchestra.run.smithi046.stdout:lab-extras 412 kB/s | 24 kB 00:00 2023-07-05T18:53:09.733 INFO:teuthology.orchestra.run.smithi073.stdout:Extra Packages for Enterprise Linux 3.0 MB/s | 16 MB 00:05 2023-07-05T18:53:10.055 INFO:teuthology.orchestra.run.smithi046.stdout:Red Hat Enterprise Linux 8 for x86_64 - BaseOS 61 MB/s | 53 MB 00:00 2023-07-05T18:53:13.181 INFO:teuthology.orchestra.run.smithi073.stdout:lab-extras 223 kB/s | 24 kB 00:00 2023-07-05T18:53:14.099 INFO:teuthology.orchestra.run.smithi073.stdout:Red Hat Enterprise Linux 8 for x86_64 - BaseOS 62 MB/s | 53 MB 00:00 2023-07-05T18:53:18.706 INFO:teuthology.orchestra.run.smithi046.stdout:Red Hat Enterprise Linux 8 for x86_64 - AppStre 56 MB/s | 47 MB 00:00 2023-07-05T18:53:22.142 INFO:teuthology.orchestra.run.smithi073.stdout:Red Hat Enterprise Linux 8 for x86_64 - AppStre 59 MB/s | 47 MB 00:00 2023-07-05T18:53:30.439 INFO:teuthology.orchestra.run.smithi046.stdout:Package librados2-1:12.2.7-9.el8.x86_64 is already installed. 2023-07-05T18:53:30.440 INFO:teuthology.orchestra.run.smithi046.stdout:Package librbd1-1:12.2.7-9.el8.x86_64 is already installed. 2023-07-05T18:53:30.457 INFO:teuthology.orchestra.run.smithi046.stdout:Package NetworkManager-1:1.36.0-4.el8.x86_64 is already installed. 2023-07-05T18:53:30.458 INFO:teuthology.orchestra.run.smithi046.stdout:Package iproute-5.15.0-4.el8.x86_64 is already installed. 2023-07-05T18:53:30.458 INFO:teuthology.orchestra.run.smithi046.stdout:Package util-linux-2.32.1-35.el8.x86_64 is already installed. 2023-07-05T18:53:30.458 INFO:teuthology.orchestra.run.smithi046.stdout:Package libacl-devel-2.2.53-1.el8.x86_64 is already installed. 2023-07-05T18:53:30.464 INFO:teuthology.orchestra.run.smithi046.stdout:Package libattr-devel-2.4.48-3.el8.x86_64 is already installed. 2023-07-05T18:53:30.465 INFO:teuthology.orchestra.run.smithi046.stdout:Package xfsdump-3.1.8-4.el8.x86_64 is already installed. 2023-07-05T18:53:30.465 INFO:teuthology.orchestra.run.smithi046.stdout:Package xfsprogs-5.0.0-10.el8.x86_64 is already installed. 2023-07-05T18:53:30.606 INFO:teuthology.orchestra.run.smithi046.stdout:Dependencies resolved. 2023-07-05T18:53:30.619 INFO:teuthology.orchestra.run.smithi046.stdout:=========================================================================================================================== 2023-07-05T18:53:30.620 INFO:teuthology.orchestra.run.smithi046.stdout: Package Arch Version Repository Size 2023-07-05T18:53:30.620 INFO:teuthology.orchestra.run.smithi046.stdout:=========================================================================================================================== 2023-07-05T18:53:30.620 INFO:teuthology.orchestra.run.smithi046.stdout:Installing: 2023-07-05T18:53:30.620 INFO:teuthology.orchestra.run.smithi046.stdout: NetworkManager-initscripts-updown noarch 1:1.36.0-9.el8_6 rhel-8-for-x86_64-baseos-rpms 138 k 2023-07-05T18:53:30.621 INFO:teuthology.orchestra.run.smithi046.stdout: bison x86_64 3.0.4-10.el8 rhel-8-for-x86_64-appstream-rpms 688 k 2023-07-05T18:53:30.621 INFO:teuthology.orchestra.run.smithi046.stdout: ceph x86_64 2:18.0.0-4488.g0a781ef0.el8 ceph 6.4 k 2023-07-05T18:53:30.621 INFO:teuthology.orchestra.run.smithi046.stdout: ceph-base x86_64 2:18.0.0-4488.g0a781ef0.el8 ceph 5.4 M 2023-07-05T18:53:30.621 INFO:teuthology.orchestra.run.smithi046.stdout: ceph-fuse x86_64 2:18.0.0-4488.g0a781ef0.el8 ceph 848 k 2023-07-05T18:53:30.621 INFO:teuthology.orchestra.run.smithi046.stdout: ceph-immutable-object-cache x86_64 2:18.0.0-4488.g0a781ef0.el8 ceph 165 k 2023-07-05T18:53:30.621 INFO:teuthology.orchestra.run.smithi046.stdout: ceph-mgr x86_64 2:18.0.0-4488.g0a781ef0.el8 ceph 1.5 M 2023-07-05T18:53:30.622 INFO:teuthology.orchestra.run.smithi046.stdout: ceph-mgr-cephadm noarch 2:18.0.0-4488.g0a781ef0.el8 ceph-noarch 128 k 2023-07-05T18:53:30.622 INFO:teuthology.orchestra.run.smithi046.stdout: ceph-mgr-dashboard noarch 2:18.0.0-4488.g0a781ef0.el8 ceph-noarch 1.7 M 2023-07-05T18:53:30.622 INFO:teuthology.orchestra.run.smithi046.stdout: ceph-mgr-diskprediction-local noarch 2:18.0.0-4488.g0a781ef0.el8 ceph-noarch 7.4 M 2023-07-05T18:53:30.622 INFO:teuthology.orchestra.run.smithi046.stdout: ceph-mgr-rook noarch 2:18.0.0-4488.g0a781ef0.el8 ceph-noarch 47 k 2023-07-05T18:53:30.622 INFO:teuthology.orchestra.run.smithi046.stdout: ceph-radosgw x86_64 2:18.0.0-4488.g0a781ef0.el8 ceph 13 M 2023-07-05T18:53:30.622 INFO:teuthology.orchestra.run.smithi046.stdout: ceph-test x86_64 2:18.0.0-4488.g0a781ef0.el8 ceph 48 M 2023-07-05T18:53:30.622 INFO:teuthology.orchestra.run.smithi046.stdout: ceph-volume noarch 2:18.0.0-4488.g0a781ef0.el8 ceph-noarch 258 k 2023-07-05T18:53:30.623 INFO:teuthology.orchestra.run.smithi046.stdout: cephadm noarch 2:18.0.0-4488.g0a781ef0.el8 ceph-noarch 161 k 2023-07-05T18:53:30.623 INFO:teuthology.orchestra.run.smithi046.stdout: cephfs-mirror x86_64 2:18.0.0-4488.g0a781ef0.el8 ceph 258 k 2023-07-05T18:53:30.623 INFO:teuthology.orchestra.run.smithi046.stdout: cephfs-top noarch 2:18.0.0-4488.g0a781ef0.el8 ceph-noarch 18 k 2023-07-05T18:53:30.623 INFO:teuthology.orchestra.run.smithi046.stdout: elfutils-libelf-devel x86_64 0.186-1.el8 rhel-8-for-x86_64-baseos-rpms 60 k 2023-07-05T18:53:30.623 INFO:teuthology.orchestra.run.smithi046.stdout: flex x86_64 2.6.1-9.el8 rhel-8-for-x86_64-appstream-rpms 320 k 2023-07-05T18:53:30.623 INFO:teuthology.orchestra.run.smithi046.stdout: libaio-devel x86_64 0.3.112-1.el8 rhel-8-for-x86_64-baseos-rpms 19 k 2023-07-05T18:53:30.623 INFO:teuthology.orchestra.run.smithi046.stdout: libcephfs-devel x86_64 2:18.0.0-4488.g0a781ef0.el8 ceph 31 k 2023-07-05T18:53:30.624 INFO:teuthology.orchestra.run.smithi046.stdout: libcephfs2 x86_64 2:18.0.0-4488.g0a781ef0.el8 ceph 771 k 2023-07-05T18:53:30.624 INFO:teuthology.orchestra.run.smithi046.stdout: librados-devel x86_64 2:18.0.0-4488.g0a781ef0.el8 ceph 139 k 2023-07-05T18:53:30.624 INFO:teuthology.orchestra.run.smithi046.stdout: libtool x86_64 2.4.6-25.el8 rhel-8-for-x86_64-appstream-rpms 709 k 2023-07-05T18:53:30.624 INFO:teuthology.orchestra.run.smithi046.stdout: libuuid-devel x86_64 2.32.1-35.el8 rhel-8-for-x86_64-baseos-rpms 98 k 2023-07-05T18:53:30.624 INFO:teuthology.orchestra.run.smithi046.stdout: openssl-devel x86_64 1:1.1.1k-7.el8_6 rhel-8-for-x86_64-baseos-rpms 2.3 M 2023-07-05T18:53:30.624 INFO:teuthology.orchestra.run.smithi046.stdout: postgresql x86_64 10.21-2.module+el8.6.0+15342+53518fac rhel-8-for-x86_64-appstream-rpms 1.5 M 2023-07-05T18:53:30.624 INFO:teuthology.orchestra.run.smithi046.stdout: postgresql-contrib x86_64 10.21-2.module+el8.6.0+15342+53518fac rhel-8-for-x86_64-appstream-rpms 808 k 2023-07-05T18:53:30.624 INFO:teuthology.orchestra.run.smithi046.stdout: postgresql-server x86_64 10.21-2.module+el8.6.0+15342+53518fac rhel-8-for-x86_64-appstream-rpms 5.1 M 2023-07-05T18:53:30.625 INFO:teuthology.orchestra.run.smithi046.stdout: python3-cephfs x86_64 2:18.0.0-4488.g0a781ef0.el8 ceph 197 k 2023-07-05T18:53:30.625 INFO:teuthology.orchestra.run.smithi046.stdout: python3-rados x86_64 2:18.0.0-4488.g0a781ef0.el8 ceph 371 k 2023-07-05T18:53:30.625 INFO:teuthology.orchestra.run.smithi046.stdout: python3-rbd x86_64 2:18.0.0-4488.g0a781ef0.el8 ceph 364 k 2023-07-05T18:53:30.625 INFO:teuthology.orchestra.run.smithi046.stdout: python3-rgw x86_64 2:18.0.0-4488.g0a781ef0.el8 ceph 107 k 2023-07-05T18:53:30.625 INFO:teuthology.orchestra.run.smithi046.stdout: rbd-fuse x86_64 2:18.0.0-4488.g0a781ef0.el8 ceph 94 k 2023-07-05T18:53:30.625 INFO:teuthology.orchestra.run.smithi046.stdout: rbd-mirror x86_64 2:18.0.0-4488.g0a781ef0.el8 ceph 3.4 M 2023-07-05T18:53:30.625 INFO:teuthology.orchestra.run.smithi046.stdout: rbd-nbd x86_64 2:18.0.0-4488.g0a781ef0.el8 ceph 180 k 2023-07-05T18:53:30.626 INFO:teuthology.orchestra.run.smithi046.stdout: xfsprogs-devel x86_64 5.0.0-10.el8 rhel-8-for-x86_64-baseos-rpms 72 k 2023-07-05T18:53:30.626 INFO:teuthology.orchestra.run.smithi046.stdout:Upgrading: 2023-07-05T18:53:30.626 INFO:teuthology.orchestra.run.smithi046.stdout: iproute x86_64 5.15.0-4.el8_6.1 rhel-8-for-x86_64-baseos-rpms 798 k 2023-07-05T18:53:30.626 INFO:teuthology.orchestra.run.smithi046.stdout: librados2 x86_64 2:18.0.0-4488.g0a781ef0.el8 ceph 3.7 M 2023-07-05T18:53:30.626 INFO:teuthology.orchestra.run.smithi046.stdout: librbd1 x86_64 2:18.0.0-4488.g0a781ef0.el8 ceph 3.6 M 2023-07-05T18:53:30.631 INFO:teuthology.orchestra.run.smithi046.stdout:Installing dependencies: 2023-07-05T18:53:30.631 INFO:teuthology.orchestra.run.smithi046.stdout: automake noarch 1.16.1-7.el8 rhel-8-for-x86_64-appstream-rpms 713 k 2023-07-05T18:53:30.631 INFO:teuthology.orchestra.run.smithi046.stdout: ceph-common x86_64 2:18.0.0-4488.g0a781ef0.el8 ceph 22 M 2023-07-05T18:53:30.631 INFO:teuthology.orchestra.run.smithi046.stdout: ceph-grafana-dashboards noarch 2:18.0.0-4488.g0a781ef0.el8 ceph-noarch 23 k 2023-07-05T18:53:30.631 INFO:teuthology.orchestra.run.smithi046.stdout: ceph-mds x86_64 2:18.0.0-4488.g0a781ef0.el8 ceph 2.3 M 2023-07-05T18:53:30.632 INFO:teuthology.orchestra.run.smithi046.stdout: ceph-mgr-modules-core noarch 2:18.0.0-4488.g0a781ef0.el8 ceph-noarch 240 k 2023-07-05T18:53:30.632 INFO:teuthology.orchestra.run.smithi046.stdout: ceph-mon x86_64 2:18.0.0-4488.g0a781ef0.el8 ceph 4.6 M 2023-07-05T18:53:30.632 INFO:teuthology.orchestra.run.smithi046.stdout: ceph-osd x86_64 2:18.0.0-4488.g0a781ef0.el8 ceph 18 M 2023-07-05T18:53:30.632 INFO:teuthology.orchestra.run.smithi046.stdout: ceph-prometheus-alerts noarch 2:18.0.0-4488.g0a781ef0.el8 ceph-noarch 15 k 2023-07-05T18:53:30.632 INFO:teuthology.orchestra.run.smithi046.stdout: ceph-selinux x86_64 2:18.0.0-4488.g0a781ef0.el8 ceph 24 k 2023-07-05T18:53:30.632 INFO:teuthology.orchestra.run.smithi046.stdout: fuse x86_64 2.9.7-15.el8 rhel-8-for-x86_64-baseos-rpms 83 k 2023-07-05T18:53:30.633 INFO:teuthology.orchestra.run.smithi046.stdout: gperftools-libs x86_64 1:2.7-9.el8 epel 306 k 2023-07-05T18:53:30.633 INFO:teuthology.orchestra.run.smithi046.stdout: jq x86_64 1.6-3.el8 rhel-8-for-x86_64-appstream-rpms 202 k 2023-07-05T18:53:30.633 INFO:teuthology.orchestra.run.smithi046.stdout: keyutils-libs-devel x86_64 1.5.10-9.el8 rhel-8-for-x86_64-baseos-rpms 48 k 2023-07-05T18:53:30.633 INFO:teuthology.orchestra.run.smithi046.stdout: krb5-devel x86_64 1.18.2-14.el8 rhel-8-for-x86_64-baseos-rpms 560 k 2023-07-05T18:53:30.633 INFO:teuthology.orchestra.run.smithi046.stdout: libcephsqlite x86_64 2:18.0.0-4488.g0a781ef0.el8 ceph 137 k 2023-07-05T18:53:30.633 INFO:teuthology.orchestra.run.smithi046.stdout: libcom_err-devel x86_64 1.45.6-4.el8 rhel-8-for-x86_64-baseos-rpms 39 k 2023-07-05T18:53:30.633 INFO:teuthology.orchestra.run.smithi046.stdout: libgfortran x86_64 8.5.0-10.1.el8_6 rhel-8-for-x86_64-baseos-rpms 644 k 2023-07-05T18:53:30.633 INFO:teuthology.orchestra.run.smithi046.stdout: liboath x86_64 2.6.2-3.el8 epel 59 k 2023-07-05T18:53:30.634 INFO:teuthology.orchestra.run.smithi046.stdout: libpq x86_64 13.5-1.el8 rhel-8-for-x86_64-appstream-rpms 198 k 2023-07-05T18:53:30.634 INFO:teuthology.orchestra.run.smithi046.stdout: libquadmath x86_64 8.5.0-10.1.el8_6 rhel-8-for-x86_64-baseos-rpms 171 k 2023-07-05T18:53:30.634 INFO:teuthology.orchestra.run.smithi046.stdout: librabbitmq x86_64 0.9.0-3.el8 rhel-8-for-x86_64-baseos-rpms 47 k 2023-07-05T18:53:30.634 INFO:teuthology.orchestra.run.smithi046.stdout: libradosstriper1 x86_64 2:18.0.0-4488.g0a781ef0.el8 ceph 473 k 2023-07-05T18:53:30.634 INFO:teuthology.orchestra.run.smithi046.stdout: librdkafka x86_64 0.11.4-3.el8 rhel-8-for-x86_64-appstream-rpms 354 k 2023-07-05T18:53:30.634 INFO:teuthology.orchestra.run.smithi046.stdout: librgw2 x86_64 2:18.0.0-4488.g0a781ef0.el8 ceph 6.7 M 2023-07-05T18:53:30.634 INFO:teuthology.orchestra.run.smithi046.stdout: libselinux-devel x86_64 2.9-5.el8 rhel-8-for-x86_64-baseos-rpms 200 k 2023-07-05T18:53:30.635 INFO:teuthology.orchestra.run.smithi046.stdout: libsepol-devel x86_64 2.9-3.el8 rhel-8-for-x86_64-baseos-rpms 87 k 2023-07-05T18:53:30.635 INFO:teuthology.orchestra.run.smithi046.stdout: libunwind x86_64 1.3.1-3.el8 epel 75 k 2023-07-05T18:53:30.635 INFO:teuthology.orchestra.run.smithi046.stdout: libverto-devel x86_64 0.3.0-5.el8 rhel-8-for-x86_64-baseos-rpms 18 k 2023-07-05T18:53:30.635 INFO:teuthology.orchestra.run.smithi046.stdout: lttng-ust x86_64 2.8.1-11.el8 rhel-8-for-x86_64-appstream-rpms 259 k 2023-07-05T18:53:30.635 INFO:teuthology.orchestra.run.smithi046.stdout: oniguruma x86_64 6.8.2-2.el8 rhel-8-for-x86_64-appstream-rpms 187 k 2023-07-05T18:53:30.635 INFO:teuthology.orchestra.run.smithi046.stdout: openblas x86_64 0.3.15-3.el8 rhel-8-for-x86_64-appstream-rpms 4.7 M 2023-07-05T18:53:30.635 INFO:teuthology.orchestra.run.smithi046.stdout: openblas-threads x86_64 0.3.15-3.el8 rhel-8-for-x86_64-appstream-rpms 4.9 M 2023-07-05T18:53:30.636 INFO:teuthology.orchestra.run.smithi046.stdout: pcre2-devel x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 605 k 2023-07-05T18:53:30.636 INFO:teuthology.orchestra.run.smithi046.stdout: pcre2-utf16 x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 229 k 2023-07-05T18:53:30.636 INFO:teuthology.orchestra.run.smithi046.stdout: pcre2-utf32 x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 220 k 2023-07-05T18:53:30.639 INFO:teuthology.orchestra.run.smithi046.stdout: python3-asyncssh noarch 2.7.0-2.el8 epel 476 k 2023-07-05T18:53:30.639 INFO:teuthology.orchestra.run.smithi046.stdout: python3-babel noarch 2.5.1-7.el8 rhel-8-for-x86_64-appstream-rpms 4.8 M 2023-07-05T18:53:30.639 INFO:teuthology.orchestra.run.smithi046.stdout: python3-bcrypt x86_64 3.1.6-2.el8.1 epel 44 k 2023-07-05T18:53:30.640 INFO:teuthology.orchestra.run.smithi046.stdout: python3-beautifulsoup4 noarch 4.6.3-2.el8.1 epel 185 k 2023-07-05T18:53:30.640 INFO:teuthology.orchestra.run.smithi046.stdout: python3-cachetools noarch 3.1.1-4.el8 epel 33 k 2023-07-05T18:53:30.640 INFO:teuthology.orchestra.run.smithi046.stdout: python3-ceph-argparse x86_64 2:18.0.0-4488.g0a781ef0.el8 ceph 45 k 2023-07-05T18:53:30.640 INFO:teuthology.orchestra.run.smithi046.stdout: python3-ceph-common x86_64 2:18.0.0-4488.g0a781ef0.el8 ceph 119 k 2023-07-05T18:53:30.640 INFO:teuthology.orchestra.run.smithi046.stdout: python3-certifi noarch 2018.10.15-7.el8 epel 16 k 2023-07-05T18:53:30.640 INFO:teuthology.orchestra.run.smithi046.stdout: python3-cffi x86_64 1.11.5-5.el8 rhel-8-for-x86_64-baseos-rpms 238 k 2023-07-05T18:53:30.640 INFO:teuthology.orchestra.run.smithi046.stdout: python3-cheroot noarch 8.5.2-1.el8 epel 173 k 2023-07-05T18:53:30.641 INFO:teuthology.orchestra.run.smithi046.stdout: python3-cherrypy noarch 18.4.0-1.el8 epel 384 k 2023-07-05T18:53:30.641 INFO:teuthology.orchestra.run.smithi046.stdout: python3-cryptography x86_64 3.2.1-5.el8 rhel-8-for-x86_64-baseos-rpms 559 k 2023-07-05T18:53:30.641 INFO:teuthology.orchestra.run.smithi046.stdout: python3-google-auth noarch 1:1.1.1-10.el8 epel 81 k 2023-07-05T18:53:30.641 INFO:teuthology.orchestra.run.smithi046.stdout: python3-jaraco noarch 6.2-6.el8 epel 11 k 2023-07-05T18:53:30.641 INFO:teuthology.orchestra.run.smithi046.stdout: python3-jaraco-functools noarch 2.0-4.el8 epel 18 k 2023-07-05T18:53:30.641 INFO:teuthology.orchestra.run.smithi046.stdout: python3-jinja2 noarch 2.10.1-3.el8 rhel-8-for-x86_64-appstream-rpms 538 k 2023-07-05T18:53:30.641 INFO:teuthology.orchestra.run.smithi046.stdout: python3-jsonpatch noarch 1.21-2.el8 rhel-8-for-x86_64-appstream-rpms 27 k 2023-07-05T18:53:30.641 INFO:teuthology.orchestra.run.smithi046.stdout: python3-jsonpointer noarch 1.10-11.el8 rhel-8-for-x86_64-appstream-rpms 20 k 2023-07-05T18:53:30.642 INFO:teuthology.orchestra.run.smithi046.stdout: python3-jwt noarch 1.6.1-2.el8 rhel-8-for-x86_64-baseos-rpms 43 k 2023-07-05T18:53:30.642 INFO:teuthology.orchestra.run.smithi046.stdout: python3-kubernetes noarch 1:11.0.0-6.el8 epel 1.2 M 2023-07-05T18:53:30.642 INFO:teuthology.orchestra.run.smithi046.stdout: python3-logutils noarch 0.3.5-11.el8 epel 49 k 2023-07-05T18:53:30.642 INFO:teuthology.orchestra.run.smithi046.stdout: python3-mako noarch 1.0.6-13.el8 rhel-8-for-x86_64-appstream-rpms 157 k 2023-07-05T18:53:30.642 INFO:teuthology.orchestra.run.smithi046.stdout: python3-markupsafe x86_64 0.23-19.el8 rhel-8-for-x86_64-appstream-rpms 39 k 2023-07-05T18:53:30.642 INFO:teuthology.orchestra.run.smithi046.stdout: python3-more-itertools noarch 7.2.0-3.el8 epel 59 k 2023-07-05T18:53:30.642 INFO:teuthology.orchestra.run.smithi046.stdout: python3-natsort noarch 7.1.1-2.el8 epel 60 k 2023-07-05T18:53:30.643 INFO:teuthology.orchestra.run.smithi046.stdout: python3-numpy x86_64 1:1.14.3-10.el8 rhel-8-for-x86_64-appstream-rpms 3.7 M 2023-07-05T18:53:30.643 INFO:teuthology.orchestra.run.smithi046.stdout: python3-numpy-f2py x86_64 1:1.14.3-10.el8 rhel-8-for-x86_64-appstream-rpms 225 k 2023-07-05T18:53:30.643 INFO:teuthology.orchestra.run.smithi046.stdout: python3-oauthlib noarch 2.1.0-1.el8 rhel-8-for-x86_64-baseos-rpms 155 k 2023-07-05T18:53:30.643 INFO:teuthology.orchestra.run.smithi046.stdout: python3-pecan noarch 1.3.2-9.el8 epel 283 k 2023-07-05T18:53:30.643 INFO:teuthology.orchestra.run.smithi046.stdout: python3-portend noarch 2.6-1.el8 epel 16 k 2023-07-05T18:53:30.643 INFO:teuthology.orchestra.run.smithi046.stdout: python3-prettytable noarch 0.7.2-14.el8 rhel-8-for-x86_64-appstream-rpms 44 k 2023-07-05T18:53:30.643 INFO:teuthology.orchestra.run.smithi046.stdout: python3-pyOpenSSL noarch 19.0.0-1.el8 rhel-8-for-x86_64-appstream-rpms 103 k 2023-07-05T18:53:30.643 INFO:teuthology.orchestra.run.smithi046.stdout: python3-pyasn1 noarch 0.3.7-6.el8 rhel-8-for-x86_64-appstream-rpms 126 k 2023-07-05T18:53:30.644 INFO:teuthology.orchestra.run.smithi046.stdout: python3-pyasn1-modules noarch 0.3.7-6.el8 rhel-8-for-x86_64-appstream-rpms 110 k 2023-07-05T18:53:30.644 INFO:teuthology.orchestra.run.smithi046.stdout: python3-pycparser noarch 2.14-14.el8 rhel-8-for-x86_64-baseos-rpms 109 k 2023-07-05T18:53:30.644 INFO:teuthology.orchestra.run.smithi046.stdout: python3-pytz noarch 2017.2-9.el8 rhel-8-for-x86_64-appstream-rpms 54 k 2023-07-05T18:53:30.644 INFO:teuthology.orchestra.run.smithi046.stdout: python3-repoze-lru noarch 0.7-6.el8 epel 34 k 2023-07-05T18:53:30.644 INFO:teuthology.orchestra.run.smithi046.stdout: python3-requests-oauthlib noarch 1.0.0-1.el8 rhel-8-for-x86_64-baseos-rpms 43 k 2023-07-05T18:53:30.644 INFO:teuthology.orchestra.run.smithi046.stdout: python3-routes noarch 2.4.1-12.el8 epel 196 k 2023-07-05T18:53:30.644 INFO:teuthology.orchestra.run.smithi046.stdout: python3-rsa noarch 4.8-1.el8 epel 61 k 2023-07-05T18:53:30.645 INFO:teuthology.orchestra.run.smithi046.stdout: python3-scipy x86_64 1.0.0-21.module+el8.5.0+10916+41bd434d rhel-8-for-x86_64-appstream-rpms 14 M 2023-07-05T18:53:30.645 INFO:teuthology.orchestra.run.smithi046.stdout: python3-simplegeneric noarch 0.8.1-17.el8 epel 19 k 2023-07-05T18:53:30.645 INFO:teuthology.orchestra.run.smithi046.stdout: python3-singledispatch noarch 3.4.0.3-18.el8 epel 24 k 2023-07-05T18:53:30.645 INFO:teuthology.orchestra.run.smithi046.stdout: python3-tempora noarch 1.14.1-5.el8 epel 29 k 2023-07-05T18:53:30.645 INFO:teuthology.orchestra.run.smithi046.stdout: python3-trustme noarch 0.6.0-4.el8 epel 27 k 2023-07-05T18:53:30.645 INFO:teuthology.orchestra.run.smithi046.stdout: python3-waitress noarch 1.4.3-1.el8 epel 255 k 2023-07-05T18:53:30.645 INFO:teuthology.orchestra.run.smithi046.stdout: python3-webob noarch 1.8.5-1.el8.1 epel 251 k 2023-07-05T18:53:30.646 INFO:teuthology.orchestra.run.smithi046.stdout: python3-websocket-client noarch 0.56.0-5.el8 epel 61 k 2023-07-05T18:53:30.646 INFO:teuthology.orchestra.run.smithi046.stdout: python3-webtest noarch 2.0.33-1.el8 epel 85 k 2023-07-05T18:53:30.646 INFO:teuthology.orchestra.run.smithi046.stdout: python3-werkzeug noarch 0.12.2-4.el8 rhel-8-for-x86_64-appstream-rpms 457 k 2023-07-05T18:53:30.646 INFO:teuthology.orchestra.run.smithi046.stdout: python3-zc-lockfile noarch 2.0-2.el8 epel 23 k 2023-07-05T18:53:30.646 INFO:teuthology.orchestra.run.smithi046.stdout: socat x86_64 1.7.4.1-1.el8 rhel-8-for-x86_64-appstream-rpms 323 k 2023-07-05T18:53:30.646 INFO:teuthology.orchestra.run.smithi046.stdout: thrift x86_64 0.13.0-2.el8 epel 1.7 M 2023-07-05T18:53:30.647 INFO:teuthology.orchestra.run.smithi046.stdout: uuid x86_64 1.6.2-43.el8 rhel-8-for-x86_64-appstream-rpms 64 k 2023-07-05T18:53:30.647 INFO:teuthology.orchestra.run.smithi046.stdout: xmlstarlet x86_64 1.6.1-20.el8 lab-extras 70 k 2023-07-05T18:53:30.648 INFO:teuthology.orchestra.run.smithi046.stdout: zlib-devel x86_64 1.2.11-18.el8_5 rhel-8-for-x86_64-baseos-rpms 58 k 2023-07-05T18:53:30.648 INFO:teuthology.orchestra.run.smithi046.stdout:Enabling module streams: 2023-07-05T18:53:30.648 INFO:teuthology.orchestra.run.smithi046.stdout: postgresql 10 2023-07-05T18:53:30.648 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T18:53:30.648 INFO:teuthology.orchestra.run.smithi046.stdout:Transaction Summary 2023-07-05T18:53:30.649 INFO:teuthology.orchestra.run.smithi046.stdout:=========================================================================================================================== 2023-07-05T18:53:30.649 INFO:teuthology.orchestra.run.smithi046.stdout:Install 128 Packages 2023-07-05T18:53:30.650 INFO:teuthology.orchestra.run.smithi046.stdout:Upgrade 3 Packages 2023-07-05T18:53:30.650 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T18:53:30.650 INFO:teuthology.orchestra.run.smithi046.stdout:Total download size: 205 M 2023-07-05T18:53:30.651 INFO:teuthology.orchestra.run.smithi046.stdout:Downloading Packages: 2023-07-05T18:53:31.207 INFO:teuthology.orchestra.run.smithi046.stdout:(1/131): ceph-18.0.0-4488.g0a781ef0.el8.x86_64. 27 kB/s | 6.4 kB 00:00 2023-07-05T18:53:31.474 INFO:teuthology.orchestra.run.smithi046.stdout:(2/131): ceph-base-18.0.0-4488.g0a781ef0.el8.x8 11 MB/s | 5.4 MB 00:00 2023-07-05T18:53:31.558 INFO:teuthology.orchestra.run.smithi046.stdout:(3/131): ceph-immutable-object-cache-18.0.0-448 1.9 MB/s | 165 kB 00:00 2023-07-05T18:53:31.725 INFO:teuthology.orchestra.run.smithi046.stdout:(4/131): ceph-mds-18.0.0-4488.g0a781ef0.el8.x86 14 MB/s | 2.3 MB 00:00 2023-07-05T18:53:31.767 INFO:teuthology.orchestra.run.smithi046.stdout:(5/131): ceph-fuse-18.0.0-4488.g0a781ef0.el8.x8 1.5 MB/s | 848 kB 00:00 2023-07-05T18:53:31.850 INFO:teuthology.orchestra.run.smithi046.stdout:(6/131): ceph-mgr-18.0.0-4488.g0a781ef0.el8.x86 12 MB/s | 1.5 MB 00:00 2023-07-05T18:53:33.015 INFO:teuthology.orchestra.run.smithi073.stdout:Package librados2-1:12.2.7-9.el8.x86_64 is already installed. 2023-07-05T18:53:33.016 INFO:teuthology.orchestra.run.smithi073.stdout:Package librbd1-1:12.2.7-9.el8.x86_64 is already installed. 2023-07-05T18:53:33.030 INFO:teuthology.orchestra.run.smithi073.stdout:Package NetworkManager-1:1.36.0-4.el8.x86_64 is already installed. 2023-07-05T18:53:33.031 INFO:teuthology.orchestra.run.smithi073.stdout:Package iproute-5.15.0-4.el8.x86_64 is already installed. 2023-07-05T18:53:33.032 INFO:teuthology.orchestra.run.smithi073.stdout:Package util-linux-2.32.1-35.el8.x86_64 is already installed. 2023-07-05T18:53:33.034 INFO:teuthology.orchestra.run.smithi073.stdout:Package libacl-devel-2.2.53-1.el8.x86_64 is already installed. 2023-07-05T18:53:33.035 INFO:teuthology.orchestra.run.smithi073.stdout:Package libattr-devel-2.4.48-3.el8.x86_64 is already installed. 2023-07-05T18:53:33.040 INFO:teuthology.orchestra.run.smithi073.stdout:Package xfsdump-3.1.8-4.el8.x86_64 is already installed. 2023-07-05T18:53:33.040 INFO:teuthology.orchestra.run.smithi073.stdout:Package xfsprogs-5.0.0-10.el8.x86_64 is already installed. 2023-07-05T18:53:33.170 INFO:teuthology.orchestra.run.smithi073.stdout:Dependencies resolved. 2023-07-05T18:53:33.182 INFO:teuthology.orchestra.run.smithi073.stdout:=========================================================================================================================== 2023-07-05T18:53:33.183 INFO:teuthology.orchestra.run.smithi073.stdout: Package Arch Version Repository Size 2023-07-05T18:53:33.183 INFO:teuthology.orchestra.run.smithi073.stdout:=========================================================================================================================== 2023-07-05T18:53:33.183 INFO:teuthology.orchestra.run.smithi073.stdout:Installing: 2023-07-05T18:53:33.183 INFO:teuthology.orchestra.run.smithi073.stdout: NetworkManager-initscripts-updown noarch 1:1.36.0-9.el8_6 rhel-8-for-x86_64-baseos-rpms 138 k 2023-07-05T18:53:33.184 INFO:teuthology.orchestra.run.smithi073.stdout: bison x86_64 3.0.4-10.el8 rhel-8-for-x86_64-appstream-rpms 688 k 2023-07-05T18:53:33.184 INFO:teuthology.orchestra.run.smithi073.stdout: ceph x86_64 2:18.0.0-4488.g0a781ef0.el8 ceph 6.4 k 2023-07-05T18:53:33.184 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-base x86_64 2:18.0.0-4488.g0a781ef0.el8 ceph 5.4 M 2023-07-05T18:53:33.184 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-fuse x86_64 2:18.0.0-4488.g0a781ef0.el8 ceph 848 k 2023-07-05T18:53:33.184 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-immutable-object-cache x86_64 2:18.0.0-4488.g0a781ef0.el8 ceph 165 k 2023-07-05T18:53:33.184 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-mgr x86_64 2:18.0.0-4488.g0a781ef0.el8 ceph 1.5 M 2023-07-05T18:53:33.184 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-mgr-cephadm noarch 2:18.0.0-4488.g0a781ef0.el8 ceph-noarch 128 k 2023-07-05T18:53:33.185 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-mgr-dashboard noarch 2:18.0.0-4488.g0a781ef0.el8 ceph-noarch 1.7 M 2023-07-05T18:53:33.185 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-mgr-diskprediction-local noarch 2:18.0.0-4488.g0a781ef0.el8 ceph-noarch 7.4 M 2023-07-05T18:53:33.185 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-mgr-rook noarch 2:18.0.0-4488.g0a781ef0.el8 ceph-noarch 47 k 2023-07-05T18:53:33.185 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-radosgw x86_64 2:18.0.0-4488.g0a781ef0.el8 ceph 13 M 2023-07-05T18:53:33.185 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-test x86_64 2:18.0.0-4488.g0a781ef0.el8 ceph 48 M 2023-07-05T18:53:33.185 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-volume noarch 2:18.0.0-4488.g0a781ef0.el8 ceph-noarch 258 k 2023-07-05T18:53:33.185 INFO:teuthology.orchestra.run.smithi073.stdout: cephadm noarch 2:18.0.0-4488.g0a781ef0.el8 ceph-noarch 161 k 2023-07-05T18:53:33.186 INFO:teuthology.orchestra.run.smithi073.stdout: cephfs-mirror x86_64 2:18.0.0-4488.g0a781ef0.el8 ceph 258 k 2023-07-05T18:53:33.186 INFO:teuthology.orchestra.run.smithi073.stdout: cephfs-top noarch 2:18.0.0-4488.g0a781ef0.el8 ceph-noarch 18 k 2023-07-05T18:53:33.186 INFO:teuthology.orchestra.run.smithi073.stdout: elfutils-libelf-devel x86_64 0.186-1.el8 rhel-8-for-x86_64-baseos-rpms 60 k 2023-07-05T18:53:33.186 INFO:teuthology.orchestra.run.smithi073.stdout: flex x86_64 2.6.1-9.el8 rhel-8-for-x86_64-appstream-rpms 320 k 2023-07-05T18:53:33.186 INFO:teuthology.orchestra.run.smithi073.stdout: libaio-devel x86_64 0.3.112-1.el8 rhel-8-for-x86_64-baseos-rpms 19 k 2023-07-05T18:53:33.186 INFO:teuthology.orchestra.run.smithi073.stdout: libcephfs-devel x86_64 2:18.0.0-4488.g0a781ef0.el8 ceph 31 k 2023-07-05T18:53:33.186 INFO:teuthology.orchestra.run.smithi073.stdout: libcephfs2 x86_64 2:18.0.0-4488.g0a781ef0.el8 ceph 771 k 2023-07-05T18:53:33.186 INFO:teuthology.orchestra.run.smithi073.stdout: librados-devel x86_64 2:18.0.0-4488.g0a781ef0.el8 ceph 139 k 2023-07-05T18:53:33.187 INFO:teuthology.orchestra.run.smithi073.stdout: libtool x86_64 2.4.6-25.el8 rhel-8-for-x86_64-appstream-rpms 709 k 2023-07-05T18:53:33.187 INFO:teuthology.orchestra.run.smithi073.stdout: libuuid-devel x86_64 2.32.1-35.el8 rhel-8-for-x86_64-baseos-rpms 98 k 2023-07-05T18:53:33.187 INFO:teuthology.orchestra.run.smithi073.stdout: openssl-devel x86_64 1:1.1.1k-7.el8_6 rhel-8-for-x86_64-baseos-rpms 2.3 M 2023-07-05T18:53:33.187 INFO:teuthology.orchestra.run.smithi073.stdout: postgresql x86_64 10.21-2.module+el8.6.0+15342+53518fac rhel-8-for-x86_64-appstream-rpms 1.5 M 2023-07-05T18:53:33.187 INFO:teuthology.orchestra.run.smithi073.stdout: postgresql-contrib x86_64 10.21-2.module+el8.6.0+15342+53518fac rhel-8-for-x86_64-appstream-rpms 808 k 2023-07-05T18:53:33.187 INFO:teuthology.orchestra.run.smithi073.stdout: postgresql-server x86_64 10.21-2.module+el8.6.0+15342+53518fac rhel-8-for-x86_64-appstream-rpms 5.1 M 2023-07-05T18:53:33.187 INFO:teuthology.orchestra.run.smithi073.stdout: python3-cephfs x86_64 2:18.0.0-4488.g0a781ef0.el8 ceph 197 k 2023-07-05T18:53:33.188 INFO:teuthology.orchestra.run.smithi073.stdout: python3-rados x86_64 2:18.0.0-4488.g0a781ef0.el8 ceph 371 k 2023-07-05T18:53:33.188 INFO:teuthology.orchestra.run.smithi073.stdout: python3-rbd x86_64 2:18.0.0-4488.g0a781ef0.el8 ceph 364 k 2023-07-05T18:53:33.188 INFO:teuthology.orchestra.run.smithi073.stdout: python3-rgw x86_64 2:18.0.0-4488.g0a781ef0.el8 ceph 107 k 2023-07-05T18:53:33.189 INFO:teuthology.orchestra.run.smithi073.stdout: rbd-fuse x86_64 2:18.0.0-4488.g0a781ef0.el8 ceph 94 k 2023-07-05T18:53:33.191 INFO:teuthology.orchestra.run.smithi073.stdout: rbd-mirror x86_64 2:18.0.0-4488.g0a781ef0.el8 ceph 3.4 M 2023-07-05T18:53:33.191 INFO:teuthology.orchestra.run.smithi073.stdout: rbd-nbd x86_64 2:18.0.0-4488.g0a781ef0.el8 ceph 180 k 2023-07-05T18:53:33.191 INFO:teuthology.orchestra.run.smithi073.stdout: xfsprogs-devel x86_64 5.0.0-10.el8 rhel-8-for-x86_64-baseos-rpms 72 k 2023-07-05T18:53:33.191 INFO:teuthology.orchestra.run.smithi073.stdout:Upgrading: 2023-07-05T18:53:33.191 INFO:teuthology.orchestra.run.smithi073.stdout: iproute x86_64 5.15.0-4.el8_6.1 rhel-8-for-x86_64-baseos-rpms 798 k 2023-07-05T18:53:33.191 INFO:teuthology.orchestra.run.smithi073.stdout: librados2 x86_64 2:18.0.0-4488.g0a781ef0.el8 ceph 3.7 M 2023-07-05T18:53:33.192 INFO:teuthology.orchestra.run.smithi073.stdout: librbd1 x86_64 2:18.0.0-4488.g0a781ef0.el8 ceph 3.6 M 2023-07-05T18:53:33.192 INFO:teuthology.orchestra.run.smithi073.stdout:Installing dependencies: 2023-07-05T18:53:33.192 INFO:teuthology.orchestra.run.smithi073.stdout: automake noarch 1.16.1-7.el8 rhel-8-for-x86_64-appstream-rpms 713 k 2023-07-05T18:53:33.192 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-common x86_64 2:18.0.0-4488.g0a781ef0.el8 ceph 22 M 2023-07-05T18:53:33.192 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-grafana-dashboards noarch 2:18.0.0-4488.g0a781ef0.el8 ceph-noarch 23 k 2023-07-05T18:53:33.192 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-mds x86_64 2:18.0.0-4488.g0a781ef0.el8 ceph 2.3 M 2023-07-05T18:53:33.192 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-mgr-modules-core noarch 2:18.0.0-4488.g0a781ef0.el8 ceph-noarch 240 k 2023-07-05T18:53:33.193 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-mon x86_64 2:18.0.0-4488.g0a781ef0.el8 ceph 4.6 M 2023-07-05T18:53:33.193 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-osd x86_64 2:18.0.0-4488.g0a781ef0.el8 ceph 18 M 2023-07-05T18:53:33.193 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-prometheus-alerts noarch 2:18.0.0-4488.g0a781ef0.el8 ceph-noarch 15 k 2023-07-05T18:53:33.193 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-selinux x86_64 2:18.0.0-4488.g0a781ef0.el8 ceph 24 k 2023-07-05T18:53:33.193 INFO:teuthology.orchestra.run.smithi073.stdout: fuse x86_64 2.9.7-15.el8 rhel-8-for-x86_64-baseos-rpms 83 k 2023-07-05T18:53:33.193 INFO:teuthology.orchestra.run.smithi073.stdout: gperftools-libs x86_64 1:2.7-9.el8 epel 306 k 2023-07-05T18:53:33.193 INFO:teuthology.orchestra.run.smithi073.stdout: jq x86_64 1.6-3.el8 rhel-8-for-x86_64-appstream-rpms 202 k 2023-07-05T18:53:33.194 INFO:teuthology.orchestra.run.smithi073.stdout: keyutils-libs-devel x86_64 1.5.10-9.el8 rhel-8-for-x86_64-baseos-rpms 48 k 2023-07-05T18:53:33.194 INFO:teuthology.orchestra.run.smithi073.stdout: krb5-devel x86_64 1.18.2-14.el8 rhel-8-for-x86_64-baseos-rpms 560 k 2023-07-05T18:53:33.194 INFO:teuthology.orchestra.run.smithi073.stdout: libcephsqlite x86_64 2:18.0.0-4488.g0a781ef0.el8 ceph 137 k 2023-07-05T18:53:33.194 INFO:teuthology.orchestra.run.smithi073.stdout: libcom_err-devel x86_64 1.45.6-4.el8 rhel-8-for-x86_64-baseos-rpms 39 k 2023-07-05T18:53:33.194 INFO:teuthology.orchestra.run.smithi073.stdout: libgfortran x86_64 8.5.0-10.1.el8_6 rhel-8-for-x86_64-baseos-rpms 644 k 2023-07-05T18:53:33.194 INFO:teuthology.orchestra.run.smithi073.stdout: liboath x86_64 2.6.2-3.el8 epel 59 k 2023-07-05T18:53:33.194 INFO:teuthology.orchestra.run.smithi073.stdout: libpq x86_64 13.5-1.el8 rhel-8-for-x86_64-appstream-rpms 198 k 2023-07-05T18:53:33.195 INFO:teuthology.orchestra.run.smithi073.stdout: libquadmath x86_64 8.5.0-10.1.el8_6 rhel-8-for-x86_64-baseos-rpms 171 k 2023-07-05T18:53:33.195 INFO:teuthology.orchestra.run.smithi073.stdout: librabbitmq x86_64 0.9.0-3.el8 rhel-8-for-x86_64-baseos-rpms 47 k 2023-07-05T18:53:33.195 INFO:teuthology.orchestra.run.smithi073.stdout: libradosstriper1 x86_64 2:18.0.0-4488.g0a781ef0.el8 ceph 473 k 2023-07-05T18:53:33.195 INFO:teuthology.orchestra.run.smithi073.stdout: librdkafka x86_64 0.11.4-3.el8 rhel-8-for-x86_64-appstream-rpms 354 k 2023-07-05T18:53:33.195 INFO:teuthology.orchestra.run.smithi073.stdout: librgw2 x86_64 2:18.0.0-4488.g0a781ef0.el8 ceph 6.7 M 2023-07-05T18:53:33.195 INFO:teuthology.orchestra.run.smithi073.stdout: libselinux-devel x86_64 2.9-5.el8 rhel-8-for-x86_64-baseos-rpms 200 k 2023-07-05T18:53:33.195 INFO:teuthology.orchestra.run.smithi073.stdout: libsepol-devel x86_64 2.9-3.el8 rhel-8-for-x86_64-baseos-rpms 87 k 2023-07-05T18:53:33.196 INFO:teuthology.orchestra.run.smithi073.stdout: libunwind x86_64 1.3.1-3.el8 epel 75 k 2023-07-05T18:53:33.196 INFO:teuthology.orchestra.run.smithi073.stdout: libverto-devel x86_64 0.3.0-5.el8 rhel-8-for-x86_64-baseos-rpms 18 k 2023-07-05T18:53:33.196 INFO:teuthology.orchestra.run.smithi073.stdout: lttng-ust x86_64 2.8.1-11.el8 rhel-8-for-x86_64-appstream-rpms 259 k 2023-07-05T18:53:33.196 INFO:teuthology.orchestra.run.smithi073.stdout: oniguruma x86_64 6.8.2-2.el8 rhel-8-for-x86_64-appstream-rpms 187 k 2023-07-05T18:53:33.196 INFO:teuthology.orchestra.run.smithi073.stdout: openblas x86_64 0.3.15-3.el8 rhel-8-for-x86_64-appstream-rpms 4.7 M 2023-07-05T18:53:33.196 INFO:teuthology.orchestra.run.smithi073.stdout: openblas-threads x86_64 0.3.15-3.el8 rhel-8-for-x86_64-appstream-rpms 4.9 M 2023-07-05T18:53:33.196 INFO:teuthology.orchestra.run.smithi073.stdout: pcre2-devel x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 605 k 2023-07-05T18:53:33.196 INFO:teuthology.orchestra.run.smithi073.stdout: pcre2-utf16 x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 229 k 2023-07-05T18:53:33.197 INFO:teuthology.orchestra.run.smithi073.stdout: pcre2-utf32 x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 220 k 2023-07-05T18:53:33.197 INFO:teuthology.orchestra.run.smithi073.stdout: python3-asyncssh noarch 2.7.0-2.el8 epel 476 k 2023-07-05T18:53:33.197 INFO:teuthology.orchestra.run.smithi073.stdout: python3-babel noarch 2.5.1-7.el8 rhel-8-for-x86_64-appstream-rpms 4.8 M 2023-07-05T18:53:33.197 INFO:teuthology.orchestra.run.smithi073.stdout: python3-bcrypt x86_64 3.1.6-2.el8.1 epel 44 k 2023-07-05T18:53:33.198 INFO:teuthology.orchestra.run.smithi073.stdout: python3-beautifulsoup4 noarch 4.6.3-2.el8.1 epel 185 k 2023-07-05T18:53:33.198 INFO:teuthology.orchestra.run.smithi073.stdout: python3-cachetools noarch 3.1.1-4.el8 epel 33 k 2023-07-05T18:53:33.198 INFO:teuthology.orchestra.run.smithi073.stdout: python3-ceph-argparse x86_64 2:18.0.0-4488.g0a781ef0.el8 ceph 45 k 2023-07-05T18:53:33.199 INFO:teuthology.orchestra.run.smithi073.stdout: python3-ceph-common x86_64 2:18.0.0-4488.g0a781ef0.el8 ceph 119 k 2023-07-05T18:53:33.199 INFO:teuthology.orchestra.run.smithi073.stdout: python3-certifi noarch 2018.10.15-7.el8 epel 16 k 2023-07-05T18:53:33.199 INFO:teuthology.orchestra.run.smithi073.stdout: python3-cffi x86_64 1.11.5-5.el8 rhel-8-for-x86_64-baseos-rpms 238 k 2023-07-05T18:53:33.199 INFO:teuthology.orchestra.run.smithi073.stdout: python3-cheroot noarch 8.5.2-1.el8 epel 173 k 2023-07-05T18:53:33.199 INFO:teuthology.orchestra.run.smithi073.stdout: python3-cherrypy noarch 18.4.0-1.el8 epel 384 k 2023-07-05T18:53:33.199 INFO:teuthology.orchestra.run.smithi073.stdout: python3-cryptography x86_64 3.2.1-5.el8 rhel-8-for-x86_64-baseos-rpms 559 k 2023-07-05T18:53:33.199 INFO:teuthology.orchestra.run.smithi073.stdout: python3-google-auth noarch 1:1.1.1-10.el8 epel 81 k 2023-07-05T18:53:33.200 INFO:teuthology.orchestra.run.smithi073.stdout: python3-jaraco noarch 6.2-6.el8 epel 11 k 2023-07-05T18:53:33.201 INFO:teuthology.orchestra.run.smithi073.stdout: python3-jaraco-functools noarch 2.0-4.el8 epel 18 k 2023-07-05T18:53:33.201 INFO:teuthology.orchestra.run.smithi073.stdout: python3-jinja2 noarch 2.10.1-3.el8 rhel-8-for-x86_64-appstream-rpms 538 k 2023-07-05T18:53:33.201 INFO:teuthology.orchestra.run.smithi073.stdout: python3-jsonpatch noarch 1.21-2.el8 rhel-8-for-x86_64-appstream-rpms 27 k 2023-07-05T18:53:33.201 INFO:teuthology.orchestra.run.smithi073.stdout: python3-jsonpointer noarch 1.10-11.el8 rhel-8-for-x86_64-appstream-rpms 20 k 2023-07-05T18:53:33.201 INFO:teuthology.orchestra.run.smithi073.stdout: python3-jwt noarch 1.6.1-2.el8 rhel-8-for-x86_64-baseos-rpms 43 k 2023-07-05T18:53:33.202 INFO:teuthology.orchestra.run.smithi073.stdout: python3-kubernetes noarch 1:11.0.0-6.el8 epel 1.2 M 2023-07-05T18:53:33.202 INFO:teuthology.orchestra.run.smithi073.stdout: python3-logutils noarch 0.3.5-11.el8 epel 49 k 2023-07-05T18:53:33.202 INFO:teuthology.orchestra.run.smithi073.stdout: python3-mako noarch 1.0.6-13.el8 rhel-8-for-x86_64-appstream-rpms 157 k 2023-07-05T18:53:33.202 INFO:teuthology.orchestra.run.smithi073.stdout: python3-markupsafe x86_64 0.23-19.el8 rhel-8-for-x86_64-appstream-rpms 39 k 2023-07-05T18:53:33.202 INFO:teuthology.orchestra.run.smithi073.stdout: python3-more-itertools noarch 7.2.0-3.el8 epel 59 k 2023-07-05T18:53:33.202 INFO:teuthology.orchestra.run.smithi073.stdout: python3-natsort noarch 7.1.1-2.el8 epel 60 k 2023-07-05T18:53:33.203 INFO:teuthology.orchestra.run.smithi073.stdout: python3-numpy x86_64 1:1.14.3-10.el8 rhel-8-for-x86_64-appstream-rpms 3.7 M 2023-07-05T18:53:33.203 INFO:teuthology.orchestra.run.smithi073.stdout: python3-numpy-f2py x86_64 1:1.14.3-10.el8 rhel-8-for-x86_64-appstream-rpms 225 k 2023-07-05T18:53:33.203 INFO:teuthology.orchestra.run.smithi073.stdout: python3-oauthlib noarch 2.1.0-1.el8 rhel-8-for-x86_64-baseos-rpms 155 k 2023-07-05T18:53:33.203 INFO:teuthology.orchestra.run.smithi073.stdout: python3-pecan noarch 1.3.2-9.el8 epel 283 k 2023-07-05T18:53:33.203 INFO:teuthology.orchestra.run.smithi073.stdout: python3-portend noarch 2.6-1.el8 epel 16 k 2023-07-05T18:53:33.203 INFO:teuthology.orchestra.run.smithi073.stdout: python3-prettytable noarch 0.7.2-14.el8 rhel-8-for-x86_64-appstream-rpms 44 k 2023-07-05T18:53:33.203 INFO:teuthology.orchestra.run.smithi073.stdout: python3-pyOpenSSL noarch 19.0.0-1.el8 rhel-8-for-x86_64-appstream-rpms 103 k 2023-07-05T18:53:33.204 INFO:teuthology.orchestra.run.smithi073.stdout: python3-pyasn1 noarch 0.3.7-6.el8 rhel-8-for-x86_64-appstream-rpms 126 k 2023-07-05T18:53:33.204 INFO:teuthology.orchestra.run.smithi073.stdout: python3-pyasn1-modules noarch 0.3.7-6.el8 rhel-8-for-x86_64-appstream-rpms 110 k 2023-07-05T18:53:33.204 INFO:teuthology.orchestra.run.smithi073.stdout: python3-pycparser noarch 2.14-14.el8 rhel-8-for-x86_64-baseos-rpms 109 k 2023-07-05T18:53:33.204 INFO:teuthology.orchestra.run.smithi073.stdout: python3-pytz noarch 2017.2-9.el8 rhel-8-for-x86_64-appstream-rpms 54 k 2023-07-05T18:53:33.204 INFO:teuthology.orchestra.run.smithi073.stdout: python3-repoze-lru noarch 0.7-6.el8 epel 34 k 2023-07-05T18:53:33.205 INFO:teuthology.orchestra.run.smithi073.stdout: python3-requests-oauthlib noarch 1.0.0-1.el8 rhel-8-for-x86_64-baseos-rpms 43 k 2023-07-05T18:53:33.208 INFO:teuthology.orchestra.run.smithi073.stdout: python3-routes noarch 2.4.1-12.el8 epel 196 k 2023-07-05T18:53:33.208 INFO:teuthology.orchestra.run.smithi073.stdout: python3-rsa noarch 4.8-1.el8 epel 61 k 2023-07-05T18:53:33.208 INFO:teuthology.orchestra.run.smithi073.stdout: python3-scipy x86_64 1.0.0-21.module+el8.5.0+10916+41bd434d rhel-8-for-x86_64-appstream-rpms 14 M 2023-07-05T18:53:33.209 INFO:teuthology.orchestra.run.smithi073.stdout: python3-simplegeneric noarch 0.8.1-17.el8 epel 19 k 2023-07-05T18:53:33.209 INFO:teuthology.orchestra.run.smithi073.stdout: python3-singledispatch noarch 3.4.0.3-18.el8 epel 24 k 2023-07-05T18:53:33.209 INFO:teuthology.orchestra.run.smithi073.stdout: python3-tempora noarch 1.14.1-5.el8 epel 29 k 2023-07-05T18:53:33.209 INFO:teuthology.orchestra.run.smithi073.stdout: python3-trustme noarch 0.6.0-4.el8 epel 27 k 2023-07-05T18:53:33.209 INFO:teuthology.orchestra.run.smithi073.stdout: python3-waitress noarch 1.4.3-1.el8 epel 255 k 2023-07-05T18:53:33.209 INFO:teuthology.orchestra.run.smithi073.stdout: python3-webob noarch 1.8.5-1.el8.1 epel 251 k 2023-07-05T18:53:33.210 INFO:teuthology.orchestra.run.smithi073.stdout: python3-websocket-client noarch 0.56.0-5.el8 epel 61 k 2023-07-05T18:53:33.210 INFO:teuthology.orchestra.run.smithi073.stdout: python3-webtest noarch 2.0.33-1.el8 epel 85 k 2023-07-05T18:53:33.210 INFO:teuthology.orchestra.run.smithi073.stdout: python3-werkzeug noarch 0.12.2-4.el8 rhel-8-for-x86_64-appstream-rpms 457 k 2023-07-05T18:53:33.210 INFO:teuthology.orchestra.run.smithi073.stdout: python3-zc-lockfile noarch 2.0-2.el8 epel 23 k 2023-07-05T18:53:33.211 INFO:teuthology.orchestra.run.smithi073.stdout: socat x86_64 1.7.4.1-1.el8 rhel-8-for-x86_64-appstream-rpms 323 k 2023-07-05T18:53:33.211 INFO:teuthology.orchestra.run.smithi073.stdout: thrift x86_64 0.13.0-2.el8 epel 1.7 M 2023-07-05T18:53:33.211 INFO:teuthology.orchestra.run.smithi073.stdout: uuid x86_64 1.6.2-43.el8 rhel-8-for-x86_64-appstream-rpms 64 k 2023-07-05T18:53:33.211 INFO:teuthology.orchestra.run.smithi073.stdout: xmlstarlet x86_64 1.6.1-20.el8 lab-extras 70 k 2023-07-05T18:53:33.211 INFO:teuthology.orchestra.run.smithi073.stdout: zlib-devel x86_64 1.2.11-18.el8_5 rhel-8-for-x86_64-baseos-rpms 58 k 2023-07-05T18:53:33.211 INFO:teuthology.orchestra.run.smithi073.stdout:Enabling module streams: 2023-07-05T18:53:33.211 INFO:teuthology.orchestra.run.smithi073.stdout: postgresql 10 2023-07-05T18:53:33.211 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-07-05T18:53:33.212 INFO:teuthology.orchestra.run.smithi073.stdout:Transaction Summary 2023-07-05T18:53:33.212 INFO:teuthology.orchestra.run.smithi073.stdout:=========================================================================================================================== 2023-07-05T18:53:33.212 INFO:teuthology.orchestra.run.smithi073.stdout:Install 128 Packages 2023-07-05T18:53:33.212 INFO:teuthology.orchestra.run.smithi073.stdout:Upgrade 3 Packages 2023-07-05T18:53:33.212 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-07-05T18:53:33.213 INFO:teuthology.orchestra.run.smithi073.stdout:Total download size: 205 M 2023-07-05T18:53:33.213 INFO:teuthology.orchestra.run.smithi073.stdout:Downloading Packages: 2023-07-05T18:53:33.484 INFO:teuthology.orchestra.run.smithi046.stdout:(7/131): ceph-osd-18.0.0-4488.g0a781ef0.el8.x86 11 MB/s | 18 MB 00:01 2023-07-05T18:53:33.551 INFO:teuthology.orchestra.run.smithi073.stdout:(1/131): ceph-18.0.0-4488.g0a781ef0.el8.x86_64. 34 kB/s | 6.4 kB 00:00 2023-07-05T18:53:34.384 INFO:teuthology.orchestra.run.smithi046.stdout:(8/131): ceph-radosgw-18.0.0-4488.g0a781ef0.el8 15 MB/s | 13 MB 00:00 2023-07-05T18:53:34.451 INFO:teuthology.orchestra.run.smithi073.stdout:(2/131): ceph-fuse-18.0.0-4488.g0a781ef0.el8.x8 942 kB/s | 848 kB 00:00 2023-07-05T18:53:34.476 INFO:teuthology.orchestra.run.smithi046.stdout:(9/131): ceph-selinux-18.0.0-4488.g0a781ef0.el8 266 kB/s | 24 kB 00:00 2023-07-05T18:53:34.651 INFO:teuthology.orchestra.run.smithi073.stdout:(3/131): ceph-immutable-object-cache-18.0.0-448 827 kB/s | 165 kB 00:00 2023-07-05T18:53:35.243 INFO:teuthology.orchestra.run.smithi046.stdout:(10/131): ceph-common-18.0.0-4488.g0a781ef0.el8 5.2 MB/s | 22 MB 00:04 2023-07-05T18:53:35.486 INFO:teuthology.orchestra.run.smithi046.stdout:(11/131): ceph-mon-18.0.0-4488.g0a781ef0.el8.x8 1.2 MB/s | 4.6 MB 00:03 2023-07-05T18:53:35.519 INFO:teuthology.orchestra.run.smithi046.stdout:(12/131): cephfs-mirror-18.0.0-4488.g0a781ef0.e 939 kB/s | 258 kB 00:00 2023-07-05T18:53:35.568 INFO:teuthology.orchestra.run.smithi046.stdout:(13/131): libcephfs-devel-18.0.0-4488.g0a781ef0 372 kB/s | 31 kB 00:00 2023-07-05T18:53:35.736 INFO:teuthology.orchestra.run.smithi046.stdout:(14/131): libcephfs2-18.0.0-4488.g0a781ef0.el8. 3.5 MB/s | 771 kB 00:00 2023-07-05T18:53:35.786 INFO:teuthology.orchestra.run.smithi046.stdout:(15/131): libcephsqlite-18.0.0-4488.g0a781ef0.e 633 kB/s | 137 kB 00:00 2023-07-05T18:53:35.844 INFO:teuthology.orchestra.run.smithi046.stdout:(16/131): librados-devel-18.0.0-4488.g0a781ef0. 1.2 MB/s | 139 kB 00:00 2023-07-05T18:53:36.111 INFO:teuthology.orchestra.run.smithi046.stdout:(17/131): libradosstriper1-18.0.0-4488.g0a781ef 1.4 MB/s | 473 kB 00:00 2023-07-05T18:53:36.220 INFO:teuthology.orchestra.run.smithi046.stdout:(18/131): python3-ceph-argparse-18.0.0-4488.g0a 413 kB/s | 45 kB 00:00 2023-07-05T18:53:36.353 INFO:teuthology.orchestra.run.smithi046.stdout:(19/131): python3-ceph-common-18.0.0-4488.g0a78 891 kB/s | 119 kB 00:00 2023-07-05T18:53:36.377 INFO:teuthology.orchestra.run.smithi073.stdout:(4/131): ceph-mds-18.0.0-4488.g0a781ef0.el8.x86 1.3 MB/s | 2.3 MB 00:01 2023-07-05T18:53:36.519 INFO:teuthology.orchestra.run.smithi073.stdout:(5/131): ceph-base-18.0.0-4488.g0a781ef0.el8.x8 1.7 MB/s | 5.4 MB 00:03 2023-07-05T18:53:36.563 INFO:teuthology.orchestra.run.smithi046.stdout:(20/131): python3-cephfs-18.0.0-4488.g0a781ef0. 948 kB/s | 197 kB 00:00 2023-07-05T18:53:36.721 INFO:teuthology.orchestra.run.smithi046.stdout:(21/131): librgw2-18.0.0-4488.g0a781ef0.el8.x86 7.7 MB/s | 6.7 MB 00:00 2023-07-05T18:53:36.881 INFO:teuthology.orchestra.run.smithi046.stdout:(22/131): python3-rbd-18.0.0-4488.g0a781ef0.el8 2.3 MB/s | 364 kB 00:00 2023-07-05T18:53:36.905 INFO:teuthology.orchestra.run.smithi046.stdout:(23/131): python3-rados-18.0.0-4488.g0a781ef0.e 1.1 MB/s | 371 kB 00:00 2023-07-05T18:53:37.005 INFO:teuthology.orchestra.run.smithi046.stdout:(24/131): python3-rgw-18.0.0-4488.g0a781ef0.el8 853 kB/s | 107 kB 00:00 2023-07-05T18:53:37.010 INFO:teuthology.orchestra.run.smithi073.stdout:(6/131): ceph-mgr-18.0.0-4488.g0a781ef0.el8.x86 2.4 MB/s | 1.5 MB 00:00 2023-07-05T18:53:37.030 INFO:teuthology.orchestra.run.smithi046.stdout:(25/131): rbd-fuse-18.0.0-4488.g0a781ef0.el8.x8 753 kB/s | 94 kB 00:00 2023-07-05T18:53:37.314 INFO:teuthology.orchestra.run.smithi046.stdout:(26/131): rbd-nbd-18.0.0-4488.g0a781ef0.el8.x86 634 kB/s | 180 kB 00:00 2023-07-05T18:53:37.448 INFO:teuthology.orchestra.run.smithi046.stdout:(27/131): ceph-grafana-dashboards-18.0.0-4488.g 173 kB/s | 23 kB 00:00 2023-07-05T18:53:37.573 INFO:teuthology.orchestra.run.smithi046.stdout:(28/131): rbd-mirror-18.0.0-4488.g0a781ef0.el8. 6.1 MB/s | 3.4 MB 00:00 2023-07-05T18:53:37.594 INFO:teuthology.orchestra.run.smithi073.stdout:(7/131): ceph-mon-18.0.0-4488.g0a781ef0.el8.x86 4.3 MB/s | 4.6 MB 00:01 2023-07-05T18:53:37.598 INFO:teuthology.orchestra.run.smithi046.stdout:(29/131): ceph-mgr-cephadm-18.0.0-4488.g0a781ef 852 kB/s | 128 kB 00:00 2023-07-05T18:53:37.881 INFO:teuthology.orchestra.run.smithi046.stdout:(30/131): ceph-mgr-dashboard-18.0.0-4488.g0a781 5.5 MB/s | 1.7 MB 00:00 2023-07-05T18:53:37.998 INFO:teuthology.orchestra.run.smithi046.stdout:(31/131): ceph-mgr-modules-core-18.0.0-4488.g0a 2.0 MB/s | 240 kB 00:00 2023-07-05T18:53:38.099 INFO:teuthology.orchestra.run.smithi046.stdout:(32/131): ceph-mgr-rook-18.0.0-4488.g0a781ef0.e 474 kB/s | 47 kB 00:00 2023-07-05T18:53:38.190 INFO:teuthology.orchestra.run.smithi046.stdout:(33/131): ceph-prometheus-alerts-18.0.0-4488.g0 159 kB/s | 15 kB 00:00 2023-07-05T18:53:38.624 INFO:teuthology.orchestra.run.smithi046.stdout:(34/131): ceph-test-18.0.0-4488.g0a781ef0.el8.x 11 MB/s | 48 MB 00:04 2023-07-05T18:53:38.650 INFO:teuthology.orchestra.run.smithi046.stdout:(35/131): ceph-volume-18.0.0-4488.g0a781ef0.el8 563 kB/s | 258 kB 00:00 2023-07-05T18:53:38.737 INFO:teuthology.orchestra.run.smithi046.stdout:(36/131): cephadm-18.0.0-4488.g0a781ef0.el8.noa 1.5 MB/s | 161 kB 00:00 2023-07-05T18:53:38.758 INFO:teuthology.orchestra.run.smithi046.stdout:(37/131): cephfs-top-18.0.0-4488.g0a781ef0.el8. 166 kB/s | 18 kB 00:00 2023-07-05T18:53:39.269 INFO:teuthology.orchestra.run.smithi073.stdout:(8/131): ceph-osd-18.0.0-4488.g0a781ef0.el8.x86 7.8 MB/s | 18 MB 00:02 2023-07-05T18:53:39.352 INFO:teuthology.orchestra.run.smithi073.stdout:(9/131): ceph-selinux-18.0.0-4488.g0a781ef0.el8 292 kB/s | 24 kB 00:00 2023-07-05T18:53:39.367 INFO:teuthology.orchestra.run.smithi046.stdout:(38/131): liboath-2.6.2-3.el8.x86_64.rpm 97 kB/s | 59 kB 00:00 2023-07-05T18:53:39.509 INFO:teuthology.orchestra.run.smithi046.stdout:(39/131): libunwind-1.3.1-3.el8.x86_64.rpm 530 kB/s | 75 kB 00:00 2023-07-05T18:53:39.959 INFO:teuthology.orchestra.run.smithi046.stdout:(40/131): gperftools-libs-2.7-9.el8.x86_64.rpm 250 kB/s | 306 kB 00:01 2023-07-05T18:53:40.102 INFO:teuthology.orchestra.run.smithi073.stdout:(10/131): ceph-common-18.0.0-4488.g0a781ef0.el8 3.3 MB/s | 22 MB 00:06 2023-07-05T18:53:40.168 INFO:teuthology.orchestra.run.smithi046.stdout:(41/131): python3-bcrypt-3.1.6-2.el8.1.x86_64.r 209 kB/s | 44 kB 00:00 2023-07-05T18:53:40.193 INFO:teuthology.orchestra.run.smithi046.stdout:(42/131): python3-asyncssh-2.7.0-2.el8.noarch.r 696 kB/s | 476 kB 00:00 2023-07-05T18:53:40.219 INFO:teuthology.orchestra.run.smithi073.stdout:(11/131): cephfs-mirror-18.0.0-4488.g0a781ef0.e 2.2 MB/s | 258 kB 00:00 2023-07-05T18:53:40.327 INFO:teuthology.orchestra.run.smithi046.stdout:(43/131): python3-cachetools-3.1.1-4.el8.noarch 247 kB/s | 33 kB 00:00 2023-07-05T18:53:40.394 INFO:teuthology.orchestra.run.smithi046.stdout:(44/131): python3-beautifulsoup4-4.6.3-2.el8.1. 821 kB/s | 185 kB 00:00 2023-07-05T18:53:40.394 INFO:teuthology.orchestra.run.smithi073.stdout:(12/131): ceph-radosgw-18.0.0-4488.g0a781ef0.el 4.8 MB/s | 13 MB 00:02 2023-07-05T18:53:40.412 INFO:teuthology.orchestra.run.smithi073.stdout:(13/131): libcephfs-devel-18.0.0-4488.g0a781ef0 161 kB/s | 31 kB 00:00 2023-07-05T18:53:40.436 INFO:teuthology.orchestra.run.smithi046.stdout:(45/131): python3-certifi-2018.10.15-7.el8.noar 150 kB/s | 16 kB 00:00 2023-07-05T18:53:40.488 INFO:teuthology.orchestra.run.smithi073.stdout:(14/131): libcephsqlite-18.0.0-4488.g0a781ef0.e 1.8 MB/s | 137 kB 00:00 2023-07-05T18:53:40.554 INFO:teuthology.orchestra.run.smithi073.stdout:(15/131): libcephfs2-18.0.0-4488.g0a781ef0.el8. 4.7 MB/s | 771 kB 00:00 2023-07-05T18:53:40.579 INFO:teuthology.orchestra.run.smithi073.stdout:(16/131): librados-devel-18.0.0-4488.g0a781ef0. 1.5 MB/s | 139 kB 00:00 2023-07-05T18:53:40.596 INFO:teuthology.orchestra.run.smithi046.stdout:(46/131): python3-cheroot-8.5.2-1.el8.noarch.rp 862 kB/s | 173 kB 00:00 2023-07-05T18:53:40.682 INFO:teuthology.orchestra.run.smithi073.stdout:(17/131): libradosstriper1-18.0.0-4488.g0a781ef 3.7 MB/s | 473 kB 00:00 2023-07-05T18:53:40.703 INFO:teuthology.orchestra.run.smithi046.stdout:(47/131): python3-google-auth-1.1.1-10.el8.noar 751 kB/s | 81 kB 00:00 2023-07-05T18:53:40.757 INFO:teuthology.orchestra.run.smithi073.stdout:(18/131): python3-ceph-argparse-18.0.0-4488.g0a 594 kB/s | 45 kB 00:00 2023-07-05T18:53:40.828 INFO:teuthology.orchestra.run.smithi046.stdout:(48/131): python3-cherrypy-18.4.0-1.el8.noarch. 980 kB/s | 384 kB 00:00 2023-07-05T18:53:40.830 INFO:teuthology.orchestra.run.smithi073.stdout:(19/131): python3-ceph-common-18.0.0-4488.g0a78 1.5 MB/s | 119 kB 00:00 2023-07-05T18:53:40.845 INFO:teuthology.orchestra.run.smithi046.stdout:(49/131): python3-jaraco-6.2-6.el8.noarch.rpm 78 kB/s | 11 kB 00:00 2023-07-05T18:53:40.914 INFO:teuthology.orchestra.run.smithi073.stdout:(20/131): python3-cephfs-18.0.0-4488.g0a781ef0. 2.3 MB/s | 197 kB 00:00 2023-07-05T18:53:41.004 INFO:teuthology.orchestra.run.smithi046.stdout:(50/131): ceph-mgr-diskprediction-local-18.0.0- 2.2 MB/s | 7.4 MB 00:03 2023-07-05T18:53:41.021 INFO:teuthology.orchestra.run.smithi046.stdout:(51/131): python3-jaraco-functools-2.0-4.el8.no 91 kB/s | 18 kB 00:00 2023-07-05T18:53:41.039 INFO:teuthology.orchestra.run.smithi073.stdout:(21/131): python3-rados-18.0.0-4488.g0a781ef0.e 2.9 MB/s | 371 kB 00:00 2023-07-05T18:53:41.121 INFO:teuthology.orchestra.run.smithi046.stdout:(52/131): python3-more-itertools-7.2.0-3.el8.no 588 kB/s | 59 kB 00:00 2023-07-05T18:53:41.173 INFO:teuthology.orchestra.run.smithi073.stdout:(22/131): python3-rbd-18.0.0-4488.g0a781ef0.el8 2.7 MB/s | 364 kB 00:00 2023-07-05T18:53:41.221 INFO:teuthology.orchestra.run.smithi046.stdout:(53/131): python3-natsort-7.1.1-2.el8.noarch.rp 602 kB/s | 60 kB 00:00 2023-07-05T18:53:41.256 INFO:teuthology.orchestra.run.smithi073.stdout:(23/131): python3-rgw-18.0.0-4488.g0a781ef0.el8 1.3 MB/s | 107 kB 00:00 2023-07-05T18:53:41.331 INFO:teuthology.orchestra.run.smithi073.stdout:(24/131): rbd-fuse-18.0.0-4488.g0a781ef0.el8.x8 1.2 MB/s | 94 kB 00:00 2023-07-05T18:53:41.464 INFO:teuthology.orchestra.run.smithi046.stdout:(54/131): python3-logutils-0.3.5-11.el8.noarch. 106 kB/s | 49 kB 00:00 2023-07-05T18:53:41.497 INFO:teuthology.orchestra.run.smithi046.stdout:(55/131): python3-pecan-1.3.2-9.el8.noarch.rpm 1.0 MB/s | 283 kB 00:00 2023-07-05T18:53:41.573 INFO:teuthology.orchestra.run.smithi046.stdout:(56/131): python3-portend-2.6-1.el8.noarch.rpm 143 kB/s | 16 kB 00:00 2023-07-05T18:53:41.598 INFO:teuthology.orchestra.run.smithi046.stdout:(57/131): python3-repoze-lru-0.7-6.el8.noarch.r 336 kB/s | 34 kB 00:00 2023-07-05T18:53:41.703 INFO:teuthology.orchestra.run.smithi046.stdout:(58/131): python3-rsa-4.8-1.el8.noarch.rpm 616 kB/s | 61 kB 00:00 2023-07-05T18:53:41.798 INFO:teuthology.orchestra.run.smithi046.stdout:(59/131): python3-simplegeneric-0.8.1-17.el8.no 187 kB/s | 19 kB 00:00 2023-07-05T18:53:41.820 INFO:teuthology.orchestra.run.smithi073.stdout:(25/131): librgw2-18.0.0-4488.g0a781ef0.el8.x86 5.5 MB/s | 6.7 MB 00:01 2023-07-05T18:53:41.832 INFO:teuthology.orchestra.run.smithi046.stdout:(60/131): python3-kubernetes-11.0.0-6.el8.noarc 1.2 MB/s | 1.2 MB 00:00 2023-07-05T18:53:41.865 INFO:teuthology.orchestra.run.smithi046.stdout:(61/131): python3-routes-2.4.1-12.el8.noarch.rp 671 kB/s | 196 kB 00:00 2023-07-05T18:53:41.899 INFO:teuthology.orchestra.run.smithi046.stdout:(62/131): python3-singledispatch-3.4.0.3-18.el8 238 kB/s | 24 kB 00:00 2023-07-05T18:53:41.907 INFO:teuthology.orchestra.run.smithi073.stdout:(26/131): rbd-nbd-18.0.0-4488.g0a781ef0.el8.x86 1.9 MB/s | 180 kB 00:00 2023-07-05T18:53:41.932 INFO:teuthology.orchestra.run.smithi046.stdout:(63/131): python3-tempora-1.14.1-5.el8.noarch.r 291 kB/s | 29 kB 00:00 2023-07-05T18:53:41.966 INFO:teuthology.orchestra.run.smithi073.stdout:(27/131): rbd-mirror-18.0.0-4488.g0a781ef0.el8. 5.4 MB/s | 3.4 MB 00:00 2023-07-05T18:53:41.967 INFO:teuthology.orchestra.run.smithi046.stdout:(64/131): python3-trustme-0.6.0-4.el8.noarch.rp 274 kB/s | 27 kB 00:00 2023-07-05T18:53:41.991 INFO:teuthology.orchestra.run.smithi073.stdout:(28/131): ceph-grafana-dashboards-18.0.0-4488.g 276 kB/s | 23 kB 00:00 2023-07-05T18:53:42.053 INFO:teuthology.orchestra.run.smithi073.stdout:(29/131): ceph-mgr-cephadm-18.0.0-4488.g0a781ef 1.5 MB/s | 128 kB 00:00 2023-07-05T18:53:42.069 INFO:teuthology.orchestra.run.smithi046.stdout:(65/131): python3-websocket-client-0.56.0-5.el8 613 kB/s | 61 kB 00:00 2023-07-05T18:53:42.133 INFO:teuthology.orchestra.run.smithi046.stdout:(66/131): python3-webob-1.8.5-1.el8.1.noarch.rp 1.2 MB/s | 251 kB 00:00 2023-07-05T18:53:42.192 INFO:teuthology.orchestra.run.smithi046.stdout:(67/131): python3-waitress-1.4.3-1.el8.noarch.r 872 kB/s | 255 kB 00:00 2023-07-05T18:53:42.208 INFO:teuthology.orchestra.run.smithi046.stdout:(68/131): python3-webtest-2.0.33-1.el8.noarch.r 600 kB/s | 85 kB 00:00 2023-07-05T18:53:42.234 INFO:teuthology.orchestra.run.smithi046.stdout:(69/131): xmlstarlet-1.6.1-20.el8.x86_64.rpm 2.7 MB/s | 70 kB 00:00 2023-07-05T18:53:42.259 INFO:teuthology.orchestra.run.smithi046.stdout:(70/131): python3-zc-lockfile-2.0-2.el8.noarch. 182 kB/s | 23 kB 00:00 2023-07-05T18:53:42.325 INFO:teuthology.orchestra.run.smithi073.stdout:(30/131): ceph-mgr-dashboard-18.0.0-4488.g0a781 5.1 MB/s | 1.7 MB 00:00 2023-07-05T18:53:42.326 INFO:teuthology.orchestra.run.smithi046.stdout:(71/131): librabbitmq-0.9.0-3.el8.x86_64.rpm 509 kB/s | 47 kB 00:00 2023-07-05T18:53:42.376 INFO:teuthology.orchestra.run.smithi046.stdout:(72/131): libselinux-devel-2.9-5.el8.x86_64.rpm 1.7 MB/s | 200 kB 00:00 2023-07-05T18:53:42.402 INFO:teuthology.orchestra.run.smithi046.stdout:(73/131): python3-jwt-1.6.1-2.el8.noarch.rpm 566 kB/s | 43 kB 00:00 2023-07-05T18:53:42.425 INFO:teuthology.orchestra.run.smithi073.stdout:(31/131): ceph-mgr-modules-core-18.0.0-4488.g0a 2.3 MB/s | 240 kB 00:00 2023-07-05T18:53:42.426 INFO:teuthology.orchestra.run.smithi046.stdout:(74/131): pcre2-utf32-10.32-2.el8.x86_64.rpm 4.3 MB/s | 220 kB 00:00 2023-07-05T18:53:42.452 INFO:teuthology.orchestra.run.smithi046.stdout:(75/131): keyutils-libs-devel-1.5.10-9.el8.x86_ 959 kB/s | 48 kB 00:00 2023-07-05T18:53:42.478 INFO:teuthology.orchestra.run.smithi046.stdout:(76/131): libsepol-devel-2.9-3.el8.x86_64.rpm 1.7 MB/s | 87 kB 00:00 2023-07-05T18:53:42.504 INFO:teuthology.orchestra.run.smithi046.stdout:(77/131): python3-requests-oauthlib-1.0.0-1.el8 849 kB/s | 43 kB 00:00 2023-07-05T18:53:42.509 INFO:teuthology.orchestra.run.smithi073.stdout:(32/131): ceph-mgr-rook-18.0.0-4488.g0a781ef0.e 568 kB/s | 47 kB 00:00 2023-07-05T18:53:42.528 INFO:teuthology.orchestra.run.smithi046.stdout:(78/131): python3-pycparser-2.14-14.el8.noarch. 2.1 MB/s | 109 kB 00:00 2023-07-05T18:53:42.553 INFO:teuthology.orchestra.run.smithi046.stdout:(79/131): pcre2-utf16-10.32-2.el8.x86_64.rpm 4.5 MB/s | 229 kB 00:00 2023-07-05T18:53:42.587 INFO:teuthology.orchestra.run.smithi046.stdout:(80/131): krb5-devel-1.18.2-14.el8.x86_64.rpm 9.3 MB/s | 560 kB 00:00 2023-07-05T18:53:42.593 INFO:teuthology.orchestra.run.smithi073.stdout:(33/131): ceph-prometheus-alerts-18.0.0-4488.g0 174 kB/s | 15 kB 00:00 2023-07-05T18:53:42.617 INFO:teuthology.orchestra.run.smithi046.stdout:(81/131): libaio-devel-0.3.112-1.el8.x86_64.rpm 318 kB/s | 19 kB 00:00 2023-07-05T18:53:42.639 INFO:teuthology.orchestra.run.smithi046.stdout:(82/131): python3-oauthlib-2.1.0-1.el8.noarch.r 3.0 MB/s | 155 kB 00:00 2023-07-05T18:53:42.671 INFO:teuthology.orchestra.run.smithi046.stdout:(83/131): python3-cryptography-3.2.1-5.el8.x86_ 9.4 MB/s | 559 kB 00:00 2023-07-05T18:53:42.693 INFO:teuthology.orchestra.run.smithi073.stdout:(34/131): ceph-volume-18.0.0-4488.g0a781ef0.el8 2.5 MB/s | 258 kB 00:00 2023-07-05T18:53:42.698 INFO:teuthology.orchestra.run.smithi046.stdout:(84/131): libverto-devel-0.3.0-5.el8.x86_64.rpm 305 kB/s | 18 kB 00:00 2023-07-05T18:53:42.742 INFO:teuthology.orchestra.run.smithi046.stdout:(85/131): pcre2-devel-10.32-2.el8.x86_64.rpm 8.8 MB/s | 605 kB 00:00 2023-07-05T18:53:42.764 INFO:teuthology.orchestra.run.smithi046.stdout:(86/131): python3-cffi-1.11.5-5.el8.x86_64.rpm 3.5 MB/s | 238 kB 00:00 2023-07-05T18:53:42.785 INFO:teuthology.orchestra.run.smithi073.stdout:(35/131): cephadm-18.0.0-4488.g0a781ef0.el8.noa 1.7 MB/s | 161 kB 00:00 2023-07-05T18:53:42.814 INFO:teuthology.orchestra.run.smithi046.stdout:(87/131): xfsprogs-devel-5.0.0-10.el8.x86_64.rp 1.4 MB/s | 72 kB 00:00 2023-07-05T18:53:42.865 INFO:teuthology.orchestra.run.smithi046.stdout:(88/131): openssl-devel-1.1.1k-7.el8_6.x86_64.r 19 MB/s | 2.3 MB 00:00 2023-07-05T18:53:42.889 INFO:teuthology.orchestra.run.smithi046.stdout:(89/131): fuse-2.9.7-15.el8.x86_64.rpm 1.1 MB/s | 83 kB 00:00 2023-07-05T18:53:42.906 INFO:teuthology.orchestra.run.smithi046.stdout:(90/131): elfutils-libelf-devel-0.186-1.el8.x86 1.4 MB/s | 60 kB 00:00 2023-07-05T18:53:42.932 INFO:teuthology.orchestra.run.smithi046.stdout:(91/131): libuuid-devel-2.32.1-35.el8.x86_64.rp 2.3 MB/s | 98 kB 00:00 2023-07-05T18:53:42.949 INFO:teuthology.orchestra.run.smithi046.stdout:(92/131): zlib-devel-1.2.11-18.el8_5.x86_64.rpm 1.3 MB/s | 58 kB 00:00 2023-07-05T18:53:42.975 INFO:teuthology.orchestra.run.smithi046.stdout:(93/131): libcom_err-devel-1.45.6-4.el8.x86_64. 924 kB/s | 39 kB 00:00 2023-07-05T18:53:43.008 INFO:teuthology.orchestra.run.smithi046.stdout:(94/131): libgfortran-8.5.0-10.1.el8_6.x86_64.r 11 MB/s | 644 kB 00:00 2023-07-05T18:53:43.028 INFO:teuthology.orchestra.run.smithi046.stdout:(95/131): libquadmath-8.5.0-10.1.el8_6.x86_64.r 3.3 MB/s | 171 kB 00:00 2023-07-05T18:53:43.066 INFO:teuthology.orchestra.run.smithi046.stdout:(96/131): NetworkManager-initscripts-updown-1.3 2.3 MB/s | 138 kB 00:00 2023-07-05T18:53:43.121 INFO:teuthology.orchestra.run.smithi046.stdout:(97/131): python3-pyasn1-modules-0.3.7-6.el8.no 2.2 MB/s | 110 kB 00:00 2023-07-05T18:53:43.167 INFO:teuthology.orchestra.run.smithi046.stdout:(98/131): python3-pytz-2017.2-9.el8.noarch.rpm 1.1 MB/s | 54 kB 00:00 2023-07-05T18:53:43.217 INFO:teuthology.orchestra.run.smithi046.stdout:(99/131): lttng-ust-2.8.1-11.el8.x86_64.rpm 5.1 MB/s | 259 kB 00:00 2023-07-05T18:53:43.235 INFO:teuthology.orchestra.run.smithi073.stdout:(36/131): ceph-test-18.0.0-4488.g0a781ef0.el8.x 12 MB/s | 48 MB 00:03 2023-07-05T18:53:43.260 INFO:teuthology.orchestra.run.smithi073.stdout:(37/131): cephfs-top-18.0.0-4488.g0a781ef0.el8. 38 kB/s | 18 kB 00:00 2023-07-05T18:53:43.277 INFO:teuthology.orchestra.run.smithi046.stdout:(100/131): socat-1.7.4.1-1.el8.x86_64.rpm 5.4 MB/s | 323 kB 00:00 2023-07-05T18:53:43.326 INFO:teuthology.orchestra.run.smithi046.stdout:(101/131): python3-markupsafe-0.23-19.el8.x86_6 780 kB/s | 39 kB 00:00 2023-07-05T18:53:43.485 INFO:teuthology.orchestra.run.smithi046.stdout:(102/131): python3-scipy-1.0.0-21.module+el8.5. 30 MB/s | 14 MB 00:00 2023-07-05T18:53:43.494 INFO:teuthology.orchestra.run.smithi073.stdout:(38/131): liboath-2.6.2-3.el8.x86_64.rpm 252 kB/s | 59 kB 00:00 2023-07-05T18:53:43.518 INFO:teuthology.orchestra.run.smithi046.stdout:(103/131): bison-3.0.4-10.el8.x86_64.rpm 3.5 MB/s | 688 kB 00:00 2023-07-05T18:53:43.552 INFO:teuthology.orchestra.run.smithi046.stdout:(104/131): python3-jinja2-2.10.1-3.el8.noarch.r 7.9 MB/s | 538 kB 00:00 2023-07-05T18:53:43.561 INFO:teuthology.orchestra.run.smithi073.stdout:(39/131): gperftools-libs-2.7-9.el8.x86_64.rpm 942 kB/s | 306 kB 00:00 2023-07-05T18:53:43.577 INFO:teuthology.orchestra.run.smithi046.stdout:(105/131): python3-mako-1.0.6-13.el8.noarch.rpm 2.6 MB/s | 157 kB 00:00 2023-07-05T18:53:43.586 INFO:teuthology.orchestra.run.smithi073.stdout:(40/131): libunwind-1.3.1-3.el8.x86_64.rpm 819 kB/s | 75 kB 00:00 2023-07-05T18:53:43.602 INFO:teuthology.orchestra.run.smithi046.stdout:(106/131): oniguruma-6.8.2-2.el8.x86_64.rpm 3.6 MB/s | 187 kB 00:00 2023-07-05T18:53:43.636 INFO:teuthology.orchestra.run.smithi046.stdout:(107/131): automake-1.16.1-7.el8.noarch.rpm 12 MB/s | 713 kB 00:00 2023-07-05T18:53:43.687 INFO:teuthology.orchestra.run.smithi046.stdout:(108/131): python3-jsonpatch-1.21-2.el8.noarch. 530 kB/s | 27 kB 00:00 2023-07-05T18:53:43.720 INFO:teuthology.orchestra.run.smithi073.stdout:(41/131): ceph-mgr-diskprediction-local-18.0.0- 4.4 MB/s | 7.4 MB 00:01 2023-07-05T18:53:43.748 INFO:teuthology.orchestra.run.smithi073.stdout:(42/131): python3-bcrypt-3.1.6-2.el8.1.x86_64.r 275 kB/s | 44 kB 00:00 2023-07-05T18:53:43.779 INFO:teuthology.orchestra.run.smithi073.stdout:(43/131): python3-asyncssh-2.7.0-2.el8.noarch.r 2.1 MB/s | 476 kB 00:00 2023-07-05T18:53:43.780 INFO:teuthology.orchestra.run.smithi046.stdout:(109/131): python3-babel-2.5.1-7.el8.noarch.rpm 27 MB/s | 4.8 MB 00:00 2023-07-05T18:53:43.804 INFO:teuthology.orchestra.run.smithi073.stdout:(44/131): python3-cachetools-3.1.1-4.el8.noarch 563 kB/s | 33 kB 00:00 2023-07-05T18:53:43.821 INFO:teuthology.orchestra.run.smithi046.stdout:(110/131): thrift-0.13.0-2.el8.x86_64.rpm 1.1 MB/s | 1.7 MB 00:01 2023-07-05T18:53:43.837 INFO:teuthology.orchestra.run.smithi073.stdout:(45/131): python3-certifi-2018.10.15-7.el8.noar 301 kB/s | 16 kB 00:00 2023-07-05T18:53:43.846 INFO:teuthology.orchestra.run.smithi046.stdout:(111/131): flex-2.6.1-9.el8.x86_64.rpm 2.0 MB/s | 320 kB 00:00 2023-07-05T18:53:43.890 INFO:teuthology.orchestra.run.smithi046.stdout:(112/131): python3-prettytable-0.7.2-14.el8.noa 394 kB/s | 44 kB 00:00 2023-07-05T18:53:43.924 INFO:teuthology.orchestra.run.smithi073.stdout:(46/131): python3-cherrypy-18.4.0-1.el8.noarch. 4.5 MB/s | 384 kB 00:00 2023-07-05T18:53:43.946 INFO:teuthology.orchestra.run.smithi073.stdout:(47/131): python3-cheroot-8.5.2-1.el8.noarch.rp 1.2 MB/s | 173 kB 00:00 2023-07-05T18:53:43.996 INFO:teuthology.orchestra.run.smithi073.stdout:(48/131): python3-google-auth-1.1.1-10.el8.noar 1.2 MB/s | 81 kB 00:00 2023-07-05T18:53:43.996 INFO:teuthology.orchestra.run.smithi046.stdout:(113/131): python3-numpy-f2py-1.14.3-10.el8.x86 3.5 MB/s | 225 kB 00:00 2023-07-05T18:53:43.997 INFO:teuthology.orchestra.run.smithi046.stdout:(114/131): python3-werkzeug-0.12.2-4.el8.noarch 5.0 MB/s | 457 kB 00:00 2023-07-05T18:53:44.005 INFO:teuthology.orchestra.run.smithi073.stdout:(49/131): python3-jaraco-6.2-6.el8.noarch.rpm 189 kB/s | 11 kB 00:00 2023-07-05T18:53:44.013 INFO:teuthology.orchestra.run.smithi046.stdout:(115/131): uuid-1.6.2-43.el8.x86_64.rpm 1.2 MB/s | 64 kB 00:00 2023-07-05T18:53:44.030 INFO:teuthology.orchestra.run.smithi046.stdout:(116/131): python3-pyasn1-0.3.7-6.el8.noarch.rp 2.9 MB/s | 126 kB 00:00 2023-07-05T18:53:44.047 INFO:teuthology.orchestra.run.smithi073.stdout:(50/131): python3-jaraco-functools-2.0-4.el8.no 300 kB/s | 18 kB 00:00 2023-07-05T18:53:44.064 INFO:teuthology.orchestra.run.smithi046.stdout:(117/131): python3-jsonpointer-1.10-11.el8.noar 399 kB/s | 20 kB 00:00 2023-07-05T18:53:44.081 INFO:teuthology.orchestra.run.smithi073.stdout:(51/131): python3-beautifulsoup4-4.6.3-2.el8.1. 513 kB/s | 185 kB 00:00 2023-07-05T18:53:44.089 INFO:teuthology.orchestra.run.smithi046.stdout:(118/131): python3-pyOpenSSL-19.0.0-1.el8.noarc 1.7 MB/s | 103 kB 00:00 2023-07-05T18:53:44.106 INFO:teuthology.orchestra.run.smithi073.stdout:(52/131): python3-logutils-0.3.5-11.el8.noarch. 834 kB/s | 49 kB 00:00 2023-07-05T18:53:44.131 INFO:teuthology.orchestra.run.smithi046.stdout:(119/131): libtool-2.4.6-25.el8.x86_64.rpm 10 MB/s | 709 kB 00:00 2023-07-05T18:53:44.240 INFO:teuthology.orchestra.run.smithi073.stdout:(53/131): python3-kubernetes-11.0.0-6.el8.noarc 5.0 MB/s | 1.2 MB 00:00 2023-07-05T18:53:44.333 INFO:teuthology.orchestra.run.smithi046.stdout:(120/131): python3-numpy-1.14.3-10.el8.x86_64.r 7.3 MB/s | 3.7 MB 00:00 2023-07-05T18:53:44.356 INFO:teuthology.orchestra.run.smithi046.stdout:(121/131): libpq-13.5-1.el8.x86_64.rpm 877 kB/s | 198 kB 00:00 2023-07-05T18:53:44.398 INFO:teuthology.orchestra.run.smithi073.stdout:(54/131): python3-more-itertools-7.2.0-3.el8.no 185 kB/s | 59 kB 00:00 2023-07-05T18:53:44.415 INFO:teuthology.orchestra.run.smithi046.stdout:(122/131): jq-1.6-3.el8.x86_64.rpm 3.4 MB/s | 202 kB 00:00 2023-07-05T18:53:44.424 INFO:teuthology.orchestra.run.smithi073.stdout:(55/131): python3-natsort-7.1.1-2.el8.noarch.rp 190 kB/s | 60 kB 00:00 2023-07-05T18:53:44.449 INFO:teuthology.orchestra.run.smithi073.stdout:(56/131): python3-pecan-1.3.2-9.el8.noarch.rpm 1.3 MB/s | 283 kB 00:00 2023-07-05T18:53:44.481 INFO:teuthology.orchestra.run.smithi073.stdout:(57/131): python3-portend-2.6-1.el8.noarch.rpm 206 kB/s | 16 kB 00:00 2023-07-05T18:53:44.491 INFO:teuthology.orchestra.run.smithi046.stdout:(123/131): openblas-threads-0.3.15-3.el8.x86_64 12 MB/s | 4.9 MB 00:00 2023-07-05T18:53:44.500 INFO:teuthology.orchestra.run.smithi073.stdout:(58/131): python3-repoze-lru-0.7-6.el8.noarch.r 446 kB/s | 34 kB 00:00 2023-07-05T18:53:44.524 INFO:teuthology.orchestra.run.smithi046.stdout:(124/131): librdkafka-0.11.4-3.el8.x86_64.rpm 3.2 MB/s | 354 kB 00:00 2023-07-05T18:53:44.525 INFO:teuthology.orchestra.run.smithi073.stdout:(59/131): python3-routes-2.4.1-12.el8.noarch.rp 2.5 MB/s | 196 kB 00:00 2023-07-05T18:53:44.550 INFO:teuthology.orchestra.run.smithi073.stdout:(60/131): python3-rsa-4.8-1.el8.noarch.rpm 817 kB/s | 61 kB 00:00 2023-07-05T18:53:44.578 INFO:teuthology.orchestra.run.smithi073.stdout:(61/131): python3-simplegeneric-0.8.1-17.el8.no 248 kB/s | 19 kB 00:00 2023-07-05T18:53:44.599 INFO:teuthology.orchestra.run.smithi046.stdout:(125/131): postgresql-contrib-10.21-2.module+el 11 MB/s | 808 kB 00:00 2023-07-05T18:53:44.600 INFO:teuthology.orchestra.run.smithi073.stdout:(62/131): python3-singledispatch-3.4.0.3-18.el8 317 kB/s | 24 kB 00:00 2023-07-05T18:53:44.626 INFO:teuthology.orchestra.run.smithi073.stdout:(63/131): python3-tempora-1.14.1-5.el8.noarch.r 387 kB/s | 29 kB 00:00 2023-07-05T18:53:44.651 INFO:teuthology.orchestra.run.smithi073.stdout:(64/131): python3-trustme-0.6.0-4.el8.noarch.rp 365 kB/s | 27 kB 00:00 2023-07-05T18:53:44.674 INFO:teuthology.orchestra.run.smithi046.stdout:(126/131): openblas-0.3.15-3.el8.x86_64.rpm 14 MB/s | 4.7 MB 00:00 2023-07-05T18:53:44.702 INFO:teuthology.orchestra.run.smithi073.stdout:(65/131): python3-waitress-1.4.3-1.el8.noarch.r 2.5 MB/s | 255 kB 00:00 2023-07-05T18:53:44.727 INFO:teuthology.orchestra.run.smithi073.stdout:(66/131): python3-websocket-client-0.56.0-5.el8 816 kB/s | 61 kB 00:00 2023-07-05T18:53:44.733 INFO:teuthology.orchestra.run.smithi046.stdout:(127/131): postgresql-10.21-2.module+el8.6.0+15 11 MB/s | 1.5 MB 00:00 2023-07-05T18:53:44.752 INFO:teuthology.orchestra.run.smithi073.stdout:(67/131): python3-webob-1.8.5-1.el8.1.noarch.rp 2.0 MB/s | 251 kB 00:00 2023-07-05T18:53:44.777 INFO:teuthology.orchestra.run.smithi073.stdout:(68/131): python3-webtest-2.0.33-1.el8.noarch.r 1.1 MB/s | 85 kB 00:00 2023-07-05T18:53:44.800 INFO:teuthology.orchestra.run.smithi046.stdout:(128/131): postgresql-server-10.21-2.module+el8 16 MB/s | 5.1 MB 00:00 2023-07-05T18:53:44.803 INFO:teuthology.orchestra.run.smithi073.stdout:(69/131): python3-zc-lockfile-2.0-2.el8.noarch. 304 kB/s | 23 kB 00:00 2023-07-05T18:53:44.828 INFO:teuthology.orchestra.run.smithi073.stdout:(70/131): xmlstarlet-1.6.1-20.el8.x86_64.rpm 1.4 MB/s | 70 kB 00:00 2023-07-05T18:53:44.859 INFO:teuthology.orchestra.run.smithi046.stdout:(129/131): iproute-5.15.0-4.el8_6.1.x86_64.rpm 13 MB/s | 798 kB 00:00 2023-07-05T18:53:44.870 INFO:teuthology.orchestra.run.smithi073.stdout:(71/131): librabbitmq-0.9.0-3.el8.x86_64.rpm 702 kB/s | 47 kB 00:00 2023-07-05T18:53:44.896 INFO:teuthology.orchestra.run.smithi073.stdout:(72/131): libselinux-devel-2.9-5.el8.x86_64.rpm 3.2 MB/s | 200 kB 00:00 2023-07-05T18:53:44.920 INFO:teuthology.orchestra.run.smithi073.stdout:(73/131): python3-jwt-1.6.1-2.el8.noarch.rpm 852 kB/s | 43 kB 00:00 2023-07-05T18:53:44.946 INFO:teuthology.orchestra.run.smithi073.stdout:(74/131): pcre2-utf32-10.32-2.el8.x86_64.rpm 4.3 MB/s | 220 kB 00:00 2023-07-05T18:53:44.971 INFO:teuthology.orchestra.run.smithi073.stdout:(75/131): keyutils-libs-devel-1.5.10-9.el8.x86_ 959 kB/s | 48 kB 00:00 2023-07-05T18:53:45.005 INFO:teuthology.orchestra.run.smithi073.stdout:(76/131): libsepol-devel-2.9-3.el8.x86_64.rpm 1.4 MB/s | 87 kB 00:00 2023-07-05T18:53:45.031 INFO:teuthology.orchestra.run.smithi073.stdout:(77/131): python3-requests-oauthlib-1.0.0-1.el8 727 kB/s | 43 kB 00:00 2023-07-05T18:53:45.057 INFO:teuthology.orchestra.run.smithi073.stdout:(78/131): python3-pycparser-2.14-14.el8.noarch. 2.1 MB/s | 109 kB 00:00 2023-07-05T18:53:45.072 INFO:teuthology.orchestra.run.smithi073.stdout:(79/131): pcre2-utf16-10.32-2.el8.x86_64.rpm 5.3 MB/s | 229 kB 00:00 2023-07-05T18:53:45.085 INFO:teuthology.orchestra.run.smithi046.stdout:(130/131): librbd1-18.0.0-4488.g0a781ef0.el8.x8 10 MB/s | 3.6 MB 00:00 2023-07-05T18:53:45.105 INFO:teuthology.orchestra.run.smithi073.stdout:(80/131): krb5-devel-1.18.2-14.el8.x86_64.rpm 11 MB/s | 560 kB 00:00 2023-07-05T18:53:45.131 INFO:teuthology.orchestra.run.smithi073.stdout:(81/131): libaio-devel-0.3.112-1.el8.x86_64.rpm 319 kB/s | 19 kB 00:00 2023-07-05T18:53:45.156 INFO:teuthology.orchestra.run.smithi073.stdout:(82/131): python3-oauthlib-2.1.0-1.el8.noarch.r 3.0 MB/s | 155 kB 00:00 2023-07-05T18:53:45.190 INFO:teuthology.orchestra.run.smithi073.stdout:(83/131): python3-cryptography-3.2.1-5.el8.x86_ 9.4 MB/s | 559 kB 00:00 2023-07-05T18:53:45.216 INFO:teuthology.orchestra.run.smithi073.stdout:(84/131): libverto-devel-0.3.0-5.el8.x86_64.rpm 305 kB/s | 18 kB 00:00 2023-07-05T18:53:45.257 INFO:teuthology.orchestra.run.smithi073.stdout:(85/131): pcre2-devel-10.32-2.el8.x86_64.rpm 8.8 MB/s | 605 kB 00:00 2023-07-05T18:53:45.299 INFO:teuthology.orchestra.run.smithi073.stdout:(86/131): thrift-0.13.0-2.el8.x86_64.rpm 3.2 MB/s | 1.7 MB 00:00 2023-07-05T18:53:45.327 INFO:teuthology.orchestra.run.smithi073.stdout:(87/131): python3-cffi-1.11.5-5.el8.x86_64.rpm 2.1 MB/s | 238 kB 00:00 2023-07-05T18:53:45.366 INFO:teuthology.orchestra.run.smithi073.stdout:(88/131): fuse-2.9.7-15.el8.x86_64.rpm 2.2 MB/s | 83 kB 00:00 2023-07-05T18:53:45.392 INFO:teuthology.orchestra.run.smithi073.stdout:(89/131): xfsprogs-devel-5.0.0-10.el8.x86_64.rp 786 kB/s | 72 kB 00:00 2023-07-05T18:53:45.420 INFO:teuthology.orchestra.run.smithi073.stdout:(90/131): elfutils-libelf-devel-0.186-1.el8.x86 1.2 MB/s | 60 kB 00:00 2023-07-05T18:53:45.442 INFO:teuthology.orchestra.run.smithi073.stdout:(91/131): libuuid-devel-2.32.1-35.el8.x86_64.rp 1.9 MB/s | 98 kB 00:00 2023-07-05T18:53:45.468 INFO:teuthology.orchestra.run.smithi073.stdout:(92/131): zlib-devel-1.2.11-18.el8_5.x86_64.rpm 1.1 MB/s | 58 kB 00:00 2023-07-05T18:53:45.494 INFO:teuthology.orchestra.run.smithi073.stdout:(93/131): libcom_err-devel-1.45.6-4.el8.x86_64. 768 kB/s | 39 kB 00:00 2023-07-05T18:53:45.543 INFO:teuthology.orchestra.run.smithi073.stdout:(94/131): openssl-devel-1.1.1k-7.el8_6.x86_64.r 8.2 MB/s | 2.3 MB 00:00 2023-07-05T18:53:45.560 INFO:teuthology.orchestra.run.smithi073.stdout:(95/131): libquadmath-8.5.0-10.1.el8_6.x86_64.r 2.5 MB/s | 171 kB 00:00 2023-07-05T18:53:45.593 INFO:teuthology.orchestra.run.smithi073.stdout:(96/131): libgfortran-8.5.0-10.1.el8_6.x86_64.r 5.0 MB/s | 644 kB 00:00 2023-07-05T18:53:45.619 INFO:teuthology.orchestra.run.smithi073.stdout:(97/131): NetworkManager-initscripts-updown-1.3 1.8 MB/s | 138 kB 00:00 2023-07-05T18:53:45.644 INFO:teuthology.orchestra.run.smithi073.stdout:(98/131): python3-pyasn1-modules-0.3.7-6.el8.no 2.1 MB/s | 110 kB 00:00 2023-07-05T18:53:45.669 INFO:teuthology.orchestra.run.smithi073.stdout:(99/131): python3-pytz-2017.2-9.el8.noarch.rpm 1.1 MB/s | 54 kB 00:00 2023-07-05T18:53:45.694 INFO:teuthology.orchestra.run.smithi073.stdout:(100/131): lttng-ust-2.8.1-11.el8.x86_64.rpm 5.1 MB/s | 259 kB 00:00 2023-07-05T18:53:45.728 INFO:teuthology.orchestra.run.smithi073.stdout:(101/131): socat-1.7.4.1-1.el8.x86_64.rpm 5.4 MB/s | 323 kB 00:00 2023-07-05T18:53:45.753 INFO:teuthology.orchestra.run.smithi073.stdout:(102/131): python3-markupsafe-0.23-19.el8.x86_6 664 kB/s | 39 kB 00:00 2023-07-05T18:53:45.787 INFO:teuthology.orchestra.run.smithi073.stdout:(103/131): bison-3.0.4-10.el8.x86_64.rpm 11 MB/s | 688 kB 00:00 2023-07-05T18:53:45.821 INFO:teuthology.orchestra.run.smithi073.stdout:(104/131): python3-jinja2-2.10.1-3.el8.noarch.r 7.9 MB/s | 538 kB 00:00 2023-07-05T18:53:45.826 INFO:teuthology.orchestra.run.smithi046.stdout:(131/131): librados2-18.0.0-4488.g0a781ef0.el8. 3.2 MB/s | 3.7 MB 00:01 2023-07-05T18:53:45.831 INFO:teuthology.orchestra.run.smithi046.stdout:-------------------------------------------------------------------------------- 2023-07-05T18:53:45.831 INFO:teuthology.orchestra.run.smithi046.stdout:Total 13 MB/s | 205 MB 00:15 2023-07-05T18:53:45.838 INFO:teuthology.orchestra.run.smithi073.stdout:(105/131): python3-mako-1.0.6-13.el8.noarch.rpm 3.1 MB/s | 157 kB 00:00 2023-07-05T18:53:45.863 INFO:teuthology.orchestra.run.smithi073.stdout:(106/131): oniguruma-6.8.2-2.el8.x86_64.rpm 4.4 MB/s | 187 kB 00:00 2023-07-05T18:53:45.915 INFO:teuthology.orchestra.run.smithi073.stdout:(107/131): automake-1.16.1-7.el8.noarch.rpm 9.2 MB/s | 713 kB 00:00 2023-07-05T18:53:45.947 INFO:teuthology.orchestra.run.smithi073.stdout:(108/131): python3-jsonpatch-1.21-2.el8.noarch. 798 kB/s | 27 kB 00:00 2023-07-05T18:53:45.997 INFO:teuthology.orchestra.run.smithi073.stdout:(109/131): flex-2.6.1-9.el8.x86_64.rpm 6.3 MB/s | 320 kB 00:00 2023-07-05T18:53:46.031 INFO:teuthology.orchestra.run.smithi073.stdout:(110/131): python3-prettytable-0.7.2-14.el8.noa 1.3 MB/s | 44 kB 00:00 2023-07-05T18:53:46.106 INFO:teuthology.orchestra.run.smithi073.stdout:(111/131): python3-babel-2.5.1-7.el8.noarch.rpm 20 MB/s | 4.8 MB 00:00 2023-07-05T18:53:46.164 INFO:teuthology.orchestra.run.smithi073.stdout:(112/131): python3-werkzeug-0.12.2-4.el8.noarch 7.7 MB/s | 457 kB 00:00 2023-07-05T18:53:46.199 INFO:teuthology.orchestra.run.smithi073.stdout:(113/131): python3-numpy-f2py-1.14.3-10.el8.x86 6.6 MB/s | 225 kB 00:00 2023-07-05T18:53:46.257 INFO:teuthology.orchestra.run.smithi073.stdout:(114/131): python3-numpy-1.14.3-10.el8.x86_64.r 17 MB/s | 3.7 MB 00:00 2023-07-05T18:53:46.282 INFO:teuthology.orchestra.run.smithi073.stdout:(115/131): uuid-1.6.2-43.el8.x86_64.rpm 766 kB/s | 64 kB 00:00 2023-07-05T18:53:46.307 INFO:teuthology.orchestra.run.smithi073.stdout:(116/131): python3-pyasn1-0.3.7-6.el8.noarch.rp 2.5 MB/s | 126 kB 00:00 2023-07-05T18:53:46.334 INFO:teuthology.orchestra.run.smithi073.stdout:(117/131): python3-jsonpointer-1.10-11.el8.noar 397 kB/s | 20 kB 00:00 2023-07-05T18:53:46.358 INFO:teuthology.orchestra.run.smithi073.stdout:(118/131): python3-pyOpenSSL-19.0.0-1.el8.noarc 2.0 MB/s | 103 kB 00:00 2023-07-05T18:53:46.400 INFO:teuthology.orchestra.run.smithi073.stdout:(119/131): libtool-2.4.6-25.el8.x86_64.rpm 10 MB/s | 709 kB 00:00 2023-07-05T18:53:46.550 INFO:teuthology.orchestra.run.smithi073.stdout:(120/131): python3-scipy-1.0.0-21.module+el8.5. 14 MB/s | 14 MB 00:00 2023-07-05T18:53:46.575 INFO:teuthology.orchestra.run.smithi073.stdout:(121/131): libpq-13.5-1.el8.x86_64.rpm 1.1 MB/s | 198 kB 00:00 2023-07-05T18:53:46.617 INFO:teuthology.orchestra.run.smithi073.stdout:(122/131): jq-1.6-3.el8.x86_64.rpm 4.7 MB/s | 202 kB 00:00 2023-07-05T18:53:46.659 INFO:teuthology.orchestra.run.smithi073.stdout:(123/131): librdkafka-0.11.4-3.el8.x86_64.rpm 8.3 MB/s | 354 kB 00:00 2023-07-05T18:53:46.700 INFO:teuthology.orchestra.run.smithi046.stdout:Running transaction check 2023-07-05T18:53:46.745 INFO:teuthology.orchestra.run.smithi073.stdout:(124/131): openblas-threads-0.3.15-3.el8.x86_64 13 MB/s | 4.9 MB 00:00 2023-07-05T18:53:46.826 INFO:teuthology.orchestra.run.smithi073.stdout:(125/131): openblas-0.3.15-3.el8.x86_64.rpm 17 MB/s | 4.7 MB 00:00 2023-07-05T18:53:46.833 INFO:teuthology.orchestra.run.smithi046.stdout:Transaction check succeeded. 2023-07-05T18:53:46.833 INFO:teuthology.orchestra.run.smithi046.stdout:Running transaction test 2023-07-05T18:53:46.869 INFO:teuthology.orchestra.run.smithi073.stdout:(126/131): postgresql-contrib-10.21-2.module+el 6.3 MB/s | 808 kB 00:00 2023-07-05T18:53:46.926 INFO:teuthology.orchestra.run.smithi073.stdout:(127/131): postgresql-10.21-2.module+el8.6.0+15 16 MB/s | 1.5 MB 00:00 2023-07-05T18:53:46.994 INFO:teuthology.orchestra.run.smithi073.stdout:(128/131): postgresql-server-10.21-2.module+el8 15 MB/s | 5.1 MB 00:00 2023-07-05T18:53:47.045 INFO:teuthology.orchestra.run.smithi073.stdout:(129/131): iproute-5.15.0-4.el8_6.1.x86_64.rpm 16 MB/s | 798 kB 00:00 2023-07-05T18:53:47.328 INFO:teuthology.orchestra.run.smithi073.stdout:(130/131): librados2-18.0.0-4488.g0a781ef0.el8. 8.0 MB/s | 3.7 MB 00:00 2023-07-05T18:53:47.678 INFO:teuthology.orchestra.run.smithi073.stdout:(131/131): librbd1-18.0.0-4488.g0a781ef0.el8.x8 4.7 MB/s | 3.6 MB 00:00 2023-07-05T18:53:47.684 INFO:teuthology.orchestra.run.smithi073.stdout:-------------------------------------------------------------------------------- 2023-07-05T18:53:47.685 INFO:teuthology.orchestra.run.smithi073.stdout:Total 14 MB/s | 205 MB 00:14 2023-07-05T18:53:48.005 INFO:teuthology.orchestra.run.smithi046.stdout:Transaction test succeeded. 2023-07-05T18:53:48.010 INFO:teuthology.orchestra.run.smithi046.stdout:Running transaction 2023-07-05T18:53:48.490 INFO:teuthology.orchestra.run.smithi073.stdout:Running transaction check 2023-07-05T18:53:48.611 INFO:teuthology.orchestra.run.smithi073.stdout:Transaction check succeeded. 2023-07-05T18:53:48.611 INFO:teuthology.orchestra.run.smithi073.stdout:Running transaction test 2023-07-05T18:53:49.727 INFO:teuthology.orchestra.run.smithi073.stdout:Transaction test succeeded. 2023-07-05T18:53:49.731 INFO:teuthology.orchestra.run.smithi073.stdout:Running transaction 2023-07-05T18:53:53.154 INFO:teuthology.orchestra.run.smithi046.stdout: Preparing : 1/1 2023-07-05T18:53:53.341 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : thrift-0.13.0-2.el8.x86_64 1/134 2023-07-05T18:53:53.530 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : liboath-2.6.2-3.el8.x86_64 2/134 2023-07-05T18:53:53.694 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : librdkafka-0.11.4-3.el8.x86_64 3/134 2023-07-05T18:53:53.847 INFO:teuthology.orchestra.run.smithi046.stdout: Running scriptlet: librdkafka-0.11.4-3.el8.x86_64 3/134 2023-07-05T18:53:54.018 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : lttng-ust-2.8.1-11.el8.x86_64 4/134 2023-07-05T18:53:54.451 INFO:teuthology.orchestra.run.smithi046.stdout: Running scriptlet: lttng-ust-2.8.1-11.el8.x86_64 4/134 2023-07-05T18:53:54.550 INFO:teuthology.orchestra.run.smithi073.stdout: Preparing : 1/1 2023-07-05T18:53:54.677 INFO:teuthology.orchestra.run.smithi046.stdout: Upgrading : librados2-2:18.0.0-4488.g0a781ef0.el8.x86_64 5/134 2023-07-05T18:53:54.751 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : thrift-0.13.0-2.el8.x86_64 1/134 2023-07-05T18:53:55.088 INFO:teuthology.orchestra.run.smithi046.stdout: Running scriptlet: librados2-2:18.0.0-4488.g0a781ef0.el8.x86_64 5/134 2023-07-05T18:53:55.232 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : liboath-2.6.2-3.el8.x86_64 2/134 2023-07-05T18:53:55.293 INFO:teuthology.orchestra.run.smithi046.stdout: Upgrading : librbd1-2:18.0.0-4488.g0a781ef0.el8.x86_64 6/134 2023-07-05T18:53:55.403 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : librdkafka-0.11.4-3.el8.x86_64 3/134 2023-07-05T18:53:55.421 INFO:teuthology.orchestra.run.smithi046.stdout: Running scriptlet: librbd1-2:18.0.0-4488.g0a781ef0.el8.x86_64 6/134 2023-07-05T18:53:55.534 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: librdkafka-0.11.4-3.el8.x86_64 3/134 2023-07-05T18:53:55.627 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : libcephfs2-2:18.0.0-4488.g0a781ef0.el8.x86_64 7/134 2023-07-05T18:53:55.724 INFO:teuthology.orchestra.run.smithi046.stdout: Running scriptlet: libcephfs2-2:18.0.0-4488.g0a781ef0.el8.x86_64 7/134 2023-07-05T18:53:55.745 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : lttng-ust-2.8.1-11.el8.x86_64 4/134 2023-07-05T18:53:55.890 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-rados-2:18.0.0-4488.g0a781ef0.el8.x86_64 8/134 2023-07-05T18:53:56.070 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : librabbitmq-0.9.0-3.el8.x86_64 9/134 2023-07-05T18:53:56.141 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: lttng-ust-2.8.1-11.el8.x86_64 4/134 2023-07-05T18:53:56.313 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : libpq-13.5-1.el8.x86_64 10/134 2023-07-05T18:53:56.344 INFO:teuthology.orchestra.run.smithi073.stdout: Upgrading : librados2-2:18.0.0-4488.g0a781ef0.el8.x86_64 5/134 2023-07-05T18:53:56.756 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: librados2-2:18.0.0-4488.g0a781ef0.el8.x86_64 5/134 2023-07-05T18:53:56.775 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-pyasn1-0.3.7-6.el8.noarch 11/134 2023-07-05T18:53:56.962 INFO:teuthology.orchestra.run.smithi073.stdout: Upgrading : librbd1-2:18.0.0-4488.g0a781ef0.el8.x86_64 6/134 2023-07-05T18:53:57.086 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: librbd1-2:18.0.0-4488.g0a781ef0.el8.x86_64 6/134 2023-07-05T18:53:57.177 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-more-itertools-7.2.0-3.el8.noarch 12/134 2023-07-05T18:53:57.303 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : libcephfs2-2:18.0.0-4488.g0a781ef0.el8.x86_64 7/134 2023-07-05T18:53:57.400 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: libcephfs2-2:18.0.0-4488.g0a781ef0.el8.x86_64 7/134 2023-07-05T18:53:57.414 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : postgresql-10.21-2.module+el8.6.0+15342+53518fac 13/134 2023-07-05T18:53:57.583 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-rados-2:18.0.0-4488.g0a781ef0.el8.x86_64 8/134 2023-07-05T18:53:57.595 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : libcephsqlite-2:18.0.0-4488.g0a781ef0.el8.x86_64 14/134 2023-07-05T18:53:57.697 INFO:teuthology.orchestra.run.smithi046.stdout: Running scriptlet: libcephsqlite-2:18.0.0-4488.g0a781ef0.el8.x86_64 14/134 2023-07-05T18:53:57.778 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : librabbitmq-0.9.0-3.el8.x86_64 9/134 2023-07-05T18:53:57.876 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : libradosstriper1-2:18.0.0-4488.g0a781ef0.el8.x86 15/134 2023-07-05T18:53:58.030 INFO:teuthology.orchestra.run.smithi046.stdout: Running scriptlet: libradosstriper1-2:18.0.0-4488.g0a781ef0.el8.x86 15/134 2023-07-05T18:53:58.049 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : libpq-13.5-1.el8.x86_64 10/134 2023-07-05T18:53:58.223 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-werkzeug-0.12.2-4.el8.noarch 16/134 2023-07-05T18:53:58.256 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-pyasn1-0.3.7-6.el8.noarch 11/134 2023-07-05T18:53:58.384 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-markupsafe-0.23-19.el8.x86_64 17/134 2023-07-05T18:53:58.542 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-pytz-2017.2-9.el8.noarch 18/134 2023-07-05T18:53:58.668 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : libquadmath-8.5.0-10.1.el8_6.x86_64 19/134 2023-07-05T18:53:58.669 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-more-itertools-7.2.0-3.el8.noarch 12/134 2023-07-05T18:53:58.800 INFO:teuthology.orchestra.run.smithi046.stdout: Running scriptlet: libquadmath-8.5.0-10.1.el8_6.x86_64 19/134 2023-07-05T18:53:58.923 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : postgresql-10.21-2.module+el8.6.0+15342+53518fac 13/134 2023-07-05T18:53:58.934 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : libgfortran-8.5.0-10.1.el8_6.x86_64 20/134 2023-07-05T18:53:59.086 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : libcephsqlite-2:18.0.0-4488.g0a781ef0.el8.x86_64 14/134 2023-07-05T18:53:59.188 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: libcephsqlite-2:18.0.0-4488.g0a781ef0.el8.x86_64 14/134 2023-07-05T18:53:59.356 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : libradosstriper1-2:18.0.0-4488.g0a781ef0.el8.x86 15/134 2023-07-05T18:53:59.533 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: libradosstriper1-2:18.0.0-4488.g0a781ef0.el8.x86 15/134 2023-07-05T18:53:59.584 INFO:teuthology.orchestra.run.smithi046.stdout: Running scriptlet: libgfortran-8.5.0-10.1.el8_6.x86_64 20/134 2023-07-05T18:53:59.715 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-werkzeug-0.12.2-4.el8.noarch 16/134 2023-07-05T18:53:59.768 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : openblas-threads-0.3.15-3.el8.x86_64 21/134 2023-07-05T18:53:59.909 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-markupsafe-0.23-19.el8.x86_64 17/134 2023-07-05T18:54:00.082 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-pytz-2017.2-9.el8.noarch 18/134 2023-07-05T18:54:00.227 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : libquadmath-8.5.0-10.1.el8_6.x86_64 19/134 2023-07-05T18:54:00.369 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: libquadmath-8.5.0-10.1.el8_6.x86_64 19/134 2023-07-05T18:54:00.389 INFO:teuthology.orchestra.run.smithi046.stdout: Running scriptlet: openblas-threads-0.3.15-3.el8.x86_64 21/134 2023-07-05T18:54:00.519 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : libgfortran-8.5.0-10.1.el8_6.x86_64 20/134 2023-07-05T18:54:00.570 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : openblas-0.3.15-3.el8.x86_64 22/134 2023-07-05T18:54:01.309 INFO:teuthology.orchestra.run.smithi046.stdout: Running scriptlet: openblas-0.3.15-3.el8.x86_64 22/134 2023-07-05T18:54:01.427 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: libgfortran-8.5.0-10.1.el8_6.x86_64 20/134 2023-07-05T18:54:01.556 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-numpy-1:1.14.3-10.el8.x86_64 23/134 2023-07-05T18:54:01.611 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : openblas-threads-0.3.15-3.el8.x86_64 21/134 2023-07-05T18:54:01.740 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : zlib-devel-1.2.11-18.el8_5.x86_64 24/134 2023-07-05T18:54:01.940 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-webob-1.8.5-1.el8.1.noarch 25/134 2023-07-05T18:54:02.152 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-ceph-common-2:18.0.0-4488.g0a781ef0.el8. 26/134 2023-07-05T18:54:02.193 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: openblas-threads-0.3.15-3.el8.x86_64 21/134 2023-07-05T18:54:02.282 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-ceph-argparse-2:18.0.0-4488.g0a781ef0.el 27/134 2023-07-05T18:54:02.378 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : openblas-0.3.15-3.el8.x86_64 22/134 2023-07-05T18:54:02.542 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-cephfs-2:18.0.0-4488.g0a781ef0.el8.x86_6 28/134 2023-07-05T18:54:02.717 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-numpy-f2py-1:1.14.3-10.el8.x86_64 29/134 2023-07-05T18:54:03.100 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: openblas-0.3.15-3.el8.x86_64 22/134 2023-07-05T18:54:03.382 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-numpy-1:1.14.3-10.el8.x86_64 23/134 2023-07-05T18:54:03.568 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : zlib-devel-1.2.11-18.el8_5.x86_64 24/134 2023-07-05T18:54:03.807 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-webob-1.8.5-1.el8.1.noarch 25/134 2023-07-05T18:54:04.008 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-ceph-common-2:18.0.0-4488.g0a781ef0.el8. 26/134 2023-07-05T18:54:04.138 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-ceph-argparse-2:18.0.0-4488.g0a781ef0.el 27/134 2023-07-05T18:54:04.392 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-cephfs-2:18.0.0-4488.g0a781ef0.el8.x86_6 28/134 2023-07-05T18:54:04.614 INFO:teuthology.orchestra.run.smithi046.stdout: Running scriptlet: python3-numpy-f2py-1:1.14.3-10.el8.x86_64 29/134 2023-07-05T18:54:04.618 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-numpy-f2py-1:1.14.3-10.el8.x86_64 29/134 2023-07-05T18:54:05.672 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-scipy-1.0.0-21.module+el8.5.0+10916+41bd 30/134 2023-07-05T18:54:05.975 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-babel-2.5.1-7.el8.noarch 31/134 2023-07-05T18:54:06.224 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-jinja2-2.10.1-3.el8.noarch 32/134 2023-07-05T18:54:06.396 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: python3-numpy-f2py-1:1.14.3-10.el8.x86_64 29/134 2023-07-05T18:54:06.428 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-mako-1.0.6-13.el8.noarch 33/134 2023-07-05T18:54:06.615 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-rsa-4.8-1.el8.noarch 34/134 2023-07-05T18:54:06.805 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-pyasn1-modules-0.3.7-6.el8.noarch 35/134 2023-07-05T18:54:07.015 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-rbd-2:18.0.0-4488.g0a781ef0.el8.x86_64 36/134 2023-07-05T18:54:07.421 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-scipy-1.0.0-21.module+el8.5.0+10916+41bd 30/134 2023-07-05T18:54:07.467 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : librados-devel-2:18.0.0-4488.g0a781ef0.el8.x86_6 37/134 2023-07-05T18:54:07.601 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-jsonpointer-1.10-11.el8.noarch 38/134 2023-07-05T18:54:07.732 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-babel-2.5.1-7.el8.noarch 31/134 2023-07-05T18:54:07.737 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-jsonpatch-1.21-2.el8.noarch 39/134 2023-07-05T18:54:07.883 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : uuid-1.6.2-43.el8.x86_64 40/134 2023-07-05T18:54:07.941 INFO:teuthology.orchestra.run.smithi046.stdout: Running scriptlet: uuid-1.6.2-43.el8.x86_64 40/134 2023-07-05T18:54:08.020 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-jinja2-2.10.1-3.el8.noarch 32/134 2023-07-05T18:54:08.162 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-prettytable-0.7.2-14.el8.noarch 41/134 2023-07-05T18:54:08.252 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-mako-1.0.6-13.el8.noarch 33/134 2023-07-05T18:54:08.372 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : automake-1.16.1-7.el8.noarch 42/134 2023-07-05T18:54:08.487 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-rsa-4.8-1.el8.noarch 34/134 2023-07-05T18:54:08.558 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : oniguruma-6.8.2-2.el8.x86_64 43/134 2023-07-05T18:54:08.637 INFO:teuthology.orchestra.run.smithi046.stdout: Running scriptlet: oniguruma-6.8.2-2.el8.x86_64 43/134 2023-07-05T18:54:08.695 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-pyasn1-modules-0.3.7-6.el8.noarch 35/134 2023-07-05T18:54:08.859 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : jq-1.6-3.el8.x86_64 44/134 2023-07-05T18:54:08.915 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-rbd-2:18.0.0-4488.g0a781ef0.el8.x86_64 36/134 2023-07-05T18:54:09.024 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : socat-1.7.4.1-1.el8.x86_64 45/134 2023-07-05T18:54:09.091 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : librados-devel-2:18.0.0-4488.g0a781ef0.el8.x86_6 37/134 2023-07-05T18:54:09.196 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : libcom_err-devel-1.45.6-4.el8.x86_64 46/134 2023-07-05T18:54:09.251 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-jsonpointer-1.10-11.el8.noarch 38/134 2023-07-05T18:54:09.379 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : libuuid-devel-2.32.1-35.el8.x86_64 47/134 2023-07-05T18:54:09.422 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-jsonpatch-1.21-2.el8.noarch 39/134 2023-07-05T18:54:09.547 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : fuse-2.9.7-15.el8.x86_64 48/134 2023-07-05T18:54:09.609 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : uuid-1.6.2-43.el8.x86_64 40/134 2023-07-05T18:54:09.681 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: uuid-1.6.2-43.el8.x86_64 40/134 2023-07-05T18:54:09.689 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : libverto-devel-0.3.0-5.el8.x86_64 49/134 2023-07-05T18:54:09.870 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : pcre2-utf16-10.32-2.el8.x86_64 50/134 2023-07-05T18:54:09.888 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-prettytable-0.7.2-14.el8.noarch 41/134 2023-07-05T18:54:10.069 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-pycparser-2.14-14.el8.noarch 51/134 2023-07-05T18:54:10.098 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : automake-1.16.1-7.el8.noarch 42/134 2023-07-05T18:54:10.259 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : oniguruma-6.8.2-2.el8.x86_64 43/134 2023-07-05T18:54:10.326 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: oniguruma-6.8.2-2.el8.x86_64 43/134 2023-07-05T18:54:10.419 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-cffi-1.11.5-5.el8.x86_64 52/134 2023-07-05T18:54:10.577 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : jq-1.6-3.el8.x86_64 44/134 2023-07-05T18:54:10.679 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-cryptography-3.2.1-5.el8.x86_64 53/134 2023-07-05T18:54:10.755 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : socat-1.7.4.1-1.el8.x86_64 45/134 2023-07-05T18:54:10.887 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-jwt-1.6.1-2.el8.noarch 54/134 2023-07-05T18:54:10.919 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : libcom_err-devel-1.45.6-4.el8.x86_64 46/134 2023-07-05T18:54:11.104 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : libuuid-devel-2.32.1-35.el8.x86_64 47/134 2023-07-05T18:54:11.119 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-pyOpenSSL-19.0.0-1.el8.noarch 55/134 2023-07-05T18:54:11.320 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : fuse-2.9.7-15.el8.x86_64 48/134 2023-07-05T18:54:11.341 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-oauthlib-2.1.0-1.el8.noarch 56/134 2023-07-05T18:54:11.455 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : libverto-devel-0.3.0-5.el8.x86_64 49/134 2023-07-05T18:54:11.636 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-requests-oauthlib-1.0.0-1.el8.noarch 57/134 2023-07-05T18:54:11.667 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : pcre2-utf16-10.32-2.el8.x86_64 50/134 2023-07-05T18:54:11.842 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-asyncssh-2.7.0-2.el8.noarch 58/134 2023-07-05T18:54:11.885 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-pycparser-2.14-14.el8.noarch 51/134 2023-07-05T18:54:12.021 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-trustme-0.6.0-4.el8.noarch 59/134 2023-07-05T18:54:12.220 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-bcrypt-3.1.6-2.el8.1.x86_64 60/134 2023-07-05T18:54:12.258 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-cffi-1.11.5-5.el8.x86_64 52/134 2023-07-05T18:54:12.390 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : libsepol-devel-2.9-3.el8.x86_64 61/134 2023-07-05T18:54:12.552 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-cryptography-3.2.1-5.el8.x86_64 53/134 2023-07-05T18:54:12.563 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : keyutils-libs-devel-1.5.10-9.el8.x86_64 62/134 2023-07-05T18:54:12.820 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-jwt-1.6.1-2.el8.noarch 54/134 2023-07-05T18:54:12.874 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : pcre2-utf32-10.32-2.el8.x86_64 63/134 2023-07-05T18:54:13.064 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-pyOpenSSL-19.0.0-1.el8.noarch 55/134 2023-07-05T18:54:13.120 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : pcre2-devel-10.32-2.el8.x86_64 64/134 2023-07-05T18:54:13.288 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-oauthlib-2.1.0-1.el8.noarch 56/134 2023-07-05T18:54:13.358 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : libselinux-devel-2.9-5.el8.x86_64 65/134 2023-07-05T18:54:13.568 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : krb5-devel-1.18.2-14.el8.x86_64 66/134 2023-07-05T18:54:13.602 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-requests-oauthlib-1.0.0-1.el8.noarch 57/134 2023-07-05T18:54:13.699 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : xmlstarlet-1.6.1-20.el8.x86_64 67/134 2023-07-05T18:54:13.833 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-asyncssh-2.7.0-2.el8.noarch 58/134 2023-07-05T18:54:13.856 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-zc-lockfile-2.0-2.el8.noarch 68/134 2023-07-05T18:54:14.003 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-trustme-0.6.0-4.el8.noarch 59/134 2023-07-05T18:54:14.116 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-websocket-client-0.56.0-5.el8.noarch 69/134 2023-07-05T18:54:14.221 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-bcrypt-3.1.6-2.el8.1.x86_64 60/134 2023-07-05T18:54:14.315 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-waitress-1.4.3-1.el8.noarch 70/134 2023-07-05T18:54:14.431 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : libsepol-devel-2.9-3.el8.x86_64 61/134 2023-07-05T18:54:14.451 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-singledispatch-3.4.0.3-18.el8.noarch 71/134 2023-07-05T18:54:14.586 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-simplegeneric-0.8.1-17.el8.noarch 72/134 2023-07-05T18:54:14.611 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : keyutils-libs-devel-1.5.10-9.el8.x86_64 62/134 2023-07-05T18:54:14.796 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-repoze-lru-0.7-6.el8.noarch 73/134 2023-07-05T18:54:14.947 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : pcre2-utf32-10.32-2.el8.x86_64 63/134 2023-07-05T18:54:14.980 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-routes-2.4.1-12.el8.noarch 74/134 2023-07-05T18:54:15.154 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-natsort-7.1.1-2.el8.noarch 75/134 2023-07-05T18:54:15.213 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : pcre2-devel-10.32-2.el8.x86_64 64/134 2023-07-05T18:54:15.302 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-logutils-0.3.5-11.el8.noarch 76/134 2023-07-05T18:54:15.444 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-jaraco-6.2-6.el8.noarch 77/134 2023-07-05T18:54:15.456 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : libselinux-devel-2.9-5.el8.x86_64 65/134 2023-07-05T18:54:15.636 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-jaraco-functools-2.0-4.el8.noarch 78/134 2023-07-05T18:54:15.676 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : krb5-devel-1.18.2-14.el8.x86_64 66/134 2023-07-05T18:54:15.829 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-cheroot-8.5.2-1.el8.noarch 79/134 2023-07-05T18:54:15.858 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : xmlstarlet-1.6.1-20.el8.x86_64 67/134 2023-07-05T18:54:15.992 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-tempora-1.14.1-5.el8.noarch 80/134 2023-07-05T18:54:16.037 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-zc-lockfile-2.0-2.el8.noarch 68/134 2023-07-05T18:54:16.253 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-portend-2.6-1.el8.noarch 81/134 2023-07-05T18:54:16.338 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-websocket-client-0.56.0-5.el8.noarch 69/134 2023-07-05T18:54:16.483 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-cherrypy-18.4.0-1.el8.noarch 82/134 2023-07-05T18:54:16.573 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-waitress-1.4.3-1.el8.noarch 70/134 2023-07-05T18:54:16.634 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-certifi-2018.10.15-7.el8.noarch 83/134 2023-07-05T18:54:16.721 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-singledispatch-3.4.0.3-18.el8.noarch 71/134 2023-07-05T18:54:16.836 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-cachetools-3.1.1-4.el8.noarch 84/134 2023-07-05T18:54:16.861 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-simplegeneric-0.8.1-17.el8.noarch 72/134 2023-07-05T18:54:17.068 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-repoze-lru-0.7-6.el8.noarch 73/134 2023-07-05T18:54:17.264 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-routes-2.4.1-12.el8.noarch 74/134 2023-07-05T18:54:17.495 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-natsort-7.1.1-2.el8.noarch 75/134 2023-07-05T18:54:17.661 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-logutils-0.3.5-11.el8.noarch 76/134 2023-07-05T18:54:17.798 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-jaraco-6.2-6.el8.noarch 77/134 2023-07-05T18:54:17.966 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-google-auth-1:1.1.1-10.el8.noarch 85/134 2023-07-05T18:54:18.023 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-jaraco-functools-2.0-4.el8.noarch 78/134 2023-07-05T18:54:18.197 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-kubernetes-1:11.0.0-6.el8.noarch 86/134 2023-07-05T18:54:18.246 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-cheroot-8.5.2-1.el8.noarch 79/134 2023-07-05T18:54:18.393 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 87/134 2023-07-05T18:54:18.439 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-tempora-1.14.1-5.el8.noarch 80/134 2023-07-05T18:54:18.653 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-webtest-2.0.33-1.el8.noarch 88/134 2023-07-05T18:54:18.704 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-portend-2.6-1.el8.noarch 81/134 2023-07-05T18:54:18.908 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-pecan-1.3.2-9.el8.noarch 89/134 2023-07-05T18:54:18.984 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-cherrypy-18.4.0-1.el8.noarch 82/134 2023-07-05T18:54:19.102 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : libunwind-1.3.1-3.el8.x86_64 90/134 2023-07-05T18:54:19.150 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-certifi-2018.10.15-7.el8.noarch 83/134 2023-07-05T18:54:19.344 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-cachetools-3.1.1-4.el8.noarch 84/134 2023-07-05T18:54:19.968 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : gperftools-libs-1:2.7-9.el8.x86_64 91/134 2023-07-05T18:54:20.165 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : librgw2-2:18.0.0-4488.g0a781ef0.el8.x86_64 92/134 2023-07-05T18:54:20.238 INFO:teuthology.orchestra.run.smithi046.stdout: Running scriptlet: librgw2-2:18.0.0-4488.g0a781ef0.el8.x86_64 92/134 2023-07-05T18:54:20.399 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-rgw-2:18.0.0-4488.g0a781ef0.el8.x86_64 93/134 2023-07-05T18:54:20.425 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-google-auth-1:1.1.1-10.el8.noarch 85/134 2023-07-05T18:54:20.669 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-kubernetes-1:11.0.0-6.el8.noarch 86/134 2023-07-05T18:54:20.908 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 87/134 2023-07-05T18:54:21.208 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-webtest-2.0.33-1.el8.noarch 88/134 2023-07-05T18:54:21.475 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-pecan-1.3.2-9.el8.noarch 89/134 2023-07-05T18:54:21.723 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : libunwind-1.3.1-3.el8.x86_64 90/134 2023-07-05T18:54:22.551 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : gperftools-libs-1:2.7-9.el8.x86_64 91/134 2023-07-05T18:54:22.741 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : librgw2-2:18.0.0-4488.g0a781ef0.el8.x86_64 92/134 2023-07-05T18:54:22.814 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: librgw2-2:18.0.0-4488.g0a781ef0.el8.x86_64 92/134 2023-07-05T18:54:22.983 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-rgw-2:18.0.0-4488.g0a781ef0.el8.x86_64 93/134 2023-07-05T18:54:24.313 INFO:teuthology.orchestra.run.smithi046.stdout: Running scriptlet: ceph-common-2:18.0.0-4488.g0a781ef0.el8.x86_64 94/134 2023-07-05T18:54:24.515 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : ceph-common-2:18.0.0-4488.g0a781ef0.el8.x86_64 94/134 2023-07-05T18:54:25.132 INFO:teuthology.orchestra.run.smithi046.stdout: Running scriptlet: ceph-common-2:18.0.0-4488.g0a781ef0.el8.x86_64 94/134 2023-07-05T18:54:25.405 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : ceph-base-2:18.0.0-4488.g0a781ef0.el8.x86_64 95/134 2023-07-05T18:54:25.491 INFO:teuthology.orchestra.run.smithi046.stdout: Running scriptlet: ceph-base-2:18.0.0-4488.g0a781ef0.el8.x86_64 95/134 2023-07-05T18:54:25.623 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : ceph-selinux-2:18.0.0-4488.g0a781ef0.el8.x86_64 96/134 2023-07-05T18:54:26.621 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: ceph-common-2:18.0.0-4488.g0a781ef0.el8.x86_64 94/134 2023-07-05T18:54:27.291 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : ceph-common-2:18.0.0-4488.g0a781ef0.el8.x86_64 94/134 2023-07-05T18:54:27.877 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: ceph-common-2:18.0.0-4488.g0a781ef0.el8.x86_64 94/134 2023-07-05T18:54:28.173 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : ceph-base-2:18.0.0-4488.g0a781ef0.el8.x86_64 95/134 2023-07-05T18:54:28.241 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: ceph-base-2:18.0.0-4488.g0a781ef0.el8.x86_64 95/134 2023-07-05T18:54:28.406 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : ceph-selinux-2:18.0.0-4488.g0a781ef0.el8.x86_64 96/134 2023-07-05T18:54:44.915 INFO:teuthology.orchestra.run.smithi046.stdout: Running scriptlet: ceph-selinux-2:18.0.0-4488.g0a781ef0.el8.x86_64 96/134 2023-07-05T18:54:44.916 INFO:teuthology.orchestra.run.smithi046.stdout:skipping the directory /sys 2023-07-05T18:54:44.916 INFO:teuthology.orchestra.run.smithi046.stdout:skipping the directory /proc 2023-07-05T18:54:44.916 INFO:teuthology.orchestra.run.smithi046.stdout:skipping the directory /dev 2023-07-05T18:54:44.917 INFO:teuthology.orchestra.run.smithi046.stdout:skipping the directory /run 2023-07-05T18:54:44.917 INFO:teuthology.orchestra.run.smithi046.stdout:skipping the directory /mnt 2023-07-05T18:54:44.919 INFO:teuthology.orchestra.run.smithi046.stdout:skipping the directory /var/tmp 2023-07-05T18:54:44.919 INFO:teuthology.orchestra.run.smithi046.stdout:skipping the directory /home 2023-07-05T18:54:44.919 INFO:teuthology.orchestra.run.smithi046.stdout:skipping the directory /tmp 2023-07-05T18:54:44.920 INFO:teuthology.orchestra.run.smithi046.stdout:skipping the directory /dev 2023-07-05T18:54:44.920 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T18:54:45.246 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : ceph-volume-2:18.0.0-4488.g0a781ef0.el8.noarch 97/134 2023-07-05T18:54:46.928 INFO:teuthology.orchestra.run.smithi046.stdout: Running scriptlet: ceph-volume-2:18.0.0-4488.g0a781ef0.el8.noarch 97/134 2023-07-05T18:54:47.127 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : ceph-osd-2:18.0.0-4488.g0a781ef0.el8.x86_64 98/134 2023-07-05T18:54:47.375 INFO:teuthology.orchestra.run.smithi046.stdout: Running scriptlet: ceph-osd-2:18.0.0-4488.g0a781ef0.el8.x86_64 98/134 2023-07-05T18:54:47.512 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : ceph-mds-2:18.0.0-4488.g0a781ef0.el8.x86_64 99/134 2023-07-05T18:54:47.876 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: ceph-selinux-2:18.0.0-4488.g0a781ef0.el8.x86_64 96/134 2023-07-05T18:54:47.876 INFO:teuthology.orchestra.run.smithi073.stdout:skipping the directory /sys 2023-07-05T18:54:47.877 INFO:teuthology.orchestra.run.smithi073.stdout:skipping the directory /proc 2023-07-05T18:54:47.877 INFO:teuthology.orchestra.run.smithi073.stdout:skipping the directory /dev 2023-07-05T18:54:47.877 INFO:teuthology.orchestra.run.smithi073.stdout:skipping the directory /run 2023-07-05T18:54:47.878 INFO:teuthology.orchestra.run.smithi073.stdout:skipping the directory /mnt 2023-07-05T18:54:47.878 INFO:teuthology.orchestra.run.smithi073.stdout:skipping the directory /var/tmp 2023-07-05T18:54:47.878 INFO:teuthology.orchestra.run.smithi073.stdout:skipping the directory /home 2023-07-05T18:54:47.878 INFO:teuthology.orchestra.run.smithi073.stdout:skipping the directory /tmp 2023-07-05T18:54:47.879 INFO:teuthology.orchestra.run.smithi073.stdout:skipping the directory /dev 2023-07-05T18:54:47.879 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-07-05T18:54:48.002 INFO:teuthology.orchestra.run.smithi046.stdout: Running scriptlet: ceph-mds-2:18.0.0-4488.g0a781ef0.el8.x86_64 99/134 2023-07-05T18:54:48.185 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : ceph-mon-2:18.0.0-4488.g0a781ef0.el8.x86_64 100/134 2023-07-05T18:54:48.197 INFO:teuthology.orchestra.run.smithi046.stdout: Running scriptlet: ceph-mon-2:18.0.0-4488.g0a781ef0.el8.x86_64 100/134 2023-07-05T18:54:48.223 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : ceph-volume-2:18.0.0-4488.g0a781ef0.el8.noarch 97/134 2023-07-05T18:54:49.797 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: ceph-volume-2:18.0.0-4488.g0a781ef0.el8.noarch 97/134 2023-07-05T18:54:49.979 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : ceph-osd-2:18.0.0-4488.g0a781ef0.el8.x86_64 98/134 2023-07-05T18:54:49.986 INFO:teuthology.orchestra.run.smithi046.stdout: Running scriptlet: cephadm-2:18.0.0-4488.g0a781ef0.el8.noarch 101/134 2023-07-05T18:54:50.189 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : cephadm-2:18.0.0-4488.g0a781ef0.el8.noarch 101/134 2023-07-05T18:54:50.197 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: ceph-osd-2:18.0.0-4488.g0a781ef0.el8.x86_64 98/134 2023-07-05T18:54:50.310 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : ceph-prometheus-alerts-2:18.0.0-4488.g0a781ef0.e 102/134 2023-07-05T18:54:50.353 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : ceph-mds-2:18.0.0-4488.g0a781ef0.el8.x86_64 99/134 2023-07-05T18:54:50.479 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : ceph-grafana-dashboards-2:18.0.0-4488.g0a781ef0. 103/134 2023-07-05T18:54:50.644 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : ceph-mgr-cephadm-2:18.0.0-4488.g0a781ef0.el8.noa 104/134 2023-07-05T18:54:50.812 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: ceph-mds-2:18.0.0-4488.g0a781ef0.el8.x86_64 99/134 2023-07-05T18:54:50.870 INFO:teuthology.orchestra.run.smithi046.stdout: Running scriptlet: ceph-mgr-cephadm-2:18.0.0-4488.g0a781ef0.el8.noa 104/134 2023-07-05T18:54:51.009 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : ceph-mon-2:18.0.0-4488.g0a781ef0.el8.x86_64 100/134 2023-07-05T18:54:51.021 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: ceph-mon-2:18.0.0-4488.g0a781ef0.el8.x86_64 100/134 2023-07-05T18:54:51.135 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : ceph-mgr-dashboard-2:18.0.0-4488.g0a781ef0.el8.n 105/134 2023-07-05T18:54:52.168 INFO:teuthology.orchestra.run.smithi046.stdout: Running scriptlet: ceph-mgr-dashboard-2:18.0.0-4488.g0a781ef0.el8.n 105/134 2023-07-05T18:54:52.320 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : ceph-mgr-diskprediction-local-2:18.0.0-4488.g0a7 106/134 2023-07-05T18:54:52.419 INFO:teuthology.orchestra.run.smithi046.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:18.0.0-4488.g0a7 106/134 2023-07-05T18:54:52.675 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: cephadm-2:18.0.0-4488.g0a781ef0.el8.noarch 101/134 2023-07-05T18:54:52.756 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : ceph-mgr-modules-core-2:18.0.0-4488.g0a781ef0.el 107/134 2023-07-05T18:54:52.875 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : cephadm-2:18.0.0-4488.g0a781ef0.el8.noarch 101/134 2023-07-05T18:54:52.992 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : ceph-prometheus-alerts-2:18.0.0-4488.g0a781ef0.e 102/134 2023-07-05T18:54:53.043 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : ceph-mgr-2:18.0.0-4488.g0a781ef0.el8.x86_64 108/134 2023-07-05T18:54:53.081 INFO:teuthology.orchestra.run.smithi046.stdout: Running scriptlet: ceph-mgr-2:18.0.0-4488.g0a781ef0.el8.x86_64 108/134 2023-07-05T18:54:53.218 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : ceph-grafana-dashboards-2:18.0.0-4488.g0a781ef0. 103/134 2023-07-05T18:54:53.261 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : ceph-mgr-rook-2:18.0.0-4488.g0a781ef0.el8.noarch 109/134 2023-07-05T18:54:53.273 INFO:teuthology.orchestra.run.smithi046.stdout: Running scriptlet: ceph-mgr-rook-2:18.0.0-4488.g0a781ef0.el8.noarch 109/134 2023-07-05T18:54:53.411 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : ceph-mgr-cephadm-2:18.0.0-4488.g0a781ef0.el8.noa 104/134 2023-07-05T18:54:53.626 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: ceph-mgr-cephadm-2:18.0.0-4488.g0a781ef0.el8.noa 104/134 2023-07-05T18:54:53.913 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : ceph-mgr-dashboard-2:18.0.0-4488.g0a781ef0.el8.n 105/134 2023-07-05T18:54:54.651 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : ceph-2:18.0.0-4488.g0a781ef0.el8.x86_64 110/134 2023-07-05T18:54:54.868 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : ceph-radosgw-2:18.0.0-4488.g0a781ef0.el8.x86_64 111/134 2023-07-05T18:54:54.869 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: ceph-mgr-dashboard-2:18.0.0-4488.g0a781ef0.el8.n 105/134 2023-07-05T18:54:54.906 INFO:teuthology.orchestra.run.smithi046.stdout: Running scriptlet: ceph-radosgw-2:18.0.0-4488.g0a781ef0.el8.x86_64 111/134 2023-07-05T18:54:55.019 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : ceph-mgr-diskprediction-local-2:18.0.0-4488.g0a7 106/134 2023-07-05T18:54:55.037 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : ceph-immutable-object-cache-2:18.0.0-4488.g0a781 112/134 2023-07-05T18:54:55.080 INFO:teuthology.orchestra.run.smithi046.stdout: Running scriptlet: ceph-immutable-object-cache-2:18.0.0-4488.g0a781 112/134 2023-07-05T18:54:55.111 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:18.0.0-4488.g0a7 106/134 2023-07-05T18:54:55.212 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : cephfs-mirror-2:18.0.0-4488.g0a781ef0.el8.x86_64 113/134 2023-07-05T18:54:55.480 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : ceph-mgr-modules-core-2:18.0.0-4488.g0a781ef0.el 107/134 2023-07-05T18:54:55.579 INFO:teuthology.orchestra.run.smithi046.stdout: Running scriptlet: cephfs-mirror-2:18.0.0-4488.g0a781ef0.el8.x86_64 113/134 2023-07-05T18:54:55.652 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : ceph-mgr-2:18.0.0-4488.g0a781ef0.el8.x86_64 108/134 2023-07-05T18:54:55.687 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: ceph-mgr-2:18.0.0-4488.g0a781ef0.el8.x86_64 108/134 2023-07-05T18:54:55.740 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : rbd-mirror-2:18.0.0-4488.g0a781ef0.el8.x86_64 114/134 2023-07-05T18:54:55.860 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : ceph-mgr-rook-2:18.0.0-4488.g0a781ef0.el8.noarch 109/134 2023-07-05T18:54:55.872 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: ceph-mgr-rook-2:18.0.0-4488.g0a781ef0.el8.noarch 109/134 2023-07-05T18:54:57.173 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : ceph-2:18.0.0-4488.g0a781ef0.el8.x86_64 110/134 2023-07-05T18:54:57.402 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : ceph-radosgw-2:18.0.0-4488.g0a781ef0.el8.x86_64 111/134 2023-07-05T18:54:57.436 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: ceph-radosgw-2:18.0.0-4488.g0a781ef0.el8.x86_64 111/134 2023-07-05T18:54:57.602 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : ceph-immutable-object-cache-2:18.0.0-4488.g0a781 112/134 2023-07-05T18:54:57.644 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: ceph-immutable-object-cache-2:18.0.0-4488.g0a781 112/134 2023-07-05T18:54:57.794 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : cephfs-mirror-2:18.0.0-4488.g0a781ef0.el8.x86_64 113/134 2023-07-05T18:54:58.141 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: cephfs-mirror-2:18.0.0-4488.g0a781ef0.el8.x86_64 113/134 2023-07-05T18:54:58.294 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : rbd-mirror-2:18.0.0-4488.g0a781ef0.el8.x86_64 114/134 2023-07-05T18:55:00.591 INFO:teuthology.orchestra.run.smithi046.stdout: Running scriptlet: rbd-mirror-2:18.0.0-4488.g0a781ef0.el8.x86_64 114/134 2023-07-05T18:55:01.555 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : ceph-test-2:18.0.0-4488.g0a781ef0.el8.x86_64 115/134 2023-07-05T18:55:01.855 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : openssl-devel-1:1.1.1k-7.el8_6.x86_64 116/134 2023-07-05T18:55:02.009 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : ceph-fuse-2:18.0.0-4488.g0a781ef0.el8.x86_64 117/134 2023-07-05T18:55:02.235 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : xfsprogs-devel-5.0.0-10.el8.x86_64 118/134 2023-07-05T18:55:02.410 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : libtool-2.4.6-25.el8.x86_64 119/134 2023-07-05T18:55:02.616 INFO:teuthology.orchestra.run.smithi046.stdout: Running scriptlet: libtool-2.4.6-25.el8.x86_64 119/134 2023-07-05T18:55:02.814 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: rbd-mirror-2:18.0.0-4488.g0a781ef0.el8.x86_64 114/134 2023-07-05T18:55:02.840 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : postgresql-contrib-10.21-2.module+el8.6.0+15342+ 120/134 2023-07-05T18:55:02.989 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : libcephfs-devel-2:18.0.0-4488.g0a781ef0.el8.x86_ 121/134 2023-07-05T18:55:03.119 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : elfutils-libelf-devel-0.186-1.el8.x86_64 122/134 2023-07-05T18:55:03.702 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : ceph-test-2:18.0.0-4488.g0a781ef0.el8.x86_64 115/134 2023-07-05T18:55:04.027 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : openssl-devel-1:1.1.1k-7.el8_6.x86_64 116/134 2023-07-05T18:55:04.232 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : ceph-fuse-2:18.0.0-4488.g0a781ef0.el8.x86_64 117/134 2023-07-05T18:55:04.503 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : xfsprogs-devel-5.0.0-10.el8.x86_64 118/134 2023-07-05T18:55:04.667 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : libtool-2.4.6-25.el8.x86_64 119/134 2023-07-05T18:55:04.857 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: libtool-2.4.6-25.el8.x86_64 119/134 2023-07-05T18:55:05.139 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : postgresql-contrib-10.21-2.module+el8.6.0+15342+ 120/134 2023-07-05T18:55:05.305 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : libcephfs-devel-2:18.0.0-4488.g0a781ef0.el8.x86_ 121/134 2023-07-05T18:55:05.433 INFO:teuthology.orchestra.run.smithi046.stdout: Running scriptlet: postgresql-server-10.21-2.module+el8.6.0+15342+5 123/134 2023-07-05T18:55:05.469 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : elfutils-libelf-devel-0.186-1.el8.x86_64 122/134 2023-07-05T18:55:05.685 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : postgresql-server-10.21-2.module+el8.6.0+15342+5 123/134 2023-07-05T18:55:05.703 INFO:teuthology.orchestra.run.smithi046.stdout: Running scriptlet: postgresql-server-10.21-2.module+el8.6.0+15342+5 123/134 2023-07-05T18:55:05.872 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : cephfs-top-2:18.0.0-4488.g0a781ef0.el8.noarch 124/134 2023-07-05T18:55:06.163 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : rbd-fuse-2:18.0.0-4488.g0a781ef0.el8.x86_64 125/134 2023-07-05T18:55:06.448 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : rbd-nbd-2:18.0.0-4488.g0a781ef0.el8.x86_64 126/134 2023-07-05T18:55:06.776 INFO:teuthology.orchestra.run.smithi046.stdout: Upgrading : iproute-5.15.0-4.el8_6.1.x86_64 127/134 2023-07-05T18:55:06.985 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : flex-2.6.1-9.el8.x86_64 128/134 2023-07-05T18:55:07.072 INFO:teuthology.orchestra.run.smithi046.stdout: Running scriptlet: flex-2.6.1-9.el8.x86_64 128/134 2023-07-05T18:55:07.251 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : bison-3.0.4-10.el8.x86_64 129/134 2023-07-05T18:55:07.269 INFO:teuthology.orchestra.run.smithi046.stdout: Running scriptlet: bison-3.0.4-10.el8.x86_64 129/134 2023-07-05T18:55:07.426 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : NetworkManager-initscripts-updown-1:1.36.0-9.el8 130/134 2023-07-05T18:55:07.439 INFO:teuthology.orchestra.run.smithi046.stdout: Running scriptlet: NetworkManager-initscripts-updown-1:1.36.0-9.el8 130/134 2023-07-05T18:55:07.562 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : libaio-devel-0.3.112-1.el8.x86_64 131/134 2023-07-05T18:55:07.562 INFO:teuthology.orchestra.run.smithi046.stdout: Cleanup : librbd1-1:12.2.7-9.el8.x86_64 132/134 2023-07-05T18:55:07.617 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: postgresql-server-10.21-2.module+el8.6.0+15342+5 123/134 2023-07-05T18:55:07.754 INFO:teuthology.orchestra.run.smithi046.stdout: Running scriptlet: librbd1-1:12.2.7-9.el8.x86_64 132/134 2023-07-05T18:55:07.755 INFO:teuthology.orchestra.run.smithi046.stdout: Cleanup : librados2-1:12.2.7-9.el8.x86_64 133/134 2023-07-05T18:55:07.867 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : postgresql-server-10.21-2.module+el8.6.0+15342+5 123/134 2023-07-05T18:55:07.886 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: postgresql-server-10.21-2.module+el8.6.0+15342+5 123/134 2023-07-05T18:55:07.983 INFO:teuthology.orchestra.run.smithi046.stdout: Running scriptlet: librados2-1:12.2.7-9.el8.x86_64 133/134 2023-07-05T18:55:08.110 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : cephfs-top-2:18.0.0-4488.g0a781ef0.el8.noarch 124/134 2023-07-05T18:55:08.178 INFO:teuthology.orchestra.run.smithi046.stdout: Cleanup : iproute-5.15.0-4.el8.x86_64 134/134 2023-07-05T18:55:08.400 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : rbd-fuse-2:18.0.0-4488.g0a781ef0.el8.x86_64 125/134 2023-07-05T18:55:08.694 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : rbd-nbd-2:18.0.0-4488.g0a781ef0.el8.x86_64 126/134 2023-07-05T18:55:08.743 INFO:teuthology.orchestra.run.smithi046.stdout: Running scriptlet: iproute-5.15.0-4.el8.x86_64 134/134 2023-07-05T18:55:08.743 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : ceph-2:18.0.0-4488.g0a781ef0.el8.x86_64 1/134 2023-07-05T18:55:08.743 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : ceph-base-2:18.0.0-4488.g0a781ef0.el8.x86_64 2/134 2023-07-05T18:55:08.744 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : ceph-common-2:18.0.0-4488.g0a781ef0.el8.x86_64 3/134 2023-07-05T18:55:08.748 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : ceph-fuse-2:18.0.0-4488.g0a781ef0.el8.x86_64 4/134 2023-07-05T18:55:08.749 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : ceph-immutable-object-cache-2:18.0.0-4488.g0a781 5/134 2023-07-05T18:55:08.749 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : ceph-mds-2:18.0.0-4488.g0a781ef0.el8.x86_64 6/134 2023-07-05T18:55:08.749 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : ceph-mgr-2:18.0.0-4488.g0a781ef0.el8.x86_64 7/134 2023-07-05T18:55:08.749 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : ceph-mon-2:18.0.0-4488.g0a781ef0.el8.x86_64 8/134 2023-07-05T18:55:08.750 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : ceph-osd-2:18.0.0-4488.g0a781ef0.el8.x86_64 9/134 2023-07-05T18:55:08.750 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : ceph-radosgw-2:18.0.0-4488.g0a781ef0.el8.x86_64 10/134 2023-07-05T18:55:08.750 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : ceph-selinux-2:18.0.0-4488.g0a781ef0.el8.x86_64 11/134 2023-07-05T18:55:08.750 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : ceph-test-2:18.0.0-4488.g0a781ef0.el8.x86_64 12/134 2023-07-05T18:55:08.753 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : cephfs-mirror-2:18.0.0-4488.g0a781ef0.el8.x86_64 13/134 2023-07-05T18:55:08.753 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : libcephfs-devel-2:18.0.0-4488.g0a781ef0.el8.x86_ 14/134 2023-07-05T18:55:08.753 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : libcephfs2-2:18.0.0-4488.g0a781ef0.el8.x86_64 15/134 2023-07-05T18:55:08.753 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : libcephsqlite-2:18.0.0-4488.g0a781ef0.el8.x86_64 16/134 2023-07-05T18:55:08.754 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : librados-devel-2:18.0.0-4488.g0a781ef0.el8.x86_6 17/134 2023-07-05T18:55:08.754 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : libradosstriper1-2:18.0.0-4488.g0a781ef0.el8.x86 18/134 2023-07-05T18:55:08.754 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : librgw2-2:18.0.0-4488.g0a781ef0.el8.x86_64 19/134 2023-07-05T18:55:08.755 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-ceph-argparse-2:18.0.0-4488.g0a781ef0.el 20/134 2023-07-05T18:55:08.755 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-ceph-common-2:18.0.0-4488.g0a781ef0.el8. 21/134 2023-07-05T18:55:08.755 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-cephfs-2:18.0.0-4488.g0a781ef0.el8.x86_6 22/134 2023-07-05T18:55:08.755 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-rados-2:18.0.0-4488.g0a781ef0.el8.x86_64 23/134 2023-07-05T18:55:08.756 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-rbd-2:18.0.0-4488.g0a781ef0.el8.x86_64 24/134 2023-07-05T18:55:08.768 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-rgw-2:18.0.0-4488.g0a781ef0.el8.x86_64 25/134 2023-07-05T18:55:08.768 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : rbd-fuse-2:18.0.0-4488.g0a781ef0.el8.x86_64 26/134 2023-07-05T18:55:08.768 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : rbd-mirror-2:18.0.0-4488.g0a781ef0.el8.x86_64 27/134 2023-07-05T18:55:08.768 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : rbd-nbd-2:18.0.0-4488.g0a781ef0.el8.x86_64 28/134 2023-07-05T18:55:08.769 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : ceph-grafana-dashboards-2:18.0.0-4488.g0a781ef0. 29/134 2023-07-05T18:55:08.769 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : ceph-mgr-cephadm-2:18.0.0-4488.g0a781ef0.el8.noa 30/134 2023-07-05T18:55:08.769 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : ceph-mgr-dashboard-2:18.0.0-4488.g0a781ef0.el8.n 31/134 2023-07-05T18:55:08.770 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : ceph-mgr-diskprediction-local-2:18.0.0-4488.g0a7 32/134 2023-07-05T18:55:08.770 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : ceph-mgr-modules-core-2:18.0.0-4488.g0a781ef0.el 33/134 2023-07-05T18:55:08.770 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : ceph-mgr-rook-2:18.0.0-4488.g0a781ef0.el8.noarch 34/134 2023-07-05T18:55:08.770 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : ceph-prometheus-alerts-2:18.0.0-4488.g0a781ef0.e 35/134 2023-07-05T18:55:08.771 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : ceph-volume-2:18.0.0-4488.g0a781ef0.el8.noarch 36/134 2023-07-05T18:55:08.771 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : cephadm-2:18.0.0-4488.g0a781ef0.el8.noarch 37/134 2023-07-05T18:55:08.771 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : cephfs-top-2:18.0.0-4488.g0a781ef0.el8.noarch 38/134 2023-07-05T18:55:08.778 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : gperftools-libs-1:2.7-9.el8.x86_64 39/134 2023-07-05T18:55:08.779 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : liboath-2.6.2-3.el8.x86_64 40/134 2023-07-05T18:55:08.779 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : libunwind-1.3.1-3.el8.x86_64 41/134 2023-07-05T18:55:08.779 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-asyncssh-2.7.0-2.el8.noarch 42/134 2023-07-05T18:55:08.779 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-bcrypt-3.1.6-2.el8.1.x86_64 43/134 2023-07-05T18:55:08.780 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 44/134 2023-07-05T18:55:08.780 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-cachetools-3.1.1-4.el8.noarch 45/134 2023-07-05T18:55:08.780 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-certifi-2018.10.15-7.el8.noarch 46/134 2023-07-05T18:55:08.780 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-cheroot-8.5.2-1.el8.noarch 47/134 2023-07-05T18:55:08.781 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-cherrypy-18.4.0-1.el8.noarch 48/134 2023-07-05T18:55:08.781 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-google-auth-1:1.1.1-10.el8.noarch 49/134 2023-07-05T18:55:08.781 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-jaraco-6.2-6.el8.noarch 50/134 2023-07-05T18:55:08.782 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-jaraco-functools-2.0-4.el8.noarch 51/134 2023-07-05T18:55:08.782 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-kubernetes-1:11.0.0-6.el8.noarch 52/134 2023-07-05T18:55:08.782 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-logutils-0.3.5-11.el8.noarch 53/134 2023-07-05T18:55:08.782 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-more-itertools-7.2.0-3.el8.noarch 54/134 2023-07-05T18:55:08.783 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-natsort-7.1.1-2.el8.noarch 55/134 2023-07-05T18:55:08.783 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-pecan-1.3.2-9.el8.noarch 56/134 2023-07-05T18:55:08.783 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-portend-2.6-1.el8.noarch 57/134 2023-07-05T18:55:08.789 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-repoze-lru-0.7-6.el8.noarch 58/134 2023-07-05T18:55:08.789 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-routes-2.4.1-12.el8.noarch 59/134 2023-07-05T18:55:08.789 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-rsa-4.8-1.el8.noarch 60/134 2023-07-05T18:55:08.789 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-simplegeneric-0.8.1-17.el8.noarch 61/134 2023-07-05T18:55:08.790 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-singledispatch-3.4.0.3-18.el8.noarch 62/134 2023-07-05T18:55:08.790 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-tempora-1.14.1-5.el8.noarch 63/134 2023-07-05T18:55:08.790 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-trustme-0.6.0-4.el8.noarch 64/134 2023-07-05T18:55:08.790 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-waitress-1.4.3-1.el8.noarch 65/134 2023-07-05T18:55:08.790 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-webob-1.8.5-1.el8.1.noarch 66/134 2023-07-05T18:55:08.790 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-websocket-client-0.56.0-5.el8.noarch 67/134 2023-07-05T18:55:08.790 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-webtest-2.0.33-1.el8.noarch 68/134 2023-07-05T18:55:08.791 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-zc-lockfile-2.0-2.el8.noarch 69/134 2023-07-05T18:55:08.791 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : thrift-0.13.0-2.el8.x86_64 70/134 2023-07-05T18:55:08.791 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : xmlstarlet-1.6.1-20.el8.x86_64 71/134 2023-07-05T18:55:08.791 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : librabbitmq-0.9.0-3.el8.x86_64 72/134 2023-07-05T18:55:08.791 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : libselinux-devel-2.9-5.el8.x86_64 73/134 2023-07-05T18:55:08.791 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-jwt-1.6.1-2.el8.noarch 74/134 2023-07-05T18:55:08.791 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : pcre2-utf32-10.32-2.el8.x86_64 75/134 2023-07-05T18:55:08.792 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : keyutils-libs-devel-1.5.10-9.el8.x86_64 76/134 2023-07-05T18:55:08.792 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : libsepol-devel-2.9-3.el8.x86_64 77/134 2023-07-05T18:55:08.792 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-requests-oauthlib-1.0.0-1.el8.noarch 78/134 2023-07-05T18:55:08.792 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-pycparser-2.14-14.el8.noarch 79/134 2023-07-05T18:55:08.792 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : pcre2-utf16-10.32-2.el8.x86_64 80/134 2023-07-05T18:55:08.792 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : krb5-devel-1.18.2-14.el8.x86_64 81/134 2023-07-05T18:55:08.792 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : libaio-devel-0.3.112-1.el8.x86_64 82/134 2023-07-05T18:55:08.793 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-oauthlib-2.1.0-1.el8.noarch 83/134 2023-07-05T18:55:08.793 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-cryptography-3.2.1-5.el8.x86_64 84/134 2023-07-05T18:55:08.793 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : libverto-devel-0.3.0-5.el8.x86_64 85/134 2023-07-05T18:55:08.793 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : pcre2-devel-10.32-2.el8.x86_64 86/134 2023-07-05T18:55:08.793 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-cffi-1.11.5-5.el8.x86_64 87/134 2023-07-05T18:55:08.799 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : openssl-devel-1:1.1.1k-7.el8_6.x86_64 88/134 2023-07-05T18:55:08.800 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : xfsprogs-devel-5.0.0-10.el8.x86_64 89/134 2023-07-05T18:55:08.800 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : fuse-2.9.7-15.el8.x86_64 90/134 2023-07-05T18:55:08.800 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : elfutils-libelf-devel-0.186-1.el8.x86_64 91/134 2023-07-05T18:55:08.801 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : libuuid-devel-2.32.1-35.el8.x86_64 92/134 2023-07-05T18:55:08.801 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : zlib-devel-1.2.11-18.el8_5.x86_64 93/134 2023-07-05T18:55:08.801 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : libcom_err-devel-1.45.6-4.el8.x86_64 94/134 2023-07-05T18:55:08.801 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : libgfortran-8.5.0-10.1.el8_6.x86_64 95/134 2023-07-05T18:55:08.801 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : libquadmath-8.5.0-10.1.el8_6.x86_64 96/134 2023-07-05T18:55:08.801 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : NetworkManager-initscripts-updown-1:1.36.0-9.el8 97/134 2023-07-05T18:55:08.801 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-scipy-1.0.0-21.module+el8.5.0+10916+41bd 98/134 2023-07-05T18:55:08.802 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-pyasn1-modules-0.3.7-6.el8.noarch 99/134 2023-07-05T18:55:08.802 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-pytz-2017.2-9.el8.noarch 100/134 2023-07-05T18:55:08.802 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : lttng-ust-2.8.1-11.el8.x86_64 101/134 2023-07-05T18:55:08.802 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : socat-1.7.4.1-1.el8.x86_64 102/134 2023-07-05T18:55:08.802 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-markupsafe-0.23-19.el8.x86_64 103/134 2023-07-05T18:55:08.802 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : bison-3.0.4-10.el8.x86_64 104/134 2023-07-05T18:55:08.802 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-jinja2-2.10.1-3.el8.noarch 105/134 2023-07-05T18:55:08.803 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-mako-1.0.6-13.el8.noarch 106/134 2023-07-05T18:55:08.803 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : oniguruma-6.8.2-2.el8.x86_64 107/134 2023-07-05T18:55:08.803 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : automake-1.16.1-7.el8.noarch 108/134 2023-07-05T18:55:08.803 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-babel-2.5.1-7.el8.noarch 109/134 2023-07-05T18:55:08.803 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-jsonpatch-1.21-2.el8.noarch 110/134 2023-07-05T18:55:08.803 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : flex-2.6.1-9.el8.x86_64 111/134 2023-07-05T18:55:08.817 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-prettytable-0.7.2-14.el8.noarch 112/134 2023-07-05T18:55:08.817 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-numpy-1:1.14.3-10.el8.x86_64 113/134 2023-07-05T18:55:08.818 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-werkzeug-0.12.2-4.el8.noarch 114/134 2023-07-05T18:55:08.818 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-numpy-f2py-1:1.14.3-10.el8.x86_64 115/134 2023-07-05T18:55:08.818 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : uuid-1.6.2-43.el8.x86_64 116/134 2023-07-05T18:55:08.818 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-pyasn1-0.3.7-6.el8.noarch 117/134 2023-07-05T18:55:08.818 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-jsonpointer-1.10-11.el8.noarch 118/134 2023-07-05T18:55:08.818 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-pyOpenSSL-19.0.0-1.el8.noarch 119/134 2023-07-05T18:55:08.818 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : libtool-2.4.6-25.el8.x86_64 120/134 2023-07-05T18:55:08.819 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : openblas-threads-0.3.15-3.el8.x86_64 121/134 2023-07-05T18:55:08.819 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : libpq-13.5-1.el8.x86_64 122/134 2023-07-05T18:55:08.819 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : openblas-0.3.15-3.el8.x86_64 123/134 2023-07-05T18:55:08.819 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : jq-1.6-3.el8.x86_64 124/134 2023-07-05T18:55:08.819 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : librdkafka-0.11.4-3.el8.x86_64 125/134 2023-07-05T18:55:08.819 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : postgresql-server-10.21-2.module+el8.6.0+15342+5 126/134 2023-07-05T18:55:08.819 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : postgresql-contrib-10.21-2.module+el8.6.0+15342+ 127/134 2023-07-05T18:55:08.820 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : postgresql-10.21-2.module+el8.6.0+15342+53518fac 128/134 2023-07-05T18:55:08.820 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : librados2-2:18.0.0-4488.g0a781ef0.el8.x86_64 129/134 2023-07-05T18:55:08.820 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : librados2-1:12.2.7-9.el8.x86_64 130/134 2023-07-05T18:55:08.835 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : librbd1-2:18.0.0-4488.g0a781ef0.el8.x86_64 131/134 2023-07-05T18:55:08.835 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : librbd1-1:12.2.7-9.el8.x86_64 132/134 2023-07-05T18:55:08.835 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : iproute-5.15.0-4.el8_6.1.x86_64 133/134 2023-07-05T18:55:09.043 INFO:teuthology.orchestra.run.smithi073.stdout: Upgrading : iproute-5.15.0-4.el8_6.1.x86_64 127/134 2023-07-05T18:55:09.242 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : flex-2.6.1-9.el8.x86_64 128/134 2023-07-05T18:55:09.324 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: flex-2.6.1-9.el8.x86_64 128/134 2023-07-05T18:55:09.542 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : bison-3.0.4-10.el8.x86_64 129/134 2023-07-05T18:55:09.557 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: bison-3.0.4-10.el8.x86_64 129/134 2023-07-05T18:55:09.704 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : NetworkManager-initscripts-updown-1:1.36.0-9.el8 130/134 2023-07-05T18:55:09.709 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: NetworkManager-initscripts-updown-1:1.36.0-9.el8 130/134 2023-07-05T18:55:09.827 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : libaio-devel-0.3.112-1.el8.x86_64 131/134 2023-07-05T18:55:09.828 INFO:teuthology.orchestra.run.smithi073.stdout: Cleanup : librbd1-1:12.2.7-9.el8.x86_64 132/134 2023-07-05T18:55:10.041 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: librbd1-1:12.2.7-9.el8.x86_64 132/134 2023-07-05T18:55:10.041 INFO:teuthology.orchestra.run.smithi073.stdout: Cleanup : librados2-1:12.2.7-9.el8.x86_64 133/134 2023-07-05T18:55:10.281 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: librados2-1:12.2.7-9.el8.x86_64 133/134 2023-07-05T18:55:10.485 INFO:teuthology.orchestra.run.smithi073.stdout: Cleanup : iproute-5.15.0-4.el8.x86_64 134/134 2023-07-05T18:55:10.979 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: iproute-5.15.0-4.el8.x86_64 134/134 2023-07-05T18:55:10.980 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : ceph-2:18.0.0-4488.g0a781ef0.el8.x86_64 1/134 2023-07-05T18:55:10.980 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : ceph-base-2:18.0.0-4488.g0a781ef0.el8.x86_64 2/134 2023-07-05T18:55:10.980 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : ceph-common-2:18.0.0-4488.g0a781ef0.el8.x86_64 3/134 2023-07-05T18:55:10.981 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : ceph-fuse-2:18.0.0-4488.g0a781ef0.el8.x86_64 4/134 2023-07-05T18:55:10.981 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : ceph-immutable-object-cache-2:18.0.0-4488.g0a781 5/134 2023-07-05T18:55:10.981 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : ceph-mds-2:18.0.0-4488.g0a781ef0.el8.x86_64 6/134 2023-07-05T18:55:10.981 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : ceph-mgr-2:18.0.0-4488.g0a781ef0.el8.x86_64 7/134 2023-07-05T18:55:10.981 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : ceph-mon-2:18.0.0-4488.g0a781ef0.el8.x86_64 8/134 2023-07-05T18:55:10.982 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : ceph-osd-2:18.0.0-4488.g0a781ef0.el8.x86_64 9/134 2023-07-05T18:55:10.982 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : ceph-radosgw-2:18.0.0-4488.g0a781ef0.el8.x86_64 10/134 2023-07-05T18:55:10.982 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : ceph-selinux-2:18.0.0-4488.g0a781ef0.el8.x86_64 11/134 2023-07-05T18:55:10.982 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : ceph-test-2:18.0.0-4488.g0a781ef0.el8.x86_64 12/134 2023-07-05T18:55:10.982 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : cephfs-mirror-2:18.0.0-4488.g0a781ef0.el8.x86_64 13/134 2023-07-05T18:55:10.982 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : libcephfs-devel-2:18.0.0-4488.g0a781ef0.el8.x86_ 14/134 2023-07-05T18:55:10.983 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : libcephfs2-2:18.0.0-4488.g0a781ef0.el8.x86_64 15/134 2023-07-05T18:55:10.983 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : libcephsqlite-2:18.0.0-4488.g0a781ef0.el8.x86_64 16/134 2023-07-05T18:55:10.984 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : librados-devel-2:18.0.0-4488.g0a781ef0.el8.x86_6 17/134 2023-07-05T18:55:10.984 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : libradosstriper1-2:18.0.0-4488.g0a781ef0.el8.x86 18/134 2023-07-05T18:55:10.984 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : librgw2-2:18.0.0-4488.g0a781ef0.el8.x86_64 19/134 2023-07-05T18:55:10.984 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-ceph-argparse-2:18.0.0-4488.g0a781ef0.el 20/134 2023-07-05T18:55:10.984 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-ceph-common-2:18.0.0-4488.g0a781ef0.el8. 21/134 2023-07-05T18:55:10.985 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-cephfs-2:18.0.0-4488.g0a781ef0.el8.x86_6 22/134 2023-07-05T18:55:10.985 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-rados-2:18.0.0-4488.g0a781ef0.el8.x86_64 23/134 2023-07-05T18:55:10.985 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-rbd-2:18.0.0-4488.g0a781ef0.el8.x86_64 24/134 2023-07-05T18:55:10.985 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-rgw-2:18.0.0-4488.g0a781ef0.el8.x86_64 25/134 2023-07-05T18:55:10.985 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : rbd-fuse-2:18.0.0-4488.g0a781ef0.el8.x86_64 26/134 2023-07-05T18:55:10.985 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : rbd-mirror-2:18.0.0-4488.g0a781ef0.el8.x86_64 27/134 2023-07-05T18:55:10.985 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : rbd-nbd-2:18.0.0-4488.g0a781ef0.el8.x86_64 28/134 2023-07-05T18:55:10.986 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : ceph-grafana-dashboards-2:18.0.0-4488.g0a781ef0. 29/134 2023-07-05T18:55:10.986 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : ceph-mgr-cephadm-2:18.0.0-4488.g0a781ef0.el8.noa 30/134 2023-07-05T18:55:10.986 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : ceph-mgr-dashboard-2:18.0.0-4488.g0a781ef0.el8.n 31/134 2023-07-05T18:55:11.002 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : ceph-mgr-diskprediction-local-2:18.0.0-4488.g0a7 32/134 2023-07-05T18:55:11.002 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : ceph-mgr-modules-core-2:18.0.0-4488.g0a781ef0.el 33/134 2023-07-05T18:55:11.002 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : ceph-mgr-rook-2:18.0.0-4488.g0a781ef0.el8.noarch 34/134 2023-07-05T18:55:11.003 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : ceph-prometheus-alerts-2:18.0.0-4488.g0a781ef0.e 35/134 2023-07-05T18:55:11.003 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : ceph-volume-2:18.0.0-4488.g0a781ef0.el8.noarch 36/134 2023-07-05T18:55:11.003 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : cephadm-2:18.0.0-4488.g0a781ef0.el8.noarch 37/134 2023-07-05T18:55:11.003 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : cephfs-top-2:18.0.0-4488.g0a781ef0.el8.noarch 38/134 2023-07-05T18:55:11.004 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : gperftools-libs-1:2.7-9.el8.x86_64 39/134 2023-07-05T18:55:11.004 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : liboath-2.6.2-3.el8.x86_64 40/134 2023-07-05T18:55:11.004 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : libunwind-1.3.1-3.el8.x86_64 41/134 2023-07-05T18:55:11.004 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-asyncssh-2.7.0-2.el8.noarch 42/134 2023-07-05T18:55:11.004 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-bcrypt-3.1.6-2.el8.1.x86_64 43/134 2023-07-05T18:55:11.004 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 44/134 2023-07-05T18:55:11.004 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-cachetools-3.1.1-4.el8.noarch 45/134 2023-07-05T18:55:11.005 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-certifi-2018.10.15-7.el8.noarch 46/134 2023-07-05T18:55:11.005 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-cheroot-8.5.2-1.el8.noarch 47/134 2023-07-05T18:55:11.005 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-cherrypy-18.4.0-1.el8.noarch 48/134 2023-07-05T18:55:11.005 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-google-auth-1:1.1.1-10.el8.noarch 49/134 2023-07-05T18:55:11.005 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-jaraco-6.2-6.el8.noarch 50/134 2023-07-05T18:55:11.005 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-jaraco-functools-2.0-4.el8.noarch 51/134 2023-07-05T18:55:11.005 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-kubernetes-1:11.0.0-6.el8.noarch 52/134 2023-07-05T18:55:11.006 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-logutils-0.3.5-11.el8.noarch 53/134 2023-07-05T18:55:11.006 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-more-itertools-7.2.0-3.el8.noarch 54/134 2023-07-05T18:55:11.006 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-natsort-7.1.1-2.el8.noarch 55/134 2023-07-05T18:55:11.006 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-pecan-1.3.2-9.el8.noarch 56/134 2023-07-05T18:55:11.006 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-portend-2.6-1.el8.noarch 57/134 2023-07-05T18:55:11.006 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-repoze-lru-0.7-6.el8.noarch 58/134 2023-07-05T18:55:11.006 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-routes-2.4.1-12.el8.noarch 59/134 2023-07-05T18:55:11.006 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-rsa-4.8-1.el8.noarch 60/134 2023-07-05T18:55:11.007 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-simplegeneric-0.8.1-17.el8.noarch 61/134 2023-07-05T18:55:11.007 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-singledispatch-3.4.0.3-18.el8.noarch 62/134 2023-07-05T18:55:11.007 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-tempora-1.14.1-5.el8.noarch 63/134 2023-07-05T18:55:11.007 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-trustme-0.6.0-4.el8.noarch 64/134 2023-07-05T18:55:11.007 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-waitress-1.4.3-1.el8.noarch 65/134 2023-07-05T18:55:11.007 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-webob-1.8.5-1.el8.1.noarch 66/134 2023-07-05T18:55:11.007 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-websocket-client-0.56.0-5.el8.noarch 67/134 2023-07-05T18:55:11.007 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-webtest-2.0.33-1.el8.noarch 68/134 2023-07-05T18:55:11.008 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-zc-lockfile-2.0-2.el8.noarch 69/134 2023-07-05T18:55:11.008 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : thrift-0.13.0-2.el8.x86_64 70/134 2023-07-05T18:55:11.008 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : xmlstarlet-1.6.1-20.el8.x86_64 71/134 2023-07-05T18:55:11.008 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : librabbitmq-0.9.0-3.el8.x86_64 72/134 2023-07-05T18:55:11.008 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : libselinux-devel-2.9-5.el8.x86_64 73/134 2023-07-05T18:55:11.008 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-jwt-1.6.1-2.el8.noarch 74/134 2023-07-05T18:55:11.008 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : pcre2-utf32-10.32-2.el8.x86_64 75/134 2023-07-05T18:55:11.009 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : keyutils-libs-devel-1.5.10-9.el8.x86_64 76/134 2023-07-05T18:55:11.009 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : libsepol-devel-2.9-3.el8.x86_64 77/134 2023-07-05T18:55:11.009 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-requests-oauthlib-1.0.0-1.el8.noarch 78/134 2023-07-05T18:55:11.009 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-pycparser-2.14-14.el8.noarch 79/134 2023-07-05T18:55:11.009 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : pcre2-utf16-10.32-2.el8.x86_64 80/134 2023-07-05T18:55:11.009 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : krb5-devel-1.18.2-14.el8.x86_64 81/134 2023-07-05T18:55:11.009 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : libaio-devel-0.3.112-1.el8.x86_64 82/134 2023-07-05T18:55:11.010 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-oauthlib-2.1.0-1.el8.noarch 83/134 2023-07-05T18:55:11.010 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-cryptography-3.2.1-5.el8.x86_64 84/134 2023-07-05T18:55:11.010 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : libverto-devel-0.3.0-5.el8.x86_64 85/134 2023-07-05T18:55:11.010 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : pcre2-devel-10.32-2.el8.x86_64 86/134 2023-07-05T18:55:11.010 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-cffi-1.11.5-5.el8.x86_64 87/134 2023-07-05T18:55:11.010 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : openssl-devel-1:1.1.1k-7.el8_6.x86_64 88/134 2023-07-05T18:55:11.010 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : xfsprogs-devel-5.0.0-10.el8.x86_64 89/134 2023-07-05T18:55:11.010 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : fuse-2.9.7-15.el8.x86_64 90/134 2023-07-05T18:55:11.011 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : elfutils-libelf-devel-0.186-1.el8.x86_64 91/134 2023-07-05T18:55:11.011 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : libuuid-devel-2.32.1-35.el8.x86_64 92/134 2023-07-05T18:55:11.011 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : zlib-devel-1.2.11-18.el8_5.x86_64 93/134 2023-07-05T18:55:11.011 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : libcom_err-devel-1.45.6-4.el8.x86_64 94/134 2023-07-05T18:55:11.011 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : libgfortran-8.5.0-10.1.el8_6.x86_64 95/134 2023-07-05T18:55:11.011 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : libquadmath-8.5.0-10.1.el8_6.x86_64 96/134 2023-07-05T18:55:11.011 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : NetworkManager-initscripts-updown-1:1.36.0-9.el8 97/134 2023-07-05T18:55:11.011 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-scipy-1.0.0-21.module+el8.5.0+10916+41bd 98/134 2023-07-05T18:55:11.012 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-pyasn1-modules-0.3.7-6.el8.noarch 99/134 2023-07-05T18:55:11.012 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-pytz-2017.2-9.el8.noarch 100/134 2023-07-05T18:55:11.012 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : lttng-ust-2.8.1-11.el8.x86_64 101/134 2023-07-05T18:55:11.012 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : socat-1.7.4.1-1.el8.x86_64 102/134 2023-07-05T18:55:11.012 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-markupsafe-0.23-19.el8.x86_64 103/134 2023-07-05T18:55:11.012 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : bison-3.0.4-10.el8.x86_64 104/134 2023-07-05T18:55:11.012 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-jinja2-2.10.1-3.el8.noarch 105/134 2023-07-05T18:55:11.013 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-mako-1.0.6-13.el8.noarch 106/134 2023-07-05T18:55:11.013 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : oniguruma-6.8.2-2.el8.x86_64 107/134 2023-07-05T18:55:11.013 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : automake-1.16.1-7.el8.noarch 108/134 2023-07-05T18:55:11.013 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-babel-2.5.1-7.el8.noarch 109/134 2023-07-05T18:55:11.014 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-jsonpatch-1.21-2.el8.noarch 110/134 2023-07-05T18:55:11.014 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : flex-2.6.1-9.el8.x86_64 111/134 2023-07-05T18:55:11.014 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-prettytable-0.7.2-14.el8.noarch 112/134 2023-07-05T18:55:11.014 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-numpy-1:1.14.3-10.el8.x86_64 113/134 2023-07-05T18:55:11.014 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-werkzeug-0.12.2-4.el8.noarch 114/134 2023-07-05T18:55:11.014 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-numpy-f2py-1:1.14.3-10.el8.x86_64 115/134 2023-07-05T18:55:11.014 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : uuid-1.6.2-43.el8.x86_64 116/134 2023-07-05T18:55:11.015 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-pyasn1-0.3.7-6.el8.noarch 117/134 2023-07-05T18:55:11.015 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-jsonpointer-1.10-11.el8.noarch 118/134 2023-07-05T18:55:11.015 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-pyOpenSSL-19.0.0-1.el8.noarch 119/134 2023-07-05T18:55:11.015 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : libtool-2.4.6-25.el8.x86_64 120/134 2023-07-05T18:55:11.015 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : openblas-threads-0.3.15-3.el8.x86_64 121/134 2023-07-05T18:55:11.015 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : libpq-13.5-1.el8.x86_64 122/134 2023-07-05T18:55:11.015 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : openblas-0.3.15-3.el8.x86_64 123/134 2023-07-05T18:55:11.015 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : jq-1.6-3.el8.x86_64 124/134 2023-07-05T18:55:11.016 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : librdkafka-0.11.4-3.el8.x86_64 125/134 2023-07-05T18:55:11.016 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : postgresql-server-10.21-2.module+el8.6.0+15342+5 126/134 2023-07-05T18:55:11.016 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : postgresql-contrib-10.21-2.module+el8.6.0+15342+ 127/134 2023-07-05T18:55:11.016 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : postgresql-10.21-2.module+el8.6.0+15342+53518fac 128/134 2023-07-05T18:55:11.016 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : librados2-2:18.0.0-4488.g0a781ef0.el8.x86_64 129/134 2023-07-05T18:55:11.017 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : librados2-1:12.2.7-9.el8.x86_64 130/134 2023-07-05T18:55:11.017 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : librbd1-2:18.0.0-4488.g0a781ef0.el8.x86_64 131/134 2023-07-05T18:55:11.017 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : librbd1-1:12.2.7-9.el8.x86_64 132/134 2023-07-05T18:55:11.017 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : iproute-5.15.0-4.el8_6.1.x86_64 133/134 2023-07-05T18:55:11.409 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : iproute-5.15.0-4.el8.x86_64 134/134 2023-07-05T18:55:11.409 INFO:teuthology.orchestra.run.smithi046.stdout:Last metadata expiration check: 0:01:53 ago on Wed 05 Jul 2023 06:53:18 PM UTC. 2023-07-05T18:55:13.640 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : iproute-5.15.0-4.el8.x86_64 134/134 2023-07-05T18:55:13.641 INFO:teuthology.orchestra.run.smithi073.stdout:Last metadata expiration check: 0:01:52 ago on Wed 05 Jul 2023 06:53:21 PM UTC. 2023-07-05T18:55:16.335 INFO:teuthology.orchestra.run.smithi046.stdout:Installed products updated. 2023-07-05T18:55:16.570 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T18:55:16.571 INFO:teuthology.orchestra.run.smithi046.stdout:Upgraded: 2023-07-05T18:55:16.571 INFO:teuthology.orchestra.run.smithi046.stdout: iproute-5.15.0-4.el8_6.1.x86_64 2023-07-05T18:55:16.571 INFO:teuthology.orchestra.run.smithi046.stdout: librados2-2:18.0.0-4488.g0a781ef0.el8.x86_64 2023-07-05T18:55:16.571 INFO:teuthology.orchestra.run.smithi046.stdout: librbd1-2:18.0.0-4488.g0a781ef0.el8.x86_64 2023-07-05T18:55:16.571 INFO:teuthology.orchestra.run.smithi046.stdout:Installed: 2023-07-05T18:55:16.571 INFO:teuthology.orchestra.run.smithi046.stdout: NetworkManager-initscripts-updown-1:1.36.0-9.el8_6.noarch 2023-07-05T18:55:16.572 INFO:teuthology.orchestra.run.smithi046.stdout: automake-1.16.1-7.el8.noarch 2023-07-05T18:55:16.572 INFO:teuthology.orchestra.run.smithi046.stdout: bison-3.0.4-10.el8.x86_64 2023-07-05T18:55:16.572 INFO:teuthology.orchestra.run.smithi046.stdout: ceph-2:18.0.0-4488.g0a781ef0.el8.x86_64 2023-07-05T18:55:16.572 INFO:teuthology.orchestra.run.smithi046.stdout: ceph-base-2:18.0.0-4488.g0a781ef0.el8.x86_64 2023-07-05T18:55:16.572 INFO:teuthology.orchestra.run.smithi046.stdout: ceph-common-2:18.0.0-4488.g0a781ef0.el8.x86_64 2023-07-05T18:55:16.572 INFO:teuthology.orchestra.run.smithi046.stdout: ceph-fuse-2:18.0.0-4488.g0a781ef0.el8.x86_64 2023-07-05T18:55:16.572 INFO:teuthology.orchestra.run.smithi046.stdout: ceph-grafana-dashboards-2:18.0.0-4488.g0a781ef0.el8.noarch 2023-07-05T18:55:16.573 INFO:teuthology.orchestra.run.smithi046.stdout: ceph-immutable-object-cache-2:18.0.0-4488.g0a781ef0.el8.x86_64 2023-07-05T18:55:16.573 INFO:teuthology.orchestra.run.smithi046.stdout: ceph-mds-2:18.0.0-4488.g0a781ef0.el8.x86_64 2023-07-05T18:55:16.573 INFO:teuthology.orchestra.run.smithi046.stdout: ceph-mgr-2:18.0.0-4488.g0a781ef0.el8.x86_64 2023-07-05T18:55:16.573 INFO:teuthology.orchestra.run.smithi046.stdout: ceph-mgr-cephadm-2:18.0.0-4488.g0a781ef0.el8.noarch 2023-07-05T18:55:16.573 INFO:teuthology.orchestra.run.smithi046.stdout: ceph-mgr-dashboard-2:18.0.0-4488.g0a781ef0.el8.noarch 2023-07-05T18:55:16.573 INFO:teuthology.orchestra.run.smithi046.stdout: ceph-mgr-diskprediction-local-2:18.0.0-4488.g0a781ef0.el8.noarch 2023-07-05T18:55:16.573 INFO:teuthology.orchestra.run.smithi046.stdout: ceph-mgr-modules-core-2:18.0.0-4488.g0a781ef0.el8.noarch 2023-07-05T18:55:16.573 INFO:teuthology.orchestra.run.smithi046.stdout: ceph-mgr-rook-2:18.0.0-4488.g0a781ef0.el8.noarch 2023-07-05T18:55:16.574 INFO:teuthology.orchestra.run.smithi046.stdout: ceph-mon-2:18.0.0-4488.g0a781ef0.el8.x86_64 2023-07-05T18:55:16.574 INFO:teuthology.orchestra.run.smithi046.stdout: ceph-osd-2:18.0.0-4488.g0a781ef0.el8.x86_64 2023-07-05T18:55:16.574 INFO:teuthology.orchestra.run.smithi046.stdout: ceph-prometheus-alerts-2:18.0.0-4488.g0a781ef0.el8.noarch 2023-07-05T18:55:16.574 INFO:teuthology.orchestra.run.smithi046.stdout: ceph-radosgw-2:18.0.0-4488.g0a781ef0.el8.x86_64 2023-07-05T18:55:16.574 INFO:teuthology.orchestra.run.smithi046.stdout: ceph-selinux-2:18.0.0-4488.g0a781ef0.el8.x86_64 2023-07-05T18:55:16.574 INFO:teuthology.orchestra.run.smithi046.stdout: ceph-test-2:18.0.0-4488.g0a781ef0.el8.x86_64 2023-07-05T18:55:16.574 INFO:teuthology.orchestra.run.smithi046.stdout: ceph-volume-2:18.0.0-4488.g0a781ef0.el8.noarch 2023-07-05T18:55:16.574 INFO:teuthology.orchestra.run.smithi046.stdout: cephadm-2:18.0.0-4488.g0a781ef0.el8.noarch 2023-07-05T18:55:16.575 INFO:teuthology.orchestra.run.smithi046.stdout: cephfs-mirror-2:18.0.0-4488.g0a781ef0.el8.x86_64 2023-07-05T18:55:16.575 INFO:teuthology.orchestra.run.smithi046.stdout: cephfs-top-2:18.0.0-4488.g0a781ef0.el8.noarch 2023-07-05T18:55:16.575 INFO:teuthology.orchestra.run.smithi046.stdout: elfutils-libelf-devel-0.186-1.el8.x86_64 2023-07-05T18:55:16.575 INFO:teuthology.orchestra.run.smithi046.stdout: flex-2.6.1-9.el8.x86_64 2023-07-05T18:55:16.575 INFO:teuthology.orchestra.run.smithi046.stdout: fuse-2.9.7-15.el8.x86_64 2023-07-05T18:55:16.575 INFO:teuthology.orchestra.run.smithi046.stdout: gperftools-libs-1:2.7-9.el8.x86_64 2023-07-05T18:55:16.575 INFO:teuthology.orchestra.run.smithi046.stdout: jq-1.6-3.el8.x86_64 2023-07-05T18:55:16.575 INFO:teuthology.orchestra.run.smithi046.stdout: keyutils-libs-devel-1.5.10-9.el8.x86_64 2023-07-05T18:55:16.576 INFO:teuthology.orchestra.run.smithi046.stdout: krb5-devel-1.18.2-14.el8.x86_64 2023-07-05T18:55:16.576 INFO:teuthology.orchestra.run.smithi046.stdout: libaio-devel-0.3.112-1.el8.x86_64 2023-07-05T18:55:16.576 INFO:teuthology.orchestra.run.smithi046.stdout: libcephfs-devel-2:18.0.0-4488.g0a781ef0.el8.x86_64 2023-07-05T18:55:16.581 INFO:teuthology.orchestra.run.smithi046.stdout: libcephfs2-2:18.0.0-4488.g0a781ef0.el8.x86_64 2023-07-05T18:55:16.581 INFO:teuthology.orchestra.run.smithi046.stdout: libcephsqlite-2:18.0.0-4488.g0a781ef0.el8.x86_64 2023-07-05T18:55:16.581 INFO:teuthology.orchestra.run.smithi046.stdout: libcom_err-devel-1.45.6-4.el8.x86_64 2023-07-05T18:55:16.582 INFO:teuthology.orchestra.run.smithi046.stdout: libgfortran-8.5.0-10.1.el8_6.x86_64 2023-07-05T18:55:16.582 INFO:teuthology.orchestra.run.smithi046.stdout: liboath-2.6.2-3.el8.x86_64 2023-07-05T18:55:16.582 INFO:teuthology.orchestra.run.smithi046.stdout: libpq-13.5-1.el8.x86_64 2023-07-05T18:55:16.582 INFO:teuthology.orchestra.run.smithi046.stdout: libquadmath-8.5.0-10.1.el8_6.x86_64 2023-07-05T18:55:16.582 INFO:teuthology.orchestra.run.smithi046.stdout: librabbitmq-0.9.0-3.el8.x86_64 2023-07-05T18:55:16.582 INFO:teuthology.orchestra.run.smithi046.stdout: librados-devel-2:18.0.0-4488.g0a781ef0.el8.x86_64 2023-07-05T18:55:16.582 INFO:teuthology.orchestra.run.smithi046.stdout: libradosstriper1-2:18.0.0-4488.g0a781ef0.el8.x86_64 2023-07-05T18:55:16.582 INFO:teuthology.orchestra.run.smithi046.stdout: librdkafka-0.11.4-3.el8.x86_64 2023-07-05T18:55:16.583 INFO:teuthology.orchestra.run.smithi046.stdout: librgw2-2:18.0.0-4488.g0a781ef0.el8.x86_64 2023-07-05T18:55:16.583 INFO:teuthology.orchestra.run.smithi046.stdout: libselinux-devel-2.9-5.el8.x86_64 2023-07-05T18:55:16.583 INFO:teuthology.orchestra.run.smithi046.stdout: libsepol-devel-2.9-3.el8.x86_64 2023-07-05T18:55:16.583 INFO:teuthology.orchestra.run.smithi046.stdout: libtool-2.4.6-25.el8.x86_64 2023-07-05T18:55:16.583 INFO:teuthology.orchestra.run.smithi046.stdout: libunwind-1.3.1-3.el8.x86_64 2023-07-05T18:55:16.583 INFO:teuthology.orchestra.run.smithi046.stdout: libuuid-devel-2.32.1-35.el8.x86_64 2023-07-05T18:55:16.583 INFO:teuthology.orchestra.run.smithi046.stdout: libverto-devel-0.3.0-5.el8.x86_64 2023-07-05T18:55:16.584 INFO:teuthology.orchestra.run.smithi046.stdout: lttng-ust-2.8.1-11.el8.x86_64 2023-07-05T18:55:16.584 INFO:teuthology.orchestra.run.smithi046.stdout: oniguruma-6.8.2-2.el8.x86_64 2023-07-05T18:55:16.584 INFO:teuthology.orchestra.run.smithi046.stdout: openblas-0.3.15-3.el8.x86_64 2023-07-05T18:55:16.589 INFO:teuthology.orchestra.run.smithi046.stdout: openblas-threads-0.3.15-3.el8.x86_64 2023-07-05T18:55:16.591 INFO:teuthology.orchestra.run.smithi046.stdout: openssl-devel-1:1.1.1k-7.el8_6.x86_64 2023-07-05T18:55:16.591 INFO:teuthology.orchestra.run.smithi046.stdout: pcre2-devel-10.32-2.el8.x86_64 2023-07-05T18:55:16.591 INFO:teuthology.orchestra.run.smithi046.stdout: pcre2-utf16-10.32-2.el8.x86_64 2023-07-05T18:55:16.591 INFO:teuthology.orchestra.run.smithi046.stdout: pcre2-utf32-10.32-2.el8.x86_64 2023-07-05T18:55:16.591 INFO:teuthology.orchestra.run.smithi046.stdout: postgresql-10.21-2.module+el8.6.0+15342+53518fac.x86_64 2023-07-05T18:55:16.592 INFO:teuthology.orchestra.run.smithi046.stdout: postgresql-contrib-10.21-2.module+el8.6.0+15342+53518fac.x86_64 2023-07-05T18:55:16.592 INFO:teuthology.orchestra.run.smithi046.stdout: postgresql-server-10.21-2.module+el8.6.0+15342+53518fac.x86_64 2023-07-05T18:55:16.592 INFO:teuthology.orchestra.run.smithi046.stdout: python3-asyncssh-2.7.0-2.el8.noarch 2023-07-05T18:55:16.592 INFO:teuthology.orchestra.run.smithi046.stdout: python3-babel-2.5.1-7.el8.noarch 2023-07-05T18:55:16.592 INFO:teuthology.orchestra.run.smithi046.stdout: python3-bcrypt-3.1.6-2.el8.1.x86_64 2023-07-05T18:55:16.592 INFO:teuthology.orchestra.run.smithi046.stdout: python3-beautifulsoup4-4.6.3-2.el8.1.noarch 2023-07-05T18:55:16.592 INFO:teuthology.orchestra.run.smithi046.stdout: python3-cachetools-3.1.1-4.el8.noarch 2023-07-05T18:55:16.593 INFO:teuthology.orchestra.run.smithi046.stdout: python3-ceph-argparse-2:18.0.0-4488.g0a781ef0.el8.x86_64 2023-07-05T18:55:16.593 INFO:teuthology.orchestra.run.smithi046.stdout: python3-ceph-common-2:18.0.0-4488.g0a781ef0.el8.x86_64 2023-07-05T18:55:16.593 INFO:teuthology.orchestra.run.smithi046.stdout: python3-cephfs-2:18.0.0-4488.g0a781ef0.el8.x86_64 2023-07-05T18:55:16.593 INFO:teuthology.orchestra.run.smithi046.stdout: python3-certifi-2018.10.15-7.el8.noarch 2023-07-05T18:55:16.593 INFO:teuthology.orchestra.run.smithi046.stdout: python3-cffi-1.11.5-5.el8.x86_64 2023-07-05T18:55:16.593 INFO:teuthology.orchestra.run.smithi046.stdout: python3-cheroot-8.5.2-1.el8.noarch 2023-07-05T18:55:16.593 INFO:teuthology.orchestra.run.smithi046.stdout: python3-cherrypy-18.4.0-1.el8.noarch 2023-07-05T18:55:16.593 INFO:teuthology.orchestra.run.smithi046.stdout: python3-cryptography-3.2.1-5.el8.x86_64 2023-07-05T18:55:16.594 INFO:teuthology.orchestra.run.smithi046.stdout: python3-google-auth-1:1.1.1-10.el8.noarch 2023-07-05T18:55:16.594 INFO:teuthology.orchestra.run.smithi046.stdout: python3-jaraco-6.2-6.el8.noarch 2023-07-05T18:55:16.594 INFO:teuthology.orchestra.run.smithi046.stdout: python3-jaraco-functools-2.0-4.el8.noarch 2023-07-05T18:55:16.594 INFO:teuthology.orchestra.run.smithi046.stdout: python3-jinja2-2.10.1-3.el8.noarch 2023-07-05T18:55:16.594 INFO:teuthology.orchestra.run.smithi046.stdout: python3-jsonpatch-1.21-2.el8.noarch 2023-07-05T18:55:16.594 INFO:teuthology.orchestra.run.smithi046.stdout: python3-jsonpointer-1.10-11.el8.noarch 2023-07-05T18:55:16.594 INFO:teuthology.orchestra.run.smithi046.stdout: python3-jwt-1.6.1-2.el8.noarch 2023-07-05T18:55:16.595 INFO:teuthology.orchestra.run.smithi046.stdout: python3-kubernetes-1:11.0.0-6.el8.noarch 2023-07-05T18:55:16.595 INFO:teuthology.orchestra.run.smithi046.stdout: python3-logutils-0.3.5-11.el8.noarch 2023-07-05T18:55:16.595 INFO:teuthology.orchestra.run.smithi046.stdout: python3-mako-1.0.6-13.el8.noarch 2023-07-05T18:55:16.596 INFO:teuthology.orchestra.run.smithi046.stdout: python3-markupsafe-0.23-19.el8.x86_64 2023-07-05T18:55:16.596 INFO:teuthology.orchestra.run.smithi046.stdout: python3-more-itertools-7.2.0-3.el8.noarch 2023-07-05T18:55:16.596 INFO:teuthology.orchestra.run.smithi046.stdout: python3-natsort-7.1.1-2.el8.noarch 2023-07-05T18:55:16.596 INFO:teuthology.orchestra.run.smithi046.stdout: python3-numpy-1:1.14.3-10.el8.x86_64 2023-07-05T18:55:16.596 INFO:teuthology.orchestra.run.smithi046.stdout: python3-numpy-f2py-1:1.14.3-10.el8.x86_64 2023-07-05T18:55:16.596 INFO:teuthology.orchestra.run.smithi046.stdout: python3-oauthlib-2.1.0-1.el8.noarch 2023-07-05T18:55:16.597 INFO:teuthology.orchestra.run.smithi046.stdout: python3-pecan-1.3.2-9.el8.noarch 2023-07-05T18:55:16.597 INFO:teuthology.orchestra.run.smithi046.stdout: python3-portend-2.6-1.el8.noarch 2023-07-05T18:55:16.597 INFO:teuthology.orchestra.run.smithi046.stdout: python3-prettytable-0.7.2-14.el8.noarch 2023-07-05T18:55:16.597 INFO:teuthology.orchestra.run.smithi046.stdout: python3-pyOpenSSL-19.0.0-1.el8.noarch 2023-07-05T18:55:16.597 INFO:teuthology.orchestra.run.smithi046.stdout: python3-pyasn1-0.3.7-6.el8.noarch 2023-07-05T18:55:16.597 INFO:teuthology.orchestra.run.smithi046.stdout: python3-pyasn1-modules-0.3.7-6.el8.noarch 2023-07-05T18:55:16.597 INFO:teuthology.orchestra.run.smithi046.stdout: python3-pycparser-2.14-14.el8.noarch 2023-07-05T18:55:16.597 INFO:teuthology.orchestra.run.smithi046.stdout: python3-pytz-2017.2-9.el8.noarch 2023-07-05T18:55:16.598 INFO:teuthology.orchestra.run.smithi046.stdout: python3-rados-2:18.0.0-4488.g0a781ef0.el8.x86_64 2023-07-05T18:55:16.598 INFO:teuthology.orchestra.run.smithi046.stdout: python3-rbd-2:18.0.0-4488.g0a781ef0.el8.x86_64 2023-07-05T18:55:16.598 INFO:teuthology.orchestra.run.smithi046.stdout: python3-repoze-lru-0.7-6.el8.noarch 2023-07-05T18:55:16.598 INFO:teuthology.orchestra.run.smithi046.stdout: python3-requests-oauthlib-1.0.0-1.el8.noarch 2023-07-05T18:55:16.598 INFO:teuthology.orchestra.run.smithi046.stdout: python3-rgw-2:18.0.0-4488.g0a781ef0.el8.x86_64 2023-07-05T18:55:16.598 INFO:teuthology.orchestra.run.smithi046.stdout: python3-routes-2.4.1-12.el8.noarch 2023-07-05T18:55:16.598 INFO:teuthology.orchestra.run.smithi046.stdout: python3-rsa-4.8-1.el8.noarch 2023-07-05T18:55:16.600 INFO:teuthology.orchestra.run.smithi046.stdout: python3-scipy-1.0.0-21.module+el8.5.0+10916+41bd434d.x86_64 2023-07-05T18:55:16.600 INFO:teuthology.orchestra.run.smithi046.stdout: python3-simplegeneric-0.8.1-17.el8.noarch 2023-07-05T18:55:16.600 INFO:teuthology.orchestra.run.smithi046.stdout: python3-singledispatch-3.4.0.3-18.el8.noarch 2023-07-05T18:55:16.601 INFO:teuthology.orchestra.run.smithi046.stdout: python3-tempora-1.14.1-5.el8.noarch 2023-07-05T18:55:16.601 INFO:teuthology.orchestra.run.smithi046.stdout: python3-trustme-0.6.0-4.el8.noarch 2023-07-05T18:55:16.601 INFO:teuthology.orchestra.run.smithi046.stdout: python3-waitress-1.4.3-1.el8.noarch 2023-07-05T18:55:16.601 INFO:teuthology.orchestra.run.smithi046.stdout: python3-webob-1.8.5-1.el8.1.noarch 2023-07-05T18:55:16.601 INFO:teuthology.orchestra.run.smithi046.stdout: python3-websocket-client-0.56.0-5.el8.noarch 2023-07-05T18:55:16.601 INFO:teuthology.orchestra.run.smithi046.stdout: python3-webtest-2.0.33-1.el8.noarch 2023-07-05T18:55:16.601 INFO:teuthology.orchestra.run.smithi046.stdout: python3-werkzeug-0.12.2-4.el8.noarch 2023-07-05T18:55:16.601 INFO:teuthology.orchestra.run.smithi046.stdout: python3-zc-lockfile-2.0-2.el8.noarch 2023-07-05T18:55:16.602 INFO:teuthology.orchestra.run.smithi046.stdout: rbd-fuse-2:18.0.0-4488.g0a781ef0.el8.x86_64 2023-07-05T18:55:16.602 INFO:teuthology.orchestra.run.smithi046.stdout: rbd-mirror-2:18.0.0-4488.g0a781ef0.el8.x86_64 2023-07-05T18:55:16.602 INFO:teuthology.orchestra.run.smithi046.stdout: rbd-nbd-2:18.0.0-4488.g0a781ef0.el8.x86_64 2023-07-05T18:55:16.602 INFO:teuthology.orchestra.run.smithi046.stdout: socat-1.7.4.1-1.el8.x86_64 2023-07-05T18:55:16.602 INFO:teuthology.orchestra.run.smithi046.stdout: thrift-0.13.0-2.el8.x86_64 2023-07-05T18:55:16.602 INFO:teuthology.orchestra.run.smithi046.stdout: uuid-1.6.2-43.el8.x86_64 2023-07-05T18:55:16.602 INFO:teuthology.orchestra.run.smithi046.stdout: xfsprogs-devel-5.0.0-10.el8.x86_64 2023-07-05T18:55:16.603 INFO:teuthology.orchestra.run.smithi046.stdout: xmlstarlet-1.6.1-20.el8.x86_64 2023-07-05T18:55:16.603 INFO:teuthology.orchestra.run.smithi046.stdout: zlib-devel-1.2.11-18.el8_5.x86_64 2023-07-05T18:55:16.603 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T18:55:16.604 INFO:teuthology.orchestra.run.smithi046.stdout:Complete! 2023-07-05T18:55:16.769 DEBUG:teuthology.parallel:result is None 2023-07-05T18:55:18.861 INFO:teuthology.orchestra.run.smithi073.stdout:Installed products updated. 2023-07-05T18:55:19.082 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-07-05T18:55:19.082 INFO:teuthology.orchestra.run.smithi073.stdout:Upgraded: 2023-07-05T18:55:19.083 INFO:teuthology.orchestra.run.smithi073.stdout: iproute-5.15.0-4.el8_6.1.x86_64 2023-07-05T18:55:19.083 INFO:teuthology.orchestra.run.smithi073.stdout: librados2-2:18.0.0-4488.g0a781ef0.el8.x86_64 2023-07-05T18:55:19.083 INFO:teuthology.orchestra.run.smithi073.stdout: librbd1-2:18.0.0-4488.g0a781ef0.el8.x86_64 2023-07-05T18:55:19.083 INFO:teuthology.orchestra.run.smithi073.stdout:Installed: 2023-07-05T18:55:19.083 INFO:teuthology.orchestra.run.smithi073.stdout: NetworkManager-initscripts-updown-1:1.36.0-9.el8_6.noarch 2023-07-05T18:55:19.083 INFO:teuthology.orchestra.run.smithi073.stdout: automake-1.16.1-7.el8.noarch 2023-07-05T18:55:19.083 INFO:teuthology.orchestra.run.smithi073.stdout: bison-3.0.4-10.el8.x86_64 2023-07-05T18:55:19.084 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-2:18.0.0-4488.g0a781ef0.el8.x86_64 2023-07-05T18:55:19.084 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-base-2:18.0.0-4488.g0a781ef0.el8.x86_64 2023-07-05T18:55:19.084 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-common-2:18.0.0-4488.g0a781ef0.el8.x86_64 2023-07-05T18:55:19.087 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-fuse-2:18.0.0-4488.g0a781ef0.el8.x86_64 2023-07-05T18:55:19.087 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-grafana-dashboards-2:18.0.0-4488.g0a781ef0.el8.noarch 2023-07-05T18:55:19.088 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-immutable-object-cache-2:18.0.0-4488.g0a781ef0.el8.x86_64 2023-07-05T18:55:19.088 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-mds-2:18.0.0-4488.g0a781ef0.el8.x86_64 2023-07-05T18:55:19.088 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-mgr-2:18.0.0-4488.g0a781ef0.el8.x86_64 2023-07-05T18:55:19.088 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-mgr-cephadm-2:18.0.0-4488.g0a781ef0.el8.noarch 2023-07-05T18:55:19.088 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-mgr-dashboard-2:18.0.0-4488.g0a781ef0.el8.noarch 2023-07-05T18:55:19.088 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-mgr-diskprediction-local-2:18.0.0-4488.g0a781ef0.el8.noarch 2023-07-05T18:55:19.088 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-mgr-modules-core-2:18.0.0-4488.g0a781ef0.el8.noarch 2023-07-05T18:55:19.091 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-mgr-rook-2:18.0.0-4488.g0a781ef0.el8.noarch 2023-07-05T18:55:19.091 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-mon-2:18.0.0-4488.g0a781ef0.el8.x86_64 2023-07-05T18:55:19.091 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-osd-2:18.0.0-4488.g0a781ef0.el8.x86_64 2023-07-05T18:55:19.092 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-prometheus-alerts-2:18.0.0-4488.g0a781ef0.el8.noarch 2023-07-05T18:55:19.092 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-radosgw-2:18.0.0-4488.g0a781ef0.el8.x86_64 2023-07-05T18:55:19.092 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-selinux-2:18.0.0-4488.g0a781ef0.el8.x86_64 2023-07-05T18:55:19.092 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-test-2:18.0.0-4488.g0a781ef0.el8.x86_64 2023-07-05T18:55:19.092 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-volume-2:18.0.0-4488.g0a781ef0.el8.noarch 2023-07-05T18:55:19.092 INFO:teuthology.orchestra.run.smithi073.stdout: cephadm-2:18.0.0-4488.g0a781ef0.el8.noarch 2023-07-05T18:55:19.092 INFO:teuthology.orchestra.run.smithi073.stdout: cephfs-mirror-2:18.0.0-4488.g0a781ef0.el8.x86_64 2023-07-05T18:55:19.093 INFO:teuthology.orchestra.run.smithi073.stdout: cephfs-top-2:18.0.0-4488.g0a781ef0.el8.noarch 2023-07-05T18:55:19.093 INFO:teuthology.orchestra.run.smithi073.stdout: elfutils-libelf-devel-0.186-1.el8.x86_64 2023-07-05T18:55:19.093 INFO:teuthology.orchestra.run.smithi073.stdout: flex-2.6.1-9.el8.x86_64 2023-07-05T18:55:19.093 INFO:teuthology.orchestra.run.smithi073.stdout: fuse-2.9.7-15.el8.x86_64 2023-07-05T18:55:19.093 INFO:teuthology.orchestra.run.smithi073.stdout: gperftools-libs-1:2.7-9.el8.x86_64 2023-07-05T18:55:19.094 INFO:teuthology.orchestra.run.smithi073.stdout: jq-1.6-3.el8.x86_64 2023-07-05T18:55:19.095 INFO:teuthology.orchestra.run.smithi073.stdout: keyutils-libs-devel-1.5.10-9.el8.x86_64 2023-07-05T18:55:19.095 INFO:teuthology.orchestra.run.smithi073.stdout: krb5-devel-1.18.2-14.el8.x86_64 2023-07-05T18:55:19.095 INFO:teuthology.orchestra.run.smithi073.stdout: libaio-devel-0.3.112-1.el8.x86_64 2023-07-05T18:55:19.096 INFO:teuthology.orchestra.run.smithi073.stdout: libcephfs-devel-2:18.0.0-4488.g0a781ef0.el8.x86_64 2023-07-05T18:55:19.096 INFO:teuthology.orchestra.run.smithi073.stdout: libcephfs2-2:18.0.0-4488.g0a781ef0.el8.x86_64 2023-07-05T18:55:19.096 INFO:teuthology.orchestra.run.smithi073.stdout: libcephsqlite-2:18.0.0-4488.g0a781ef0.el8.x86_64 2023-07-05T18:55:19.096 INFO:teuthology.orchestra.run.smithi073.stdout: libcom_err-devel-1.45.6-4.el8.x86_64 2023-07-05T18:55:19.096 INFO:teuthology.orchestra.run.smithi073.stdout: libgfortran-8.5.0-10.1.el8_6.x86_64 2023-07-05T18:55:19.096 INFO:teuthology.orchestra.run.smithi073.stdout: liboath-2.6.2-3.el8.x86_64 2023-07-05T18:55:19.097 INFO:teuthology.orchestra.run.smithi073.stdout: libpq-13.5-1.el8.x86_64 2023-07-05T18:55:19.097 INFO:teuthology.orchestra.run.smithi073.stdout: libquadmath-8.5.0-10.1.el8_6.x86_64 2023-07-05T18:55:19.097 INFO:teuthology.orchestra.run.smithi073.stdout: librabbitmq-0.9.0-3.el8.x86_64 2023-07-05T18:55:19.097 INFO:teuthology.orchestra.run.smithi073.stdout: librados-devel-2:18.0.0-4488.g0a781ef0.el8.x86_64 2023-07-05T18:55:19.097 INFO:teuthology.orchestra.run.smithi073.stdout: libradosstriper1-2:18.0.0-4488.g0a781ef0.el8.x86_64 2023-07-05T18:55:19.097 INFO:teuthology.orchestra.run.smithi073.stdout: librdkafka-0.11.4-3.el8.x86_64 2023-07-05T18:55:19.097 INFO:teuthology.orchestra.run.smithi073.stdout: librgw2-2:18.0.0-4488.g0a781ef0.el8.x86_64 2023-07-05T18:55:19.097 INFO:teuthology.orchestra.run.smithi073.stdout: libselinux-devel-2.9-5.el8.x86_64 2023-07-05T18:55:19.098 INFO:teuthology.orchestra.run.smithi073.stdout: libsepol-devel-2.9-3.el8.x86_64 2023-07-05T18:55:19.098 INFO:teuthology.orchestra.run.smithi073.stdout: libtool-2.4.6-25.el8.x86_64 2023-07-05T18:55:19.098 INFO:teuthology.orchestra.run.smithi073.stdout: libunwind-1.3.1-3.el8.x86_64 2023-07-05T18:55:19.099 INFO:teuthology.orchestra.run.smithi073.stdout: libuuid-devel-2.32.1-35.el8.x86_64 2023-07-05T18:55:19.099 INFO:teuthology.orchestra.run.smithi073.stdout: libverto-devel-0.3.0-5.el8.x86_64 2023-07-05T18:55:19.099 INFO:teuthology.orchestra.run.smithi073.stdout: lttng-ust-2.8.1-11.el8.x86_64 2023-07-05T18:55:19.099 INFO:teuthology.orchestra.run.smithi073.stdout: oniguruma-6.8.2-2.el8.x86_64 2023-07-05T18:55:19.100 INFO:teuthology.orchestra.run.smithi073.stdout: openblas-0.3.15-3.el8.x86_64 2023-07-05T18:55:19.101 INFO:teuthology.orchestra.run.smithi073.stdout: openblas-threads-0.3.15-3.el8.x86_64 2023-07-05T18:55:19.101 INFO:teuthology.orchestra.run.smithi073.stdout: openssl-devel-1:1.1.1k-7.el8_6.x86_64 2023-07-05T18:55:19.102 INFO:teuthology.orchestra.run.smithi073.stdout: pcre2-devel-10.32-2.el8.x86_64 2023-07-05T18:55:19.102 INFO:teuthology.orchestra.run.smithi073.stdout: pcre2-utf16-10.32-2.el8.x86_64 2023-07-05T18:55:19.102 INFO:teuthology.orchestra.run.smithi073.stdout: pcre2-utf32-10.32-2.el8.x86_64 2023-07-05T18:55:19.102 INFO:teuthology.orchestra.run.smithi073.stdout: postgresql-10.21-2.module+el8.6.0+15342+53518fac.x86_64 2023-07-05T18:55:19.102 INFO:teuthology.orchestra.run.smithi073.stdout: postgresql-contrib-10.21-2.module+el8.6.0+15342+53518fac.x86_64 2023-07-05T18:55:19.102 INFO:teuthology.orchestra.run.smithi073.stdout: postgresql-server-10.21-2.module+el8.6.0+15342+53518fac.x86_64 2023-07-05T18:55:19.102 INFO:teuthology.orchestra.run.smithi073.stdout: python3-asyncssh-2.7.0-2.el8.noarch 2023-07-05T18:55:19.103 INFO:teuthology.orchestra.run.smithi073.stdout: python3-babel-2.5.1-7.el8.noarch 2023-07-05T18:55:19.103 INFO:teuthology.orchestra.run.smithi073.stdout: python3-bcrypt-3.1.6-2.el8.1.x86_64 2023-07-05T18:55:19.103 INFO:teuthology.orchestra.run.smithi073.stdout: python3-beautifulsoup4-4.6.3-2.el8.1.noarch 2023-07-05T18:55:19.103 INFO:teuthology.orchestra.run.smithi073.stdout: python3-cachetools-3.1.1-4.el8.noarch 2023-07-05T18:55:19.103 INFO:teuthology.orchestra.run.smithi073.stdout: python3-ceph-argparse-2:18.0.0-4488.g0a781ef0.el8.x86_64 2023-07-05T18:55:19.103 INFO:teuthology.orchestra.run.smithi073.stdout: python3-ceph-common-2:18.0.0-4488.g0a781ef0.el8.x86_64 2023-07-05T18:55:19.103 INFO:teuthology.orchestra.run.smithi073.stdout: python3-cephfs-2:18.0.0-4488.g0a781ef0.el8.x86_64 2023-07-05T18:55:19.104 INFO:teuthology.orchestra.run.smithi073.stdout: python3-certifi-2018.10.15-7.el8.noarch 2023-07-05T18:55:19.104 INFO:teuthology.orchestra.run.smithi073.stdout: python3-cffi-1.11.5-5.el8.x86_64 2023-07-05T18:55:19.104 INFO:teuthology.orchestra.run.smithi073.stdout: python3-cheroot-8.5.2-1.el8.noarch 2023-07-05T18:55:19.104 INFO:teuthology.orchestra.run.smithi073.stdout: python3-cherrypy-18.4.0-1.el8.noarch 2023-07-05T18:55:19.104 INFO:teuthology.orchestra.run.smithi073.stdout: python3-cryptography-3.2.1-5.el8.x86_64 2023-07-05T18:55:19.104 INFO:teuthology.orchestra.run.smithi073.stdout: python3-google-auth-1:1.1.1-10.el8.noarch 2023-07-05T18:55:19.104 INFO:teuthology.orchestra.run.smithi073.stdout: python3-jaraco-6.2-6.el8.noarch 2023-07-05T18:55:19.105 INFO:teuthology.orchestra.run.smithi073.stdout: python3-jaraco-functools-2.0-4.el8.noarch 2023-07-05T18:55:19.105 INFO:teuthology.orchestra.run.smithi073.stdout: python3-jinja2-2.10.1-3.el8.noarch 2023-07-05T18:55:19.105 INFO:teuthology.orchestra.run.smithi073.stdout: python3-jsonpatch-1.21-2.el8.noarch 2023-07-05T18:55:19.105 INFO:teuthology.orchestra.run.smithi073.stdout: python3-jsonpointer-1.10-11.el8.noarch 2023-07-05T18:55:19.105 INFO:teuthology.orchestra.run.smithi073.stdout: python3-jwt-1.6.1-2.el8.noarch 2023-07-05T18:55:19.105 INFO:teuthology.orchestra.run.smithi073.stdout: python3-kubernetes-1:11.0.0-6.el8.noarch 2023-07-05T18:55:19.106 INFO:teuthology.orchestra.run.smithi073.stdout: python3-logutils-0.3.5-11.el8.noarch 2023-07-05T18:55:19.106 INFO:teuthology.orchestra.run.smithi073.stdout: python3-mako-1.0.6-13.el8.noarch 2023-07-05T18:55:19.106 INFO:teuthology.orchestra.run.smithi073.stdout: python3-markupsafe-0.23-19.el8.x86_64 2023-07-05T18:55:19.106 INFO:teuthology.orchestra.run.smithi073.stdout: python3-more-itertools-7.2.0-3.el8.noarch 2023-07-05T18:55:19.107 INFO:teuthology.orchestra.run.smithi073.stdout: python3-natsort-7.1.1-2.el8.noarch 2023-07-05T18:55:19.107 INFO:teuthology.orchestra.run.smithi073.stdout: python3-numpy-1:1.14.3-10.el8.x86_64 2023-07-05T18:55:19.107 INFO:teuthology.orchestra.run.smithi073.stdout: python3-numpy-f2py-1:1.14.3-10.el8.x86_64 2023-07-05T18:55:19.107 INFO:teuthology.orchestra.run.smithi073.stdout: python3-oauthlib-2.1.0-1.el8.noarch 2023-07-05T18:55:19.108 INFO:teuthology.orchestra.run.smithi073.stdout: python3-pecan-1.3.2-9.el8.noarch 2023-07-05T18:55:19.108 INFO:teuthology.orchestra.run.smithi073.stdout: python3-portend-2.6-1.el8.noarch 2023-07-05T18:55:19.108 INFO:teuthology.orchestra.run.smithi073.stdout: python3-prettytable-0.7.2-14.el8.noarch 2023-07-05T18:55:19.108 INFO:teuthology.orchestra.run.smithi073.stdout: python3-pyOpenSSL-19.0.0-1.el8.noarch 2023-07-05T18:55:19.109 INFO:teuthology.orchestra.run.smithi073.stdout: python3-pyasn1-0.3.7-6.el8.noarch 2023-07-05T18:55:19.109 INFO:teuthology.orchestra.run.smithi073.stdout: python3-pyasn1-modules-0.3.7-6.el8.noarch 2023-07-05T18:55:19.109 INFO:teuthology.orchestra.run.smithi073.stdout: python3-pycparser-2.14-14.el8.noarch 2023-07-05T18:55:19.121 INFO:teuthology.orchestra.run.smithi073.stdout: python3-pytz-2017.2-9.el8.noarch 2023-07-05T18:55:19.121 INFO:teuthology.orchestra.run.smithi073.stdout: python3-rados-2:18.0.0-4488.g0a781ef0.el8.x86_64 2023-07-05T18:55:19.122 INFO:teuthology.orchestra.run.smithi073.stdout: python3-rbd-2:18.0.0-4488.g0a781ef0.el8.x86_64 2023-07-05T18:55:19.122 INFO:teuthology.orchestra.run.smithi073.stdout: python3-repoze-lru-0.7-6.el8.noarch 2023-07-05T18:55:19.122 INFO:teuthology.orchestra.run.smithi073.stdout: python3-requests-oauthlib-1.0.0-1.el8.noarch 2023-07-05T18:55:19.122 INFO:teuthology.orchestra.run.smithi073.stdout: python3-rgw-2:18.0.0-4488.g0a781ef0.el8.x86_64 2023-07-05T18:55:19.122 INFO:teuthology.orchestra.run.smithi073.stdout: python3-routes-2.4.1-12.el8.noarch 2023-07-05T18:55:19.122 INFO:teuthology.orchestra.run.smithi073.stdout: python3-rsa-4.8-1.el8.noarch 2023-07-05T18:55:19.122 INFO:teuthology.orchestra.run.smithi073.stdout: python3-scipy-1.0.0-21.module+el8.5.0+10916+41bd434d.x86_64 2023-07-05T18:55:19.123 INFO:teuthology.orchestra.run.smithi073.stdout: python3-simplegeneric-0.8.1-17.el8.noarch 2023-07-05T18:55:19.123 INFO:teuthology.orchestra.run.smithi073.stdout: python3-singledispatch-3.4.0.3-18.el8.noarch 2023-07-05T18:55:19.123 INFO:teuthology.orchestra.run.smithi073.stdout: python3-tempora-1.14.1-5.el8.noarch 2023-07-05T18:55:19.123 INFO:teuthology.orchestra.run.smithi073.stdout: python3-trustme-0.6.0-4.el8.noarch 2023-07-05T18:55:19.125 INFO:teuthology.orchestra.run.smithi073.stdout: python3-waitress-1.4.3-1.el8.noarch 2023-07-05T18:55:19.126 INFO:teuthology.orchestra.run.smithi073.stdout: python3-webob-1.8.5-1.el8.1.noarch 2023-07-05T18:55:19.126 INFO:teuthology.orchestra.run.smithi073.stdout: python3-websocket-client-0.56.0-5.el8.noarch 2023-07-05T18:55:19.126 INFO:teuthology.orchestra.run.smithi073.stdout: python3-webtest-2.0.33-1.el8.noarch 2023-07-05T18:55:19.126 INFO:teuthology.orchestra.run.smithi073.stdout: python3-werkzeug-0.12.2-4.el8.noarch 2023-07-05T18:55:19.126 INFO:teuthology.orchestra.run.smithi073.stdout: python3-zc-lockfile-2.0-2.el8.noarch 2023-07-05T18:55:19.127 INFO:teuthology.orchestra.run.smithi073.stdout: rbd-fuse-2:18.0.0-4488.g0a781ef0.el8.x86_64 2023-07-05T18:55:19.127 INFO:teuthology.orchestra.run.smithi073.stdout: rbd-mirror-2:18.0.0-4488.g0a781ef0.el8.x86_64 2023-07-05T18:55:19.127 INFO:teuthology.orchestra.run.smithi073.stdout: rbd-nbd-2:18.0.0-4488.g0a781ef0.el8.x86_64 2023-07-05T18:55:19.128 INFO:teuthology.orchestra.run.smithi073.stdout: socat-1.7.4.1-1.el8.x86_64 2023-07-05T18:55:19.128 INFO:teuthology.orchestra.run.smithi073.stdout: thrift-0.13.0-2.el8.x86_64 2023-07-05T18:55:19.128 INFO:teuthology.orchestra.run.smithi073.stdout: uuid-1.6.2-43.el8.x86_64 2023-07-05T18:55:19.128 INFO:teuthology.orchestra.run.smithi073.stdout: xfsprogs-devel-5.0.0-10.el8.x86_64 2023-07-05T18:55:19.128 INFO:teuthology.orchestra.run.smithi073.stdout: xmlstarlet-1.6.1-20.el8.x86_64 2023-07-05T18:55:19.128 INFO:teuthology.orchestra.run.smithi073.stdout: zlib-devel-1.2.11-18.el8_5.x86_64 2023-07-05T18:55:19.128 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-07-05T18:55:19.128 INFO:teuthology.orchestra.run.smithi073.stdout:Complete! 2023-07-05T18:55:19.263 DEBUG:teuthology.parallel:result is None 2023-07-05T18:55:19.264 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=0a781ef0807ae9473fb1306ef07036226ca4f1a6 2023-07-05T18:55:19.450 DEBUG:teuthology.orchestra.run.smithi046:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2023-07-05T18:55:19.487 INFO:teuthology.orchestra.run.smithi046.stdout:18.0.0-4488.g0a781ef0.el8 2023-07-05T18:55:19.488 INFO:teuthology.packaging:The installed version of ceph is 18.0.0-4488.g0a781ef0.el8 2023-07-05T18:55:19.488 INFO:teuthology.task.install:The correct ceph version 18.0.0-4488.g0a781ef0 is installed. 2023-07-05T18:55:19.489 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=0a781ef0807ae9473fb1306ef07036226ca4f1a6 2023-07-05T18:55:19.639 DEBUG:teuthology.orchestra.run.smithi073:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2023-07-05T18:55:19.669 INFO:teuthology.orchestra.run.smithi073.stdout:18.0.0-4488.g0a781ef0.el8 2023-07-05T18:55:19.669 INFO:teuthology.packaging:The installed version of ceph is 18.0.0-4488.g0a781ef0.el8 2023-07-05T18:55:19.670 INFO:teuthology.task.install:The correct ceph version 18.0.0-4488.g0a781ef0 is installed. 2023-07-05T18:55:19.670 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2023-07-05T18:55:19.671 DEBUG:teuthology.orchestra.run.smithi046:> set -ex 2023-07-05T18:55:19.671 DEBUG:teuthology.orchestra.run.smithi046:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2023-07-05T18:55:19.726 DEBUG:teuthology.orchestra.run.smithi073:> set -ex 2023-07-05T18:55:19.727 DEBUG:teuthology.orchestra.run.smithi073:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2023-07-05T18:55:19.780 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2023-07-05T18:55:19.781 DEBUG:teuthology.orchestra.run.smithi046:> set -ex 2023-07-05T18:55:19.781 DEBUG:teuthology.orchestra.run.smithi046:> sudo dd of=/usr/bin/daemon-helper 2023-07-05T18:55:19.815 DEBUG:teuthology.orchestra.run.smithi046:> sudo chmod a=rx -- /usr/bin/daemon-helper 2023-07-05T18:55:19.885 DEBUG:teuthology.orchestra.run.smithi073:> set -ex 2023-07-05T18:55:19.885 DEBUG:teuthology.orchestra.run.smithi073:> sudo dd of=/usr/bin/daemon-helper 2023-07-05T18:55:19.931 DEBUG:teuthology.orchestra.run.smithi073:> sudo chmod a=rx -- /usr/bin/daemon-helper 2023-07-05T18:55:19.999 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2023-07-05T18:55:20.000 DEBUG:teuthology.orchestra.run.smithi046:> set -ex 2023-07-05T18:55:20.000 DEBUG:teuthology.orchestra.run.smithi046:> sudo dd of=/usr/bin/adjust-ulimits 2023-07-05T18:55:20.039 DEBUG:teuthology.orchestra.run.smithi046:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2023-07-05T18:55:20.111 DEBUG:teuthology.orchestra.run.smithi073:> set -ex 2023-07-05T18:55:20.111 DEBUG:teuthology.orchestra.run.smithi073:> sudo dd of=/usr/bin/adjust-ulimits 2023-07-05T18:55:20.138 DEBUG:teuthology.orchestra.run.smithi073:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2023-07-05T18:55:20.206 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2023-07-05T18:55:20.206 DEBUG:teuthology.orchestra.run.smithi046:> set -ex 2023-07-05T18:55:20.207 DEBUG:teuthology.orchestra.run.smithi046:> sudo dd of=/usr/bin/stdin-killer 2023-07-05T18:55:20.238 DEBUG:teuthology.orchestra.run.smithi046:> sudo chmod a=rx -- /usr/bin/stdin-killer 2023-07-05T18:55:20.360 DEBUG:teuthology.orchestra.run.smithi073:> set -ex 2023-07-05T18:55:20.361 DEBUG:teuthology.orchestra.run.smithi073:> sudo dd of=/usr/bin/stdin-killer 2023-07-05T18:55:20.387 DEBUG:teuthology.orchestra.run.smithi073:> sudo chmod a=rx -- /usr/bin/stdin-killer 2023-07-05T18:55:20.457 INFO:teuthology.run_tasks:Running task ceph... 2023-07-05T18:55:20.562 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2023-07-05T18:55:20.563 DEBUG:teuthology.orchestra.run.smithi046:> sudo chmod 777 /var/log/ceph 2023-07-05T18:55:20.567 DEBUG:teuthology.orchestra.run.smithi073:> sudo chmod 777 /var/log/ceph 2023-07-05T18:55:20.597 INFO:tasks.ceph:Disabling ceph logrotate... 2023-07-05T18:55:20.597 DEBUG:teuthology.orchestra.run.smithi046:> sudo rm -f -- /etc/logrotate.d/ceph 2023-07-05T18:55:20.643 DEBUG:teuthology.orchestra.run.smithi073:> sudo rm -f -- /etc/logrotate.d/ceph 2023-07-05T18:55:20.682 INFO:tasks.ceph:Creating extra log directories... 2023-07-05T18:55:20.682 DEBUG:teuthology.orchestra.run.smithi046:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2023-07-05T18:55:20.716 DEBUG:teuthology.orchestra.run.smithi073:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2023-07-05T18:55:20.770 INFO:tasks.ceph:Setting up log rotation with {'ceph-mds': '10G', 'ceph-osd': '10G'} 2023-07-05T18:55:20.771 INFO:tasks.ceph:writing logrotate stanza for ceph-mds 2023-07-05T18:55:20.771 INFO:tasks.ceph:writing logrotate stanza for ceph-osd 2023-07-05T18:55:20.771 DEBUG:teuthology.orchestra.run.smithi046:> set -ex 2023-07-05T18:55:20.772 DEBUG:teuthology.orchestra.run.smithi046:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2023-07-05T18:55:20.807 DEBUG:teuthology.orchestra.run.smithi046:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2023-07-05T18:55:20.978 DEBUG:teuthology.orchestra.run.smithi046:> sudo chcon system_u:object_r:etc_t:s0 /etc/logrotate.d/ceph-test.conf 2023-07-05T18:55:21.010 DEBUG:teuthology.orchestra.run.smithi073:> set -ex 2023-07-05T18:55:21.011 DEBUG:teuthology.orchestra.run.smithi073:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2023-07-05T18:55:21.029 DEBUG:teuthology.orchestra.run.smithi073:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2023-07-05T18:55:21.174 DEBUG:teuthology.orchestra.run.smithi073:> sudo chcon system_u:object_r:etc_t:s0 /etc/logrotate.d/ceph-test.conf 2023-07-05T18:55:21.234 INFO:tasks.ceph:Creating ceph cluster ceph... 2023-07-05T18:55:21.234 INFO:tasks.ceph:config {'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'ms die on skipped message': False}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2023-07-05T18:55:21.235 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/rishabh-2023-07-05_18:32:52-fs-wip-rishabh-CephManager-in-CephFSTestCase-testing-default-smithi/7327386', 'branch': 'wip-rishabh-CephManager-in-CephFSTestCase', 'description': 'fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/xfstests-dev}', 'email': None, 'first_in_suite': False, 'job_id': '7327386', 'kernel': {'client': {'sha1': 'distro'}, 'flavor': 'default', 'kdb': True, 'sha1': '84139c18d56f518615369e8310ae4ecf07a36dcd'}, 'ktype': 'distro', 'last_in_suite': False, 'log-rotate': {'ceph-mds': '10G', 'ceph-osd': '10G'}, 'machine_type': 'smithi', 'name': 'rishabh-2023-07-05_18:32:52-fs-wip-rishabh-CephManager-in-CephFSTestCase-testing-default-smithi', 'no_nested_subset': False, 'nuke-on-error': True, 'openstack': [{'volumes': {'count': 4, 'size': 20}}, {'machine': {'disk': 200}}], 'os_type': 'rhel', 'os_version': '8.6', 'overrides': {'admin_socket': {'branch': 'wip-rishabh-CephManager-in-CephFSTestCase'}, 'ceph': {'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'ms die on skipped message': False}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding'], 'sha1': '0a781ef0807ae9473fb1306ef07036226ca4f1a6'}, 'ceph-deploy': {'bluestore': True, 'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {'osd default pool size': 2}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'fs': 'xfs'}, 'install': {'ceph': {'flavor': 'default', 'sha1': '0a781ef0807ae9473fb1306ef07036226ca4f1a6'}}, 'kclient': {'syntax': 'v1'}, 'selinux': {'whitelist': ['scontext=system_u:system_r:logrotate_t:s0']}, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'wip-rishabh-CephManager-in-CephFSTestCase', 'sha1': '0a781ef0807ae9473fb1306ef07036226ca4f1a6'}}, 'owner': 'scheduled_rishabh@teuthology', 'priority': 80, 'repo': 'https://git.ceph.com/ceph-ci.git', 'roles': [['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'client.2'], ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'client.3']], 'sha1': '0a781ef0807ae9473fb1306ef07036226ca4f1a6', 'sleep_before_teardown': 0, 'suite': 'fs', 'suite_branch': 'wip-rishabh-CephManager-in-CephFSTestCase', 'suite_path': '/home/teuthworker/src/git.ceph.com_ceph-c_0a781ef0807ae9473fb1306ef07036226ca4f1a6/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://git.ceph.com/ceph-ci.git', 'suite_sha1': '0a781ef0807ae9473fb1306ef07036226ca4f1a6', 'syslog': {'ignorelist': ['WARNING*.*check_session_state', 'WARNING*.*__ceph_remove_cap']}, 'targets': {'smithi046.front.sepia.ceph.com': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCpUxo5ay/ucdkX9rleNMm8Ofp24XRXUtJPOK3Ji3XBpTiUgmmwneaY6316+3CG+k4K0p3IebanuyTvZApjm02/dNCvu8yD3rjEpWVgIuqYH8O3lEdN9DXcCX+7xHJE0m18+ZPsJQVsNrNJxY+5zqyNnBc8jpZq2LStsWwPOKPWhauANRkOBFSGDoLppWZbLx/yJs+R0qoNLLK9LpKQTUnqsapXvbD27OpPahzj/qbNxFPPyY6XrrldZ6qEO+EjJOujFLH3gzv0kJu10DCuzxrpz6ston4RPi1O3GgcHnF4Mqr/W9VwZ94UTMh+k4dIFRVqJEKrcwRHa5kFsvH/WhVx0Ygr/MiV/Q86mmV7JT+/MpzIRTtWyei5L9IBeZIE9cwzj+mOk6SD/t1roIVEGVV/uF2AyFDVBPr6F8oZ822OGpUyyaDsWTitPNdTX4TC3zdSrLc9tyDa1P74eH/ZLeTSf+C6pM/cepOhQaa6XzpDiPSuJUm9HOQxUlEAvcqa7Ac=', 'smithi073.front.sepia.ceph.com': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCpUxo5ay/ucdkX9rleNMm8Ofp24XRXUtJPOK3Ji3XBpTiUgmmwneaY6316+3CG+k4K0p3IebanuyTvZApjm02/dNCvu8yD3rjEpWVgIuqYH8O3lEdN9DXcCX+7xHJE0m18+ZPsJQVsNrNJxY+5zqyNnBc8jpZq2LStsWwPOKPWhauANRkOBFSGDoLppWZbLx/yJs+R0qoNLLK9LpKQTUnqsapXvbD27OpPahzj/qbNxFPPyY6XrrldZ6qEO+EjJOujFLH3gzv0kJu10DCuzxrpz6ston4RPi1O3GgcHnF4Mqr/W9VwZ94UTMh+k4dIFRVqJEKrcwRHa5kFsvH/WhVx0Ygr/MiV/Q86mmV7JT+/MpzIRTtWyei5L9IBeZIE9cwzj+mOk6SD/t1roIVEGVV/uF2AyFDVBPr6F8oZ822OGpUyyaDsWTitPNdTX4TC3zdSrLc9tyDa1P74eH/ZLeTSf+C6pM/cepOhQaa6XzpDiPSuJUm9HOQxUlEAvcqa7Ac='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'client': {'sha1': 'distro'}, 'flavor': 'default', 'kdb': True, 'sha1': '84139c18d56f518615369e8310ae4ecf07a36dcd'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': '0a781ef0807ae9473fb1306ef07036226ca4f1a6'}}, {'ceph': None}, {'kclient': None}, {'cephfs_test_runner': {'fail_on_skip': False, 'modules': ['tasks.cephfs.tests_from_xfstests_dev']}}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': ["local function is_kupstream() return yaml.ktype == 'upstream' end", "local function is_kdistro() return yaml.ktype == 'distro' end", 'local function is_fuse() return false end', 'local function syntax_version() return yaml.overrides.kclient.syntax end']}, 'teuthology_branch': 'main', 'teuthology_sha1': 'b53f236c1077f1d295baafb9e0ca9a4b447019d7', 'timestamp': '2023-07-05_18:32:52', 'tube': 'smithi', 'user': 'rishabh', 'verbose': False, 'worker_log': '/home/teuthworker/archive/worker_logs/dispatcher.smithi.23459'} 2023-07-05T18:55:21.236 DEBUG:teuthology.orchestra.run.smithi046:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2023-07-05T18:55:21.246 DEBUG:teuthology.orchestra.run.smithi073:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2023-07-05T18:55:21.279 DEBUG:teuthology.orchestra.run.smithi046:> sudo install -d -m0777 -- /var/run/ceph 2023-07-05T18:55:21.306 DEBUG:teuthology.orchestra.run.smithi073:> sudo install -d -m0777 -- /var/run/ceph 2023-07-05T18:55:21.357 DEBUG:teuthology.orchestra.run.smithi046:> set -ex 2023-07-05T18:55:21.358 DEBUG:teuthology.orchestra.run.smithi046:> dd if=/scratch_devs of=/dev/stdout 2023-07-05T18:55:21.399 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2023-07-05T18:55:21.400 DEBUG:teuthology.orchestra.run.smithi046:> stat /dev/vg_nvme/lv_1 2023-07-05T18:55:21.460 INFO:teuthology.orchestra.run.smithi046.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2023-07-05T18:55:21.460 INFO:teuthology.orchestra.run.smithi046.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-07-05T18:55:21.460 INFO:teuthology.orchestra.run.smithi046.stdout:Device: 6h/6d Inode: 380136 Links: 1 2023-07-05T18:55:21.460 INFO:teuthology.orchestra.run.smithi046.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-07-05T18:55:21.461 INFO:teuthology.orchestra.run.smithi046.stdout:Context: system_u:object_r:device_t:s0 2023-07-05T18:55:21.461 INFO:teuthology.orchestra.run.smithi046.stdout:Access: 2023-07-05 18:55:08.401301837 +0000 2023-07-05T18:55:21.461 INFO:teuthology.orchestra.run.smithi046.stdout:Modify: 2023-07-05 18:52:25.451759816 +0000 2023-07-05T18:55:21.461 INFO:teuthology.orchestra.run.smithi046.stdout:Change: 2023-07-05 18:52:25.451759816 +0000 2023-07-05T18:55:21.461 INFO:teuthology.orchestra.run.smithi046.stdout: Birth: - 2023-07-05T18:55:21.462 DEBUG:teuthology.orchestra.run.smithi046:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2023-07-05T18:55:21.530 INFO:teuthology.orchestra.run.smithi046.stderr:1+0 records in 2023-07-05T18:55:21.531 INFO:teuthology.orchestra.run.smithi046.stderr:1+0 records out 2023-07-05T18:55:21.531 INFO:teuthology.orchestra.run.smithi046.stderr:512 bytes copied, 0.000133153 s, 3.8 MB/s 2023-07-05T18:55:21.532 DEBUG:teuthology.orchestra.run.smithi046:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2023-07-05T18:55:21.595 DEBUG:teuthology.orchestra.run.smithi046:> stat /dev/vg_nvme/lv_2 2023-07-05T18:55:21.655 INFO:teuthology.orchestra.run.smithi046.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2023-07-05T18:55:21.655 INFO:teuthology.orchestra.run.smithi046.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-07-05T18:55:21.656 INFO:teuthology.orchestra.run.smithi046.stdout:Device: 6h/6d Inode: 374388 Links: 1 2023-07-05T18:55:21.656 INFO:teuthology.orchestra.run.smithi046.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-07-05T18:55:21.656 INFO:teuthology.orchestra.run.smithi046.stdout:Context: system_u:object_r:device_t:s0 2023-07-05T18:55:21.656 INFO:teuthology.orchestra.run.smithi046.stdout:Access: 2023-07-05 18:55:08.402301825 +0000 2023-07-05T18:55:21.656 INFO:teuthology.orchestra.run.smithi046.stdout:Modify: 2023-07-05 18:52:25.987753897 +0000 2023-07-05T18:55:21.656 INFO:teuthology.orchestra.run.smithi046.stdout:Change: 2023-07-05 18:52:25.987753897 +0000 2023-07-05T18:55:21.656 INFO:teuthology.orchestra.run.smithi046.stdout: Birth: - 2023-07-05T18:55:21.657 DEBUG:teuthology.orchestra.run.smithi046:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2023-07-05T18:55:21.729 INFO:teuthology.orchestra.run.smithi046.stderr:1+0 records in 2023-07-05T18:55:21.729 INFO:teuthology.orchestra.run.smithi046.stderr:1+0 records out 2023-07-05T18:55:21.729 INFO:teuthology.orchestra.run.smithi046.stderr:512 bytes copied, 0.000124072 s, 4.1 MB/s 2023-07-05T18:55:21.730 DEBUG:teuthology.orchestra.run.smithi046:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2023-07-05T18:55:21.790 DEBUG:teuthology.orchestra.run.smithi046:> stat /dev/vg_nvme/lv_3 2023-07-05T18:55:21.850 INFO:teuthology.orchestra.run.smithi046.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2023-07-05T18:55:21.850 INFO:teuthology.orchestra.run.smithi046.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-07-05T18:55:21.851 INFO:teuthology.orchestra.run.smithi046.stdout:Device: 6h/6d Inode: 379205 Links: 1 2023-07-05T18:55:21.851 INFO:teuthology.orchestra.run.smithi046.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-07-05T18:55:21.851 INFO:teuthology.orchestra.run.smithi046.stdout:Context: system_u:object_r:device_t:s0 2023-07-05T18:55:21.851 INFO:teuthology.orchestra.run.smithi046.stdout:Access: 2023-07-05 18:55:08.402301825 +0000 2023-07-05T18:55:21.851 INFO:teuthology.orchestra.run.smithi046.stdout:Modify: 2023-07-05 18:52:26.524747968 +0000 2023-07-05T18:55:21.851 INFO:teuthology.orchestra.run.smithi046.stdout:Change: 2023-07-05 18:52:26.524747968 +0000 2023-07-05T18:55:21.852 INFO:teuthology.orchestra.run.smithi046.stdout: Birth: - 2023-07-05T18:55:21.852 DEBUG:teuthology.orchestra.run.smithi046:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2023-07-05T18:55:21.921 INFO:teuthology.orchestra.run.smithi046.stderr:1+0 records in 2023-07-05T18:55:21.922 INFO:teuthology.orchestra.run.smithi046.stderr:1+0 records out 2023-07-05T18:55:21.922 INFO:teuthology.orchestra.run.smithi046.stderr:512 bytes copied, 0.000102741 s, 5.0 MB/s 2023-07-05T18:55:21.924 DEBUG:teuthology.orchestra.run.smithi046:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2023-07-05T18:55:21.982 DEBUG:teuthology.orchestra.run.smithi046:> stat /dev/vg_nvme/lv_4 2023-07-05T18:55:22.043 INFO:teuthology.orchestra.run.smithi046.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2023-07-05T18:55:22.043 INFO:teuthology.orchestra.run.smithi046.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-07-05T18:55:22.043 INFO:teuthology.orchestra.run.smithi046.stdout:Device: 6h/6d Inode: 379277 Links: 1 2023-07-05T18:55:22.044 INFO:teuthology.orchestra.run.smithi046.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-07-05T18:55:22.044 INFO:teuthology.orchestra.run.smithi046.stdout:Context: system_u:object_r:device_t:s0 2023-07-05T18:55:22.044 INFO:teuthology.orchestra.run.smithi046.stdout:Access: 2023-07-05 18:55:08.402301825 +0000 2023-07-05T18:55:22.045 INFO:teuthology.orchestra.run.smithi046.stdout:Modify: 2023-07-05 18:52:27.050742160 +0000 2023-07-05T18:55:22.045 INFO:teuthology.orchestra.run.smithi046.stdout:Change: 2023-07-05 18:52:27.050742160 +0000 2023-07-05T18:55:22.045 INFO:teuthology.orchestra.run.smithi046.stdout: Birth: - 2023-07-05T18:55:22.045 DEBUG:teuthology.orchestra.run.smithi046:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2023-07-05T18:55:22.110 INFO:teuthology.orchestra.run.smithi046.stderr:1+0 records in 2023-07-05T18:55:22.110 INFO:teuthology.orchestra.run.smithi046.stderr:1+0 records out 2023-07-05T18:55:22.110 INFO:teuthology.orchestra.run.smithi046.stderr:512 bytes copied, 0.000100627 s, 5.1 MB/s 2023-07-05T18:55:22.111 DEBUG:teuthology.orchestra.run.smithi046:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2023-07-05T18:55:22.170 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-07-05T18:55:22.171 DEBUG:teuthology.orchestra.run.smithi073:> set -ex 2023-07-05T18:55:22.171 DEBUG:teuthology.orchestra.run.smithi073:> dd if=/scratch_devs of=/dev/stdout 2023-07-05T18:55:22.191 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2023-07-05T18:55:22.191 DEBUG:teuthology.orchestra.run.smithi073:> stat /dev/vg_nvme/lv_1 2023-07-05T18:55:22.255 INFO:teuthology.orchestra.run.smithi073.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2023-07-05T18:55:22.255 INFO:teuthology.orchestra.run.smithi073.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-07-05T18:55:22.255 INFO:teuthology.orchestra.run.smithi073.stdout:Device: 6h/6d Inode: 380186 Links: 1 2023-07-05T18:55:22.255 INFO:teuthology.orchestra.run.smithi073.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-07-05T18:55:22.256 INFO:teuthology.orchestra.run.smithi073.stdout:Context: system_u:object_r:device_t:s0 2023-07-05T18:55:22.256 INFO:teuthology.orchestra.run.smithi073.stdout:Access: 2023-07-05 18:55:10.683832522 +0000 2023-07-05T18:55:22.256 INFO:teuthology.orchestra.run.smithi073.stdout:Modify: 2023-07-05 18:52:17.055954217 +0000 2023-07-05T18:55:22.256 INFO:teuthology.orchestra.run.smithi073.stdout:Change: 2023-07-05 18:52:17.055954217 +0000 2023-07-05T18:55:22.256 INFO:teuthology.orchestra.run.smithi073.stdout: Birth: - 2023-07-05T18:55:22.256 DEBUG:teuthology.orchestra.run.smithi073:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2023-07-05T18:55:22.328 INFO:teuthology.orchestra.run.smithi073.stderr:1+0 records in 2023-07-05T18:55:22.329 INFO:teuthology.orchestra.run.smithi073.stderr:1+0 records out 2023-07-05T18:55:22.329 INFO:teuthology.orchestra.run.smithi073.stderr:512 bytes copied, 0.00032432 s, 1.6 MB/s 2023-07-05T18:55:22.329 DEBUG:teuthology.orchestra.run.smithi073:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2023-07-05T18:55:22.391 DEBUG:teuthology.orchestra.run.smithi073:> stat /dev/vg_nvme/lv_2 2023-07-05T18:55:22.455 INFO:teuthology.orchestra.run.smithi073.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2023-07-05T18:55:22.456 INFO:teuthology.orchestra.run.smithi073.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-07-05T18:55:22.456 INFO:teuthology.orchestra.run.smithi073.stdout:Device: 6h/6d Inode: 379585 Links: 1 2023-07-05T18:55:22.456 INFO:teuthology.orchestra.run.smithi073.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-07-05T18:55:22.456 INFO:teuthology.orchestra.run.smithi073.stdout:Context: system_u:object_r:device_t:s0 2023-07-05T18:55:22.456 INFO:teuthology.orchestra.run.smithi073.stdout:Access: 2023-07-05 18:55:10.683832522 +0000 2023-07-05T18:55:22.456 INFO:teuthology.orchestra.run.smithi073.stdout:Modify: 2023-07-05 18:52:17.617941214 +0000 2023-07-05T18:55:22.457 INFO:teuthology.orchestra.run.smithi073.stdout:Change: 2023-07-05 18:52:17.617941214 +0000 2023-07-05T18:55:22.457 INFO:teuthology.orchestra.run.smithi073.stdout: Birth: - 2023-07-05T18:55:22.457 DEBUG:teuthology.orchestra.run.smithi073:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2023-07-05T18:55:22.524 INFO:teuthology.orchestra.run.smithi073.stderr:1+0 records in 2023-07-05T18:55:22.525 INFO:teuthology.orchestra.run.smithi073.stderr:1+0 records out 2023-07-05T18:55:22.525 INFO:teuthology.orchestra.run.smithi073.stderr:512 bytes copied, 0.000220271 s, 2.3 MB/s 2023-07-05T18:55:22.526 DEBUG:teuthology.orchestra.run.smithi073:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2023-07-05T18:55:22.588 DEBUG:teuthology.orchestra.run.smithi073:> stat /dev/vg_nvme/lv_3 2023-07-05T18:55:22.649 INFO:teuthology.orchestra.run.smithi073.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2023-07-05T18:55:22.650 INFO:teuthology.orchestra.run.smithi073.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-07-05T18:55:22.650 INFO:teuthology.orchestra.run.smithi073.stdout:Device: 6h/6d Inode: 379639 Links: 1 2023-07-05T18:55:22.650 INFO:teuthology.orchestra.run.smithi073.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-07-05T18:55:22.650 INFO:teuthology.orchestra.run.smithi073.stdout:Context: system_u:object_r:device_t:s0 2023-07-05T18:55:22.650 INFO:teuthology.orchestra.run.smithi073.stdout:Access: 2023-07-05 18:55:10.684832499 +0000 2023-07-05T18:55:22.650 INFO:teuthology.orchestra.run.smithi073.stdout:Modify: 2023-07-05 18:52:18.132929298 +0000 2023-07-05T18:55:22.651 INFO:teuthology.orchestra.run.smithi073.stdout:Change: 2023-07-05 18:52:18.132929298 +0000 2023-07-05T18:55:22.651 INFO:teuthology.orchestra.run.smithi073.stdout: Birth: - 2023-07-05T18:55:22.651 DEBUG:teuthology.orchestra.run.smithi073:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2023-07-05T18:55:22.720 INFO:teuthology.orchestra.run.smithi073.stderr:1+0 records in 2023-07-05T18:55:22.720 INFO:teuthology.orchestra.run.smithi073.stderr:1+0 records out 2023-07-05T18:55:22.721 INFO:teuthology.orchestra.run.smithi073.stderr:512 bytes copied, 0.000235797 s, 2.2 MB/s 2023-07-05T18:55:22.722 DEBUG:teuthology.orchestra.run.smithi073:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2023-07-05T18:55:22.782 DEBUG:teuthology.orchestra.run.smithi073:> stat /dev/vg_nvme/lv_4 2023-07-05T18:55:22.842 INFO:teuthology.orchestra.run.smithi073.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2023-07-05T18:55:22.842 INFO:teuthology.orchestra.run.smithi073.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-07-05T18:55:22.842 INFO:teuthology.orchestra.run.smithi073.stdout:Device: 6h/6d Inode: 381163 Links: 1 2023-07-05T18:55:22.843 INFO:teuthology.orchestra.run.smithi073.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-07-05T18:55:22.843 INFO:teuthology.orchestra.run.smithi073.stdout:Context: system_u:object_r:device_t:s0 2023-07-05T18:55:22.843 INFO:teuthology.orchestra.run.smithi073.stdout:Access: 2023-07-05 18:55:10.684832499 +0000 2023-07-05T18:55:22.843 INFO:teuthology.orchestra.run.smithi073.stdout:Modify: 2023-07-05 18:52:18.640917543 +0000 2023-07-05T18:55:22.843 INFO:teuthology.orchestra.run.smithi073.stdout:Change: 2023-07-05 18:52:18.640917543 +0000 2023-07-05T18:55:22.843 INFO:teuthology.orchestra.run.smithi073.stdout: Birth: - 2023-07-05T18:55:22.844 DEBUG:teuthology.orchestra.run.smithi073:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2023-07-05T18:55:22.914 INFO:teuthology.orchestra.run.smithi073.stderr:1+0 records in 2023-07-05T18:55:22.915 INFO:teuthology.orchestra.run.smithi073.stderr:1+0 records out 2023-07-05T18:55:22.917 INFO:teuthology.orchestra.run.smithi073.stderr:512 bytes copied, 0.000250956 s, 2.0 MB/s 2023-07-05T18:55:22.924 DEBUG:teuthology.orchestra.run.smithi073:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2023-07-05T18:55:22.986 INFO:tasks.ceph:osd dev map: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-07-05T18:55:22.986 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi046.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi073.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2023-07-05T18:55:22.986 INFO:tasks.ceph:Generating config... 2023-07-05T18:55:22.988 INFO:tasks.ceph:[client] client mount timeout = 600 2023-07-05T18:55:22.988 INFO:tasks.ceph:[client] debug client = 20 2023-07-05T18:55:22.989 INFO:tasks.ceph:[client] debug ms = 1 2023-07-05T18:55:22.990 INFO:tasks.ceph:[client] pid file = 2023-07-05T18:55:22.990 INFO:tasks.ceph:[client] rados mon op timeout = 900 2023-07-05T18:55:22.990 INFO:tasks.ceph:[client] rados osd op timeout = 900 2023-07-05T18:55:22.990 INFO:tasks.ceph:[global] ms die on skipped message = False 2023-07-05T18:55:22.991 INFO:tasks.ceph:[mds] debug mds = 20 2023-07-05T18:55:22.991 INFO:tasks.ceph:[mds] debug mds balancer = 20 2023-07-05T18:55:22.991 INFO:tasks.ceph:[mds] debug ms = 1 2023-07-05T18:55:22.991 INFO:tasks.ceph:[mds] mds debug frag = True 2023-07-05T18:55:22.992 INFO:tasks.ceph:[mds] mds debug scatterstat = True 2023-07-05T18:55:22.992 INFO:tasks.ceph:[mds] mds op complaint time = 180 2023-07-05T18:55:22.992 INFO:tasks.ceph:[mds] mds verify scatter = True 2023-07-05T18:55:22.992 INFO:tasks.ceph:[mds] osd op complaint time = 180 2023-07-05T18:55:22.996 INFO:tasks.ceph:[mds] rados mon op timeout = 900 2023-07-05T18:55:22.996 INFO:tasks.ceph:[mds] rados osd op timeout = 900 2023-07-05T18:55:22.996 INFO:tasks.ceph:[mgr] debug mgr = 20 2023-07-05T18:55:22.996 INFO:tasks.ceph:[mgr] debug ms = 1 2023-07-05T18:55:22.996 INFO:tasks.ceph:[mon] debug mon = 20 2023-07-05T18:55:22.997 INFO:tasks.ceph:[mon] debug ms = 1 2023-07-05T18:55:22.997 INFO:tasks.ceph:[mon] debug paxos = 20 2023-07-05T18:55:22.997 INFO:tasks.ceph:[mon] mon op complaint time = 120 2023-07-05T18:55:22.997 INFO:tasks.ceph:[osd] bdev async discard = True 2023-07-05T18:55:22.997 INFO:tasks.ceph:[osd] bdev enable discard = True 2023-07-05T18:55:22.998 INFO:tasks.ceph:[osd] bluestore allocator = bitmap 2023-07-05T18:55:22.998 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2023-07-05T18:55:22.998 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2023-07-05T18:55:22.998 INFO:tasks.ceph:[osd] debug bluefs = 1/20 2023-07-05T18:55:22.998 INFO:tasks.ceph:[osd] debug bluestore = 1/20 2023-07-05T18:55:22.999 INFO:tasks.ceph:[osd] debug ms = 1 2023-07-05T18:55:22.999 INFO:tasks.ceph:[osd] debug osd = 20 2023-07-05T18:55:22.999 INFO:tasks.ceph:[osd] debug rocksdb = 4/10 2023-07-05T18:55:22.999 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2023-07-05T18:55:23.000 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2023-07-05T18:55:23.000 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2023-07-05T18:55:23.000 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2023-07-05T18:55:23.000 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2023-07-05T18:55:23.002 INFO:tasks.ceph:[osd] osd op complaint time = 180 2023-07-05T18:55:23.002 INFO:tasks.ceph:Setting up mon.a... 2023-07-05T18:55:23.003 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2023-07-05T18:55:23.065 INFO:teuthology.orchestra.run.smithi046.stdout:creating /etc/ceph/ceph.keyring 2023-07-05T18:55:23.068 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2023-07-05T18:55:23.119 DEBUG:teuthology.orchestra.run.smithi046:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-07-05T18:55:23.150 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '172.21.15.46'), ('mon.b', '172.21.15.73'), ('mon.c', '[v2:172.21.15.73:3301,v1:172.21.15.73:6790]')] 2023-07-05T18:55:23.151 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '172.21.15.46,172.21.15.73,[v2:172.21.15.73:3301,v1:172.21.15.73:6790]', 'ms die on skipped message': False}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd mclock profile': 'high_recovery_ops', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false'}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false', 'mon op complaint time': 120}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok', 'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mon.a': {}, 'mon.b': {}, 'mon.c': {}, 'mds.a': {}, 'mds.c': {}, 'mds.b': {}, 'mds.d': {}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}} 2023-07-05T18:55:23.152 DEBUG:teuthology.orchestra.run.smithi046:> set -ex 2023-07-05T18:55:23.152 DEBUG:teuthology.orchestra.run.smithi046:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2023-07-05T18:55:23.213 DEBUG:teuthology.orchestra.run.smithi046:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 172.21.15.46 --add b 172.21.15.73 --addv c '[v2:172.21.15.73:3301,v1:172.21.15.73:6790]' --print /home/ubuntu/cephtest/ceph.monmap 2023-07-05T18:55:23.305 INFO:teuthology.orchestra.run.smithi046.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2023-07-05T18:55:23.306 INFO:teuthology.orchestra.run.smithi046.stdout:monmaptool: generated fsid 042652d3-d80c-4ad8-9366-3e94f2a0a512 2023-07-05T18:55:23.306 INFO:teuthology.orchestra.run.smithi046.stdout:setting min_mon_release = pacific 2023-07-05T18:55:23.306 INFO:teuthology.orchestra.run.smithi046.stdout:epoch 0 2023-07-05T18:55:23.306 INFO:teuthology.orchestra.run.smithi046.stdout:fsid 042652d3-d80c-4ad8-9366-3e94f2a0a512 2023-07-05T18:55:23.306 INFO:teuthology.orchestra.run.smithi046.stdout:last_changed 2023-07-05T18:55:23.304543+0000 2023-07-05T18:55:23.306 INFO:teuthology.orchestra.run.smithi046.stdout:created 2023-07-05T18:55:23.304543+0000 2023-07-05T18:55:23.307 INFO:teuthology.orchestra.run.smithi046.stdout:min_mon_release 16 (pacific) 2023-07-05T18:55:23.307 INFO:teuthology.orchestra.run.smithi046.stdout:election_strategy: 1 2023-07-05T18:55:23.307 INFO:teuthology.orchestra.run.smithi046.stdout:0: [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] mon.a 2023-07-05T18:55:23.307 INFO:teuthology.orchestra.run.smithi046.stdout:1: [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] mon.b 2023-07-05T18:55:23.307 INFO:teuthology.orchestra.run.smithi046.stdout:2: [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] mon.c 2023-07-05T18:55:23.307 INFO:teuthology.orchestra.run.smithi046.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (3 monitors) 2023-07-05T18:55:23.310 DEBUG:teuthology.orchestra.run.smithi046:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2023-07-05T18:55:23.333 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID 042652d3-d80c-4ad8-9366-3e94f2a0a512... 2023-07-05T18:55:23.334 DEBUG:teuthology.orchestra.run.smithi046:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2023-07-05T18:55:23.378 DEBUG:teuthology.orchestra.run.smithi073:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2023-07-05T18:55:23.420 INFO:teuthology.orchestra.run.smithi046.stdout:[global] 2023-07-05T18:55:23.420 INFO:teuthology.orchestra.run.smithi046.stdout: chdir = "" 2023-07-05T18:55:23.421 INFO:teuthology.orchestra.run.smithi046.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2023-07-05T18:55:23.421 INFO:teuthology.orchestra.run.smithi046.stdout: auth supported = cephx 2023-07-05T18:55:23.421 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T18:55:23.421 INFO:teuthology.orchestra.run.smithi046.stdout: filestore xattr use omap = true 2023-07-05T18:55:23.421 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T18:55:23.421 INFO:teuthology.orchestra.run.smithi046.stdout: mon clock drift allowed = 1.000 2023-07-05T18:55:23.421 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T18:55:23.421 INFO:teuthology.orchestra.run.smithi046.stdout: osd crush chooseleaf type = 0 2023-07-05T18:55:23.422 INFO:teuthology.orchestra.run.smithi046.stdout: auth debug = true 2023-07-05T18:55:23.422 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T18:55:23.422 INFO:teuthology.orchestra.run.smithi046.stdout: ms die on old message = true 2023-07-05T18:55:23.422 INFO:teuthology.orchestra.run.smithi046.stdout: ms die on bug = true 2023-07-05T18:55:23.422 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T18:55:23.422 INFO:teuthology.orchestra.run.smithi046.stdout: mon max pg per osd = 10000 # >= luminous 2023-07-05T18:55:23.422 INFO:teuthology.orchestra.run.smithi046.stdout: mon pg warn max object skew = 0 2023-07-05T18:55:23.423 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T18:55:23.423 INFO:teuthology.orchestra.run.smithi046.stdout: # disable pg_autoscaler by default for new pools 2023-07-05T18:55:23.423 INFO:teuthology.orchestra.run.smithi046.stdout: osd_pool_default_pg_autoscale_mode = off 2023-07-05T18:55:23.423 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T18:55:23.423 INFO:teuthology.orchestra.run.smithi046.stdout: osd pool default size = 2 2023-07-05T18:55:23.423 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T18:55:23.423 INFO:teuthology.orchestra.run.smithi046.stdout: mon osd allow primary affinity = true 2023-07-05T18:55:23.423 INFO:teuthology.orchestra.run.smithi046.stdout: mon osd allow pg remap = true 2023-07-05T18:55:23.424 INFO:teuthology.orchestra.run.smithi046.stdout: mon warn on legacy crush tunables = false 2023-07-05T18:55:23.424 INFO:teuthology.orchestra.run.smithi046.stdout: mon warn on crush straw calc version zero = false 2023-07-05T18:55:23.424 INFO:teuthology.orchestra.run.smithi046.stdout: mon warn on no sortbitwise = false 2023-07-05T18:55:23.424 INFO:teuthology.orchestra.run.smithi046.stdout: mon warn on osd down out interval zero = false 2023-07-05T18:55:23.424 INFO:teuthology.orchestra.run.smithi046.stdout: mon warn on too few osds = false 2023-07-05T18:55:23.425 INFO:teuthology.orchestra.run.smithi046.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2023-07-05T18:55:23.425 INFO:teuthology.orchestra.run.smithi046.stdout: mon_warn_on_pool_no_redundancy = false 2023-07-05T18:55:23.425 INFO:teuthology.orchestra.run.smithi046.stdout: mon_allow_pool_size_one = true 2023-07-05T18:55:23.428 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T18:55:23.429 INFO:teuthology.orchestra.run.smithi046.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2023-07-05T18:55:23.429 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T18:55:23.429 INFO:teuthology.orchestra.run.smithi046.stdout: osd default data pool replay window = 5 2023-07-05T18:55:23.429 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T18:55:23.429 INFO:teuthology.orchestra.run.smithi046.stdout: mon allow pool delete = true 2023-07-05T18:55:23.429 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T18:55:23.429 INFO:teuthology.orchestra.run.smithi046.stdout: mon cluster log file level = debug 2023-07-05T18:55:23.430 INFO:teuthology.orchestra.run.smithi046.stdout: debug asserts on shutdown = true 2023-07-05T18:55:23.430 INFO:teuthology.orchestra.run.smithi046.stdout: mon health detail to clog = false 2023-07-05T18:55:23.430 INFO:teuthology.orchestra.run.smithi046.stdout: mon host = "172.21.15.46,172.21.15.73,[v2:172.21.15.73:3301,v1:172.21.15.73:6790]" 2023-07-05T18:55:23.430 INFO:teuthology.orchestra.run.smithi046.stdout: ms die on skipped message = False 2023-07-05T18:55:23.430 INFO:teuthology.orchestra.run.smithi046.stdout: fsid = 042652d3-d80c-4ad8-9366-3e94f2a0a512 2023-07-05T18:55:23.431 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T18:55:23.431 INFO:teuthology.orchestra.run.smithi046.stdout:[osd] 2023-07-05T18:55:23.431 INFO:teuthology.orchestra.run.smithi046.stdout: osd journal size = 100 2023-07-05T18:55:23.431 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T18:55:23.431 INFO:teuthology.orchestra.run.smithi046.stdout: osd scrub load threshold = 5.0 2023-07-05T18:55:23.432 INFO:teuthology.orchestra.run.smithi046.stdout: osd scrub max interval = 600 2023-07-05T18:55:23.432 INFO:teuthology.orchestra.run.smithi046.stdout: osd mclock profile = high_recovery_ops 2023-07-05T18:55:23.439 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T18:55:23.439 INFO:teuthology.orchestra.run.smithi046.stdout: osd recover clone overlap = true 2023-07-05T18:55:23.439 INFO:teuthology.orchestra.run.smithi046.stdout: osd recovery max chunk = 1048576 2023-07-05T18:55:23.439 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T18:55:23.439 INFO:teuthology.orchestra.run.smithi046.stdout: osd debug shutdown = true 2023-07-05T18:55:23.440 INFO:teuthology.orchestra.run.smithi046.stdout: osd debug op order = true 2023-07-05T18:55:23.440 INFO:teuthology.orchestra.run.smithi046.stdout: osd debug verify stray on activate = true 2023-07-05T18:55:23.440 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T18:55:23.440 INFO:teuthology.orchestra.run.smithi046.stdout: osd open classes on start = true 2023-07-05T18:55:23.440 INFO:teuthology.orchestra.run.smithi046.stdout: osd debug pg log writeout = true 2023-07-05T18:55:23.440 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T18:55:23.440 INFO:teuthology.orchestra.run.smithi046.stdout: osd deep scrub update digest min age = 30 2023-07-05T18:55:23.441 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T18:55:23.442 INFO:teuthology.orchestra.run.smithi046.stdout: osd map max advance = 10 2023-07-05T18:55:23.443 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T18:55:23.443 INFO:teuthology.orchestra.run.smithi046.stdout: journal zero on create = true 2023-07-05T18:55:23.443 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T18:55:23.443 INFO:teuthology.orchestra.run.smithi046.stdout: filestore ondisk finisher threads = 3 2023-07-05T18:55:23.443 INFO:teuthology.orchestra.run.smithi046.stdout: filestore apply finisher threads = 3 2023-07-05T18:55:23.443 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T18:55:23.450 INFO:teuthology.orchestra.run.smithi046.stdout: bdev debug aio = true 2023-07-05T18:55:23.450 INFO:teuthology.orchestra.run.smithi046.stdout: osd debug misdirected ops = true 2023-07-05T18:55:23.450 INFO:teuthology.orchestra.run.smithi046.stdout: bdev async discard = True 2023-07-05T18:55:23.450 INFO:teuthology.orchestra.run.smithi046.stdout: bdev enable discard = True 2023-07-05T18:55:23.451 INFO:teuthology.orchestra.run.smithi046.stdout: bluestore allocator = bitmap 2023-07-05T18:55:23.451 INFO:teuthology.orchestra.run.smithi046.stdout: bluestore block size = 96636764160 2023-07-05T18:55:23.451 INFO:teuthology.orchestra.run.smithi046.stdout: bluestore fsck on mount = True 2023-07-05T18:55:23.452 INFO:teuthology.orchestra.run.smithi046.stdout: debug bluefs = 1/20 2023-07-05T18:55:23.456 INFO:teuthology.orchestra.run.smithi046.stdout: debug bluestore = 1/20 2023-07-05T18:55:23.456 INFO:teuthology.orchestra.run.smithi046.stdout: debug ms = 1 2023-07-05T18:55:23.457 INFO:teuthology.orchestra.run.smithi046.stdout: debug osd = 20 2023-07-05T18:55:23.457 INFO:teuthology.orchestra.run.smithi046.stdout: debug rocksdb = 4/10 2023-07-05T18:55:23.457 INFO:teuthology.orchestra.run.smithi046.stdout: mon osd backfillfull_ratio = 0.85 2023-07-05T18:55:23.458 INFO:teuthology.orchestra.run.smithi046.stdout: mon osd full ratio = 0.9 2023-07-05T18:55:23.458 INFO:teuthology.orchestra.run.smithi046.stdout: mon osd nearfull ratio = 0.8 2023-07-05T18:55:23.458 INFO:teuthology.orchestra.run.smithi046.stdout: osd failsafe full ratio = 0.95 2023-07-05T18:55:23.458 INFO:teuthology.orchestra.run.smithi046.stdout: osd objectstore = bluestore 2023-07-05T18:55:23.459 INFO:teuthology.orchestra.run.smithi046.stdout: osd op complaint time = 180 2023-07-05T18:55:23.459 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T18:55:23.459 INFO:teuthology.orchestra.run.smithi046.stdout:[mgr] 2023-07-05T18:55:23.460 INFO:teuthology.orchestra.run.smithi046.stdout: debug ms = 1 2023-07-05T18:55:23.460 INFO:teuthology.orchestra.run.smithi046.stdout: debug mgr = 20 2023-07-05T18:55:23.460 INFO:teuthology.orchestra.run.smithi046.stdout: debug mon = 20 2023-07-05T18:55:23.461 INFO:teuthology.orchestra.run.smithi046.stdout: debug auth = 20 2023-07-05T18:55:23.461 INFO:teuthology.orchestra.run.smithi046.stdout: mon reweight min pgs per osd = 4 2023-07-05T18:55:23.461 INFO:teuthology.orchestra.run.smithi046.stdout: mon reweight min bytes per osd = 10 2023-07-05T18:55:23.461 INFO:teuthology.orchestra.run.smithi046.stdout: mgr/telemetry/nag = false 2023-07-05T18:55:23.462 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T18:55:23.462 INFO:teuthology.orchestra.run.smithi046.stdout:[mon] 2023-07-05T18:55:23.462 INFO:teuthology.orchestra.run.smithi046.stdout: debug ms = 1 2023-07-05T18:55:23.463 INFO:teuthology.orchestra.run.smithi046.stdout: debug mon = 20 2023-07-05T18:55:23.463 INFO:teuthology.orchestra.run.smithi046.stdout: debug paxos = 20 2023-07-05T18:55:23.464 INFO:teuthology.orchestra.run.smithi046.stdout: debug auth = 20 2023-07-05T18:55:23.464 INFO:teuthology.orchestra.run.smithi046.stdout: mon data avail warn = 5 2023-07-05T18:55:23.464 INFO:teuthology.orchestra.run.smithi046.stdout: mon mgr mkfs grace = 240 2023-07-05T18:55:23.464 INFO:teuthology.orchestra.run.smithi046.stdout: mon reweight min pgs per osd = 4 2023-07-05T18:55:23.464 INFO:teuthology.orchestra.run.smithi046.stdout: mon osd reporter subtree level = osd 2023-07-05T18:55:23.465 INFO:teuthology.orchestra.run.smithi046.stdout: mon osd prime pg temp = true 2023-07-05T18:55:23.465 INFO:teuthology.orchestra.run.smithi046.stdout: mon reweight min bytes per osd = 10 2023-07-05T18:55:23.465 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T18:55:23.465 INFO:teuthology.orchestra.run.smithi046.stdout: # rotate auth tickets quickly to exercise renewal paths 2023-07-05T18:55:23.466 INFO:teuthology.orchestra.run.smithi046.stdout: auth mon ticket ttl = 660 # 11m 2023-07-05T18:55:23.466 INFO:teuthology.orchestra.run.smithi046.stdout: auth service ticket ttl = 240 # 4m 2023-07-05T18:55:23.466 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T18:55:23.467 INFO:teuthology.orchestra.run.smithi046.stdout: # don't complain about insecure global_id in the test suite 2023-07-05T18:55:23.467 INFO:teuthology.orchestra.run.smithi046.stdout: mon_warn_on_insecure_global_id_reclaim = false 2023-07-05T18:55:23.467 INFO:teuthology.orchestra.run.smithi046.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2023-07-05T18:55:23.467 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T18:55:23.468 INFO:teuthology.orchestra.run.smithi046.stdout: # 1m isn't quite enough 2023-07-05T18:55:23.468 INFO:teuthology.orchestra.run.smithi046.stdout: mon_down_mkfs_grace = 2m 2023-07-05T18:55:23.468 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T18:55:23.469 INFO:teuthology.orchestra.run.smithi046.stdout: mon_warn_on_filestore_osds = false 2023-07-05T18:55:23.469 INFO:teuthology.orchestra.run.smithi046.stdout: mon op complaint time = 120 2023-07-05T18:55:23.469 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T18:55:23.469 INFO:teuthology.orchestra.run.smithi046.stdout:[client] 2023-07-05T18:55:23.469 INFO:teuthology.orchestra.run.smithi046.stdout: rgw cache enabled = true 2023-07-05T18:55:23.469 INFO:teuthology.orchestra.run.smithi046.stdout: rgw enable ops log = true 2023-07-05T18:55:23.469 INFO:teuthology.orchestra.run.smithi046.stdout: rgw enable usage log = true 2023-07-05T18:55:23.470 INFO:teuthology.orchestra.run.smithi046.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2023-07-05T18:55:23.470 INFO:teuthology.orchestra.run.smithi046.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2023-07-05T18:55:23.470 INFO:teuthology.orchestra.run.smithi046.stdout: client mount timeout = 600 2023-07-05T18:55:23.470 INFO:teuthology.orchestra.run.smithi046.stdout: debug client = 20 2023-07-05T18:55:23.471 INFO:teuthology.orchestra.run.smithi046.stdout: debug ms = 1 2023-07-05T18:55:23.471 INFO:teuthology.orchestra.run.smithi046.stdout: pid file = "" 2023-07-05T18:55:23.471 INFO:teuthology.orchestra.run.smithi046.stdout: rados mon op timeout = 900 2023-07-05T18:55:23.471 INFO:teuthology.orchestra.run.smithi046.stdout: rados osd op timeout = 900 2023-07-05T18:55:23.472 INFO:teuthology.orchestra.run.smithi046.stdout:[mon.a] 2023-07-05T18:55:23.472 INFO:teuthology.orchestra.run.smithi046.stdout:[mon.b] 2023-07-05T18:55:23.472 INFO:teuthology.orchestra.run.smithi046.stdout:[mon.c] 2023-07-05T18:55:23.472 INFO:teuthology.orchestra.run.smithi046.stdout:[mds.a] 2023-07-05T18:55:23.473 INFO:teuthology.orchestra.run.smithi046.stdout:[mds.c] 2023-07-05T18:55:23.473 INFO:teuthology.orchestra.run.smithi046.stdout:[mds.b] 2023-07-05T18:55:23.474 INFO:teuthology.orchestra.run.smithi046.stdout:[mds.d] 2023-07-05T18:55:23.474 INFO:teuthology.orchestra.run.smithi046.stdout:[mds] 2023-07-05T18:55:23.474 INFO:teuthology.orchestra.run.smithi046.stdout: debug mds = 20 2023-07-05T18:55:23.474 INFO:teuthology.orchestra.run.smithi046.stdout: debug mds balancer = 20 2023-07-05T18:55:23.475 INFO:teuthology.orchestra.run.smithi046.stdout: debug ms = 1 2023-07-05T18:55:23.475 INFO:teuthology.orchestra.run.smithi046.stdout: mds debug frag = True 2023-07-05T18:55:23.475 INFO:teuthology.orchestra.run.smithi046.stdout: mds debug scatterstat = True 2023-07-05T18:55:23.475 INFO:teuthology.orchestra.run.smithi046.stdout: mds op complaint time = 180 2023-07-05T18:55:23.476 INFO:teuthology.orchestra.run.smithi046.stdout: mds verify scatter = True 2023-07-05T18:55:23.476 INFO:teuthology.orchestra.run.smithi046.stdout: osd op complaint time = 180 2023-07-05T18:55:23.476 INFO:teuthology.orchestra.run.smithi046.stdout: rados mon op timeout = 900 2023-07-05T18:55:23.476 INFO:teuthology.orchestra.run.smithi046.stdout: rados osd op timeout = 900 2023-07-05T18:55:23.479 INFO:teuthology.orchestra.run.smithi073.stdout:[global] 2023-07-05T18:55:23.480 INFO:teuthology.orchestra.run.smithi073.stdout: chdir = "" 2023-07-05T18:55:23.480 INFO:teuthology.orchestra.run.smithi073.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2023-07-05T18:55:23.480 INFO:teuthology.orchestra.run.smithi073.stdout: auth supported = cephx 2023-07-05T18:55:23.480 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-07-05T18:55:23.481 INFO:teuthology.orchestra.run.smithi073.stdout: filestore xattr use omap = true 2023-07-05T18:55:23.482 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-07-05T18:55:23.482 INFO:teuthology.orchestra.run.smithi073.stdout: mon clock drift allowed = 1.000 2023-07-05T18:55:23.482 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-07-05T18:55:23.482 INFO:teuthology.orchestra.run.smithi073.stdout: osd crush chooseleaf type = 0 2023-07-05T18:55:23.482 INFO:teuthology.orchestra.run.smithi073.stdout: auth debug = true 2023-07-05T18:55:23.483 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-07-05T18:55:23.483 INFO:teuthology.orchestra.run.smithi073.stdout: ms die on old message = true 2023-07-05T18:55:23.483 INFO:teuthology.orchestra.run.smithi073.stdout: ms die on bug = true 2023-07-05T18:55:23.483 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-07-05T18:55:23.483 INFO:teuthology.orchestra.run.smithi073.stdout: mon max pg per osd = 10000 # >= luminous 2023-07-05T18:55:23.484 INFO:teuthology.orchestra.run.smithi073.stdout: mon pg warn max object skew = 0 2023-07-05T18:55:23.484 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-07-05T18:55:23.484 INFO:teuthology.orchestra.run.smithi073.stdout: # disable pg_autoscaler by default for new pools 2023-07-05T18:55:23.484 INFO:teuthology.orchestra.run.smithi073.stdout: osd_pool_default_pg_autoscale_mode = off 2023-07-05T18:55:23.485 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-07-05T18:55:23.488 INFO:teuthology.orchestra.run.smithi073.stdout: osd pool default size = 2 2023-07-05T18:55:23.488 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-07-05T18:55:23.488 INFO:teuthology.orchestra.run.smithi073.stdout: mon osd allow primary affinity = true 2023-07-05T18:55:23.488 INFO:teuthology.orchestra.run.smithi073.stdout: mon osd allow pg remap = true 2023-07-05T18:55:23.488 INFO:teuthology.orchestra.run.smithi073.stdout: mon warn on legacy crush tunables = false 2023-07-05T18:55:23.489 INFO:teuthology.orchestra.run.smithi073.stdout: mon warn on crush straw calc version zero = false 2023-07-05T18:55:23.489 INFO:teuthology.orchestra.run.smithi073.stdout: mon warn on no sortbitwise = false 2023-07-05T18:55:23.489 INFO:teuthology.orchestra.run.smithi073.stdout: mon warn on osd down out interval zero = false 2023-07-05T18:55:23.489 INFO:teuthology.orchestra.run.smithi073.stdout: mon warn on too few osds = false 2023-07-05T18:55:23.489 INFO:teuthology.orchestra.run.smithi073.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2023-07-05T18:55:23.489 INFO:teuthology.orchestra.run.smithi073.stdout: mon_warn_on_pool_no_redundancy = false 2023-07-05T18:55:23.489 INFO:teuthology.orchestra.run.smithi073.stdout: mon_allow_pool_size_one = true 2023-07-05T18:55:23.489 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-07-05T18:55:23.490 INFO:teuthology.orchestra.run.smithi073.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2023-07-05T18:55:23.490 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-07-05T18:55:23.490 INFO:teuthology.orchestra.run.smithi073.stdout: osd default data pool replay window = 5 2023-07-05T18:55:23.490 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-07-05T18:55:23.490 INFO:teuthology.orchestra.run.smithi073.stdout: mon allow pool delete = true 2023-07-05T18:55:23.493 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-07-05T18:55:23.494 INFO:teuthology.orchestra.run.smithi073.stdout: mon cluster log file level = debug 2023-07-05T18:55:23.495 INFO:teuthology.orchestra.run.smithi073.stdout: debug asserts on shutdown = true 2023-07-05T18:55:23.495 INFO:teuthology.orchestra.run.smithi073.stdout: mon health detail to clog = false 2023-07-05T18:55:23.495 INFO:teuthology.orchestra.run.smithi073.stdout: mon host = "172.21.15.46,172.21.15.73,[v2:172.21.15.73:3301,v1:172.21.15.73:6790]" 2023-07-05T18:55:23.496 INFO:teuthology.orchestra.run.smithi073.stdout: ms die on skipped message = False 2023-07-05T18:55:23.496 INFO:teuthology.orchestra.run.smithi073.stdout: fsid = 042652d3-d80c-4ad8-9366-3e94f2a0a512 2023-07-05T18:55:23.496 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-07-05T18:55:23.497 INFO:teuthology.orchestra.run.smithi073.stdout:[osd] 2023-07-05T18:55:23.497 INFO:teuthology.orchestra.run.smithi073.stdout: osd journal size = 100 2023-07-05T18:55:23.497 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-07-05T18:55:23.497 INFO:teuthology.orchestra.run.smithi073.stdout: osd scrub load threshold = 5.0 2023-07-05T18:55:23.497 INFO:teuthology.orchestra.run.smithi073.stdout: osd scrub max interval = 600 2023-07-05T18:55:23.498 INFO:teuthology.orchestra.run.smithi073.stdout: osd mclock profile = high_recovery_ops 2023-07-05T18:55:23.498 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-07-05T18:55:23.498 INFO:teuthology.orchestra.run.smithi073.stdout: osd recover clone overlap = true 2023-07-05T18:55:23.499 INFO:teuthology.orchestra.run.smithi073.stdout: osd recovery max chunk = 1048576 2023-07-05T18:55:23.499 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-07-05T18:55:23.499 INFO:teuthology.orchestra.run.smithi073.stdout: osd debug shutdown = true 2023-07-05T18:55:23.500 INFO:teuthology.orchestra.run.smithi073.stdout: osd debug op order = true 2023-07-05T18:55:23.500 INFO:teuthology.orchestra.run.smithi073.stdout: osd debug verify stray on activate = true 2023-07-05T18:55:23.500 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-07-05T18:55:23.500 INFO:teuthology.orchestra.run.smithi073.stdout: osd open classes on start = true 2023-07-05T18:55:23.501 INFO:teuthology.orchestra.run.smithi073.stdout: osd debug pg log writeout = true 2023-07-05T18:55:23.501 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-07-05T18:55:23.501 INFO:teuthology.orchestra.run.smithi073.stdout: osd deep scrub update digest min age = 30 2023-07-05T18:55:23.501 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-07-05T18:55:23.502 INFO:teuthology.orchestra.run.smithi073.stdout: osd map max advance = 10 2023-07-05T18:55:23.502 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-07-05T18:55:23.502 INFO:teuthology.orchestra.run.smithi073.stdout: journal zero on create = true 2023-07-05T18:55:23.503 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-07-05T18:55:23.503 INFO:teuthology.orchestra.run.smithi073.stdout: filestore ondisk finisher threads = 3 2023-07-05T18:55:23.504 INFO:teuthology.orchestra.run.smithi073.stdout: filestore apply finisher threads = 3 2023-07-05T18:55:23.504 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-07-05T18:55:23.505 INFO:teuthology.orchestra.run.smithi073.stdout: bdev debug aio = true 2023-07-05T18:55:23.505 INFO:teuthology.orchestra.run.smithi073.stdout: osd debug misdirected ops = true 2023-07-05T18:55:23.505 INFO:teuthology.orchestra.run.smithi073.stdout: bdev async discard = True 2023-07-05T18:55:23.506 INFO:teuthology.orchestra.run.smithi073.stdout: bdev enable discard = True 2023-07-05T18:55:23.506 INFO:teuthology.orchestra.run.smithi073.stdout: bluestore allocator = bitmap 2023-07-05T18:55:23.506 INFO:teuthology.orchestra.run.smithi073.stdout: bluestore block size = 96636764160 2023-07-05T18:55:23.506 INFO:teuthology.orchestra.run.smithi073.stdout: bluestore fsck on mount = True 2023-07-05T18:55:23.507 INFO:teuthology.orchestra.run.smithi073.stdout: debug bluefs = 1/20 2023-07-05T18:55:23.507 INFO:teuthology.orchestra.run.smithi073.stdout: debug bluestore = 1/20 2023-07-05T18:55:23.507 INFO:teuthology.orchestra.run.smithi073.stdout: debug ms = 1 2023-07-05T18:55:23.507 INFO:teuthology.orchestra.run.smithi073.stdout: debug osd = 20 2023-07-05T18:55:23.508 INFO:teuthology.orchestra.run.smithi073.stdout: debug rocksdb = 4/10 2023-07-05T18:55:23.508 INFO:teuthology.orchestra.run.smithi073.stdout: mon osd backfillfull_ratio = 0.85 2023-07-05T18:55:23.508 INFO:teuthology.orchestra.run.smithi073.stdout: mon osd full ratio = 0.9 2023-07-05T18:55:23.508 INFO:teuthology.orchestra.run.smithi073.stdout: mon osd nearfull ratio = 0.8 2023-07-05T18:55:23.509 INFO:teuthology.orchestra.run.smithi073.stdout: osd failsafe full ratio = 0.95 2023-07-05T18:55:23.509 INFO:teuthology.orchestra.run.smithi073.stdout: osd objectstore = bluestore 2023-07-05T18:55:23.509 INFO:teuthology.orchestra.run.smithi073.stdout: osd op complaint time = 180 2023-07-05T18:55:23.509 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-07-05T18:55:23.510 INFO:teuthology.orchestra.run.smithi073.stdout:[mgr] 2023-07-05T18:55:23.510 INFO:teuthology.orchestra.run.smithi073.stdout: debug ms = 1 2023-07-05T18:55:23.510 INFO:teuthology.orchestra.run.smithi073.stdout: debug mgr = 20 2023-07-05T18:55:23.510 INFO:teuthology.orchestra.run.smithi073.stdout: debug mon = 20 2023-07-05T18:55:23.511 INFO:teuthology.orchestra.run.smithi073.stdout: debug auth = 20 2023-07-05T18:55:23.511 INFO:teuthology.orchestra.run.smithi073.stdout: mon reweight min pgs per osd = 4 2023-07-05T18:55:23.511 INFO:teuthology.orchestra.run.smithi073.stdout: mon reweight min bytes per osd = 10 2023-07-05T18:55:23.511 INFO:teuthology.orchestra.run.smithi073.stdout: mgr/telemetry/nag = false 2023-07-05T18:55:23.511 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-07-05T18:55:23.512 INFO:teuthology.orchestra.run.smithi073.stdout:[mon] 2023-07-05T18:55:23.512 INFO:teuthology.orchestra.run.smithi073.stdout: debug ms = 1 2023-07-05T18:55:23.512 INFO:teuthology.orchestra.run.smithi073.stdout: debug mon = 20 2023-07-05T18:55:23.512 INFO:teuthology.orchestra.run.smithi073.stdout: debug paxos = 20 2023-07-05T18:55:23.513 INFO:teuthology.orchestra.run.smithi073.stdout: debug auth = 20 2023-07-05T18:55:23.513 INFO:teuthology.orchestra.run.smithi073.stdout: mon data avail warn = 5 2023-07-05T18:55:23.513 INFO:teuthology.orchestra.run.smithi073.stdout: mon mgr mkfs grace = 240 2023-07-05T18:55:23.513 INFO:teuthology.orchestra.run.smithi073.stdout: mon reweight min pgs per osd = 4 2023-07-05T18:55:23.513 INFO:teuthology.orchestra.run.smithi073.stdout: mon osd reporter subtree level = osd 2023-07-05T18:55:23.513 INFO:teuthology.orchestra.run.smithi073.stdout: mon osd prime pg temp = true 2023-07-05T18:55:23.513 INFO:teuthology.orchestra.run.smithi073.stdout: mon reweight min bytes per osd = 10 2023-07-05T18:55:23.514 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-07-05T18:55:23.514 INFO:teuthology.orchestra.run.smithi073.stdout: # rotate auth tickets quickly to exercise renewal paths 2023-07-05T18:55:23.514 INFO:teuthology.orchestra.run.smithi073.stdout: auth mon ticket ttl = 660 # 11m 2023-07-05T18:55:23.514 INFO:teuthology.orchestra.run.smithi073.stdout: auth service ticket ttl = 240 # 4m 2023-07-05T18:55:23.515 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-07-05T18:55:23.515 INFO:teuthology.orchestra.run.smithi073.stdout: # don't complain about insecure global_id in the test suite 2023-07-05T18:55:23.515 INFO:teuthology.orchestra.run.smithi073.stdout: mon_warn_on_insecure_global_id_reclaim = false 2023-07-05T18:55:23.515 INFO:teuthology.orchestra.run.smithi073.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2023-07-05T18:55:23.515 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-07-05T18:55:23.515 INFO:teuthology.orchestra.run.smithi073.stdout: # 1m isn't quite enough 2023-07-05T18:55:23.515 INFO:teuthology.orchestra.run.smithi073.stdout: mon_down_mkfs_grace = 2m 2023-07-05T18:55:23.515 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-07-05T18:55:23.516 INFO:teuthology.orchestra.run.smithi073.stdout: mon_warn_on_filestore_osds = false 2023-07-05T18:55:23.516 INFO:teuthology.orchestra.run.smithi073.stdout: mon op complaint time = 120 2023-07-05T18:55:23.516 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-07-05T18:55:23.516 INFO:teuthology.orchestra.run.smithi073.stdout:[client] 2023-07-05T18:55:23.516 INFO:teuthology.orchestra.run.smithi073.stdout: rgw cache enabled = true 2023-07-05T18:55:23.516 INFO:teuthology.orchestra.run.smithi073.stdout: rgw enable ops log = true 2023-07-05T18:55:23.516 INFO:teuthology.orchestra.run.smithi073.stdout: rgw enable usage log = true 2023-07-05T18:55:23.517 INFO:teuthology.orchestra.run.smithi073.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2023-07-05T18:55:23.517 INFO:teuthology.orchestra.run.smithi073.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2023-07-05T18:55:23.517 INFO:teuthology.orchestra.run.smithi073.stdout: client mount timeout = 600 2023-07-05T18:55:23.517 INFO:teuthology.orchestra.run.smithi073.stdout: debug client = 20 2023-07-05T18:55:23.517 INFO:teuthology.orchestra.run.smithi073.stdout: debug ms = 1 2023-07-05T18:55:23.517 INFO:teuthology.orchestra.run.smithi073.stdout: pid file = "" 2023-07-05T18:55:23.517 INFO:teuthology.orchestra.run.smithi073.stdout: rados mon op timeout = 900 2023-07-05T18:55:23.518 INFO:teuthology.orchestra.run.smithi073.stdout: rados osd op timeout = 900 2023-07-05T18:55:23.518 INFO:teuthology.orchestra.run.smithi073.stdout:[mon.a] 2023-07-05T18:55:23.518 INFO:teuthology.orchestra.run.smithi073.stdout:[mon.b] 2023-07-05T18:55:23.518 INFO:teuthology.orchestra.run.smithi073.stdout:[mon.c] 2023-07-05T18:55:23.518 INFO:teuthology.orchestra.run.smithi073.stdout:[mds.a] 2023-07-05T18:55:23.518 INFO:teuthology.orchestra.run.smithi073.stdout:[mds.c] 2023-07-05T18:55:23.518 INFO:teuthology.orchestra.run.smithi073.stdout:[mds.b] 2023-07-05T18:55:23.518 INFO:teuthology.orchestra.run.smithi073.stdout:[mds.d] 2023-07-05T18:55:23.519 INFO:teuthology.orchestra.run.smithi073.stdout:[mds] 2023-07-05T18:55:23.519 INFO:teuthology.orchestra.run.smithi073.stdout: debug mds = 20 2023-07-05T18:55:23.519 INFO:teuthology.orchestra.run.smithi073.stdout: debug mds balancer = 20 2023-07-05T18:55:23.519 INFO:teuthology.orchestra.run.smithi073.stdout: debug ms = 1 2023-07-05T18:55:23.519 INFO:teuthology.orchestra.run.smithi073.stdout: mds debug frag = True 2023-07-05T18:55:23.519 INFO:teuthology.orchestra.run.smithi073.stdout: mds debug scatterstat = True 2023-07-05T18:55:23.519 INFO:teuthology.orchestra.run.smithi073.stdout: mds op complaint time = 180 2023-07-05T18:55:23.519 INFO:teuthology.orchestra.run.smithi073.stdout: mds verify scatter = True 2023-07-05T18:55:23.520 INFO:teuthology.orchestra.run.smithi073.stdout: osd op complaint time = 180 2023-07-05T18:55:23.520 INFO:teuthology.orchestra.run.smithi073.stdout: rados mon op timeout = 900 2023-07-05T18:55:23.520 INFO:teuthology.orchestra.run.smithi073.stdout: rados osd op timeout = 900 2023-07-05T18:55:23.520 INFO:tasks.ceph:Creating admin key on mon.a... 2023-07-05T18:55:23.521 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2023-07-05T18:55:23.579 INFO:tasks.ceph:Copying monmap to all nodes... 2023-07-05T18:55:23.580 DEBUG:teuthology.orchestra.run.smithi046:> set -ex 2023-07-05T18:55:23.580 DEBUG:teuthology.orchestra.run.smithi046:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2023-07-05T18:55:23.602 DEBUG:teuthology.orchestra.run.smithi046:> set -ex 2023-07-05T18:55:23.602 DEBUG:teuthology.orchestra.run.smithi046:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2023-07-05T18:55:23.658 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi046.front.sepia.ceph.com 2023-07-05T18:55:23.659 DEBUG:teuthology.orchestra.run.smithi046:> set -ex 2023-07-05T18:55:23.664 DEBUG:teuthology.orchestra.run.smithi046:> sudo dd of=/etc/ceph/ceph.keyring 2023-07-05T18:55:23.665 DEBUG:teuthology.orchestra.run.smithi046:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-07-05T18:55:23.738 DEBUG:teuthology.orchestra.run.smithi046:> set -ex 2023-07-05T18:55:23.738 DEBUG:teuthology.orchestra.run.smithi046:> dd of=/home/ubuntu/cephtest/ceph.monmap 2023-07-05T18:55:23.794 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi073.front.sepia.ceph.com 2023-07-05T18:55:23.795 DEBUG:teuthology.orchestra.run.smithi073:> set -ex 2023-07-05T18:55:23.796 DEBUG:teuthology.orchestra.run.smithi073:> sudo dd of=/etc/ceph/ceph.keyring 2023-07-05T18:55:23.796 DEBUG:teuthology.orchestra.run.smithi073:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-07-05T18:55:23.843 DEBUG:teuthology.orchestra.run.smithi073:> set -ex 2023-07-05T18:55:23.844 DEBUG:teuthology.orchestra.run.smithi073:> dd of=/home/ubuntu/cephtest/ceph.monmap 2023-07-05T18:55:23.907 INFO:tasks.ceph:Setting up mon nodes... 2023-07-05T18:55:23.907 INFO:tasks.ceph:Setting up mgr nodes... 2023-07-05T18:55:23.908 DEBUG:teuthology.orchestra.run.smithi046:> sudo mkdir -p /var/lib/ceph/mgr/ceph-y && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.y /var/lib/ceph/mgr/ceph-y/keyring 2023-07-05T18:55:23.966 INFO:teuthology.orchestra.run.smithi046.stdout:creating /var/lib/ceph/mgr/ceph-y/keyring 2023-07-05T18:55:23.969 DEBUG:teuthology.orchestra.run.smithi073:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2023-07-05T18:55:24.051 INFO:teuthology.orchestra.run.smithi073.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2023-07-05T18:55:24.051 INFO:tasks.ceph:Setting up mds nodes... 2023-07-05T18:55:24.052 DEBUG:teuthology.orchestra.run.smithi046:> sudo mkdir -p /var/lib/ceph/mds/ceph-a && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.a /var/lib/ceph/mds/ceph-a/keyring 2023-07-05T18:55:24.108 INFO:teuthology.orchestra.run.smithi046.stdout:creating /var/lib/ceph/mds/ceph-a/keyring 2023-07-05T18:55:24.110 DEBUG:teuthology.orchestra.run.smithi046:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-a 2023-07-05T18:55:24.137 DEBUG:teuthology.orchestra.run.smithi046:> sudo mkdir -p /var/lib/ceph/mds/ceph-c && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.c /var/lib/ceph/mds/ceph-c/keyring 2023-07-05T18:55:24.233 INFO:teuthology.orchestra.run.smithi046.stdout:creating /var/lib/ceph/mds/ceph-c/keyring 2023-07-05T18:55:24.242 DEBUG:teuthology.orchestra.run.smithi046:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-c 2023-07-05T18:55:24.270 DEBUG:teuthology.orchestra.run.smithi073:> sudo mkdir -p /var/lib/ceph/mds/ceph-b && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.b /var/lib/ceph/mds/ceph-b/keyring 2023-07-05T18:55:24.330 INFO:teuthology.orchestra.run.smithi073.stdout:creating /var/lib/ceph/mds/ceph-b/keyring 2023-07-05T18:55:24.333 DEBUG:teuthology.orchestra.run.smithi073:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-b 2023-07-05T18:55:24.362 DEBUG:teuthology.orchestra.run.smithi073:> sudo mkdir -p /var/lib/ceph/mds/ceph-d && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.d /var/lib/ceph/mds/ceph-d/keyring 2023-07-05T18:55:24.462 INFO:teuthology.orchestra.run.smithi073.stdout:creating /var/lib/ceph/mds/ceph-d/keyring 2023-07-05T18:55:24.463 DEBUG:teuthology.orchestra.run.smithi073:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-d 2023-07-05T18:55:24.490 INFO:tasks.ceph_client:Setting up client nodes... 2023-07-05T18:55:24.491 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2023-07-05T18:55:24.540 INFO:teuthology.orchestra.run.smithi046.stdout:creating /etc/ceph/ceph.client.0.keyring 2023-07-05T18:55:24.550 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.2 /etc/ceph/ceph.client.2.keyring && sudo chmod 0644 /etc/ceph/ceph.client.2.keyring 2023-07-05T18:55:24.596 INFO:teuthology.orchestra.run.smithi046.stdout:creating /etc/ceph/ceph.client.2.keyring 2023-07-05T18:55:24.616 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.1 /etc/ceph/ceph.client.1.keyring && sudo chmod 0644 /etc/ceph/ceph.client.1.keyring 2023-07-05T18:55:24.661 INFO:teuthology.orchestra.run.smithi073.stdout:creating /etc/ceph/ceph.client.1.keyring 2023-07-05T18:55:24.676 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.3 /etc/ceph/ceph.client.3.keyring && sudo chmod 0644 /etc/ceph/ceph.client.3.keyring 2023-07-05T18:55:24.760 INFO:teuthology.orchestra.run.smithi073.stdout:creating /etc/ceph/ceph.client.3.keyring 2023-07-05T18:55:24.773 INFO:tasks.ceph:Running mkfs on osd nodes... 2023-07-05T18:55:24.774 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi046.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi073.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2023-07-05T18:55:24.774 DEBUG:teuthology.orchestra.run.smithi046:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2023-07-05T18:55:24.804 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-07-05T18:55:24.805 INFO:tasks.ceph:role: osd.0 2023-07-05T18:55:24.805 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi046.front.sepia.ceph.com 2023-07-05T18:55:24.805 DEBUG:teuthology.orchestra.run.smithi046:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2023-07-05T18:55:24.872 INFO:teuthology.orchestra.run.smithi046.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2023-07-05T18:55:24.872 INFO:teuthology.orchestra.run.smithi046.stdout: = sectsz=512 attr=2, projid32bit=1 2023-07-05T18:55:24.872 INFO:teuthology.orchestra.run.smithi046.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-07-05T18:55:24.872 INFO:teuthology.orchestra.run.smithi046.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-07-05T18:55:24.873 INFO:teuthology.orchestra.run.smithi046.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-07-05T18:55:24.873 INFO:teuthology.orchestra.run.smithi046.stdout: = sunit=0 swidth=0 blks 2023-07-05T18:55:24.873 INFO:teuthology.orchestra.run.smithi046.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-07-05T18:55:24.873 INFO:teuthology.orchestra.run.smithi046.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-07-05T18:55:24.873 INFO:teuthology.orchestra.run.smithi046.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-07-05T18:55:24.873 INFO:teuthology.orchestra.run.smithi046.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-07-05T18:55:24.897 INFO:teuthology.orchestra.run.smithi046.stdout:Discarding blocks...Done. 2023-07-05T18:55:24.897 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi046.front.sepia.ceph.com -o noatime 2023-07-05T18:55:24.897 DEBUG:teuthology.orchestra.run.smithi046:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2023-07-05T18:55:24.981 DEBUG:teuthology.orchestra.run.smithi046:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2023-07-05T18:55:25.053 DEBUG:teuthology.orchestra.run.smithi046:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2023-07-05T18:55:25.123 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-07-05T18:55:25.124 INFO:tasks.ceph:role: osd.1 2023-07-05T18:55:25.124 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi046.front.sepia.ceph.com 2023-07-05T18:55:25.125 DEBUG:teuthology.orchestra.run.smithi046:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2023-07-05T18:55:25.190 INFO:teuthology.orchestra.run.smithi046.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2023-07-05T18:55:25.190 INFO:teuthology.orchestra.run.smithi046.stdout: = sectsz=512 attr=2, projid32bit=1 2023-07-05T18:55:25.191 INFO:teuthology.orchestra.run.smithi046.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-07-05T18:55:25.191 INFO:teuthology.orchestra.run.smithi046.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-07-05T18:55:25.191 INFO:teuthology.orchestra.run.smithi046.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-07-05T18:55:25.191 INFO:teuthology.orchestra.run.smithi046.stdout: = sunit=0 swidth=0 blks 2023-07-05T18:55:25.191 INFO:teuthology.orchestra.run.smithi046.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-07-05T18:55:25.191 INFO:teuthology.orchestra.run.smithi046.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-07-05T18:55:25.191 INFO:teuthology.orchestra.run.smithi046.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-07-05T18:55:25.191 INFO:teuthology.orchestra.run.smithi046.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-07-05T18:55:25.217 INFO:teuthology.orchestra.run.smithi046.stdout:Discarding blocks...Done. 2023-07-05T18:55:25.217 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi046.front.sepia.ceph.com -o noatime 2023-07-05T18:55:25.217 DEBUG:teuthology.orchestra.run.smithi046:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-1 2023-07-05T18:55:25.297 DEBUG:teuthology.orchestra.run.smithi046:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2023-07-05T18:55:25.370 DEBUG:teuthology.orchestra.run.smithi046:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2023-07-05T18:55:25.439 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-07-05T18:55:25.440 INFO:tasks.ceph:role: osd.2 2023-07-05T18:55:25.440 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi046.front.sepia.ceph.com 2023-07-05T18:55:25.440 DEBUG:teuthology.orchestra.run.smithi046:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2023-07-05T18:55:25.510 INFO:teuthology.orchestra.run.smithi046.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2023-07-05T18:55:25.511 INFO:teuthology.orchestra.run.smithi046.stdout: = sectsz=512 attr=2, projid32bit=1 2023-07-05T18:55:25.511 INFO:teuthology.orchestra.run.smithi046.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-07-05T18:55:25.511 INFO:teuthology.orchestra.run.smithi046.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-07-05T18:55:25.511 INFO:teuthology.orchestra.run.smithi046.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-07-05T18:55:25.511 INFO:teuthology.orchestra.run.smithi046.stdout: = sunit=0 swidth=0 blks 2023-07-05T18:55:25.512 INFO:teuthology.orchestra.run.smithi046.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-07-05T18:55:25.512 INFO:teuthology.orchestra.run.smithi046.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-07-05T18:55:25.512 INFO:teuthology.orchestra.run.smithi046.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-07-05T18:55:25.512 INFO:teuthology.orchestra.run.smithi046.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-07-05T18:55:25.532 INFO:teuthology.orchestra.run.smithi046.stdout:Discarding blocks...Done. 2023-07-05T18:55:25.537 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi046.front.sepia.ceph.com -o noatime 2023-07-05T18:55:25.538 DEBUG:teuthology.orchestra.run.smithi046:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-2 2023-07-05T18:55:25.621 DEBUG:teuthology.orchestra.run.smithi046:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2023-07-05T18:55:25.694 DEBUG:teuthology.orchestra.run.smithi046:> sudo mkdir -p /var/lib/ceph/osd/ceph-3 2023-07-05T18:55:25.761 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-07-05T18:55:25.761 INFO:tasks.ceph:role: osd.3 2023-07-05T18:55:25.762 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi046.front.sepia.ceph.com 2023-07-05T18:55:25.762 DEBUG:teuthology.orchestra.run.smithi046:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2023-07-05T18:55:25.827 INFO:teuthology.orchestra.run.smithi046.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2023-07-05T18:55:25.827 INFO:teuthology.orchestra.run.smithi046.stdout: = sectsz=512 attr=2, projid32bit=1 2023-07-05T18:55:25.828 INFO:teuthology.orchestra.run.smithi046.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-07-05T18:55:25.828 INFO:teuthology.orchestra.run.smithi046.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-07-05T18:55:25.828 INFO:teuthology.orchestra.run.smithi046.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-07-05T18:55:25.828 INFO:teuthology.orchestra.run.smithi046.stdout: = sunit=0 swidth=0 blks 2023-07-05T18:55:25.828 INFO:teuthology.orchestra.run.smithi046.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-07-05T18:55:25.828 INFO:teuthology.orchestra.run.smithi046.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-07-05T18:55:25.828 INFO:teuthology.orchestra.run.smithi046.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-07-05T18:55:25.829 INFO:teuthology.orchestra.run.smithi046.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-07-05T18:55:25.854 INFO:teuthology.orchestra.run.smithi046.stdout:Discarding blocks...Done. 2023-07-05T18:55:25.856 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi046.front.sepia.ceph.com -o noatime 2023-07-05T18:55:25.857 DEBUG:teuthology.orchestra.run.smithi046:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-3 2023-07-05T18:55:25.937 DEBUG:teuthology.orchestra.run.smithi046:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-3 2023-07-05T18:55:26.009 DEBUG:teuthology.orchestra.run.smithi046:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-07-05T18:55:26.287 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:55:26.283+0000 7f12aa1ab640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2023-07-05T18:55:26.287 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:55:26.283+0000 7f12aa1ab640 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2023-07-05T18:55:26.287 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:55:26.283+0000 7f12aa1ab640 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2023-07-05T18:55:26.288 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:55:26.283+0000 7f12aa1ab640 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2023-07-05T18:55:26.288 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:55:26.283+0000 7f12aa1ab640 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2023-07-05T18:55:26.288 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:55:26.284+0000 7f12aa1ab640 -1 bluestore(/var/lib/ceph/osd/ceph-0) _read_fsid unparsable uuid 2023-07-05T18:55:29.157 DEBUG:teuthology.orchestra.run.smithi046:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2023-07-05T18:55:29.191 DEBUG:teuthology.orchestra.run.smithi046:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-07-05T18:55:29.283 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:55:29.282+0000 7f6591203640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2023-07-05T18:55:29.284 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:55:29.282+0000 7f6591203640 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2023-07-05T18:55:29.284 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:55:29.282+0000 7f6591203640 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2023-07-05T18:55:29.284 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:55:29.282+0000 7f6591203640 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2023-07-05T18:55:29.284 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:55:29.282+0000 7f6591203640 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2023-07-05T18:55:29.284 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:55:29.283+0000 7f6591203640 -1 bluestore(/var/lib/ceph/osd/ceph-1) _read_fsid unparsable uuid 2023-07-05T18:55:32.147 DEBUG:teuthology.orchestra.run.smithi046:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2023-07-05T18:55:32.184 DEBUG:teuthology.orchestra.run.smithi046:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-07-05T18:55:32.279 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:55:32.278+0000 7f5e5c457640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2023-07-05T18:55:32.280 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:55:32.278+0000 7f5e5c457640 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2023-07-05T18:55:32.280 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:55:32.278+0000 7f5e5c457640 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2023-07-05T18:55:32.280 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:55:32.278+0000 7f5e5c457640 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2023-07-05T18:55:32.280 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:55:32.278+0000 7f5e5c457640 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2023-07-05T18:55:32.281 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:55:32.278+0000 7f5e5c457640 -1 bluestore(/var/lib/ceph/osd/ceph-2) _read_fsid unparsable uuid 2023-07-05T18:55:35.147 DEBUG:teuthology.orchestra.run.smithi046:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2023-07-05T18:55:35.179 DEBUG:teuthology.orchestra.run.smithi046:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 3 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-07-05T18:55:35.273 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:55:35.270+0000 7fe85bf22640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-3/keyring: can't open /var/lib/ceph/osd/ceph-3/keyring: (2) No such file or directory 2023-07-05T18:55:35.273 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:55:35.271+0000 7fe85bf22640 -1 created new key in keyring /var/lib/ceph/osd/ceph-3/keyring 2023-07-05T18:55:35.273 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:55:35.271+0000 7fe85bf22640 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2023-07-05T18:55:35.273 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:55:35.271+0000 7fe85bf22640 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2023-07-05T18:55:35.273 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:55:35.271+0000 7fe85bf22640 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2023-07-05T18:55:35.274 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:55:35.271+0000 7fe85bf22640 -1 bluestore(/var/lib/ceph/osd/ceph-3) _read_fsid unparsable uuid 2023-07-05T18:55:38.144 DEBUG:teuthology.orchestra.run.smithi046:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2023-07-05T18:55:38.181 DEBUG:teuthology.orchestra.run.smithi073:> sudo mkdir -p /var/lib/ceph/osd/ceph-4 2023-07-05T18:55:38.217 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-07-05T18:55:38.218 INFO:tasks.ceph:role: osd.4 2023-07-05T18:55:38.219 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi073.front.sepia.ceph.com 2023-07-05T18:55:38.219 DEBUG:teuthology.orchestra.run.smithi073:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2023-07-05T18:55:38.295 INFO:teuthology.orchestra.run.smithi073.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2023-07-05T18:55:38.296 INFO:teuthology.orchestra.run.smithi073.stdout: = sectsz=512 attr=2, projid32bit=1 2023-07-05T18:55:38.296 INFO:teuthology.orchestra.run.smithi073.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-07-05T18:55:38.296 INFO:teuthology.orchestra.run.smithi073.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-07-05T18:55:38.296 INFO:teuthology.orchestra.run.smithi073.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-07-05T18:55:38.296 INFO:teuthology.orchestra.run.smithi073.stdout: = sunit=0 swidth=0 blks 2023-07-05T18:55:38.297 INFO:teuthology.orchestra.run.smithi073.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-07-05T18:55:38.297 INFO:teuthology.orchestra.run.smithi073.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-07-05T18:55:38.298 INFO:teuthology.orchestra.run.smithi073.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-07-05T18:55:38.298 INFO:teuthology.orchestra.run.smithi073.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-07-05T18:55:38.735 INFO:teuthology.orchestra.run.smithi073.stdout:Discarding blocks...Done. 2023-07-05T18:55:38.737 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi073.front.sepia.ceph.com -o noatime 2023-07-05T18:55:38.737 DEBUG:teuthology.orchestra.run.smithi073:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-4 2023-07-05T18:55:38.918 DEBUG:teuthology.orchestra.run.smithi073:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-4 2023-07-05T18:55:38.959 DEBUG:teuthology.orchestra.run.smithi073:> sudo mkdir -p /var/lib/ceph/osd/ceph-5 2023-07-05T18:55:39.036 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-07-05T18:55:39.037 INFO:tasks.ceph:role: osd.5 2023-07-05T18:55:39.038 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi073.front.sepia.ceph.com 2023-07-05T18:55:39.038 DEBUG:teuthology.orchestra.run.smithi073:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2023-07-05T18:55:39.112 INFO:teuthology.orchestra.run.smithi073.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2023-07-05T18:55:39.113 INFO:teuthology.orchestra.run.smithi073.stdout: = sectsz=512 attr=2, projid32bit=1 2023-07-05T18:55:39.113 INFO:teuthology.orchestra.run.smithi073.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-07-05T18:55:39.113 INFO:teuthology.orchestra.run.smithi073.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-07-05T18:55:39.113 INFO:teuthology.orchestra.run.smithi073.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-07-05T18:55:39.113 INFO:teuthology.orchestra.run.smithi073.stdout: = sunit=0 swidth=0 blks 2023-07-05T18:55:39.114 INFO:teuthology.orchestra.run.smithi073.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-07-05T18:55:39.114 INFO:teuthology.orchestra.run.smithi073.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-07-05T18:55:39.114 INFO:teuthology.orchestra.run.smithi073.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-07-05T18:55:39.114 INFO:teuthology.orchestra.run.smithi073.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-07-05T18:55:39.513 INFO:teuthology.orchestra.run.smithi073.stdout:Discarding blocks...Done. 2023-07-05T18:55:39.516 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi073.front.sepia.ceph.com -o noatime 2023-07-05T18:55:39.517 DEBUG:teuthology.orchestra.run.smithi073:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-5 2023-07-05T18:55:39.635 DEBUG:teuthology.orchestra.run.smithi073:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-5 2023-07-05T18:55:39.673 DEBUG:teuthology.orchestra.run.smithi073:> sudo mkdir -p /var/lib/ceph/osd/ceph-6 2023-07-05T18:55:39.742 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-07-05T18:55:39.742 INFO:tasks.ceph:role: osd.6 2023-07-05T18:55:39.743 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi073.front.sepia.ceph.com 2023-07-05T18:55:39.743 DEBUG:teuthology.orchestra.run.smithi073:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2023-07-05T18:55:39.820 INFO:teuthology.orchestra.run.smithi073.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2023-07-05T18:55:39.820 INFO:teuthology.orchestra.run.smithi073.stdout: = sectsz=512 attr=2, projid32bit=1 2023-07-05T18:55:39.820 INFO:teuthology.orchestra.run.smithi073.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-07-05T18:55:39.820 INFO:teuthology.orchestra.run.smithi073.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-07-05T18:55:39.821 INFO:teuthology.orchestra.run.smithi073.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-07-05T18:55:39.821 INFO:teuthology.orchestra.run.smithi073.stdout: = sunit=0 swidth=0 blks 2023-07-05T18:55:39.821 INFO:teuthology.orchestra.run.smithi073.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-07-05T18:55:39.821 INFO:teuthology.orchestra.run.smithi073.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-07-05T18:55:39.821 INFO:teuthology.orchestra.run.smithi073.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-07-05T18:55:39.821 INFO:teuthology.orchestra.run.smithi073.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-07-05T18:55:40.279 INFO:teuthology.orchestra.run.smithi073.stdout:Discarding blocks...Done. 2023-07-05T18:55:40.281 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi073.front.sepia.ceph.com -o noatime 2023-07-05T18:55:40.282 DEBUG:teuthology.orchestra.run.smithi073:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-6 2023-07-05T18:55:40.458 DEBUG:teuthology.orchestra.run.smithi073:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-6 2023-07-05T18:55:40.492 DEBUG:teuthology.orchestra.run.smithi073:> sudo mkdir -p /var/lib/ceph/osd/ceph-7 2023-07-05T18:55:40.561 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-07-05T18:55:40.561 INFO:tasks.ceph:role: osd.7 2023-07-05T18:55:40.562 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi073.front.sepia.ceph.com 2023-07-05T18:55:40.562 DEBUG:teuthology.orchestra.run.smithi073:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2023-07-05T18:55:40.637 INFO:teuthology.orchestra.run.smithi073.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2023-07-05T18:55:40.638 INFO:teuthology.orchestra.run.smithi073.stdout: = sectsz=512 attr=2, projid32bit=1 2023-07-05T18:55:40.638 INFO:teuthology.orchestra.run.smithi073.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-07-05T18:55:40.638 INFO:teuthology.orchestra.run.smithi073.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-07-05T18:55:40.638 INFO:teuthology.orchestra.run.smithi073.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-07-05T18:55:40.638 INFO:teuthology.orchestra.run.smithi073.stdout: = sunit=0 swidth=0 blks 2023-07-05T18:55:40.638 INFO:teuthology.orchestra.run.smithi073.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-07-05T18:55:40.639 INFO:teuthology.orchestra.run.smithi073.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-07-05T18:55:40.639 INFO:teuthology.orchestra.run.smithi073.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-07-05T18:55:40.639 INFO:teuthology.orchestra.run.smithi073.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-07-05T18:55:41.071 INFO:teuthology.orchestra.run.smithi073.stdout:Discarding blocks...Done. 2023-07-05T18:55:41.073 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi073.front.sepia.ceph.com -o noatime 2023-07-05T18:55:41.074 DEBUG:teuthology.orchestra.run.smithi073:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-7 2023-07-05T18:55:41.249 DEBUG:teuthology.orchestra.run.smithi073:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-7 2023-07-05T18:55:41.285 DEBUG:teuthology.orchestra.run.smithi073:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 4 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-07-05T18:55:41.392 INFO:teuthology.orchestra.run.smithi073.stderr:2023-07-05T18:55:41.390+0000 7f332cff8640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-4/keyring: can't open /var/lib/ceph/osd/ceph-4/keyring: (2) No such file or directory 2023-07-05T18:55:41.392 INFO:teuthology.orchestra.run.smithi073.stderr:2023-07-05T18:55:41.390+0000 7f332cff8640 -1 created new key in keyring /var/lib/ceph/osd/ceph-4/keyring 2023-07-05T18:55:41.392 INFO:teuthology.orchestra.run.smithi073.stderr:2023-07-05T18:55:41.390+0000 7f332cff8640 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2023-07-05T18:55:41.392 INFO:teuthology.orchestra.run.smithi073.stderr:2023-07-05T18:55:41.390+0000 7f332cff8640 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2023-07-05T18:55:41.393 INFO:teuthology.orchestra.run.smithi073.stderr:2023-07-05T18:55:41.390+0000 7f332cff8640 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2023-07-05T18:55:41.393 INFO:teuthology.orchestra.run.smithi073.stderr:2023-07-05T18:55:41.390+0000 7f332cff8640 -1 bluestore(/var/lib/ceph/osd/ceph-4) _read_fsid unparsable uuid 2023-07-05T18:55:44.253 DEBUG:teuthology.orchestra.run.smithi073:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2023-07-05T18:55:44.285 DEBUG:teuthology.orchestra.run.smithi073:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 5 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-07-05T18:55:44.377 INFO:teuthology.orchestra.run.smithi073.stderr:2023-07-05T18:55:44.375+0000 7f26234d4640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-5/keyring: can't open /var/lib/ceph/osd/ceph-5/keyring: (2) No such file or directory 2023-07-05T18:55:44.377 INFO:teuthology.orchestra.run.smithi073.stderr:2023-07-05T18:55:44.375+0000 7f26234d4640 -1 created new key in keyring /var/lib/ceph/osd/ceph-5/keyring 2023-07-05T18:55:44.377 INFO:teuthology.orchestra.run.smithi073.stderr:2023-07-05T18:55:44.375+0000 7f26234d4640 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2023-07-05T18:55:44.378 INFO:teuthology.orchestra.run.smithi073.stderr:2023-07-05T18:55:44.375+0000 7f26234d4640 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2023-07-05T18:55:44.378 INFO:teuthology.orchestra.run.smithi073.stderr:2023-07-05T18:55:44.375+0000 7f26234d4640 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2023-07-05T18:55:44.378 INFO:teuthology.orchestra.run.smithi073.stderr:2023-07-05T18:55:44.376+0000 7f26234d4640 -1 bluestore(/var/lib/ceph/osd/ceph-5) _read_fsid unparsable uuid 2023-07-05T18:55:47.248 DEBUG:teuthology.orchestra.run.smithi073:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2023-07-05T18:55:47.280 DEBUG:teuthology.orchestra.run.smithi073:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 6 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-07-05T18:55:47.372 INFO:teuthology.orchestra.run.smithi073.stderr:2023-07-05T18:55:47.369+0000 7f36f0875640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-6/keyring: can't open /var/lib/ceph/osd/ceph-6/keyring: (2) No such file or directory 2023-07-05T18:55:47.373 INFO:teuthology.orchestra.run.smithi073.stderr:2023-07-05T18:55:47.369+0000 7f36f0875640 -1 created new key in keyring /var/lib/ceph/osd/ceph-6/keyring 2023-07-05T18:55:47.373 INFO:teuthology.orchestra.run.smithi073.stderr:2023-07-05T18:55:47.369+0000 7f36f0875640 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2023-07-05T18:55:47.373 INFO:teuthology.orchestra.run.smithi073.stderr:2023-07-05T18:55:47.369+0000 7f36f0875640 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2023-07-05T18:55:47.374 INFO:teuthology.orchestra.run.smithi073.stderr:2023-07-05T18:55:47.369+0000 7f36f0875640 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2023-07-05T18:55:47.374 INFO:teuthology.orchestra.run.smithi073.stderr:2023-07-05T18:55:47.370+0000 7f36f0875640 -1 bluestore(/var/lib/ceph/osd/ceph-6) _read_fsid unparsable uuid 2023-07-05T18:55:50.256 DEBUG:teuthology.orchestra.run.smithi073:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-6 2023-07-05T18:55:50.301 DEBUG:teuthology.orchestra.run.smithi073:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 7 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-07-05T18:55:50.391 INFO:teuthology.orchestra.run.smithi073.stderr:2023-07-05T18:55:50.388+0000 7fcf3aef1640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-7/keyring: can't open /var/lib/ceph/osd/ceph-7/keyring: (2) No such file or directory 2023-07-05T18:55:50.391 INFO:teuthology.orchestra.run.smithi073.stderr:2023-07-05T18:55:50.388+0000 7fcf3aef1640 -1 created new key in keyring /var/lib/ceph/osd/ceph-7/keyring 2023-07-05T18:55:50.392 INFO:teuthology.orchestra.run.smithi073.stderr:2023-07-05T18:55:50.389+0000 7fcf3aef1640 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2023-07-05T18:55:50.392 INFO:teuthology.orchestra.run.smithi073.stderr:2023-07-05T18:55:50.389+0000 7fcf3aef1640 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2023-07-05T18:55:50.392 INFO:teuthology.orchestra.run.smithi073.stderr:2023-07-05T18:55:50.389+0000 7fcf3aef1640 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2023-07-05T18:55:50.392 INFO:teuthology.orchestra.run.smithi073.stderr:2023-07-05T18:55:50.389+0000 7fcf3aef1640 -1 bluestore(/var/lib/ceph/osd/ceph-7) _read_fsid unparsable uuid 2023-07-05T18:55:51.240 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-05T18:55:51.243 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-05T18:55:53.267 DEBUG:teuthology.orchestra.run.smithi073:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-7 2023-07-05T18:55:53.301 INFO:tasks.ceph:Reading keys from all nodes... 2023-07-05T18:55:53.301 DEBUG:teuthology.orchestra.run.smithi046:> set -ex 2023-07-05T18:55:53.301 DEBUG:teuthology.orchestra.run.smithi046:> sudo dd if=/var/lib/ceph/mgr/ceph-y/keyring of=/dev/stdout 2023-07-05T18:55:53.334 DEBUG:teuthology.orchestra.run.smithi046:> set -ex 2023-07-05T18:55:53.335 DEBUG:teuthology.orchestra.run.smithi046:> sudo dd if=/var/lib/ceph/mds/ceph-a/keyring of=/dev/stdout 2023-07-05T18:55:53.409 DEBUG:teuthology.orchestra.run.smithi046:> set -ex 2023-07-05T18:55:53.409 DEBUG:teuthology.orchestra.run.smithi046:> sudo dd if=/var/lib/ceph/mds/ceph-c/keyring of=/dev/stdout 2023-07-05T18:55:53.482 DEBUG:teuthology.orchestra.run.smithi046:> set -ex 2023-07-05T18:55:53.483 DEBUG:teuthology.orchestra.run.smithi046:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2023-07-05T18:55:53.555 DEBUG:teuthology.orchestra.run.smithi046:> set -ex 2023-07-05T18:55:53.556 DEBUG:teuthology.orchestra.run.smithi046:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2023-07-05T18:55:53.625 DEBUG:teuthology.orchestra.run.smithi046:> set -ex 2023-07-05T18:55:53.625 DEBUG:teuthology.orchestra.run.smithi046:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2023-07-05T18:55:53.695 DEBUG:teuthology.orchestra.run.smithi046:> set -ex 2023-07-05T18:55:53.696 DEBUG:teuthology.orchestra.run.smithi046:> sudo dd if=/var/lib/ceph/osd/ceph-3/keyring of=/dev/stdout 2023-07-05T18:55:53.766 DEBUG:teuthology.orchestra.run.smithi073:> set -ex 2023-07-05T18:55:53.766 DEBUG:teuthology.orchestra.run.smithi073:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2023-07-05T18:55:53.800 DEBUG:teuthology.orchestra.run.smithi073:> set -ex 2023-07-05T18:55:53.800 DEBUG:teuthology.orchestra.run.smithi073:> sudo dd if=/var/lib/ceph/mds/ceph-b/keyring of=/dev/stdout 2023-07-05T18:55:53.872 DEBUG:teuthology.orchestra.run.smithi073:> set -ex 2023-07-05T18:55:53.872 DEBUG:teuthology.orchestra.run.smithi073:> sudo dd if=/var/lib/ceph/mds/ceph-d/keyring of=/dev/stdout 2023-07-05T18:55:53.941 DEBUG:teuthology.orchestra.run.smithi073:> set -ex 2023-07-05T18:55:53.941 DEBUG:teuthology.orchestra.run.smithi073:> sudo dd if=/var/lib/ceph/osd/ceph-4/keyring of=/dev/stdout 2023-07-05T18:55:54.011 DEBUG:teuthology.orchestra.run.smithi073:> set -ex 2023-07-05T18:55:54.011 DEBUG:teuthology.orchestra.run.smithi073:> sudo dd if=/var/lib/ceph/osd/ceph-5/keyring of=/dev/stdout 2023-07-05T18:55:54.079 DEBUG:teuthology.orchestra.run.smithi073:> set -ex 2023-07-05T18:55:54.079 DEBUG:teuthology.orchestra.run.smithi073:> sudo dd if=/var/lib/ceph/osd/ceph-6/keyring of=/dev/stdout 2023-07-05T18:55:54.146 DEBUG:teuthology.orchestra.run.smithi073:> set -ex 2023-07-05T18:55:54.147 DEBUG:teuthology.orchestra.run.smithi073:> sudo dd if=/var/lib/ceph/osd/ceph-7/keyring of=/dev/stdout 2023-07-05T18:55:54.213 DEBUG:teuthology.orchestra.run.smithi046:> set -ex 2023-07-05T18:55:54.214 DEBUG:teuthology.orchestra.run.smithi046:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2023-07-05T18:55:54.235 DEBUG:teuthology.orchestra.run.smithi046:> set -ex 2023-07-05T18:55:54.235 DEBUG:teuthology.orchestra.run.smithi046:> dd if=/etc/ceph/ceph.client.2.keyring of=/dev/stdout 2023-07-05T18:55:54.295 DEBUG:teuthology.orchestra.run.smithi073:> set -ex 2023-07-05T18:55:54.296 DEBUG:teuthology.orchestra.run.smithi073:> dd if=/etc/ceph/ceph.client.1.keyring of=/dev/stdout 2023-07-05T18:55:54.314 DEBUG:teuthology.orchestra.run.smithi073:> set -ex 2023-07-05T18:55:54.315 DEBUG:teuthology.orchestra.run.smithi073:> dd if=/etc/ceph/ceph.client.3.keyring of=/dev/stdout 2023-07-05T18:55:54.372 INFO:tasks.ceph:Adding keys to all mons... 2023-07-05T18:55:54.373 DEBUG:teuthology.orchestra.run.smithi046:> sudo tee -a /etc/ceph/ceph.keyring 2023-07-05T18:55:54.376 DEBUG:teuthology.orchestra.run.smithi073:> sudo tee -a /etc/ceph/ceph.keyring 2023-07-05T18:55:54.415 INFO:teuthology.orchestra.run.smithi046.stdout:[mgr.y] 2023-07-05T18:55:54.416 INFO:teuthology.orchestra.run.smithi046.stdout: key = AQCbvKVkmAeGORAARtEgzTDqIi/PI4u7OEey0g== 2023-07-05T18:55:54.416 INFO:teuthology.orchestra.run.smithi046.stdout:[mds.a] 2023-07-05T18:55:54.416 INFO:teuthology.orchestra.run.smithi046.stdout: key = AQCcvKVkSyJqBhAAg8BNDzzXYyHzhVt+viqltQ== 2023-07-05T18:55:54.416 INFO:teuthology.orchestra.run.smithi046.stdout:[mds.c] 2023-07-05T18:55:54.416 INFO:teuthology.orchestra.run.smithi046.stdout: key = AQCcvKVkQCPnDRAA67WfGe98FpDUG7rwOHpN/A== 2023-07-05T18:55:54.417 INFO:teuthology.orchestra.run.smithi046.stdout:[osd.0] 2023-07-05T18:55:54.417 INFO:teuthology.orchestra.run.smithi046.stdout: key = AQCevKVkJAjsEBAAG/M981ZejiEKWE9H9MgW3A== 2023-07-05T18:55:54.417 INFO:teuthology.orchestra.run.smithi046.stdout:[osd.1] 2023-07-05T18:55:54.417 INFO:teuthology.orchestra.run.smithi046.stdout: key = AQChvKVkGOPYEBAABUMv/LIkN/+e5PXc5SBknA== 2023-07-05T18:55:54.418 INFO:teuthology.orchestra.run.smithi046.stdout:[osd.2] 2023-07-05T18:55:54.418 INFO:teuthology.orchestra.run.smithi046.stdout: key = AQCkvKVk3nmbEBAAbKDHZnuO/x/UvH+A5bAOLQ== 2023-07-05T18:55:54.418 INFO:teuthology.orchestra.run.smithi046.stdout:[osd.3] 2023-07-05T18:55:54.418 INFO:teuthology.orchestra.run.smithi046.stdout: key = AQCnvKVkAGs3EBAAXcRN+CCYBniZkxD5JxV40Q== 2023-07-05T18:55:54.418 INFO:teuthology.orchestra.run.smithi046.stdout:[mgr.x] 2023-07-05T18:55:54.419 INFO:teuthology.orchestra.run.smithi046.stdout: key = AQCcvKVkvWrFAhAA/Aqe9qlW5+uCL0TUTPXuhA== 2023-07-05T18:55:54.419 INFO:teuthology.orchestra.run.smithi046.stdout:[mds.b] 2023-07-05T18:55:54.419 INFO:teuthology.orchestra.run.smithi046.stdout: key = AQCcvKVkooGkExAA5BtzsmXGFlxJFz6wdWWAww== 2023-07-05T18:55:54.419 INFO:teuthology.orchestra.run.smithi046.stdout:[mds.d] 2023-07-05T18:55:54.419 INFO:teuthology.orchestra.run.smithi046.stdout: key = AQCcvKVkbgVUGxAAh0i8s6bO1YiJcx3pLpwHjA== 2023-07-05T18:55:54.419 INFO:teuthology.orchestra.run.smithi046.stdout:[osd.4] 2023-07-05T18:55:54.419 INFO:teuthology.orchestra.run.smithi046.stdout: key = AQCtvKVkGzJQFxAAe8+vmDgU0bgrOGbGtG3epQ== 2023-07-05T18:55:54.420 INFO:teuthology.orchestra.run.smithi046.stdout:[osd.5] 2023-07-05T18:55:54.420 INFO:teuthology.orchestra.run.smithi046.stdout: key = AQCwvKVkAGJsFhAAKBzz0ePGRD7wLLrbI8MyqQ== 2023-07-05T18:55:54.420 INFO:teuthology.orchestra.run.smithi046.stdout:[osd.6] 2023-07-05T18:55:54.420 INFO:teuthology.orchestra.run.smithi046.stdout: key = AQCzvKVkSvAeFhAAAjyu21p6+GFiRUWefuXs7w== 2023-07-05T18:55:54.420 INFO:teuthology.orchestra.run.smithi046.stdout:[osd.7] 2023-07-05T18:55:54.421 INFO:teuthology.orchestra.run.smithi046.stdout: key = AQC2vKVk03JIFxAAf5MH+S9FhbPXG/ex1AoAAQ== 2023-07-05T18:55:54.421 INFO:teuthology.orchestra.run.smithi046.stdout:[client.0] 2023-07-05T18:55:54.421 INFO:teuthology.orchestra.run.smithi046.stdout: key = AQCcvKVkPxf4HxAALyNjHQc594Dg6fVfsq01hQ== 2023-07-05T18:55:54.421 INFO:teuthology.orchestra.run.smithi046.stdout:[client.2] 2023-07-05T18:55:54.421 INFO:teuthology.orchestra.run.smithi046.stdout: key = AQCcvKVkEHWDIxAAq2we83Gx4nijR7SjOOgtJg== 2023-07-05T18:55:54.421 INFO:teuthology.orchestra.run.smithi046.stdout:[client.1] 2023-07-05T18:55:54.421 INFO:teuthology.orchestra.run.smithi046.stdout: key = AQCcvKVkP39nJxAA20ddJDd4HtNA+LRLCTPXrg== 2023-07-05T18:55:54.422 INFO:teuthology.orchestra.run.smithi046.stdout:[client.3] 2023-07-05T18:55:54.422 INFO:teuthology.orchestra.run.smithi046.stdout: key = AQCcvKVkIs9NLRAArWr6ilA75p0/9/fcl5uC1Q== 2023-07-05T18:55:54.442 INFO:teuthology.orchestra.run.smithi073.stdout:[mgr.y] 2023-07-05T18:55:54.442 INFO:teuthology.orchestra.run.smithi073.stdout: key = AQCbvKVkmAeGORAARtEgzTDqIi/PI4u7OEey0g== 2023-07-05T18:55:54.442 INFO:teuthology.orchestra.run.smithi073.stdout:[mds.a] 2023-07-05T18:55:54.442 INFO:teuthology.orchestra.run.smithi073.stdout: key = AQCcvKVkSyJqBhAAg8BNDzzXYyHzhVt+viqltQ== 2023-07-05T18:55:54.442 INFO:teuthology.orchestra.run.smithi073.stdout:[mds.c] 2023-07-05T18:55:54.443 INFO:teuthology.orchestra.run.smithi073.stdout: key = AQCcvKVkQCPnDRAA67WfGe98FpDUG7rwOHpN/A== 2023-07-05T18:55:54.443 INFO:teuthology.orchestra.run.smithi073.stdout:[osd.0] 2023-07-05T18:55:54.443 INFO:teuthology.orchestra.run.smithi073.stdout: key = AQCevKVkJAjsEBAAG/M981ZejiEKWE9H9MgW3A== 2023-07-05T18:55:54.443 INFO:teuthology.orchestra.run.smithi073.stdout:[osd.1] 2023-07-05T18:55:54.443 INFO:teuthology.orchestra.run.smithi073.stdout: key = AQChvKVkGOPYEBAABUMv/LIkN/+e5PXc5SBknA== 2023-07-05T18:55:54.443 INFO:teuthology.orchestra.run.smithi073.stdout:[osd.2] 2023-07-05T18:55:54.443 INFO:teuthology.orchestra.run.smithi073.stdout: key = AQCkvKVk3nmbEBAAbKDHZnuO/x/UvH+A5bAOLQ== 2023-07-05T18:55:54.443 INFO:teuthology.orchestra.run.smithi073.stdout:[osd.3] 2023-07-05T18:55:54.444 INFO:teuthology.orchestra.run.smithi073.stdout: key = AQCnvKVkAGs3EBAAXcRN+CCYBniZkxD5JxV40Q== 2023-07-05T18:55:54.444 INFO:teuthology.orchestra.run.smithi073.stdout:[mgr.x] 2023-07-05T18:55:54.444 INFO:teuthology.orchestra.run.smithi073.stdout: key = AQCcvKVkvWrFAhAA/Aqe9qlW5+uCL0TUTPXuhA== 2023-07-05T18:55:54.444 INFO:teuthology.orchestra.run.smithi073.stdout:[mds.b] 2023-07-05T18:55:54.444 INFO:teuthology.orchestra.run.smithi073.stdout: key = AQCcvKVkooGkExAA5BtzsmXGFlxJFz6wdWWAww== 2023-07-05T18:55:54.444 INFO:teuthology.orchestra.run.smithi073.stdout:[mds.d] 2023-07-05T18:55:54.444 INFO:teuthology.orchestra.run.smithi073.stdout: key = AQCcvKVkbgVUGxAAh0i8s6bO1YiJcx3pLpwHjA== 2023-07-05T18:55:54.445 INFO:teuthology.orchestra.run.smithi073.stdout:[osd.4] 2023-07-05T18:55:54.445 INFO:teuthology.orchestra.run.smithi073.stdout: key = AQCtvKVkGzJQFxAAe8+vmDgU0bgrOGbGtG3epQ== 2023-07-05T18:55:54.445 INFO:teuthology.orchestra.run.smithi073.stdout:[osd.5] 2023-07-05T18:55:54.445 INFO:teuthology.orchestra.run.smithi073.stdout: key = AQCwvKVkAGJsFhAAKBzz0ePGRD7wLLrbI8MyqQ== 2023-07-05T18:55:54.445 INFO:teuthology.orchestra.run.smithi073.stdout:[osd.6] 2023-07-05T18:55:54.445 INFO:teuthology.orchestra.run.smithi073.stdout: key = AQCzvKVkSvAeFhAAAjyu21p6+GFiRUWefuXs7w== 2023-07-05T18:55:54.445 INFO:teuthology.orchestra.run.smithi073.stdout:[osd.7] 2023-07-05T18:55:54.445 INFO:teuthology.orchestra.run.smithi073.stdout: key = AQC2vKVk03JIFxAAf5MH+S9FhbPXG/ex1AoAAQ== 2023-07-05T18:55:54.446 INFO:teuthology.orchestra.run.smithi073.stdout:[client.0] 2023-07-05T18:55:54.446 INFO:teuthology.orchestra.run.smithi073.stdout: key = AQCcvKVkPxf4HxAALyNjHQc594Dg6fVfsq01hQ== 2023-07-05T18:55:54.446 INFO:teuthology.orchestra.run.smithi073.stdout:[client.2] 2023-07-05T18:55:54.446 INFO:teuthology.orchestra.run.smithi073.stdout: key = AQCcvKVkEHWDIxAAq2we83Gx4nijR7SjOOgtJg== 2023-07-05T18:55:54.446 INFO:teuthology.orchestra.run.smithi073.stdout:[client.1] 2023-07-05T18:55:54.446 INFO:teuthology.orchestra.run.smithi073.stdout: key = AQCcvKVkP39nJxAA20ddJDd4HtNA+LRLCTPXrg== 2023-07-05T18:55:54.446 INFO:teuthology.orchestra.run.smithi073.stdout:[client.3] 2023-07-05T18:55:54.446 INFO:teuthology.orchestra.run.smithi073.stdout: key = AQCcvKVkIs9NLRAArWr6ilA75p0/9/fcl5uC1Q== 2023-07-05T18:55:54.447 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-07-05T18:55:54.469 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-07-05T18:55:54.536 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-07-05T18:55:54.539 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-07-05T18:55:54.599 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-07-05T18:55:54.602 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-07-05T18:55:54.659 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-07-05T18:55:54.662 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-07-05T18:55:54.716 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-07-05T18:55:54.719 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-07-05T18:55:54.772 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-07-05T18:55:54.775 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-07-05T18:55:54.829 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-07-05T18:55:54.837 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-07-05T18:55:54.890 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-07-05T18:55:54.893 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-07-05T18:55:54.946 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-07-05T18:55:54.949 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-07-05T18:55:55.005 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-07-05T18:55:55.008 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-07-05T18:55:55.066 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-07-05T18:55:55.068 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-07-05T18:55:55.122 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-07-05T18:55:55.128 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-07-05T18:55:55.183 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-07-05T18:55:55.186 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-07-05T18:55:55.240 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-07-05T18:55:55.244 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-07-05T18:55:55.301 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-07-05T18:55:55.304 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-07-05T18:55:55.361 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.2 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-07-05T18:55:55.368 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.2 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-07-05T18:55:55.426 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-07-05T18:55:55.430 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-07-05T18:55:55.489 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.3 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-07-05T18:55:55.493 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.3 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-07-05T18:55:55.549 INFO:tasks.ceph:Running mkfs on mon nodes... 2023-07-05T18:55:55.550 DEBUG:teuthology.orchestra.run.smithi046:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2023-07-05T18:55:55.577 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2023-07-05T18:55:55.681 DEBUG:teuthology.orchestra.run.smithi046:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2023-07-05T18:55:55.709 DEBUG:teuthology.orchestra.run.smithi073:> sudo mkdir -p /var/lib/ceph/mon/ceph-b 2023-07-05T18:55:55.736 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i b --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2023-07-05T18:55:55.836 DEBUG:teuthology.orchestra.run.smithi073:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-b 2023-07-05T18:55:55.863 DEBUG:teuthology.orchestra.run.smithi073:> sudo mkdir -p /var/lib/ceph/mon/ceph-c 2023-07-05T18:55:55.930 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i c --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2023-07-05T18:55:56.034 DEBUG:teuthology.orchestra.run.smithi073:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-c 2023-07-05T18:55:56.062 DEBUG:teuthology.orchestra.run.smithi046:> rm -- /home/ubuntu/cephtest/ceph.monmap 2023-07-05T18:55:56.073 DEBUG:teuthology.orchestra.run.smithi073:> rm -- /home/ubuntu/cephtest/ceph.monmap 2023-07-05T18:55:56.121 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2023-07-05T18:55:56.122 INFO:tasks.ceph.mon.a:Restarting daemon 2023-07-05T18:55:56.122 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2023-07-05T18:55:56.129 INFO:tasks.ceph.mon.a:Started 2023-07-05T18:55:56.130 INFO:tasks.ceph.mon.b:Restarting daemon 2023-07-05T18:55:56.130 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2023-07-05T18:55:56.166 INFO:tasks.ceph.mon.b:Started 2023-07-05T18:55:56.166 INFO:tasks.ceph.mon.c:Restarting daemon 2023-07-05T18:55:56.167 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2023-07-05T18:55:56.169 INFO:tasks.ceph.mon.c:Started 2023-07-05T18:55:56.169 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2023-07-05T18:55:56.170 INFO:tasks.ceph.mgr.y:Restarting daemon 2023-07-05T18:55:56.170 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i y 2023-07-05T18:55:56.177 INFO:tasks.ceph.mgr.y:Started 2023-07-05T18:55:56.177 INFO:tasks.ceph.mgr.x:Restarting daemon 2023-07-05T18:55:56.178 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2023-07-05T18:55:56.180 INFO:tasks.ceph.mgr.x:Started 2023-07-05T18:55:56.180 INFO:tasks.ceph:Setting crush tunables to default 2023-07-05T18:55:56.180 DEBUG:teuthology.orchestra.run.smithi046:> sudo ceph --cluster ceph osd crush tunables default 2023-07-05T18:55:56.312 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:55:56.306+0000 7fa39f5b1700 1 Processor -- start 2023-07-05T18:55:56.312 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:55:56.306+0000 7fa39f5b1700 1 -- start start 2023-07-05T18:55:56.312 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:55:56.307+0000 7fa39f5b1700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fa3980aef40 0x7fa3980b3530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:55:56.312 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:55:56.307+0000 7fa39f5b1700 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa3980b30a0 con 0x7fa398069e00 2023-07-05T18:55:56.313 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:55:56.307+0000 7fa39f5b1700 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa39806ca80 con 0x7fa39815d190 2023-07-05T18:55:56.313 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:55:56.307+0000 7fa39f5b1700 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa39815d940 con 0x7fa3980aef40 2023-07-05T18:55:56.316 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:55:56.307+0000 7fa39d34d700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fa3980aef40 0x7fa3980b3530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:55:56.316 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:55:56.307+0000 7fa39d34d700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fa3980aef40 0x7fa3980b3530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:57108/0 (socket says 172.21.15.46:57108) 2023-07-05T18:55:56.317 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:55:56.307+0000 7fa39d34d700 1 -- 172.21.15.46:0/2655043287 learned_addr learned my addr 172.21.15.46:0/2655043287 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-07-05T18:55:56.317 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:55:56.307+0000 7fa39d34d700 1 -- 172.21.15.46:0/2655043287 >> v2:172.21.15.46:3300/0 conn(0x7fa3980aef40 msgr2=0x7fa3980b3530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2023-07-05T18:55:56.317 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:55:56.308+0000 7fa39d34d700 1 -- 172.21.15.46:0/2655043287 >> v2:172.21.15.46:3300/0 conn(0x7fa3980aef40 msgr2=0x7fa3980b3530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-07-05T18:55:56.317 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:55:56.308+0000 7fa39d34d700 1 --2- 172.21.15.46:0/2655043287 >> v2:172.21.15.46:3300/0 conn(0x7fa3980aef40 0x7fa3980b3530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-07-05T18:55:56.317 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:55:56.308+0000 7fa39d34d700 1 --2- 172.21.15.46:0/2655043287 >> v2:172.21.15.46:3300/0 conn(0x7fa3980aef40 0x7fa3980b3530 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-07-05T18:55:56.482 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:55:56.480+0000 7fa38ffff700 1 -- 172.21.15.46:0/2655043287 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3823032986 0 0) 0x7fa3980b30a0 con 0x7fa398069e00 2023-07-05T18:55:56.482 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:55:56.480+0000 7fa38ffff700 1 -- 172.21.15.46:0/2655043287 --> v1:172.21.15.46:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa3840035b0 con 0x7fa398069e00 2023-07-05T18:55:56.483 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:55:56.481+0000 7fa38ffff700 1 -- 172.21.15.46:0/2655043287 <== mon.0 v1:172.21.15.46:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2309399438 0 0) 0x7fa3840035b0 con 0x7fa398069e00 2023-07-05T18:55:56.483 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:55:56.481+0000 7fa38ffff700 1 -- 172.21.15.46:0/2655043287 >> v2:172.21.15.46:3300/0 conn(0x7fa3980aef40 msgr2=0x7fa3980b3530 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-07-05T18:55:56.483 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:55:56.481+0000 7fa38ffff700 1 --2- 172.21.15.46:0/2655043287 >> v2:172.21.15.46:3300/0 conn(0x7fa3980aef40 0x7fa3980b3530 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:55:56.484 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:55:56.481+0000 7fa38ffff700 1 -- 172.21.15.46:0/2655043287 >> v1:172.21.15.73:6789/0 conn(0x7fa39815d190 legacy=0x7fa398152c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:55:56.484 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:55:56.481+0000 7fa38ffff700 1 -- 172.21.15.46:0/2655043287 --> v1:172.21.15.46:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa39815d660 con 0x7fa398069e00 2023-07-05T18:55:56.484 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:55:56.481+0000 7fa38ffff700 1 -- 172.21.15.46:0/2655043287 <== mon.0 v1:172.21.15.46:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2195585215 0 0) 0x7fa388001670 con 0x7fa398069e00 2023-07-05T18:55:56.484 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:55:56.481+0000 7fa38ffff700 1 -- 172.21.15.46:0/2655043287 >> v1:172.21.15.46:6789/0 conn(0x7fa398069e00 legacy=0x7fa39815ca80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:55:56.485 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:55:56.481+0000 7fa38ffff700 1 --2- 172.21.15.46:0/2655043287 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa384003a00 0x7fa384003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:55:56.485 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:55:56.481+0000 7fa38ffff700 1 --2- 172.21.15.46:0/2655043287 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fa384004850 0x7fa384004cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:55:56.485 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:55:56.481+0000 7fa38ffff700 1 --2- 172.21.15.46:0/2655043287 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa384005320 0x7fa38400ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:55:56.485 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:55:56.481+0000 7fa38ffff700 1 -- 172.21.15.46:0/2655043287 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa39815d940 con 0x7fa384005320 2023-07-05T18:55:56.486 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:55:56.481+0000 7fa38ffff700 1 -- 172.21.15.46:0/2655043287 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa38400c1e0 con 0x7fa384003a00 2023-07-05T18:55:56.486 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:55:56.481+0000 7fa38ffff700 1 -- 172.21.15.46:0/2655043287 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa38400c3a0 con 0x7fa384004850 2023-07-05T18:55:56.486 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:55:56.481+0000 7fa39cb4c700 1 --2- 172.21.15.46:0/2655043287 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fa384004850 0x7fa384004cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:55:56.486 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:55:56.481+0000 7fa39d34d700 1 --2- 172.21.15.46:0/2655043287 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa384003a00 0x7fa384003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:55:56.486 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:55:56.481+0000 7fa39db4e700 1 --2- 172.21.15.46:0/2655043287 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa384005320 0x7fa38400ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:55:56.487 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:55:56.482+0000 7fa39d34d700 1 -- 172.21.15.46:0/2655043287 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fa384004850 msgr2=0x7fa384004cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-05T18:55:56.487 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:55:56.482+0000 7fa39d34d700 1 --2- 172.21.15.46:0/2655043287 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fa384004850 0x7fa384004cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:55:56.487 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:55:56.482+0000 7fa39d34d700 1 -- 172.21.15.46:0/2655043287 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa384005320 msgr2=0x7fa38400ba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-05T18:55:56.488 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:55:56.482+0000 7fa39d34d700 1 --2- 172.21.15.46:0/2655043287 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa384005320 0x7fa38400ba10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:55:56.488 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:55:56.482+0000 7fa39d34d700 1 -- 172.21.15.46:0/2655043287 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa3840035b0 con 0x7fa384003a00 2023-07-05T18:55:56.488 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:55:56.482+0000 7fa39db4e700 1 --2- 172.21.15.46:0/2655043287 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa384005320 0x7fa38400ba10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-05T18:55:56.488 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:55:56.482+0000 7fa39db4e700 1 -- 172.21.15.46:0/2655043287 reap_dead start 2023-07-05T18:55:56.488 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:55:56.482+0000 7fa39d34d700 1 --2- 172.21.15.46:0/2655043287 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa384003a00 0x7fa384003e10 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fa390009cc0 tx=0x7fa384005880 comp rx=0 tx=0).ready entity=mon.1 client_cookie=aaca97508a00ab26 server_cookie=0 in_seq=0 out_seq=0 2023-07-05T18:55:56.488 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:55:56.485+0000 7fa38ffff700 1 -- 172.21.15.46:0/2655043287 <== mon.1 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa390017070 con 0x7fa384003a00 2023-07-05T18:55:56.488 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:55:56.485+0000 7fa38ffff700 1 -- 172.21.15.46:0/2655043287 <== mon.1 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa39000f040 con 0x7fa384003a00 2023-07-05T18:55:56.489 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:55:56.485+0000 7fa38ffff700 1 -- 172.21.15.46:0/2655043287 <== mon.1 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa390003c60 con 0x7fa384003a00 2023-07-05T18:55:56.489 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:55:56.486+0000 7fa39f5b1700 1 -- 172.21.15.46:0/2655043287 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa384003a00 msgr2=0x7fa384003e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:55:56.490 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:55:56.486+0000 7fa39f5b1700 1 --2- 172.21.15.46:0/2655043287 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa384003a00 0x7fa384003e10 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fa390009cc0 tx=0x7fa384005880 comp rx=0 tx=0).stop 2023-07-05T18:55:56.490 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:55:56.486+0000 7fa39f5b1700 1 -- 172.21.15.46:0/2655043287 shutdown_connections 2023-07-05T18:55:56.490 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:55:56.486+0000 7fa39f5b1700 1 --2- 172.21.15.46:0/2655043287 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa384003a00 0x7fa384003e10 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:55:56.490 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:55:56.486+0000 7fa39f5b1700 1 -- 172.21.15.46:0/2655043287 >> 172.21.15.46:0/2655043287 conn(0x7fa39806af10 msgr2=0x7fa39806b2e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-05T18:55:56.491 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:55:56.486+0000 7fa39f5b1700 1 -- 172.21.15.46:0/2655043287 shutdown_connections 2023-07-05T18:55:56.491 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:55:56.486+0000 7fa39f5b1700 1 -- 172.21.15.46:0/2655043287 wait complete. 2023-07-05T18:55:56.491 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:55:56.487+0000 7fa39f5b1700 1 Processor -- start 2023-07-05T18:55:56.491 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:55:56.488+0000 7fa39f5b1700 1 -- start start 2023-07-05T18:55:56.493 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:55:56.489+0000 7fa39f5b1700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa384003a00 0x7fa3981f21c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:55:56.494 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:55:56.489+0000 7fa39f5b1700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa3981e5760 0x7fa3980ceeb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:55:56.494 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:55:56.489+0000 7fa39f5b1700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fa3981e5bd0 0x7fa3981f4b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:55:56.494 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:55:56.489+0000 7fa39f5b1700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3980cc450 con 0x7fa3981e5760 2023-07-05T18:55:56.495 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:55:56.489+0000 7fa39f5b1700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3980cc730 con 0x7fa384003a00 2023-07-05T18:55:56.497 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:55:56.489+0000 7fa39f5b1700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa3980cca10 con 0x7fa3981e5bd0 2023-07-05T18:55:56.498 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:55:56.489+0000 7fa39d34d700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa384003a00 0x7fa3981f21c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:55:56.498 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:55:56.489+0000 7fa39cb4c700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa3981e5760 0x7fa3980ceeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:55:56.498 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:55:56.489+0000 7fa39d34d700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa384003a00 0x7fa3981f21c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.46:56624/0 (socket says 172.21.15.46:56624) 2023-07-05T18:55:56.498 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:55:56.489+0000 7fa39d34d700 1 -- 172.21.15.46:0/3874456571 learned_addr learned my addr 172.21.15.46:0/3874456571 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-07-05T18:55:56.499 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:55:56.489+0000 7fa39db4e700 1 --2- 172.21.15.46:0/3874456571 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fa3981e5bd0 0x7fa3981f4b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:55:56.499 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:55:56.489+0000 7fa39cb4c700 1 -- 172.21.15.46:0/3874456571 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fa3981e5bd0 msgr2=0x7fa3981f4b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:55:56.499 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:55:56.489+0000 7fa39cb4c700 1 --2- 172.21.15.46:0/3874456571 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fa3981e5bd0 0x7fa3981f4b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:55:56.500 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:55:56.489+0000 7fa39cb4c700 1 -- 172.21.15.46:0/3874456571 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa384003a00 msgr2=0x7fa3981f21c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:55:56.500 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:55:56.489+0000 7fa39cb4c700 1 --2- 172.21.15.46:0/3874456571 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa384003a00 0x7fa3981f21c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:55:56.500 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:55:56.489+0000 7fa39cb4c700 1 -- 172.21.15.46:0/3874456571 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa3980cccf0 con 0x7fa3981e5760 2023-07-05T18:55:56.501 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:55:56.489+0000 7fa39d34d700 1 --2- 172.21.15.46:0/3874456571 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa384003a00 0x7fa3981f21c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-05T18:55:56.501 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:55:56.489+0000 7fa39cb4c700 1 --2- 172.21.15.46:0/3874456571 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa3981e5760 0x7fa3980ceeb0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7fa398068cf0 tx=0x7fa38800fdc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-05T18:55:56.501 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:55:56.490+0000 7fa38dffb700 1 -- 172.21.15.46:0/3874456571 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa38800fee0 con 0x7fa3981e5760 2023-07-05T18:55:56.501 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:55:56.490+0000 7fa38dffb700 1 -- 172.21.15.46:0/3874456571 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa388001640 con 0x7fa3981e5760 2023-07-05T18:55:56.502 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:55:56.490+0000 7fa39f5b1700 1 -- 172.21.15.46:0/3874456571 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa3980cf930 con 0x7fa3981e5760 2023-07-05T18:55:56.502 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:55:56.490+0000 7fa38dffb700 1 -- 172.21.15.46:0/3874456571 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3880054e0 con 0x7fa3981e5760 2023-07-05T18:55:56.502 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:55:56.491+0000 7fa38dffb700 1 -- 172.21.15.46:0/3874456571 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7fa388003980 con 0x7fa3981e5760 2023-07-05T18:55:56.502 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:55:56.491+0000 7fa39f5b1700 1 -- 172.21.15.46:0/3874456571 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa3980cf3f0 con 0x7fa3981e5760 2023-07-05T18:55:56.502 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:55:56.491+0000 7fa38dffb700 1 -- 172.21.15.46:0/3874456571 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7fa38800dc50 con 0x7fa3981e5760 2023-07-05T18:55:56.502 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:55:56.492+0000 7fa39f5b1700 1 -- 172.21.15.46:0/3874456571 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa39815cb20 con 0x7fa3981e5760 2023-07-05T18:55:56.503 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:55:56.494+0000 7fa38dffb700 1 -- 172.21.15.46:0/3874456571 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72429 (secure 0 0 0) 0x7fa38800de10 con 0x7fa3981e5760 2023-07-05T18:55:56.573 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:55:56.571+0000 7fa39f5b1700 1 -- 172.21.15.46:0/3874456571 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) v1 -- 0x7fa3980672e0 con 0x7fa3981e5760 2023-07-05T18:55:56.578 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:55:56.577+0000 7fa38dffb700 1 -- 172.21.15.46:0/3874456571 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v2) v1 ==== 124+0+0 (secure 0 0 0) 0x7fa38800d5c0 con 0x7fa3981e5760 2023-07-05T18:55:56.580 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:55:56.578+0000 7fa39f5b1700 1 -- 172.21.15.46:0/3874456571 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa3981e5760 msgr2=0x7fa3980ceeb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:55:56.580 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:55:56.578+0000 7fa39f5b1700 1 --2- 172.21.15.46:0/3874456571 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa3981e5760 0x7fa3980ceeb0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7fa398068cf0 tx=0x7fa38800fdc0 comp rx=0 tx=0).stop 2023-07-05T18:55:56.580 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:55:56.578+0000 7fa39f5b1700 1 -- 172.21.15.46:0/3874456571 shutdown_connections 2023-07-05T18:55:56.581 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:55:56.578+0000 7fa39f5b1700 1 --2- 172.21.15.46:0/3874456571 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fa3981e5bd0 0x7fa3981f4b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:55:56.581 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:55:56.578+0000 7fa39f5b1700 1 --2- 172.21.15.46:0/3874456571 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa384003a00 0x7fa3981f21c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:55:56.581 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:55:56.578+0000 7fa39f5b1700 1 --2- 172.21.15.46:0/3874456571 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa3981e5760 0x7fa3980ceeb0 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:55:56.581 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:55:56.578+0000 7fa39f5b1700 1 -- 172.21.15.46:0/3874456571 >> 172.21.15.46:0/3874456571 conn(0x7fa39806af10 msgr2=0x7fa3980b3530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-05T18:55:56.581 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:55:56.578+0000 7fa39f5b1700 1 -- 172.21.15.46:0/3874456571 shutdown_connections 2023-07-05T18:55:56.581 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:55:56.578+0000 7fa39f5b1700 1 -- 172.21.15.46:0/3874456571 wait complete. 2023-07-05T18:55:56.582 INFO:teuthology.orchestra.run.smithi046.stderr:adjusted tunables profile to default 2023-07-05T18:55:56.592 INFO:tasks.ceph:check_enable_crimson: False 2023-07-05T18:55:56.592 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2023-07-05T18:55:56.594 DEBUG:teuthology.orchestra.run.smithi046:> set -ex 2023-07-05T18:55:56.594 DEBUG:teuthology.orchestra.run.smithi046:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2023-07-05T18:55:56.603 INFO:tasks.ceph.mgr.x.smithi073.stderr:2023-07-05T18:55:56.601+0000 7fbd956e1200 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-07-05T18:55:56.609 INFO:tasks.ceph.mgr.y.smithi046.stderr:2023-07-05T18:55:56.606+0000 7fd435390200 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-07-05T18:55:56.621 DEBUG:teuthology.orchestra.run.smithi046:> set -ex 2023-07-05T18:55:56.621 DEBUG:teuthology.orchestra.run.smithi046:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2023-07-05T18:55:56.667 INFO:tasks.ceph.mgr.x.smithi073.stderr:2023-07-05T18:55:56.665+0000 7fbd956e1200 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-07-05T18:55:56.679 INFO:tasks.ceph.mgr.y.smithi046.stderr:2023-07-05T18:55:56.677+0000 7fd435390200 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-07-05T18:55:56.689 DEBUG:teuthology.orchestra.run.smithi046:> set -ex 2023-07-05T18:55:56.690 DEBUG:teuthology.orchestra.run.smithi046:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2023-07-05T18:55:56.742 INFO:tasks.ceph.mgr.x.smithi073.stderr:2023-07-05T18:55:56.740+0000 7fbd956e1200 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-07-05T18:55:56.756 DEBUG:teuthology.orchestra.run.smithi046:> set -ex 2023-07-05T18:55:56.757 DEBUG:teuthology.orchestra.run.smithi046:> sudo dd if=/var/lib/ceph/osd/ceph-3/fsid of=/dev/stdout 2023-07-05T18:55:56.761 INFO:tasks.ceph.mgr.y.smithi046.stderr:2023-07-05T18:55:56.759+0000 7fd435390200 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-07-05T18:55:56.788 DEBUG:teuthology.orchestra.run.smithi073:> set -ex 2023-07-05T18:55:56.789 DEBUG:teuthology.orchestra.run.smithi073:> sudo dd if=/var/lib/ceph/osd/ceph-4/fsid of=/dev/stdout 2023-07-05T18:55:56.819 DEBUG:teuthology.orchestra.run.smithi073:> set -ex 2023-07-05T18:55:56.819 DEBUG:teuthology.orchestra.run.smithi073:> sudo dd if=/var/lib/ceph/osd/ceph-5/fsid of=/dev/stdout 2023-07-05T18:55:56.825 INFO:tasks.ceph.mgr.x.smithi073.stderr:2023-07-05T18:55:56.822+0000 7fbd956e1200 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-07-05T18:55:56.847 INFO:tasks.ceph.mgr.y.smithi046.stderr:2023-07-05T18:55:56.845+0000 7fd435390200 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-07-05T18:55:56.850 DEBUG:teuthology.orchestra.run.smithi073:> set -ex 2023-07-05T18:55:56.851 DEBUG:teuthology.orchestra.run.smithi073:> sudo dd if=/var/lib/ceph/osd/ceph-6/fsid of=/dev/stdout 2023-07-05T18:55:56.917 DEBUG:teuthology.orchestra.run.smithi073:> set -ex 2023-07-05T18:55:56.917 DEBUG:teuthology.orchestra.run.smithi073:> sudo dd if=/var/lib/ceph/osd/ceph-7/fsid of=/dev/stdout 2023-07-05T18:55:56.974 INFO:tasks.ceph.mgr.x.smithi073.stderr:2023-07-05T18:55:56.972+0000 7fbd956e1200 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-07-05T18:55:56.983 DEBUG:teuthology.orchestra.run.smithi073:> sudo ceph --cluster ceph osd new 20009183-9a47-4392-8751-883f88d2bfb1 0 2023-07-05T18:55:57.001 INFO:tasks.ceph.mgr.y.smithi046.stderr:2023-07-05T18:55:56.995+0000 7fd435390200 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-07-05T18:55:57.145 INFO:teuthology.orchestra.run.smithi073.stderr:2023-07-05T18:55:57.143+0000 7fc5675f8700 1 Processor -- start 2023-07-05T18:55:57.145 INFO:teuthology.orchestra.run.smithi073.stderr:2023-07-05T18:55:57.143+0000 7fc5675f8700 1 -- start start 2023-07-05T18:55:57.146 INFO:teuthology.orchestra.run.smithi073.stderr:2023-07-05T18:55:57.144+0000 7fc5675f8700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fc56006bc60 0x7fc5600cd7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:55:57.146 INFO:teuthology.orchestra.run.smithi073.stderr:2023-07-05T18:55:57.144+0000 7fc5675f8700 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc5600cc8c0 con 0x7fc5600afe70 2023-07-05T18:55:57.146 INFO:teuthology.orchestra.run.smithi073.stderr:2023-07-05T18:55:57.144+0000 7fc5675f8700 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc5600ce170 con 0x7fc5600cd410 2023-07-05T18:55:57.146 INFO:teuthology.orchestra.run.smithi073.stderr:2023-07-05T18:55:57.144+0000 7fc5675f8700 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc5600cc300 con 0x7fc56006bc60 2023-07-05T18:55:57.146 INFO:teuthology.orchestra.run.smithi073.stderr:2023-07-05T18:55:57.144+0000 7fc565394700 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7fc5600cd410 0x7fc5600d1440 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:60038/0 (socket says 172.21.15.73:60038) 2023-07-05T18:55:57.146 INFO:teuthology.orchestra.run.smithi073.stderr:2023-07-05T18:55:57.144+0000 7fc565394700 1 -- 172.21.15.73:0/577305792 learned_addr learned my addr 172.21.15.73:0/577305792 (peer_addr_for_me v1:172.21.15.73:0/0) 2023-07-05T18:55:57.146 INFO:teuthology.orchestra.run.smithi073.stderr:2023-07-05T18:55:57.144+0000 7fc565b95700 1 --2- 172.21.15.73:0/577305792 >> v2:172.21.15.73:3300/0 conn(0x7fc56006bc60 0x7fc5600cd7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:55:57.148 INFO:teuthology.orchestra.run.smithi073.stderr:2023-07-05T18:55:57.145+0000 7fc557fff700 1 -- 172.21.15.73:0/577305792 <== mon.1 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3649034167 0 0) 0x7fc5600ce170 con 0x7fc5600cd410 2023-07-05T18:55:57.148 INFO:teuthology.orchestra.run.smithi073.stderr:2023-07-05T18:55:57.145+0000 7fc557fff700 1 -- 172.21.15.73:0/577305792 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc54c0035b0 con 0x7fc5600cd410 2023-07-05T18:55:57.148 INFO:teuthology.orchestra.run.smithi073.stderr:2023-07-05T18:55:57.145+0000 7fc557fff700 1 -- 172.21.15.73:0/577305792 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3938592852 0 0) 0x7fc5600cc8c0 con 0x7fc5600afe70 2023-07-05T18:55:57.148 INFO:teuthology.orchestra.run.smithi073.stderr:2023-07-05T18:55:57.145+0000 7fc557fff700 1 -- 172.21.15.73:0/577305792 --> v1:172.21.15.46:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc5600ce170 con 0x7fc5600afe70 2023-07-05T18:55:57.148 INFO:teuthology.orchestra.run.smithi073.stderr:2023-07-05T18:55:57.145+0000 7fc565b95700 1 -- 172.21.15.73:0/577305792 >> v1:172.21.15.73:6789/0 conn(0x7fc5600cd410 legacy=0x7fc5600d1440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:55:57.149 INFO:teuthology.orchestra.run.smithi073.stderr:2023-07-05T18:55:57.145+0000 7fc565b95700 1 -- 172.21.15.73:0/577305792 >> v1:172.21.15.46:6789/0 conn(0x7fc5600afe70 legacy=0x7fc5600cb170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:55:57.149 INFO:teuthology.orchestra.run.smithi073.stderr:2023-07-05T18:55:57.145+0000 7fc565b95700 1 -- 172.21.15.73:0/577305792 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc5600cc5e0 con 0x7fc56006bc60 2023-07-05T18:55:57.149 INFO:teuthology.orchestra.run.smithi073.stderr:2023-07-05T18:55:57.145+0000 7fc565b95700 1 --2- 172.21.15.73:0/577305792 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc56006bc60 0x7fc5600cd7e0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fc558009d90 tx=0x7fc55800b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=bc1380bdd8873f08 server_cookie=0 in_seq=0 out_seq=0 2023-07-05T18:55:57.149 INFO:teuthology.orchestra.run.smithi073.stderr:2023-07-05T18:55:57.145+0000 7fc557fff700 1 -- 172.21.15.73:0/577305792 <== mon.1 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc55800e070 con 0x7fc56006bc60 2023-07-05T18:55:57.149 INFO:teuthology.orchestra.run.smithi073.stderr:2023-07-05T18:55:57.145+0000 7fc557fff700 1 -- 172.21.15.73:0/577305792 <== mon.1 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc55800bb20 con 0x7fc56006bc60 2023-07-05T18:55:57.149 INFO:teuthology.orchestra.run.smithi073.stderr:2023-07-05T18:55:57.145+0000 7fc557fff700 1 -- 172.21.15.73:0/577305792 <== mon.1 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc558012430 con 0x7fc56006bc60 2023-07-05T18:55:57.149 INFO:teuthology.orchestra.run.smithi073.stderr:2023-07-05T18:55:57.145+0000 7fc5675f8700 1 -- 172.21.15.73:0/577305792 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc56006bc60 msgr2=0x7fc5600cd7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:55:57.150 INFO:teuthology.orchestra.run.smithi073.stderr:2023-07-05T18:55:57.145+0000 7fc5675f8700 1 --2- 172.21.15.73:0/577305792 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc56006bc60 0x7fc5600cd7e0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fc558009d90 tx=0x7fc55800b330 comp rx=0 tx=0).stop 2023-07-05T18:55:57.150 INFO:teuthology.orchestra.run.smithi073.stderr:2023-07-05T18:55:57.146+0000 7fc5675f8700 1 -- 172.21.15.73:0/577305792 shutdown_connections 2023-07-05T18:55:57.150 INFO:teuthology.orchestra.run.smithi073.stderr:2023-07-05T18:55:57.146+0000 7fc5675f8700 1 --2- 172.21.15.73:0/577305792 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc56006bc60 0x7fc5600cd7e0 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:55:57.150 INFO:teuthology.orchestra.run.smithi073.stderr:2023-07-05T18:55:57.146+0000 7fc5675f8700 1 -- 172.21.15.73:0/577305792 >> 172.21.15.73:0/577305792 conn(0x7fc560099e00 msgr2=0x7fc5600d0b20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-05T18:55:57.150 INFO:teuthology.orchestra.run.smithi073.stderr:2023-07-05T18:55:57.146+0000 7fc5675f8700 1 -- 172.21.15.73:0/577305792 shutdown_connections 2023-07-05T18:55:57.150 INFO:teuthology.orchestra.run.smithi073.stderr:2023-07-05T18:55:57.146+0000 7fc5675f8700 1 -- 172.21.15.73:0/577305792 wait complete. 2023-07-05T18:55:57.152 INFO:teuthology.orchestra.run.smithi073.stderr:2023-07-05T18:55:57.147+0000 7fc5675f8700 1 Processor -- start 2023-07-05T18:55:57.152 INFO:teuthology.orchestra.run.smithi073.stderr:2023-07-05T18:55:57.147+0000 7fc5675f8700 1 -- start start 2023-07-05T18:55:57.152 INFO:teuthology.orchestra.run.smithi073.stderr:2023-07-05T18:55:57.147+0000 7fc5675f8700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc56006bc60 0x7fc5601488c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:55:57.153 INFO:teuthology.orchestra.run.smithi073.stderr:2023-07-05T18:55:57.147+0000 7fc5675f8700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fc5600afe70 0x7fc5600ca550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:55:57.153 INFO:teuthology.orchestra.run.smithi073.stderr:2023-07-05T18:55:57.148+0000 7fc5675f8700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc5600cd410 0x7fc560149080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:55:57.153 INFO:teuthology.orchestra.run.smithi073.stderr:2023-07-05T18:55:57.148+0000 7fc5675f8700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc5600b6960 con 0x7fc56006bc60 2023-07-05T18:55:57.153 INFO:teuthology.orchestra.run.smithi073.stderr:2023-07-05T18:55:57.148+0000 7fc5675f8700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc5600ae070 con 0x7fc5600cd410 2023-07-05T18:55:57.153 INFO:teuthology.orchestra.run.smithi073.stderr:2023-07-05T18:55:57.148+0000 7fc5675f8700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc560148e00 con 0x7fc5600afe70 2023-07-05T18:55:57.153 INFO:teuthology.orchestra.run.smithi073.stderr:2023-07-05T18:55:57.148+0000 7fc565b95700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc5600cd410 0x7fc560149080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:55:57.153 INFO:teuthology.orchestra.run.smithi073.stderr:2023-07-05T18:55:57.148+0000 7fc565b95700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc5600cd410 0x7fc560149080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:40504/0 (socket says 172.21.15.73:40504) 2023-07-05T18:55:57.153 INFO:teuthology.orchestra.run.smithi073.stderr:2023-07-05T18:55:57.148+0000 7fc565b95700 1 -- 172.21.15.73:0/887162327 learned_addr learned my addr 172.21.15.73:0/887162327 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-07-05T18:55:57.154 INFO:teuthology.orchestra.run.smithi073.stderr:2023-07-05T18:55:57.148+0000 7fc564b93700 1 --2- 172.21.15.73:0/887162327 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fc5600afe70 0x7fc5600ca550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:55:57.154 INFO:teuthology.orchestra.run.smithi073.stderr:2023-07-05T18:55:57.148+0000 7fc565394700 1 --2- 172.21.15.73:0/887162327 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc56006bc60 0x7fc5601488c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:55:57.154 INFO:teuthology.orchestra.run.smithi073.stderr:2023-07-05T18:55:57.148+0000 7fc565b95700 1 -- 172.21.15.73:0/887162327 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fc5600afe70 msgr2=0x7fc5600ca550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:55:57.154 INFO:teuthology.orchestra.run.smithi073.stderr:2023-07-05T18:55:57.148+0000 7fc565b95700 1 --2- 172.21.15.73:0/887162327 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fc5600afe70 0x7fc5600ca550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:55:57.154 INFO:teuthology.orchestra.run.smithi073.stderr:2023-07-05T18:55:57.148+0000 7fc565b95700 1 -- 172.21.15.73:0/887162327 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc56006bc60 msgr2=0x7fc5601488c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:55:57.154 INFO:teuthology.orchestra.run.smithi073.stderr:2023-07-05T18:55:57.148+0000 7fc565b95700 1 --2- 172.21.15.73:0/887162327 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc56006bc60 0x7fc5601488c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:55:57.154 INFO:teuthology.orchestra.run.smithi073.stderr:2023-07-05T18:55:57.148+0000 7fc565b95700 1 -- 172.21.15.73:0/887162327 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc558009a70 con 0x7fc5600cd410 2023-07-05T18:55:57.155 INFO:teuthology.orchestra.run.smithi073.stderr:2023-07-05T18:55:57.148+0000 7fc565b95700 1 --2- 172.21.15.73:0/887162327 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc5600cd410 0x7fc560149080 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fc55800b680 tx=0x7fc558004ad0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-05T18:55:57.155 INFO:teuthology.orchestra.run.smithi073.stderr:2023-07-05T18:55:57.148+0000 7fc555ffb700 1 -- 172.21.15.73:0/887162327 <== mon.1 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc55801c810 con 0x7fc5600cd410 2023-07-05T18:55:57.155 INFO:teuthology.orchestra.run.smithi073.stderr:2023-07-05T18:55:57.148+0000 7fc555ffb700 1 -- 172.21.15.73:0/887162327 <== mon.1 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc558020070 con 0x7fc5600cd410 2023-07-05T18:55:57.155 INFO:teuthology.orchestra.run.smithi073.stderr:2023-07-05T18:55:57.148+0000 7fc5675f8700 1 -- 172.21.15.73:0/887162327 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc5600caa90 con 0x7fc5600cd410 2023-07-05T18:55:57.155 INFO:teuthology.orchestra.run.smithi073.stderr:2023-07-05T18:55:57.148+0000 7fc555ffb700 1 -- 172.21.15.73:0/887162327 <== mon.1 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc55801cbb0 con 0x7fc5600cd410 2023-07-05T18:55:57.155 INFO:teuthology.orchestra.run.smithi073.stderr:2023-07-05T18:55:57.148+0000 7fc5675f8700 1 -- 172.21.15.73:0/887162327 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc5600ae310 con 0x7fc5600cd410 2023-07-05T18:55:57.155 INFO:teuthology.orchestra.run.smithi073.stderr:2023-07-05T18:55:57.149+0000 7fc555ffb700 1 -- 172.21.15.73:0/887162327 <== mon.1 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7fc558027780 con 0x7fc5600cd410 2023-07-05T18:55:57.155 INFO:teuthology.orchestra.run.smithi073.stderr:2023-07-05T18:55:57.149+0000 7fc555ffb700 1 -- 172.21.15.73:0/887162327 <== mon.1 v2:172.21.15.73:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 725+0+0 (secure 0 0 0) 0x7fc558022070 con 0x7fc5600cd410 2023-07-05T18:55:57.156 INFO:teuthology.orchestra.run.smithi073.stderr:2023-07-05T18:55:57.149+0000 7fc5675f8700 1 -- 172.21.15.73:0/887162327 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc5600672e0 con 0x7fc5600cd410 2023-07-05T18:55:57.156 INFO:teuthology.orchestra.run.smithi073.stderr:2023-07-05T18:55:57.153+0000 7fc555ffb700 1 -- 172.21.15.73:0/887162327 <== mon.1 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72429 (secure 0 0 0) 0x7fc558027c10 con 0x7fc5600cd410 2023-07-05T18:55:57.238 INFO:teuthology.orchestra.run.smithi073.stderr:2023-07-05T18:55:57.236+0000 7fc5675f8700 1 -- 172.21.15.73:0/887162327 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd new", "uuid": "20009183-9a47-4392-8751-883f88d2bfb1", "id": 0} v 0) v1 -- 0x7fc56006c5c0 con 0x7fc5600cd410 2023-07-05T18:55:57.241 INFO:teuthology.orchestra.run.smithi073.stderr:2023-07-05T18:55:57.239+0000 7fc555ffb700 1 -- 172.21.15.73:0/887162327 <== mon.1 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "20009183-9a47-4392-8751-883f88d2bfb1", "id": 0}]=0 v3) v1 ==== 112+0+2 (secure 0 0 0) 0x7fc558027db0 con 0x7fc5600cd410 2023-07-05T18:55:57.242 INFO:teuthology.orchestra.run.smithi073.stdout:0 2023-07-05T18:55:57.243 INFO:teuthology.orchestra.run.smithi073.stderr:2023-07-05T18:55:57.240+0000 7fc5675f8700 1 -- 172.21.15.73:0/887162327 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc5600cd410 msgr2=0x7fc560149080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:55:57.243 INFO:teuthology.orchestra.run.smithi073.stderr:2023-07-05T18:55:57.240+0000 7fc5675f8700 1 --2- 172.21.15.73:0/887162327 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc5600cd410 0x7fc560149080 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fc55800b680 tx=0x7fc558004ad0 comp rx=0 tx=0).stop 2023-07-05T18:55:57.243 INFO:teuthology.orchestra.run.smithi073.stderr:2023-07-05T18:55:57.240+0000 7fc5675f8700 1 -- 172.21.15.73:0/887162327 shutdown_connections 2023-07-05T18:55:57.243 INFO:teuthology.orchestra.run.smithi073.stderr:2023-07-05T18:55:57.240+0000 7fc5675f8700 1 --2- 172.21.15.73:0/887162327 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc5600cd410 0x7fc560149080 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:55:57.243 INFO:teuthology.orchestra.run.smithi073.stderr:2023-07-05T18:55:57.240+0000 7fc5675f8700 1 --2- 172.21.15.73:0/887162327 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc56006bc60 0x7fc5601488c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:55:57.243 INFO:teuthology.orchestra.run.smithi073.stderr:2023-07-05T18:55:57.240+0000 7fc5675f8700 1 --2- 172.21.15.73:0/887162327 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fc5600afe70 0x7fc5600ca550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:55:57.244 INFO:teuthology.orchestra.run.smithi073.stderr:2023-07-05T18:55:57.240+0000 7fc5675f8700 1 -- 172.21.15.73:0/887162327 >> 172.21.15.73:0/887162327 conn(0x7fc560099e00 msgr2=0x7fc5600cef00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-05T18:55:57.251 INFO:teuthology.orchestra.run.smithi073.stderr:2023-07-05T18:55:57.240+0000 7fc5675f8700 1 -- 172.21.15.73:0/887162327 shutdown_connections 2023-07-05T18:55:57.251 INFO:teuthology.orchestra.run.smithi073.stderr:2023-07-05T18:55:57.240+0000 7fc5675f8700 1 -- 172.21.15.73:0/887162327 wait complete. 2023-07-05T18:55:57.254 DEBUG:teuthology.orchestra.run.smithi073:> sudo ceph --cluster ceph osd new 91b4a7b0-e4e4-4888-a1fe-9edb0d68004c 1 2023-07-05T18:55:57.319 INFO:tasks.ceph.mgr.x.smithi073.stderr:2023-07-05T18:55:57.318+0000 7fbd956e1200 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-07-05T18:55:57.353 INFO:tasks.ceph.mgr.y.smithi046.stderr:2023-07-05T18:55:57.350+0000 7fd435390200 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-07-05T18:55:57.376 INFO:teuthology.orchestra.run.smithi073.stderr:2023-07-05T18:55:57.374+0000 7fa030eff700 1 Processor -- start 2023-07-05T18:55:57.376 INFO:teuthology.orchestra.run.smithi073.stderr:2023-07-05T18:55:57.374+0000 7fa030eff700 1 -- start start 2023-07-05T18:55:57.377 INFO:teuthology.orchestra.run.smithi073.stderr:2023-07-05T18:55:57.375+0000 7fa030eff700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fa02c15c990 0x7fa02c0cc120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:55:57.378 INFO:teuthology.orchestra.run.smithi073.stderr:2023-07-05T18:55:57.375+0000 7fa030eff700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fa02c0cc660 0x7fa02c0ce9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:55:57.378 INFO:teuthology.orchestra.run.smithi073.stderr:2023-07-05T18:55:57.375+0000 7fa030eff700 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa02c06b0b0 con 0x7fa02c0ceef0 2023-07-05T18:55:57.378 INFO:teuthology.orchestra.run.smithi073.stderr:2023-07-05T18:55:57.375+0000 7fa030eff700 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa02c0cf370 con 0x7fa02c15c990 2023-07-05T18:55:57.378 INFO:teuthology.orchestra.run.smithi073.stderr:2023-07-05T18:55:57.375+0000 7fa030eff700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa02c06ad80 con 0x7fa02c0cc660 2023-07-05T18:55:57.378 INFO:teuthology.orchestra.run.smithi073.stderr:2023-07-05T18:55:57.375+0000 7fa029d9b700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fa02c0cc660 0x7fa02c0ce9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:55:57.380 INFO:teuthology.orchestra.run.smithi073.stderr:2023-07-05T18:55:57.375+0000 7fa029d9b700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fa02c0cc660 0x7fa02c0ce9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3301/0 says I am v2:172.21.15.73:42860/0 (socket says 172.21.15.73:42860) 2023-07-05T18:55:57.380 INFO:teuthology.orchestra.run.smithi073.stderr:2023-07-05T18:55:57.375+0000 7fa029d9b700 1 -- 172.21.15.73:0/2045124504 learned_addr learned my addr 172.21.15.73:0/2045124504 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-07-05T18:55:57.381 INFO:teuthology.orchestra.run.smithi073.stderr:2023-07-05T18:55:57.375+0000 7fa02a59c700 1 --2- 172.21.15.73:0/2045124504 >> v2:172.21.15.46:3300/0 conn(0x7fa02c15c990 0x7fa02c0cc120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:55:57.381 INFO:teuthology.orchestra.run.smithi073.stderr:2023-07-05T18:55:57.376+0000 7fa029d9b700 1 -- 172.21.15.73:0/2045124504 >> v2:172.21.15.46:3300/0 conn(0x7fa02c15c990 msgr2=0x7fa02c0cc120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-05T18:55:57.381 INFO:teuthology.orchestra.run.smithi073.stderr:2023-07-05T18:55:57.376+0000 7fa029d9b700 1 --2- 172.21.15.73:0/2045124504 >> v2:172.21.15.46:3300/0 conn(0x7fa02c15c990 0x7fa02c0cc120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:55:57.382 INFO:teuthology.orchestra.run.smithi073.stderr:2023-07-05T18:55:57.376+0000 7fa029d9b700 1 -- 172.21.15.73:0/2045124504 >> v1:172.21.15.46:6789/0 conn(0x7fa02c0ceef0 legacy=0x7fa02c0cd110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:55:57.382 INFO:teuthology.orchestra.run.smithi073.stderr:2023-07-05T18:55:57.376+0000 7fa029d9b700 1 -- 172.21.15.73:0/2045124504 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa02c0ccb50 con 0x7fa02c0cc660 2023-07-05T18:55:57.382 INFO:teuthology.orchestra.run.smithi073.stderr:2023-07-05T18:55:57.376+0000 7fa029d9b700 1 --2- 172.21.15.73:0/2045124504 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fa02c0cc660 0x7fa02c0ce9b0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fa0200098f0 tx=0x7fa020009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2a8620c0ed88e9b5 server_cookie=0 in_seq=0 out_seq=0 2023-07-05T18:55:57.383 INFO:teuthology.orchestra.run.smithi073.stderr:2023-07-05T18:55:57.376+0000 7fa02959a700 1 -- 172.21.15.73:0/2045124504 <== mon.2 v2:172.21.15.73:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa020011830 con 0x7fa02c0cc660 2023-07-05T18:55:57.383 INFO:teuthology.orchestra.run.smithi073.stderr:2023-07-05T18:55:57.376+0000 7fa02959a700 1 -- 172.21.15.73:0/2045124504 <== mon.2 v2:172.21.15.73:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa020011990 con 0x7fa02c0cc660 2023-07-05T18:55:57.383 INFO:teuthology.orchestra.run.smithi073.stderr:2023-07-05T18:55:57.376+0000 7fa02959a700 1 -- 172.21.15.73:0/2045124504 <== mon.2 v2:172.21.15.73:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa020011d20 con 0x7fa02c0cc660 2023-07-05T18:55:57.388 INFO:teuthology.orchestra.run.smithi073.stderr:2023-07-05T18:55:57.376+0000 7fa030eff700 1 -- 172.21.15.73:0/2045124504 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fa02c0cc660 msgr2=0x7fa02c0ce9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:55:57.388 INFO:teuthology.orchestra.run.smithi073.stderr:2023-07-05T18:55:57.376+0000 7fa030eff700 1 --2- 172.21.15.73:0/2045124504 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fa02c0cc660 0x7fa02c0ce9b0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fa0200098f0 tx=0x7fa020009c00 comp rx=0 tx=0).stop 2023-07-05T18:55:57.389 INFO:teuthology.orchestra.run.smithi073.stderr:2023-07-05T18:55:57.377+0000 7fa030eff700 1 -- 172.21.15.73:0/2045124504 shutdown_connections 2023-07-05T18:55:57.389 INFO:teuthology.orchestra.run.smithi073.stderr:2023-07-05T18:55:57.377+0000 7fa030eff700 1 --2- 172.21.15.73:0/2045124504 >> v2:172.21.15.46:3300/0 conn(0x7fa02c15c990 0x7fa02c0cc120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:55:57.389 INFO:teuthology.orchestra.run.smithi073.stderr:2023-07-05T18:55:57.377+0000 7fa030eff700 1 --2- 172.21.15.73:0/2045124504 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fa02c0cc660 0x7fa02c0ce9b0 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:55:57.389 INFO:teuthology.orchestra.run.smithi073.stderr:2023-07-05T18:55:57.377+0000 7fa030eff700 1 -- 172.21.15.73:0/2045124504 >> 172.21.15.73:0/2045124504 conn(0x7fa02c099e00 msgr2=0x7fa02c0d0ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-05T18:55:57.389 INFO:teuthology.orchestra.run.smithi073.stderr:2023-07-05T18:55:57.377+0000 7fa030eff700 1 -- 172.21.15.73:0/2045124504 shutdown_connections 2023-07-05T18:55:57.389 INFO:teuthology.orchestra.run.smithi073.stderr:2023-07-05T18:55:57.377+0000 7fa030eff700 1 -- 172.21.15.73:0/2045124504 wait complete. 2023-07-05T18:55:57.390 INFO:teuthology.orchestra.run.smithi073.stderr:2023-07-05T18:55:57.378+0000 7fa030eff700 1 Processor -- start 2023-07-05T18:55:57.390 INFO:teuthology.orchestra.run.smithi073.stderr:2023-07-05T18:55:57.378+0000 7fa030eff700 1 -- start start 2023-07-05T18:55:57.390 INFO:teuthology.orchestra.run.smithi073.stderr:2023-07-05T18:55:57.379+0000 7fa030eff700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fa02c0cc660 0x7fa02c157c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:55:57.390 INFO:teuthology.orchestra.run.smithi073.stderr:2023-07-05T18:55:57.379+0000 7fa030eff700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa02c0ceef0 0x7fa02c15a370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:55:57.390 INFO:teuthology.orchestra.run.smithi073.stderr:2023-07-05T18:55:57.379+0000 7fa030eff700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa02c15c990 0x7fa02c06c1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:55:57.390 INFO:teuthology.orchestra.run.smithi073.stderr:2023-07-05T18:55:57.379+0000 7fa030eff700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa02c159690 con 0x7fa02c15c990 2023-07-05T18:55:57.390 INFO:teuthology.orchestra.run.smithi073.stderr:2023-07-05T18:55:57.379+0000 7fa030eff700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa02c0c4740 con 0x7fa02c0ceef0 2023-07-05T18:55:57.390 INFO:teuthology.orchestra.run.smithi073.stderr:2023-07-05T18:55:57.379+0000 7fa030eff700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa02c158a10 con 0x7fa02c0cc660 2023-07-05T18:55:57.391 INFO:teuthology.orchestra.run.smithi073.stderr:2023-07-05T18:55:57.379+0000 7fa02a59c700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fa02c0cc660 0x7fa02c157c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:55:57.391 INFO:teuthology.orchestra.run.smithi073.stderr:2023-07-05T18:55:57.379+0000 7fa029d9b700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa02c0ceef0 0x7fa02c15a370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:55:57.391 INFO:teuthology.orchestra.run.smithi073.stderr:2023-07-05T18:55:57.379+0000 7fa029d9b700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa02c0ceef0 0x7fa02c15a370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:40514/0 (socket says 172.21.15.73:40514) 2023-07-05T18:55:57.391 INFO:teuthology.orchestra.run.smithi073.stderr:2023-07-05T18:55:57.379+0000 7fa02a59c700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fa02c0cc660 0x7fa02c157c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3301/0 says I am v2:172.21.15.73:42864/0 (socket says 172.21.15.73:42864) 2023-07-05T18:55:57.391 INFO:teuthology.orchestra.run.smithi073.stderr:2023-07-05T18:55:57.379+0000 7fa029d9b700 1 -- 172.21.15.73:0/2663407130 learned_addr learned my addr 172.21.15.73:0/2663407130 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-07-05T18:55:57.391 INFO:teuthology.orchestra.run.smithi073.stderr:2023-07-05T18:55:57.380+0000 7fa02ad9d700 1 --2- 172.21.15.73:0/2663407130 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa02c15c990 0x7fa02c06c1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:55:57.391 INFO:teuthology.orchestra.run.smithi073.stderr:2023-07-05T18:55:57.380+0000 7fa029d9b700 1 -- 172.21.15.73:0/2663407130 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fa02c0cc660 msgr2=0x7fa02c157c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:55:57.392 INFO:teuthology.orchestra.run.smithi073.stderr:2023-07-05T18:55:57.380+0000 7fa029d9b700 1 --2- 172.21.15.73:0/2663407130 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fa02c0cc660 0x7fa02c157c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:55:57.392 INFO:teuthology.orchestra.run.smithi073.stderr:2023-07-05T18:55:57.380+0000 7fa029d9b700 1 -- 172.21.15.73:0/2663407130 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa02c15c990 msgr2=0x7fa02c06c1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:55:57.392 INFO:teuthology.orchestra.run.smithi073.stderr:2023-07-05T18:55:57.380+0000 7fa029d9b700 1 --2- 172.21.15.73:0/2663407130 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa02c15c990 0x7fa02c06c1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:55:57.392 INFO:teuthology.orchestra.run.smithi073.stderr:2023-07-05T18:55:57.380+0000 7fa029d9b700 1 -- 172.21.15.73:0/2663407130 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa020009550 con 0x7fa02c0ceef0 2023-07-05T18:55:57.392 INFO:teuthology.orchestra.run.smithi073.stderr:2023-07-05T18:55:57.380+0000 7fa029d9b700 1 --2- 172.21.15.73:0/2663407130 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa02c0ceef0 0x7fa02c15a370 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7fa020000c00 tx=0x7fa020004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-05T18:55:57.392 INFO:teuthology.orchestra.run.smithi073.stderr:2023-07-05T18:55:57.380+0000 7fa01affd700 1 -- 172.21.15.73:0/2663407130 <== mon.1 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa020004400 con 0x7fa02c0ceef0 2023-07-05T18:55:57.392 INFO:teuthology.orchestra.run.smithi073.stderr:2023-07-05T18:55:57.380+0000 7fa01affd700 1 -- 172.21.15.73:0/2663407130 <== mon.1 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa02001f070 con 0x7fa02c0ceef0 2023-07-05T18:55:57.392 INFO:teuthology.orchestra.run.smithi073.stderr:2023-07-05T18:55:57.380+0000 7fa030eff700 1 -- 172.21.15.73:0/2663407130 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa02c158cf0 con 0x7fa02c0ceef0 2023-07-05T18:55:57.393 INFO:teuthology.orchestra.run.smithi073.stderr:2023-07-05T18:55:57.380+0000 7fa01affd700 1 -- 172.21.15.73:0/2663407130 <== mon.1 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0200038e0 con 0x7fa02c0ceef0 2023-07-05T18:55:57.393 INFO:teuthology.orchestra.run.smithi073.stderr:2023-07-05T18:55:57.380+0000 7fa030eff700 1 -- 172.21.15.73:0/2663407130 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa02c1592b0 con 0x7fa02c0ceef0 2023-07-05T18:55:57.393 INFO:teuthology.orchestra.run.smithi073.stderr:2023-07-05T18:55:57.380+0000 7fa01affd700 1 -- 172.21.15.73:0/2663407130 <== mon.1 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7fa020021030 con 0x7fa02c0ceef0 2023-07-05T18:55:57.393 INFO:teuthology.orchestra.run.smithi073.stderr:2023-07-05T18:55:57.380+0000 7fa01affd700 1 -- 172.21.15.73:0/2663407130 <== mon.1 v2:172.21.15.73:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 840+0+0 (secure 0 0 0) 0x7fa02001a990 con 0x7fa02c0ceef0 2023-07-05T18:55:57.393 INFO:teuthology.orchestra.run.smithi073.stderr:2023-07-05T18:55:57.381+0000 7fa030eff700 1 -- 172.21.15.73:0/2663407130 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa02c1597d0 con 0x7fa02c0ceef0 2023-07-05T18:55:57.393 INFO:teuthology.orchestra.run.smithi073.stderr:2023-07-05T18:55:57.383+0000 7fa01affd700 1 -- 172.21.15.73:0/2663407130 <== mon.1 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72429 (secure 0 0 0) 0x7fa02c1597d0 con 0x7fa02c0ceef0 2023-07-05T18:55:57.400 INFO:tasks.ceph.mgr.x.smithi073.stderr:2023-07-05T18:55:57.397+0000 7fbd956e1200 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-07-05T18:55:57.432 INFO:tasks.ceph.mgr.y.smithi046.stderr:2023-07-05T18:55:57.430+0000 7fd435390200 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-07-05T18:55:57.469 INFO:teuthology.orchestra.run.smithi073.stderr:2023-07-05T18:55:57.467+0000 7fa030eff700 1 -- 172.21.15.73:0/2663407130 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd new", "uuid": "91b4a7b0-e4e4-4888-a1fe-9edb0d68004c", "id": 1} v 0) v1 -- 0x7fa02c0672e0 con 0x7fa02c0ceef0 2023-07-05T18:55:57.472 INFO:teuthology.orchestra.run.smithi073.stderr:2023-07-05T18:55:57.470+0000 7fa01affd700 1 -- 172.21.15.73:0/2663407130 <== mon.1 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "91b4a7b0-e4e4-4888-a1fe-9edb0d68004c", "id": 1}]=0 v4) v1 ==== 112+0+2 (secure 0 0 0) 0x7fa020015020 con 0x7fa02c0ceef0 2023-07-05T18:55:57.472 INFO:teuthology.orchestra.run.smithi073.stdout:1 2023-07-05T18:55:57.473 INFO:teuthology.orchestra.run.smithi073.stderr:2023-07-05T18:55:57.471+0000 7fa030eff700 1 -- 172.21.15.73:0/2663407130 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa02c0ceef0 msgr2=0x7fa02c15a370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:55:57.473 INFO:teuthology.orchestra.run.smithi073.stderr:2023-07-05T18:55:57.471+0000 7fa030eff700 1 --2- 172.21.15.73:0/2663407130 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa02c0ceef0 0x7fa02c15a370 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7fa020000c00 tx=0x7fa020004750 comp rx=0 tx=0).stop 2023-07-05T18:55:57.473 INFO:teuthology.orchestra.run.smithi073.stderr:2023-07-05T18:55:57.471+0000 7fa030eff700 1 -- 172.21.15.73:0/2663407130 shutdown_connections 2023-07-05T18:55:57.474 INFO:teuthology.orchestra.run.smithi073.stderr:2023-07-05T18:55:57.471+0000 7fa030eff700 1 --2- 172.21.15.73:0/2663407130 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa02c15c990 0x7fa02c06c1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:55:57.474 INFO:teuthology.orchestra.run.smithi073.stderr:2023-07-05T18:55:57.471+0000 7fa030eff700 1 --2- 172.21.15.73:0/2663407130 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fa02c0cc660 0x7fa02c157c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:55:57.474 INFO:teuthology.orchestra.run.smithi073.stderr:2023-07-05T18:55:57.471+0000 7fa030eff700 1 --2- 172.21.15.73:0/2663407130 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa02c0ceef0 0x7fa02c15a370 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:55:57.474 INFO:teuthology.orchestra.run.smithi073.stderr:2023-07-05T18:55:57.471+0000 7fa030eff700 1 -- 172.21.15.73:0/2663407130 >> 172.21.15.73:0/2663407130 conn(0x7fa02c099e00 msgr2=0x7fa02c06d7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-05T18:55:57.474 INFO:teuthology.orchestra.run.smithi073.stderr:2023-07-05T18:55:57.471+0000 7fa030eff700 1 -- 172.21.15.73:0/2663407130 shutdown_connections 2023-07-05T18:55:57.474 INFO:teuthology.orchestra.run.smithi073.stderr:2023-07-05T18:55:57.471+0000 7fa030eff700 1 -- 172.21.15.73:0/2663407130 wait complete. 2023-07-05T18:55:57.485 DEBUG:teuthology.orchestra.run.smithi073:> sudo ceph --cluster ceph osd new 669ff744-1331-47c5-8579-0440731c889a 2 2023-07-05T18:55:57.534 INFO:tasks.ceph.mgr.x.smithi073.stderr:2023-07-05T18:55:57.532+0000 7fbd956e1200 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-07-05T18:55:57.563 INFO:tasks.ceph.mgr.y.smithi046.stderr:2023-07-05T18:55:57.560+0000 7fd435390200 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-07-05T18:55:57.606 INFO:teuthology.orchestra.run.smithi073.stderr:2023-07-05T18:55:57.604+0000 7fdb09d5d700 1 Processor -- start 2023-07-05T18:55:57.607 INFO:teuthology.orchestra.run.smithi073.stderr:2023-07-05T18:55:57.604+0000 7fdb09d5d700 1 -- start start 2023-07-05T18:55:57.608 INFO:teuthology.orchestra.run.smithi073.stderr:2023-07-05T18:55:57.605+0000 7fdb09d5d700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fdb0413f4c0 0x7fdb0415d6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:55:57.608 INFO:teuthology.orchestra.run.smithi073.stderr:2023-07-05T18:55:57.605+0000 7fdb09d5d700 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdb0415dbe0 con 0x7fdb0406d140 2023-07-05T18:55:57.608 INFO:teuthology.orchestra.run.smithi073.stderr:2023-07-05T18:55:57.605+0000 7fdb09d5d700 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdb0406c8d0 con 0x7fdb04142480 2023-07-05T18:55:57.608 INFO:teuthology.orchestra.run.smithi073.stderr:2023-07-05T18:55:57.605+0000 7fdb09d5d700 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdb0406ce90 con 0x7fdb0413f4c0 2023-07-05T18:55:57.608 INFO:teuthology.orchestra.run.smithi073.stderr:2023-07-05T18:55:57.605+0000 7fdb037fe700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fdb0413f4c0 0x7fdb0415d6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:55:57.609 INFO:teuthology.orchestra.run.smithi073.stderr:2023-07-05T18:55:57.605+0000 7fdb02ffd700 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7fdb04142480 0x7fdb040b41d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:60064/0 (socket says 172.21.15.73:60064) 2023-07-05T18:55:57.609 INFO:teuthology.orchestra.run.smithi073.stderr:2023-07-05T18:55:57.605+0000 7fdb02ffd700 1 -- 172.21.15.73:0/350342936 learned_addr learned my addr 172.21.15.73:0/350342936 (peer_addr_for_me v1:172.21.15.73:0/0) 2023-07-05T18:55:57.611 INFO:teuthology.orchestra.run.smithi073.stderr:2023-07-05T18:55:57.606+0000 7fdb037fe700 1 -- 172.21.15.73:0/350342936 >> v1:172.21.15.73:6789/0 conn(0x7fdb04142480 legacy=0x7fdb040b41d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:55:57.611 INFO:teuthology.orchestra.run.smithi073.stderr:2023-07-05T18:55:57.606+0000 7fdb037fe700 1 -- 172.21.15.73:0/350342936 >> v1:172.21.15.46:6789/0 conn(0x7fdb0406d140 legacy=0x7fdb0413fdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:55:57.611 INFO:teuthology.orchestra.run.smithi073.stderr:2023-07-05T18:55:57.606+0000 7fdb037fe700 1 -- 172.21.15.73:0/350342936 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdb0406cbb0 con 0x7fdb0413f4c0 2023-07-05T18:55:57.612 INFO:teuthology.orchestra.run.smithi073.stderr:2023-07-05T18:55:57.606+0000 7fdb027fc700 1 -- 172.21.15.73:0/350342936 <== mon.1 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 745859605 0 0) 0x7fdb0406c8d0 con 0x7fdb04142480 2023-07-05T18:55:57.612 INFO:teuthology.orchestra.run.smithi073.stderr:2023-07-05T18:55:57.606+0000 7fdb037fe700 1 --2- 172.21.15.73:0/350342936 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fdb0413f4c0 0x7fdb0415d6a0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7fdaf4009840 tx=0x7fdaf4009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=58198b068987e458 server_cookie=0 in_seq=0 out_seq=0 2023-07-05T18:55:57.612 INFO:teuthology.orchestra.run.smithi073.stderr:2023-07-05T18:55:57.606+0000 7fdb027fc700 1 -- 172.21.15.73:0/350342936 <== mon.1 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdaf4011830 con 0x7fdb0413f4c0 2023-07-05T18:55:57.613 INFO:teuthology.orchestra.run.smithi073.stderr:2023-07-05T18:55:57.606+0000 7fdb027fc700 1 -- 172.21.15.73:0/350342936 <== mon.1 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdaf4011990 con 0x7fdb0413f4c0 2023-07-05T18:55:57.613 INFO:teuthology.orchestra.run.smithi073.stderr:2023-07-05T18:55:57.606+0000 7fdb027fc700 1 -- 172.21.15.73:0/350342936 <== mon.1 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdaf4011d20 con 0x7fdb0413f4c0 2023-07-05T18:55:57.616 INFO:teuthology.orchestra.run.smithi073.stderr:2023-07-05T18:55:57.607+0000 7fdb09d5d700 1 -- 172.21.15.73:0/350342936 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fdb0413f4c0 msgr2=0x7fdb0415d6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:55:57.616 INFO:teuthology.orchestra.run.smithi073.stderr:2023-07-05T18:55:57.607+0000 7fdb09d5d700 1 --2- 172.21.15.73:0/350342936 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fdb0413f4c0 0x7fdb0415d6a0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7fdaf4009840 tx=0x7fdaf4009b50 comp rx=0 tx=0).stop 2023-07-05T18:55:57.617 INFO:teuthology.orchestra.run.smithi073.stderr:2023-07-05T18:55:57.607+0000 7fdb09d5d700 1 -- 172.21.15.73:0/350342936 shutdown_connections 2023-07-05T18:55:57.617 INFO:teuthology.orchestra.run.smithi073.stderr:2023-07-05T18:55:57.607+0000 7fdb09d5d700 1 --2- 172.21.15.73:0/350342936 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fdb0413f4c0 0x7fdb0415d6a0 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:55:57.617 INFO:teuthology.orchestra.run.smithi073.stderr:2023-07-05T18:55:57.607+0000 7fdb09d5d700 1 -- 172.21.15.73:0/350342936 >> 172.21.15.73:0/350342936 conn(0x7fdb0406af10 msgr2=0x7fdb0406b2e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-05T18:55:57.617 INFO:teuthology.orchestra.run.smithi073.stderr:2023-07-05T18:55:57.607+0000 7fdb09d5d700 1 -- 172.21.15.73:0/350342936 shutdown_connections 2023-07-05T18:55:57.617 INFO:teuthology.orchestra.run.smithi073.stderr:2023-07-05T18:55:57.607+0000 7fdb09d5d700 1 -- 172.21.15.73:0/350342936 wait complete. 2023-07-05T18:55:57.618 INFO:teuthology.orchestra.run.smithi073.stderr:2023-07-05T18:55:57.608+0000 7fdb09d5d700 1 Processor -- start 2023-07-05T18:55:57.618 INFO:teuthology.orchestra.run.smithi073.stderr:2023-07-05T18:55:57.609+0000 7fdb09d5d700 1 -- start start 2023-07-05T18:55:57.618 INFO:teuthology.orchestra.run.smithi073.stderr:2023-07-05T18:55:57.609+0000 7fdb09d5d700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fdb0406d140 0x7fdb04156a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:55:57.619 INFO:teuthology.orchestra.run.smithi073.stderr:2023-07-05T18:55:57.609+0000 7fdb09d5d700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fdb0413f4c0 0x7fdb041f2eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:55:57.619 INFO:teuthology.orchestra.run.smithi073.stderr:2023-07-05T18:55:57.609+0000 7fdb09d5d700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fdb04142480 0x7fdb040b0780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:55:57.619 INFO:teuthology.orchestra.run.smithi073.stderr:2023-07-05T18:55:57.610+0000 7fdb09d5d700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb041f2a20 con 0x7fdb04142480 2023-07-05T18:55:57.619 INFO:teuthology.orchestra.run.smithi073.stderr:2023-07-05T18:55:57.610+0000 7fdb09d5d700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb0415d090 con 0x7fdb0406d140 2023-07-05T18:55:57.619 INFO:teuthology.orchestra.run.smithi073.stderr:2023-07-05T18:55:57.610+0000 7fdb09d5d700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdb0415d370 con 0x7fdb0413f4c0 2023-07-05T18:55:57.619 INFO:teuthology.orchestra.run.smithi073.stderr:2023-07-05T18:55:57.610+0000 7fdb02ffd700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fdb0413f4c0 0x7fdb041f2eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:55:57.619 INFO:teuthology.orchestra.run.smithi073.stderr:2023-07-05T18:55:57.610+0000 7fdb037fe700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fdb0406d140 0x7fdb04156a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:55:57.620 INFO:teuthology.orchestra.run.smithi073.stderr:2023-07-05T18:55:57.610+0000 7fdb037fe700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fdb0406d140 0x7fdb04156a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:40524/0 (socket says 172.21.15.73:40524) 2023-07-05T18:55:57.620 INFO:teuthology.orchestra.run.smithi073.stderr:2023-07-05T18:55:57.610+0000 7fdb037fe700 1 -- 172.21.15.73:0/3127937484 learned_addr learned my addr 172.21.15.73:0/3127937484 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-07-05T18:55:57.620 INFO:teuthology.orchestra.run.smithi073.stderr:2023-07-05T18:55:57.610+0000 7fdb02ffd700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fdb0413f4c0 0x7fdb041f2eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3301/0 says I am v2:172.21.15.73:42878/0 (socket says 172.21.15.73:42878) 2023-07-05T18:55:57.620 INFO:teuthology.orchestra.run.smithi073.stderr:2023-07-05T18:55:57.610+0000 7fdb03fff700 1 --2- 172.21.15.73:0/3127937484 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fdb04142480 0x7fdb040b0780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:55:57.620 INFO:teuthology.orchestra.run.smithi073.stderr:2023-07-05T18:55:57.610+0000 7fdb02ffd700 1 -- 172.21.15.73:0/3127937484 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fdb0406d140 msgr2=0x7fdb04156a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:55:57.620 INFO:teuthology.orchestra.run.smithi073.stderr:2023-07-05T18:55:57.610+0000 7fdb02ffd700 1 --2- 172.21.15.73:0/3127937484 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fdb0406d140 0x7fdb04156a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:55:57.620 INFO:teuthology.orchestra.run.smithi073.stderr:2023-07-05T18:55:57.610+0000 7fdb02ffd700 1 -- 172.21.15.73:0/3127937484 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fdb04142480 msgr2=0x7fdb040b0780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:55:57.621 INFO:teuthology.orchestra.run.smithi073.stderr:2023-07-05T18:55:57.610+0000 7fdb02ffd700 1 --2- 172.21.15.73:0/3127937484 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fdb04142480 0x7fdb040b0780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:55:57.621 INFO:teuthology.orchestra.run.smithi073.stderr:2023-07-05T18:55:57.610+0000 7fdb02ffd700 1 -- 172.21.15.73:0/3127937484 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdaf40094a0 con 0x7fdb0413f4c0 2023-07-05T18:55:57.621 INFO:teuthology.orchestra.run.smithi073.stderr:2023-07-05T18:55:57.610+0000 7fdb037fe700 1 --2- 172.21.15.73:0/3127937484 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fdb0406d140 0x7fdb04156a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-05T18:55:57.621 INFO:teuthology.orchestra.run.smithi073.stderr:2023-07-05T18:55:57.610+0000 7fdb02ffd700 1 --2- 172.21.15.73:0/3127937484 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fdb0413f4c0 0x7fdb041f2eb0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7fdaf800c470 tx=0x7fdaf800c780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-05T18:55:57.621 INFO:teuthology.orchestra.run.smithi073.stderr:2023-07-05T18:55:57.610+0000 7fdaebfff700 1 -- 172.21.15.73:0/3127937484 <== mon.2 v2:172.21.15.73:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdaf8004c80 con 0x7fdb0413f4c0 2023-07-05T18:55:57.622 INFO:teuthology.orchestra.run.smithi073.stderr:2023-07-05T18:55:57.610+0000 7fdaebfff700 1 -- 172.21.15.73:0/3127937484 <== mon.2 v2:172.21.15.73:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdaf8004de0 con 0x7fdb0413f4c0 2023-07-05T18:55:57.622 INFO:teuthology.orchestra.run.smithi073.stderr:2023-07-05T18:55:57.610+0000 7fdb09d5d700 1 -- 172.21.15.73:0/3127937484 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdb0415d650 con 0x7fdb0413f4c0 2023-07-05T18:55:57.622 INFO:teuthology.orchestra.run.smithi073.stderr:2023-07-05T18:55:57.610+0000 7fdaebfff700 1 -- 172.21.15.73:0/3127937484 <== mon.2 v2:172.21.15.73:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdaf8007310 con 0x7fdb0413f4c0 2023-07-05T18:55:57.622 INFO:teuthology.orchestra.run.smithi073.stderr:2023-07-05T18:55:57.610+0000 7fdb09d5d700 1 -- 172.21.15.73:0/3127937484 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdb04156740 con 0x7fdb0413f4c0 2023-07-05T18:55:57.622 INFO:teuthology.orchestra.run.smithi073.stderr:2023-07-05T18:55:57.611+0000 7fdaebfff700 1 -- 172.21.15.73:0/3127937484 <== mon.2 v2:172.21.15.73:3301/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7fdaf801d3f0 con 0x7fdb0413f4c0 2023-07-05T18:55:57.622 INFO:teuthology.orchestra.run.smithi073.stderr:2023-07-05T18:55:57.611+0000 7fdaebfff700 1 -- 172.21.15.73:0/3127937484 <== mon.2 v2:172.21.15.73:3301/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 955+0+0 (secure 0 0 0) 0x7fdaf80137e0 con 0x7fdb0413f4c0 2023-07-05T18:55:57.623 INFO:teuthology.orchestra.run.smithi073.stderr:2023-07-05T18:55:57.611+0000 7fdb09d5d700 1 -- 172.21.15.73:0/3127937484 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdb041f2b90 con 0x7fdb0413f4c0 2023-07-05T18:55:57.623 INFO:teuthology.orchestra.run.smithi073.stderr:2023-07-05T18:55:57.613+0000 7fdaebfff700 1 -- 172.21.15.73:0/3127937484 <== mon.2 v2:172.21.15.73:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72429 (secure 0 0 0) 0x7fdaf80133c0 con 0x7fdb0413f4c0 2023-07-05T18:55:57.623 INFO:tasks.ceph.mgr.x.smithi073.stderr:2023-07-05T18:55:57.617+0000 7fbd956e1200 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-07-05T18:55:57.648 INFO:tasks.ceph.mgr.y.smithi046.stderr:2023-07-05T18:55:57.646+0000 7fd435390200 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-07-05T18:55:57.698 INFO:teuthology.orchestra.run.smithi073.stderr:2023-07-05T18:55:57.697+0000 7fdb09d5d700 1 -- 172.21.15.73:0/3127937484 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_command({"prefix": "osd new", "uuid": "669ff744-1331-47c5-8579-0440731c889a", "id": 2} v 0) v1 -- 0x7fdb040672e0 con 0x7fdb0413f4c0 2023-07-05T18:55:57.701 INFO:teuthology.orchestra.run.smithi073.stderr:2023-07-05T18:55:57.700+0000 7fdaebfff700 1 -- 172.21.15.73:0/3127937484 <== mon.2 v2:172.21.15.73:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "669ff744-1331-47c5-8579-0440731c889a", "id": 2}]=0 v5) v1 ==== 112+0+2 (secure 0 0 0) 0x7fdaf80139f0 con 0x7fdb0413f4c0 2023-07-05T18:55:57.702 INFO:teuthology.orchestra.run.smithi073.stdout:2 2023-07-05T18:55:57.703 INFO:teuthology.orchestra.run.smithi073.stderr:2023-07-05T18:55:57.700+0000 7fdb09d5d700 1 -- 172.21.15.73:0/3127937484 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fdb0413f4c0 msgr2=0x7fdb041f2eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:55:57.703 INFO:teuthology.orchestra.run.smithi073.stderr:2023-07-05T18:55:57.700+0000 7fdb09d5d700 1 --2- 172.21.15.73:0/3127937484 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fdb0413f4c0 0x7fdb041f2eb0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7fdaf800c470 tx=0x7fdaf800c780 comp rx=0 tx=0).stop 2023-07-05T18:55:57.703 INFO:teuthology.orchestra.run.smithi073.stderr:2023-07-05T18:55:57.701+0000 7fdb09d5d700 1 -- 172.21.15.73:0/3127937484 shutdown_connections 2023-07-05T18:55:57.703 INFO:teuthology.orchestra.run.smithi073.stderr:2023-07-05T18:55:57.701+0000 7fdb09d5d700 1 --2- 172.21.15.73:0/3127937484 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fdb04142480 0x7fdb040b0780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:55:57.703 INFO:teuthology.orchestra.run.smithi073.stderr:2023-07-05T18:55:57.701+0000 7fdb09d5d700 1 --2- 172.21.15.73:0/3127937484 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fdb0406d140 0x7fdb04156a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:55:57.704 INFO:teuthology.orchestra.run.smithi073.stderr:2023-07-05T18:55:57.701+0000 7fdb09d5d700 1 --2- 172.21.15.73:0/3127937484 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fdb0413f4c0 0x7fdb041f2eb0 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:55:57.704 INFO:teuthology.orchestra.run.smithi073.stderr:2023-07-05T18:55:57.701+0000 7fdb09d5d700 1 -- 172.21.15.73:0/3127937484 >> 172.21.15.73:0/3127937484 conn(0x7fdb0406af10 msgr2=0x7fdb04158180 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-05T18:55:57.704 INFO:teuthology.orchestra.run.smithi073.stderr:2023-07-05T18:55:57.701+0000 7fdb09d5d700 1 -- 172.21.15.73:0/3127937484 shutdown_connections 2023-07-05T18:55:57.704 INFO:teuthology.orchestra.run.smithi073.stderr:2023-07-05T18:55:57.701+0000 7fdb09d5d700 1 -- 172.21.15.73:0/3127937484 wait complete. 2023-07-05T18:55:57.714 DEBUG:teuthology.orchestra.run.smithi073:> sudo ceph --cluster ceph osd new 34e1b86d-ffad-415d-861c-07a5f08068a6 3 2023-07-05T18:55:57.844 INFO:teuthology.orchestra.run.smithi073.stderr:2023-07-05T18:55:57.834+0000 7fd1d8f06700 1 Processor -- start 2023-07-05T18:55:57.845 INFO:teuthology.orchestra.run.smithi073.stderr:2023-07-05T18:55:57.834+0000 7fd1d8f06700 1 -- start start 2023-07-05T18:55:57.845 INFO:teuthology.orchestra.run.smithi073.stderr:2023-07-05T18:55:57.835+0000 7fd1d8f06700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fd1d415b2d0 0x7fd1d4069e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:55:57.845 INFO:teuthology.orchestra.run.smithi073.stderr:2023-07-05T18:55:57.835+0000 7fd1d8f06700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fd1d40ce550 0x7fd1d406a340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:55:57.846 INFO:teuthology.orchestra.run.smithi073.stderr:2023-07-05T18:55:57.835+0000 7fd1d8f06700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fd1d406e370 0x7fd1d406e7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:55:57.846 INFO:teuthology.orchestra.run.smithi073.stderr:2023-07-05T18:55:57.835+0000 7fd1d8f06700 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd1d40ce0c0 con 0x7fd1d406e370 2023-07-05T18:55:57.847 INFO:teuthology.orchestra.run.smithi073.stderr:2023-07-05T18:55:57.835+0000 7fd1d8f06700 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd1d406ed30 con 0x7fd1d40ce550 2023-07-05T18:55:57.847 INFO:teuthology.orchestra.run.smithi073.stderr:2023-07-05T18:55:57.835+0000 7fd1d8f06700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd1d40cd790 con 0x7fd1d415b2d0 2023-07-05T18:55:57.847 INFO:teuthology.orchestra.run.smithi073.stderr:2023-07-05T18:55:57.836+0000 7fd1d259c700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fd1d415b2d0 0x7fd1d4069e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:55:57.847 INFO:teuthology.orchestra.run.smithi073.stderr:2023-07-05T18:55:57.836+0000 7fd1d259c700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fd1d415b2d0 0x7fd1d4069e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3301/0 says I am v2:172.21.15.73:42882/0 (socket says 172.21.15.73:42882) 2023-07-05T18:55:57.847 INFO:teuthology.orchestra.run.smithi073.stderr:2023-07-05T18:55:57.836+0000 7fd1d1d9b700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fd1d40ce550 0x7fd1d406a340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:55:57.847 INFO:teuthology.orchestra.run.smithi073.stderr:2023-07-05T18:55:57.836+0000 7fd1d259c700 1 -- 172.21.15.73:0/3928321821 learned_addr learned my addr 172.21.15.73:0/3928321821 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-07-05T18:55:57.848 INFO:teuthology.orchestra.run.smithi073.stderr:2023-07-05T18:55:57.836+0000 7fd1d2d9d700 1 --2- 172.21.15.73:0/3928321821 >> v2:172.21.15.46:3300/0 conn(0x7fd1d406e370 0x7fd1d406e7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:55:57.848 INFO:teuthology.orchestra.run.smithi073.stderr:2023-07-05T18:55:57.836+0000 7fd1d259c700 1 -- 172.21.15.73:0/3928321821 >> v2:172.21.15.73:3300/0 conn(0x7fd1d40ce550 msgr2=0x7fd1d406a340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-05T18:55:57.848 INFO:teuthology.orchestra.run.smithi073.stderr:2023-07-05T18:55:57.836+0000 7fd1d259c700 1 --2- 172.21.15.73:0/3928321821 >> v2:172.21.15.73:3300/0 conn(0x7fd1d40ce550 0x7fd1d406a340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:55:57.848 INFO:teuthology.orchestra.run.smithi073.stderr:2023-07-05T18:55:57.836+0000 7fd1d259c700 1 -- 172.21.15.73:0/3928321821 >> v2:172.21.15.46:3300/0 conn(0x7fd1d406e370 msgr2=0x7fd1d406e7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-05T18:55:57.848 INFO:teuthology.orchestra.run.smithi073.stderr:2023-07-05T18:55:57.836+0000 7fd1d259c700 1 --2- 172.21.15.73:0/3928321821 >> v2:172.21.15.46:3300/0 conn(0x7fd1d406e370 0x7fd1d406e7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:55:57.849 INFO:teuthology.orchestra.run.smithi073.stderr:2023-07-05T18:55:57.836+0000 7fd1d259c700 1 -- 172.21.15.73:0/3928321821 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd1d40cda70 con 0x7fd1d415b2d0 2023-07-05T18:55:57.849 INFO:teuthology.orchestra.run.smithi073.stderr:2023-07-05T18:55:57.836+0000 7fd1d1d9b700 1 --2- 172.21.15.73:0/3928321821 >> v2:172.21.15.73:3300/0 conn(0x7fd1d40ce550 0x7fd1d406a340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-05T18:55:57.849 INFO:teuthology.orchestra.run.smithi073.stderr:2023-07-05T18:55:57.836+0000 7fd1d259c700 1 --2- 172.21.15.73:0/3928321821 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fd1d415b2d0 0x7fd1d4069e00 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7fd1d406bef0 tx=0x7fd1c4009bd0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b6c04d733b3b4689 server_cookie=0 in_seq=0 out_seq=0 2023-07-05T18:55:57.850 INFO:teuthology.orchestra.run.smithi073.stderr:2023-07-05T18:55:57.836+0000 7fd1d159a700 1 -- 172.21.15.73:0/3928321821 <== mon.2 v2:172.21.15.73:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1c4011830 con 0x7fd1d415b2d0 2023-07-05T18:55:57.850 INFO:teuthology.orchestra.run.smithi073.stderr:2023-07-05T18:55:57.836+0000 7fd1d159a700 1 -- 172.21.15.73:0/3928321821 <== mon.2 v2:172.21.15.73:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd1c4011990 con 0x7fd1d415b2d0 2023-07-05T18:55:57.851 INFO:teuthology.orchestra.run.smithi073.stderr:2023-07-05T18:55:57.836+0000 7fd1d159a700 1 -- 172.21.15.73:0/3928321821 <== mon.2 v2:172.21.15.73:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1c4011d20 con 0x7fd1d415b2d0 2023-07-05T18:55:57.851 INFO:teuthology.orchestra.run.smithi073.stderr:2023-07-05T18:55:57.837+0000 7fd1d8f06700 1 -- 172.21.15.73:0/3928321821 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fd1d415b2d0 msgr2=0x7fd1d4069e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:55:57.851 INFO:teuthology.orchestra.run.smithi073.stderr:2023-07-05T18:55:57.837+0000 7fd1d8f06700 1 --2- 172.21.15.73:0/3928321821 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fd1d415b2d0 0x7fd1d4069e00 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7fd1d406bef0 tx=0x7fd1c4009bd0 comp rx=0 tx=0).stop 2023-07-05T18:55:57.851 INFO:teuthology.orchestra.run.smithi073.stderr:2023-07-05T18:55:57.837+0000 7fd1d8f06700 1 -- 172.21.15.73:0/3928321821 shutdown_connections 2023-07-05T18:55:57.851 INFO:teuthology.orchestra.run.smithi073.stderr:2023-07-05T18:55:57.837+0000 7fd1d8f06700 1 --2- 172.21.15.73:0/3928321821 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fd1d415b2d0 0x7fd1d4069e00 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:55:57.852 INFO:teuthology.orchestra.run.smithi073.stderr:2023-07-05T18:55:57.837+0000 7fd1d8f06700 1 --2- 172.21.15.73:0/3928321821 >> v2:172.21.15.46:3300/0 conn(0x7fd1d406e370 0x7fd1d406e7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:55:57.852 INFO:teuthology.orchestra.run.smithi073.stderr:2023-07-05T18:55:57.837+0000 7fd1d8f06700 1 --2- 172.21.15.73:0/3928321821 >> v2:172.21.15.73:3300/0 conn(0x7fd1d40ce550 0x7fd1d406a340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:55:57.852 INFO:teuthology.orchestra.run.smithi073.stderr:2023-07-05T18:55:57.837+0000 7fd1d8f06700 1 -- 172.21.15.73:0/3928321821 >> 172.21.15.73:0/3928321821 conn(0x7fd1d406af10 msgr2=0x7fd1d406b2e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-05T18:55:57.852 INFO:teuthology.orchestra.run.smithi073.stderr:2023-07-05T18:55:57.837+0000 7fd1d8f06700 1 -- 172.21.15.73:0/3928321821 shutdown_connections 2023-07-05T18:55:57.852 INFO:teuthology.orchestra.run.smithi073.stderr:2023-07-05T18:55:57.837+0000 7fd1d8f06700 1 -- 172.21.15.73:0/3928321821 wait complete. 2023-07-05T18:55:57.853 INFO:teuthology.orchestra.run.smithi073.stderr:2023-07-05T18:55:57.838+0000 7fd1d8f06700 1 Processor -- start 2023-07-05T18:55:57.853 INFO:teuthology.orchestra.run.smithi073.stderr:2023-07-05T18:55:57.838+0000 7fd1d8f06700 1 -- start start 2023-07-05T18:55:57.853 INFO:teuthology.orchestra.run.smithi073.stderr:2023-07-05T18:55:57.839+0000 7fd1d8f06700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fd1d406e370 0x7fd1d414a400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:55:57.853 INFO:teuthology.orchestra.run.smithi073.stderr:2023-07-05T18:55:57.839+0000 7fd1d8f06700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd1d40ce550 0x7fd1d40ac860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:55:57.853 INFO:teuthology.orchestra.run.smithi073.stderr:2023-07-05T18:55:57.839+0000 7fd1d8f06700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd1d415b2d0 0x7fd1d4153600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:55:57.853 INFO:teuthology.orchestra.run.smithi073.stderr:2023-07-05T18:55:57.839+0000 7fd1d8f06700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1d40adea0 con 0x7fd1d40ce550 2023-07-05T18:55:57.853 INFO:teuthology.orchestra.run.smithi073.stderr:2023-07-05T18:55:57.839+0000 7fd1d8f06700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1d4157330 con 0x7fd1d415b2d0 2023-07-05T18:55:57.854 INFO:teuthology.orchestra.run.smithi073.stderr:2023-07-05T18:55:57.839+0000 7fd1d8f06700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd1d40ad320 con 0x7fd1d406e370 2023-07-05T18:55:57.854 INFO:teuthology.orchestra.run.smithi073.stderr:2023-07-05T18:55:57.839+0000 7fd1d259c700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fd1d406e370 0x7fd1d414a400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:55:57.854 INFO:teuthology.orchestra.run.smithi073.stderr:2023-07-05T18:55:57.839+0000 7fd1d2d9d700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd1d415b2d0 0x7fd1d4153600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:55:57.854 INFO:teuthology.orchestra.run.smithi073.stderr:2023-07-05T18:55:57.839+0000 7fd1d259c700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fd1d406e370 0x7fd1d414a400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3301/0 says I am v2:172.21.15.73:42888/0 (socket says 172.21.15.73:42888) 2023-07-05T18:55:57.854 INFO:teuthology.orchestra.run.smithi073.stderr:2023-07-05T18:55:57.839+0000 7fd1d259c700 1 -- 172.21.15.73:0/2523767413 learned_addr learned my addr 172.21.15.73:0/2523767413 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-07-05T18:55:57.854 INFO:teuthology.orchestra.run.smithi073.stderr:2023-07-05T18:55:57.839+0000 7fd1d2d9d700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd1d415b2d0 0x7fd1d4153600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:40540/0 (socket says 172.21.15.73:40540) 2023-07-05T18:55:57.854 INFO:teuthology.orchestra.run.smithi073.stderr:2023-07-05T18:55:57.839+0000 7fd1d1d9b700 1 --2- 172.21.15.73:0/2523767413 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd1d40ce550 0x7fd1d40ac860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:55:57.855 INFO:teuthology.orchestra.run.smithi073.stderr:2023-07-05T18:55:57.839+0000 7fd1d259c700 1 -- 172.21.15.73:0/2523767413 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd1d415b2d0 msgr2=0x7fd1d4153600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:55:57.855 INFO:teuthology.orchestra.run.smithi073.stderr:2023-07-05T18:55:57.839+0000 7fd1d259c700 1 --2- 172.21.15.73:0/2523767413 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd1d415b2d0 0x7fd1d4153600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:55:57.855 INFO:teuthology.orchestra.run.smithi073.stderr:2023-07-05T18:55:57.839+0000 7fd1d259c700 1 -- 172.21.15.73:0/2523767413 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd1d40ce550 msgr2=0x7fd1d40ac860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:55:57.855 INFO:teuthology.orchestra.run.smithi073.stderr:2023-07-05T18:55:57.839+0000 7fd1d259c700 1 --2- 172.21.15.73:0/2523767413 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd1d40ce550 0x7fd1d40ac860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:55:57.855 INFO:teuthology.orchestra.run.smithi073.stderr:2023-07-05T18:55:57.839+0000 7fd1d259c700 1 -- 172.21.15.73:0/2523767413 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd1c80094a0 con 0x7fd1d406e370 2023-07-05T18:55:57.855 INFO:teuthology.orchestra.run.smithi073.stderr:2023-07-05T18:55:57.840+0000 7fd1d259c700 1 --2- 172.21.15.73:0/2523767413 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fd1d406e370 0x7fd1d414a400 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fd1c4000c00 tx=0x7fd1c4004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-05T18:55:57.855 INFO:teuthology.orchestra.run.smithi073.stderr:2023-07-05T18:55:57.840+0000 7fd1c2ffd700 1 -- 172.21.15.73:0/2523767413 <== mon.2 v2:172.21.15.73:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1c4004450 con 0x7fd1d406e370 2023-07-05T18:55:57.855 INFO:teuthology.orchestra.run.smithi073.stderr:2023-07-05T18:55:57.840+0000 7fd1c2ffd700 1 -- 172.21.15.73:0/2523767413 <== mon.2 v2:172.21.15.73:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd1c40036a0 con 0x7fd1d406e370 2023-07-05T18:55:57.856 INFO:teuthology.orchestra.run.smithi073.stderr:2023-07-05T18:55:57.840+0000 7fd1c2ffd700 1 -- 172.21.15.73:0/2523767413 <== mon.2 v2:172.21.15.73:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1c40045f0 con 0x7fd1d406e370 2023-07-05T18:55:57.856 INFO:teuthology.orchestra.run.smithi073.stderr:2023-07-05T18:55:57.840+0000 7fd1d8f06700 1 -- 172.21.15.73:0/2523767413 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd1c4009550 con 0x7fd1d406e370 2023-07-05T18:55:57.856 INFO:teuthology.orchestra.run.smithi073.stderr:2023-07-05T18:55:57.840+0000 7fd1d8f06700 1 -- 172.21.15.73:0/2523767413 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd1d40ad8e0 con 0x7fd1d406e370 2023-07-05T18:55:57.856 INFO:teuthology.orchestra.run.smithi073.stderr:2023-07-05T18:55:57.840+0000 7fd1c2ffd700 1 -- 172.21.15.73:0/2523767413 <== mon.2 v2:172.21.15.73:3301/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7fd1c4003d50 con 0x7fd1d406e370 2023-07-05T18:55:57.856 INFO:teuthology.orchestra.run.smithi073.stderr:2023-07-05T18:55:57.840+0000 7fd1c2ffd700 1 -- 172.21.15.73:0/2523767413 <== mon.2 v2:172.21.15.73:3301/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1070+0+0 (secure 0 0 0) 0x7fd1c401ac40 con 0x7fd1d406e370 2023-07-05T18:55:57.856 INFO:teuthology.orchestra.run.smithi073.stderr:2023-07-05T18:55:57.841+0000 7fd1d8f06700 1 -- 172.21.15.73:0/2523767413 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd1d41574f0 con 0x7fd1d406e370 2023-07-05T18:55:57.857 INFO:teuthology.orchestra.run.smithi073.stderr:2023-07-05T18:55:57.843+0000 7fd1c2ffd700 1 -- 172.21.15.73:0/2523767413 <== mon.2 v2:172.21.15.73:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72429 (secure 0 0 0) 0x7fd1c4031060 con 0x7fd1d406e370 2023-07-05T18:55:57.927 INFO:teuthology.orchestra.run.smithi073.stderr:2023-07-05T18:55:57.925+0000 7fd1d8f06700 1 -- 172.21.15.73:0/2523767413 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_command({"prefix": "osd new", "uuid": "34e1b86d-ffad-415d-861c-07a5f08068a6", "id": 3} v 0) v1 -- 0x7fd1d40672e0 con 0x7fd1d406e370 2023-07-05T18:55:57.930 INFO:teuthology.orchestra.run.smithi073.stderr:2023-07-05T18:55:57.928+0000 7fd1c2ffd700 1 -- 172.21.15.73:0/2523767413 <== mon.2 v2:172.21.15.73:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "34e1b86d-ffad-415d-861c-07a5f08068a6", "id": 3}]=0 v6) v1 ==== 112+0+2 (secure 0 0 0) 0x7fd1c403a0b0 con 0x7fd1d406e370 2023-07-05T18:55:57.930 INFO:teuthology.orchestra.run.smithi073.stdout:3 2023-07-05T18:55:57.931 INFO:teuthology.orchestra.run.smithi073.stderr:2023-07-05T18:55:57.929+0000 7fd1d8f06700 1 -- 172.21.15.73:0/2523767413 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fd1d406e370 msgr2=0x7fd1d414a400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:55:57.931 INFO:teuthology.orchestra.run.smithi073.stderr:2023-07-05T18:55:57.929+0000 7fd1d8f06700 1 --2- 172.21.15.73:0/2523767413 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fd1d406e370 0x7fd1d414a400 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fd1c4000c00 tx=0x7fd1c4004750 comp rx=0 tx=0).stop 2023-07-05T18:55:57.932 INFO:teuthology.orchestra.run.smithi073.stderr:2023-07-05T18:55:57.929+0000 7fd1d8f06700 1 -- 172.21.15.73:0/2523767413 shutdown_connections 2023-07-05T18:55:57.932 INFO:teuthology.orchestra.run.smithi073.stderr:2023-07-05T18:55:57.929+0000 7fd1d8f06700 1 --2- 172.21.15.73:0/2523767413 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd1d415b2d0 0x7fd1d4153600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:55:57.935 INFO:teuthology.orchestra.run.smithi073.stderr:2023-07-05T18:55:57.929+0000 7fd1d8f06700 1 --2- 172.21.15.73:0/2523767413 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fd1d406e370 0x7fd1d414a400 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:55:57.935 INFO:teuthology.orchestra.run.smithi073.stderr:2023-07-05T18:55:57.929+0000 7fd1d8f06700 1 --2- 172.21.15.73:0/2523767413 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd1d40ce550 0x7fd1d40ac860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:55:57.935 INFO:teuthology.orchestra.run.smithi073.stderr:2023-07-05T18:55:57.929+0000 7fd1d8f06700 1 -- 172.21.15.73:0/2523767413 >> 172.21.15.73:0/2523767413 conn(0x7fd1d406af10 msgr2=0x7fd1d415ca20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-05T18:55:57.935 INFO:teuthology.orchestra.run.smithi073.stderr:2023-07-05T18:55:57.929+0000 7fd1d8f06700 1 -- 172.21.15.73:0/2523767413 shutdown_connections 2023-07-05T18:55:57.936 INFO:teuthology.orchestra.run.smithi073.stderr:2023-07-05T18:55:57.930+0000 7fd1d8f06700 1 -- 172.21.15.73:0/2523767413 wait complete. 2023-07-05T18:55:57.945 DEBUG:teuthology.orchestra.run.smithi073:> sudo ceph --cluster ceph osd new 57ffcb91-c7dc-4a69-ae71-4d9622a14a05 4 2023-07-05T18:55:58.067 INFO:teuthology.orchestra.run.smithi073.stderr:2023-07-05T18:55:58.064+0000 7fc478159700 1 Processor -- start 2023-07-05T18:55:58.068 INFO:teuthology.orchestra.run.smithi073.stderr:2023-07-05T18:55:58.064+0000 7fc478159700 1 -- start start 2023-07-05T18:55:58.068 INFO:teuthology.orchestra.run.smithi073.stderr:2023-07-05T18:55:58.065+0000 7fc478159700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fc470159170 0x7fc4700cc3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:55:58.068 INFO:teuthology.orchestra.run.smithi073.stderr:2023-07-05T18:55:58.065+0000 7fc478159700 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc470159540 con 0x7fc4700cdc90 2023-07-05T18:55:58.068 INFO:teuthology.orchestra.run.smithi073.stderr:2023-07-05T18:55:58.065+0000 7fc478159700 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc47006c2f0 con 0x7fc4700713a0 2023-07-05T18:55:58.068 INFO:teuthology.orchestra.run.smithi073.stderr:2023-07-05T18:55:58.065+0000 7fc478159700 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc4700cca50 con 0x7fc470159170 2023-07-05T18:55:58.068 INFO:teuthology.orchestra.run.smithi073.stderr:2023-07-05T18:55:58.065+0000 7fc4756f4700 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7fc4700713a0 0x7fc4700cd580 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:60086/0 (socket says 172.21.15.73:60086) 2023-07-05T18:55:58.069 INFO:teuthology.orchestra.run.smithi073.stderr:2023-07-05T18:55:58.065+0000 7fc4756f4700 1 -- 172.21.15.73:0/3616005815 learned_addr learned my addr 172.21.15.73:0/3616005815 (peer_addr_for_me v1:172.21.15.73:0/0) 2023-07-05T18:55:58.069 INFO:teuthology.orchestra.run.smithi073.stderr:2023-07-05T18:55:58.065+0000 7fc475ef5700 1 --2- 172.21.15.73:0/3616005815 >> v2:172.21.15.46:3300/0 conn(0x7fc470159170 0x7fc4700cc3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:55:58.069 INFO:teuthology.orchestra.run.smithi073.stderr:2023-07-05T18:55:58.065+0000 7fc474ef3700 1 -- 172.21.15.73:0/3616005815 <== mon.1 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3141375719 0 0) 0x7fc47006c2f0 con 0x7fc4700713a0 2023-07-05T18:55:58.069 INFO:teuthology.orchestra.run.smithi073.stderr:2023-07-05T18:55:58.066+0000 7fc474ef3700 1 -- 172.21.15.73:0/3616005815 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc45c0035b0 con 0x7fc4700713a0 2023-07-05T18:55:58.069 INFO:teuthology.orchestra.run.smithi073.stderr:2023-07-05T18:55:58.066+0000 7fc475ef5700 1 -- 172.21.15.73:0/3616005815 >> v1:172.21.15.73:6789/0 conn(0x7fc4700713a0 legacy=0x7fc4700cd580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:55:58.069 INFO:teuthology.orchestra.run.smithi073.stderr:2023-07-05T18:55:58.066+0000 7fc475ef5700 1 -- 172.21.15.73:0/3616005815 >> v1:172.21.15.46:6789/0 conn(0x7fc4700cdc90 legacy=0x7fc47006cd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:55:58.069 INFO:teuthology.orchestra.run.smithi073.stderr:2023-07-05T18:55:58.066+0000 7fc474ef3700 1 -- 172.21.15.73:0/3616005815 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 445649506 0 0) 0x7fc470159540 con 0x7fc4700cdc90 2023-07-05T18:55:58.070 INFO:teuthology.orchestra.run.smithi073.stderr:2023-07-05T18:55:58.066+0000 7fc475ef5700 1 -- 172.21.15.73:0/3616005815 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc4700ccd30 con 0x7fc470159170 2023-07-05T18:55:58.070 INFO:teuthology.orchestra.run.smithi073.stderr:2023-07-05T18:55:58.066+0000 7fc475ef5700 1 --2- 172.21.15.73:0/3616005815 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc470159170 0x7fc4700cc3c0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fc46c009840 tx=0x7fc46c009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=93cf4f0ecf63ea7f server_cookie=0 in_seq=0 out_seq=0 2023-07-05T18:55:58.070 INFO:teuthology.orchestra.run.smithi073.stderr:2023-07-05T18:55:58.066+0000 7fc474ef3700 1 -- 172.21.15.73:0/3616005815 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc46c011830 con 0x7fc470159170 2023-07-05T18:55:58.070 INFO:teuthology.orchestra.run.smithi073.stderr:2023-07-05T18:55:58.066+0000 7fc474ef3700 1 -- 172.21.15.73:0/3616005815 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc46c011990 con 0x7fc470159170 2023-07-05T18:55:58.070 INFO:teuthology.orchestra.run.smithi073.stderr:2023-07-05T18:55:58.066+0000 7fc474ef3700 1 -- 172.21.15.73:0/3616005815 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc46c011d20 con 0x7fc470159170 2023-07-05T18:55:58.072 INFO:teuthology.orchestra.run.smithi073.stderr:2023-07-05T18:55:58.066+0000 7fc478159700 1 -- 172.21.15.73:0/3616005815 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc470159170 msgr2=0x7fc4700cc3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:55:58.073 INFO:teuthology.orchestra.run.smithi073.stderr:2023-07-05T18:55:58.066+0000 7fc478159700 1 --2- 172.21.15.73:0/3616005815 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc470159170 0x7fc4700cc3c0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fc46c009840 tx=0x7fc46c009b50 comp rx=0 tx=0).stop 2023-07-05T18:55:58.073 INFO:teuthology.orchestra.run.smithi073.stderr:2023-07-05T18:55:58.067+0000 7fc478159700 1 -- 172.21.15.73:0/3616005815 shutdown_connections 2023-07-05T18:55:58.073 INFO:teuthology.orchestra.run.smithi073.stderr:2023-07-05T18:55:58.067+0000 7fc478159700 1 --2- 172.21.15.73:0/3616005815 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc470159170 0x7fc4700cc3c0 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:55:58.073 INFO:teuthology.orchestra.run.smithi073.stderr:2023-07-05T18:55:58.067+0000 7fc478159700 1 -- 172.21.15.73:0/3616005815 >> 172.21.15.73:0/3616005815 conn(0x7fc47006bb30 msgr2=0x7fc4700b1580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-05T18:55:58.073 INFO:teuthology.orchestra.run.smithi073.stderr:2023-07-05T18:55:58.067+0000 7fc478159700 1 -- 172.21.15.73:0/3616005815 shutdown_connections 2023-07-05T18:55:58.073 INFO:teuthology.orchestra.run.smithi073.stderr:2023-07-05T18:55:58.067+0000 7fc478159700 1 -- 172.21.15.73:0/3616005815 wait complete. 2023-07-05T18:55:58.074 INFO:teuthology.orchestra.run.smithi073.stderr:2023-07-05T18:55:58.068+0000 7fc478159700 1 Processor -- start 2023-07-05T18:55:58.074 INFO:teuthology.orchestra.run.smithi073.stderr:2023-07-05T18:55:58.068+0000 7fc478159700 1 -- start start 2023-07-05T18:55:58.074 INFO:teuthology.orchestra.run.smithi073.stderr:2023-07-05T18:55:58.069+0000 7fc478159700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fc4700713a0 0x7fc4701525e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:55:58.074 INFO:teuthology.orchestra.run.smithi073.stderr:2023-07-05T18:55:58.069+0000 7fc478159700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc4700cdc90 0x7fc47015a7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:55:58.075 INFO:teuthology.orchestra.run.smithi073.stderr:2023-07-05T18:55:58.069+0000 7fc478159700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc470159170 0x7fc470157bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:55:58.075 INFO:teuthology.orchestra.run.smithi073.stderr:2023-07-05T18:55:58.069+0000 7fc478159700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc470155f80 con 0x7fc470159170 2023-07-05T18:55:58.075 INFO:teuthology.orchestra.run.smithi073.stderr:2023-07-05T18:55:58.069+0000 7fc478159700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc47015ad00 con 0x7fc4700cdc90 2023-07-05T18:55:58.075 INFO:teuthology.orchestra.run.smithi073.stderr:2023-07-05T18:55:58.069+0000 7fc478159700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc470155340 con 0x7fc4700713a0 2023-07-05T18:55:58.075 INFO:teuthology.orchestra.run.smithi073.stderr:2023-07-05T18:55:58.069+0000 7fc4756f4700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc4700cdc90 0x7fc47015a7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:55:58.075 INFO:teuthology.orchestra.run.smithi073.stderr:2023-07-05T18:55:58.069+0000 7fc4756f4700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc4700cdc90 0x7fc47015a7c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:40548/0 (socket says 172.21.15.73:40548) 2023-07-05T18:55:58.075 INFO:teuthology.orchestra.run.smithi073.stderr:2023-07-05T18:55:58.069+0000 7fc475ef5700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fc4700713a0 0x7fc4701525e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:55:58.076 INFO:teuthology.orchestra.run.smithi073.stderr:2023-07-05T18:55:58.069+0000 7fc4756f4700 1 -- 172.21.15.73:0/3940471114 learned_addr learned my addr 172.21.15.73:0/3940471114 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-07-05T18:55:58.076 INFO:teuthology.orchestra.run.smithi073.stderr:2023-07-05T18:55:58.069+0000 7fc4766f6700 1 --2- 172.21.15.73:0/3940471114 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc470159170 0x7fc470157bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:55:58.076 INFO:teuthology.orchestra.run.smithi073.stderr:2023-07-05T18:55:58.069+0000 7fc475ef5700 1 -- 172.21.15.73:0/3940471114 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc4700cdc90 msgr2=0x7fc47015a7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:55:58.076 INFO:teuthology.orchestra.run.smithi073.stderr:2023-07-05T18:55:58.069+0000 7fc475ef5700 1 --2- 172.21.15.73:0/3940471114 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc4700cdc90 0x7fc47015a7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:55:58.077 INFO:teuthology.orchestra.run.smithi073.stderr:2023-07-05T18:55:58.069+0000 7fc475ef5700 1 -- 172.21.15.73:0/3940471114 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc470159170 msgr2=0x7fc470157bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:55:58.077 INFO:teuthology.orchestra.run.smithi073.stderr:2023-07-05T18:55:58.069+0000 7fc475ef5700 1 --2- 172.21.15.73:0/3940471114 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc470159170 0x7fc470157bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:55:58.077 INFO:teuthology.orchestra.run.smithi073.stderr:2023-07-05T18:55:58.069+0000 7fc475ef5700 1 -- 172.21.15.73:0/3940471114 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc46c0094a0 con 0x7fc4700713a0 2023-07-05T18:55:58.077 INFO:teuthology.orchestra.run.smithi073.stderr:2023-07-05T18:55:58.069+0000 7fc4756f4700 1 --2- 172.21.15.73:0/3940471114 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc4700cdc90 0x7fc47015a7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-05T18:55:58.077 INFO:teuthology.orchestra.run.smithi073.stderr:2023-07-05T18:55:58.069+0000 7fc475ef5700 1 --2- 172.21.15.73:0/3940471114 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fc4700713a0 0x7fc4701525e0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fc46c016000 tx=0x7fc46c004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-05T18:55:58.077 INFO:teuthology.orchestra.run.smithi073.stderr:2023-07-05T18:55:58.069+0000 7fc4667fc700 1 -- 172.21.15.73:0/3940471114 <== mon.2 v2:172.21.15.73:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc46c01a7e0 con 0x7fc4700713a0 2023-07-05T18:55:58.077 INFO:teuthology.orchestra.run.smithi073.stderr:2023-07-05T18:55:58.069+0000 7fc4667fc700 1 -- 172.21.15.73:0/3940471114 <== mon.2 v2:172.21.15.73:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc46c01a960 con 0x7fc4700713a0 2023-07-05T18:55:58.078 INFO:teuthology.orchestra.run.smithi073.stderr:2023-07-05T18:55:58.069+0000 7fc478159700 1 -- 172.21.15.73:0/3940471114 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc4701555e0 con 0x7fc4700713a0 2023-07-05T18:55:58.078 INFO:teuthology.orchestra.run.smithi073.stderr:2023-07-05T18:55:58.069+0000 7fc4667fc700 1 -- 172.21.15.73:0/3940471114 <== mon.2 v2:172.21.15.73:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc46c01ad10 con 0x7fc4700713a0 2023-07-05T18:55:58.078 INFO:teuthology.orchestra.run.smithi073.stderr:2023-07-05T18:55:58.069+0000 7fc478159700 1 -- 172.21.15.73:0/3940471114 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc470155ba0 con 0x7fc4700713a0 2023-07-05T18:55:58.078 INFO:teuthology.orchestra.run.smithi073.stderr:2023-07-05T18:55:58.070+0000 7fc4667fc700 1 -- 172.21.15.73:0/3940471114 <== mon.2 v2:172.21.15.73:3301/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7fc46c022070 con 0x7fc4700713a0 2023-07-05T18:55:58.078 INFO:teuthology.orchestra.run.smithi073.stderr:2023-07-05T18:55:58.070+0000 7fc4667fc700 1 -- 172.21.15.73:0/3940471114 <== mon.2 v2:172.21.15.73:3301/0 5 ==== osd_map(6..6 src has 1..6) v4 ==== 1185+0+0 (secure 0 0 0) 0x7fc46c024930 con 0x7fc4700713a0 2023-07-05T18:55:58.079 INFO:tasks.ceph.mgr.x.smithi073.stderr:2023-07-05T18:55:58.070+0000 7fbd956e1200 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-07-05T18:55:58.079 INFO:teuthology.orchestra.run.smithi073.stderr:2023-07-05T18:55:58.071+0000 7fc478159700 1 -- 172.21.15.73:0/3940471114 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc470155d30 con 0x7fc4700713a0 2023-07-05T18:55:58.079 INFO:teuthology.orchestra.run.smithi073.stderr:2023-07-05T18:55:58.073+0000 7fc4667fc700 1 -- 172.21.15.73:0/3940471114 <== mon.2 v2:172.21.15.73:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72429 (secure 0 0 0) 0x7fc46c029070 con 0x7fc4700713a0 2023-07-05T18:55:58.092 INFO:tasks.ceph.mgr.y.smithi046.stderr:2023-07-05T18:55:58.090+0000 7fd435390200 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-07-05T18:55:58.157 INFO:teuthology.orchestra.run.smithi073.stderr:2023-07-05T18:55:58.155+0000 7fc478159700 1 -- 172.21.15.73:0/3940471114 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_command({"prefix": "osd new", "uuid": "57ffcb91-c7dc-4a69-ae71-4d9622a14a05", "id": 4} v 0) v1 -- 0x7fc4700672e0 con 0x7fc4700713a0 2023-07-05T18:55:58.160 INFO:teuthology.orchestra.run.smithi073.stderr:2023-07-05T18:55:58.158+0000 7fc4667fc700 1 -- 172.21.15.73:0/3940471114 <== mon.2 v2:172.21.15.73:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "57ffcb91-c7dc-4a69-ae71-4d9622a14a05", "id": 4}]=0 v7) v1 ==== 112+0+2 (secure 0 0 0) 0x7fc46c015020 con 0x7fc4700713a0 2023-07-05T18:55:58.160 INFO:teuthology.orchestra.run.smithi073.stdout:4 2023-07-05T18:55:58.161 INFO:teuthology.orchestra.run.smithi073.stderr:2023-07-05T18:55:58.159+0000 7fc478159700 1 -- 172.21.15.73:0/3940471114 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fc4700713a0 msgr2=0x7fc4701525e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:55:58.161 INFO:teuthology.orchestra.run.smithi073.stderr:2023-07-05T18:55:58.159+0000 7fc478159700 1 --2- 172.21.15.73:0/3940471114 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fc4700713a0 0x7fc4701525e0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fc46c016000 tx=0x7fc46c004750 comp rx=0 tx=0).stop 2023-07-05T18:55:58.162 INFO:teuthology.orchestra.run.smithi073.stderr:2023-07-05T18:55:58.159+0000 7fc478159700 1 -- 172.21.15.73:0/3940471114 shutdown_connections 2023-07-05T18:55:58.162 INFO:teuthology.orchestra.run.smithi073.stderr:2023-07-05T18:55:58.159+0000 7fc478159700 1 --2- 172.21.15.73:0/3940471114 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc470159170 0x7fc470157bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:55:58.162 INFO:teuthology.orchestra.run.smithi073.stderr:2023-07-05T18:55:58.159+0000 7fc478159700 1 --2- 172.21.15.73:0/3940471114 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fc4700713a0 0x7fc4701525e0 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:55:58.162 INFO:teuthology.orchestra.run.smithi073.stderr:2023-07-05T18:55:58.159+0000 7fc478159700 1 --2- 172.21.15.73:0/3940471114 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc4700cdc90 0x7fc47015a7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:55:58.162 INFO:teuthology.orchestra.run.smithi073.stderr:2023-07-05T18:55:58.159+0000 7fc478159700 1 -- 172.21.15.73:0/3940471114 >> 172.21.15.73:0/3940471114 conn(0x7fc47006bb30 msgr2=0x7fc4700b5230 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-05T18:55:58.162 INFO:teuthology.orchestra.run.smithi073.stderr:2023-07-05T18:55:58.159+0000 7fc478159700 1 -- 172.21.15.73:0/3940471114 shutdown_connections 2023-07-05T18:55:58.163 INFO:teuthology.orchestra.run.smithi073.stderr:2023-07-05T18:55:58.159+0000 7fc478159700 1 -- 172.21.15.73:0/3940471114 wait complete. 2023-07-05T18:55:58.175 DEBUG:teuthology.orchestra.run.smithi073:> sudo ceph --cluster ceph osd new 665f41c9-ee20-49cf-bf0e-fbe0c03d3aed 5 2023-07-05T18:55:58.296 INFO:teuthology.orchestra.run.smithi073.stderr:2023-07-05T18:55:58.294+0000 7f6350a8f700 1 Processor -- start 2023-07-05T18:55:58.297 INFO:teuthology.orchestra.run.smithi073.stderr:2023-07-05T18:55:58.294+0000 7f6350a8f700 1 -- start start 2023-07-05T18:55:58.304 INFO:teuthology.orchestra.run.smithi073.stderr:2023-07-05T18:55:58.295+0000 7f6350a8f700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f634c15c2f0 0x7f634c0cd2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:55:58.305 INFO:teuthology.orchestra.run.smithi073.stderr:2023-07-05T18:55:58.295+0000 7f6350a8f700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f634c15c6c0 0x7f634c06c760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:55:58.305 INFO:teuthology.orchestra.run.smithi073.stderr:2023-07-05T18:55:58.295+0000 7f6350a8f700 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f634c0cd8c0 con 0x7f634c0b5ae0 2023-07-05T18:55:58.305 INFO:teuthology.orchestra.run.smithi073.stderr:2023-07-05T18:55:58.295+0000 7f6350a8f700 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f634c0d0990 con 0x7f634c15c2f0 2023-07-05T18:55:58.306 INFO:teuthology.orchestra.run.smithi073.stderr:2023-07-05T18:55:58.295+0000 7f6350a8f700 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f634c0d0c70 con 0x7f634c15c6c0 2023-07-05T18:55:58.306 INFO:teuthology.orchestra.run.smithi073.stderr:2023-07-05T18:55:58.296+0000 7f6349d9b700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f634c15c6c0 0x7f634c06c760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:55:58.306 INFO:teuthology.orchestra.run.smithi073.stderr:2023-07-05T18:55:58.296+0000 7f6349d9b700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f634c15c6c0 0x7f634c06c760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:40554/0 (socket says 172.21.15.73:40554) 2023-07-05T18:55:58.307 INFO:teuthology.orchestra.run.smithi073.stderr:2023-07-05T18:55:58.296+0000 7f6349d9b700 1 -- 172.21.15.73:0/423901047 learned_addr learned my addr 172.21.15.73:0/423901047 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-07-05T18:55:58.307 INFO:teuthology.orchestra.run.smithi073.stderr:2023-07-05T18:55:58.296+0000 7f634a59c700 1 --2- 172.21.15.73:0/423901047 >> v2:172.21.15.46:3300/0 conn(0x7f634c15c2f0 0x7f634c0cd2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:55:58.307 INFO:teuthology.orchestra.run.smithi073.stderr:2023-07-05T18:55:58.296+0000 7f6349d9b700 1 -- 172.21.15.73:0/423901047 >> v2:172.21.15.46:3300/0 conn(0x7f634c15c2f0 msgr2=0x7f634c0cd2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-05T18:55:58.307 INFO:teuthology.orchestra.run.smithi073.stderr:2023-07-05T18:55:58.296+0000 7f6349d9b700 1 --2- 172.21.15.73:0/423901047 >> v2:172.21.15.46:3300/0 conn(0x7f634c15c2f0 0x7f634c0cd2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:55:58.308 INFO:teuthology.orchestra.run.smithi073.stderr:2023-07-05T18:55:58.296+0000 7f6349d9b700 1 -- 172.21.15.73:0/423901047 >> v1:172.21.15.46:6789/0 conn(0x7f634c0b5ae0 legacy=0x7f634c0d1450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:55:58.308 INFO:teuthology.orchestra.run.smithi073.stderr:2023-07-05T18:55:58.296+0000 7f6349d9b700 1 -- 172.21.15.73:0/423901047 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f634c0d0f50 con 0x7f634c15c6c0 2023-07-05T18:55:58.309 INFO:teuthology.orchestra.run.smithi073.stderr:2023-07-05T18:55:58.296+0000 7f6349d9b700 1 --2- 172.21.15.73:0/423901047 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f634c15c6c0 0x7f634c06c760 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f634c15ff70 tx=0x7f6340009bd0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c7a2745556807cd5 server_cookie=0 in_seq=0 out_seq=0 2023-07-05T18:55:58.310 INFO:teuthology.orchestra.run.smithi073.stderr:2023-07-05T18:55:58.296+0000 7f634959a700 1 -- 172.21.15.73:0/423901047 <== mon.1 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6340011830 con 0x7f634c15c6c0 2023-07-05T18:55:58.310 INFO:teuthology.orchestra.run.smithi073.stderr:2023-07-05T18:55:58.296+0000 7f634959a700 1 -- 172.21.15.73:0/423901047 <== mon.1 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6340011990 con 0x7f634c15c6c0 2023-07-05T18:55:58.310 INFO:teuthology.orchestra.run.smithi073.stderr:2023-07-05T18:55:58.296+0000 7f634959a700 1 -- 172.21.15.73:0/423901047 <== mon.1 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6340011d20 con 0x7f634c15c6c0 2023-07-05T18:55:58.310 INFO:teuthology.orchestra.run.smithi073.stderr:2023-07-05T18:55:58.297+0000 7f6350a8f700 1 -- 172.21.15.73:0/423901047 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f634c15c6c0 msgr2=0x7f634c06c760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:55:58.310 INFO:teuthology.orchestra.run.smithi073.stderr:2023-07-05T18:55:58.297+0000 7f6350a8f700 1 --2- 172.21.15.73:0/423901047 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f634c15c6c0 0x7f634c06c760 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f634c15ff70 tx=0x7f6340009bd0 comp rx=0 tx=0).stop 2023-07-05T18:55:58.310 INFO:teuthology.orchestra.run.smithi073.stderr:2023-07-05T18:55:58.297+0000 7f6350a8f700 1 -- 172.21.15.73:0/423901047 shutdown_connections 2023-07-05T18:55:58.311 INFO:teuthology.orchestra.run.smithi073.stderr:2023-07-05T18:55:58.297+0000 7f6350a8f700 1 --2- 172.21.15.73:0/423901047 >> v2:172.21.15.46:3300/0 conn(0x7f634c15c2f0 0x7f634c0cd2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:55:58.311 INFO:teuthology.orchestra.run.smithi073.stderr:2023-07-05T18:55:58.297+0000 7f6350a8f700 1 --2- 172.21.15.73:0/423901047 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f634c15c6c0 0x7f634c06c760 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:55:58.311 INFO:teuthology.orchestra.run.smithi073.stderr:2023-07-05T18:55:58.297+0000 7f6350a8f700 1 -- 172.21.15.73:0/423901047 >> 172.21.15.73:0/423901047 conn(0x7f634c06afa0 msgr2=0x7f634c0cf710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-05T18:55:58.311 INFO:teuthology.orchestra.run.smithi073.stderr:2023-07-05T18:55:58.297+0000 7f6350a8f700 1 -- 172.21.15.73:0/423901047 shutdown_connections 2023-07-05T18:55:58.311 INFO:teuthology.orchestra.run.smithi073.stderr:2023-07-05T18:55:58.297+0000 7f6350a8f700 1 -- 172.21.15.73:0/423901047 wait complete. 2023-07-05T18:55:58.312 INFO:teuthology.orchestra.run.smithi073.stderr:2023-07-05T18:55:58.298+0000 7f6350a8f700 1 Processor -- start 2023-07-05T18:55:58.313 INFO:teuthology.orchestra.run.smithi073.stderr:2023-07-05T18:55:58.298+0000 7f6350a8f700 1 -- start start 2023-07-05T18:55:58.313 INFO:teuthology.orchestra.run.smithi073.stderr:2023-07-05T18:55:58.299+0000 7f6350a8f700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f634c0b5ae0 0x7f634c0c5b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:55:58.313 INFO:teuthology.orchestra.run.smithi073.stderr:2023-07-05T18:55:58.299+0000 7f6350a8f700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f634c15c2f0 0x7f634c0cafd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:55:58.314 INFO:teuthology.orchestra.run.smithi073.stderr:2023-07-05T18:55:58.299+0000 7f6350a8f700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f634c15c6c0 0x7f634c0cc850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:55:58.314 INFO:teuthology.orchestra.run.smithi073.stderr:2023-07-05T18:55:58.299+0000 7f6350a8f700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f634c0cb640 con 0x7f634c15c6c0 2023-07-05T18:55:58.315 INFO:teuthology.orchestra.run.smithi073.stderr:2023-07-05T18:55:58.299+0000 7f6350a8f700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f634c0cba90 con 0x7f634c15c2f0 2023-07-05T18:55:58.315 INFO:teuthology.orchestra.run.smithi073.stderr:2023-07-05T18:55:58.299+0000 7f6350a8f700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f634c0cbd70 con 0x7f634c0b5ae0 2023-07-05T18:55:58.315 INFO:teuthology.orchestra.run.smithi073.stderr:2023-07-05T18:55:58.299+0000 7f6349d9b700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f634c15c2f0 0x7f634c0cafd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:55:58.315 INFO:teuthology.orchestra.run.smithi073.stderr:2023-07-05T18:55:58.299+0000 7f6349d9b700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f634c15c2f0 0x7f634c0cafd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:40560/0 (socket says 172.21.15.73:40560) 2023-07-05T18:55:58.316 INFO:teuthology.orchestra.run.smithi073.stderr:2023-07-05T18:55:58.299+0000 7f6349d9b700 1 -- 172.21.15.73:0/2951453721 learned_addr learned my addr 172.21.15.73:0/2951453721 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-07-05T18:55:58.316 INFO:teuthology.orchestra.run.smithi073.stderr:2023-07-05T18:55:58.299+0000 7f634ad9d700 1 --2- 172.21.15.73:0/2951453721 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f634c15c6c0 0x7f634c0cc850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:55:58.316 INFO:teuthology.orchestra.run.smithi073.stderr:2023-07-05T18:55:58.299+0000 7f634a59c700 1 --2- 172.21.15.73:0/2951453721 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f634c0b5ae0 0x7f634c0c5b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:55:58.320 INFO:teuthology.orchestra.run.smithi073.stderr:2023-07-05T18:55:58.299+0000 7f6349d9b700 1 -- 172.21.15.73:0/2951453721 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f634c0b5ae0 msgr2=0x7f634c0c5b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:55:58.320 INFO:teuthology.orchestra.run.smithi073.stderr:2023-07-05T18:55:58.299+0000 7f6349d9b700 1 --2- 172.21.15.73:0/2951453721 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f634c0b5ae0 0x7f634c0c5b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:55:58.320 INFO:teuthology.orchestra.run.smithi073.stderr:2023-07-05T18:55:58.299+0000 7f6349d9b700 1 -- 172.21.15.73:0/2951453721 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f634c15c6c0 msgr2=0x7f634c0cc850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:55:58.320 INFO:teuthology.orchestra.run.smithi073.stderr:2023-07-05T18:55:58.299+0000 7f6349d9b700 1 --2- 172.21.15.73:0/2951453721 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f634c15c6c0 0x7f634c0cc850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:55:58.320 INFO:teuthology.orchestra.run.smithi073.stderr:2023-07-05T18:55:58.299+0000 7f6349d9b700 1 -- 172.21.15.73:0/2951453721 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6340009550 con 0x7f634c15c2f0 2023-07-05T18:55:58.321 INFO:teuthology.orchestra.run.smithi073.stderr:2023-07-05T18:55:58.299+0000 7f634ad9d700 1 --2- 172.21.15.73:0/2951453721 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f634c15c6c0 0x7f634c0cc850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-05T18:55:58.321 INFO:teuthology.orchestra.run.smithi073.stderr:2023-07-05T18:55:58.300+0000 7f6349d9b700 1 --2- 172.21.15.73:0/2951453721 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f634c15c2f0 0x7f634c0cafd0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f6340000c00 tx=0x7f6340004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-05T18:55:58.325 INFO:teuthology.orchestra.run.smithi073.stderr:2023-07-05T18:55:58.300+0000 7f633affd700 1 -- 172.21.15.73:0/2951453721 <== mon.1 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6340004380 con 0x7f634c15c2f0 2023-07-05T18:55:58.326 INFO:teuthology.orchestra.run.smithi073.stderr:2023-07-05T18:55:58.300+0000 7f633affd700 1 -- 172.21.15.73:0/2951453721 <== mon.1 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f634001f070 con 0x7f634c15c2f0 2023-07-05T18:55:58.326 INFO:teuthology.orchestra.run.smithi073.stderr:2023-07-05T18:55:58.300+0000 7f6350a8f700 1 -- 172.21.15.73:0/2951453721 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f634c0cc050 con 0x7f634c15c2f0 2023-07-05T18:55:58.326 INFO:teuthology.orchestra.run.smithi073.stderr:2023-07-05T18:55:58.300+0000 7f633affd700 1 -- 172.21.15.73:0/2951453721 <== mon.1 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63400036a0 con 0x7f634c15c2f0 2023-07-05T18:55:58.327 INFO:teuthology.orchestra.run.smithi073.stderr:2023-07-05T18:55:58.300+0000 7f6350a8f700 1 -- 172.21.15.73:0/2951453721 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f634c0c6830 con 0x7f634c15c2f0 2023-07-05T18:55:58.327 INFO:teuthology.orchestra.run.smithi073.stderr:2023-07-05T18:55:58.300+0000 7f633affd700 1 -- 172.21.15.73:0/2951453721 <== mon.1 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f6340021030 con 0x7f634c15c2f0 2023-07-05T18:55:58.327 INFO:teuthology.orchestra.run.smithi073.stderr:2023-07-05T18:55:58.300+0000 7f633affd700 1 -- 172.21.15.73:0/2951453721 <== mon.1 v2:172.21.15.73:3300/0 5 ==== osd_map(7..7 src has 1..7) v4 ==== 1300+0+0 (secure 0 0 0) 0x7f6340024430 con 0x7f634c15c2f0 2023-07-05T18:55:58.327 INFO:teuthology.orchestra.run.smithi073.stderr:2023-07-05T18:55:58.301+0000 7f6338ff9700 1 -- 172.21.15.73:0/2951453721 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f63240052f0 con 0x7f634c15c2f0 2023-07-05T18:55:58.327 INFO:teuthology.orchestra.run.smithi073.stderr:2023-07-05T18:55:58.303+0000 7f633affd700 1 -- 172.21.15.73:0/2951453721 <== mon.1 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72429 (secure 0 0 0) 0x7f6340015020 con 0x7f634c15c2f0 2023-07-05T18:55:58.388 INFO:teuthology.orchestra.run.smithi073.stderr:2023-07-05T18:55:58.386+0000 7f6338ff9700 1 -- 172.21.15.73:0/2951453721 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd new", "uuid": "665f41c9-ee20-49cf-bf0e-fbe0c03d3aed", "id": 5} v 0) v1 -- 0x7f6324005910 con 0x7f634c15c2f0 2023-07-05T18:55:58.393 INFO:teuthology.orchestra.run.smithi073.stderr:2023-07-05T18:55:58.392+0000 7f633affd700 1 -- 172.21.15.73:0/2951453721 <== mon.1 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "665f41c9-ee20-49cf-bf0e-fbe0c03d3aed", "id": 5}]=0 v8) v1 ==== 112+0+2 (secure 0 0 0) 0x7f634001a520 con 0x7f634c15c2f0 2023-07-05T18:55:58.394 INFO:teuthology.orchestra.run.smithi073.stdout:5 2023-07-05T18:55:58.395 INFO:teuthology.orchestra.run.smithi073.stderr:2023-07-05T18:55:58.393+0000 7f6338ff9700 1 -- 172.21.15.73:0/2951453721 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f634c15c2f0 msgr2=0x7f634c0cafd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:55:58.395 INFO:teuthology.orchestra.run.smithi073.stderr:2023-07-05T18:55:58.393+0000 7f6338ff9700 1 --2- 172.21.15.73:0/2951453721 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f634c15c2f0 0x7f634c0cafd0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f6340000c00 tx=0x7f6340004750 comp rx=0 tx=0).stop 2023-07-05T18:55:58.395 INFO:teuthology.orchestra.run.smithi073.stderr:2023-07-05T18:55:58.393+0000 7f6338ff9700 1 -- 172.21.15.73:0/2951453721 shutdown_connections 2023-07-05T18:55:58.395 INFO:teuthology.orchestra.run.smithi073.stderr:2023-07-05T18:55:58.393+0000 7f6338ff9700 1 --2- 172.21.15.73:0/2951453721 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f634c15c6c0 0x7f634c0cc850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:55:58.395 INFO:teuthology.orchestra.run.smithi073.stderr:2023-07-05T18:55:58.393+0000 7f6338ff9700 1 --2- 172.21.15.73:0/2951453721 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f634c0b5ae0 0x7f634c0c5b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:55:58.396 INFO:teuthology.orchestra.run.smithi073.stderr:2023-07-05T18:55:58.393+0000 7f6338ff9700 1 --2- 172.21.15.73:0/2951453721 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f634c15c2f0 0x7f634c0cafd0 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:55:58.396 INFO:teuthology.orchestra.run.smithi073.stderr:2023-07-05T18:55:58.393+0000 7f6338ff9700 1 -- 172.21.15.73:0/2951453721 >> 172.21.15.73:0/2951453721 conn(0x7f634c06afa0 msgr2=0x7f634c15b480 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-05T18:55:58.396 INFO:teuthology.orchestra.run.smithi073.stderr:2023-07-05T18:55:58.393+0000 7f6338ff9700 1 -- 172.21.15.73:0/2951453721 shutdown_connections 2023-07-05T18:55:58.396 INFO:teuthology.orchestra.run.smithi073.stderr:2023-07-05T18:55:58.393+0000 7f6338ff9700 1 -- 172.21.15.73:0/2951453721 wait complete. 2023-07-05T18:55:58.407 DEBUG:teuthology.orchestra.run.smithi073:> sudo ceph --cluster ceph osd new 5790c6cc-bd56-4ce4-9a7c-0f0c3b59215c 6 2023-07-05T18:55:58.553 INFO:teuthology.orchestra.run.smithi073.stderr:2023-07-05T18:55:58.551+0000 7fd0364f6700 1 Processor -- start 2023-07-05T18:55:58.553 INFO:teuthology.orchestra.run.smithi073.stderr:2023-07-05T18:55:58.551+0000 7fd0364f6700 1 -- start start 2023-07-05T18:55:58.556 INFO:teuthology.orchestra.run.smithi073.stderr:2023-07-05T18:55:58.552+0000 7fd0364f6700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fd03015a1d0 0x7fd03015a5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:55:58.556 INFO:teuthology.orchestra.run.smithi073.stderr:2023-07-05T18:55:58.552+0000 7fd0364f6700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fd03006a980 0x7fd03006b3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:55:58.557 INFO:teuthology.orchestra.run.smithi073.stderr:2023-07-05T18:55:58.552+0000 7fd0364f6700 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd030071b40 con 0x7fd030071370 2023-07-05T18:55:58.557 INFO:teuthology.orchestra.run.smithi073.stderr:2023-07-05T18:55:58.552+0000 7fd0364f6700 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd03006add0 con 0x7fd03015a1d0 2023-07-05T18:55:58.557 INFO:teuthology.orchestra.run.smithi073.stderr:2023-07-05T18:55:58.552+0000 7fd0364f6700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd030069ea0 con 0x7fd03006a980 2023-07-05T18:55:58.557 INFO:teuthology.orchestra.run.smithi073.stderr:2023-07-05T18:55:58.552+0000 7fd034a93700 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7fd030071370 0x7fd0300ce580 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:60112/0 (socket says 172.21.15.73:60112) 2023-07-05T18:55:58.557 INFO:teuthology.orchestra.run.smithi073.stderr:2023-07-05T18:55:58.552+0000 7fd034a93700 1 -- 172.21.15.73:0/3936800604 learned_addr learned my addr 172.21.15.73:0/3936800604 (peer_addr_for_me v1:172.21.15.73:0/0) 2023-07-05T18:55:58.558 INFO:teuthology.orchestra.run.smithi073.stderr:2023-07-05T18:55:58.552+0000 7fd02f7fe700 1 --2- 172.21.15.73:0/3936800604 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fd03006a980 0x7fd03006b3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:55:58.558 INFO:teuthology.orchestra.run.smithi073.stderr:2023-07-05T18:55:58.552+0000 7fd02ffff700 1 --2- 172.21.15.73:0/3936800604 >> v2:172.21.15.46:3300/0 conn(0x7fd03015a1d0 0x7fd03015a5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:55:58.558 INFO:teuthology.orchestra.run.smithi073.stderr:2023-07-05T18:55:58.552+0000 7fd02effd700 1 -- 172.21.15.73:0/3936800604 <== mon.1 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3146469482 0 0) 0x7fd030071b40 con 0x7fd030071370 2023-07-05T18:55:58.558 INFO:teuthology.orchestra.run.smithi073.stderr:2023-07-05T18:55:58.552+0000 7fd02effd700 1 -- 172.21.15.73:0/3936800604 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd0180035b0 con 0x7fd030071370 2023-07-05T18:55:58.558 INFO:teuthology.orchestra.run.smithi073.stderr:2023-07-05T18:55:58.552+0000 7fd02f7fe700 1 -- 172.21.15.73:0/3936800604 >> v2:172.21.15.46:3300/0 conn(0x7fd03015a1d0 msgr2=0x7fd03015a5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-05T18:55:58.559 INFO:teuthology.orchestra.run.smithi073.stderr:2023-07-05T18:55:58.552+0000 7fd02f7fe700 1 --2- 172.21.15.73:0/3936800604 >> v2:172.21.15.46:3300/0 conn(0x7fd03015a1d0 0x7fd03015a5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:55:58.559 INFO:teuthology.orchestra.run.smithi073.stderr:2023-07-05T18:55:58.552+0000 7fd02f7fe700 1 -- 172.21.15.73:0/3936800604 >> v1:172.21.15.73:6789/0 conn(0x7fd030071370 legacy=0x7fd0300ce580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:55:58.559 INFO:teuthology.orchestra.run.smithi073.stderr:2023-07-05T18:55:58.552+0000 7fd02f7fe700 1 -- 172.21.15.73:0/3936800604 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd03006a180 con 0x7fd03006a980 2023-07-05T18:55:58.559 INFO:teuthology.orchestra.run.smithi073.stderr:2023-07-05T18:55:58.553+0000 7fd02f7fe700 1 --2- 172.21.15.73:0/3936800604 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fd03006a980 0x7fd03006b3d0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7fd024009840 tx=0x7fd024009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=db32008df2c04460 server_cookie=0 in_seq=0 out_seq=0 2023-07-05T18:55:58.560 INFO:teuthology.orchestra.run.smithi073.stderr:2023-07-05T18:55:58.553+0000 7fd02effd700 1 -- 172.21.15.73:0/3936800604 <== mon.2 v2:172.21.15.73:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd024011830 con 0x7fd03006a980 2023-07-05T18:55:58.560 INFO:teuthology.orchestra.run.smithi073.stderr:2023-07-05T18:55:58.553+0000 7fd02effd700 1 -- 172.21.15.73:0/3936800604 <== mon.2 v2:172.21.15.73:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd024011990 con 0x7fd03006a980 2023-07-05T18:55:58.560 INFO:teuthology.orchestra.run.smithi073.stderr:2023-07-05T18:55:58.553+0000 7fd02effd700 1 -- 172.21.15.73:0/3936800604 <== mon.2 v2:172.21.15.73:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd024011d20 con 0x7fd03006a980 2023-07-05T18:55:58.560 INFO:teuthology.orchestra.run.smithi073.stderr:2023-07-05T18:55:58.553+0000 7fd0364f6700 1 -- 172.21.15.73:0/3936800604 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fd03006a980 msgr2=0x7fd03006b3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:55:58.561 INFO:teuthology.orchestra.run.smithi073.stderr:2023-07-05T18:55:58.553+0000 7fd0364f6700 1 --2- 172.21.15.73:0/3936800604 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fd03006a980 0x7fd03006b3d0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7fd024009840 tx=0x7fd024009b50 comp rx=0 tx=0).stop 2023-07-05T18:55:58.561 INFO:teuthology.orchestra.run.smithi073.stderr:2023-07-05T18:55:58.553+0000 7fd0364f6700 1 -- 172.21.15.73:0/3936800604 shutdown_connections 2023-07-05T18:55:58.561 INFO:teuthology.orchestra.run.smithi073.stderr:2023-07-05T18:55:58.553+0000 7fd0364f6700 1 --2- 172.21.15.73:0/3936800604 >> v2:172.21.15.46:3300/0 conn(0x7fd03015a1d0 0x7fd03015a5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:55:58.562 INFO:teuthology.orchestra.run.smithi073.stderr:2023-07-05T18:55:58.553+0000 7fd0364f6700 1 --2- 172.21.15.73:0/3936800604 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fd03006a980 0x7fd03006b3d0 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:55:58.562 INFO:teuthology.orchestra.run.smithi073.stderr:2023-07-05T18:55:58.553+0000 7fd0364f6700 1 -- 172.21.15.73:0/3936800604 >> 172.21.15.73:0/3936800604 conn(0x7fd0300b0d50 msgr2=0x7fd0300b1150 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-05T18:55:58.562 INFO:teuthology.orchestra.run.smithi073.stderr:2023-07-05T18:55:58.553+0000 7fd0364f6700 1 -- 172.21.15.73:0/3936800604 shutdown_connections 2023-07-05T18:55:58.563 INFO:teuthology.orchestra.run.smithi073.stderr:2023-07-05T18:55:58.553+0000 7fd0364f6700 1 -- 172.21.15.73:0/3936800604 wait complete. 2023-07-05T18:55:58.563 INFO:teuthology.orchestra.run.smithi073.stderr:2023-07-05T18:55:58.555+0000 7fd0364f6700 1 Processor -- start 2023-07-05T18:55:58.566 INFO:teuthology.orchestra.run.smithi073.stderr:2023-07-05T18:55:58.555+0000 7fd0364f6700 1 -- start start 2023-07-05T18:55:58.566 INFO:teuthology.orchestra.run.smithi073.stderr:2023-07-05T18:55:58.555+0000 7fd0364f6700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd03006a980 0x7fd03014ab70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:55:58.567 INFO:teuthology.orchestra.run.smithi073.stderr:2023-07-05T18:55:58.555+0000 7fd0364f6700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd030071370 0x7fd03014be50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:55:58.567 INFO:teuthology.orchestra.run.smithi073.stderr:2023-07-05T18:55:58.555+0000 7fd0364f6700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fd03015a1d0 0x7fd0300b37a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:55:58.567 INFO:teuthology.orchestra.run.smithi073.stderr:2023-07-05T18:55:58.555+0000 7fd0364f6700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0301533a0 con 0x7fd030071370 2023-07-05T18:55:58.567 INFO:teuthology.orchestra.run.smithi073.stderr:2023-07-05T18:55:58.555+0000 7fd0364f6700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0300b3310 con 0x7fd03006a980 2023-07-05T18:55:58.568 INFO:teuthology.orchestra.run.smithi073.stderr:2023-07-05T18:55:58.555+0000 7fd0364f6700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd0300b2740 con 0x7fd03015a1d0 2023-07-05T18:55:58.568 INFO:teuthology.orchestra.run.smithi073.stderr:2023-07-05T18:55:58.556+0000 7fd02ffff700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd03006a980 0x7fd03014ab70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:55:58.568 INFO:teuthology.orchestra.run.smithi073.stderr:2023-07-05T18:55:58.556+0000 7fd034a93700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fd03015a1d0 0x7fd0300b37a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:55:58.568 INFO:teuthology.orchestra.run.smithi073.stderr:2023-07-05T18:55:58.556+0000 7fd02ffff700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd03006a980 0x7fd03014ab70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:40570/0 (socket says 172.21.15.73:40570) 2023-07-05T18:55:58.569 INFO:teuthology.orchestra.run.smithi073.stderr:2023-07-05T18:55:58.556+0000 7fd02ffff700 1 -- 172.21.15.73:0/325945594 learned_addr learned my addr 172.21.15.73:0/325945594 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-07-05T18:55:58.569 INFO:teuthology.orchestra.run.smithi073.stderr:2023-07-05T18:55:58.556+0000 7fd02f7fe700 1 --2- 172.21.15.73:0/325945594 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd030071370 0x7fd03014be50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:55:58.569 INFO:teuthology.orchestra.run.smithi073.stderr:2023-07-05T18:55:58.556+0000 7fd02ffff700 1 -- 172.21.15.73:0/325945594 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fd03015a1d0 msgr2=0x7fd0300b37a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:55:58.569 INFO:teuthology.orchestra.run.smithi073.stderr:2023-07-05T18:55:58.556+0000 7fd02ffff700 1 --2- 172.21.15.73:0/325945594 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fd03015a1d0 0x7fd0300b37a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:55:58.569 INFO:teuthology.orchestra.run.smithi073.stderr:2023-07-05T18:55:58.556+0000 7fd02ffff700 1 -- 172.21.15.73:0/325945594 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd030071370 msgr2=0x7fd03014be50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:55:58.569 INFO:teuthology.orchestra.run.smithi073.stderr:2023-07-05T18:55:58.556+0000 7fd02ffff700 1 --2- 172.21.15.73:0/325945594 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd030071370 0x7fd03014be50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:55:58.570 INFO:teuthology.orchestra.run.smithi073.stderr:2023-07-05T18:55:58.556+0000 7fd02ffff700 1 -- 172.21.15.73:0/325945594 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd0240094a0 con 0x7fd03006a980 2023-07-05T18:55:58.570 INFO:teuthology.orchestra.run.smithi073.stderr:2023-07-05T18:55:58.556+0000 7fd02ffff700 1 --2- 172.21.15.73:0/325945594 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd03006a980 0x7fd03014ab70 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7fd02000e870 tx=0x7fd02000eb80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-05T18:55:58.570 INFO:teuthology.orchestra.run.smithi073.stderr:2023-07-05T18:55:58.556+0000 7fd02cff9700 1 -- 172.21.15.73:0/325945594 <== mon.1 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd020009590 con 0x7fd03006a980 2023-07-05T18:55:58.570 INFO:teuthology.orchestra.run.smithi073.stderr:2023-07-05T18:55:58.556+0000 7fd02cff9700 1 -- 172.21.15.73:0/325945594 <== mon.1 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd020013680 con 0x7fd03006a980 2023-07-05T18:55:58.570 INFO:teuthology.orchestra.run.smithi073.stderr:2023-07-05T18:55:58.556+0000 7fd0364f6700 1 -- 172.21.15.73:0/325945594 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd0300b29e0 con 0x7fd03006a980 2023-07-05T18:55:58.571 INFO:teuthology.orchestra.run.smithi073.stderr:2023-07-05T18:55:58.556+0000 7fd02cff9700 1 -- 172.21.15.73:0/325945594 <== mon.1 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0200139f0 con 0x7fd03006a980 2023-07-05T18:55:58.571 INFO:teuthology.orchestra.run.smithi073.stderr:2023-07-05T18:55:58.556+0000 7fd0364f6700 1 -- 172.21.15.73:0/325945594 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd0300b2fa0 con 0x7fd03006a980 2023-07-05T18:55:58.571 INFO:teuthology.orchestra.run.smithi073.stderr:2023-07-05T18:55:58.556+0000 7fd02cff9700 1 -- 172.21.15.73:0/325945594 <== mon.1 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7fd020005a20 con 0x7fd03006a980 2023-07-05T18:55:58.571 INFO:teuthology.orchestra.run.smithi073.stderr:2023-07-05T18:55:58.556+0000 7fd02cff9700 1 -- 172.21.15.73:0/325945594 <== mon.1 v2:172.21.15.73:3300/0 5 ==== osd_map(8..8 src has 1..8) v4 ==== 1415+0+0 (secure 0 0 0) 0x7fd020006700 con 0x7fd03006a980 2023-07-05T18:55:58.571 INFO:teuthology.orchestra.run.smithi073.stderr:2023-07-05T18:55:58.557+0000 7fd0364f6700 1 -- 172.21.15.73:0/325945594 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd030071e00 con 0x7fd03006a980 2023-07-05T18:55:58.571 INFO:teuthology.orchestra.run.smithi073.stderr:2023-07-05T18:55:58.559+0000 7fd02cff9700 1 -- 172.21.15.73:0/325945594 <== mon.1 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72429 (secure 0 0 0) 0x7fd030071e00 con 0x7fd03006a980 2023-07-05T18:55:58.644 INFO:teuthology.orchestra.run.smithi073.stderr:2023-07-05T18:55:58.643+0000 7fd0364f6700 1 -- 172.21.15.73:0/325945594 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd new", "uuid": "5790c6cc-bd56-4ce4-9a7c-0f0c3b59215c", "id": 6} v 0) v1 -- 0x7fd0300672e0 con 0x7fd03006a980 2023-07-05T18:55:58.650 INFO:teuthology.orchestra.run.smithi073.stderr:2023-07-05T18:55:58.649+0000 7fd02cff9700 1 -- 172.21.15.73:0/325945594 <== mon.1 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "5790c6cc-bd56-4ce4-9a7c-0f0c3b59215c", "id": 6}]=0 v9) v1 ==== 112+0+2 (secure 0 0 0) 0x7fd020021060 con 0x7fd03006a980 2023-07-05T18:55:58.651 INFO:teuthology.orchestra.run.smithi073.stdout:6 2023-07-05T18:55:58.652 INFO:teuthology.orchestra.run.smithi073.stderr:2023-07-05T18:55:58.650+0000 7fd0364f6700 1 -- 172.21.15.73:0/325945594 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd03006a980 msgr2=0x7fd03014ab70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:55:58.652 INFO:teuthology.orchestra.run.smithi073.stderr:2023-07-05T18:55:58.650+0000 7fd0364f6700 1 --2- 172.21.15.73:0/325945594 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd03006a980 0x7fd03014ab70 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7fd02000e870 tx=0x7fd02000eb80 comp rx=0 tx=0).stop 2023-07-05T18:55:58.653 INFO:teuthology.orchestra.run.smithi073.stderr:2023-07-05T18:55:58.650+0000 7fd0364f6700 1 -- 172.21.15.73:0/325945594 shutdown_connections 2023-07-05T18:55:58.653 INFO:teuthology.orchestra.run.smithi073.stderr:2023-07-05T18:55:58.650+0000 7fd0364f6700 1 --2- 172.21.15.73:0/325945594 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fd03015a1d0 0x7fd0300b37a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:55:58.653 INFO:teuthology.orchestra.run.smithi073.stderr:2023-07-05T18:55:58.650+0000 7fd0364f6700 1 --2- 172.21.15.73:0/325945594 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd03006a980 0x7fd03014ab70 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:55:58.653 INFO:teuthology.orchestra.run.smithi073.stderr:2023-07-05T18:55:58.650+0000 7fd0364f6700 1 --2- 172.21.15.73:0/325945594 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd030071370 0x7fd03014be50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:55:58.653 INFO:teuthology.orchestra.run.smithi073.stderr:2023-07-05T18:55:58.650+0000 7fd0364f6700 1 -- 172.21.15.73:0/325945594 >> 172.21.15.73:0/325945594 conn(0x7fd0300b0d50 msgr2=0x7fd0300af350 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-05T18:55:58.653 INFO:teuthology.orchestra.run.smithi073.stderr:2023-07-05T18:55:58.650+0000 7fd0364f6700 1 -- 172.21.15.73:0/325945594 shutdown_connections 2023-07-05T18:55:58.654 INFO:teuthology.orchestra.run.smithi073.stderr:2023-07-05T18:55:58.650+0000 7fd0364f6700 1 -- 172.21.15.73:0/325945594 wait complete. 2023-07-05T18:55:58.660 INFO:tasks.ceph.mgr.x.smithi073.stderr:2023-07-05T18:55:58.659+0000 7fbd956e1200 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-07-05T18:55:58.663 DEBUG:teuthology.orchestra.run.smithi073:> sudo ceph --cluster ceph osd new b66f4d2e-147e-4c9b-97dd-cbd59d33802e 7 2023-07-05T18:55:58.695 INFO:tasks.ceph.mgr.y.smithi046.stderr:2023-07-05T18:55:58.693+0000 7fd435390200 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-07-05T18:55:58.787 INFO:teuthology.orchestra.run.smithi073.stderr:2023-07-05T18:55:58.785+0000 7fa31f873700 1 Processor -- start 2023-07-05T18:55:58.787 INFO:teuthology.orchestra.run.smithi073.stderr:2023-07-05T18:55:58.785+0000 7fa31f873700 1 -- start start 2023-07-05T18:55:58.788 INFO:teuthology.orchestra.run.smithi073.stderr:2023-07-05T18:55:58.786+0000 7fa31f873700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fa3180aeed0 0x7fa318069e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:55:58.789 INFO:teuthology.orchestra.run.smithi073.stderr:2023-07-05T18:55:58.786+0000 7fa31f873700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fa31815d190 0x7fa31806a340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:55:58.789 INFO:teuthology.orchestra.run.smithi073.stderr:2023-07-05T18:55:58.786+0000 7fa31f873700 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa31806caf0 con 0x7fa3180b35c0 2023-07-05T18:55:58.789 INFO:teuthology.orchestra.run.smithi073.stderr:2023-07-05T18:55:58.786+0000 7fa31f873700 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa31815d9b0 con 0x7fa3180aeed0 2023-07-05T18:55:58.789 INFO:teuthology.orchestra.run.smithi073.stderr:2023-07-05T18:55:58.786+0000 7fa31f873700 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa3180b3130 con 0x7fa31815d190 2023-07-05T18:55:58.789 INFO:teuthology.orchestra.run.smithi073.stderr:2023-07-05T18:55:58.786+0000 7fa31de10700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fa31815d190 0x7fa31806a340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:55:58.796 INFO:teuthology.orchestra.run.smithi073.stderr:2023-07-05T18:55:58.786+0000 7fa31de10700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fa31815d190 0x7fa31806a340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:40580/0 (socket says 172.21.15.73:40580) 2023-07-05T18:55:58.796 INFO:teuthology.orchestra.run.smithi073.stderr:2023-07-05T18:55:58.786+0000 7fa31de10700 1 -- 172.21.15.73:0/2076322891 learned_addr learned my addr 172.21.15.73:0/2076322891 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-07-05T18:55:58.797 INFO:teuthology.orchestra.run.smithi073.stderr:2023-07-05T18:55:58.786+0000 7fa31d60f700 1 --2- 172.21.15.73:0/2076322891 >> v2:172.21.15.46:3300/0 conn(0x7fa3180aeed0 0x7fa318069e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:55:58.797 INFO:teuthology.orchestra.run.smithi073.stderr:2023-07-05T18:55:58.787+0000 7fa31de10700 1 -- 172.21.15.73:0/2076322891 >> v2:172.21.15.46:3300/0 conn(0x7fa3180aeed0 msgr2=0x7fa318069e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-05T18:55:58.797 INFO:teuthology.orchestra.run.smithi073.stderr:2023-07-05T18:55:58.787+0000 7fa31de10700 1 --2- 172.21.15.73:0/2076322891 >> v2:172.21.15.46:3300/0 conn(0x7fa3180aeed0 0x7fa318069e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:55:58.798 INFO:teuthology.orchestra.run.smithi073.stderr:2023-07-05T18:55:58.787+0000 7fa31de10700 1 -- 172.21.15.73:0/2076322891 >> v1:172.21.15.46:6789/0 conn(0x7fa3180b35c0 legacy=0x7fa31815ca80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:55:58.798 INFO:teuthology.orchestra.run.smithi073.stderr:2023-07-05T18:55:58.787+0000 7fa31de10700 1 -- 172.21.15.73:0/2076322891 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa31815d6d0 con 0x7fa31815d190 2023-07-05T18:55:58.798 INFO:teuthology.orchestra.run.smithi073.stderr:2023-07-05T18:55:58.787+0000 7fa31de10700 1 --2- 172.21.15.73:0/2076322891 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa31815d190 0x7fa31806a340 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7fa3180706c0 tx=0x7fa31000b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d9271381c44a98d0 server_cookie=0 in_seq=0 out_seq=0 2023-07-05T18:55:58.799 INFO:teuthology.orchestra.run.smithi073.stderr:2023-07-05T18:55:58.787+0000 7fa30ffff700 1 -- 172.21.15.73:0/2076322891 <== mon.1 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa31000e070 con 0x7fa31815d190 2023-07-05T18:55:58.800 INFO:teuthology.orchestra.run.smithi073.stderr:2023-07-05T18:55:58.787+0000 7fa30ffff700 1 -- 172.21.15.73:0/2076322891 <== mon.1 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa31000b910 con 0x7fa31815d190 2023-07-05T18:55:58.800 INFO:teuthology.orchestra.run.smithi073.stderr:2023-07-05T18:55:58.787+0000 7fa30ffff700 1 -- 172.21.15.73:0/2076322891 <== mon.1 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa31000bcc0 con 0x7fa31815d190 2023-07-05T18:55:58.802 INFO:teuthology.orchestra.run.smithi073.stderr:2023-07-05T18:55:58.788+0000 7fa31f873700 1 -- 172.21.15.73:0/2076322891 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa31815d190 msgr2=0x7fa31806a340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:55:58.803 INFO:teuthology.orchestra.run.smithi073.stderr:2023-07-05T18:55:58.788+0000 7fa31f873700 1 --2- 172.21.15.73:0/2076322891 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa31815d190 0x7fa31806a340 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7fa3180706c0 tx=0x7fa31000b330 comp rx=0 tx=0).stop 2023-07-05T18:55:58.803 INFO:teuthology.orchestra.run.smithi073.stderr:2023-07-05T18:55:58.788+0000 7fa31f873700 1 -- 172.21.15.73:0/2076322891 shutdown_connections 2023-07-05T18:55:58.803 INFO:teuthology.orchestra.run.smithi073.stderr:2023-07-05T18:55:58.788+0000 7fa31f873700 1 --2- 172.21.15.73:0/2076322891 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa31815d190 0x7fa31806a340 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:55:58.803 INFO:teuthology.orchestra.run.smithi073.stderr:2023-07-05T18:55:58.788+0000 7fa31f873700 1 --2- 172.21.15.73:0/2076322891 >> v2:172.21.15.46:3300/0 conn(0x7fa3180aeed0 0x7fa318069e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:55:58.803 INFO:teuthology.orchestra.run.smithi073.stderr:2023-07-05T18:55:58.788+0000 7fa31f873700 1 -- 172.21.15.73:0/2076322891 >> 172.21.15.73:0/2076322891 conn(0x7fa31806af10 msgr2=0x7fa31806b2e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-05T18:55:58.803 INFO:teuthology.orchestra.run.smithi073.stderr:2023-07-05T18:55:58.788+0000 7fa31f873700 1 -- 172.21.15.73:0/2076322891 shutdown_connections 2023-07-05T18:55:58.804 INFO:teuthology.orchestra.run.smithi073.stderr:2023-07-05T18:55:58.788+0000 7fa31f873700 1 -- 172.21.15.73:0/2076322891 wait complete. 2023-07-05T18:55:58.804 INFO:teuthology.orchestra.run.smithi073.stderr:2023-07-05T18:55:58.789+0000 7fa31f873700 1 Processor -- start 2023-07-05T18:55:58.804 INFO:teuthology.orchestra.run.smithi073.stderr:2023-07-05T18:55:58.789+0000 7fa31f873700 1 -- start start 2023-07-05T18:55:58.804 INFO:teuthology.orchestra.run.smithi073.stderr:2023-07-05T18:55:58.790+0000 7fa31f873700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa3180aeed0 0x7fa31813f750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:55:58.804 INFO:teuthology.orchestra.run.smithi073.stderr:2023-07-05T18:55:58.790+0000 7fa31f873700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa3180b35c0 0x7fa318158b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:55:58.805 INFO:teuthology.orchestra.run.smithi073.stderr:2023-07-05T18:55:58.790+0000 7fa31f873700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fa31815d190 0x7fa3180cd690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:55:58.805 INFO:teuthology.orchestra.run.smithi073.stderr:2023-07-05T18:55:58.790+0000 7fa31f873700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa318140f40 con 0x7fa3180aeed0 2023-07-05T18:55:58.806 INFO:teuthology.orchestra.run.smithi073.stderr:2023-07-05T18:55:58.790+0000 7fa31f873700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa31813ffe0 con 0x7fa3180b35c0 2023-07-05T18:55:58.806 INFO:teuthology.orchestra.run.smithi073.stderr:2023-07-05T18:55:58.790+0000 7fa31f873700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa3181402c0 con 0x7fa31815d190 2023-07-05T18:55:58.806 INFO:teuthology.orchestra.run.smithi073.stderr:2023-07-05T18:55:58.790+0000 7fa31d60f700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa3180aeed0 0x7fa31813f750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:55:58.806 INFO:teuthology.orchestra.run.smithi073.stderr:2023-07-05T18:55:58.790+0000 7fa31ce0e700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa3180b35c0 0x7fa318158b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:55:58.806 INFO:teuthology.orchestra.run.smithi073.stderr:2023-07-05T18:55:58.790+0000 7fa31de10700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fa31815d190 0x7fa3180cd690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:55:58.807 INFO:teuthology.orchestra.run.smithi073.stderr:2023-07-05T18:55:58.790+0000 7fa31d60f700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa3180aeed0 0x7fa31813f750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.73:51566/0 (socket says 172.21.15.73:51566) 2023-07-05T18:55:58.807 INFO:teuthology.orchestra.run.smithi073.stderr:2023-07-05T18:55:58.790+0000 7fa31d60f700 1 -- 172.21.15.73:0/1076632182 learned_addr learned my addr 172.21.15.73:0/1076632182 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-07-05T18:55:58.807 INFO:teuthology.orchestra.run.smithi073.stderr:2023-07-05T18:55:58.790+0000 7fa31ce0e700 1 -- 172.21.15.73:0/1076632182 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fa31815d190 msgr2=0x7fa3180cd690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:55:58.807 INFO:teuthology.orchestra.run.smithi073.stderr:2023-07-05T18:55:58.790+0000 7fa31ce0e700 1 --2- 172.21.15.73:0/1076632182 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fa31815d190 0x7fa3180cd690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:55:58.807 INFO:teuthology.orchestra.run.smithi073.stderr:2023-07-05T18:55:58.790+0000 7fa31ce0e700 1 -- 172.21.15.73:0/1076632182 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa3180aeed0 msgr2=0x7fa31813f750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:55:58.807 INFO:teuthology.orchestra.run.smithi073.stderr:2023-07-05T18:55:58.790+0000 7fa31ce0e700 1 --2- 172.21.15.73:0/1076632182 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa3180aeed0 0x7fa31813f750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:55:58.807 INFO:teuthology.orchestra.run.smithi073.stderr:2023-07-05T18:55:58.790+0000 7fa31ce0e700 1 -- 172.21.15.73:0/1076632182 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa310009b30 con 0x7fa3180b35c0 2023-07-05T18:55:58.808 INFO:teuthology.orchestra.run.smithi073.stderr:2023-07-05T18:55:58.790+0000 7fa31d60f700 1 --2- 172.21.15.73:0/1076632182 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa3180aeed0 0x7fa31813f750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-05T18:55:58.808 INFO:teuthology.orchestra.run.smithi073.stderr:2023-07-05T18:55:58.790+0000 7fa31de10700 1 --2- 172.21.15.73:0/1076632182 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fa31815d190 0x7fa3180cd690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-05T18:55:58.808 INFO:teuthology.orchestra.run.smithi073.stderr:2023-07-05T18:55:58.790+0000 7fa31ce0e700 1 --2- 172.21.15.73:0/1076632182 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa3180b35c0 0x7fa318158b10 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7fa308000f60 tx=0x7fa30800c730 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-05T18:55:58.808 INFO:teuthology.orchestra.run.smithi073.stderr:2023-07-05T18:55:58.790+0000 7fa30dffb700 1 -- 172.21.15.73:0/1076632182 <== mon.1 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3080052d0 con 0x7fa3180b35c0 2023-07-05T18:55:58.808 INFO:teuthology.orchestra.run.smithi073.stderr:2023-07-05T18:55:58.790+0000 7fa30dffb700 1 -- 172.21.15.73:0/1076632182 <== mon.1 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa308005430 con 0x7fa3180b35c0 2023-07-05T18:55:58.808 INFO:teuthology.orchestra.run.smithi073.stderr:2023-07-05T18:55:58.790+0000 7fa31f873700 1 -- 172.21.15.73:0/1076632182 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa3181405a0 con 0x7fa3180b35c0 2023-07-05T18:55:58.808 INFO:teuthology.orchestra.run.smithi073.stderr:2023-07-05T18:55:58.790+0000 7fa30dffb700 1 -- 172.21.15.73:0/1076632182 <== mon.1 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3080038c0 con 0x7fa3180b35c0 2023-07-05T18:55:58.809 INFO:teuthology.orchestra.run.smithi073.stderr:2023-07-05T18:55:58.790+0000 7fa30dffb700 1 -- 172.21.15.73:0/1076632182 <== mon.1 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7fa308003d20 con 0x7fa3180b35c0 2023-07-05T18:55:58.809 INFO:teuthology.orchestra.run.smithi073.stderr:2023-07-05T18:55:58.790+0000 7fa31f873700 1 -- 172.21.15.73:0/1076632182 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa318140b60 con 0x7fa3180b35c0 2023-07-05T18:55:58.809 INFO:teuthology.orchestra.run.smithi073.stderr:2023-07-05T18:55:58.791+0000 7fa30dffb700 1 -- 172.21.15.73:0/1076632182 <== mon.1 v2:172.21.15.73:3300/0 5 ==== osd_map(9..9 src has 1..9) v4 ==== 1530+0+0 (secure 0 0 0) 0x7fa30800ce30 con 0x7fa3180b35c0 2023-07-05T18:55:58.810 INFO:teuthology.orchestra.run.smithi073.stderr:2023-07-05T18:55:58.792+0000 7fa31f873700 1 -- 172.21.15.73:0/1076632182 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa318141080 con 0x7fa3180b35c0 2023-07-05T18:55:58.810 INFO:teuthology.orchestra.run.smithi073.stderr:2023-07-05T18:55:58.794+0000 7fa30dffb700 1 -- 172.21.15.73:0/1076632182 <== mon.1 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72429 (secure 0 0 0) 0x7fa318141080 con 0x7fa3180b35c0 2023-07-05T18:55:58.824 INFO:tasks.ceph.mgr.x.smithi073.stderr:2023-07-05T18:55:58.822+0000 7fbd956e1200 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-07-05T18:55:58.857 INFO:tasks.ceph.mgr.y.smithi046.stderr:2023-07-05T18:55:58.855+0000 7fd435390200 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-07-05T18:55:58.882 INFO:teuthology.orchestra.run.smithi073.stderr:2023-07-05T18:55:58.877+0000 7fa31f873700 1 -- 172.21.15.73:0/1076632182 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd new", "uuid": "b66f4d2e-147e-4c9b-97dd-cbd59d33802e", "id": 7} v 0) v1 -- 0x7fa3180672e0 con 0x7fa3180b35c0 2023-07-05T18:55:58.888 INFO:teuthology.orchestra.run.smithi073.stderr:2023-07-05T18:55:58.886+0000 7fa30dffb700 1 -- 172.21.15.73:0/1076632182 <== mon.1 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "b66f4d2e-147e-4c9b-97dd-cbd59d33802e", "id": 7}]=0 v10) v1 ==== 112+0+2 (secure 0 0 0) 0x7fa308021060 con 0x7fa3180b35c0 2023-07-05T18:55:58.888 INFO:teuthology.orchestra.run.smithi073.stdout:7 2023-07-05T18:55:58.889 INFO:teuthology.orchestra.run.smithi073.stderr:2023-07-05T18:55:58.887+0000 7fa31f873700 1 -- 172.21.15.73:0/1076632182 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa3180b35c0 msgr2=0x7fa318158b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:55:58.889 INFO:teuthology.orchestra.run.smithi073.stderr:2023-07-05T18:55:58.887+0000 7fa31f873700 1 --2- 172.21.15.73:0/1076632182 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa3180b35c0 0x7fa318158b10 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7fa308000f60 tx=0x7fa30800c730 comp rx=0 tx=0).stop 2023-07-05T18:55:58.890 INFO:teuthology.orchestra.run.smithi073.stderr:2023-07-05T18:55:58.887+0000 7fa31f873700 1 -- 172.21.15.73:0/1076632182 shutdown_connections 2023-07-05T18:55:58.890 INFO:teuthology.orchestra.run.smithi073.stderr:2023-07-05T18:55:58.887+0000 7fa31f873700 1 --2- 172.21.15.73:0/1076632182 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fa31815d190 0x7fa3180cd690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:55:58.890 INFO:teuthology.orchestra.run.smithi073.stderr:2023-07-05T18:55:58.887+0000 7fa31f873700 1 --2- 172.21.15.73:0/1076632182 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa3180aeed0 0x7fa31813f750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:55:58.890 INFO:teuthology.orchestra.run.smithi073.stderr:2023-07-05T18:55:58.887+0000 7fa31f873700 1 --2- 172.21.15.73:0/1076632182 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa3180b35c0 0x7fa318158b10 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:55:58.891 INFO:teuthology.orchestra.run.smithi073.stderr:2023-07-05T18:55:58.887+0000 7fa31f873700 1 -- 172.21.15.73:0/1076632182 >> 172.21.15.73:0/1076632182 conn(0x7fa31806af10 msgr2=0x7fa3180ad610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-05T18:55:58.891 INFO:teuthology.orchestra.run.smithi073.stderr:2023-07-05T18:55:58.887+0000 7fa31f873700 1 -- 172.21.15.73:0/1076632182 shutdown_connections 2023-07-05T18:55:58.891 INFO:teuthology.orchestra.run.smithi073.stderr:2023-07-05T18:55:58.887+0000 7fa31f873700 1 -- 172.21.15.73:0/1076632182 wait complete. 2023-07-05T18:55:58.907 INFO:tasks.ceph.osd.0:Restarting daemon 2023-07-05T18:55:58.907 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2023-07-05T18:55:58.910 INFO:tasks.ceph.osd.0:Started 2023-07-05T18:55:58.911 INFO:tasks.ceph.osd.1:Restarting daemon 2023-07-05T18:55:58.911 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2023-07-05T18:55:58.916 INFO:tasks.ceph.osd.1:Started 2023-07-05T18:55:58.917 INFO:tasks.ceph.osd.2:Restarting daemon 2023-07-05T18:55:58.917 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2023-07-05T18:55:58.919 INFO:tasks.ceph.osd.2:Started 2023-07-05T18:55:58.919 INFO:tasks.ceph.osd.3:Restarting daemon 2023-07-05T18:55:58.920 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 3 2023-07-05T18:55:58.922 INFO:tasks.ceph.osd.3:Started 2023-07-05T18:55:58.923 INFO:tasks.ceph.osd.4:Restarting daemon 2023-07-05T18:55:58.923 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 4 2023-07-05T18:55:58.925 INFO:tasks.ceph.osd.4:Started 2023-07-05T18:55:58.925 INFO:tasks.ceph.osd.5:Restarting daemon 2023-07-05T18:55:58.926 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 5 2023-07-05T18:55:58.928 INFO:tasks.ceph.osd.5:Started 2023-07-05T18:55:58.928 INFO:tasks.ceph.osd.6:Restarting daemon 2023-07-05T18:55:58.928 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 6 2023-07-05T18:55:58.930 INFO:tasks.ceph.osd.6:Started 2023-07-05T18:55:58.931 INFO:tasks.ceph.osd.7:Restarting daemon 2023-07-05T18:55:58.931 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 7 2023-07-05T18:55:58.933 INFO:tasks.ceph.osd.7:Started 2023-07-05T18:55:58.933 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-05T18:55:59.079 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:55:59.077+0000 7ff99e3e6700 1 Processor -- start 2023-07-05T18:55:59.082 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:55:59.077+0000 7ff99e3e6700 1 -- start start 2023-07-05T18:55:59.082 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:55:59.078+0000 7ff99e3e6700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7ff998156c10 0x7ff998071070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:55:59.082 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:55:59.078+0000 7ff99e3e6700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7ff9980715b0 0x7ff9980ce700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:55:59.083 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:55:59.078+0000 7ff99e3e6700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7ff9980cec40 0x7ff9980cd4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:55:59.083 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:55:59.078+0000 7ff99e3e6700 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff998071a20 con 0x7ff998156c10 2023-07-05T18:55:59.083 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:55:59.078+0000 7ff99e3e6700 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff99806a710 con 0x7ff9980cec40 2023-07-05T18:55:59.083 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:55:59.078+0000 7ff99e3e6700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff998160040 con 0x7ff9980715b0 2023-07-05T18:55:59.083 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:55:59.078+0000 7ff997fff700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7ff998156c10 0x7ff998071070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:55:59.083 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:55:59.078+0000 7ff997fff700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7ff998156c10 0x7ff998071070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:57170/0 (socket says 172.21.15.46:57170) 2023-07-05T18:55:59.083 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:55:59.078+0000 7ff997fff700 1 -- 172.21.15.46:0/3014281606 learned_addr learned my addr 172.21.15.46:0/3014281606 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-07-05T18:55:59.084 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:55:59.078+0000 7ff9977fe700 1 --2- 172.21.15.46:0/3014281606 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7ff9980715b0 0x7ff9980ce700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:55:59.084 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:55:59.078+0000 7ff99c983700 1 --2- 172.21.15.46:0/3014281606 >> v2:172.21.15.73:3300/0 conn(0x7ff9980cec40 0x7ff9980cd4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:55:59.084 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:55:59.078+0000 7ff997fff700 1 -- 172.21.15.46:0/3014281606 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7ff9980715b0 msgr2=0x7ff9980ce700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-05T18:55:59.084 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:55:59.078+0000 7ff997fff700 1 --2- 172.21.15.46:0/3014281606 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7ff9980715b0 0x7ff9980ce700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:55:59.084 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:55:59.078+0000 7ff997fff700 1 -- 172.21.15.46:0/3014281606 >> v2:172.21.15.73:3300/0 conn(0x7ff9980cec40 msgr2=0x7ff9980cd4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-05T18:55:59.084 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:55:59.078+0000 7ff997fff700 1 --2- 172.21.15.46:0/3014281606 >> v2:172.21.15.73:3300/0 conn(0x7ff9980cec40 0x7ff9980cd4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:55:59.084 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:55:59.078+0000 7ff997fff700 1 -- 172.21.15.46:0/3014281606 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff998069e00 con 0x7ff998156c10 2023-07-05T18:55:59.085 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:55:59.078+0000 7ff997fff700 1 --2- 172.21.15.46:0/3014281606 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff998156c10 0x7ff998071070 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7ff99806c430 tx=0x7ff988009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ea8b7506a935ea19 server_cookie=0 in_seq=0 out_seq=0 2023-07-05T18:55:59.085 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:55:59.078+0000 7ff996ffd700 1 -- 172.21.15.46:0/3014281606 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff988005e30 con 0x7ff998156c10 2023-07-05T18:55:59.085 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:55:59.078+0000 7ff996ffd700 1 -- 172.21.15.46:0/3014281606 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff988004030 con 0x7ff998156c10 2023-07-05T18:55:59.085 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:55:59.078+0000 7ff996ffd700 1 -- 172.21.15.46:0/3014281606 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9880043e0 con 0x7ff998156c10 2023-07-05T18:55:59.085 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:55:59.079+0000 7ff99e3e6700 1 -- 172.21.15.46:0/3014281606 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff998156c10 msgr2=0x7ff998071070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:55:59.085 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:55:59.079+0000 7ff99e3e6700 1 --2- 172.21.15.46:0/3014281606 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff998156c10 0x7ff998071070 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7ff99806c430 tx=0x7ff988009bd0 comp rx=0 tx=0).stop 2023-07-05T18:55:59.085 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:55:59.079+0000 7ff99e3e6700 1 -- 172.21.15.46:0/3014281606 shutdown_connections 2023-07-05T18:55:59.085 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:55:59.079+0000 7ff99e3e6700 1 --2- 172.21.15.46:0/3014281606 >> v2:172.21.15.73:3300/0 conn(0x7ff9980cec40 0x7ff9980cd4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:55:59.086 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:55:59.079+0000 7ff99e3e6700 1 --2- 172.21.15.46:0/3014281606 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff998156c10 0x7ff998071070 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:55:59.086 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:55:59.079+0000 7ff99e3e6700 1 --2- 172.21.15.46:0/3014281606 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7ff9980715b0 0x7ff9980ce700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:55:59.086 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:55:59.079+0000 7ff99e3e6700 1 -- 172.21.15.46:0/3014281606 >> 172.21.15.46:0/3014281606 conn(0x7ff9980cf9a0 msgr2=0x7ff9980cfda0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-05T18:55:59.086 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:55:59.079+0000 7ff99e3e6700 1 -- 172.21.15.46:0/3014281606 shutdown_connections 2023-07-05T18:55:59.086 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:55:59.079+0000 7ff99e3e6700 1 -- 172.21.15.46:0/3014281606 wait complete. 2023-07-05T18:55:59.086 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:55:59.080+0000 7ff99e3e6700 1 Processor -- start 2023-07-05T18:55:59.088 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:55:59.081+0000 7ff99e3e6700 1 -- start start 2023-07-05T18:55:59.088 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:55:59.081+0000 7ff99e3e6700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff9980715b0 0x7ff998151d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:55:59.089 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:55:59.081+0000 7ff99e3e6700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff9980cec40 0x7ff9980b43d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:55:59.089 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:55:59.081+0000 7ff99e3e6700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7ff998156c10 0x7ff9980b4910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:55:59.089 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:55:59.081+0000 7ff99e3e6700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff998152810 con 0x7ff9980cec40 2023-07-05T18:55:59.089 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:55:59.081+0000 7ff99e3e6700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9980b01c0 con 0x7ff9980715b0 2023-07-05T18:55:59.089 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:55:59.081+0000 7ff99e3e6700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff9980b04a0 con 0x7ff998156c10 2023-07-05T18:55:59.089 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:55:59.081+0000 7ff9977fe700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff9980cec40 0x7ff9980b43d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:55:59.092 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:55:59.081+0000 7ff9977fe700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff9980cec40 0x7ff9980b43d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:57176/0 (socket says 172.21.15.46:57176) 2023-07-05T18:55:59.092 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:55:59.081+0000 7ff9977fe700 1 -- 172.21.15.46:0/3033610590 learned_addr learned my addr 172.21.15.46:0/3033610590 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-07-05T18:55:59.092 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:55:59.081+0000 7ff997fff700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff9980715b0 0x7ff998151d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:55:59.092 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:55:59.081+0000 7ff99c983700 1 --2- 172.21.15.46:0/3033610590 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7ff998156c10 0x7ff9980b4910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:55:59.092 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:55:59.082+0000 7ff9977fe700 1 -- 172.21.15.46:0/3033610590 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7ff998156c10 msgr2=0x7ff9980b4910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:55:59.092 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:55:59.082+0000 7ff9977fe700 1 --2- 172.21.15.46:0/3033610590 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7ff998156c10 0x7ff9980b4910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:55:59.093 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:55:59.082+0000 7ff9977fe700 1 -- 172.21.15.46:0/3033610590 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff9980715b0 msgr2=0x7ff998151d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:55:59.093 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:55:59.082+0000 7ff9977fe700 1 --2- 172.21.15.46:0/3033610590 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff9980715b0 0x7ff998151d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:55:59.093 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:55:59.082+0000 7ff9977fe700 1 -- 172.21.15.46:0/3033610590 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff988009500 con 0x7ff9980cec40 2023-07-05T18:55:59.093 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:55:59.082+0000 7ff997fff700 1 --2- 172.21.15.46:0/3033610590 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff9980715b0 0x7ff998151d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-05T18:55:59.093 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:55:59.082+0000 7ff99c983700 1 --2- 172.21.15.46:0/3033610590 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7ff998156c10 0x7ff9980b4910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-05T18:55:59.093 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:55:59.082+0000 7ff9977fe700 1 --2- 172.21.15.46:0/3033610590 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff9980cec40 0x7ff9980b43d0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7ff98c00e870 tx=0x7ff98c00eb80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-05T18:55:59.093 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:55:59.082+0000 7ff994ff9700 1 -- 172.21.15.46:0/3033610590 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff98c013680 con 0x7ff9980cec40 2023-07-05T18:55:59.094 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:55:59.082+0000 7ff994ff9700 1 -- 172.21.15.46:0/3033610590 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff98c0137e0 con 0x7ff9980cec40 2023-07-05T18:55:59.094 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:55:59.082+0000 7ff994ff9700 1 -- 172.21.15.46:0/3033610590 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff98c013b90 con 0x7ff9980cec40 2023-07-05T18:55:59.094 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:55:59.082+0000 7ff99e3e6700 1 -- 172.21.15.46:0/3033610590 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff9980b0780 con 0x7ff9980cec40 2023-07-05T18:55:59.094 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:55:59.082+0000 7ff99e3e6700 1 -- 172.21.15.46:0/3033610590 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff998152270 con 0x7ff9980cec40 2023-07-05T18:55:59.094 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:55:59.083+0000 7ff994ff9700 1 -- 172.21.15.46:0/3033610590 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7ff98c005a20 con 0x7ff9980cec40 2023-07-05T18:55:59.094 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:55:59.083+0000 7ff99e3e6700 1 -- 172.21.15.46:0/3033610590 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff9980672e0 con 0x7ff9980cec40 2023-07-05T18:55:59.094 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:55:59.083+0000 7ff994ff9700 1 -- 172.21.15.46:0/3033610590 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(10..10 src has 1..10) v4 ==== 1645+0+0 (secure 0 0 0) 0x7ff98c006700 con 0x7ff9980cec40 2023-07-05T18:55:59.094 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:55:59.085+0000 7ff994ff9700 1 -- 172.21.15.46:0/3033610590 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72429 (secure 0 0 0) 0x7ff98c021060 con 0x7ff9980cec40 2023-07-05T18:55:59.160 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:55:59.157+0000 7ff99e3e6700 1 -- 172.21.15.46:0/3033610590 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ff9980ad050 con 0x7ff9980cec40 2023-07-05T18:55:59.160 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:55:59.157+0000 7ff994ff9700 1 -- 172.21.15.46:0/3033610590 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) v1 ==== 74+0+7057 (secure 0 0 0) 0x7ff98c02a090 con 0x7ff9980cec40 2023-07-05T18:55:59.161 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T18:55:59.161 INFO:teuthology.orchestra.run.smithi046.stdout:{"epoch":10,"fsid":"042652d3-d80c-4ad8-9366-3e94f2a0a512","created":"2023-07-05T18:55:56.455710+0000","modified":"2023-07-05T18:55:58.879340+0000","last_up_change":"0.000000","last_in_change":"2023-07-05T18:55:58.879340+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"20009183-9a47-4392-8751-883f88d2bfb1","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"91b4a7b0-e4e4-4888-a1fe-9edb0d68004c","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"669ff744-1331-47c5-8579-0440731c889a","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"34e1b86d-ffad-415d-861c-07a5f08068a6","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"57ffcb91-c7dc-4a69-ae71-4d9622a14a05","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"665f41c9-ee20-49cf-bf0e-fbe0c03d3aed","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"5790c6cc-bd56-4ce4-9a7c-0f0c3b59215c","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"b66f4d2e-147e-4c9b-97dd-cbd59d33802e","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-05T18:55:59.162 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:55:59.158+0000 7ff99e3e6700 1 -- 172.21.15.46:0/3033610590 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff9980cec40 msgr2=0x7ff9980b43d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:55:59.162 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:55:59.158+0000 7ff99e3e6700 1 --2- 172.21.15.46:0/3033610590 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff9980cec40 0x7ff9980b43d0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7ff98c00e870 tx=0x7ff98c00eb80 comp rx=0 tx=0).stop 2023-07-05T18:55:59.162 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:55:59.158+0000 7ff99e3e6700 1 -- 172.21.15.46:0/3033610590 shutdown_connections 2023-07-05T18:55:59.162 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:55:59.158+0000 7ff99e3e6700 1 --2- 172.21.15.46:0/3033610590 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7ff998156c10 0x7ff9980b4910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:55:59.162 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:55:59.158+0000 7ff99e3e6700 1 --2- 172.21.15.46:0/3033610590 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff9980715b0 0x7ff998151d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:55:59.163 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:55:59.158+0000 7ff99e3e6700 1 --2- 172.21.15.46:0/3033610590 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff9980cec40 0x7ff9980b43d0 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:55:59.163 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:55:59.158+0000 7ff99e3e6700 1 -- 172.21.15.46:0/3033610590 >> 172.21.15.46:0/3033610590 conn(0x7ff9980cf9a0 msgr2=0x7ff9980ad270 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-05T18:55:59.163 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:55:59.159+0000 7ff99e3e6700 1 -- 172.21.15.46:0/3033610590 shutdown_connections 2023-07-05T18:55:59.163 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:55:59.159+0000 7ff99e3e6700 1 -- 172.21.15.46:0/3033610590 wait complete. 2023-07-05T18:55:59.173 INFO:tasks.ceph.ceph_manager.ceph:[] 2023-07-05T18:55:59.173 INFO:tasks.ceph:Waiting for OSDs to come up 2023-07-05T18:55:59.523 INFO:tasks.ceph.osd.4.smithi073.stderr:2023-07-05T18:55:59.521+0000 7fb791c30640 -1 Falling back to public interface 2023-07-05T18:55:59.534 INFO:tasks.ceph.osd.2.smithi046.stderr:2023-07-05T18:55:59.532+0000 7f5a8a3e0640 -1 Falling back to public interface 2023-07-05T18:55:59.540 INFO:tasks.ceph.osd.6.smithi073.stderr:2023-07-05T18:55:59.537+0000 7f258d4cb640 -1 Falling back to public interface 2023-07-05T18:55:59.541 INFO:tasks.ceph.osd.7.smithi073.stderr:2023-07-05T18:55:59.538+0000 7fe611bec640 -1 Falling back to public interface 2023-07-05T18:55:59.541 INFO:tasks.ceph.osd.7.smithi073.stderr:2023-07-05T18:55:59.539+0000 7fe608faa700 -1 PosixStack listen unable to listen on v2:0.0.0.0:6813/0: (98) Address already in use 2023-07-05T18:55:59.546 INFO:tasks.ceph.osd.1.smithi046.stderr:2023-07-05T18:55:59.544+0000 7f2fd3058640 -1 Falling back to public interface 2023-07-05T18:55:59.547 INFO:tasks.ceph.osd.5.smithi073.stderr:2023-07-05T18:55:59.545+0000 7f1df61a7640 -1 Falling back to public interface 2023-07-05T18:55:59.547 INFO:tasks.ceph.osd.0.smithi046.stderr:2023-07-05T18:55:59.545+0000 7f77dd208640 -1 Falling back to public interface 2023-07-05T18:55:59.557 INFO:tasks.ceph.osd.3.smithi046.stderr:2023-07-05T18:55:59.555+0000 7f110f4c0640 -1 Falling back to public interface 2023-07-05T18:55:59.565 INFO:tasks.ceph.mgr.x.smithi073.stderr:2023-07-05T18:55:59.564+0000 7fbd956e1200 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-07-05T18:55:59.639 INFO:tasks.ceph.mgr.y.smithi046.stderr:2023-07-05T18:55:59.637+0000 7fd435390200 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-07-05T18:55:59.643 INFO:tasks.ceph.mgr.x.smithi073.stderr:2023-07-05T18:55:59.641+0000 7fbd956e1200 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-07-05T18:55:59.720 INFO:tasks.ceph.mgr.y.smithi046.stderr:2023-07-05T18:55:59.718+0000 7fd435390200 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-07-05T18:55:59.782 INFO:tasks.ceph.mgr.x.smithi073.stderr:2023-07-05T18:55:59.779+0000 7fbd956e1200 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-07-05T18:55:59.871 INFO:tasks.ceph.mgr.y.smithi046.stderr:2023-07-05T18:55:59.864+0000 7fd435390200 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-07-05T18:55:59.980 DEBUG:teuthology.orchestra.run.smithi046:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2023-07-05T18:56:00.015 INFO:tasks.ceph.mgr.x.smithi073.stderr:2023-07-05T18:56:00.013+0000 7fbd956e1200 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2023-07-05T18:56:00.089 INFO:tasks.ceph.mgr.x.smithi073.stderr:2023-07-05T18:56:00.087+0000 7fbd956e1200 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-07-05T18:56:00.096 INFO:teuthology.misc.health.smithi046.stderr:2023-07-05T18:56:00.094+0000 7f9cff456700 1 Processor -- start 2023-07-05T18:56:00.097 INFO:teuthology.misc.health.smithi046.stderr:2023-07-05T18:56:00.095+0000 7f9cff456700 1 -- start start 2023-07-05T18:56:00.098 INFO:teuthology.misc.health.smithi046.stderr:2023-07-05T18:56:00.095+0000 7f9cff456700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f9cf80b4ee0 0x7f9cf80cd310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:56:00.098 INFO:teuthology.misc.health.smithi046.stderr:2023-07-05T18:56:00.095+0000 7f9cff456700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f9cf8160b10 0x7f9cf80d0a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:56:00.098 INFO:teuthology.misc.health.smithi046.stderr:2023-07-05T18:56:00.095+0000 7f9cff456700 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9cf8160f70 con 0x7f9cf815c6a0 2023-07-05T18:56:00.099 INFO:teuthology.misc.health.smithi046.stderr:2023-07-05T18:56:00.095+0000 7f9cff456700 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9cf80cd9f0 con 0x7f9cf8160b10 2023-07-05T18:56:00.099 INFO:teuthology.misc.health.smithi046.stderr:2023-07-05T18:56:00.095+0000 7f9cff456700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9cf815ce60 con 0x7f9cf80b4ee0 2023-07-05T18:56:00.099 INFO:teuthology.misc.health.smithi046.stderr:2023-07-05T18:56:00.096+0000 7f9cfd1f2700 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7f9cf815c6a0 0x7f9cf80b47d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:56452/0 (socket says 172.21.15.46:56452) 2023-07-05T18:56:00.099 INFO:teuthology.misc.health.smithi046.stderr:2023-07-05T18:56:00.096+0000 7f9cfd1f2700 1 -- 172.21.15.46:0/1624013847 learned_addr learned my addr 172.21.15.46:0/1624013847 (peer_addr_for_me v1:172.21.15.46:0/0) 2023-07-05T18:56:00.099 INFO:teuthology.misc.health.smithi046.stderr:2023-07-05T18:56:00.096+0000 7f9cfd9f3700 1 --2- 172.21.15.46:0/1624013847 >> v2:172.21.15.73:3300/0 conn(0x7f9cf8160b10 0x7f9cf80d0a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:56:00.099 INFO:teuthology.misc.health.smithi046.stderr:2023-07-05T18:56:00.096+0000 7f9cfc9f1700 1 --2- 172.21.15.46:0/1624013847 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f9cf80b4ee0 0x7f9cf80cd310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:56:00.100 INFO:teuthology.misc.health.smithi046.stderr:2023-07-05T18:56:00.096+0000 7f9ceffff700 1 -- 172.21.15.46:0/1624013847 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3805706729 0 0) 0x7f9cf8160f70 con 0x7f9cf815c6a0 2023-07-05T18:56:00.100 INFO:teuthology.misc.health.smithi046.stderr:2023-07-05T18:56:00.096+0000 7f9ceffff700 1 -- 172.21.15.46:0/1624013847 --> v1:172.21.15.46:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9ce40035b0 con 0x7f9cf815c6a0 2023-07-05T18:56:00.100 INFO:teuthology.misc.health.smithi046.stderr:2023-07-05T18:56:00.096+0000 7f9cfc9f1700 1 -- 172.21.15.46:0/1624013847 >> v2:172.21.15.73:3300/0 conn(0x7f9cf8160b10 msgr2=0x7f9cf80d0a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-05T18:56:00.100 INFO:teuthology.misc.health.smithi046.stderr:2023-07-05T18:56:00.096+0000 7f9cfc9f1700 1 --2- 172.21.15.46:0/1624013847 >> v2:172.21.15.73:3300/0 conn(0x7f9cf8160b10 0x7f9cf80d0a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:00.100 INFO:teuthology.misc.health.smithi046.stderr:2023-07-05T18:56:00.096+0000 7f9cfc9f1700 1 -- 172.21.15.46:0/1624013847 >> v1:172.21.15.46:6789/0 conn(0x7f9cf815c6a0 legacy=0x7f9cf80b47d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:56:00.100 INFO:teuthology.misc.health.smithi046.stderr:2023-07-05T18:56:00.096+0000 7f9cfc9f1700 1 -- 172.21.15.46:0/1624013847 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9cf815d140 con 0x7f9cf80b4ee0 2023-07-05T18:56:00.100 INFO:teuthology.misc.health.smithi046.stderr:2023-07-05T18:56:00.096+0000 7f9cfc9f1700 1 --2- 172.21.15.46:0/1624013847 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f9cf80b4ee0 0x7f9cf80cd310 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f9ce8009840 tx=0x7f9ce8009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=799cea07731f41a8 server_cookie=0 in_seq=0 out_seq=0 2023-07-05T18:56:00.100 INFO:teuthology.misc.health.smithi046.stderr:2023-07-05T18:56:00.096+0000 7f9ceffff700 1 -- 172.21.15.46:0/1624013847 <== mon.2 v2:172.21.15.73:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ce8011830 con 0x7f9cf80b4ee0 2023-07-05T18:56:00.101 INFO:teuthology.misc.health.smithi046.stderr:2023-07-05T18:56:00.096+0000 7f9ceffff700 1 -- 172.21.15.46:0/1624013847 <== mon.2 v2:172.21.15.73:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9ce8011990 con 0x7f9cf80b4ee0 2023-07-05T18:56:00.101 INFO:teuthology.misc.health.smithi046.stderr:2023-07-05T18:56:00.096+0000 7f9ceffff700 1 -- 172.21.15.46:0/1624013847 <== mon.2 v2:172.21.15.73:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ce8011d20 con 0x7f9cf80b4ee0 2023-07-05T18:56:00.104 INFO:teuthology.misc.health.smithi046.stderr:2023-07-05T18:56:00.097+0000 7f9cff456700 1 -- 172.21.15.46:0/1624013847 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f9cf80b4ee0 msgr2=0x7f9cf80cd310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:56:00.104 INFO:teuthology.misc.health.smithi046.stderr:2023-07-05T18:56:00.097+0000 7f9cff456700 1 --2- 172.21.15.46:0/1624013847 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f9cf80b4ee0 0x7f9cf80cd310 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f9ce8009840 tx=0x7f9ce8009b50 comp rx=0 tx=0).stop 2023-07-05T18:56:00.105 INFO:teuthology.misc.health.smithi046.stderr:2023-07-05T18:56:00.097+0000 7f9cff456700 1 -- 172.21.15.46:0/1624013847 shutdown_connections 2023-07-05T18:56:00.105 INFO:teuthology.misc.health.smithi046.stderr:2023-07-05T18:56:00.097+0000 7f9cff456700 1 --2- 172.21.15.46:0/1624013847 >> v2:172.21.15.73:3300/0 conn(0x7f9cf8160b10 0x7f9cf80d0a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:00.105 INFO:teuthology.misc.health.smithi046.stderr:2023-07-05T18:56:00.097+0000 7f9cff456700 1 --2- 172.21.15.46:0/1624013847 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f9cf80b4ee0 0x7f9cf80cd310 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:00.106 INFO:teuthology.misc.health.smithi046.stderr:2023-07-05T18:56:00.097+0000 7f9cff456700 1 -- 172.21.15.46:0/1624013847 >> 172.21.15.46:0/1624013847 conn(0x7f9cf80d39e0 msgr2=0x7f9cf80cf7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-05T18:56:00.106 INFO:teuthology.misc.health.smithi046.stderr:2023-07-05T18:56:00.097+0000 7f9cff456700 1 -- 172.21.15.46:0/1624013847 shutdown_connections 2023-07-05T18:56:00.106 INFO:teuthology.misc.health.smithi046.stderr:2023-07-05T18:56:00.097+0000 7f9cff456700 1 -- 172.21.15.46:0/1624013847 wait complete. 2023-07-05T18:56:00.106 INFO:teuthology.misc.health.smithi046.stderr:2023-07-05T18:56:00.098+0000 7f9cff456700 1 Processor -- start 2023-07-05T18:56:00.106 INFO:teuthology.misc.health.smithi046.stderr:2023-07-05T18:56:00.098+0000 7f9cff456700 1 -- start start 2023-07-05T18:56:00.107 INFO:teuthology.misc.health.smithi046.stderr:2023-07-05T18:56:00.099+0000 7f9cff456700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9cf80b4ee0 0x7f9cf8157780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:56:00.107 INFO:teuthology.misc.health.smithi046.stderr:2023-07-05T18:56:00.099+0000 7f9cff456700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f9cf815c6a0 0x7f9cf80c8530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:56:00.107 INFO:teuthology.misc.health.smithi046.stderr:2023-07-05T18:56:00.099+0000 7f9cff456700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9cf8160b10 0x7f9cf80ca1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:56:00.107 INFO:teuthology.misc.health.smithi046.stderr:2023-07-05T18:56:00.099+0000 7f9cff456700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9cf8157cc0 con 0x7f9cf8160b10 2023-07-05T18:56:00.108 INFO:teuthology.misc.health.smithi046.stderr:2023-07-05T18:56:00.099+0000 7f9cff456700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9cf80b5ef0 con 0x7f9cf80b4ee0 2023-07-05T18:56:00.108 INFO:teuthology.misc.health.smithi046.stderr:2023-07-05T18:56:00.099+0000 7f9cff456700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9cf80b61d0 con 0x7f9cf815c6a0 2023-07-05T18:56:00.108 INFO:teuthology.misc.health.smithi046.stderr:2023-07-05T18:56:00.099+0000 7f9cfd9f3700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9cf8160b10 0x7f9cf80ca1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:56:00.108 INFO:teuthology.misc.health.smithi046.stderr:2023-07-05T18:56:00.099+0000 7f9cfd9f3700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9cf8160b10 0x7f9cf80ca1b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:57190/0 (socket says 172.21.15.46:57190) 2023-07-05T18:56:00.109 INFO:teuthology.misc.health.smithi046.stderr:2023-07-05T18:56:00.099+0000 7f9cfd9f3700 1 -- 172.21.15.46:0/2267589400 learned_addr learned my addr 172.21.15.46:0/2267589400 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-07-05T18:56:00.111 INFO:teuthology.misc.health.smithi046.stderr:2023-07-05T18:56:00.099+0000 7f9cfc9f1700 1 --2- 172.21.15.46:0/2267589400 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f9cf815c6a0 0x7f9cf80c8530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:56:00.112 INFO:teuthology.misc.health.smithi046.stderr:2023-07-05T18:56:00.099+0000 7f9cfd1f2700 1 --2- 172.21.15.46:0/2267589400 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9cf80b4ee0 0x7f9cf8157780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:56:00.112 INFO:teuthology.misc.health.smithi046.stderr:2023-07-05T18:56:00.100+0000 7f9cfd9f3700 1 -- 172.21.15.46:0/2267589400 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f9cf815c6a0 msgr2=0x7f9cf80c8530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:56:00.112 INFO:teuthology.misc.health.smithi046.stderr:2023-07-05T18:56:00.100+0000 7f9cfd9f3700 1 --2- 172.21.15.46:0/2267589400 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f9cf815c6a0 0x7f9cf80c8530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:00.112 INFO:teuthology.misc.health.smithi046.stderr:2023-07-05T18:56:00.100+0000 7f9cfd9f3700 1 -- 172.21.15.46:0/2267589400 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9cf80b4ee0 msgr2=0x7f9cf8157780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:56:00.112 INFO:teuthology.misc.health.smithi046.stderr:2023-07-05T18:56:00.100+0000 7f9cfd9f3700 1 --2- 172.21.15.46:0/2267589400 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9cf80b4ee0 0x7f9cf8157780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:00.112 INFO:teuthology.misc.health.smithi046.stderr:2023-07-05T18:56:00.100+0000 7f9cfd9f3700 1 -- 172.21.15.46:0/2267589400 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ce80094a0 con 0x7f9cf8160b10 2023-07-05T18:56:00.112 INFO:teuthology.misc.health.smithi046.stderr:2023-07-05T18:56:00.100+0000 7f9cfc9f1700 1 --2- 172.21.15.46:0/2267589400 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f9cf815c6a0 0x7f9cf80c8530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-05T18:56:00.113 INFO:teuthology.misc.health.smithi046.stderr:2023-07-05T18:56:00.100+0000 7f9cfd9f3700 1 --2- 172.21.15.46:0/2267589400 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9cf8160b10 0x7f9cf80ca1b0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f9cf000efc0 tx=0x7f9cf000c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-05T18:56:00.113 INFO:teuthology.misc.health.smithi046.stderr:2023-07-05T18:56:00.100+0000 7f9cedffb700 1 -- 172.21.15.46:0/2267589400 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9cf0009ea0 con 0x7f9cf8160b10 2023-07-05T18:56:00.113 INFO:teuthology.misc.health.smithi046.stderr:2023-07-05T18:56:00.100+0000 7f9cedffb700 1 -- 172.21.15.46:0/2267589400 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9cf000f040 con 0x7f9cf8160b10 2023-07-05T18:56:00.114 INFO:teuthology.misc.health.smithi046.stderr:2023-07-05T18:56:00.100+0000 7f9cff456700 1 -- 172.21.15.46:0/2267589400 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9cf80b64b0 con 0x7f9cf8160b10 2023-07-05T18:56:00.114 INFO:teuthology.misc.health.smithi046.stderr:2023-07-05T18:56:00.100+0000 7f9cedffb700 1 -- 172.21.15.46:0/2267589400 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9cf000ced0 con 0x7f9cf8160b10 2023-07-05T18:56:00.117 INFO:teuthology.misc.health.smithi046.stderr:2023-07-05T18:56:00.100+0000 7f9cff456700 1 -- 172.21.15.46:0/2267589400 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9cf80b6a70 con 0x7f9cf8160b10 2023-07-05T18:56:00.117 INFO:teuthology.misc.health.smithi046.stderr:2023-07-05T18:56:00.100+0000 7f9cedffb700 1 -- 172.21.15.46:0/2267589400 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f9cf0014780 con 0x7f9cf8160b10 2023-07-05T18:56:00.117 INFO:teuthology.misc.health.smithi046.stderr:2023-07-05T18:56:00.100+0000 7f9cedffb700 1 -- 172.21.15.46:0/2267589400 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(10..10 src has 1..10) v4 ==== 1645+0+0 (secure 0 0 0) 0x7f9cf0013ab0 con 0x7f9cf8160b10 2023-07-05T18:56:00.117 INFO:teuthology.misc.health.smithi046.stderr:2023-07-05T18:56:00.101+0000 7f9cff456700 1 -- 172.21.15.46:0/2267589400 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9cf80b6c60 con 0x7f9cf8160b10 2023-07-05T18:56:00.118 INFO:teuthology.misc.health.smithi046.stderr:2023-07-05T18:56:00.103+0000 7f9cedffb700 1 -- 172.21.15.46:0/2267589400 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72429 (secure 0 0 0) 0x7f9cf0018020 con 0x7f9cf8160b10 2023-07-05T18:56:00.118 INFO:tasks.ceph.mgr.y.smithi046.stderr:2023-07-05T18:56:00.113+0000 7fd435390200 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2023-07-05T18:56:00.176 INFO:teuthology.misc.health.smithi046.stderr:2023-07-05T18:56:00.174+0000 7f9cff456700 1 -- 172.21.15.46:0/2267589400 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f9cf80672e0 con 0x7f9cf8160b10 2023-07-05T18:56:00.177 INFO:teuthology.misc.health.smithi046.stderr:2023-07-05T18:56:00.174+0000 7f9cedffb700 1 -- 172.21.15.46:0/2267589400 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) v1 ==== 74+0+7057 (secure 0 0 0) 0x7f9cf0013e40 con 0x7f9cf8160b10 2023-07-05T18:56:00.177 INFO:teuthology.misc.health.smithi046.stdout: 2023-07-05T18:56:00.177 INFO:teuthology.misc.health.smithi046.stdout:{"epoch":10,"fsid":"042652d3-d80c-4ad8-9366-3e94f2a0a512","created":"2023-07-05T18:55:56.455710+0000","modified":"2023-07-05T18:55:58.879340+0000","last_up_change":"0.000000","last_in_change":"2023-07-05T18:55:58.879340+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"20009183-9a47-4392-8751-883f88d2bfb1","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"91b4a7b0-e4e4-4888-a1fe-9edb0d68004c","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"669ff744-1331-47c5-8579-0440731c889a","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"34e1b86d-ffad-415d-861c-07a5f08068a6","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"57ffcb91-c7dc-4a69-ae71-4d9622a14a05","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"665f41c9-ee20-49cf-bf0e-fbe0c03d3aed","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"5790c6cc-bd56-4ce4-9a7c-0f0c3b59215c","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"b66f4d2e-147e-4c9b-97dd-cbd59d33802e","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-05T18:56:00.181 INFO:teuthology.misc.health.smithi046.stderr:2023-07-05T18:56:00.175+0000 7f9cff456700 1 -- 172.21.15.46:0/2267589400 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9cf8160b10 msgr2=0x7f9cf80ca1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:56:00.182 INFO:teuthology.misc.health.smithi046.stderr:2023-07-05T18:56:00.175+0000 7f9cff456700 1 --2- 172.21.15.46:0/2267589400 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9cf8160b10 0x7f9cf80ca1b0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f9cf000efc0 tx=0x7f9cf000c3a0 comp rx=0 tx=0).stop 2023-07-05T18:56:00.182 INFO:teuthology.misc.health.smithi046.stderr:2023-07-05T18:56:00.175+0000 7f9cff456700 1 -- 172.21.15.46:0/2267589400 shutdown_connections 2023-07-05T18:56:00.182 INFO:teuthology.misc.health.smithi046.stderr:2023-07-05T18:56:00.175+0000 7f9cff456700 1 --2- 172.21.15.46:0/2267589400 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9cf8160b10 0x7f9cf80ca1b0 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:00.182 INFO:teuthology.misc.health.smithi046.stderr:2023-07-05T18:56:00.175+0000 7f9cff456700 1 --2- 172.21.15.46:0/2267589400 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9cf80b4ee0 0x7f9cf8157780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:00.183 INFO:teuthology.misc.health.smithi046.stderr:2023-07-05T18:56:00.175+0000 7f9cff456700 1 --2- 172.21.15.46:0/2267589400 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f9cf815c6a0 0x7f9cf80c8530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:00.183 INFO:teuthology.misc.health.smithi046.stderr:2023-07-05T18:56:00.175+0000 7f9cff456700 1 -- 172.21.15.46:0/2267589400 >> 172.21.15.46:0/2267589400 conn(0x7f9cf80d39e0 msgr2=0x7f9cf81581c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-05T18:56:00.183 INFO:teuthology.misc.health.smithi046.stderr:2023-07-05T18:56:00.175+0000 7f9cff456700 1 -- 172.21.15.46:0/2267589400 shutdown_connections 2023-07-05T18:56:00.183 INFO:teuthology.misc.health.smithi046.stderr:2023-07-05T18:56:00.175+0000 7f9cff456700 1 -- 172.21.15.46:0/2267589400 wait complete. 2023-07-05T18:56:00.188 DEBUG:teuthology.misc:0 of 8 OSDs are up 2023-07-05T18:56:00.196 INFO:tasks.ceph.mgr.y.smithi046.stderr:2023-07-05T18:56:00.193+0000 7fd435390200 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-07-05T18:56:00.359 INFO:tasks.ceph.mgr.x.smithi073.stderr:2023-07-05T18:56:00.358+0000 7fbd956e1200 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-07-05T18:56:00.478 INFO:tasks.ceph.mgr.y.smithi046.stderr:2023-07-05T18:56:00.477+0000 7fd435390200 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-07-05T18:56:00.584 INFO:tasks.ceph.mgr.x.smithi073.stderr:2023-07-05T18:56:00.575+0000 7fbd956e1200 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-07-05T18:56:00.707 INFO:tasks.ceph.mgr.y.smithi046.stderr:2023-07-05T18:56:00.705+0000 7fd435390200 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-07-05T18:56:00.734 INFO:tasks.ceph.mgr.x.smithi073.stderr:2023-07-05T18:56:00.733+0000 7fbd956e1200 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-07-05T18:56:00.849 INFO:tasks.ceph.mgr.x.smithi073.stderr:2023-07-05T18:56:00.847+0000 7fbd956e1200 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-07-05T18:56:00.870 INFO:tasks.ceph.mgr.y.smithi046.stderr:2023-07-05T18:56:00.868+0000 7fd435390200 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-07-05T18:56:00.992 INFO:tasks.ceph.mgr.y.smithi046.stderr:2023-07-05T18:56:00.990+0000 7fd435390200 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-07-05T18:56:00.999 INFO:tasks.ceph.mgr.x.smithi073.stderr:2023-07-05T18:56:00.998+0000 7fbd956e1200 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-07-05T18:56:01.148 INFO:tasks.ceph.mgr.y.smithi046.stderr:2023-07-05T18:56:01.146+0000 7fd435390200 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-07-05T18:56:01.273 INFO:tasks.ceph.mgr.x.smithi073.stderr:2023-07-05T18:56:01.272+0000 7fbd956e1200 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-07-05T18:56:01.435 INFO:tasks.ceph.mgr.y.smithi046.stderr:2023-07-05T18:56:01.433+0000 7fd435390200 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-07-05T18:56:01.458 INFO:tasks.ceph.mgr.x.smithi073.stderr:2023-07-05T18:56:01.456+0000 7fbd956e1200 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-07-05T18:56:01.629 INFO:tasks.ceph.mgr.y.smithi046.stderr:2023-07-05T18:56:01.627+0000 7fd435390200 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-07-05T18:56:02.051 INFO:tasks.ceph.mgr.x.smithi073.stderr:2023-07-05T18:56:02.050+0000 7fbd956e1200 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-07-05T18:56:02.268 INFO:tasks.ceph.mgr.y.smithi046.stderr:2023-07-05T18:56:02.267+0000 7fd435390200 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-07-05T18:56:03.044 INFO:tasks.ceph.osd.4.smithi073.stderr:2023-07-05T18:56:03.042+0000 7fb791c30640 -1 osd.4 0 log_to_monitors true 2023-07-05T18:56:03.054 INFO:tasks.ceph.osd.7.smithi073.stderr:2023-07-05T18:56:03.052+0000 7fe611bec640 -1 osd.7 0 log_to_monitors true 2023-07-05T18:56:03.069 INFO:tasks.ceph.osd.0.smithi046.stderr:2023-07-05T18:56:03.067+0000 7f77dd208640 -1 osd.0 0 log_to_monitors true 2023-07-05T18:56:03.075 INFO:tasks.ceph.osd.2.smithi046.stderr:2023-07-05T18:56:03.073+0000 7f5a8a3e0640 -1 osd.2 0 log_to_monitors true 2023-07-05T18:56:03.083 INFO:tasks.ceph.mgr.x.smithi073.stderr:2023-07-05T18:56:03.082+0000 7fbd4d90d700 -1 mgr.server handle_report got status from non-daemon mon.b 2023-07-05T18:56:03.083 INFO:tasks.ceph.mgr.x.smithi073.stderr:2023-07-05T18:56:03.082+0000 7fbd4d90d700 -1 mgr.server handle_report got status from non-daemon mon.c 2023-07-05T18:56:03.084 INFO:tasks.ceph.osd.3.smithi046.stderr:2023-07-05T18:56:03.083+0000 7f110f4c0640 -1 osd.3 0 log_to_monitors true 2023-07-05T18:56:03.086 INFO:tasks.ceph.osd.1.smithi046.stderr:2023-07-05T18:56:03.084+0000 7f2fd3058640 -1 osd.1 0 log_to_monitors true 2023-07-05T18:56:03.089 INFO:tasks.ceph.osd.6.smithi073.stderr:2023-07-05T18:56:03.088+0000 7f258d4cb640 -1 osd.6 0 log_to_monitors true 2023-07-05T18:56:03.090 INFO:tasks.ceph.osd.5.smithi073.stderr:2023-07-05T18:56:03.088+0000 7f1df61a7640 -1 osd.5 0 log_to_monitors true 2023-07-05T18:56:05.579 INFO:tasks.ceph.osd.3.smithi046.stderr:2023-07-05T18:56:05.577+0000 7f1103077700 -1 osd.3 0 waiting for initial osdmap 2023-07-05T18:56:05.593 INFO:tasks.ceph.osd.3.smithi046.stderr:2023-07-05T18:56:05.591+0000 7f10fb452700 -1 osd.3 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-07-05T18:56:05.624 INFO:tasks.ceph.osd.0.smithi046.stderr:2023-07-05T18:56:05.619+0000 7f77d0dbf700 -1 osd.0 0 waiting for initial osdmap 2023-07-05T18:56:05.635 INFO:tasks.ceph.osd.0.smithi046.stderr:2023-07-05T18:56:05.632+0000 7f77c919a700 -1 osd.0 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-07-05T18:56:05.645 INFO:tasks.ceph.osd.1.smithi046.stderr:2023-07-05T18:56:05.643+0000 7f2fc6c0f700 -1 osd.1 0 waiting for initial osdmap 2023-07-05T18:56:05.648 INFO:tasks.ceph.osd.2.smithi046.stderr:2023-07-05T18:56:05.646+0000 7f5a7df97700 -1 osd.2 0 waiting for initial osdmap 2023-07-05T18:56:05.664 INFO:tasks.ceph.osd.1.smithi046.stderr:2023-07-05T18:56:05.662+0000 7f2fbefea700 -1 osd.1 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-07-05T18:56:05.673 INFO:tasks.ceph.osd.2.smithi046.stderr:2023-07-05T18:56:05.671+0000 7f5a76372700 -1 osd.2 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-07-05T18:56:06.183 INFO:tasks.ceph.osd.6.smithi073.stderr:2023-07-05T18:56:06.181+0000 7f2581082700 -1 osd.6 0 waiting for initial osdmap 2023-07-05T18:56:06.200 INFO:tasks.ceph.osd.6.smithi073.stderr:2023-07-05T18:56:06.199+0000 7f257945d700 -1 osd.6 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-07-05T18:56:06.263 INFO:tasks.ceph.osd.7.smithi073.stderr:2023-07-05T18:56:06.261+0000 7fe606fa6700 -1 osd.7 0 waiting for initial osdmap 2023-07-05T18:56:06.272 INFO:tasks.ceph.osd.5.smithi073.stderr:2023-07-05T18:56:06.271+0000 7f1de9d5e700 -1 osd.5 0 waiting for initial osdmap 2023-07-05T18:56:06.275 INFO:tasks.ceph.osd.4.smithi073.stderr:2023-07-05T18:56:06.272+0000 7fb786fea700 -1 osd.4 0 waiting for initial osdmap 2023-07-05T18:56:06.280 INFO:tasks.ceph.osd.7.smithi073.stderr:2023-07-05T18:56:06.277+0000 7fe5fdb7e700 -1 osd.7 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-07-05T18:56:06.286 INFO:tasks.ceph.osd.4.smithi073.stderr:2023-07-05T18:56:06.285+0000 7fb77dbc2700 -1 osd.4 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-07-05T18:56:06.287 INFO:tasks.ceph.osd.5.smithi073.stderr:2023-07-05T18:56:06.285+0000 7f1de2139700 -1 osd.5 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-07-05T18:56:07.005 DEBUG:teuthology.orchestra.run.smithi046:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2023-07-05T18:56:07.133 INFO:teuthology.misc.health.smithi046.stderr:2023-07-05T18:56:07.131+0000 7f2640932700 1 Processor -- start 2023-07-05T18:56:07.133 INFO:teuthology.misc.health.smithi046.stderr:2023-07-05T18:56:07.131+0000 7f2640932700 1 -- start start 2023-07-05T18:56:07.135 INFO:teuthology.misc.health.smithi046.stderr:2023-07-05T18:56:07.132+0000 7f2640932700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f263c0ce910 0x7f263c0ccde0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:56:07.135 INFO:teuthology.misc.health.smithi046.stderr:2023-07-05T18:56:07.132+0000 7f2640932700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f263c0cbc60 0x7f263c0cece0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:56:07.135 INFO:teuthology.misc.health.smithi046.stderr:2023-07-05T18:56:07.132+0000 7f2640932700 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f263c0cf220 con 0x7f263c0cd410 2023-07-05T18:56:07.135 INFO:teuthology.misc.health.smithi046.stderr:2023-07-05T18:56:07.132+0000 7f2640932700 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f263c0cc400 con 0x7f263c0cbc60 2023-07-05T18:56:07.135 INFO:teuthology.misc.health.smithi046.stderr:2023-07-05T18:56:07.132+0000 7f2640932700 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f263c0cc6e0 con 0x7f263c0ce910 2023-07-05T18:56:07.136 INFO:teuthology.misc.health.smithi046.stderr:2023-07-05T18:56:07.132+0000 7f2639d9b700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f263c0cbc60 0x7f263c0cece0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:56:07.136 INFO:teuthology.misc.health.smithi046.stderr:2023-07-05T18:56:07.132+0000 7f263ad9d700 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7f263c0cd410 0x7f263c0cd870 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:56626/0 (socket says 172.21.15.46:56626) 2023-07-05T18:56:07.136 INFO:teuthology.misc.health.smithi046.stderr:2023-07-05T18:56:07.132+0000 7f263ad9d700 1 -- 172.21.15.46:0/3193263894 learned_addr learned my addr 172.21.15.46:0/3193263894 (peer_addr_for_me v1:172.21.15.46:0/0) 2023-07-05T18:56:07.136 INFO:teuthology.misc.health.smithi046.stderr:2023-07-05T18:56:07.132+0000 7f263a59c700 1 --2- 172.21.15.46:0/3193263894 >> v2:172.21.15.73:3300/0 conn(0x7f263c0ce910 0x7f263c0ccde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:56:07.136 INFO:teuthology.misc.health.smithi046.stderr:2023-07-05T18:56:07.132+0000 7f263959a700 1 -- 172.21.15.46:0/3193263894 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2319434373 0 0) 0x7f263c0cf220 con 0x7f263c0cd410 2023-07-05T18:56:07.136 INFO:teuthology.misc.health.smithi046.stderr:2023-07-05T18:56:07.132+0000 7f263959a700 1 -- 172.21.15.46:0/3193263894 --> v1:172.21.15.46:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f26240035b0 con 0x7f263c0cd410 2023-07-05T18:56:07.136 INFO:teuthology.misc.health.smithi046.stderr:2023-07-05T18:56:07.132+0000 7f2639d9b700 1 -- 172.21.15.46:0/3193263894 >> v2:172.21.15.73:3300/0 conn(0x7f263c0ce910 msgr2=0x7f263c0ccde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-05T18:56:07.137 INFO:teuthology.misc.health.smithi046.stderr:2023-07-05T18:56:07.133+0000 7f2639d9b700 1 --2- 172.21.15.46:0/3193263894 >> v2:172.21.15.73:3300/0 conn(0x7f263c0ce910 0x7f263c0ccde0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:07.137 INFO:teuthology.misc.health.smithi046.stderr:2023-07-05T18:56:07.133+0000 7f2639d9b700 1 -- 172.21.15.46:0/3193263894 >> v1:172.21.15.46:6789/0 conn(0x7f263c0cd410 legacy=0x7f263c0cd870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:56:07.137 INFO:teuthology.misc.health.smithi046.stderr:2023-07-05T18:56:07.133+0000 7f2639d9b700 1 -- 172.21.15.46:0/3193263894 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f263c06acf0 con 0x7f263c0cbc60 2023-07-05T18:56:07.137 INFO:teuthology.misc.health.smithi046.stderr:2023-07-05T18:56:07.133+0000 7f2639d9b700 1 --2- 172.21.15.46:0/3193263894 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f263c0cbc60 0x7f263c0cece0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f263c0b3650 tx=0x7f2630009b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6991c1c59a4bc81f server_cookie=0 in_seq=0 out_seq=0 2023-07-05T18:56:07.137 INFO:teuthology.misc.health.smithi046.stderr:2023-07-05T18:56:07.133+0000 7f263959a700 1 -- 172.21.15.46:0/3193263894 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2630011830 con 0x7f263c0cbc60 2023-07-05T18:56:07.137 INFO:teuthology.misc.health.smithi046.stderr:2023-07-05T18:56:07.133+0000 7f263959a700 1 -- 172.21.15.46:0/3193263894 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2630011990 con 0x7f263c0cbc60 2023-07-05T18:56:07.137 INFO:teuthology.misc.health.smithi046.stderr:2023-07-05T18:56:07.133+0000 7f263959a700 1 -- 172.21.15.46:0/3193263894 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2630011d00 con 0x7f263c0cbc60 2023-07-05T18:56:07.146 INFO:teuthology.misc.health.smithi046.stderr:2023-07-05T18:56:07.133+0000 7f2640932700 1 -- 172.21.15.46:0/3193263894 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f263c0cbc60 msgr2=0x7f263c0cece0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:56:07.146 INFO:teuthology.misc.health.smithi046.stderr:2023-07-05T18:56:07.133+0000 7f2640932700 1 --2- 172.21.15.46:0/3193263894 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f263c0cbc60 0x7f263c0cece0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f263c0b3650 tx=0x7f2630009b20 comp rx=0 tx=0).stop 2023-07-05T18:56:07.147 INFO:teuthology.misc.health.smithi046.stderr:2023-07-05T18:56:07.133+0000 7f2640932700 1 -- 172.21.15.46:0/3193263894 shutdown_connections 2023-07-05T18:56:07.147 INFO:teuthology.misc.health.smithi046.stderr:2023-07-05T18:56:07.133+0000 7f2640932700 1 --2- 172.21.15.46:0/3193263894 >> v2:172.21.15.73:3300/0 conn(0x7f263c0ce910 0x7f263c0ccde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:07.147 INFO:teuthology.misc.health.smithi046.stderr:2023-07-05T18:56:07.133+0000 7f2640932700 1 --2- 172.21.15.46:0/3193263894 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f263c0cbc60 0x7f263c0cece0 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:07.147 INFO:teuthology.misc.health.smithi046.stderr:2023-07-05T18:56:07.134+0000 7f2640932700 1 -- 172.21.15.46:0/3193263894 >> 172.21.15.46:0/3193263894 conn(0x7f263c099e00 msgr2=0x7f263c0d0b30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-05T18:56:07.147 INFO:teuthology.misc.health.smithi046.stderr:2023-07-05T18:56:07.134+0000 7f2640932700 1 -- 172.21.15.46:0/3193263894 shutdown_connections 2023-07-05T18:56:07.148 INFO:teuthology.misc.health.smithi046.stderr:2023-07-05T18:56:07.134+0000 7f2640932700 1 -- 172.21.15.46:0/3193263894 wait complete. 2023-07-05T18:56:07.148 INFO:teuthology.misc.health.smithi046.stderr:2023-07-05T18:56:07.135+0000 7f2640932700 1 Processor -- start 2023-07-05T18:56:07.148 INFO:teuthology.misc.health.smithi046.stderr:2023-07-05T18:56:07.135+0000 7f2640932700 1 -- start start 2023-07-05T18:56:07.148 INFO:teuthology.misc.health.smithi046.stderr:2023-07-05T18:56:07.136+0000 7f2640932700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f263c0cbc60 0x7f263c1f2ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:56:07.148 INFO:teuthology.misc.health.smithi046.stderr:2023-07-05T18:56:07.136+0000 7f2640932700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f263c0cd410 0x7f263c0c98c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:56:07.148 INFO:teuthology.misc.health.smithi046.stderr:2023-07-05T18:56:07.136+0000 7f2640932700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f263c0ce910 0x7f263c15b800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:56:07.149 INFO:teuthology.misc.health.smithi046.stderr:2023-07-05T18:56:07.136+0000 7f2640932700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f263c0c8e20 con 0x7f263c0cbc60 2023-07-05T18:56:07.149 INFO:teuthology.misc.health.smithi046.stderr:2023-07-05T18:56:07.136+0000 7f2640932700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f263c0b65e0 con 0x7f263c0ce910 2023-07-05T18:56:07.149 INFO:teuthology.misc.health.smithi046.stderr:2023-07-05T18:56:07.136+0000 7f2640932700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f263c0c90c0 con 0x7f263c0cd410 2023-07-05T18:56:07.149 INFO:teuthology.misc.health.smithi046.stderr:2023-07-05T18:56:07.136+0000 7f263a59c700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f263c0cbc60 0x7f263c1f2ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:56:07.150 INFO:teuthology.misc.health.smithi046.stderr:2023-07-05T18:56:07.136+0000 7f263a59c700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f263c0cbc60 0x7f263c1f2ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:57360/0 (socket says 172.21.15.46:57360) 2023-07-05T18:56:07.150 INFO:teuthology.misc.health.smithi046.stderr:2023-07-05T18:56:07.136+0000 7f263a59c700 1 -- 172.21.15.46:0/3129345697 learned_addr learned my addr 172.21.15.46:0/3129345697 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-07-05T18:56:07.151 INFO:teuthology.misc.health.smithi046.stderr:2023-07-05T18:56:07.136+0000 7f2639d9b700 1 --2- 172.21.15.46:0/3129345697 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f263c0cd410 0x7f263c0c98c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:56:07.151 INFO:teuthology.misc.health.smithi046.stderr:2023-07-05T18:56:07.136+0000 7f263ad9d700 1 --2- 172.21.15.46:0/3129345697 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f263c0ce910 0x7f263c15b800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:56:07.151 INFO:teuthology.misc.health.smithi046.stderr:2023-07-05T18:56:07.136+0000 7f263a59c700 1 -- 172.21.15.46:0/3129345697 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f263c0cd410 msgr2=0x7f263c0c98c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:56:07.151 INFO:teuthology.misc.health.smithi046.stderr:2023-07-05T18:56:07.136+0000 7f263a59c700 1 --2- 172.21.15.46:0/3129345697 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f263c0cd410 0x7f263c0c98c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:07.151 INFO:teuthology.misc.health.smithi046.stderr:2023-07-05T18:56:07.136+0000 7f263a59c700 1 -- 172.21.15.46:0/3129345697 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f263c0ce910 msgr2=0x7f263c15b800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:56:07.151 INFO:teuthology.misc.health.smithi046.stderr:2023-07-05T18:56:07.136+0000 7f263a59c700 1 --2- 172.21.15.46:0/3129345697 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f263c0ce910 0x7f263c15b800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:07.151 INFO:teuthology.misc.health.smithi046.stderr:2023-07-05T18:56:07.136+0000 7f263a59c700 1 -- 172.21.15.46:0/3129345697 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f26300094a0 con 0x7f263c0cbc60 2023-07-05T18:56:07.152 INFO:teuthology.misc.health.smithi046.stderr:2023-07-05T18:56:07.136+0000 7f2639d9b700 1 --2- 172.21.15.46:0/3129345697 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f263c0cd410 0x7f263c0c98c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-05T18:56:07.152 INFO:teuthology.misc.health.smithi046.stderr:2023-07-05T18:56:07.136+0000 7f263ad9d700 1 --2- 172.21.15.46:0/3129345697 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f263c0ce910 0x7f263c15b800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-05T18:56:07.152 INFO:teuthology.misc.health.smithi046.stderr:2023-07-05T18:56:07.136+0000 7f263a59c700 1 --2- 172.21.15.46:0/3129345697 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f263c0cbc60 0x7f263c1f2ab0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f262c00e9b0 tx=0x7f262c00ed70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-05T18:56:07.152 INFO:teuthology.misc.health.smithi046.stderr:2023-07-05T18:56:07.136+0000 7f262affd700 1 -- 172.21.15.46:0/3129345697 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f262c009710 con 0x7f263c0cbc60 2023-07-05T18:56:07.152 INFO:teuthology.misc.health.smithi046.stderr:2023-07-05T18:56:07.137+0000 7f262affd700 1 -- 172.21.15.46:0/3129345697 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f262c00c850 con 0x7f263c0cbc60 2023-07-05T18:56:07.152 INFO:teuthology.misc.health.smithi046.stderr:2023-07-05T18:56:07.137+0000 7f2640932700 1 -- 172.21.15.46:0/3129345697 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f263c0c93a0 con 0x7f263c0cbc60 2023-07-05T18:56:07.152 INFO:teuthology.misc.health.smithi046.stderr:2023-07-05T18:56:07.137+0000 7f262affd700 1 -- 172.21.15.46:0/3129345697 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f262c00cbc0 con 0x7f263c0cbc60 2023-07-05T18:56:07.153 INFO:teuthology.misc.health.smithi046.stderr:2023-07-05T18:56:07.137+0000 7f2640932700 1 -- 172.21.15.46:0/3129345697 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f263c0b68c0 con 0x7f263c0cbc60 2023-07-05T18:56:07.153 INFO:teuthology.misc.health.smithi046.stderr:2023-07-05T18:56:07.138+0000 7f2640932700 1 -- 172.21.15.46:0/3129345697 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f263c0672e0 con 0x7f263c0cbc60 2023-07-05T18:56:07.153 INFO:teuthology.misc.health.smithi046.stderr:2023-07-05T18:56:07.138+0000 7f262affd700 1 -- 172.21.15.46:0/3129345697 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 4) v1 ==== 88981+0+0 (secure 0 0 0) 0x7f262c00cd20 con 0x7f263c0cbc60 2023-07-05T18:56:07.153 INFO:teuthology.misc.health.smithi046.stderr:2023-07-05T18:56:07.138+0000 7f262affd700 1 --2- 172.21.15.46:0/3129345697 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7f261c06ac50 0x7f261c06d100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:56:07.153 INFO:teuthology.misc.health.smithi046.stderr:2023-07-05T18:56:07.138+0000 7f262affd700 1 -- 172.21.15.46:0/3129345697 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(13..13 src has 1..13) v4 ==== 4471+0+0 (secure 0 0 0) 0x7f262c088dc0 con 0x7f263c0cbc60 2023-07-05T18:56:07.154 INFO:teuthology.misc.health.smithi046.stderr:2023-07-05T18:56:07.139+0000 7f2639d9b700 1 --2- 172.21.15.46:0/3129345697 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7f261c06ac50 0x7f261c06d100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:56:07.154 INFO:teuthology.misc.health.smithi046.stderr:2023-07-05T18:56:07.139+0000 7f2639d9b700 1 --2- 172.21.15.46:0/3129345697 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7f261c06ac50 0x7f261c06d100 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f263c15c900 tx=0x7f2630008030 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-05T18:56:07.154 INFO:teuthology.misc.health.smithi046.stderr:2023-07-05T18:56:07.143+0000 7f262affd700 1 -- 172.21.15.46:0/3129345697 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f262c054610 con 0x7f263c0cbc60 2023-07-05T18:56:07.352 INFO:teuthology.misc.health.smithi046.stderr:2023-07-05T18:56:07.346+0000 7f2640932700 1 -- 172.21.15.46:0/3129345697 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f263c1595e0 con 0x7f263c0cbc60 2023-07-05T18:56:07.353 INFO:teuthology.misc.health.smithi046.stderr:2023-07-05T18:56:07.347+0000 7f262affd700 1 -- 172.21.15.46:0/3129345697 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v13) v1 ==== 74+0+10848 (secure 0 0 0) 0x7f262c057c30 con 0x7f263c0cbc60 2023-07-05T18:56:07.353 INFO:teuthology.misc.health.smithi046.stdout: 2023-07-05T18:56:07.353 INFO:teuthology.misc.health.smithi046.stdout:{"epoch":13,"fsid":"042652d3-d80c-4ad8-9366-3e94f2a0a512","created":"2023-07-05T18:55:56.455710+0000","modified":"2023-07-05T18:56:06.594022+0000","last_up_change":"2023-07-05T18:56:06.594022+0000","last_in_change":"2023-07-05T18:55:58.879340+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"20009183-9a47-4392-8751-883f88d2bfb1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6813","nonce":4151971443},{"type":"v1","addr":"172.21.15.46:6815","nonce":4151971443}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6817","nonce":4151971443},{"type":"v1","addr":"172.21.15.46:6818","nonce":4151971443}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6822","nonce":4151971443},{"type":"v1","addr":"172.21.15.46:6823","nonce":4151971443}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6820","nonce":4151971443},{"type":"v1","addr":"172.21.15.46:6821","nonce":4151971443}]},"public_addr":"172.21.15.46:6815/4151971443","cluster_addr":"172.21.15.46:6818/4151971443","heartbeat_back_addr":"172.21.15.46:6823/4151971443","heartbeat_front_addr":"172.21.15.46:6821/4151971443","state":["exists","up"]},{"osd":1,"uuid":"91b4a7b0-e4e4-4888-a1fe-9edb0d68004c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6808","nonce":502575881},{"type":"v1","addr":"172.21.15.46:6809","nonce":502575881}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6810","nonce":502575881},{"type":"v1","addr":"172.21.15.46:6811","nonce":502575881}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6816","nonce":502575881},{"type":"v1","addr":"172.21.15.46:6819","nonce":502575881}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6812","nonce":502575881},{"type":"v1","addr":"172.21.15.46:6814","nonce":502575881}]},"public_addr":"172.21.15.46:6809/502575881","cluster_addr":"172.21.15.46:6811/502575881","heartbeat_back_addr":"172.21.15.46:6819/502575881","heartbeat_front_addr":"172.21.15.46:6814/502575881","state":["exists","up"]},{"osd":2,"uuid":"669ff744-1331-47c5-8579-0440731c889a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6800","nonce":2115251461},{"type":"v1","addr":"172.21.15.46:6801","nonce":2115251461}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6802","nonce":2115251461},{"type":"v1","addr":"172.21.15.46:6803","nonce":2115251461}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6806","nonce":2115251461},{"type":"v1","addr":"172.21.15.46:6807","nonce":2115251461}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6804","nonce":2115251461},{"type":"v1","addr":"172.21.15.46:6805","nonce":2115251461}]},"public_addr":"172.21.15.46:6801/2115251461","cluster_addr":"172.21.15.46:6803/2115251461","heartbeat_back_addr":"172.21.15.46:6807/2115251461","heartbeat_front_addr":"172.21.15.46:6805/2115251461","state":["exists","up"]},{"osd":3,"uuid":"34e1b86d-ffad-415d-861c-07a5f08068a6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6824","nonce":2981388766},{"type":"v1","addr":"172.21.15.46:6825","nonce":2981388766}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6826","nonce":2981388766},{"type":"v1","addr":"172.21.15.46:6827","nonce":2981388766}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6830","nonce":2981388766},{"type":"v1","addr":"172.21.15.46:6831","nonce":2981388766}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6828","nonce":2981388766},{"type":"v1","addr":"172.21.15.46:6829","nonce":2981388766}]},"public_addr":"172.21.15.46:6825/2981388766","cluster_addr":"172.21.15.46:6827/2981388766","heartbeat_back_addr":"172.21.15.46:6831/2981388766","heartbeat_front_addr":"172.21.15.46:6829/2981388766","state":["exists","up"]},{"osd":4,"uuid":"57ffcb91-c7dc-4a69-ae71-4d9622a14a05","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6800","nonce":2083655348},{"type":"v1","addr":"172.21.15.73:6801","nonce":2083655348}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6802","nonce":2083655348},{"type":"v1","addr":"172.21.15.73:6803","nonce":2083655348}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6806","nonce":2083655348},{"type":"v1","addr":"172.21.15.73:6807","nonce":2083655348}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6804","nonce":2083655348},{"type":"v1","addr":"172.21.15.73:6805","nonce":2083655348}]},"public_addr":"172.21.15.73:6801/2083655348","cluster_addr":"172.21.15.73:6803/2083655348","heartbeat_back_addr":"172.21.15.73:6807/2083655348","heartbeat_front_addr":"172.21.15.73:6805/2083655348","state":["exists","up"]},{"osd":5,"uuid":"665f41c9-ee20-49cf-bf0e-fbe0c03d3aed","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6824","nonce":2803788401},{"type":"v1","addr":"172.21.15.73:6825","nonce":2803788401}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6826","nonce":2803788401},{"type":"v1","addr":"172.21.15.73:6827","nonce":2803788401}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6830","nonce":2803788401},{"type":"v1","addr":"172.21.15.73:6831","nonce":2803788401}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6828","nonce":2803788401},{"type":"v1","addr":"172.21.15.73:6829","nonce":2803788401}]},"public_addr":"172.21.15.73:6825/2803788401","cluster_addr":"172.21.15.73:6827/2803788401","heartbeat_back_addr":"172.21.15.73:6831/2803788401","heartbeat_front_addr":"172.21.15.73:6829/2803788401","state":["exists","up"]},{"osd":6,"uuid":"5790c6cc-bd56-4ce4-9a7c-0f0c3b59215c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6808","nonce":974108383},{"type":"v1","addr":"172.21.15.73:6809","nonce":974108383}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6810","nonce":974108383},{"type":"v1","addr":"172.21.15.73:6811","nonce":974108383}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6815","nonce":974108383},{"type":"v1","addr":"172.21.15.73:6817","nonce":974108383}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6812","nonce":974108383},{"type":"v1","addr":"172.21.15.73:6813","nonce":974108383}]},"public_addr":"172.21.15.73:6809/974108383","cluster_addr":"172.21.15.73:6811/974108383","heartbeat_back_addr":"172.21.15.73:6817/974108383","heartbeat_front_addr":"172.21.15.73:6813/974108383","state":["exists","up"]},{"osd":7,"uuid":"b66f4d2e-147e-4c9b-97dd-cbd59d33802e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6814","nonce":3772673248},{"type":"v1","addr":"172.21.15.73:6816","nonce":3772673248}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6818","nonce":3772673248},{"type":"v1","addr":"172.21.15.73:6819","nonce":3772673248}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6822","nonce":3772673248},{"type":"v1","addr":"172.21.15.73:6823","nonce":3772673248}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6820","nonce":3772673248},{"type":"v1","addr":"172.21.15.73:6821","nonce":3772673248}]},"public_addr":"172.21.15.73:6816/3772673248","cluster_addr":"172.21.15.73:6819/3772673248","heartbeat_back_addr":"172.21.15.73:6823/3772673248","heartbeat_front_addr":"172.21.15.73:6821/3772673248","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-05T18:56:07.354 INFO:teuthology.misc.health.smithi046.stderr:2023-07-05T18:56:07.349+0000 7f2640932700 1 -- 172.21.15.46:0/3129345697 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7f261c06ac50 msgr2=0x7f261c06d100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:56:07.355 INFO:teuthology.misc.health.smithi046.stderr:2023-07-05T18:56:07.349+0000 7f2640932700 1 --2- 172.21.15.46:0/3129345697 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7f261c06ac50 0x7f261c06d100 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f263c15c900 tx=0x7f2630008030 comp rx=0 tx=0).stop 2023-07-05T18:56:07.355 INFO:teuthology.misc.health.smithi046.stderr:2023-07-05T18:56:07.349+0000 7f2640932700 1 -- 172.21.15.46:0/3129345697 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f263c0cbc60 msgr2=0x7f263c1f2ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:56:07.355 INFO:teuthology.misc.health.smithi046.stderr:2023-07-05T18:56:07.349+0000 7f2640932700 1 --2- 172.21.15.46:0/3129345697 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f263c0cbc60 0x7f263c1f2ab0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f262c00e9b0 tx=0x7f262c00ed70 comp rx=0 tx=0).stop 2023-07-05T18:56:07.355 INFO:teuthology.misc.health.smithi046.stderr:2023-07-05T18:56:07.349+0000 7f2640932700 1 -- 172.21.15.46:0/3129345697 shutdown_connections 2023-07-05T18:56:07.355 INFO:teuthology.misc.health.smithi046.stderr:2023-07-05T18:56:07.349+0000 7f2640932700 1 --2- 172.21.15.46:0/3129345697 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7f261c06ac50 0x7f261c06d100 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:07.355 INFO:teuthology.misc.health.smithi046.stderr:2023-07-05T18:56:07.349+0000 7f2640932700 1 --2- 172.21.15.46:0/3129345697 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f263c0ce910 0x7f263c15b800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:07.355 INFO:teuthology.misc.health.smithi046.stderr:2023-07-05T18:56:07.349+0000 7f2640932700 1 --2- 172.21.15.46:0/3129345697 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f263c0cbc60 0x7f263c1f2ab0 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:07.356 INFO:teuthology.misc.health.smithi046.stderr:2023-07-05T18:56:07.349+0000 7f2640932700 1 --2- 172.21.15.46:0/3129345697 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f263c0cd410 0x7f263c0c98c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:07.356 INFO:teuthology.misc.health.smithi046.stderr:2023-07-05T18:56:07.349+0000 7f2640932700 1 -- 172.21.15.46:0/3129345697 >> 172.21.15.46:0/3129345697 conn(0x7f263c099e00 msgr2=0x7f263c15aef0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-05T18:56:07.356 INFO:teuthology.misc.health.smithi046.stderr:2023-07-05T18:56:07.349+0000 7f2640932700 1 -- 172.21.15.46:0/3129345697 shutdown_connections 2023-07-05T18:56:07.356 INFO:teuthology.misc.health.smithi046.stderr:2023-07-05T18:56:07.349+0000 7f2640932700 1 -- 172.21.15.46:0/3129345697 wait complete. 2023-07-05T18:56:07.364 DEBUG:teuthology.misc:8 of 8 OSDs are up 2023-07-05T18:56:07.364 INFO:tasks.ceph:Creating RBD pool 2023-07-05T18:56:07.364 DEBUG:teuthology.orchestra.run.smithi046:> sudo ceph --cluster ceph osd pool create rbd 8 2023-07-05T18:56:07.489 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:07.487+0000 7fb736bc2700 1 Processor -- start 2023-07-05T18:56:07.489 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:07.487+0000 7fb736bc2700 1 -- start start 2023-07-05T18:56:07.491 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:07.488+0000 7fb736bc2700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fb7300b13f0 0x7fb7300b1870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:56:07.491 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:07.488+0000 7fb736bc2700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fb7300c9fc0 0x7fb7300ca3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:56:07.491 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:07.488+0000 7fb736bc2700 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb73015e040 con 0x7fb7301594f0 2023-07-05T18:56:07.496 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:07.488+0000 7fb736bc2700 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb7300ce200 con 0x7fb7300b13f0 2023-07-05T18:56:07.496 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:07.488+0000 7fb736bc2700 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb7300b1db0 con 0x7fb7300c9fc0 2023-07-05T18:56:07.497 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:07.488+0000 7fb72ffff700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fb7300b13f0 0x7fb7300b1870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:56:07.497 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:07.488+0000 7fb73495e700 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7fb7301594f0 0x7fb7300cd690 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:56648/0 (socket says 172.21.15.46:56648) 2023-07-05T18:56:07.497 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:07.488+0000 7fb73495e700 1 -- 172.21.15.46:0/4149404522 learned_addr learned my addr 172.21.15.46:0/4149404522 (peer_addr_for_me v1:172.21.15.46:0/0) 2023-07-05T18:56:07.499 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:07.488+0000 7fb72ffff700 1 -- 172.21.15.46:0/4149404522 >> v2:172.21.15.73:3300/0 conn(0x7fb7300c9fc0 msgr2=0x7fb7300ca3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-05T18:56:07.499 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:07.488+0000 7fb72ffff700 1 --2- 172.21.15.46:0/4149404522 >> v2:172.21.15.73:3300/0 conn(0x7fb7300c9fc0 0x7fb7300ca3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:07.499 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:07.488+0000 7fb72ffff700 1 -- 172.21.15.46:0/4149404522 >> v1:172.21.15.46:6789/0 conn(0x7fb7301594f0 legacy=0x7fb7300cd690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:56:07.499 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:07.488+0000 7fb72ffff700 1 -- 172.21.15.46:0/4149404522 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb73015dbb0 con 0x7fb7300b13f0 2023-07-05T18:56:07.500 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:07.488+0000 7fb72ffff700 1 --2- 172.21.15.46:0/4149404522 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb7300b13f0 0x7fb7300b1870 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7fb7300b5ab0 tx=0x7fb71c009b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9fb4f8e7c5b11a6d server_cookie=0 in_seq=0 out_seq=0 2023-07-05T18:56:07.500 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:07.488+0000 7fb72f7fe700 1 -- 172.21.15.46:0/4149404522 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb71c011830 con 0x7fb7300b13f0 2023-07-05T18:56:07.500 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:07.488+0000 7fb72f7fe700 1 -- 172.21.15.46:0/4149404522 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb71c011990 con 0x7fb7300b13f0 2023-07-05T18:56:07.500 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:07.488+0000 7fb72f7fe700 1 -- 172.21.15.46:0/4149404522 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb71c011d20 con 0x7fb7300b13f0 2023-07-05T18:56:07.500 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:07.489+0000 7fb736bc2700 1 -- 172.21.15.46:0/4149404522 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb7300b13f0 msgr2=0x7fb7300b1870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:56:07.500 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:07.489+0000 7fb736bc2700 1 --2- 172.21.15.46:0/4149404522 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb7300b13f0 0x7fb7300b1870 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7fb7300b5ab0 tx=0x7fb71c009b20 comp rx=0 tx=0).stop 2023-07-05T18:56:07.501 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:07.489+0000 7fb736bc2700 1 -- 172.21.15.46:0/4149404522 shutdown_connections 2023-07-05T18:56:07.501 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:07.489+0000 7fb736bc2700 1 --2- 172.21.15.46:0/4149404522 >> v2:172.21.15.73:3300/0 conn(0x7fb7300c9fc0 0x7fb7300ca3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:07.501 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:07.489+0000 7fb736bc2700 1 --2- 172.21.15.46:0/4149404522 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb7300b13f0 0x7fb7300b1870 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:07.501 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:07.489+0000 7fb736bc2700 1 -- 172.21.15.46:0/4149404522 >> 172.21.15.46:0/4149404522 conn(0x7fb73006bba0 msgr2=0x7fb7300cc3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-05T18:56:07.501 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:07.489+0000 7fb736bc2700 1 -- 172.21.15.46:0/4149404522 shutdown_connections 2023-07-05T18:56:07.501 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:07.489+0000 7fb736bc2700 1 -- 172.21.15.46:0/4149404522 wait complete. 2023-07-05T18:56:07.503 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:07.490+0000 7fb736bc2700 1 Processor -- start 2023-07-05T18:56:07.504 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:07.490+0000 7fb736bc2700 1 -- start start 2023-07-05T18:56:07.504 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:07.491+0000 7fb736bc2700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fb7300b13f0 0x7fb730150db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:56:07.504 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:07.491+0000 7fb736bc2700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb7300c9fc0 0x7fb730069e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:56:07.504 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:07.491+0000 7fb736bc2700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb7301594f0 0x7fb73006a340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:56:07.505 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:07.491+0000 7fb736bc2700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7301f6540 con 0x7fb7301594f0 2023-07-05T18:56:07.505 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:07.491+0000 7fb736bc2700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7301f5970 con 0x7fb7300c9fc0 2023-07-05T18:56:07.505 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:07.491+0000 7fb736bc2700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb7301f5c10 con 0x7fb7300b13f0 2023-07-05T18:56:07.505 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:07.491+0000 7fb73515f700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb7301594f0 0x7fb73006a340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:56:07.505 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:07.491+0000 7fb73515f700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb7301594f0 0x7fb73006a340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:57386/0 (socket says 172.21.15.46:57386) 2023-07-05T18:56:07.505 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:07.491+0000 7fb73515f700 1 -- 172.21.15.46:0/969973904 learned_addr learned my addr 172.21.15.46:0/969973904 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-07-05T18:56:07.506 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:07.491+0000 7fb73495e700 1 --2- 172.21.15.46:0/969973904 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fb7300b13f0 0x7fb730150db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:56:07.506 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:07.491+0000 7fb72ffff700 1 --2- 172.21.15.46:0/969973904 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb7300c9fc0 0x7fb730069e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:56:07.506 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:07.492+0000 7fb73515f700 1 -- 172.21.15.46:0/969973904 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fb7300b13f0 msgr2=0x7fb730150db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:56:07.506 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:07.492+0000 7fb73515f700 1 --2- 172.21.15.46:0/969973904 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fb7300b13f0 0x7fb730150db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:07.506 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:07.492+0000 7fb73515f700 1 -- 172.21.15.46:0/969973904 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb7300c9fc0 msgr2=0x7fb730069e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:56:07.506 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:07.492+0000 7fb73515f700 1 --2- 172.21.15.46:0/969973904 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb7300c9fc0 0x7fb730069e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:07.506 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:07.492+0000 7fb73515f700 1 -- 172.21.15.46:0/969973904 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb71c0094a0 con 0x7fb7301594f0 2023-07-05T18:56:07.507 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:07.492+0000 7fb72ffff700 1 --2- 172.21.15.46:0/969973904 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb7300c9fc0 0x7fb730069e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-05T18:56:07.507 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:07.492+0000 7fb73515f700 1 --2- 172.21.15.46:0/969973904 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb7301594f0 0x7fb73006a340 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7fb72800b970 tx=0x7fb72800bc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-05T18:56:07.507 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:07.492+0000 7fb72d7fa700 1 -- 172.21.15.46:0/969973904 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb72800c930 con 0x7fb7301594f0 2023-07-05T18:56:07.507 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:07.492+0000 7fb72d7fa700 1 -- 172.21.15.46:0/969973904 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb72800cab0 con 0x7fb7301594f0 2023-07-05T18:56:07.507 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:07.492+0000 7fb736bc2700 1 -- 172.21.15.46:0/969973904 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb7301f5ef0 con 0x7fb7301594f0 2023-07-05T18:56:07.507 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:07.492+0000 7fb72d7fa700 1 -- 172.21.15.46:0/969973904 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb72800ce60 con 0x7fb7301594f0 2023-07-05T18:56:07.512 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:07.492+0000 7fb736bc2700 1 -- 172.21.15.46:0/969973904 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb7301512f0 con 0x7fb7301594f0 2023-07-05T18:56:07.512 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:07.493+0000 7fb736bc2700 1 -- 172.21.15.46:0/969973904 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb730067e40 con 0x7fb7301594f0 2023-07-05T18:56:07.512 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:07.493+0000 7fb72d7fa700 1 -- 172.21.15.46:0/969973904 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 4) v1 ==== 88981+0+0 (secure 0 0 0) 0x7fb72801d3b0 con 0x7fb7301594f0 2023-07-05T18:56:07.513 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:07.494+0000 7fb72d7fa700 1 --2- 172.21.15.46:0/969973904 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7fb71406ac50 0x7fb71406d100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:56:07.513 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:07.494+0000 7fb72d7fa700 1 -- 172.21.15.46:0/969973904 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(13..13 src has 1..13) v4 ==== 4471+0+0 (secure 0 0 0) 0x7fb728006e40 con 0x7fb7301594f0 2023-07-05T18:56:07.513 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:07.494+0000 7fb73495e700 1 --2- 172.21.15.46:0/969973904 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7fb71406ac50 0x7fb71406d100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:56:07.513 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:07.494+0000 7fb73495e700 1 --2- 172.21.15.46:0/969973904 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7fb71406ac50 0x7fb71406d100 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fb724005910 tx=0x7fb724009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-05T18:56:07.514 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:07.498+0000 7fb72d7fa700 1 -- 172.21.15.46:0/969973904 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fb728054200 con 0x7fb7301594f0 2023-07-05T18:56:07.700 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:07.699+0000 7fb736bc2700 1 -- 172.21.15.46:0/969973904 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "rbd", "pg_num": 8} v 0) v1 -- 0x7fb7300672e0 con 0x7fb7301594f0 2023-07-05T18:56:08.610 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:08.609+0000 7fb72d7fa700 1 -- 172.21.15.46:0/969973904 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "rbd", "pg_num": 8}]=0 pool 'rbd' created v15) v1 ==== 109+0+0 (secure 0 0 0) 0x7fb728019020 con 0x7fb7301594f0 2023-07-05T18:56:08.614 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:08.611+0000 7fb736bc2700 1 -- 172.21.15.46:0/969973904 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7fb71406ac50 msgr2=0x7fb71406d100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:56:08.615 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:08.611+0000 7fb736bc2700 1 --2- 172.21.15.46:0/969973904 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7fb71406ac50 0x7fb71406d100 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fb724005910 tx=0x7fb724009040 comp rx=0 tx=0).stop 2023-07-05T18:56:08.615 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:08.611+0000 7fb736bc2700 1 -- 172.21.15.46:0/969973904 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb7301594f0 msgr2=0x7fb73006a340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:56:08.615 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:08.611+0000 7fb736bc2700 1 --2- 172.21.15.46:0/969973904 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb7301594f0 0x7fb73006a340 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7fb72800b970 tx=0x7fb72800bc80 comp rx=0 tx=0).stop 2023-07-05T18:56:08.615 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:08.612+0000 7fb736bc2700 1 -- 172.21.15.46:0/969973904 shutdown_connections 2023-07-05T18:56:08.615 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:08.612+0000 7fb736bc2700 1 --2- 172.21.15.46:0/969973904 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7fb71406ac50 0x7fb71406d100 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:08.615 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:08.612+0000 7fb736bc2700 1 --2- 172.21.15.46:0/969973904 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb7301594f0 0x7fb73006a340 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:08.617 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:08.612+0000 7fb736bc2700 1 --2- 172.21.15.46:0/969973904 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fb7300b13f0 0x7fb730150db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:08.617 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:08.612+0000 7fb736bc2700 1 --2- 172.21.15.46:0/969973904 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb7300c9fc0 0x7fb730069e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:08.618 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:08.612+0000 7fb736bc2700 1 -- 172.21.15.46:0/969973904 >> 172.21.15.46:0/969973904 conn(0x7fb73006bba0 msgr2=0x7fb730070520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-05T18:56:08.618 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:08.612+0000 7fb736bc2700 1 -- 172.21.15.46:0/969973904 shutdown_connections 2023-07-05T18:56:08.618 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:08.612+0000 7fb736bc2700 1 -- 172.21.15.46:0/969973904 wait complete. 2023-07-05T18:56:08.618 INFO:teuthology.orchestra.run.smithi046.stderr:pool 'rbd' created 2023-07-05T18:56:08.631 DEBUG:teuthology.orchestra.run.smithi046:> sudo ceph --cluster ceph osd pool application enable rbd rbd --yes-i-really-mean-it 2023-07-05T18:56:08.769 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:08.764+0000 7f082d65d700 1 Processor -- start 2023-07-05T18:56:08.769 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:08.764+0000 7f082d65d700 1 -- start start 2023-07-05T18:56:08.770 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:08.764+0000 7f082d65d700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f0828099dc0 0x7f082806af10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:56:08.770 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:08.764+0000 7f082d65d700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f08280cd310 0x7f082806b450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:56:08.770 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:08.764+0000 7f082d65d700 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f08280cb4a0 con 0x7f082815c970 2023-07-05T18:56:08.770 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:08.764+0000 7f082d65d700 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f08280cb780 con 0x7f0828099dc0 2023-07-05T18:56:08.770 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:08.764+0000 7f082d65d700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f08280cba60 con 0x7f08280cd310 2023-07-05T18:56:08.770 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:08.765+0000 7f08267fc700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f0828099dc0 0x7f082806af10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:56:08.770 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:08.765+0000 7f08277fe700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f08280cd310 0x7f082806b450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:56:08.771 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:08.765+0000 7f08267fc700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f0828099dc0 0x7f082806af10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.46:56918/0 (socket says 172.21.15.46:56918) 2023-07-05T18:56:08.771 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:08.765+0000 7f08277fe700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f08280cd310 0x7f082806b450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3301/0 says I am v2:172.21.15.46:41122/0 (socket says 172.21.15.46:41122) 2023-07-05T18:56:08.771 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:08.765+0000 7f08267fc700 1 -- 172.21.15.46:0/1687585991 learned_addr learned my addr 172.21.15.46:0/1687585991 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-07-05T18:56:08.771 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:08.765+0000 7f0826ffd700 1 --1- 172.21.15.46:0/1687585991 >> v1:172.21.15.73:6789/0 conn(0x7f082815c970 0x7f08280ce660 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.46:42620/0 (socket says 172.21.15.46:42620) 2023-07-05T18:56:08.771 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:08.765+0000 7f08277fe700 1 -- 172.21.15.46:0/1687585991 >> v2:172.21.15.73:3300/0 conn(0x7f0828099dc0 msgr2=0x7f082806af10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-05T18:56:08.771 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:08.765+0000 7f08277fe700 1 --2- 172.21.15.46:0/1687585991 >> v2:172.21.15.73:3300/0 conn(0x7f0828099dc0 0x7f082806af10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:08.771 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:08.765+0000 7f08277fe700 1 -- 172.21.15.46:0/1687585991 >> v1:172.21.15.73:6789/0 conn(0x7f082815c970 legacy=0x7f08280ce660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:56:08.772 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:08.765+0000 7f08277fe700 1 -- 172.21.15.46:0/1687585991 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f08280cbd40 con 0x7f08280cd310 2023-07-05T18:56:08.772 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:08.765+0000 7f08267fc700 1 --2- 172.21.15.46:0/1687585991 >> v2:172.21.15.73:3300/0 conn(0x7f0828099dc0 0x7f082806af10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-05T18:56:08.772 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:08.765+0000 7f08277fe700 1 --2- 172.21.15.46:0/1687585991 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f08280cd310 0x7f082806b450 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f0820009d90 tx=0x7f082000b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8bd2b2283c145287 server_cookie=0 in_seq=0 out_seq=0 2023-07-05T18:56:08.772 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:08.765+0000 7f0825ffb700 1 -- 172.21.15.46:0/1687585991 <== mon.2 v2:172.21.15.73:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f082000e070 con 0x7f08280cd310 2023-07-05T18:56:08.772 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:08.766+0000 7f0825ffb700 1 -- 172.21.15.46:0/1687585991 <== mon.2 v2:172.21.15.73:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f082000bb20 con 0x7f08280cd310 2023-07-05T18:56:08.772 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:08.766+0000 7f0825ffb700 1 -- 172.21.15.46:0/1687585991 <== mon.2 v2:172.21.15.73:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0820012430 con 0x7f08280cd310 2023-07-05T18:56:08.772 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:08.766+0000 7f082d65d700 1 -- 172.21.15.46:0/1687585991 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f08280cd310 msgr2=0x7f082806b450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:56:08.773 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:08.766+0000 7f082d65d700 1 --2- 172.21.15.46:0/1687585991 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f08280cd310 0x7f082806b450 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f0820009d90 tx=0x7f082000b330 comp rx=0 tx=0).stop 2023-07-05T18:56:08.773 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:08.766+0000 7f082d65d700 1 -- 172.21.15.46:0/1687585991 shutdown_connections 2023-07-05T18:56:08.773 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:08.766+0000 7f082d65d700 1 --2- 172.21.15.46:0/1687585991 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f08280cd310 0x7f082806b450 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:08.773 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:08.766+0000 7f082d65d700 1 --2- 172.21.15.46:0/1687585991 >> v2:172.21.15.73:3300/0 conn(0x7f0828099dc0 0x7f082806af10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:08.773 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:08.766+0000 7f082d65d700 1 -- 172.21.15.46:0/1687585991 >> 172.21.15.46:0/1687585991 conn(0x7f08280999f0 msgr2=0x7f08280d0a90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-05T18:56:08.773 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:08.766+0000 7f082d65d700 1 -- 172.21.15.46:0/1687585991 shutdown_connections 2023-07-05T18:56:08.773 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:08.766+0000 7f082d65d700 1 -- 172.21.15.46:0/1687585991 wait complete. 2023-07-05T18:56:08.776 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:08.767+0000 7f082d65d700 1 Processor -- start 2023-07-05T18:56:08.777 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:08.767+0000 7f082d65d700 1 -- start start 2023-07-05T18:56:08.777 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:08.768+0000 7f082d65d700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f0828099dc0 0x7f08280b38c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:56:08.777 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:08.768+0000 7f082d65d700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f08280cd310 0x7f08280b5b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:56:08.777 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:08.768+0000 7f082d65d700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f082815c970 0x7f08281560a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:56:08.777 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:08.768+0000 7f082d65d700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f082815de50 con 0x7f08280cd310 2023-07-05T18:56:08.777 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:08.768+0000 7f082d65d700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08280b3ea0 con 0x7f082815c970 2023-07-05T18:56:08.777 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:08.768+0000 7f082d65d700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f08280b4180 con 0x7f0828099dc0 2023-07-05T18:56:08.778 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:08.768+0000 7f08267fc700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f08280cd310 0x7f08280b5b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:56:08.778 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:08.768+0000 7f08267fc700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f08280cd310 0x7f08280b5b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:57440/0 (socket says 172.21.15.46:57440) 2023-07-05T18:56:08.778 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:08.768+0000 7f08267fc700 1 -- 172.21.15.46:0/4139806258 learned_addr learned my addr 172.21.15.46:0/4139806258 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-07-05T18:56:08.778 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:08.768+0000 7f08277fe700 1 --2- 172.21.15.46:0/4139806258 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f082815c970 0x7f08281560a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:56:08.779 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:08.768+0000 7f0826ffd700 1 --2- 172.21.15.46:0/4139806258 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f0828099dc0 0x7f08280b38c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:56:08.779 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:08.769+0000 7f08267fc700 1 -- 172.21.15.46:0/4139806258 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f0828099dc0 msgr2=0x7f08280b38c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:56:08.779 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:08.769+0000 7f08267fc700 1 --2- 172.21.15.46:0/4139806258 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f0828099dc0 0x7f08280b38c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:08.779 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:08.769+0000 7f08267fc700 1 -- 172.21.15.46:0/4139806258 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f082815c970 msgr2=0x7f08281560a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:56:08.779 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:08.769+0000 7f08267fc700 1 --2- 172.21.15.46:0/4139806258 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f082815c970 0x7f08281560a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:08.779 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:08.769+0000 7f08267fc700 1 -- 172.21.15.46:0/4139806258 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0818009550 con 0x7f08280cd310 2023-07-05T18:56:08.779 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:08.769+0000 7f08267fc700 1 --2- 172.21.15.46:0/4139806258 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f08280cd310 0x7f08280b5b60 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f081800ebe0 tx=0x7f081800eef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-05T18:56:08.780 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:08.769+0000 7f080f7fe700 1 -- 172.21.15.46:0/4139806258 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f081800c850 con 0x7f08280cd310 2023-07-05T18:56:08.780 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:08.769+0000 7f080f7fe700 1 -- 172.21.15.46:0/4139806258 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f081800c9b0 con 0x7f08280cd310 2023-07-05T18:56:08.780 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:08.769+0000 7f082d65d700 1 -- 172.21.15.46:0/4139806258 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0820009a70 con 0x7f08280cd310 2023-07-05T18:56:08.780 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:08.769+0000 7f080f7fe700 1 -- 172.21.15.46:0/4139806258 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f081800cd40 con 0x7f08280cd310 2023-07-05T18:56:08.780 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:08.769+0000 7f082d65d700 1 -- 172.21.15.46:0/4139806258 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f082815f290 con 0x7f08280cd310 2023-07-05T18:56:08.780 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:08.770+0000 7f082d65d700 1 -- 172.21.15.46:0/4139806258 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f08280c44b0 con 0x7f08280cd310 2023-07-05T18:56:08.780 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:08.771+0000 7f080f7fe700 1 -- 172.21.15.46:0/4139806258 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 4) v1 ==== 88981+0+0 (secure 0 0 0) 0x7f0818013470 con 0x7f08280cd310 2023-07-05T18:56:08.781 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:08.771+0000 7f080f7fe700 1 --2- 172.21.15.46:0/4139806258 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7f081406ac50 0x7f081406d100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:56:08.781 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:08.771+0000 7f080f7fe700 1 -- 172.21.15.46:0/4139806258 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(15..15 src has 1..15) v4 ==== 5188+0+0 (secure 0 0 0) 0x7f08180891a0 con 0x7f08280cd310 2023-07-05T18:56:08.781 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:08.771+0000 7f0826ffd700 1 --2- 172.21.15.46:0/4139806258 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7f081406ac50 0x7f081406d100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:56:08.781 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:08.772+0000 7f0826ffd700 1 --2- 172.21.15.46:0/4139806258 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7f081406ac50 0x7f081406d100 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f081c000f60 tx=0x7f081c007ed0 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-05T18:56:08.782 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:08.776+0000 7f080f7fe700 1 -- 172.21.15.46:0/4139806258 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f0818054610 con 0x7f08280cd310 2023-07-05T18:56:08.978 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:08.976+0000 7f082d65d700 1 -- 172.21.15.46:0/4139806258 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd pool application enable", "pool": "rbd", "app": "rbd", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f082804e1d0 con 0x7f08280cd310 2023-07-05T18:56:09.615 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:09.613+0000 7f080f7fe700 1 -- 172.21.15.46:0/4139806258 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool application enable", "pool": "rbd", "app": "rbd", "yes_i_really_mean_it": true}]=0 enabled application 'rbd' on pool 'rbd' v16) v1 ==== 173+0+0 (secure 0 0 0) 0x7f0818057c30 con 0x7f08280cd310 2023-07-05T18:56:09.619 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:09.616+0000 7f082d65d700 1 -- 172.21.15.46:0/4139806258 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7f081406ac50 msgr2=0x7f081406d100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:56:09.619 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:09.616+0000 7f082d65d700 1 --2- 172.21.15.46:0/4139806258 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7f081406ac50 0x7f081406d100 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f081c000f60 tx=0x7f081c007ed0 comp rx=0 tx=0).stop 2023-07-05T18:56:09.619 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:09.616+0000 7f082d65d700 1 -- 172.21.15.46:0/4139806258 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f08280cd310 msgr2=0x7f08280b5b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:56:09.620 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:09.616+0000 7f082d65d700 1 --2- 172.21.15.46:0/4139806258 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f08280cd310 0x7f08280b5b60 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f081800ebe0 tx=0x7f081800eef0 comp rx=0 tx=0).stop 2023-07-05T18:56:09.620 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:09.617+0000 7f082d65d700 1 -- 172.21.15.46:0/4139806258 shutdown_connections 2023-07-05T18:56:09.620 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:09.617+0000 7f082d65d700 1 --2- 172.21.15.46:0/4139806258 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7f081406ac50 0x7f081406d100 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:09.620 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:09.617+0000 7f082d65d700 1 --2- 172.21.15.46:0/4139806258 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f082815c970 0x7f08281560a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:09.620 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:09.617+0000 7f082d65d700 1 --2- 172.21.15.46:0/4139806258 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f0828099dc0 0x7f08280b38c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:09.621 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:09.617+0000 7f082d65d700 1 --2- 172.21.15.46:0/4139806258 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f08280cd310 0x7f08280b5b60 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:09.621 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:09.617+0000 7f082d65d700 1 -- 172.21.15.46:0/4139806258 >> 172.21.15.46:0/4139806258 conn(0x7f08280999f0 msgr2=0x7f08280c9b70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-05T18:56:09.621 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:09.617+0000 7f082d65d700 1 -- 172.21.15.46:0/4139806258 shutdown_connections 2023-07-05T18:56:09.621 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:09.617+0000 7f082d65d700 1 -- 172.21.15.46:0/4139806258 wait complete. 2023-07-05T18:56:09.624 INFO:teuthology.orchestra.run.smithi046.stderr:enabled application 'rbd' on pool 'rbd' 2023-07-05T18:56:09.635 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2023-07-05T18:56:09.636 INFO:tasks.ceph.mds.a:Restarting daemon 2023-07-05T18:56:09.636 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-07-05T18:56:09.640 INFO:tasks.ceph.mds.a:Started 2023-07-05T18:56:09.640 INFO:tasks.ceph.mds.c:Restarting daemon 2023-07-05T18:56:09.641 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-07-05T18:56:09.648 INFO:tasks.ceph.mds.c:Started 2023-07-05T18:56:09.648 INFO:tasks.ceph.mds.b:Restarting daemon 2023-07-05T18:56:09.648 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-07-05T18:56:09.653 INFO:tasks.ceph.mds.b:Started 2023-07-05T18:56:09.653 INFO:tasks.ceph.mds.d:Restarting daemon 2023-07-05T18:56:09.653 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-07-05T18:56:09.656 INFO:tasks.ceph.mds.d:Started 2023-07-05T18:56:09.656 INFO:tasks.ceph:Setting up CephFS filesystem(s)... 2023-07-05T18:56:09.658 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-05T18:56:09.737 INFO:tasks.ceph.mds.a.smithi046.stdout:starting mds.a at 2023-07-05T18:56:09.737 INFO:tasks.ceph.mds.c.smithi046.stdout:starting mds.c at 2023-07-05T18:56:09.751 INFO:tasks.ceph.mds.b.smithi073.stdout:starting mds.b at 2023-07-05T18:56:09.751 INFO:tasks.ceph.mds.d.smithi073.stdout:starting mds.d at 2023-07-05T18:56:09.806 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:09.801+0000 7f5d80f02700 1 Processor -- start 2023-07-05T18:56:09.806 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:09.801+0000 7f5d80f02700 1 -- start start 2023-07-05T18:56:09.806 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:09.802+0000 7f5d80f02700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f5d7c06f5b0 0x7f5d7c06f980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:56:09.806 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:09.802+0000 7f5d80f02700 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5d7c0c9400 con 0x7f5d7c0ca150 2023-07-05T18:56:09.807 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:09.802+0000 7f5d80f02700 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5d7c0cdd60 con 0x7f5d7c0cc840 2023-07-05T18:56:09.807 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:09.802+0000 7f5d80f02700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5d7c06fec0 con 0x7f5d7c06f5b0 2023-07-05T18:56:09.807 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:09.802+0000 7f5d7ad9d700 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7f5d7c0ca150 0x7f5d7c0ca5d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:56760/0 (socket says 172.21.15.46:56760) 2023-07-05T18:56:09.807 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:09.802+0000 7f5d7ad9d700 1 -- 172.21.15.46:0/699994881 learned_addr learned my addr 172.21.15.46:0/699994881 (peer_addr_for_me v1:172.21.15.46:0/0) 2023-07-05T18:56:09.807 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:09.802+0000 7f5d7a59c700 1 --2- 172.21.15.46:0/699994881 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f5d7c06f5b0 0x7f5d7c06f980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:56:09.807 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:09.802+0000 7f5d7959a700 1 -- 172.21.15.46:0/699994881 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1371095005 0 0) 0x7f5d7c0c9400 con 0x7f5d7c0ca150 2023-07-05T18:56:09.807 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:09.802+0000 7f5d7959a700 1 -- 172.21.15.46:0/699994881 --> v1:172.21.15.46:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5d640035b0 con 0x7f5d7c0ca150 2023-07-05T18:56:09.808 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:09.802+0000 7f5d7959a700 1 -- 172.21.15.46:0/699994881 <== mon.1 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3926390453 0 0) 0x7f5d7c0cdd60 con 0x7f5d7c0cc840 2023-07-05T18:56:09.808 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:09.802+0000 7f5d7a59c700 1 -- 172.21.15.46:0/699994881 >> v1:172.21.15.73:6789/0 conn(0x7f5d7c0cc840 legacy=0x7f5d7c0cd650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:56:09.808 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:09.802+0000 7f5d7a59c700 1 -- 172.21.15.46:0/699994881 >> v1:172.21.15.46:6789/0 conn(0x7f5d7c0ca150 legacy=0x7f5d7c0ca5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:56:09.808 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:09.802+0000 7f5d7a59c700 1 -- 172.21.15.46:0/699994881 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5d7c1596a0 con 0x7f5d7c06f5b0 2023-07-05T18:56:09.808 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:09.803+0000 7f5d7a59c700 1 --2- 172.21.15.46:0/699994881 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f5d7c06f5b0 0x7f5d7c06f980 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f5d6c009870 tx=0x7f5d6c009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1aafb0799e17ce4b server_cookie=0 in_seq=0 out_seq=0 2023-07-05T18:56:09.808 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:09.803+0000 7f5d7959a700 1 -- 172.21.15.46:0/699994881 <== mon.2 v2:172.21.15.73:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d6c011830 con 0x7f5d7c06f5b0 2023-07-05T18:56:09.808 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:09.803+0000 7f5d7959a700 1 -- 172.21.15.46:0/699994881 <== mon.2 v2:172.21.15.73:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5d6c011990 con 0x7f5d7c06f5b0 2023-07-05T18:56:09.809 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:09.803+0000 7f5d7959a700 1 -- 172.21.15.46:0/699994881 <== mon.2 v2:172.21.15.73:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d6c011d20 con 0x7f5d7c06f5b0 2023-07-05T18:56:09.809 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:09.803+0000 7f5d80f02700 1 -- 172.21.15.46:0/699994881 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f5d7c06f5b0 msgr2=0x7f5d7c06f980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:56:09.809 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:09.803+0000 7f5d80f02700 1 --2- 172.21.15.46:0/699994881 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f5d7c06f5b0 0x7f5d7c06f980 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f5d6c009870 tx=0x7f5d6c009b80 comp rx=0 tx=0).stop 2023-07-05T18:56:09.809 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:09.803+0000 7f5d80f02700 1 -- 172.21.15.46:0/699994881 shutdown_connections 2023-07-05T18:56:09.809 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:09.803+0000 7f5d80f02700 1 --2- 172.21.15.46:0/699994881 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f5d7c06f5b0 0x7f5d7c06f980 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:09.809 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:09.803+0000 7f5d80f02700 1 -- 172.21.15.46:0/699994881 >> 172.21.15.46:0/699994881 conn(0x7f5d7c0b0fc0 msgr2=0x7f5d7c0ce860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-05T18:56:09.809 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:09.803+0000 7f5d80f02700 1 -- 172.21.15.46:0/699994881 shutdown_connections 2023-07-05T18:56:09.809 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:09.803+0000 7f5d80f02700 1 -- 172.21.15.46:0/699994881 wait complete. 2023-07-05T18:56:09.814 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:09.805+0000 7f5d80f02700 1 Processor -- start 2023-07-05T18:56:09.814 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:09.805+0000 7f5d80f02700 1 -- start start 2023-07-05T18:56:09.815 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:09.805+0000 7f5d80f02700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f5d7c06f5b0 0x7f5d7c0b16d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:56:09.815 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:09.805+0000 7f5d80f02700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5d7c0ca150 0x7f5d7c154070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:56:09.815 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:09.806+0000 7f5d80f02700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5d7c0cc840 0x7f5d7c1e43c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:56:09.815 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:09.806+0000 7f5d80f02700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d7c0c30b0 con 0x7f5d7c0ca150 2023-07-05T18:56:09.815 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:09.806+0000 7f5d80f02700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d7c0c2430 con 0x7f5d7c0cc840 2023-07-05T18:56:09.815 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:09.806+0000 7f5d80f02700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5d7c0c2710 con 0x7f5d7c06f5b0 2023-07-05T18:56:09.815 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:09.806+0000 7f5d79d9b700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5d7c0ca150 0x7f5d7c154070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:56:09.815 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:09.806+0000 7f5d79d9b700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5d7c0ca150 0x7f5d7c154070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:57492/0 (socket says 172.21.15.46:57492) 2023-07-05T18:56:09.816 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:09.806+0000 7f5d79d9b700 1 -- 172.21.15.46:0/1905882434 learned_addr learned my addr 172.21.15.46:0/1905882434 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-07-05T18:56:09.816 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:09.806+0000 7f5d7ad9d700 1 --2- 172.21.15.46:0/1905882434 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5d7c0cc840 0x7f5d7c1e43c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:56:09.817 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:09.806+0000 7f5d7a59c700 1 --2- 172.21.15.46:0/1905882434 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f5d7c06f5b0 0x7f5d7c0b16d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:56:09.817 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:09.806+0000 7f5d79d9b700 1 -- 172.21.15.46:0/1905882434 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f5d7c06f5b0 msgr2=0x7f5d7c0b16d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:56:09.818 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:09.806+0000 7f5d79d9b700 1 --2- 172.21.15.46:0/1905882434 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f5d7c06f5b0 0x7f5d7c0b16d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:09.818 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:09.806+0000 7f5d79d9b700 1 -- 172.21.15.46:0/1905882434 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5d7c0cc840 msgr2=0x7f5d7c1e43c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:56:09.818 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:09.806+0000 7f5d79d9b700 1 --2- 172.21.15.46:0/1905882434 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5d7c0cc840 0x7f5d7c1e43c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:09.818 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:09.806+0000 7f5d79d9b700 1 -- 172.21.15.46:0/1905882434 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5d6c0094a0 con 0x7f5d7c0ca150 2023-07-05T18:56:09.818 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:09.806+0000 7f5d7a59c700 1 --2- 172.21.15.46:0/1905882434 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f5d7c06f5b0 0x7f5d7c0b16d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-05T18:56:09.818 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:09.806+0000 7f5d7ad9d700 1 --2- 172.21.15.46:0/1905882434 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5d7c0cc840 0x7f5d7c1e43c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-05T18:56:09.818 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:09.806+0000 7f5d79d9b700 1 --2- 172.21.15.46:0/1905882434 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5d7c0ca150 0x7f5d7c154070 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f5d7000c450 tx=0x7f5d7000c760 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-05T18:56:09.819 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:09.806+0000 7f5d6affd700 1 -- 172.21.15.46:0/1905882434 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d700054e0 con 0x7f5d7c0ca150 2023-07-05T18:56:09.819 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:09.806+0000 7f5d80f02700 1 -- 172.21.15.46:0/1905882434 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5d7c0c29f0 con 0x7f5d7c0ca150 2023-07-05T18:56:09.824 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:09.806+0000 7f5d6affd700 1 -- 172.21.15.46:0/1905882434 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5d7000ce60 con 0x7f5d7c0ca150 2023-07-05T18:56:09.825 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:09.806+0000 7f5d6affd700 1 -- 172.21.15.46:0/1905882434 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d700038a0 con 0x7f5d7c0ca150 2023-07-05T18:56:09.825 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:09.807+0000 7f5d80f02700 1 -- 172.21.15.46:0/1905882434 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5d7c154b80 con 0x7f5d7c0ca150 2023-07-05T18:56:09.826 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:09.808+0000 7f5d80f02700 1 -- 172.21.15.46:0/1905882434 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5d7c0c31f0 con 0x7f5d7c0ca150 2023-07-05T18:56:09.826 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:09.808+0000 7f5d6affd700 1 -- 172.21.15.46:0/1905882434 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 4) v1 ==== 88981+0+0 (secure 0 0 0) 0x7f5d70003a00 con 0x7f5d7c0ca150 2023-07-05T18:56:09.826 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:09.809+0000 7f5d6affd700 1 --2- 172.21.15.46:0/1905882434 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7f5d5c06ac50 0x7f5d5c06d100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:56:09.826 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:09.809+0000 7f5d6affd700 1 -- 172.21.15.46:0/1905882434 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f5d700883e0 con 0x7f5d7c0ca150 2023-07-05T18:56:09.826 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:09.809+0000 7f5d7a59c700 1 --2- 172.21.15.46:0/1905882434 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7f5d5c06ac50 0x7f5d5c06d100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:56:09.826 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:09.809+0000 7f5d7a59c700 1 --2- 172.21.15.46:0/1905882434 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7f5d5c06ac50 0x7f5d5c06d100 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f5d6c0097c0 tx=0x7f5d6c01c040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-05T18:56:09.827 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:09.813+0000 7f5d6affd700 1 -- 172.21.15.46:0/1905882434 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f5d7c0c31f0 con 0x7f5d7c0ca150 2023-07-05T18:56:10.023 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:10.021+0000 7f5d80f02700 1 -- 172.21.15.46:0/1905882434 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f5d7c0c31f0 con 0x7f5d7c0ca150 2023-07-05T18:56:10.024 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:10.022+0000 7f5d6affd700 1 -- 172.21.15.46:0/1905882434 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v16) v1 ==== 74+0+14545 (secure 0 0 0) 0x7f5d7c0c31f0 con 0x7f5d7c0ca150 2023-07-05T18:56:10.024 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T18:56:10.025 INFO:teuthology.orchestra.run.smithi046.stdout:{"epoch":16,"fsid":"042652d3-d80c-4ad8-9366-3e94f2a0a512","created":"2023-07-05T18:55:56.455710+0000","modified":"2023-07-05T18:56:09.608307+0000","last_up_change":"2023-07-05T18:56:06.594022+0000","last_in_change":"2023-07-05T18:55:58.879340+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-07-05T18:56:07.729620+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2023-07-05T18:56:08.128122+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"20009183-9a47-4392-8751-883f88d2bfb1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6813","nonce":4151971443},{"type":"v1","addr":"172.21.15.46:6815","nonce":4151971443}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6817","nonce":4151971443},{"type":"v1","addr":"172.21.15.46:6818","nonce":4151971443}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6822","nonce":4151971443},{"type":"v1","addr":"172.21.15.46:6823","nonce":4151971443}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6820","nonce":4151971443},{"type":"v1","addr":"172.21.15.46:6821","nonce":4151971443}]},"public_addr":"172.21.15.46:6815/4151971443","cluster_addr":"172.21.15.46:6818/4151971443","heartbeat_back_addr":"172.21.15.46:6823/4151971443","heartbeat_front_addr":"172.21.15.46:6821/4151971443","state":["exists","up"]},{"osd":1,"uuid":"91b4a7b0-e4e4-4888-a1fe-9edb0d68004c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6808","nonce":502575881},{"type":"v1","addr":"172.21.15.46:6809","nonce":502575881}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6810","nonce":502575881},{"type":"v1","addr":"172.21.15.46:6811","nonce":502575881}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6816","nonce":502575881},{"type":"v1","addr":"172.21.15.46:6819","nonce":502575881}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6812","nonce":502575881},{"type":"v1","addr":"172.21.15.46:6814","nonce":502575881}]},"public_addr":"172.21.15.46:6809/502575881","cluster_addr":"172.21.15.46:6811/502575881","heartbeat_back_addr":"172.21.15.46:6819/502575881","heartbeat_front_addr":"172.21.15.46:6814/502575881","state":["exists","up"]},{"osd":2,"uuid":"669ff744-1331-47c5-8579-0440731c889a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6800","nonce":2115251461},{"type":"v1","addr":"172.21.15.46:6801","nonce":2115251461}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6802","nonce":2115251461},{"type":"v1","addr":"172.21.15.46:6803","nonce":2115251461}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6806","nonce":2115251461},{"type":"v1","addr":"172.21.15.46:6807","nonce":2115251461}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6804","nonce":2115251461},{"type":"v1","addr":"172.21.15.46:6805","nonce":2115251461}]},"public_addr":"172.21.15.46:6801/2115251461","cluster_addr":"172.21.15.46:6803/2115251461","heartbeat_back_addr":"172.21.15.46:6807/2115251461","heartbeat_front_addr":"172.21.15.46:6805/2115251461","state":["exists","up"]},{"osd":3,"uuid":"34e1b86d-ffad-415d-861c-07a5f08068a6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6824","nonce":2981388766},{"type":"v1","addr":"172.21.15.46:6825","nonce":2981388766}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6826","nonce":2981388766},{"type":"v1","addr":"172.21.15.46:6827","nonce":2981388766}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6830","nonce":2981388766},{"type":"v1","addr":"172.21.15.46:6831","nonce":2981388766}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6828","nonce":2981388766},{"type":"v1","addr":"172.21.15.46:6829","nonce":2981388766}]},"public_addr":"172.21.15.46:6825/2981388766","cluster_addr":"172.21.15.46:6827/2981388766","heartbeat_back_addr":"172.21.15.46:6831/2981388766","heartbeat_front_addr":"172.21.15.46:6829/2981388766","state":["exists","up"]},{"osd":4,"uuid":"57ffcb91-c7dc-4a69-ae71-4d9622a14a05","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6800","nonce":2083655348},{"type":"v1","addr":"172.21.15.73:6801","nonce":2083655348}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6802","nonce":2083655348},{"type":"v1","addr":"172.21.15.73:6803","nonce":2083655348}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6806","nonce":2083655348},{"type":"v1","addr":"172.21.15.73:6807","nonce":2083655348}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6804","nonce":2083655348},{"type":"v1","addr":"172.21.15.73:6805","nonce":2083655348}]},"public_addr":"172.21.15.73:6801/2083655348","cluster_addr":"172.21.15.73:6803/2083655348","heartbeat_back_addr":"172.21.15.73:6807/2083655348","heartbeat_front_addr":"172.21.15.73:6805/2083655348","state":["exists","up"]},{"osd":5,"uuid":"665f41c9-ee20-49cf-bf0e-fbe0c03d3aed","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6824","nonce":2803788401},{"type":"v1","addr":"172.21.15.73:6825","nonce":2803788401}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6826","nonce":2803788401},{"type":"v1","addr":"172.21.15.73:6827","nonce":2803788401}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6830","nonce":2803788401},{"type":"v1","addr":"172.21.15.73:6831","nonce":2803788401}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6828","nonce":2803788401},{"type":"v1","addr":"172.21.15.73:6829","nonce":2803788401}]},"public_addr":"172.21.15.73:6825/2803788401","cluster_addr":"172.21.15.73:6827/2803788401","heartbeat_back_addr":"172.21.15.73:6831/2803788401","heartbeat_front_addr":"172.21.15.73:6829/2803788401","state":["exists","up"]},{"osd":6,"uuid":"5790c6cc-bd56-4ce4-9a7c-0f0c3b59215c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6808","nonce":974108383},{"type":"v1","addr":"172.21.15.73:6809","nonce":974108383}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6810","nonce":974108383},{"type":"v1","addr":"172.21.15.73:6811","nonce":974108383}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6815","nonce":974108383},{"type":"v1","addr":"172.21.15.73:6817","nonce":974108383}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6812","nonce":974108383},{"type":"v1","addr":"172.21.15.73:6813","nonce":974108383}]},"public_addr":"172.21.15.73:6809/974108383","cluster_addr":"172.21.15.73:6811/974108383","heartbeat_back_addr":"172.21.15.73:6817/974108383","heartbeat_front_addr":"172.21.15.73:6813/974108383","state":["exists","up"]},{"osd":7,"uuid":"b66f4d2e-147e-4c9b-97dd-cbd59d33802e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6814","nonce":3772673248},{"type":"v1","addr":"172.21.15.73:6816","nonce":3772673248}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6818","nonce":3772673248},{"type":"v1","addr":"172.21.15.73:6819","nonce":3772673248}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6822","nonce":3772673248},{"type":"v1","addr":"172.21.15.73:6823","nonce":3772673248}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6820","nonce":3772673248},{"type":"v1","addr":"172.21.15.73:6821","nonce":3772673248}]},"public_addr":"172.21.15.73:6816/3772673248","cluster_addr":"172.21.15.73:6819/3772673248","heartbeat_back_addr":"172.21.15.73:6823/3772673248","heartbeat_front_addr":"172.21.15.73:6821/3772673248","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-05T18:56:04.115334+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-05T18:56:04.071250+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-05T18:56:04.044387+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-05T18:56:04.085389+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-05T18:56:04.090726+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-05T18:56:04.074529+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-05T18:56:04.058841+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-05T18:56:04.043054+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-05T18:56:10.026 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:10.024+0000 7f5d80f02700 1 -- 172.21.15.46:0/1905882434 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7f5d5c06ac50 msgr2=0x7f5d5c06d100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:56:10.027 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:10.024+0000 7f5d80f02700 1 --2- 172.21.15.46:0/1905882434 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7f5d5c06ac50 0x7f5d5c06d100 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f5d6c0097c0 tx=0x7f5d6c01c040 comp rx=0 tx=0).stop 2023-07-05T18:56:10.027 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:10.024+0000 7f5d80f02700 1 -- 172.21.15.46:0/1905882434 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5d7c0ca150 msgr2=0x7f5d7c154070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:56:10.028 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:10.024+0000 7f5d80f02700 1 --2- 172.21.15.46:0/1905882434 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5d7c0ca150 0x7f5d7c154070 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f5d7000c450 tx=0x7f5d7000c760 comp rx=0 tx=0).stop 2023-07-05T18:56:10.028 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:10.024+0000 7f5d80f02700 1 -- 172.21.15.46:0/1905882434 shutdown_connections 2023-07-05T18:56:10.028 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:10.024+0000 7f5d80f02700 1 --2- 172.21.15.46:0/1905882434 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7f5d5c06ac50 0x7f5d5c06d100 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:10.028 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:10.024+0000 7f5d80f02700 1 --2- 172.21.15.46:0/1905882434 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5d7c0cc840 0x7f5d7c1e43c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:10.028 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:10.024+0000 7f5d80f02700 1 --2- 172.21.15.46:0/1905882434 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f5d7c06f5b0 0x7f5d7c0b16d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:10.029 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:10.024+0000 7f5d80f02700 1 --2- 172.21.15.46:0/1905882434 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5d7c0ca150 0x7f5d7c154070 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:10.029 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:10.024+0000 7f5d80f02700 1 -- 172.21.15.46:0/1905882434 >> 172.21.15.46:0/1905882434 conn(0x7f5d7c0b0fc0 msgr2=0x7f5d7c0aecf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-05T18:56:10.029 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:10.024+0000 7f5d80f02700 1 -- 172.21.15.46:0/1905882434 shutdown_connections 2023-07-05T18:56:10.029 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:10.024+0000 7f5d80f02700 1 -- 172.21.15.46:0/1905882434 wait complete. 2023-07-05T18:56:10.039 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'rbd', 'create_time': '2023-07-05T18:56:07.729620+0000', 'flags': 32769, 'flags_names': 'hashpspool,creating', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': '.mgr', 'create_time': '2023-07-05T18:56:08.128122+0000', 'flags': 32769, 'flags_names': 'hashpspool,creating', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-07-05T18:56:10.039 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-07-05T18:56:10.185 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:10.170+0000 7fef586df700 1 Processor -- start 2023-07-05T18:56:10.185 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:10.170+0000 7fef586df700 1 -- start start 2023-07-05T18:56:10.186 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:10.171+0000 7fef586df700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fef500b13f0 0x7fef500b1870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:56:10.186 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:10.171+0000 7fef586df700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fef500c9fc0 0x7fef500ca3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:56:10.186 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:10.171+0000 7fef586df700 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fef5015e040 con 0x7fef501594f0 2023-07-05T18:56:10.186 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:10.171+0000 7fef586df700 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fef500ce200 con 0x7fef500b13f0 2023-07-05T18:56:10.187 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:10.171+0000 7fef586df700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fef500b1db0 con 0x7fef500c9fc0 2023-07-05T18:56:10.187 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:10.171+0000 7fef55c7a700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fef500b13f0 0x7fef500b1870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:56:10.187 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:10.171+0000 7fef5647b700 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7fef501594f0 0x7fef500cd690 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:56770/0 (socket says 172.21.15.46:56770) 2023-07-05T18:56:10.187 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:10.171+0000 7fef5647b700 1 -- 172.21.15.46:0/17373105 learned_addr learned my addr 172.21.15.46:0/17373105 (peer_addr_for_me v1:172.21.15.46:0/0) 2023-07-05T18:56:10.187 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:10.171+0000 7fef56c7c700 1 --2- 172.21.15.46:0/17373105 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fef500c9fc0 0x7fef500ca3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:56:10.187 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:10.172+0000 7fef55c7a700 1 -- 172.21.15.46:0/17373105 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fef500c9fc0 msgr2=0x7fef500ca3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-05T18:56:10.188 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:10.172+0000 7fef55c7a700 1 --2- 172.21.15.46:0/17373105 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fef500c9fc0 0x7fef500ca3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:10.188 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:10.172+0000 7fef55c7a700 1 -- 172.21.15.46:0/17373105 >> v1:172.21.15.46:6789/0 conn(0x7fef501594f0 legacy=0x7fef500cd690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:56:10.188 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:10.172+0000 7fef55c7a700 1 -- 172.21.15.46:0/17373105 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef5015dbb0 con 0x7fef500b13f0 2023-07-05T18:56:10.188 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:10.172+0000 7fef55479700 1 -- 172.21.15.46:0/17373105 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 512214141 0 0) 0x7fef5015e040 con 0x7fef501594f0 2023-07-05T18:56:10.188 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:10.172+0000 7fef55c7a700 1 --2- 172.21.15.46:0/17373105 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fef500b13f0 0x7fef500b1870 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fef4c009840 tx=0x7fef4c009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=843f8acdbe679b19 server_cookie=0 in_seq=0 out_seq=0 2023-07-05T18:56:10.189 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:10.172+0000 7fef55479700 1 -- 172.21.15.46:0/17373105 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef4c011830 con 0x7fef500b13f0 2023-07-05T18:56:10.189 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:10.172+0000 7fef55479700 1 -- 172.21.15.46:0/17373105 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fef4c011990 con 0x7fef500b13f0 2023-07-05T18:56:10.189 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:10.172+0000 7fef55479700 1 -- 172.21.15.46:0/17373105 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef4c011d20 con 0x7fef500b13f0 2023-07-05T18:56:10.189 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:10.173+0000 7fef586df700 1 -- 172.21.15.46:0/17373105 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fef500b13f0 msgr2=0x7fef500b1870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:56:10.189 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:10.173+0000 7fef586df700 1 --2- 172.21.15.46:0/17373105 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fef500b13f0 0x7fef500b1870 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fef4c009840 tx=0x7fef4c009b50 comp rx=0 tx=0).stop 2023-07-05T18:56:10.190 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:10.173+0000 7fef586df700 1 -- 172.21.15.46:0/17373105 shutdown_connections 2023-07-05T18:56:10.190 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:10.173+0000 7fef586df700 1 --2- 172.21.15.46:0/17373105 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fef500c9fc0 0x7fef500ca3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:10.190 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:10.173+0000 7fef586df700 1 --2- 172.21.15.46:0/17373105 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fef500b13f0 0x7fef500b1870 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:10.190 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:10.173+0000 7fef586df700 1 -- 172.21.15.46:0/17373105 >> 172.21.15.46:0/17373105 conn(0x7fef5006bba0 msgr2=0x7fef500cc3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-05T18:56:10.190 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:10.173+0000 7fef586df700 1 -- 172.21.15.46:0/17373105 shutdown_connections 2023-07-05T18:56:10.191 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:10.173+0000 7fef586df700 1 -- 172.21.15.46:0/17373105 wait complete. 2023-07-05T18:56:10.191 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:10.174+0000 7fef586df700 1 Processor -- start 2023-07-05T18:56:10.191 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:10.174+0000 7fef586df700 1 -- start start 2023-07-05T18:56:10.191 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:10.175+0000 7fef586df700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fef500b13f0 0x7fef500adfe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:56:10.191 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:10.175+0000 7fef586df700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fef500c9fc0 0x7fef50152e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:56:10.191 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:10.175+0000 7fef586df700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fef501594f0 0x7fef500c54b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:56:10.191 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:10.175+0000 7fef586df700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef500ae520 con 0x7fef501594f0 2023-07-05T18:56:10.191 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:10.175+0000 7fef586df700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef500accf0 con 0x7fef500c9fc0 2023-07-05T18:56:10.192 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:10.175+0000 7fef586df700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fef500acf40 con 0x7fef500b13f0 2023-07-05T18:56:10.193 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:10.175+0000 7fef56c7c700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fef501594f0 0x7fef500c54b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:56:10.194 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:10.175+0000 7fef56c7c700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fef501594f0 0x7fef500c54b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:57508/0 (socket says 172.21.15.46:57508) 2023-07-05T18:56:10.194 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:10.175+0000 7fef56c7c700 1 -- 172.21.15.46:0/3818620978 learned_addr learned my addr 172.21.15.46:0/3818620978 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-07-05T18:56:10.194 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:10.175+0000 7fef5647b700 1 --2- 172.21.15.46:0/3818620978 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fef500b13f0 0x7fef500adfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:56:10.194 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:10.175+0000 7fef55c7a700 1 --2- 172.21.15.46:0/3818620978 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fef500c9fc0 0x7fef50152e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:56:10.194 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:10.175+0000 7fef56c7c700 1 -- 172.21.15.46:0/3818620978 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fef500b13f0 msgr2=0x7fef500adfe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:56:10.194 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:10.175+0000 7fef56c7c700 1 --2- 172.21.15.46:0/3818620978 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fef500b13f0 0x7fef500adfe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:10.194 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:10.175+0000 7fef56c7c700 1 -- 172.21.15.46:0/3818620978 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fef500c9fc0 msgr2=0x7fef50152e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:56:10.195 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:10.175+0000 7fef56c7c700 1 --2- 172.21.15.46:0/3818620978 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fef500c9fc0 0x7fef50152e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:10.195 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:10.175+0000 7fef56c7c700 1 -- 172.21.15.46:0/3818620978 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef4c0094a0 con 0x7fef501594f0 2023-07-05T18:56:10.195 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:10.175+0000 7fef56c7c700 1 --2- 172.21.15.46:0/3818620978 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fef501594f0 0x7fef500c54b0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fef4800efc0 tx=0x7fef4800c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-05T18:56:10.195 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:10.175+0000 7fef46ffd700 1 -- 172.21.15.46:0/3818620978 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef48009ea0 con 0x7fef501594f0 2023-07-05T18:56:10.195 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:10.175+0000 7fef46ffd700 1 -- 172.21.15.46:0/3818620978 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fef4800f040 con 0x7fef501594f0 2023-07-05T18:56:10.195 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:10.175+0000 7fef586df700 1 -- 172.21.15.46:0/3818620978 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fef500ad220 con 0x7fef501594f0 2023-07-05T18:56:10.195 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:10.175+0000 7fef46ffd700 1 -- 172.21.15.46:0/3818620978 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef4800ced0 con 0x7fef501594f0 2023-07-05T18:56:10.196 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:10.175+0000 7fef586df700 1 -- 172.21.15.46:0/3818620978 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fef500ad7e0 con 0x7fef501594f0 2023-07-05T18:56:10.196 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:10.176+0000 7fef586df700 1 -- 172.21.15.46:0/3818620978 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fef500672e0 con 0x7fef501594f0 2023-07-05T18:56:10.196 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:10.177+0000 7fef46ffd700 1 -- 172.21.15.46:0/3818620978 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 4) v1 ==== 88981+0+0 (secure 0 0 0) 0x7fef48014480 con 0x7fef501594f0 2023-07-05T18:56:10.196 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:10.177+0000 7fef46ffd700 1 --2- 172.21.15.46:0/3818620978 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7fef3406ac50 0x7fef3406d100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:56:10.196 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:10.177+0000 7fef46ffd700 1 -- 172.21.15.46:0/3818620978 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 5210+0+0 (secure 0 0 0) 0x7fef480897b0 con 0x7fef501594f0 2023-07-05T18:56:10.196 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:10.182+0000 7fef46ffd700 1 -- 172.21.15.46:0/3818620978 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fef48054d20 con 0x7fef501594f0 2023-07-05T18:56:10.197 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:10.189+0000 7fef5647b700 1 --2- 172.21.15.46:0/3818620978 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7fef3406ac50 0x7fef3406d100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:56:10.197 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:10.190+0000 7fef5647b700 1 --2- 172.21.15.46:0/3818620978 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7fef3406ac50 0x7fef3406d100 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fef40000f60 tx=0x7fef40007e70 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-05T18:56:10.383 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:10.381+0000 7fef586df700 1 -- 172.21.15.46:0/3818620978 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fef500cd210 con 0x7fef501594f0 2023-07-05T18:56:10.383 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:10.381+0000 7fef46ffd700 1 -- 172.21.15.46:0/3818620978 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v16) v1 ==== 92+0+10 (secure 0 0 0) 0x7fef48058340 con 0x7fef501594f0 2023-07-05T18:56:10.384 INFO:teuthology.orchestra.run.smithi046.stdout:pg_num: 8 2023-07-05T18:56:10.386 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:10.383+0000 7fef586df700 1 -- 172.21.15.46:0/3818620978 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7fef3406ac50 msgr2=0x7fef3406d100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:56:10.386 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:10.383+0000 7fef586df700 1 --2- 172.21.15.46:0/3818620978 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7fef3406ac50 0x7fef3406d100 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fef40000f60 tx=0x7fef40007e70 comp rx=0 tx=0).stop 2023-07-05T18:56:10.386 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:10.383+0000 7fef586df700 1 -- 172.21.15.46:0/3818620978 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fef501594f0 msgr2=0x7fef500c54b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:56:10.386 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:10.383+0000 7fef586df700 1 --2- 172.21.15.46:0/3818620978 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fef501594f0 0x7fef500c54b0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fef4800efc0 tx=0x7fef4800c3a0 comp rx=0 tx=0).stop 2023-07-05T18:56:10.386 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:10.383+0000 7fef586df700 1 -- 172.21.15.46:0/3818620978 shutdown_connections 2023-07-05T18:56:10.387 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:10.383+0000 7fef586df700 1 --2- 172.21.15.46:0/3818620978 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7fef3406ac50 0x7fef3406d100 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:10.387 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:10.383+0000 7fef586df700 1 --2- 172.21.15.46:0/3818620978 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fef501594f0 0x7fef500c54b0 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:10.387 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:10.383+0000 7fef586df700 1 --2- 172.21.15.46:0/3818620978 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fef500b13f0 0x7fef500adfe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:10.387 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:10.383+0000 7fef586df700 1 --2- 172.21.15.46:0/3818620978 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fef500c9fc0 0x7fef50152e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:10.387 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:10.383+0000 7fef586df700 1 -- 172.21.15.46:0/3818620978 >> 172.21.15.46:0/3818620978 conn(0x7fef5006bba0 msgr2=0x7fef500af030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-05T18:56:10.387 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:10.383+0000 7fef586df700 1 -- 172.21.15.46:0/3818620978 shutdown_connections 2023-07-05T18:56:10.387 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:10.383+0000 7fef586df700 1 -- 172.21.15.46:0/3818620978 wait complete. 2023-07-05T18:56:10.407 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-07-05T18:56:10.541 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:10.538+0000 7f794bbbf700 1 Processor -- start 2023-07-05T18:56:10.541 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:10.538+0000 7f794bbbf700 1 -- start start 2023-07-05T18:56:10.541 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:10.539+0000 7f794bbbf700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f794406bc70 0x7f794406c040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:56:10.541 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:10.539+0000 7f794bbbf700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f7944069e00 0x7f79440c4580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:56:10.541 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:10.539+0000 7f794bbbf700 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f794406b060 con 0x7f794406a270 2023-07-05T18:56:10.542 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:10.539+0000 7f794bbbf700 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f79440c4160 con 0x7f7944069e00 2023-07-05T18:56:10.542 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:10.539+0000 7f794bbbf700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f794406c580 con 0x7f794406bc70 2023-07-05T18:56:10.555 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:10.539+0000 7f794915a700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f7944069e00 0x7f79440c4580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:56:10.556 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:10.539+0000 7f794995b700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f794406bc70 0x7f794406c040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:56:10.556 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:10.539+0000 7f794a15c700 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7f794406a270 0x7f79440c4ac0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.46:42704/0 (socket says 172.21.15.46:42704) 2023-07-05T18:56:10.556 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:10.539+0000 7f794915a700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f7944069e00 0x7f79440c4580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.46:56998/0 (socket says 172.21.15.46:56998) 2023-07-05T18:56:10.556 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:10.539+0000 7f794a15c700 1 -- 172.21.15.46:0/2636656942 learned_addr learned my addr 172.21.15.46:0/2636656942 (peer_addr_for_me v1:172.21.15.46:0/0) 2023-07-05T18:56:10.556 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:10.539+0000 7f794995b700 1 --2- 172.21.15.46:0/2636656942 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f794406bc70 0x7f794406c040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3301/0 says I am v2:172.21.15.46:41198/0 (socket says 172.21.15.46:41198) 2023-07-05T18:56:10.557 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:10.539+0000 7f794995b700 1 -- 172.21.15.46:0/2636656942 >> v2:172.21.15.73:3300/0 conn(0x7f7944069e00 msgr2=0x7f79440c4580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-05T18:56:10.557 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:10.539+0000 7f794995b700 1 --2- 172.21.15.46:0/2636656942 >> v2:172.21.15.73:3300/0 conn(0x7f7944069e00 0x7f79440c4580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:10.557 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:10.539+0000 7f794995b700 1 -- 172.21.15.46:0/2636656942 >> v1:172.21.15.73:6789/0 conn(0x7f794406a270 legacy=0x7f79440c4ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:56:10.557 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:10.539+0000 7f794995b700 1 -- 172.21.15.46:0/2636656942 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f794406a7c0 con 0x7f794406bc70 2023-07-05T18:56:10.557 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:10.539+0000 7f794915a700 1 --2- 172.21.15.46:0/2636656942 >> v2:172.21.15.73:3300/0 conn(0x7f7944069e00 0x7f79440c4580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-05T18:56:10.557 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:10.540+0000 7f794995b700 1 --2- 172.21.15.46:0/2636656942 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f794406bc70 0x7f794406c040 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f7940009840 tx=0x7f7940009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c770a8ceccf5d441 server_cookie=0 in_seq=0 out_seq=0 2023-07-05T18:56:10.557 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:10.540+0000 7f7948959700 1 -- 172.21.15.46:0/2636656942 <== mon.2 v2:172.21.15.73:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7940011830 con 0x7f794406bc70 2023-07-05T18:56:10.558 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:10.540+0000 7f7948959700 1 -- 172.21.15.46:0/2636656942 <== mon.2 v2:172.21.15.73:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7940011990 con 0x7f794406bc70 2023-07-05T18:56:10.558 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:10.540+0000 7f7948959700 1 -- 172.21.15.46:0/2636656942 <== mon.2 v2:172.21.15.73:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7940011d20 con 0x7f794406bc70 2023-07-05T18:56:10.558 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:10.540+0000 7f794bbbf700 1 -- 172.21.15.46:0/2636656942 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f794406bc70 msgr2=0x7f794406c040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:56:10.558 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:10.540+0000 7f794bbbf700 1 --2- 172.21.15.46:0/2636656942 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f794406bc70 0x7f794406c040 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f7940009840 tx=0x7f7940009b50 comp rx=0 tx=0).stop 2023-07-05T18:56:10.559 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:10.540+0000 7f794bbbf700 1 -- 172.21.15.46:0/2636656942 shutdown_connections 2023-07-05T18:56:10.559 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:10.540+0000 7f794bbbf700 1 --2- 172.21.15.46:0/2636656942 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f794406bc70 0x7f794406c040 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:10.559 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:10.540+0000 7f794bbbf700 1 --2- 172.21.15.46:0/2636656942 >> v2:172.21.15.73:3300/0 conn(0x7f7944069e00 0x7f79440c4580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:10.559 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:10.540+0000 7f794bbbf700 1 -- 172.21.15.46:0/2636656942 >> 172.21.15.46:0/2636656942 conn(0x7f79440b19d0 msgr2=0x7f79440cf120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-05T18:56:10.560 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:10.541+0000 7f794bbbf700 1 -- 172.21.15.46:0/2636656942 shutdown_connections 2023-07-05T18:56:10.560 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:10.541+0000 7f794bbbf700 1 -- 172.21.15.46:0/2636656942 wait complete. 2023-07-05T18:56:10.560 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:10.542+0000 7f794bbbf700 1 Processor -- start 2023-07-05T18:56:10.560 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:10.542+0000 7f794bbbf700 1 -- start start 2023-07-05T18:56:10.560 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:10.543+0000 7f794bbbf700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7944069e00 0x7f79440b2a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:56:10.560 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:10.543+0000 7f794bbbf700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f794406a270 0x7f79440b3e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:56:10.560 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:10.543+0000 7f794bbbf700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f794406bc70 0x7f79441584d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:56:10.561 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:10.543+0000 7f794bbbf700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f794415ca50 con 0x7f7944069e00 2023-07-05T18:56:10.561 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:10.543+0000 7f794bbbf700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f794415cca0 con 0x7f794406a270 2023-07-05T18:56:10.561 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:10.543+0000 7f794bbbf700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f794415cf80 con 0x7f794406bc70 2023-07-05T18:56:10.561 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:10.543+0000 7f794915a700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f794406a270 0x7f79440b3e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:56:10.561 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:10.543+0000 7f794a15c700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f794406bc70 0x7f79441584d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:56:10.561 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:10.543+0000 7f794915a700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f794406a270 0x7f79440b3e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.46:57004/0 (socket says 172.21.15.46:57004) 2023-07-05T18:56:10.561 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:10.543+0000 7f794a15c700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f794406bc70 0x7f79441584d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3301/0 says I am v2:172.21.15.46:41208/0 (socket says 172.21.15.46:41208) 2023-07-05T18:56:10.561 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:10.543+0000 7f794915a700 1 -- 172.21.15.46:0/566049694 learned_addr learned my addr 172.21.15.46:0/566049694 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-07-05T18:56:10.562 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:10.544+0000 7f794995b700 1 --2- 172.21.15.46:0/566049694 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7944069e00 0x7f79440b2a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:56:10.562 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:10.544+0000 7f794915a700 1 -- 172.21.15.46:0/566049694 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f794406bc70 msgr2=0x7f79441584d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:56:10.562 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:10.544+0000 7f794915a700 1 --2- 172.21.15.46:0/566049694 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f794406bc70 0x7f79441584d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:10.562 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:10.544+0000 7f794915a700 1 -- 172.21.15.46:0/566049694 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7944069e00 msgr2=0x7f79440b2a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:56:10.563 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:10.544+0000 7f794915a700 1 --2- 172.21.15.46:0/566049694 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7944069e00 0x7f79440b2a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:10.563 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:10.544+0000 7f794915a700 1 -- 172.21.15.46:0/566049694 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f79340094a0 con 0x7f794406a270 2023-07-05T18:56:10.563 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:10.544+0000 7f794995b700 1 --2- 172.21.15.46:0/566049694 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7944069e00 0x7f79440b2a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-05T18:56:10.563 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:10.544+0000 7f794915a700 1 --2- 172.21.15.46:0/566049694 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f794406a270 0x7f79440b3e80 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f793400ebe0 tx=0x7f793400eef0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-05T18:56:10.563 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:10.544+0000 7f793a7fc700 1 -- 172.21.15.46:0/566049694 <== mon.1 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f793400c850 con 0x7f794406a270 2023-07-05T18:56:10.564 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:10.544+0000 7f793a7fc700 1 -- 172.21.15.46:0/566049694 <== mon.1 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f793400c9b0 con 0x7f794406a270 2023-07-05T18:56:10.564 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:10.544+0000 7f794bbbf700 1 -- 172.21.15.46:0/566049694 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f79400094a0 con 0x7f794406a270 2023-07-05T18:56:10.564 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:10.544+0000 7f793a7fc700 1 -- 172.21.15.46:0/566049694 <== mon.1 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f793400cd40 con 0x7f794406a270 2023-07-05T18:56:10.564 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:10.544+0000 7f794bbbf700 1 -- 172.21.15.46:0/566049694 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f794415d820 con 0x7f794406a270 2023-07-05T18:56:10.564 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:10.545+0000 7f794bbbf700 1 -- 172.21.15.46:0/566049694 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f794415d370 con 0x7f794406a270 2023-07-05T18:56:10.564 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:10.546+0000 7f793a7fc700 1 -- 172.21.15.46:0/566049694 <== mon.1 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 4) v1 ==== 88981+0+0 (secure 0 0 0) 0x7f7934013470 con 0x7f794406a270 2023-07-05T18:56:10.564 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:10.546+0000 7f793a7fc700 1 --2- 172.21.15.46:0/566049694 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7f792806ac50 0x7f792806d100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:56:10.565 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:10.546+0000 7f793a7fc700 1 -- 172.21.15.46:0/566049694 <== mon.1 v2:172.21.15.73:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f79340890b0 con 0x7f794406a270 2023-07-05T18:56:10.565 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:10.546+0000 7f794995b700 1 --2- 172.21.15.46:0/566049694 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7f792806ac50 0x7f792806d100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:56:10.565 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:10.546+0000 7f794995b700 1 --2- 172.21.15.46:0/566049694 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7f792806ac50 0x7f792806d100 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f7940014040 tx=0x7f7940008030 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-05T18:56:10.565 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:10.551+0000 7f793a7fc700 1 -- 172.21.15.46:0/566049694 <== mon.1 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f7934054590 con 0x7f794406a270 2023-07-05T18:56:10.756 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:10.754+0000 7f794bbbf700 1 -- 172.21.15.46:0/566049694 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f794415d140 con 0x7f794406a270 2023-07-05T18:56:10.757 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:10.755+0000 7f793a7fc700 1 -- 172.21.15.46:0/566049694 <== mon.1 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v17) v1 ==== 93+0+10 (secure 0 0 0) 0x7f793400cea0 con 0x7f794406a270 2023-07-05T18:56:10.757 INFO:teuthology.orchestra.run.smithi046.stdout:pg_num: 1 2023-07-05T18:56:10.760 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:10.757+0000 7f794bbbf700 1 -- 172.21.15.46:0/566049694 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7f792806ac50 msgr2=0x7f792806d100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:56:10.760 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:10.757+0000 7f794bbbf700 1 --2- 172.21.15.46:0/566049694 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7f792806ac50 0x7f792806d100 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f7940014040 tx=0x7f7940008030 comp rx=0 tx=0).stop 2023-07-05T18:56:10.760 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:10.757+0000 7f794bbbf700 1 -- 172.21.15.46:0/566049694 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f794406a270 msgr2=0x7f79440b3e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:56:10.760 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:10.757+0000 7f794bbbf700 1 --2- 172.21.15.46:0/566049694 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f794406a270 0x7f79440b3e80 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f793400ebe0 tx=0x7f793400eef0 comp rx=0 tx=0).stop 2023-07-05T18:56:10.760 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:10.757+0000 7f794bbbf700 1 -- 172.21.15.46:0/566049694 shutdown_connections 2023-07-05T18:56:10.760 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:10.757+0000 7f794bbbf700 1 --2- 172.21.15.46:0/566049694 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7f792806ac50 0x7f792806d100 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:10.761 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:10.757+0000 7f794bbbf700 1 --2- 172.21.15.46:0/566049694 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f794406bc70 0x7f79441584d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:10.761 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:10.757+0000 7f794bbbf700 1 --2- 172.21.15.46:0/566049694 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7944069e00 0x7f79440b2a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:10.761 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:10.757+0000 7f794bbbf700 1 --2- 172.21.15.46:0/566049694 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f794406a270 0x7f79440b3e80 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:10.761 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:10.757+0000 7f794bbbf700 1 -- 172.21.15.46:0/566049694 >> 172.21.15.46:0/566049694 conn(0x7f79440b19d0 msgr2=0x7f79440af820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-05T18:56:10.761 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:10.757+0000 7f794bbbf700 1 -- 172.21.15.46:0/566049694 shutdown_connections 2023-07-05T18:56:10.761 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:10.757+0000 7f794bbbf700 1 -- 172.21.15.46:0/566049694 wait complete. 2023-07-05T18:56:10.772 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-05T18:56:10.899 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:10.896+0000 7f2963d6a700 1 Processor -- start 2023-07-05T18:56:10.899 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:10.896+0000 7f2963d6a700 1 -- start start 2023-07-05T18:56:10.901 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:10.897+0000 7f2963d6a700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f295c06c5a0 0x7f295c071620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:56:10.902 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:10.897+0000 7f2963d6a700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f295c15d900 0x7f295c069e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:56:10.902 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:10.897+0000 7f2963d6a700 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f295c06b650 con 0x7f295c15c6d0 2023-07-05T18:56:10.902 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:10.897+0000 7f2963d6a700 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f295c15ce20 con 0x7f295c06c5a0 2023-07-05T18:56:10.903 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:10.897+0000 7f2963d6a700 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f295c15d100 con 0x7f295c15d900 2023-07-05T18:56:10.903 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:10.897+0000 7f2961305700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f295c06c5a0 0x7f295c071620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:56:10.903 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:10.897+0000 7f2961b06700 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7f295c15c6d0 0x7f295c06be90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:56800/0 (socket says 172.21.15.46:56800) 2023-07-05T18:56:10.903 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:10.897+0000 7f2961305700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f295c06c5a0 0x7f295c071620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:57530/0 (socket says 172.21.15.46:57530) 2023-07-05T18:56:10.903 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:10.897+0000 7f2961b06700 1 -- 172.21.15.46:0/1377988908 learned_addr learned my addr 172.21.15.46:0/1377988908 (peer_addr_for_me v1:172.21.15.46:0/0) 2023-07-05T18:56:10.903 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:10.898+0000 7f2962307700 1 --2- 172.21.15.46:0/1377988908 >> v2:172.21.15.73:3300/0 conn(0x7f295c15d900 0x7f295c069e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:56:10.903 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:10.898+0000 7f2961305700 1 -- 172.21.15.46:0/1377988908 >> v2:172.21.15.73:3300/0 conn(0x7f295c15d900 msgr2=0x7f295c069e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-05T18:56:10.903 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:10.898+0000 7f2961305700 1 --2- 172.21.15.46:0/1377988908 >> v2:172.21.15.73:3300/0 conn(0x7f295c15d900 0x7f295c069e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:10.904 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:10.898+0000 7f2961305700 1 -- 172.21.15.46:0/1377988908 >> v1:172.21.15.46:6789/0 conn(0x7f295c15c6d0 legacy=0x7f295c06be90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:56:10.904 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:10.898+0000 7f2960b04700 1 -- 172.21.15.46:0/1377988908 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3216250933 0 0) 0x7f295c06b650 con 0x7f295c15c6d0 2023-07-05T18:56:10.904 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:10.898+0000 7f2961305700 1 -- 172.21.15.46:0/1377988908 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f295c15d3e0 con 0x7f295c06c5a0 2023-07-05T18:56:10.904 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:10.898+0000 7f2961305700 1 --2- 172.21.15.46:0/1377988908 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f295c06c5a0 0x7f295c071620 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f295c0663d0 tx=0x7f2950009b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e6f3d73e89a4f29a server_cookie=0 in_seq=0 out_seq=0 2023-07-05T18:56:10.904 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:10.898+0000 7f2960b04700 1 -- 172.21.15.46:0/1377988908 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2950011830 con 0x7f295c06c5a0 2023-07-05T18:56:10.904 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:10.898+0000 7f2960b04700 1 -- 172.21.15.46:0/1377988908 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2950011990 con 0x7f295c06c5a0 2023-07-05T18:56:10.904 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:10.898+0000 7f2960b04700 1 -- 172.21.15.46:0/1377988908 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2950011d20 con 0x7f295c06c5a0 2023-07-05T18:56:10.905 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:10.899+0000 7f2963d6a700 1 -- 172.21.15.46:0/1377988908 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f295c06c5a0 msgr2=0x7f295c071620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:56:10.905 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:10.899+0000 7f2963d6a700 1 --2- 172.21.15.46:0/1377988908 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f295c06c5a0 0x7f295c071620 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f295c0663d0 tx=0x7f2950009b20 comp rx=0 tx=0).stop 2023-07-05T18:56:10.905 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:10.899+0000 7f2963d6a700 1 -- 172.21.15.46:0/1377988908 shutdown_connections 2023-07-05T18:56:10.905 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:10.899+0000 7f2963d6a700 1 --2- 172.21.15.46:0/1377988908 >> v2:172.21.15.73:3300/0 conn(0x7f295c15d900 0x7f295c069e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:10.905 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:10.899+0000 7f2963d6a700 1 --2- 172.21.15.46:0/1377988908 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f295c06c5a0 0x7f295c071620 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:10.905 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:10.899+0000 7f2963d6a700 1 -- 172.21.15.46:0/1377988908 >> 172.21.15.46:0/1377988908 conn(0x7f295c0b0d50 msgr2=0x7f295c0b1150 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-05T18:56:10.905 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:10.899+0000 7f2963d6a700 1 -- 172.21.15.46:0/1377988908 shutdown_connections 2023-07-05T18:56:10.905 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:10.899+0000 7f2963d6a700 1 -- 172.21.15.46:0/1377988908 wait complete. 2023-07-05T18:56:10.906 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:10.900+0000 7f2963d6a700 1 Processor -- start 2023-07-05T18:56:10.906 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:10.900+0000 7f2963d6a700 1 -- start start 2023-07-05T18:56:10.909 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:10.901+0000 7f2963d6a700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f295c06c5a0 0x7f295c143b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:56:10.909 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:10.901+0000 7f2963d6a700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f295c15c6d0 0x7f295c0ac9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:56:10.909 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:10.901+0000 7f2963d6a700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f295c15d900 0x7f295c1e9050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:56:10.909 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:10.901+0000 7f2963d6a700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f295c15eda0 con 0x7f295c15d900 2023-07-05T18:56:10.909 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:10.901+0000 7f2963d6a700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f295c15e190 con 0x7f295c06c5a0 2023-07-05T18:56:10.910 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:10.901+0000 7f2963d6a700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f295c15e470 con 0x7f295c15c6d0 2023-07-05T18:56:10.910 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:10.901+0000 7f2962307700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f295c15d900 0x7f295c1e9050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:56:10.910 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:10.901+0000 7f2962307700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f295c15d900 0x7f295c1e9050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:57538/0 (socket says 172.21.15.46:57538) 2023-07-05T18:56:10.910 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:10.901+0000 7f2962307700 1 -- 172.21.15.46:0/2169117619 learned_addr learned my addr 172.21.15.46:0/2169117619 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-07-05T18:56:10.910 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:10.901+0000 7f2961305700 1 --2- 172.21.15.46:0/2169117619 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f295c15c6d0 0x7f295c0ac9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:56:10.911 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:10.901+0000 7f2961b06700 1 --2- 172.21.15.46:0/2169117619 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f295c06c5a0 0x7f295c143b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:56:10.911 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:10.901+0000 7f2962307700 1 -- 172.21.15.46:0/2169117619 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f295c15c6d0 msgr2=0x7f295c0ac9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:56:10.911 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:10.901+0000 7f2962307700 1 --2- 172.21.15.46:0/2169117619 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f295c15c6d0 0x7f295c0ac9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:10.911 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:10.901+0000 7f2962307700 1 -- 172.21.15.46:0/2169117619 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f295c06c5a0 msgr2=0x7f295c143b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:56:10.911 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:10.901+0000 7f2962307700 1 --2- 172.21.15.46:0/2169117619 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f295c06c5a0 0x7f295c143b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:10.911 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:10.901+0000 7f2962307700 1 -- 172.21.15.46:0/2169117619 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f29500094a0 con 0x7f295c15d900 2023-07-05T18:56:10.912 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:10.901+0000 7f2962307700 1 --2- 172.21.15.46:0/2169117619 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f295c15d900 0x7f295c1e9050 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f2954009fd0 tx=0x7f295400e3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-05T18:56:10.912 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:10.901+0000 7f294e7fc700 1 -- 172.21.15.46:0/2169117619 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2954007ea0 con 0x7f295c15d900 2023-07-05T18:56:10.912 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:10.901+0000 7f294e7fc700 1 -- 172.21.15.46:0/2169117619 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f295400ed30 con 0x7f295c15d900 2023-07-05T18:56:10.912 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:10.901+0000 7f2963d6a700 1 -- 172.21.15.46:0/2169117619 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f295c15e750 con 0x7f295c15d900 2023-07-05T18:56:10.912 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:10.901+0000 7f294e7fc700 1 -- 172.21.15.46:0/2169117619 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f295400eea0 con 0x7f295c15d900 2023-07-05T18:56:10.912 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:10.901+0000 7f2963d6a700 1 -- 172.21.15.46:0/2169117619 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f295c144060 con 0x7f295c15d900 2023-07-05T18:56:10.912 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:10.902+0000 7f2963d6a700 1 -- 172.21.15.46:0/2169117619 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f295c15f400 con 0x7f295c15d900 2023-07-05T18:56:10.912 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:10.903+0000 7f294e7fc700 1 -- 172.21.15.46:0/2169117619 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f2954014660 con 0x7f295c15d900 2023-07-05T18:56:10.913 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:10.903+0000 7f294e7fc700 1 --2- 172.21.15.46:0/2169117619 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7f294006ace0 0x7f294006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:56:10.913 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:10.903+0000 7f294e7fc700 1 -- 172.21.15.46:0/2169117619 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f29540897d0 con 0x7f295c15d900 2023-07-05T18:56:10.913 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:10.903+0000 7f2961b06700 1 --2- 172.21.15.46:0/2169117619 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7f294006ace0 0x7f294006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:56:10.913 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:10.904+0000 7f2961b06700 1 --2- 172.21.15.46:0/2169117619 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7f294006ace0 0x7f294006d190 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f2958007fd0 tx=0x7f2958007de0 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-05T18:56:10.913 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:10.908+0000 7f294e7fc700 1 -- 172.21.15.46:0/2169117619 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f295c15f400 con 0x7f295c15d900 2023-07-05T18:56:11.150 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:11.148+0000 7f2963d6a700 1 -- 172.21.15.46:0/2169117619 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f295c15f400 con 0x7f295c15d900 2023-07-05T18:56:11.151 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:11.148+0000 7f294e7fc700 1 -- 172.21.15.46:0/2169117619 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 3 v3) v1 ==== 93+0+3515 (secure 0 0 0) 0x7f295c15f400 con 0x7f295c15d900 2023-07-05T18:56:11.151 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T18:56:11.151 INFO:teuthology.orchestra.run.smithi046.stdout:{"epoch":3,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4247,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.73:6837/75231790","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6835","nonce":75231790},{"type":"v1","addr":"172.21.15.73:6837","nonce":75231790}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4284,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.46:6834/378741372","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6832","nonce":378741372},{"type":"v1","addr":"172.21.15.46:6834","nonce":378741372}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4287,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.46:6835/1674703862","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6833","nonce":1674703862},{"type":"v1","addr":"172.21.15.46:6835","nonce":1674703862}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4296,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.73:6836/2654190748","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6834","nonce":2654190748},{"type":"v1","addr":"172.21.15.73:6836","nonce":2654190748}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[]} 2023-07-05T18:56:11.152 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:11.150+0000 7f2963d6a700 1 -- 172.21.15.46:0/2169117619 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7f294006ace0 msgr2=0x7f294006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:56:11.153 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:11.150+0000 7f2963d6a700 1 --2- 172.21.15.46:0/2169117619 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7f294006ace0 0x7f294006d190 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f2958007fd0 tx=0x7f2958007de0 comp rx=0 tx=0).stop 2023-07-05T18:56:11.153 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:11.150+0000 7f2963d6a700 1 -- 172.21.15.46:0/2169117619 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f295c15d900 msgr2=0x7f295c1e9050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:56:11.153 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:11.150+0000 7f2963d6a700 1 --2- 172.21.15.46:0/2169117619 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f295c15d900 0x7f295c1e9050 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f2954009fd0 tx=0x7f295400e3c0 comp rx=0 tx=0).stop 2023-07-05T18:56:11.153 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:11.151+0000 7f2963d6a700 1 -- 172.21.15.46:0/2169117619 shutdown_connections 2023-07-05T18:56:11.153 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:11.151+0000 7f2963d6a700 1 --2- 172.21.15.46:0/2169117619 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7f294006ace0 0x7f294006d190 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:11.153 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:11.151+0000 7f2963d6a700 1 --2- 172.21.15.46:0/2169117619 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f295c15d900 0x7f295c1e9050 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:11.154 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:11.151+0000 7f2963d6a700 1 --2- 172.21.15.46:0/2169117619 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f295c06c5a0 0x7f295c143b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:11.154 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:11.151+0000 7f2963d6a700 1 --2- 172.21.15.46:0/2169117619 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f295c15c6d0 0x7f295c0ac9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:11.154 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:11.151+0000 7f2963d6a700 1 -- 172.21.15.46:0/2169117619 >> 172.21.15.46:0/2169117619 conn(0x7f295c0b0d50 msgr2=0x7f295c155ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-05T18:56:11.155 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:11.151+0000 7f2963d6a700 1 -- 172.21.15.46:0/2169117619 shutdown_connections 2023-07-05T18:56:11.155 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:11.151+0000 7f2963d6a700 1 -- 172.21.15.46:0/2169117619 wait complete. 2023-07-05T18:56:11.155 INFO:teuthology.orchestra.run.smithi046.stderr:dumped fsmap epoch 3 2023-07-05T18:56:11.165 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-05T18:56:11.290 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:11.288+0000 7fd7ac0b7700 1 Processor -- start 2023-07-05T18:56:11.290 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:11.288+0000 7fd7ac0b7700 1 -- start start 2023-07-05T18:56:11.292 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:11.289+0000 7fd7ac0b7700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fd7a40ccde0 0x7fd7a40cbc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:56:11.292 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:11.289+0000 7fd7ac0b7700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fd7a406b7d0 0x7fd7a406bc50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:56:11.292 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:11.289+0000 7fd7ac0b7700 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd7a40cd250 con 0x7fd7a40ce910 2023-07-05T18:56:11.293 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:11.289+0000 7fd7ac0b7700 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd7a40cc1a0 con 0x7fd7a40ccde0 2023-07-05T18:56:11.293 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:11.289+0000 7fd7ac0b7700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd7a40cc400 con 0x7fd7a406b7d0 2023-07-05T18:56:11.293 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:11.289+0000 7fd7a9652700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fd7a40ccde0 0x7fd7a40cbc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:56:11.293 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:11.289+0000 7fd7a9652700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fd7a40ccde0 0x7fd7a40cbc60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:57544/0 (socket says 172.21.15.46:57544) 2023-07-05T18:56:11.293 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:11.289+0000 7fd7a9652700 1 -- 172.21.15.46:0/1697848864 learned_addr learned my addr 172.21.15.46:0/1697848864 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-07-05T18:56:11.293 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:11.289+0000 7fd7aa654700 1 --2- 172.21.15.46:0/1697848864 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fd7a406b7d0 0x7fd7a406bc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:56:11.293 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:11.289+0000 7fd7a9652700 1 -- 172.21.15.46:0/1697848864 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fd7a406b7d0 msgr2=0x7fd7a406bc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-05T18:56:11.294 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:11.289+0000 7fd7a9652700 1 --2- 172.21.15.46:0/1697848864 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fd7a406b7d0 0x7fd7a406bc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:11.294 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:11.289+0000 7fd7a9652700 1 -- 172.21.15.46:0/1697848864 >> v1:172.21.15.73:6789/0 conn(0x7fd7a40ce910 legacy=0x7fd7a40cece0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:56:11.294 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:11.289+0000 7fd7a9652700 1 -- 172.21.15.46:0/1697848864 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd7a40cc6e0 con 0x7fd7a40ccde0 2023-07-05T18:56:11.294 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:11.290+0000 7fd7a9652700 1 --2- 172.21.15.46:0/1697848864 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd7a40ccde0 0x7fd7a40cbc60 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fd7a00098f0 tx=0x7fd7a0009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3af0a3d22d64d21b server_cookie=0 in_seq=0 out_seq=0 2023-07-05T18:56:11.294 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:11.290+0000 7fd7a8e51700 1 -- 172.21.15.46:0/1697848864 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7a0011830 con 0x7fd7a40ccde0 2023-07-05T18:56:11.294 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:11.290+0000 7fd7a8e51700 1 -- 172.21.15.46:0/1697848864 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd7a0011990 con 0x7fd7a40ccde0 2023-07-05T18:56:11.294 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:11.290+0000 7fd7a8e51700 1 -- 172.21.15.46:0/1697848864 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7a0011d20 con 0x7fd7a40ccde0 2023-07-05T18:56:11.294 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:11.290+0000 7fd7ac0b7700 1 -- 172.21.15.46:0/1697848864 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd7a40ccde0 msgr2=0x7fd7a40cbc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:56:11.297 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:11.290+0000 7fd7ac0b7700 1 --2- 172.21.15.46:0/1697848864 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd7a40ccde0 0x7fd7a40cbc60 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fd7a00098f0 tx=0x7fd7a0009c00 comp rx=0 tx=0).stop 2023-07-05T18:56:11.297 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:11.290+0000 7fd7ac0b7700 1 -- 172.21.15.46:0/1697848864 shutdown_connections 2023-07-05T18:56:11.298 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:11.290+0000 7fd7ac0b7700 1 --2- 172.21.15.46:0/1697848864 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fd7a406b7d0 0x7fd7a406bc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:11.298 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:11.290+0000 7fd7ac0b7700 1 --2- 172.21.15.46:0/1697848864 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd7a40ccde0 0x7fd7a40cbc60 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:11.298 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:11.290+0000 7fd7ac0b7700 1 -- 172.21.15.46:0/1697848864 >> 172.21.15.46:0/1697848864 conn(0x7fd7a4099e00 msgr2=0x7fd7a40d0b30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-05T18:56:11.298 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:11.290+0000 7fd7ac0b7700 1 -- 172.21.15.46:0/1697848864 shutdown_connections 2023-07-05T18:56:11.298 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:11.290+0000 7fd7ac0b7700 1 -- 172.21.15.46:0/1697848864 wait complete. 2023-07-05T18:56:11.301 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:11.292+0000 7fd7ac0b7700 1 Processor -- start 2023-07-05T18:56:11.301 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:11.292+0000 7fd7ac0b7700 1 -- start start 2023-07-05T18:56:11.301 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:11.292+0000 7fd7ac0b7700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd7a406b7d0 0x7fd7a40b02c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:56:11.301 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:11.292+0000 7fd7ac0b7700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd7a40ccde0 0x7fd7a40b5b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:56:11.301 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:11.292+0000 7fd7ac0b7700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fd7a40ce910 0x7fd7a409acd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:56:11.301 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:11.292+0000 7fd7ac0b7700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7a415a9a0 con 0x7fd7a406b7d0 2023-07-05T18:56:11.302 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:11.292+0000 7fd7ac0b7700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7a40af220 con 0x7fd7a40ccde0 2023-07-05T18:56:11.302 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:11.292+0000 7fd7ac0b7700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd7a40af500 con 0x7fd7a40ce910 2023-07-05T18:56:11.302 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:11.293+0000 7fd7a9e53700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd7a406b7d0 0x7fd7a40b02c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:56:11.302 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:11.293+0000 7fd7a9652700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd7a40ccde0 0x7fd7a40b5b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:56:11.302 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:11.293+0000 7fd7a9e53700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd7a406b7d0 0x7fd7a40b02c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:57550/0 (socket says 172.21.15.46:57550) 2023-07-05T18:56:11.302 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:11.293+0000 7fd7a9e53700 1 -- 172.21.15.46:0/1308961312 learned_addr learned my addr 172.21.15.46:0/1308961312 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-07-05T18:56:11.302 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:11.293+0000 7fd7aa654700 1 --2- 172.21.15.46:0/1308961312 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fd7a40ce910 0x7fd7a409acd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:56:11.303 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:11.293+0000 7fd7a9e53700 1 -- 172.21.15.46:0/1308961312 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fd7a40ce910 msgr2=0x7fd7a409acd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:56:11.303 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:11.293+0000 7fd7a9e53700 1 --2- 172.21.15.46:0/1308961312 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fd7a40ce910 0x7fd7a409acd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:11.303 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:11.293+0000 7fd7a9e53700 1 -- 172.21.15.46:0/1308961312 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd7a40ccde0 msgr2=0x7fd7a40b5b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:56:11.303 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:11.293+0000 7fd7a9e53700 1 --2- 172.21.15.46:0/1308961312 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd7a40ccde0 0x7fd7a40b5b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:11.303 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:11.293+0000 7fd7a9e53700 1 -- 172.21.15.46:0/1308961312 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd7a0009550 con 0x7fd7a406b7d0 2023-07-05T18:56:11.303 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:11.293+0000 7fd7a9652700 1 --2- 172.21.15.46:0/1308961312 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd7a40ccde0 0x7fd7a40b5b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-05T18:56:11.303 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:11.293+0000 7fd7a9e53700 1 --2- 172.21.15.46:0/1308961312 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd7a406b7d0 0x7fd7a40b02c0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fd79400c450 tx=0x7fd79400c760 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-05T18:56:11.304 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:11.293+0000 7fd79a7fc700 1 -- 172.21.15.46:0/1308961312 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7940052d0 con 0x7fd7a406b7d0 2023-07-05T18:56:11.304 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:11.293+0000 7fd79a7fc700 1 -- 172.21.15.46:0/1308961312 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd794005430 con 0x7fd7a406b7d0 2023-07-05T18:56:11.306 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:11.293+0000 7fd7ac0b7700 1 -- 172.21.15.46:0/1308961312 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd7a40af7e0 con 0x7fd7a406b7d0 2023-07-05T18:56:11.306 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:11.293+0000 7fd79a7fc700 1 -- 172.21.15.46:0/1308961312 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7940038c0 con 0x7fd7a406b7d0 2023-07-05T18:56:11.306 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:11.293+0000 7fd7ac0b7700 1 -- 172.21.15.46:0/1308961312 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd7a40afda0 con 0x7fd7a406b7d0 2023-07-05T18:56:11.307 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:11.294+0000 7fd7ac0b7700 1 -- 172.21.15.46:0/1308961312 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd7a40672e0 con 0x7fd7a406b7d0 2023-07-05T18:56:11.307 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:11.295+0000 7fd79a7fc700 1 -- 172.21.15.46:0/1308961312 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fd794003a20 con 0x7fd7a406b7d0 2023-07-05T18:56:11.307 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:11.295+0000 7fd79a7fc700 1 --2- 172.21.15.46:0/1308961312 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7fd78806ad10 0x7fd78806d1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:56:11.308 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:11.295+0000 7fd79a7fc700 1 -- 172.21.15.46:0/1308961312 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 5210+0+0 (secure 0 0 0) 0x7fd794088240 con 0x7fd7a406b7d0 2023-07-05T18:56:11.308 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:11.295+0000 7fd7a9652700 1 --2- 172.21.15.46:0/1308961312 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7fd78806ad10 0x7fd78806d1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:56:11.308 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:11.296+0000 7fd7a9652700 1 --2- 172.21.15.46:0/1308961312 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7fd78806ad10 0x7fd78806d1c0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fd7a0009c40 tx=0x7fd7a0008030 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-05T18:56:11.309 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:11.300+0000 7fd79a7fc700 1 -- 172.21.15.46:0/1308961312 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fd7940536d0 con 0x7fd7a406b7d0 2023-07-05T18:56:11.504 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:11.495+0000 7fd7ac0b7700 1 -- 172.21.15.46:0/1308961312 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fd7a40cd250 con 0x7fd7a406b7d0 2023-07-05T18:56:11.504 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:11.496+0000 7fd79a7fc700 1 -- 172.21.15.46:0/1308961312 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v17) v1 ==== 74+0+14519 (secure 0 0 0) 0x7fd7a40cd250 con 0x7fd7a406b7d0 2023-07-05T18:56:11.504 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T18:56:11.504 INFO:teuthology.orchestra.run.smithi046.stdout:{"epoch":17,"fsid":"042652d3-d80c-4ad8-9366-3e94f2a0a512","created":"2023-07-05T18:55:56.455710+0000","modified":"2023-07-05T18:56:10.612890+0000","last_up_change":"2023-07-05T18:56:06.594022+0000","last_in_change":"2023-07-05T18:55:58.879340+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-07-05T18:56:07.729620+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2023-07-05T18:56:08.128122+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"20009183-9a47-4392-8751-883f88d2bfb1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6813","nonce":4151971443},{"type":"v1","addr":"172.21.15.46:6815","nonce":4151971443}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6817","nonce":4151971443},{"type":"v1","addr":"172.21.15.46:6818","nonce":4151971443}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6822","nonce":4151971443},{"type":"v1","addr":"172.21.15.46:6823","nonce":4151971443}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6820","nonce":4151971443},{"type":"v1","addr":"172.21.15.46:6821","nonce":4151971443}]},"public_addr":"172.21.15.46:6815/4151971443","cluster_addr":"172.21.15.46:6818/4151971443","heartbeat_back_addr":"172.21.15.46:6823/4151971443","heartbeat_front_addr":"172.21.15.46:6821/4151971443","state":["exists","up"]},{"osd":1,"uuid":"91b4a7b0-e4e4-4888-a1fe-9edb0d68004c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6808","nonce":502575881},{"type":"v1","addr":"172.21.15.46:6809","nonce":502575881}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6810","nonce":502575881},{"type":"v1","addr":"172.21.15.46:6811","nonce":502575881}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6816","nonce":502575881},{"type":"v1","addr":"172.21.15.46:6819","nonce":502575881}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6812","nonce":502575881},{"type":"v1","addr":"172.21.15.46:6814","nonce":502575881}]},"public_addr":"172.21.15.46:6809/502575881","cluster_addr":"172.21.15.46:6811/502575881","heartbeat_back_addr":"172.21.15.46:6819/502575881","heartbeat_front_addr":"172.21.15.46:6814/502575881","state":["exists","up"]},{"osd":2,"uuid":"669ff744-1331-47c5-8579-0440731c889a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6800","nonce":2115251461},{"type":"v1","addr":"172.21.15.46:6801","nonce":2115251461}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6802","nonce":2115251461},{"type":"v1","addr":"172.21.15.46:6803","nonce":2115251461}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6806","nonce":2115251461},{"type":"v1","addr":"172.21.15.46:6807","nonce":2115251461}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6804","nonce":2115251461},{"type":"v1","addr":"172.21.15.46:6805","nonce":2115251461}]},"public_addr":"172.21.15.46:6801/2115251461","cluster_addr":"172.21.15.46:6803/2115251461","heartbeat_back_addr":"172.21.15.46:6807/2115251461","heartbeat_front_addr":"172.21.15.46:6805/2115251461","state":["exists","up"]},{"osd":3,"uuid":"34e1b86d-ffad-415d-861c-07a5f08068a6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6824","nonce":2981388766},{"type":"v1","addr":"172.21.15.46:6825","nonce":2981388766}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6826","nonce":2981388766},{"type":"v1","addr":"172.21.15.46:6827","nonce":2981388766}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6830","nonce":2981388766},{"type":"v1","addr":"172.21.15.46:6831","nonce":2981388766}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6828","nonce":2981388766},{"type":"v1","addr":"172.21.15.46:6829","nonce":2981388766}]},"public_addr":"172.21.15.46:6825/2981388766","cluster_addr":"172.21.15.46:6827/2981388766","heartbeat_back_addr":"172.21.15.46:6831/2981388766","heartbeat_front_addr":"172.21.15.46:6829/2981388766","state":["exists","up"]},{"osd":4,"uuid":"57ffcb91-c7dc-4a69-ae71-4d9622a14a05","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6800","nonce":2083655348},{"type":"v1","addr":"172.21.15.73:6801","nonce":2083655348}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6802","nonce":2083655348},{"type":"v1","addr":"172.21.15.73:6803","nonce":2083655348}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6806","nonce":2083655348},{"type":"v1","addr":"172.21.15.73:6807","nonce":2083655348}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6804","nonce":2083655348},{"type":"v1","addr":"172.21.15.73:6805","nonce":2083655348}]},"public_addr":"172.21.15.73:6801/2083655348","cluster_addr":"172.21.15.73:6803/2083655348","heartbeat_back_addr":"172.21.15.73:6807/2083655348","heartbeat_front_addr":"172.21.15.73:6805/2083655348","state":["exists","up"]},{"osd":5,"uuid":"665f41c9-ee20-49cf-bf0e-fbe0c03d3aed","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6824","nonce":2803788401},{"type":"v1","addr":"172.21.15.73:6825","nonce":2803788401}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6826","nonce":2803788401},{"type":"v1","addr":"172.21.15.73:6827","nonce":2803788401}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6830","nonce":2803788401},{"type":"v1","addr":"172.21.15.73:6831","nonce":2803788401}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6828","nonce":2803788401},{"type":"v1","addr":"172.21.15.73:6829","nonce":2803788401}]},"public_addr":"172.21.15.73:6825/2803788401","cluster_addr":"172.21.15.73:6827/2803788401","heartbeat_back_addr":"172.21.15.73:6831/2803788401","heartbeat_front_addr":"172.21.15.73:6829/2803788401","state":["exists","up"]},{"osd":6,"uuid":"5790c6cc-bd56-4ce4-9a7c-0f0c3b59215c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6808","nonce":974108383},{"type":"v1","addr":"172.21.15.73:6809","nonce":974108383}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6810","nonce":974108383},{"type":"v1","addr":"172.21.15.73:6811","nonce":974108383}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6815","nonce":974108383},{"type":"v1","addr":"172.21.15.73:6817","nonce":974108383}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6812","nonce":974108383},{"type":"v1","addr":"172.21.15.73:6813","nonce":974108383}]},"public_addr":"172.21.15.73:6809/974108383","cluster_addr":"172.21.15.73:6811/974108383","heartbeat_back_addr":"172.21.15.73:6817/974108383","heartbeat_front_addr":"172.21.15.73:6813/974108383","state":["exists","up"]},{"osd":7,"uuid":"b66f4d2e-147e-4c9b-97dd-cbd59d33802e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6814","nonce":3772673248},{"type":"v1","addr":"172.21.15.73:6816","nonce":3772673248}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6818","nonce":3772673248},{"type":"v1","addr":"172.21.15.73:6819","nonce":3772673248}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6822","nonce":3772673248},{"type":"v1","addr":"172.21.15.73:6823","nonce":3772673248}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6820","nonce":3772673248},{"type":"v1","addr":"172.21.15.73:6821","nonce":3772673248}]},"public_addr":"172.21.15.73:6816/3772673248","cluster_addr":"172.21.15.73:6819/3772673248","heartbeat_back_addr":"172.21.15.73:6823/3772673248","heartbeat_front_addr":"172.21.15.73:6821/3772673248","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-05T18:56:04.115334+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-05T18:56:04.071250+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-05T18:56:04.044387+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-05T18:56:04.085389+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-05T18:56:04.090726+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-05T18:56:04.074529+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-05T18:56:04.058841+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-05T18:56:04.043054+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-05T18:56:11.505 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:11.498+0000 7fd7ac0b7700 1 -- 172.21.15.46:0/1308961312 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7fd78806ad10 msgr2=0x7fd78806d1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:56:11.506 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:11.498+0000 7fd7ac0b7700 1 --2- 172.21.15.46:0/1308961312 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7fd78806ad10 0x7fd78806d1c0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fd7a0009c40 tx=0x7fd7a0008030 comp rx=0 tx=0).stop 2023-07-05T18:56:11.506 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:11.498+0000 7fd7ac0b7700 1 -- 172.21.15.46:0/1308961312 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd7a406b7d0 msgr2=0x7fd7a40b02c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:56:11.506 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:11.498+0000 7fd7ac0b7700 1 --2- 172.21.15.46:0/1308961312 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd7a406b7d0 0x7fd7a40b02c0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fd79400c450 tx=0x7fd79400c760 comp rx=0 tx=0).stop 2023-07-05T18:56:11.506 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:11.498+0000 7fd7ac0b7700 1 -- 172.21.15.46:0/1308961312 shutdown_connections 2023-07-05T18:56:11.506 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:11.498+0000 7fd7ac0b7700 1 --2- 172.21.15.46:0/1308961312 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7fd78806ad10 0x7fd78806d1c0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:11.506 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:11.498+0000 7fd7ac0b7700 1 --2- 172.21.15.46:0/1308961312 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fd7a40ce910 0x7fd7a409acd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:11.506 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:11.498+0000 7fd7ac0b7700 1 --2- 172.21.15.46:0/1308961312 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd7a406b7d0 0x7fd7a40b02c0 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:11.507 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:11.498+0000 7fd7ac0b7700 1 --2- 172.21.15.46:0/1308961312 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd7a40ccde0 0x7fd7a40b5b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:11.507 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:11.498+0000 7fd7ac0b7700 1 -- 172.21.15.46:0/1308961312 >> 172.21.15.46:0/1308961312 conn(0x7fd7a4099e00 msgr2=0x7fd7a406d9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-05T18:56:11.507 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:11.498+0000 7fd7ac0b7700 1 -- 172.21.15.46:0/1308961312 shutdown_connections 2023-07-05T18:56:11.507 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:11.499+0000 7fd7ac0b7700 1 -- 172.21.15.46:0/1308961312 wait complete. 2023-07-05T18:56:11.513 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'rbd', 'create_time': '2023-07-05T18:56:07.729620+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': '.mgr', 'create_time': '2023-07-05T18:56:08.128122+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-07-05T18:56:11.514 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-07-05T18:56:11.645 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:11.641+0000 7fe7b549a700 1 Processor -- start 2023-07-05T18:56:11.645 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:11.641+0000 7fe7b549a700 1 -- start start 2023-07-05T18:56:11.645 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:11.641+0000 7fe7b549a700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fe7b015c2f0 0x7fe7b00cd2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:56:11.645 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:11.641+0000 7fe7b549a700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fe7b015c6c0 0x7fe7b006c760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:56:11.645 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:11.641+0000 7fe7b549a700 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe7b00cd8c0 con 0x7fe7b00b5ae0 2023-07-05T18:56:11.646 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:11.642+0000 7fe7b549a700 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe7b00d0990 con 0x7fe7b015c6c0 2023-07-05T18:56:11.646 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:11.642+0000 7fe7b549a700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe7b00d0c70 con 0x7fe7b015c2f0 2023-07-05T18:56:11.646 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:11.642+0000 7fe7ae7fc700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fe7b015c6c0 0x7fe7b006c760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:56:11.646 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:11.642+0000 7fe7af7fe700 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7fe7b00b5ae0 0x7fe7b00d1450 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:56828/0 (socket says 172.21.15.46:56828) 2023-07-05T18:56:11.646 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:11.642+0000 7fe7af7fe700 1 -- 172.21.15.46:0/3797268039 learned_addr learned my addr 172.21.15.46:0/3797268039 (peer_addr_for_me v1:172.21.15.46:0/0) 2023-07-05T18:56:11.647 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:11.642+0000 7fe7aeffd700 1 --2- 172.21.15.46:0/3797268039 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fe7b015c2f0 0x7fe7b00cd2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:56:11.647 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:11.642+0000 7fe7ae7fc700 1 -- 172.21.15.46:0/3797268039 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fe7b015c2f0 msgr2=0x7fe7b00cd2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-05T18:56:11.647 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:11.642+0000 7fe7ae7fc700 1 --2- 172.21.15.46:0/3797268039 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fe7b015c2f0 0x7fe7b00cd2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:11.647 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:11.642+0000 7fe7ae7fc700 1 -- 172.21.15.46:0/3797268039 >> v1:172.21.15.46:6789/0 conn(0x7fe7b00b5ae0 legacy=0x7fe7b00d1450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:56:11.647 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:11.642+0000 7fe7ae7fc700 1 -- 172.21.15.46:0/3797268039 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe7b00d0f50 con 0x7fe7b015c6c0 2023-07-05T18:56:11.647 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:11.642+0000 7fe7adffb700 1 -- 172.21.15.46:0/3797268039 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2682151634 0 0) 0x7fe7b00cd8c0 con 0x7fe7b00b5ae0 2023-07-05T18:56:11.647 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:11.642+0000 7fe7aeffd700 1 --2- 172.21.15.46:0/3797268039 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fe7b015c2f0 0x7fe7b00cd2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-05T18:56:11.648 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:11.642+0000 7fe7ae7fc700 1 --2- 172.21.15.46:0/3797268039 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe7b015c6c0 0x7fe7b006c760 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fe7a0009840 tx=0x7fe7a0009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=64258daf2a5d308e server_cookie=0 in_seq=0 out_seq=0 2023-07-05T18:56:11.648 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:11.642+0000 7fe7adffb700 1 -- 172.21.15.46:0/3797268039 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7a0011830 con 0x7fe7b015c6c0 2023-07-05T18:56:11.648 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:11.642+0000 7fe7adffb700 1 -- 172.21.15.46:0/3797268039 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe7a0011990 con 0x7fe7b015c6c0 2023-07-05T18:56:11.648 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:11.642+0000 7fe7adffb700 1 -- 172.21.15.46:0/3797268039 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7a0011d20 con 0x7fe7b015c6c0 2023-07-05T18:56:11.648 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:11.643+0000 7fe7b549a700 1 -- 172.21.15.46:0/3797268039 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe7b015c6c0 msgr2=0x7fe7b006c760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:56:11.649 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:11.643+0000 7fe7b549a700 1 --2- 172.21.15.46:0/3797268039 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe7b015c6c0 0x7fe7b006c760 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fe7a0009840 tx=0x7fe7a0009b50 comp rx=0 tx=0).stop 2023-07-05T18:56:11.649 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:11.643+0000 7fe7b549a700 1 -- 172.21.15.46:0/3797268039 shutdown_connections 2023-07-05T18:56:11.649 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:11.643+0000 7fe7b549a700 1 --2- 172.21.15.46:0/3797268039 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fe7b015c2f0 0x7fe7b00cd2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:11.649 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:11.643+0000 7fe7b549a700 1 --2- 172.21.15.46:0/3797268039 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe7b015c6c0 0x7fe7b006c760 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:11.649 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:11.643+0000 7fe7b549a700 1 -- 172.21.15.46:0/3797268039 >> 172.21.15.46:0/3797268039 conn(0x7fe7b006afa0 msgr2=0x7fe7b00cf710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-05T18:56:11.649 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:11.643+0000 7fe7b549a700 1 -- 172.21.15.46:0/3797268039 shutdown_connections 2023-07-05T18:56:11.649 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:11.643+0000 7fe7b549a700 1 -- 172.21.15.46:0/3797268039 wait complete. 2023-07-05T18:56:11.651 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:11.644+0000 7fe7b549a700 1 Processor -- start 2023-07-05T18:56:11.652 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:11.644+0000 7fe7b549a700 1 -- start start 2023-07-05T18:56:11.652 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:11.645+0000 7fe7b549a700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe7b00b5ae0 0x7fe7b00c9f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:56:11.652 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:11.645+0000 7fe7b549a700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fe7b015c2f0 0x7fe7b0153850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:56:11.652 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:11.645+0000 7fe7b549a700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe7b015c6c0 0x7fe7b01f51b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:56:11.652 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:11.645+0000 7fe7b549a700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7b0153d90 con 0x7fe7b00b5ae0 2023-07-05T18:56:11.652 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:11.645+0000 7fe7b549a700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7b01f56f0 con 0x7fe7b015c6c0 2023-07-05T18:56:11.652 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:11.645+0000 7fe7b549a700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe7b01f5970 con 0x7fe7b015c2f0 2023-07-05T18:56:11.653 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:11.645+0000 7fe7aeffd700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe7b00b5ae0 0x7fe7b00c9f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:56:11.653 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:11.645+0000 7fe7aeffd700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe7b00b5ae0 0x7fe7b00c9f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:57560/0 (socket says 172.21.15.46:57560) 2023-07-05T18:56:11.653 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:11.645+0000 7fe7aeffd700 1 -- 172.21.15.46:0/3250095774 learned_addr learned my addr 172.21.15.46:0/3250095774 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-07-05T18:56:11.653 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:11.645+0000 7fe7aeffd700 1 -- 172.21.15.46:0/3250095774 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fe7b015c2f0 msgr2=0x7fe7b0153850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:56:11.654 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:11.645+0000 7fe7aeffd700 1 --2- 172.21.15.46:0/3250095774 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fe7b015c2f0 0x7fe7b0153850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:11.654 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:11.645+0000 7fe7af7fe700 1 --2- 172.21.15.46:0/3250095774 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe7b015c6c0 0x7fe7b01f51b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:56:11.654 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:11.645+0000 7fe7aeffd700 1 -- 172.21.15.46:0/3250095774 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe7b015c6c0 msgr2=0x7fe7b01f51b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:56:11.654 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:11.645+0000 7fe7aeffd700 1 --2- 172.21.15.46:0/3250095774 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe7b015c6c0 0x7fe7b01f51b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:11.654 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:11.645+0000 7fe7aeffd700 1 -- 172.21.15.46:0/3250095774 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe7a00094a0 con 0x7fe7b00b5ae0 2023-07-05T18:56:11.654 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:11.645+0000 7fe7af7fe700 1 --2- 172.21.15.46:0/3250095774 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe7b015c6c0 0x7fe7b01f51b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-05T18:56:11.654 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:11.646+0000 7fe7aeffd700 1 --2- 172.21.15.46:0/3250095774 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe7b00b5ae0 0x7fe7b00c9f90 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fe7a400c750 tx=0x7fe7a400cb10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-05T18:56:11.655 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:11.646+0000 7fe7977fe700 1 -- 172.21.15.46:0/3250095774 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7a4011800 con 0x7fe7b00b5ae0 2023-07-05T18:56:11.655 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:11.646+0000 7fe7977fe700 1 -- 172.21.15.46:0/3250095774 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe7a4011960 con 0x7fe7b00b5ae0 2023-07-05T18:56:11.655 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:11.646+0000 7fe7b549a700 1 -- 172.21.15.46:0/3250095774 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe7b01f5c50 con 0x7fe7b00b5ae0 2023-07-05T18:56:11.655 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:11.646+0000 7fe7977fe700 1 -- 172.21.15.46:0/3250095774 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7a4011cd0 con 0x7fe7b00b5ae0 2023-07-05T18:56:11.655 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:11.646+0000 7fe7b549a700 1 -- 172.21.15.46:0/3250095774 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe7b00cc760 con 0x7fe7b00b5ae0 2023-07-05T18:56:11.655 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:11.647+0000 7fe7b549a700 1 -- 172.21.15.46:0/3250095774 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe7b00cc950 con 0x7fe7b00b5ae0 2023-07-05T18:56:11.655 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:11.647+0000 7fe7977fe700 1 -- 172.21.15.46:0/3250095774 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fe7a4021350 con 0x7fe7b00b5ae0 2023-07-05T18:56:11.656 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:11.647+0000 7fe7977fe700 1 --2- 172.21.15.46:0/3250095774 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7fe79c06ace0 0x7fe79c06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:56:11.656 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:11.648+0000 7fe7977fe700 1 -- 172.21.15.46:0/3250095774 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 5210+0+0 (secure 0 0 0) 0x7fe7a40890a0 con 0x7fe7b00b5ae0 2023-07-05T18:56:11.656 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:11.648+0000 7fe7ae7fc700 1 --2- 172.21.15.46:0/3250095774 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7fe79c06ace0 0x7fe79c06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:56:11.656 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:11.648+0000 7fe7ae7fc700 1 --2- 172.21.15.46:0/3250095774 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7fe79c06ace0 0x7fe79c06d190 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fe7b015cb00 tx=0x7fe7a0010000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-05T18:56:11.657 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:11.652+0000 7fe7977fe700 1 -- 172.21.15.46:0/3250095774 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fe7a4054530 con 0x7fe7b00b5ae0 2023-07-05T18:56:11.859 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:11.857+0000 7fe7b549a700 1 -- 172.21.15.46:0/3250095774 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fe7b004e1d0 con 0x7fe7b00b5ae0 2023-07-05T18:56:11.860 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:11.858+0000 7fe7977fe700 1 -- 172.21.15.46:0/3250095774 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v17) v1 ==== 92+0+10 (secure 0 0 0) 0x7fe7a4057b50 con 0x7fe7b00b5ae0 2023-07-05T18:56:11.860 INFO:teuthology.orchestra.run.smithi046.stdout:pg_num: 8 2023-07-05T18:56:11.862 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:11.860+0000 7fe7b549a700 1 -- 172.21.15.46:0/3250095774 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7fe79c06ace0 msgr2=0x7fe79c06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:56:11.862 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:11.860+0000 7fe7b549a700 1 --2- 172.21.15.46:0/3250095774 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7fe79c06ace0 0x7fe79c06d190 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fe7b015cb00 tx=0x7fe7a0010000 comp rx=0 tx=0).stop 2023-07-05T18:56:11.862 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:11.860+0000 7fe7b549a700 1 -- 172.21.15.46:0/3250095774 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe7b00b5ae0 msgr2=0x7fe7b00c9f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:56:11.862 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:11.860+0000 7fe7b549a700 1 --2- 172.21.15.46:0/3250095774 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe7b00b5ae0 0x7fe7b00c9f90 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fe7a400c750 tx=0x7fe7a400cb10 comp rx=0 tx=0).stop 2023-07-05T18:56:11.862 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:11.860+0000 7fe7b549a700 1 -- 172.21.15.46:0/3250095774 shutdown_connections 2023-07-05T18:56:11.863 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:11.860+0000 7fe7b549a700 1 --2- 172.21.15.46:0/3250095774 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7fe79c06ace0 0x7fe79c06d190 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:11.863 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:11.860+0000 7fe7b549a700 1 --2- 172.21.15.46:0/3250095774 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe7b015c6c0 0x7fe7b01f51b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:11.863 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:11.860+0000 7fe7b549a700 1 --2- 172.21.15.46:0/3250095774 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe7b00b5ae0 0x7fe7b00c9f90 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:11.863 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:11.860+0000 7fe7b549a700 1 --2- 172.21.15.46:0/3250095774 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fe7b015c2f0 0x7fe7b0153850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:11.863 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:11.860+0000 7fe7b549a700 1 -- 172.21.15.46:0/3250095774 >> 172.21.15.46:0/3250095774 conn(0x7fe7b006afa0 msgr2=0x7fe7b00b4f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-05T18:56:11.863 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:11.860+0000 7fe7b549a700 1 -- 172.21.15.46:0/3250095774 shutdown_connections 2023-07-05T18:56:11.863 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:11.860+0000 7fe7b549a700 1 -- 172.21.15.46:0/3250095774 wait complete. 2023-07-05T18:56:11.876 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-07-05T18:56:12.006 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:12.002+0000 7f6790e2b700 1 Processor -- start 2023-07-05T18:56:12.007 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:12.002+0000 7f6790e2b700 1 -- start start 2023-07-05T18:56:12.007 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:12.003+0000 7f6790e2b700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f678c0ce800 0x7f678c069e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:56:12.007 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:12.003+0000 7f6790e2b700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f678c0cccf0 0x7f678c15b260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:56:12.007 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:12.003+0000 7f6790e2b700 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f678c15b7a0 con 0x7f678c06bc70 2023-07-05T18:56:12.007 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:12.003+0000 7f6790e2b700 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f678c0cebd0 con 0x7f678c0cccf0 2023-07-05T18:56:12.008 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:12.003+0000 7f6790e2b700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f678c06a3e0 con 0x7f678c0ce800 2023-07-05T18:56:12.008 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:12.003+0000 7f6789d9b700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f678c0cccf0 0x7f678c15b260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:56:12.008 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:12.003+0000 7f678ad9d700 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7f678c06bc70 0x7f678c0cac10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.46:42766/0 (socket says 172.21.15.46:42766) 2023-07-05T18:56:12.009 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:12.003+0000 7f678ad9d700 1 -- 172.21.15.46:0/2413707664 learned_addr learned my addr 172.21.15.46:0/2413707664 (peer_addr_for_me v1:172.21.15.46:0/0) 2023-07-05T18:56:12.009 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:12.004+0000 7f678a59c700 1 --2- 172.21.15.46:0/2413707664 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f678c0ce800 0x7f678c069e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:56:12.009 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:12.004+0000 7f6789d9b700 1 -- 172.21.15.46:0/2413707664 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f678c0ce800 msgr2=0x7f678c069e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-05T18:56:12.009 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:12.004+0000 7f6789d9b700 1 --2- 172.21.15.46:0/2413707664 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f678c0ce800 0x7f678c069e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:12.009 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:12.004+0000 7f6789d9b700 1 -- 172.21.15.46:0/2413707664 >> v1:172.21.15.73:6789/0 conn(0x7f678c06bc70 legacy=0x7f678c0cac10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:56:12.009 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:12.004+0000 7f6789d9b700 1 -- 172.21.15.46:0/2413707664 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f678c06a6c0 con 0x7f678c0cccf0 2023-07-05T18:56:12.009 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:12.004+0000 7f6789d9b700 1 --2- 172.21.15.46:0/2413707664 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f678c0cccf0 0x7f678c15b260 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f677c009840 tx=0x7f677c009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4cd84aac64bd30c9 server_cookie=0 in_seq=0 out_seq=0 2023-07-05T18:56:12.010 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:12.004+0000 7f678959a700 1 -- 172.21.15.46:0/2413707664 <== mon.1 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f677c011830 con 0x7f678c0cccf0 2023-07-05T18:56:12.010 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:12.004+0000 7f678959a700 1 -- 172.21.15.46:0/2413707664 <== mon.1 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f677c011990 con 0x7f678c0cccf0 2023-07-05T18:56:12.010 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:12.004+0000 7f678959a700 1 -- 172.21.15.46:0/2413707664 <== mon.1 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f677c011d20 con 0x7f678c0cccf0 2023-07-05T18:56:12.010 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:12.005+0000 7f6790e2b700 1 -- 172.21.15.46:0/2413707664 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f678c0cccf0 msgr2=0x7f678c15b260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:56:12.010 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:12.005+0000 7f6790e2b700 1 --2- 172.21.15.46:0/2413707664 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f678c0cccf0 0x7f678c15b260 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f677c009840 tx=0x7f677c009b50 comp rx=0 tx=0).stop 2023-07-05T18:56:12.010 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:12.005+0000 7f6790e2b700 1 -- 172.21.15.46:0/2413707664 shutdown_connections 2023-07-05T18:56:12.010 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:12.005+0000 7f6790e2b700 1 --2- 172.21.15.46:0/2413707664 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f678c0ce800 0x7f678c069e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:12.010 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:12.005+0000 7f6790e2b700 1 --2- 172.21.15.46:0/2413707664 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f678c0cccf0 0x7f678c15b260 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:12.011 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:12.005+0000 7f6790e2b700 1 -- 172.21.15.46:0/2413707664 >> 172.21.15.46:0/2413707664 conn(0x7f678c0b19d0 msgr2=0x7f678c0cf120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-05T18:56:12.011 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:12.005+0000 7f6790e2b700 1 -- 172.21.15.46:0/2413707664 shutdown_connections 2023-07-05T18:56:12.011 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:12.005+0000 7f6790e2b700 1 -- 172.21.15.46:0/2413707664 wait complete. 2023-07-05T18:56:12.014 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:12.006+0000 7f6790e2b700 1 Processor -- start 2023-07-05T18:56:12.014 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:12.006+0000 7f6790e2b700 1 -- start start 2023-07-05T18:56:12.015 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:12.007+0000 7f6790e2b700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f678c06bc70 0x7f678c1e5ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:56:12.015 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:12.007+0000 7f6790e2b700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f678c0cccf0 0x7f678c0c5b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:56:12.016 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:12.007+0000 7f6790e2b700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f678c0ce800 0x7f678c1452c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:56:12.016 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:12.007+0000 7f6790e2b700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f678c1e6370 con 0x7f678c06bc70 2023-07-05T18:56:12.016 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:12.007+0000 7f6790e2b700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f678c152080 con 0x7f678c0cccf0 2023-07-05T18:56:12.016 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:12.007+0000 7f6790e2b700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f678c146340 con 0x7f678c0ce800 2023-07-05T18:56:12.016 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:12.007+0000 7f678a59c700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f678c06bc70 0x7f678c1e5ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:56:12.016 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:12.007+0000 7f678a59c700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f678c06bc70 0x7f678c1e5ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:57580/0 (socket says 172.21.15.46:57580) 2023-07-05T18:56:12.017 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:12.007+0000 7f678a59c700 1 -- 172.21.15.46:0/4025511877 learned_addr learned my addr 172.21.15.46:0/4025511877 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-07-05T18:56:12.017 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:12.007+0000 7f6789d9b700 1 --2- 172.21.15.46:0/4025511877 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f678c0cccf0 0x7f678c0c5b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:56:12.017 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:12.007+0000 7f678ad9d700 1 --2- 172.21.15.46:0/4025511877 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f678c0ce800 0x7f678c1452c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:56:12.017 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:12.007+0000 7f678a59c700 1 -- 172.21.15.46:0/4025511877 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f678c0ce800 msgr2=0x7f678c1452c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:56:12.017 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:12.007+0000 7f678a59c700 1 --2- 172.21.15.46:0/4025511877 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f678c0ce800 0x7f678c1452c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:12.018 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:12.007+0000 7f678a59c700 1 -- 172.21.15.46:0/4025511877 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f678c0cccf0 msgr2=0x7f678c0c5b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:56:12.018 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:12.007+0000 7f678a59c700 1 --2- 172.21.15.46:0/4025511877 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f678c0cccf0 0x7f678c0c5b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:12.018 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:12.007+0000 7f678a59c700 1 -- 172.21.15.46:0/4025511877 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f677c0094a0 con 0x7f678c06bc70 2023-07-05T18:56:12.018 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:12.007+0000 7f678ad9d700 1 --2- 172.21.15.46:0/4025511877 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f678c0ce800 0x7f678c1452c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-05T18:56:12.018 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:12.008+0000 7f678a59c700 1 --2- 172.21.15.46:0/4025511877 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f678c06bc70 0x7f678c1e5ab0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f678000e8a0 tx=0x7f678000ebb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-05T18:56:12.018 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:12.008+0000 7f677affd700 1 -- 172.21.15.46:0/4025511877 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6780009590 con 0x7f678c06bc70 2023-07-05T18:56:12.018 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:12.008+0000 7f677affd700 1 -- 172.21.15.46:0/4025511877 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6780013680 con 0x7f678c06bc70 2023-07-05T18:56:12.019 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:12.008+0000 7f677affd700 1 -- 172.21.15.46:0/4025511877 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67800139f0 con 0x7f678c06bc70 2023-07-05T18:56:12.019 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:12.008+0000 7f6790e2b700 1 -- 172.21.15.46:0/4025511877 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f678c1e6090 con 0x7f678c06bc70 2023-07-05T18:56:12.019 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:12.008+0000 7f6790e2b700 1 -- 172.21.15.46:0/4025511877 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f678c151d10 con 0x7f678c06bc70 2023-07-05T18:56:12.019 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:12.009+0000 7f6790e2b700 1 -- 172.21.15.46:0/4025511877 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f678c152360 con 0x7f678c06bc70 2023-07-05T18:56:12.020 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:12.009+0000 7f677affd700 1 -- 172.21.15.46:0/4025511877 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f6780013b50 con 0x7f678c06bc70 2023-07-05T18:56:12.020 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:12.010+0000 7f677affd700 1 --2- 172.21.15.46:0/4025511877 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7f676c06ace0 0x7f676c06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:56:12.020 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:12.010+0000 7f677affd700 1 -- 172.21.15.46:0/4025511877 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f6780088fb0 con 0x7f678c06bc70 2023-07-05T18:56:12.020 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:12.010+0000 7f6789d9b700 1 --2- 172.21.15.46:0/4025511877 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7f676c06ace0 0x7f676c06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:56:12.020 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:12.010+0000 7f6789d9b700 1 --2- 172.21.15.46:0/4025511877 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7f676c06ace0 0x7f676c06d190 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f677c009fd0 tx=0x7f677c008030 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-05T18:56:12.021 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:12.014+0000 7f677affd700 1 -- 172.21.15.46:0/4025511877 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f67800bb310 con 0x7f678c06bc70 2023-07-05T18:56:12.214 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:12.211+0000 7f6790e2b700 1 -- 172.21.15.46:0/4025511877 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f678c0713b0 con 0x7f678c06bc70 2023-07-05T18:56:12.215 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:12.212+0000 7f677affd700 1 -- 172.21.15.46:0/4025511877 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v17) v1 ==== 93+0+10 (secure 0 0 0) 0x7f67800170a0 con 0x7f678c06bc70 2023-07-05T18:56:12.215 INFO:teuthology.orchestra.run.smithi046.stdout:pg_num: 1 2023-07-05T18:56:12.218 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:12.214+0000 7f6790e2b700 1 -- 172.21.15.46:0/4025511877 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7f676c06ace0 msgr2=0x7f676c06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:56:12.218 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:12.214+0000 7f6790e2b700 1 --2- 172.21.15.46:0/4025511877 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7f676c06ace0 0x7f676c06d190 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f677c009fd0 tx=0x7f677c008030 comp rx=0 tx=0).stop 2023-07-05T18:56:12.219 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:12.214+0000 7f6790e2b700 1 -- 172.21.15.46:0/4025511877 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f678c06bc70 msgr2=0x7f678c1e5ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:56:12.219 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:12.214+0000 7f6790e2b700 1 --2- 172.21.15.46:0/4025511877 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f678c06bc70 0x7f678c1e5ab0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f678000e8a0 tx=0x7f678000ebb0 comp rx=0 tx=0).stop 2023-07-05T18:56:12.221 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:12.214+0000 7f6790e2b700 1 -- 172.21.15.46:0/4025511877 shutdown_connections 2023-07-05T18:56:12.221 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:12.214+0000 7f6790e2b700 1 --2- 172.21.15.46:0/4025511877 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7f676c06ace0 0x7f676c06d190 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:12.221 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:12.214+0000 7f6790e2b700 1 --2- 172.21.15.46:0/4025511877 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f678c0ce800 0x7f678c1452c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:12.222 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:12.214+0000 7f6790e2b700 1 --2- 172.21.15.46:0/4025511877 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f678c06bc70 0x7f678c1e5ab0 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:12.222 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:12.214+0000 7f6790e2b700 1 --2- 172.21.15.46:0/4025511877 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f678c0cccf0 0x7f678c0c5b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:12.222 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:12.214+0000 7f6790e2b700 1 -- 172.21.15.46:0/4025511877 >> 172.21.15.46:0/4025511877 conn(0x7f678c0b19d0 msgr2=0x7f678c06fd00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-05T18:56:12.222 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:12.214+0000 7f6790e2b700 1 -- 172.21.15.46:0/4025511877 shutdown_connections 2023-07-05T18:56:12.223 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:12.214+0000 7f6790e2b700 1 -- 172.21.15.46:0/4025511877 wait complete. 2023-07-05T18:56:12.228 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-07-05T18:56:12.353 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:12.351+0000 7fc2a71d5700 1 Processor -- start 2023-07-05T18:56:12.353 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:12.351+0000 7fc2a71d5700 1 -- start start 2023-07-05T18:56:12.355 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:12.352+0000 7fc2a71d5700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fc2a0069e00 0x7fc2a006ed80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:56:12.356 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:12.352+0000 7fc2a71d5700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fc2a006a1d0 0x7fc2a00b29b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:56:12.356 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:12.352+0000 7fc2a71d5700 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc2a006e8f0 con 0x7fc2a00b2ef0 2023-07-05T18:56:12.356 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:12.352+0000 7fc2a71d5700 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc2a006ca80 con 0x7fc2a006a1d0 2023-07-05T18:56:12.356 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:12.352+0000 7fc2a71d5700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc2a00b3520 con 0x7fc2a0069e00 2023-07-05T18:56:12.356 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:12.352+0000 7fc2a5772700 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7fc2a00b2ef0 0x7fc2a015c9f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:56864/0 (socket says 172.21.15.46:56864) 2023-07-05T18:56:12.357 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:12.352+0000 7fc2a5772700 1 -- 172.21.15.46:0/1248177546 learned_addr learned my addr 172.21.15.46:0/1248177546 (peer_addr_for_me v1:172.21.15.46:0/0) 2023-07-05T18:56:12.357 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:12.352+0000 7fc2a4f71700 1 --2- 172.21.15.46:0/1248177546 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fc2a0069e00 0x7fc2a006ed80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:56:12.357 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:12.352+0000 7fc29ffff700 1 --2- 172.21.15.46:0/1248177546 >> v2:172.21.15.73:3300/0 conn(0x7fc2a006a1d0 0x7fc2a00b29b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:56:12.357 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:12.352+0000 7fc29f7fe700 1 -- 172.21.15.46:0/1248177546 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1040374815 0 0) 0x7fc2a006e8f0 con 0x7fc2a00b2ef0 2023-07-05T18:56:12.357 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:12.352+0000 7fc29f7fe700 1 -- 172.21.15.46:0/1248177546 --> v1:172.21.15.46:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc2900035b0 con 0x7fc2a00b2ef0 2023-07-05T18:56:12.357 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:12.352+0000 7fc2a4f71700 1 -- 172.21.15.46:0/1248177546 >> v2:172.21.15.73:3300/0 conn(0x7fc2a006a1d0 msgr2=0x7fc2a00b29b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-05T18:56:12.358 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:12.352+0000 7fc2a4f71700 1 --2- 172.21.15.46:0/1248177546 >> v2:172.21.15.73:3300/0 conn(0x7fc2a006a1d0 0x7fc2a00b29b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:12.358 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:12.352+0000 7fc2a4f71700 1 -- 172.21.15.46:0/1248177546 >> v1:172.21.15.46:6789/0 conn(0x7fc2a00b2ef0 legacy=0x7fc2a015c9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:56:12.358 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:12.352+0000 7fc29f7fe700 1 -- 172.21.15.46:0/1248177546 <== mon.0 v1:172.21.15.46:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2401954030 0 0) 0x7fc2900035b0 con 0x7fc2a00b2ef0 2023-07-05T18:56:12.358 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:12.352+0000 7fc2a4f71700 1 -- 172.21.15.46:0/1248177546 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc2a006e2a0 con 0x7fc2a0069e00 2023-07-05T18:56:12.358 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:12.353+0000 7fc2a4f71700 1 --2- 172.21.15.46:0/1248177546 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fc2a0069e00 0x7fc2a006ed80 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7fc294009840 tx=0x7fc294009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=cad80fbbb284df41 server_cookie=0 in_seq=0 out_seq=0 2023-07-05T18:56:12.359 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:12.353+0000 7fc29f7fe700 1 -- 172.21.15.46:0/1248177546 <== mon.2 v2:172.21.15.73:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2980019f0 con 0x7fc2a0069e00 2023-07-05T18:56:12.359 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:12.353+0000 7fc29f7fe700 1 -- 172.21.15.46:0/1248177546 <== mon.2 v2:172.21.15.73:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc294004030 con 0x7fc2a0069e00 2023-07-05T18:56:12.360 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:12.353+0000 7fc29f7fe700 1 -- 172.21.15.46:0/1248177546 <== mon.2 v2:172.21.15.73:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2940043c0 con 0x7fc2a0069e00 2023-07-05T18:56:12.360 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:12.353+0000 7fc2a71d5700 1 -- 172.21.15.46:0/1248177546 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fc2a0069e00 msgr2=0x7fc2a006ed80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:56:12.360 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:12.353+0000 7fc2a71d5700 1 --2- 172.21.15.46:0/1248177546 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fc2a0069e00 0x7fc2a006ed80 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7fc294009840 tx=0x7fc294009b50 comp rx=0 tx=0).stop 2023-07-05T18:56:12.361 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:12.353+0000 7fc2a71d5700 1 -- 172.21.15.46:0/1248177546 shutdown_connections 2023-07-05T18:56:12.361 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:12.353+0000 7fc2a71d5700 1 --2- 172.21.15.46:0/1248177546 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fc2a0069e00 0x7fc2a006ed80 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:12.361 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:12.353+0000 7fc2a71d5700 1 --2- 172.21.15.46:0/1248177546 >> v2:172.21.15.73:3300/0 conn(0x7fc2a006a1d0 0x7fc2a00b29b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:12.361 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:12.353+0000 7fc2a71d5700 1 -- 172.21.15.46:0/1248177546 >> 172.21.15.46:0/1248177546 conn(0x7fc2a006af10 msgr2=0x7fc2a006b2e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-05T18:56:12.362 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:12.353+0000 7fc2a71d5700 1 -- 172.21.15.46:0/1248177546 shutdown_connections 2023-07-05T18:56:12.362 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:12.353+0000 7fc2a71d5700 1 -- 172.21.15.46:0/1248177546 wait complete. 2023-07-05T18:56:12.365 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:12.354+0000 7fc2a71d5700 1 Processor -- start 2023-07-05T18:56:12.366 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:12.355+0000 7fc2a71d5700 1 -- start start 2023-07-05T18:56:12.366 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:12.355+0000 7fc2a71d5700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fc2a0069e00 0x7fc2a01f1520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:56:12.366 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:12.355+0000 7fc2a71d5700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc2a006a1d0 0x7fc2a00ccdc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:56:12.367 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:12.355+0000 7fc2a71d5700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc2a00b2ef0 0x7fc2a0157aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:56:12.367 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:12.355+0000 7fc2a71d5700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2a00cd880 con 0x7fc2a00b2ef0 2023-07-05T18:56:12.367 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:12.355+0000 7fc2a71d5700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2a00cdb60 con 0x7fc2a006a1d0 2023-07-05T18:56:12.367 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:12.355+0000 7fc2a71d5700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc2a00cea80 con 0x7fc2a0069e00 2023-07-05T18:56:12.367 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:12.356+0000 7fc2a5772700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc2a00b2ef0 0x7fc2a0157aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:56:12.368 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:12.356+0000 7fc2a5772700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc2a00b2ef0 0x7fc2a0157aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:57598/0 (socket says 172.21.15.46:57598) 2023-07-05T18:56:12.368 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:12.356+0000 7fc2a5772700 1 -- 172.21.15.46:0/2771811397 learned_addr learned my addr 172.21.15.46:0/2771811397 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-07-05T18:56:12.368 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:12.356+0000 7fc2a4f71700 1 --2- 172.21.15.46:0/2771811397 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fc2a0069e00 0x7fc2a01f1520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:56:12.368 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:12.356+0000 7fc29ffff700 1 --2- 172.21.15.46:0/2771811397 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc2a006a1d0 0x7fc2a00ccdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:56:12.369 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:12.356+0000 7fc2a5772700 1 -- 172.21.15.46:0/2771811397 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fc2a0069e00 msgr2=0x7fc2a01f1520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:56:12.369 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:12.356+0000 7fc2a5772700 1 --2- 172.21.15.46:0/2771811397 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fc2a0069e00 0x7fc2a01f1520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:12.369 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:12.356+0000 7fc2a5772700 1 -- 172.21.15.46:0/2771811397 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc2a006a1d0 msgr2=0x7fc2a00ccdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:56:12.369 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:12.356+0000 7fc2a5772700 1 --2- 172.21.15.46:0/2771811397 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc2a006a1d0 0x7fc2a00ccdc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:12.370 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:12.356+0000 7fc2a5772700 1 -- 172.21.15.46:0/2771811397 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc2940094a0 con 0x7fc2a00b2ef0 2023-07-05T18:56:12.371 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:12.356+0000 7fc2a5772700 1 --2- 172.21.15.46:0/2771811397 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc2a00b2ef0 0x7fc2a0157aa0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fc29800cc00 tx=0x7fc29800cf10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-05T18:56:12.371 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:12.356+0000 7fc29d7fa700 1 -- 172.21.15.46:0/2771811397 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc29800aa80 con 0x7fc2a00b2ef0 2023-07-05T18:56:12.371 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:12.356+0000 7fc29d7fa700 1 -- 172.21.15.46:0/2771811397 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc29800ac00 con 0x7fc2a00b2ef0 2023-07-05T18:56:12.371 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:12.356+0000 7fc29d7fa700 1 -- 172.21.15.46:0/2771811397 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2980070d0 con 0x7fc2a00b2ef0 2023-07-05T18:56:12.371 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:12.356+0000 7fc2a71d5700 1 -- 172.21.15.46:0/2771811397 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc2a00ced60 con 0x7fc2a00b2ef0 2023-07-05T18:56:12.372 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:12.356+0000 7fc2a71d5700 1 -- 172.21.15.46:0/2771811397 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc2a014a7b0 con 0x7fc2a00b2ef0 2023-07-05T18:56:12.372 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:12.357+0000 7fc2a71d5700 1 -- 172.21.15.46:0/2771811397 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc2a00ce8c0 con 0x7fc2a00b2ef0 2023-07-05T18:56:12.372 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:12.357+0000 7fc29d7fa700 1 -- 172.21.15.46:0/2771811397 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fc298007230 con 0x7fc2a00b2ef0 2023-07-05T18:56:12.372 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:12.358+0000 7fc29d7fa700 1 --2- 172.21.15.46:0/2771811397 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7fc28406ace0 0x7fc28406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:56:12.373 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:12.358+0000 7fc29d7fa700 1 -- 172.21.15.46:0/2771811397 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 5210+0+0 (secure 0 0 0) 0x7fc298088b90 con 0x7fc2a00b2ef0 2023-07-05T18:56:12.373 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:12.358+0000 7fc2a4f71700 1 --2- 172.21.15.46:0/2771811397 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7fc28406ace0 0x7fc28406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:56:12.373 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:12.359+0000 7fc2a4f71700 1 --2- 172.21.15.46:0/2771811397 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7fc28406ace0 0x7fc28406d190 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fc2940090b0 tx=0x7fc294008030 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-05T18:56:12.373 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:12.363+0000 7fc29d7fa700 1 -- 172.21.15.46:0/2771811397 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fc298053f90 con 0x7fc2a00b2ef0 2023-07-05T18:56:12.569 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:12.566+0000 7fc2a71d5700 1 -- 172.21.15.46:0/2771811397 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7fc2a00672e0 con 0x7fc2a00b2ef0 2023-07-05T18:56:12.569 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:12.567+0000 7fc29d7fa700 1 -- 172.21.15.46:0/2771811397 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v17) v1 ==== 84+0+126 (secure 0 0 0) 0x7fc298018090 con 0x7fc2a00b2ef0 2023-07-05T18:56:12.570 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T18:56:12.570 INFO:teuthology.orchestra.run.smithi046.stdout:[ 2023-07-05T18:56:12.570 INFO:teuthology.orchestra.run.smithi046.stdout: { 2023-07-05T18:56:12.571 INFO:teuthology.orchestra.run.smithi046.stdout: "poolnum": 1, 2023-07-05T18:56:12.571 INFO:teuthology.orchestra.run.smithi046.stdout: "poolname": "rbd" 2023-07-05T18:56:12.571 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-07-05T18:56:12.572 INFO:teuthology.orchestra.run.smithi046.stdout: { 2023-07-05T18:56:12.572 INFO:teuthology.orchestra.run.smithi046.stdout: "poolnum": 2, 2023-07-05T18:56:12.572 INFO:teuthology.orchestra.run.smithi046.stdout: "poolname": ".mgr" 2023-07-05T18:56:12.572 INFO:teuthology.orchestra.run.smithi046.stdout: } 2023-07-05T18:56:12.573 INFO:teuthology.orchestra.run.smithi046.stdout:] 2023-07-05T18:56:12.575 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:12.569+0000 7fc2a71d5700 1 -- 172.21.15.46:0/2771811397 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7fc28406ace0 msgr2=0x7fc28406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:56:12.575 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:12.569+0000 7fc2a71d5700 1 --2- 172.21.15.46:0/2771811397 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7fc28406ace0 0x7fc28406d190 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fc2940090b0 tx=0x7fc294008030 comp rx=0 tx=0).stop 2023-07-05T18:56:12.575 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:12.569+0000 7fc2a71d5700 1 -- 172.21.15.46:0/2771811397 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc2a00b2ef0 msgr2=0x7fc2a0157aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:56:12.576 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:12.569+0000 7fc2a71d5700 1 --2- 172.21.15.46:0/2771811397 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc2a00b2ef0 0x7fc2a0157aa0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fc29800cc00 tx=0x7fc29800cf10 comp rx=0 tx=0).stop 2023-07-05T18:56:12.576 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:12.569+0000 7fc2a71d5700 1 -- 172.21.15.46:0/2771811397 shutdown_connections 2023-07-05T18:56:12.576 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:12.569+0000 7fc2a71d5700 1 --2- 172.21.15.46:0/2771811397 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7fc28406ace0 0x7fc28406d190 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:12.576 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:12.569+0000 7fc2a71d5700 1 --2- 172.21.15.46:0/2771811397 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc2a00b2ef0 0x7fc2a0157aa0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:12.577 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:12.569+0000 7fc2a71d5700 1 --2- 172.21.15.46:0/2771811397 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fc2a0069e00 0x7fc2a01f1520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:12.577 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:12.569+0000 7fc2a71d5700 1 --2- 172.21.15.46:0/2771811397 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc2a006a1d0 0x7fc2a00ccdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:12.577 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:12.569+0000 7fc2a71d5700 1 -- 172.21.15.46:0/2771811397 >> 172.21.15.46:0/2771811397 conn(0x7fc2a006af10 msgr2=0x7fc2a00b1690 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-05T18:56:12.577 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:12.569+0000 7fc2a71d5700 1 -- 172.21.15.46:0/2771811397 shutdown_connections 2023-07-05T18:56:12.577 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:12.569+0000 7fc2a71d5700 1 -- 172.21.15.46:0/2771811397 wait complete. 2023-07-05T18:56:12.585 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-07-05T18:56:12.585 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-07-05T18:56:12.716 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:12.713+0000 7f9d4ab76700 1 Processor -- start 2023-07-05T18:56:12.716 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:12.713+0000 7f9d4ab76700 1 -- start start 2023-07-05T18:56:12.718 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:12.714+0000 7f9d4ab76700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f9d4406e7c0 0x7f9d4406ba50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:56:12.718 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:12.714+0000 7f9d4ab76700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f9d4406c810 0x7f9d4406ccb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:56:12.718 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:12.714+0000 7f9d4ab76700 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9d440cf440 con 0x7f9d4415c8d0 2023-07-05T18:56:12.719 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:12.714+0000 7f9d4ab76700 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9d4406acd0 con 0x7f9d4406e7c0 2023-07-05T18:56:12.719 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:12.714+0000 7f9d4ab76700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9d4406d540 con 0x7f9d4406c810 2023-07-05T18:56:12.719 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:12.715+0000 7f9d43fff700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f9d4406e7c0 0x7f9d4406ba50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:56:12.719 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:12.715+0000 7f9d49113700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f9d4406c810 0x7f9d4406ccb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:56:12.719 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:12.715+0000 7f9d43fff700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f9d4406e7c0 0x7f9d4406ba50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.46:57092/0 (socket says 172.21.15.46:57092) 2023-07-05T18:56:12.719 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:12.715+0000 7f9d48912700 1 --1- 172.21.15.46:0/3444175566 >> v1:172.21.15.73:6789/0 conn(0x7f9d4415c8d0 0x7f9d4406e0b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.46:42794/0 (socket says 172.21.15.46:42794) 2023-07-05T18:56:12.719 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:12.715+0000 7f9d43fff700 1 -- 172.21.15.46:0/3444175566 learned_addr learned my addr 172.21.15.46:0/3444175566 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-07-05T18:56:12.719 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:12.715+0000 7f9d437fe700 1 -- 172.21.15.46:0/3444175566 <== mon.1 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1304548640 0 0) 0x7f9d38001110 con 0x7f9d4415c8d0 2023-07-05T18:56:12.720 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:12.715+0000 7f9d437fe700 1 -- 172.21.15.46:0/3444175566 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9d340035b0 con 0x7f9d4415c8d0 2023-07-05T18:56:12.720 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:12.715+0000 7f9d43fff700 1 -- 172.21.15.46:0/3444175566 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f9d4406c810 msgr2=0x7f9d4406ccb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-05T18:56:12.720 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:12.715+0000 7f9d43fff700 1 --2- 172.21.15.46:0/3444175566 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f9d4406c810 0x7f9d4406ccb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:12.720 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:12.715+0000 7f9d43fff700 1 -- 172.21.15.46:0/3444175566 >> v1:172.21.15.73:6789/0 conn(0x7f9d4415c8d0 legacy=0x7f9d4406e0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:56:12.720 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:12.715+0000 7f9d43fff700 1 -- 172.21.15.46:0/3444175566 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9d4406af70 con 0x7f9d4406e7c0 2023-07-05T18:56:12.720 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:12.715+0000 7f9d49113700 1 --2- 172.21.15.46:0/3444175566 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f9d4406c810 0x7f9d4406ccb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-05T18:56:12.720 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:12.715+0000 7f9d43fff700 1 --2- 172.21.15.46:0/3444175566 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9d4406e7c0 0x7f9d4406ba50 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f9d300098f0 tx=0x7f9d30009c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=252d0def4d27fd84 server_cookie=0 in_seq=0 out_seq=0 2023-07-05T18:56:12.721 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:12.715+0000 7f9d437fe700 1 -- 172.21.15.46:0/3444175566 <== mon.1 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d30011830 con 0x7f9d4406e7c0 2023-07-05T18:56:12.721 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:12.716+0000 7f9d437fe700 1 -- 172.21.15.46:0/3444175566 <== mon.1 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9d30011990 con 0x7f9d4406e7c0 2023-07-05T18:56:12.721 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:12.716+0000 7f9d437fe700 1 -- 172.21.15.46:0/3444175566 <== mon.1 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d30011d20 con 0x7f9d4406e7c0 2023-07-05T18:56:12.721 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:12.716+0000 7f9d4ab76700 1 -- 172.21.15.46:0/3444175566 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9d4406e7c0 msgr2=0x7f9d4406ba50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:56:12.721 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:12.716+0000 7f9d4ab76700 1 --2- 172.21.15.46:0/3444175566 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9d4406e7c0 0x7f9d4406ba50 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f9d300098f0 tx=0x7f9d30009c00 comp rx=0 tx=0).stop 2023-07-05T18:56:12.721 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:12.716+0000 7f9d4ab76700 1 -- 172.21.15.46:0/3444175566 shutdown_connections 2023-07-05T18:56:12.721 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:12.716+0000 7f9d4ab76700 1 --2- 172.21.15.46:0/3444175566 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f9d4406c810 0x7f9d4406ccb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:12.721 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:12.716+0000 7f9d4ab76700 1 --2- 172.21.15.46:0/3444175566 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9d4406e7c0 0x7f9d4406ba50 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:12.723 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:12.716+0000 7f9d4ab76700 1 -- 172.21.15.46:0/3444175566 >> 172.21.15.46:0/3444175566 conn(0x7f9d440cf9e0 msgr2=0x7f9d440cfde0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-05T18:56:12.723 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:12.716+0000 7f9d4ab76700 1 -- 172.21.15.46:0/3444175566 shutdown_connections 2023-07-05T18:56:12.723 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:12.716+0000 7f9d4ab76700 1 -- 172.21.15.46:0/3444175566 wait complete. 2023-07-05T18:56:12.728 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:12.717+0000 7f9d4ab76700 1 Processor -- start 2023-07-05T18:56:12.728 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:12.717+0000 7f9d4ab76700 1 -- start start 2023-07-05T18:56:12.728 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:12.718+0000 7f9d4ab76700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f9d4406c810 0x7f9d4415cca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:56:12.729 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:12.718+0000 7f9d4ab76700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9d4406e7c0 0x7f9d440aff60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:56:12.729 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:12.718+0000 7f9d4ab76700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9d4415c8d0 0x7f9d441563e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:56:12.729 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:12.718+0000 7f9d4ab76700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d440b3f80 con 0x7f9d4415c8d0 2023-07-05T18:56:12.729 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:12.718+0000 7f9d4ab76700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d440b4260 con 0x7f9d4406e7c0 2023-07-05T18:56:12.729 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:12.718+0000 7f9d4ab76700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9d440c8100 con 0x7f9d4406c810 2023-07-05T18:56:12.729 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:12.718+0000 7f9d49113700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9d4415c8d0 0x7f9d441563e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:56:12.729 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:12.718+0000 7f9d49113700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9d4415c8d0 0x7f9d441563e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:57616/0 (socket says 172.21.15.46:57616) 2023-07-05T18:56:12.730 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:12.718+0000 7f9d49113700 1 -- 172.21.15.46:0/1953374958 learned_addr learned my addr 172.21.15.46:0/1953374958 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-07-05T18:56:12.730 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:12.718+0000 7f9d43fff700 1 --2- 172.21.15.46:0/1953374958 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9d4406e7c0 0x7f9d440aff60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:56:12.730 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:12.718+0000 7f9d48912700 1 --2- 172.21.15.46:0/1953374958 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f9d4406c810 0x7f9d4415cca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:56:12.730 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:12.719+0000 7f9d49113700 1 -- 172.21.15.46:0/1953374958 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f9d4406c810 msgr2=0x7f9d4415cca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:56:12.730 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:12.719+0000 7f9d49113700 1 --2- 172.21.15.46:0/1953374958 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f9d4406c810 0x7f9d4415cca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:12.730 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:12.719+0000 7f9d49113700 1 -- 172.21.15.46:0/1953374958 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9d4406e7c0 msgr2=0x7f9d440aff60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:56:12.730 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:12.719+0000 7f9d49113700 1 --2- 172.21.15.46:0/1953374958 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9d4406e7c0 0x7f9d440aff60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:12.730 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:12.719+0000 7f9d49113700 1 -- 172.21.15.46:0/1953374958 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9d3c009a70 con 0x7f9d4415c8d0 2023-07-05T18:56:12.731 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:12.719+0000 7f9d49113700 1 --2- 172.21.15.46:0/1953374958 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9d4415c8d0 0x7f9d441563e0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f9d3c00efc0 tx=0x7f9d3c00c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-05T18:56:12.731 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:12.719+0000 7f9d417fa700 1 -- 172.21.15.46:0/1953374958 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d3c00ca90 con 0x7f9d4415c8d0 2023-07-05T18:56:12.731 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:12.719+0000 7f9d417fa700 1 -- 172.21.15.46:0/1953374958 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9d3c00f040 con 0x7f9d4415c8d0 2023-07-05T18:56:12.731 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:12.719+0000 7f9d417fa700 1 -- 172.21.15.46:0/1953374958 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d3c00ce30 con 0x7f9d4415c8d0 2023-07-05T18:56:12.731 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:12.719+0000 7f9d4ab76700 1 -- 172.21.15.46:0/1953374958 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9d30009550 con 0x7f9d4415c8d0 2023-07-05T18:56:12.731 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:12.719+0000 7f9d4ab76700 1 -- 172.21.15.46:0/1953374958 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9d440c86c0 con 0x7f9d4415c8d0 2023-07-05T18:56:12.732 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:12.720+0000 7f9d4ab76700 1 -- 172.21.15.46:0/1953374958 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9d440672e0 con 0x7f9d4415c8d0 2023-07-05T18:56:12.732 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:12.720+0000 7f9d417fa700 1 -- 172.21.15.46:0/1953374958 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f9d3c014480 con 0x7f9d4415c8d0 2023-07-05T18:56:12.732 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:12.721+0000 7f9d417fa700 1 --2- 172.21.15.46:0/1953374958 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7f9d2806ace0 0x7f9d2806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:56:12.732 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:12.721+0000 7f9d417fa700 1 -- 172.21.15.46:0/1953374958 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f9d3c0896e0 con 0x7f9d4415c8d0 2023-07-05T18:56:12.732 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:12.721+0000 7f9d48912700 1 --2- 172.21.15.46:0/1953374958 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7f9d2806ace0 0x7f9d2806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:56:12.732 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:12.722+0000 7f9d48912700 1 --2- 172.21.15.46:0/1953374958 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7f9d2806ace0 0x7f9d2806d190 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f9d38001370 tx=0x7f9d38007c40 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-05T18:56:12.733 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:12.725+0000 7f9d417fa700 1 -- 172.21.15.46:0/1953374958 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f9d3c054b70 con 0x7f9d4415c8d0 2023-07-05T18:56:12.925 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:12.923+0000 7f9d4ab76700 1 -- 172.21.15.46:0/1953374958 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7f9d440c32f0 con 0x7f9d4415c8d0 2023-07-05T18:56:13.667 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:13.665+0000 7f9d417fa700 1 -- 172.21.15.46:0/1953374958 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v18) v1 ==== 138+0+0 (secure 0 0 0) 0x7f9d3c058190 con 0x7f9d4415c8d0 2023-07-05T18:56:13.672 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:13.671+0000 7f9d4ab76700 1 -- 172.21.15.46:0/1953374958 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7f9d2806ace0 msgr2=0x7f9d2806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:56:13.673 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:13.671+0000 7f9d4ab76700 1 --2- 172.21.15.46:0/1953374958 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7f9d2806ace0 0x7f9d2806d190 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f9d38001370 tx=0x7f9d38007c40 comp rx=0 tx=0).stop 2023-07-05T18:56:13.673 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:13.671+0000 7f9d4ab76700 1 -- 172.21.15.46:0/1953374958 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9d4415c8d0 msgr2=0x7f9d441563e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:56:13.673 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:13.671+0000 7f9d4ab76700 1 --2- 172.21.15.46:0/1953374958 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9d4415c8d0 0x7f9d441563e0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f9d3c00efc0 tx=0x7f9d3c00c3a0 comp rx=0 tx=0).stop 2023-07-05T18:56:13.674 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:13.671+0000 7f9d4ab76700 1 -- 172.21.15.46:0/1953374958 shutdown_connections 2023-07-05T18:56:13.674 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:13.671+0000 7f9d4ab76700 1 --2- 172.21.15.46:0/1953374958 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7f9d2806ace0 0x7f9d2806d190 secure :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f9d38001370 tx=0x7f9d38007c40 comp rx=0 tx=0).stop 2023-07-05T18:56:13.674 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:13.671+0000 7f9d4ab76700 1 --2- 172.21.15.46:0/1953374958 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9d4415c8d0 0x7f9d441563e0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:13.674 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:13.671+0000 7f9d4ab76700 1 --2- 172.21.15.46:0/1953374958 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f9d4406c810 0x7f9d4415cca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:13.674 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:13.671+0000 7f9d4ab76700 1 --2- 172.21.15.46:0/1953374958 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9d4406e7c0 0x7f9d440aff60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:13.674 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:13.671+0000 7f9d4ab76700 1 -- 172.21.15.46:0/1953374958 >> 172.21.15.46:0/1953374958 conn(0x7f9d440cf9e0 msgr2=0x7f9d440cd8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-05T18:56:13.674 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:13.672+0000 7f9d4ab76700 1 -- 172.21.15.46:0/1953374958 shutdown_connections 2023-07-05T18:56:13.675 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:13.673+0000 7f9d4ab76700 1 -- 172.21.15.46:0/1953374958 wait complete. 2023-07-05T18:56:13.675 INFO:teuthology.orchestra.run.smithi046.stderr:pool 'cephfs_metadata' created 2023-07-05T18:56:13.690 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-07-05T18:56:13.837 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:13.828+0000 7fbd956b8700 1 Processor -- start 2023-07-05T18:56:13.837 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:13.828+0000 7fbd956b8700 1 -- start start 2023-07-05T18:56:13.838 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:13.829+0000 7fbd956b8700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fbd9015c5e0 0x7fbd90160b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:56:13.838 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:13.829+0000 7fbd956b8700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fbd900cd2e0 0x7fbd900b5ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:56:13.838 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:13.829+0000 7fbd956b8700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fbd900cf670 0x7fbd900cfad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:56:13.838 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:13.829+0000 7fbd956b8700 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbd900cf480 con 0x7fbd900cf670 2023-07-05T18:56:13.838 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:13.829+0000 7fbd956b8700 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbd90161060 con 0x7fbd900cd2e0 2023-07-05T18:56:13.839 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:13.829+0000 7fbd956b8700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbd900d1050 con 0x7fbd9015c5e0 2023-07-05T18:56:13.839 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:13.829+0000 7fbd8f7fe700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fbd900cf670 0x7fbd900cfad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:56:13.839 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:13.829+0000 7fbd8f7fe700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fbd900cf670 0x7fbd900cfad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:57624/0 (socket says 172.21.15.46:57624) 2023-07-05T18:56:13.839 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:13.829+0000 7fbd8f7fe700 1 -- 172.21.15.46:0/2415631891 learned_addr learned my addr 172.21.15.46:0/2415631891 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-07-05T18:56:13.840 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:13.829+0000 7fbd8e7fc700 1 --2- 172.21.15.46:0/2415631891 >> v2:172.21.15.73:3300/0 conn(0x7fbd900cd2e0 0x7fbd900b5ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:56:13.840 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:13.829+0000 7fbd8effd700 1 --2- 172.21.15.46:0/2415631891 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fbd9015c5e0 0x7fbd90160b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:56:13.840 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:13.829+0000 7fbd8f7fe700 1 -- 172.21.15.46:0/2415631891 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fbd9015c5e0 msgr2=0x7fbd90160b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-05T18:56:13.841 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:13.829+0000 7fbd8f7fe700 1 --2- 172.21.15.46:0/2415631891 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fbd9015c5e0 0x7fbd90160b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:13.841 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:13.829+0000 7fbd8f7fe700 1 -- 172.21.15.46:0/2415631891 >> v2:172.21.15.73:3300/0 conn(0x7fbd900cd2e0 msgr2=0x7fbd900b5ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-05T18:56:13.841 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:13.829+0000 7fbd8f7fe700 1 --2- 172.21.15.46:0/2415631891 >> v2:172.21.15.73:3300/0 conn(0x7fbd900cd2e0 0x7fbd900b5ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:13.841 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:13.829+0000 7fbd8f7fe700 1 -- 172.21.15.46:0/2415631891 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbd900d0010 con 0x7fbd900cf670 2023-07-05T18:56:13.842 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:13.829+0000 7fbd8f7fe700 1 --2- 172.21.15.46:0/2415631891 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fbd900cf670 0x7fbd900cfad0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fbd9006cfe0 tx=0x7fbd8800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9448bbb29514fcbe server_cookie=0 in_seq=0 out_seq=0 2023-07-05T18:56:13.842 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:13.830+0000 7fbd8dffb700 1 -- 172.21.15.46:0/2415631891 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd8800e070 con 0x7fbd900cf670 2023-07-05T18:56:13.842 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:13.830+0000 7fbd8dffb700 1 -- 172.21.15.46:0/2415631891 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbd8800b910 con 0x7fbd900cf670 2023-07-05T18:56:13.843 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:13.830+0000 7fbd8dffb700 1 -- 172.21.15.46:0/2415631891 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd8800bcc0 con 0x7fbd900cf670 2023-07-05T18:56:13.843 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:13.830+0000 7fbd956b8700 1 -- 172.21.15.46:0/2415631891 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fbd900cf670 msgr2=0x7fbd900cfad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:56:13.843 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:13.830+0000 7fbd956b8700 1 --2- 172.21.15.46:0/2415631891 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fbd900cf670 0x7fbd900cfad0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fbd9006cfe0 tx=0x7fbd8800b330 comp rx=0 tx=0).stop 2023-07-05T18:56:13.843 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:13.830+0000 7fbd956b8700 1 -- 172.21.15.46:0/2415631891 shutdown_connections 2023-07-05T18:56:13.844 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:13.830+0000 7fbd956b8700 1 --2- 172.21.15.46:0/2415631891 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fbd9015c5e0 0x7fbd90160b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:13.844 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:13.830+0000 7fbd956b8700 1 --2- 172.21.15.46:0/2415631891 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fbd900cf670 0x7fbd900cfad0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:13.844 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:13.830+0000 7fbd956b8700 1 --2- 172.21.15.46:0/2415631891 >> v2:172.21.15.73:3300/0 conn(0x7fbd900cd2e0 0x7fbd900b5ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:13.845 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:13.830+0000 7fbd956b8700 1 -- 172.21.15.46:0/2415631891 >> 172.21.15.46:0/2415631891 conn(0x7fbd9006cb50 msgr2=0x7fbd900b47e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-05T18:56:13.845 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:13.830+0000 7fbd956b8700 1 -- 172.21.15.46:0/2415631891 shutdown_connections 2023-07-05T18:56:13.845 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:13.830+0000 7fbd956b8700 1 -- 172.21.15.46:0/2415631891 wait complete. 2023-07-05T18:56:13.845 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:13.832+0000 7fbd956b8700 1 Processor -- start 2023-07-05T18:56:13.846 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:13.832+0000 7fbd956b8700 1 -- start start 2023-07-05T18:56:13.847 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:13.832+0000 7fbd956b8700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fbd900cd2e0 0x7fbd900c9230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:56:13.847 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:13.832+0000 7fbd956b8700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fbd900cf670 0x7fbd90149c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:56:13.847 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:13.832+0000 7fbd956b8700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fbd9015c5e0 0x7fbd900c6c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:56:13.847 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:13.832+0000 7fbd956b8700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd9015fa30 con 0x7fbd9015c5e0 2023-07-05T18:56:13.847 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:13.832+0000 7fbd956b8700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd9014a190 con 0x7fbd900cd2e0 2023-07-05T18:56:13.848 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:13.832+0000 7fbd956b8700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbd9015f4b0 con 0x7fbd900cf670 2023-07-05T18:56:13.848 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:13.832+0000 7fbd8f7fe700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fbd9015c5e0 0x7fbd900c6c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:56:13.848 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:13.833+0000 7fbd8f7fe700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fbd9015c5e0 0x7fbd900c6c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:57630/0 (socket says 172.21.15.46:57630) 2023-07-05T18:56:13.848 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:13.833+0000 7fbd8effd700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fbd900cd2e0 0x7fbd900c9230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:56:13.848 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:13.833+0000 7fbd8f7fe700 1 -- 172.21.15.46:0/2237109594 learned_addr learned my addr 172.21.15.46:0/2237109594 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-07-05T18:56:13.849 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:13.833+0000 7fbd8e7fc700 1 --2- 172.21.15.46:0/2237109594 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fbd900cf670 0x7fbd90149c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:56:13.849 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:13.833+0000 7fbd8f7fe700 1 -- 172.21.15.46:0/2237109594 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fbd900cf670 msgr2=0x7fbd90149c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:56:13.849 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:13.833+0000 7fbd8f7fe700 1 --2- 172.21.15.46:0/2237109594 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fbd900cf670 0x7fbd90149c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:13.849 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:13.833+0000 7fbd8f7fe700 1 -- 172.21.15.46:0/2237109594 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fbd900cd2e0 msgr2=0x7fbd900c9230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:56:13.849 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:13.833+0000 7fbd8f7fe700 1 --2- 172.21.15.46:0/2237109594 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fbd900cd2e0 0x7fbd900c9230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:13.849 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:13.833+0000 7fbd8f7fe700 1 -- 172.21.15.46:0/2237109594 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbd88009b30 con 0x7fbd9015c5e0 2023-07-05T18:56:13.849 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:13.833+0000 7fbd8effd700 1 --2- 172.21.15.46:0/2237109594 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fbd900cd2e0 0x7fbd900c9230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-05T18:56:13.849 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:13.833+0000 7fbd8f7fe700 1 --2- 172.21.15.46:0/2237109594 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fbd9015c5e0 0x7fbd900c6c90 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fbd9008ba50 tx=0x7fbd88004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-05T18:56:13.850 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:13.833+0000 7fbd777fe700 1 -- 172.21.15.46:0/2237109594 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd880099b0 con 0x7fbd9015c5e0 2023-07-05T18:56:13.850 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:13.833+0000 7fbd777fe700 1 -- 172.21.15.46:0/2237109594 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbd8800ce80 con 0x7fbd9015c5e0 2023-07-05T18:56:13.850 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:13.833+0000 7fbd956b8700 1 -- 172.21.15.46:0/2237109594 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbd9015f750 con 0x7fbd9015c5e0 2023-07-05T18:56:13.850 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:13.833+0000 7fbd777fe700 1 -- 172.21.15.46:0/2237109594 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd88004490 con 0x7fbd9015c5e0 2023-07-05T18:56:13.851 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:13.833+0000 7fbd956b8700 1 -- 172.21.15.46:0/2237109594 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbd900c8d10 con 0x7fbd9015c5e0 2023-07-05T18:56:13.851 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:13.834+0000 7fbd956b8700 1 -- 172.21.15.46:0/2237109594 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbd900672e0 con 0x7fbd9015c5e0 2023-07-05T18:56:13.851 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:13.835+0000 7fbd777fe700 1 -- 172.21.15.46:0/2237109594 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fbd880045f0 con 0x7fbd9015c5e0 2023-07-05T18:56:13.851 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:13.835+0000 7fbd777fe700 1 --2- 172.21.15.46:0/2237109594 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7fbd7c06ace0 0x7fbd7c06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:56:13.852 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:13.835+0000 7fbd777fe700 1 -- 172.21.15.46:0/2237109594 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 5580+0+0 (secure 0 0 0) 0x7fbd8808a4f0 con 0x7fbd9015c5e0 2023-07-05T18:56:13.852 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:13.835+0000 7fbd8effd700 1 --2- 172.21.15.46:0/2237109594 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7fbd7c06ace0 0x7fbd7c06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:56:13.852 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:13.836+0000 7fbd8effd700 1 --2- 172.21.15.46:0/2237109594 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7fbd7c06ace0 0x7fbd7c06d190 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fbd80009fd0 tx=0x7fbd80009210 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-05T18:56:13.853 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:13.840+0000 7fbd777fe700 1 -- 172.21.15.46:0/2237109594 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fbd88055810 con 0x7fbd9015c5e0 2023-07-05T18:56:14.039 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:14.037+0000 7fbd956b8700 1 -- 172.21.15.46:0/2237109594 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7fbd900c6a70 con 0x7fbd9015c5e0 2023-07-05T18:56:14.676 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:14.672+0000 7fbd777fe700 1 -- 172.21.15.46:0/2237109594 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v19) v1 ==== 170+0+0 (secure 0 0 0) 0x7fbd88058e30 con 0x7fbd9015c5e0 2023-07-05T18:56:14.680 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:14.678+0000 7fbd956b8700 1 -- 172.21.15.46:0/2237109594 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7fbd7c06ace0 msgr2=0x7fbd7c06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:56:14.680 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:14.678+0000 7fbd956b8700 1 --2- 172.21.15.46:0/2237109594 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7fbd7c06ace0 0x7fbd7c06d190 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fbd80009fd0 tx=0x7fbd80009210 comp rx=0 tx=0).stop 2023-07-05T18:56:14.680 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:14.678+0000 7fbd956b8700 1 -- 172.21.15.46:0/2237109594 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fbd9015c5e0 msgr2=0x7fbd900c6c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:56:14.681 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:14.678+0000 7fbd956b8700 1 --2- 172.21.15.46:0/2237109594 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fbd9015c5e0 0x7fbd900c6c90 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fbd9008ba50 tx=0x7fbd88004ad0 comp rx=0 tx=0).stop 2023-07-05T18:56:14.681 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:14.678+0000 7fbd956b8700 1 -- 172.21.15.46:0/2237109594 shutdown_connections 2023-07-05T18:56:14.681 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:14.678+0000 7fbd956b8700 1 --2- 172.21.15.46:0/2237109594 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7fbd7c06ace0 0x7fbd7c06d190 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:14.681 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:14.678+0000 7fbd956b8700 1 --2- 172.21.15.46:0/2237109594 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fbd9015c5e0 0x7fbd900c6c90 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:14.682 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:14.678+0000 7fbd956b8700 1 --2- 172.21.15.46:0/2237109594 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fbd900cd2e0 0x7fbd900c9230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:14.682 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:14.678+0000 7fbd956b8700 1 --2- 172.21.15.46:0/2237109594 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fbd900cf670 0x7fbd90149c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:14.682 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:14.678+0000 7fbd956b8700 1 -- 172.21.15.46:0/2237109594 >> 172.21.15.46:0/2237109594 conn(0x7fbd9006cb50 msgr2=0x7fbd900b3e50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-05T18:56:14.682 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:14.679+0000 7fbd956b8700 1 -- 172.21.15.46:0/2237109594 shutdown_connections 2023-07-05T18:56:14.685 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:14.679+0000 7fbd956b8700 1 -- 172.21.15.46:0/2237109594 wait complete. 2023-07-05T18:56:14.686 INFO:teuthology.orchestra.run.smithi046.stderr:pool 'cephfs_data' created 2023-07-05T18:56:14.705 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-07-05T18:56:14.846 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:14.838+0000 7fe59c2e6700 1 Processor -- start 2023-07-05T18:56:14.847 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:14.838+0000 7fe59c2e6700 1 -- start start 2023-07-05T18:56:14.847 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:14.839+0000 7fe59c2e6700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fe59415c860 0x7fe594160ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:56:14.847 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:14.839+0000 7fe59c2e6700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fe59406a510 0x7fe59406c1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:56:14.847 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:14.839+0000 7fe59c2e6700 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe5940ce640 con 0x7fe5940715c0 2023-07-05T18:56:14.847 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:14.839+0000 7fe59c2e6700 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe5941611e0 con 0x7fe59415c860 2023-07-05T18:56:14.847 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:14.839+0000 7fe59c2e6700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe5940ce870 con 0x7fe59406a510 2023-07-05T18:56:14.847 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:14.839+0000 7fe59a082700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fe59415c860 0x7fe594160ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:56:14.848 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:14.839+0000 7fe59a082700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fe59415c860 0x7fe594160ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:57634/0 (socket says 172.21.15.46:57634) 2023-07-05T18:56:14.848 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:14.839+0000 7fe59a082700 1 -- 172.21.15.46:0/1601378697 learned_addr learned my addr 172.21.15.46:0/1601378697 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-07-05T18:56:14.853 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:14.840+0000 7fe59a883700 1 --2- 172.21.15.46:0/1601378697 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fe59406a510 0x7fe59406c1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:56:14.853 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:14.840+0000 7fe59a082700 1 -- 172.21.15.46:0/1601378697 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fe59406a510 msgr2=0x7fe59406c1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-05T18:56:14.853 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:14.840+0000 7fe59a082700 1 --2- 172.21.15.46:0/1601378697 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fe59406a510 0x7fe59406c1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:14.854 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:14.840+0000 7fe59a082700 1 -- 172.21.15.46:0/1601378697 >> v1:172.21.15.73:6789/0 conn(0x7fe5940715c0 legacy=0x7fe594069e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:56:14.854 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:14.840+0000 7fe59a082700 1 -- 172.21.15.46:0/1601378697 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe5940ceb50 con 0x7fe59415c860 2023-07-05T18:56:14.854 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:14.840+0000 7fe59a883700 1 --2- 172.21.15.46:0/1601378697 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fe59406a510 0x7fe59406c1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-05T18:56:14.854 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:14.840+0000 7fe59a082700 1 --2- 172.21.15.46:0/1601378697 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe59415c860 0x7fe594160ca0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fe5840098f0 tx=0x7fe584009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a555c32a2dab9eec server_cookie=0 in_seq=0 out_seq=0 2023-07-05T18:56:14.855 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:14.840+0000 7fe599080700 1 -- 172.21.15.46:0/1601378697 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe58400b8a0 con 0x7fe59415c860 2023-07-05T18:56:14.855 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:14.840+0000 7fe599080700 1 -- 172.21.15.46:0/1601378697 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe58400ba00 con 0x7fe59415c860 2023-07-05T18:56:14.855 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:14.840+0000 7fe599080700 1 -- 172.21.15.46:0/1601378697 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe58400bd90 con 0x7fe59415c860 2023-07-05T18:56:14.855 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:14.841+0000 7fe59c2e6700 1 -- 172.21.15.46:0/1601378697 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe59415c860 msgr2=0x7fe594160ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:56:14.855 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:14.841+0000 7fe59c2e6700 1 --2- 172.21.15.46:0/1601378697 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe59415c860 0x7fe594160ca0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fe5840098f0 tx=0x7fe584009c00 comp rx=0 tx=0).stop 2023-07-05T18:56:14.856 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:14.841+0000 7fe59c2e6700 1 -- 172.21.15.46:0/1601378697 shutdown_connections 2023-07-05T18:56:14.856 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:14.841+0000 7fe59c2e6700 1 --2- 172.21.15.46:0/1601378697 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fe59406a510 0x7fe59406c1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:14.856 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:14.841+0000 7fe59c2e6700 1 --2- 172.21.15.46:0/1601378697 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe59415c860 0x7fe594160ca0 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:14.856 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:14.841+0000 7fe59c2e6700 1 -- 172.21.15.46:0/1601378697 >> 172.21.15.46:0/1601378697 conn(0x7fe59406bba0 msgr2=0x7fe5940cc3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-05T18:56:14.857 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:14.841+0000 7fe59c2e6700 1 -- 172.21.15.46:0/1601378697 shutdown_connections 2023-07-05T18:56:14.857 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:14.841+0000 7fe59c2e6700 1 -- 172.21.15.46:0/1601378697 wait complete. 2023-07-05T18:56:14.857 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:14.842+0000 7fe59c2e6700 1 Processor -- start 2023-07-05T18:56:14.857 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:14.842+0000 7fe59c2e6700 1 -- start start 2023-07-05T18:56:14.857 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:14.843+0000 7fe59c2e6700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe59406a510 0x7fe5940c63d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:56:14.857 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:14.843+0000 7fe59c2e6700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe5940715c0 0x7fe59414b970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:56:14.858 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:14.843+0000 7fe59c2e6700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fe59415c860 0x7fe5940adbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:56:14.858 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:14.843+0000 7fe59c2e6700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe59414beb0 con 0x7fe5940715c0 2023-07-05T18:56:14.858 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:14.843+0000 7fe59c2e6700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5941f5940 con 0x7fe59406a510 2023-07-05T18:56:14.858 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:14.843+0000 7fe59c2e6700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe59414c110 con 0x7fe59415c860 2023-07-05T18:56:14.859 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:14.843+0000 7fe599881700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe5940715c0 0x7fe59414b970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:56:14.860 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:14.843+0000 7fe599881700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe5940715c0 0x7fe59414b970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:57642/0 (socket says 172.21.15.46:57642) 2023-07-05T18:56:14.860 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:14.843+0000 7fe599881700 1 -- 172.21.15.46:0/77591868 learned_addr learned my addr 172.21.15.46:0/77591868 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-07-05T18:56:14.860 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:14.843+0000 7fe59a082700 1 --2- 172.21.15.46:0/77591868 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe59406a510 0x7fe5940c63d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:56:14.860 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:14.843+0000 7fe59a883700 1 --2- 172.21.15.46:0/77591868 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fe59415c860 0x7fe5940adbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:56:14.861 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:14.843+0000 7fe599881700 1 -- 172.21.15.46:0/77591868 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fe59415c860 msgr2=0x7fe5940adbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:56:14.861 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:14.843+0000 7fe599881700 1 --2- 172.21.15.46:0/77591868 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fe59415c860 0x7fe5940adbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:14.861 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:14.843+0000 7fe599881700 1 -- 172.21.15.46:0/77591868 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe59406a510 msgr2=0x7fe5940c63d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:56:14.862 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:14.843+0000 7fe599881700 1 --2- 172.21.15.46:0/77591868 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe59406a510 0x7fe5940c63d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:14.863 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:14.843+0000 7fe599881700 1 -- 172.21.15.46:0/77591868 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe584009550 con 0x7fe5940715c0 2023-07-05T18:56:14.863 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:14.843+0000 7fe599881700 1 --2- 172.21.15.46:0/77591868 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe5940715c0 0x7fe59414b970 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fe59000c4e0 tx=0x7fe59000c7f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-05T18:56:14.863 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:14.843+0000 7fe58affd700 1 -- 172.21.15.46:0/77591868 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5900052d0 con 0x7fe5940715c0 2023-07-05T18:56:14.863 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:14.843+0000 7fe58affd700 1 -- 172.21.15.46:0/77591868 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe590005430 con 0x7fe5940715c0 2023-07-05T18:56:14.863 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:14.844+0000 7fe59c2e6700 1 -- 172.21.15.46:0/77591868 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe59414c3f0 con 0x7fe5940715c0 2023-07-05T18:56:14.863 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:14.844+0000 7fe58affd700 1 -- 172.21.15.46:0/77591868 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5900038c0 con 0x7fe5940715c0 2023-07-05T18:56:14.863 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:14.844+0000 7fe59c2e6700 1 -- 172.21.15.46:0/77591868 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe5940ae130 con 0x7fe5940715c0 2023-07-05T18:56:14.864 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:14.844+0000 7fe59c2e6700 1 -- 172.21.15.46:0/77591868 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe594067e40 con 0x7fe5940715c0 2023-07-05T18:56:14.865 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:14.845+0000 7fe58affd700 1 -- 172.21.15.46:0/77591868 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fe590003a20 con 0x7fe5940715c0 2023-07-05T18:56:14.865 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:14.845+0000 7fe58affd700 1 --2- 172.21.15.46:0/77591868 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7fe57806ace0 0x7fe57806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:56:14.865 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:14.845+0000 7fe58affd700 1 -- 172.21.15.46:0/77591868 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 5962+0+0 (secure 0 0 0) 0x7fe5900887c0 con 0x7fe5940715c0 2023-07-05T18:56:14.865 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:14.845+0000 7fe59a082700 1 --2- 172.21.15.46:0/77591868 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7fe57806ace0 0x7fe57806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:56:14.865 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:14.846+0000 7fe59a082700 1 --2- 172.21.15.46:0/77591868 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7fe57806ace0 0x7fe57806d190 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fe584014040 tx=0x7fe584008030 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-05T18:56:14.865 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:14.850+0000 7fe58affd700 1 -- 172.21.15.46:0/77591868 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fe5900538d0 con 0x7fe5940715c0 2023-07-05T18:56:15.094 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:15.092+0000 7fe59c2e6700 1 -- 172.21.15.46:0/77591868 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7fe5941f5b60 con 0x7fe5940715c0 2023-07-05T18:56:15.098 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:15.097+0000 7fe58affd700 1 -- 172.21.15.46:0/77591868 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 3 and data pool 4 v4) v1 ==== 172+0+0 (secure 0 0 0) 0x7fe5941f5b60 con 0x7fe5940715c0 2023-07-05T18:56:15.102 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:15.100+0000 7fe59c2e6700 1 -- 172.21.15.46:0/77591868 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7fe57806ace0 msgr2=0x7fe57806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:56:15.102 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:15.100+0000 7fe59c2e6700 1 --2- 172.21.15.46:0/77591868 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7fe57806ace0 0x7fe57806d190 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fe584014040 tx=0x7fe584008030 comp rx=0 tx=0).stop 2023-07-05T18:56:15.102 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:15.100+0000 7fe59c2e6700 1 -- 172.21.15.46:0/77591868 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe5940715c0 msgr2=0x7fe59414b970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:56:15.103 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:15.100+0000 7fe59c2e6700 1 --2- 172.21.15.46:0/77591868 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe5940715c0 0x7fe59414b970 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fe59000c4e0 tx=0x7fe59000c7f0 comp rx=0 tx=0).stop 2023-07-05T18:56:15.103 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:15.101+0000 7fe59c2e6700 1 -- 172.21.15.46:0/77591868 shutdown_connections 2023-07-05T18:56:15.103 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:15.101+0000 7fe59c2e6700 1 --2- 172.21.15.46:0/77591868 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7fe57806ace0 0x7fe57806d190 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:15.104 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:15.101+0000 7fe59c2e6700 1 --2- 172.21.15.46:0/77591868 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fe59415c860 0x7fe5940adbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:15.104 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:15.101+0000 7fe59c2e6700 1 --2- 172.21.15.46:0/77591868 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe59406a510 0x7fe5940c63d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:15.104 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:15.101+0000 7fe59c2e6700 1 --2- 172.21.15.46:0/77591868 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe5940715c0 0x7fe59414b970 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:15.105 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:15.101+0000 7fe59c2e6700 1 -- 172.21.15.46:0/77591868 >> 172.21.15.46:0/77591868 conn(0x7fe59406bba0 msgr2=0x7fe59415bde0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-05T18:56:15.105 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:15.101+0000 7fe59c2e6700 1 -- 172.21.15.46:0/77591868 shutdown_connections 2023-07-05T18:56:15.105 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:15.101+0000 7fe59c2e6700 1 -- 172.21.15.46:0/77591868 wait complete. 2023-07-05T18:56:15.112 INFO:teuthology.orchestra.run.smithi046.stderr:new fs with metadata pool 3 and data pool 4 2023-07-05T18:56:15.130 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-05T18:56:15.257 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:15.255+0000 7ff4d4901700 1 Processor -- start 2023-07-05T18:56:15.257 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:15.255+0000 7ff4d4901700 1 -- start start 2023-07-05T18:56:15.263 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:15.256+0000 7ff4d4901700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7ff4d00ae0d0 0x7ff4d00b07b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:56:15.263 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:15.256+0000 7ff4d4901700 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff4d00af280 con 0x7ff4d00af710 2023-07-05T18:56:15.263 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:15.256+0000 7ff4d4901700 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff4d015a910 con 0x7ff4d00ce700 2023-07-05T18:56:15.264 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:15.256+0000 7ff4d4901700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff4d00ae670 con 0x7ff4d00ae0d0 2023-07-05T18:56:15.264 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:15.256+0000 7ff4cdd9b700 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7ff4d00af710 0x7ff4d00b00a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:56920/0 (socket says 172.21.15.46:56920) 2023-07-05T18:56:15.264 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:15.256+0000 7ff4cdd9b700 1 -- 172.21.15.46:0/2302790065 learned_addr learned my addr 172.21.15.46:0/2302790065 (peer_addr_for_me v1:172.21.15.46:0/0) 2023-07-05T18:56:15.264 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:15.256+0000 7ff4ced9d700 1 --2- 172.21.15.46:0/2302790065 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7ff4d00ae0d0 0x7ff4d00b07b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:56:15.264 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:15.256+0000 7ff4cd59a700 1 -- 172.21.15.46:0/2302790065 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3570104324 0 0) 0x7ff4d00af280 con 0x7ff4d00af710 2023-07-05T18:56:15.265 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:15.256+0000 7ff4cd59a700 1 -- 172.21.15.46:0/2302790065 --> v1:172.21.15.46:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff4b80035b0 con 0x7ff4d00af710 2023-07-05T18:56:15.265 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:15.256+0000 7ff4cd59a700 1 -- 172.21.15.46:0/2302790065 <== mon.0 v1:172.21.15.46:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2948568843 0 0) 0x7ff4b80035b0 con 0x7ff4d00af710 2023-07-05T18:56:15.265 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:15.256+0000 7ff4cd59a700 1 -- 172.21.15.46:0/2302790065 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7ff4d00ae0d0 msgr2=0x7ff4d00b07b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-05T18:56:15.265 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:15.256+0000 7ff4cd59a700 1 --2- 172.21.15.46:0/2302790065 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7ff4d00ae0d0 0x7ff4d00b07b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:15.265 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:15.256+0000 7ff4cd59a700 1 -- 172.21.15.46:0/2302790065 >> v1:172.21.15.73:6789/0 conn(0x7ff4d00ce700 legacy=0x7ff4d00cead0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:56:15.266 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:15.256+0000 7ff4cd59a700 1 -- 172.21.15.46:0/2302790065 --> v1:172.21.15.46:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff4d00ae950 con 0x7ff4d00af710 2023-07-05T18:56:15.266 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:15.256+0000 7ff4cd59a700 1 -- 172.21.15.46:0/2302790065 <== mon.0 v1:172.21.15.46:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2195585215 0 0) 0x7ff4c4001670 con 0x7ff4d00af710 2023-07-05T18:56:15.266 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:15.257+0000 7ff4cd59a700 1 -- 172.21.15.46:0/2302790065 >> v1:172.21.15.46:6789/0 conn(0x7ff4d00af710 legacy=0x7ff4d00b00a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:56:15.266 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:15.257+0000 7ff4cd59a700 1 --2- 172.21.15.46:0/2302790065 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7ff4d00ae0d0 0x7ff4b8003a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:56:15.266 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:15.257+0000 7ff4cd59a700 1 --2- 172.21.15.46:0/2302790065 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff4b8003f70 0x7ff4b8004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:56:15.266 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:15.257+0000 7ff4cd59a700 1 --2- 172.21.15.46:0/2302790065 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff4b8004d90 0x7ff4b8005200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:56:15.267 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:15.257+0000 7ff4cd59a700 1 -- 172.21.15.46:0/2302790065 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4d00ae670 con 0x7ff4b8004d90 2023-07-05T18:56:15.267 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:15.257+0000 7ff4cd59a700 1 -- 172.21.15.46:0/2302790065 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4b800ba40 con 0x7ff4b8003f70 2023-07-05T18:56:15.267 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:15.257+0000 7ff4cd59a700 1 -- 172.21.15.46:0/2302790065 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff4b800bc00 con 0x7ff4d00ae0d0 2023-07-05T18:56:15.267 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:15.257+0000 7ff4ced9d700 1 --2- 172.21.15.46:0/2302790065 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff4b8004d90 0x7ff4b8005200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:56:15.267 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:15.257+0000 7ff4cdd9b700 1 --2- 172.21.15.46:0/2302790065 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff4b8003f70 0x7ff4b8004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:56:15.268 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:15.257+0000 7ff4ce59c700 1 --2- 172.21.15.46:0/2302790065 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7ff4d00ae0d0 0x7ff4b8003a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:56:15.268 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:15.257+0000 7ff4ced9d700 1 -- 172.21.15.46:0/2302790065 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7ff4d00ae0d0 msgr2=0x7ff4b8003a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-05T18:56:15.268 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:15.257+0000 7ff4ced9d700 1 --2- 172.21.15.46:0/2302790065 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7ff4d00ae0d0 0x7ff4b8003a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:15.268 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:15.257+0000 7ff4ced9d700 1 -- 172.21.15.46:0/2302790065 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff4b8003f70 msgr2=0x7ff4b8004850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-05T18:56:15.270 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:15.257+0000 7ff4ced9d700 1 --2- 172.21.15.46:0/2302790065 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff4b8003f70 0x7ff4b8004850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:15.270 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:15.257+0000 7ff4ced9d700 1 -- 172.21.15.46:0/2302790065 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff4b80035b0 con 0x7ff4b8004d90 2023-07-05T18:56:15.271 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:15.257+0000 7ff4ced9d700 1 --2- 172.21.15.46:0/2302790065 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff4b8004d90 0x7ff4b8005200 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7ff4c8009fc0 tx=0x7ff4b8005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ce604946ed59f4f server_cookie=0 in_seq=0 out_seq=0 2023-07-05T18:56:15.271 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:15.257+0000 7ff4cd59a700 1 -- 172.21.15.46:0/2302790065 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4c800ec30 con 0x7ff4b8004d90 2023-07-05T18:56:15.271 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:15.257+0000 7ff4cd59a700 1 -- 172.21.15.46:0/2302790065 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff4c800f040 con 0x7ff4b8004d90 2023-07-05T18:56:15.271 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:15.257+0000 7ff4cd59a700 1 -- 172.21.15.46:0/2302790065 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4c8014480 con 0x7ff4b8004d90 2023-07-05T18:56:15.271 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:15.258+0000 7ff4d4901700 1 -- 172.21.15.46:0/2302790065 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff4b8004d90 msgr2=0x7ff4b8005200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:56:15.271 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:15.258+0000 7ff4d4901700 1 --2- 172.21.15.46:0/2302790065 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff4b8004d90 0x7ff4b8005200 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7ff4c8009fc0 tx=0x7ff4b8005880 comp rx=0 tx=0).stop 2023-07-05T18:56:15.272 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:15.258+0000 7ff4ced9d700 1 -- 172.21.15.46:0/2302790065 reap_dead start 2023-07-05T18:56:15.272 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:15.258+0000 7ff4d4901700 1 -- 172.21.15.46:0/2302790065 shutdown_connections 2023-07-05T18:56:15.272 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:15.258+0000 7ff4d4901700 1 -- 172.21.15.46:0/2302790065 >> 172.21.15.46:0/2302790065 conn(0x7ff4d0099e00 msgr2=0x7ff4d00d0b30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-05T18:56:15.272 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:15.258+0000 7ff4d4901700 1 -- 172.21.15.46:0/2302790065 shutdown_connections 2023-07-05T18:56:15.273 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:15.258+0000 7ff4d4901700 1 -- 172.21.15.46:0/2302790065 wait complete. 2023-07-05T18:56:15.273 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:15.259+0000 7ff4d4901700 1 Processor -- start 2023-07-05T18:56:15.273 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:15.259+0000 7ff4d4901700 1 -- start start 2023-07-05T18:56:15.273 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:15.260+0000 7ff4d4901700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff4b8004d90 0x7ff4d00c7500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:56:15.273 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:15.260+0000 7ff4d4901700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff4d01ef8c0 0x7ff4d00c5340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:56:15.273 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:15.260+0000 7ff4d4901700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7ff4d0157250 0x7ff4d01576c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:56:15.274 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:15.260+0000 7ff4d4901700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4d0157c00 con 0x7ff4b8004d90 2023-07-05T18:56:15.274 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:15.260+0000 7ff4d4901700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4d01542c0 con 0x7ff4d01ef8c0 2023-07-05T18:56:15.274 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:15.260+0000 7ff4d4901700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff4d00c5880 con 0x7ff4d0157250 2023-07-05T18:56:15.274 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:15.260+0000 7ff4ce59c700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff4b8004d90 0x7ff4d00c7500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:56:15.275 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:15.260+0000 7ff4ce59c700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff4b8004d90 0x7ff4d00c7500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:57660/0 (socket says 172.21.15.46:57660) 2023-07-05T18:56:15.275 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:15.260+0000 7ff4ce59c700 1 -- 172.21.15.46:0/3222590985 learned_addr learned my addr 172.21.15.46:0/3222590985 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-07-05T18:56:15.275 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:15.260+0000 7ff4cdd9b700 1 --2- 172.21.15.46:0/3222590985 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff4d01ef8c0 0x7ff4d00c5340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:56:15.275 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:15.260+0000 7ff4ced9d700 1 --2- 172.21.15.46:0/3222590985 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7ff4d0157250 0x7ff4d01576c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:56:15.275 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:15.260+0000 7ff4ce59c700 1 -- 172.21.15.46:0/3222590985 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7ff4d0157250 msgr2=0x7ff4d01576c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:56:15.275 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:15.260+0000 7ff4ce59c700 1 --2- 172.21.15.46:0/3222590985 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7ff4d0157250 0x7ff4d01576c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:15.276 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:15.260+0000 7ff4ce59c700 1 -- 172.21.15.46:0/3222590985 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff4d01ef8c0 msgr2=0x7ff4d00c5340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:56:15.276 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:15.260+0000 7ff4ce59c700 1 --2- 172.21.15.46:0/3222590985 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff4d01ef8c0 0x7ff4d00c5340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:15.276 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:15.260+0000 7ff4ce59c700 1 -- 172.21.15.46:0/3222590985 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff4d01efd30 con 0x7ff4b8004d90 2023-07-05T18:56:15.276 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:15.260+0000 7ff4cdd9b700 1 --2- 172.21.15.46:0/3222590985 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff4d01ef8c0 0x7ff4d00c5340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-05T18:56:15.276 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:15.260+0000 7ff4ce59c700 1 --2- 172.21.15.46:0/3222590985 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff4b8004d90 0x7ff4d00c7500 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7ff4c000f850 tx=0x7ff4c000fc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-05T18:56:15.277 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:15.261+0000 7ff4beffd700 1 -- 172.21.15.46:0/3222590985 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4c000fe50 con 0x7ff4b8004d90 2023-07-05T18:56:15.277 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:15.261+0000 7ff4beffd700 1 -- 172.21.15.46:0/3222590985 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff4c00052e0 con 0x7ff4b8004d90 2023-07-05T18:56:15.277 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:15.261+0000 7ff4d4901700 1 -- 172.21.15.46:0/3222590985 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff4d00c6350 con 0x7ff4b8004d90 2023-07-05T18:56:15.277 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:15.261+0000 7ff4beffd700 1 -- 172.21.15.46:0/3222590985 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4c0003680 con 0x7ff4b8004d90 2023-07-05T18:56:15.280 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:15.261+0000 7ff4d4901700 1 -- 172.21.15.46:0/3222590985 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff4d00c5ab0 con 0x7ff4b8004d90 2023-07-05T18:56:15.280 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:15.262+0000 7ff4d4901700 1 -- 172.21.15.46:0/3222590985 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff4d01546d0 con 0x7ff4b8004d90 2023-07-05T18:56:15.281 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:15.262+0000 7ff4beffd700 1 -- 172.21.15.46:0/3222590985 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7ff4c00037e0 con 0x7ff4b8004d90 2023-07-05T18:56:15.281 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:15.263+0000 7ff4beffd700 1 --2- 172.21.15.46:0/3222590985 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7ff4b006ace0 0x7ff4b006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:56:15.281 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:15.263+0000 7ff4beffd700 1 -- 172.21.15.46:0/3222590985 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 6062+0+0 (secure 0 0 0) 0x7ff4c0089300 con 0x7ff4b8004d90 2023-07-05T18:56:15.281 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:15.263+0000 7ff4cdd9b700 1 --2- 172.21.15.46:0/3222590985 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7ff4b006ace0 0x7ff4b006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:56:15.281 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:15.263+0000 7ff4cdd9b700 1 --2- 172.21.15.46:0/3222590985 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7ff4b006ace0 0x7ff4b006d190 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7ff4d00c4880 tx=0x7ff4c4009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-05T18:56:15.281 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:15.267+0000 7ff4beffd700 1 -- 172.21.15.46:0/3222590985 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7ff4c0057da0 con 0x7ff4b8004d90 2023-07-05T18:56:15.468 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:15.466+0000 7ff4d4901700 1 -- 172.21.15.46:0/3222590985 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ff4d01efd10 con 0x7ff4b8004d90 2023-07-05T18:56:15.469 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:15.467+0000 7ff4beffd700 1 -- 172.21.15.46:0/3222590985 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+18174 (secure 0 0 0) 0x7ff4c0057930 con 0x7ff4b8004d90 2023-07-05T18:56:15.471 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T18:56:15.471 INFO:teuthology.orchestra.run.smithi046.stdout:{"epoch":20,"fsid":"042652d3-d80c-4ad8-9366-3e94f2a0a512","created":"2023-07-05T18:55:56.455710+0000","modified":"2023-07-05T18:56:15.093620+0000","last_up_change":"2023-07-05T18:56:06.594022+0000","last_in_change":"2023-07-05T18:55:58.879340+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-07-05T18:56:07.729620+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2023-07-05T18:56:08.128122+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-07-05T18:56:12.954625+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-07-05T18:56:14.068396+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"20009183-9a47-4392-8751-883f88d2bfb1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6813","nonce":4151971443},{"type":"v1","addr":"172.21.15.46:6815","nonce":4151971443}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6817","nonce":4151971443},{"type":"v1","addr":"172.21.15.46:6818","nonce":4151971443}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6822","nonce":4151971443},{"type":"v1","addr":"172.21.15.46:6823","nonce":4151971443}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6820","nonce":4151971443},{"type":"v1","addr":"172.21.15.46:6821","nonce":4151971443}]},"public_addr":"172.21.15.46:6815/4151971443","cluster_addr":"172.21.15.46:6818/4151971443","heartbeat_back_addr":"172.21.15.46:6823/4151971443","heartbeat_front_addr":"172.21.15.46:6821/4151971443","state":["exists","up"]},{"osd":1,"uuid":"91b4a7b0-e4e4-4888-a1fe-9edb0d68004c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6808","nonce":502575881},{"type":"v1","addr":"172.21.15.46:6809","nonce":502575881}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6810","nonce":502575881},{"type":"v1","addr":"172.21.15.46:6811","nonce":502575881}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6816","nonce":502575881},{"type":"v1","addr":"172.21.15.46:6819","nonce":502575881}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6812","nonce":502575881},{"type":"v1","addr":"172.21.15.46:6814","nonce":502575881}]},"public_addr":"172.21.15.46:6809/502575881","cluster_addr":"172.21.15.46:6811/502575881","heartbeat_back_addr":"172.21.15.46:6819/502575881","heartbeat_front_addr":"172.21.15.46:6814/502575881","state":["exists","up"]},{"osd":2,"uuid":"669ff744-1331-47c5-8579-0440731c889a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6800","nonce":2115251461},{"type":"v1","addr":"172.21.15.46:6801","nonce":2115251461}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6802","nonce":2115251461},{"type":"v1","addr":"172.21.15.46:6803","nonce":2115251461}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6806","nonce":2115251461},{"type":"v1","addr":"172.21.15.46:6807","nonce":2115251461}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6804","nonce":2115251461},{"type":"v1","addr":"172.21.15.46:6805","nonce":2115251461}]},"public_addr":"172.21.15.46:6801/2115251461","cluster_addr":"172.21.15.46:6803/2115251461","heartbeat_back_addr":"172.21.15.46:6807/2115251461","heartbeat_front_addr":"172.21.15.46:6805/2115251461","state":["exists","up"]},{"osd":3,"uuid":"34e1b86d-ffad-415d-861c-07a5f08068a6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6824","nonce":2981388766},{"type":"v1","addr":"172.21.15.46:6825","nonce":2981388766}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6826","nonce":2981388766},{"type":"v1","addr":"172.21.15.46:6827","nonce":2981388766}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6830","nonce":2981388766},{"type":"v1","addr":"172.21.15.46:6831","nonce":2981388766}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6828","nonce":2981388766},{"type":"v1","addr":"172.21.15.46:6829","nonce":2981388766}]},"public_addr":"172.21.15.46:6825/2981388766","cluster_addr":"172.21.15.46:6827/2981388766","heartbeat_back_addr":"172.21.15.46:6831/2981388766","heartbeat_front_addr":"172.21.15.46:6829/2981388766","state":["exists","up"]},{"osd":4,"uuid":"57ffcb91-c7dc-4a69-ae71-4d9622a14a05","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6800","nonce":2083655348},{"type":"v1","addr":"172.21.15.73:6801","nonce":2083655348}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6802","nonce":2083655348},{"type":"v1","addr":"172.21.15.73:6803","nonce":2083655348}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6806","nonce":2083655348},{"type":"v1","addr":"172.21.15.73:6807","nonce":2083655348}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6804","nonce":2083655348},{"type":"v1","addr":"172.21.15.73:6805","nonce":2083655348}]},"public_addr":"172.21.15.73:6801/2083655348","cluster_addr":"172.21.15.73:6803/2083655348","heartbeat_back_addr":"172.21.15.73:6807/2083655348","heartbeat_front_addr":"172.21.15.73:6805/2083655348","state":["exists","up"]},{"osd":5,"uuid":"665f41c9-ee20-49cf-bf0e-fbe0c03d3aed","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6824","nonce":2803788401},{"type":"v1","addr":"172.21.15.73:6825","nonce":2803788401}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6826","nonce":2803788401},{"type":"v1","addr":"172.21.15.73:6827","nonce":2803788401}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6830","nonce":2803788401},{"type":"v1","addr":"172.21.15.73:6831","nonce":2803788401}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6828","nonce":2803788401},{"type":"v1","addr":"172.21.15.73:6829","nonce":2803788401}]},"public_addr":"172.21.15.73:6825/2803788401","cluster_addr":"172.21.15.73:6827/2803788401","heartbeat_back_addr":"172.21.15.73:6831/2803788401","heartbeat_front_addr":"172.21.15.73:6829/2803788401","state":["exists","up"]},{"osd":6,"uuid":"5790c6cc-bd56-4ce4-9a7c-0f0c3b59215c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6808","nonce":974108383},{"type":"v1","addr":"172.21.15.73:6809","nonce":974108383}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6810","nonce":974108383},{"type":"v1","addr":"172.21.15.73:6811","nonce":974108383}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6815","nonce":974108383},{"type":"v1","addr":"172.21.15.73:6817","nonce":974108383}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6812","nonce":974108383},{"type":"v1","addr":"172.21.15.73:6813","nonce":974108383}]},"public_addr":"172.21.15.73:6809/974108383","cluster_addr":"172.21.15.73:6811/974108383","heartbeat_back_addr":"172.21.15.73:6817/974108383","heartbeat_front_addr":"172.21.15.73:6813/974108383","state":["exists","up"]},{"osd":7,"uuid":"b66f4d2e-147e-4c9b-97dd-cbd59d33802e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6814","nonce":3772673248},{"type":"v1","addr":"172.21.15.73:6816","nonce":3772673248}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6818","nonce":3772673248},{"type":"v1","addr":"172.21.15.73:6819","nonce":3772673248}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6822","nonce":3772673248},{"type":"v1","addr":"172.21.15.73:6823","nonce":3772673248}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6820","nonce":3772673248},{"type":"v1","addr":"172.21.15.73:6821","nonce":3772673248}]},"public_addr":"172.21.15.73:6816/3772673248","cluster_addr":"172.21.15.73:6819/3772673248","heartbeat_back_addr":"172.21.15.73:6823/3772673248","heartbeat_front_addr":"172.21.15.73:6821/3772673248","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-05T18:56:04.115334+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-05T18:56:04.071250+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-05T18:56:04.044387+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-05T18:56:04.085389+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-05T18:56:04.090726+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-05T18:56:04.074529+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-05T18:56:04.058841+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-05T18:56:04.043054+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-05T18:56:15.472 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:15.469+0000 7ff4d4901700 1 -- 172.21.15.46:0/3222590985 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7ff4b006ace0 msgr2=0x7ff4b006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:56:15.472 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:15.469+0000 7ff4d4901700 1 --2- 172.21.15.46:0/3222590985 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7ff4b006ace0 0x7ff4b006d190 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7ff4d00c4880 tx=0x7ff4c4009040 comp rx=0 tx=0).stop 2023-07-05T18:56:15.472 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:15.469+0000 7ff4d4901700 1 -- 172.21.15.46:0/3222590985 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff4b8004d90 msgr2=0x7ff4d00c7500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:56:15.473 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:15.469+0000 7ff4d4901700 1 --2- 172.21.15.46:0/3222590985 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff4b8004d90 0x7ff4d00c7500 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7ff4c000f850 tx=0x7ff4c000fc10 comp rx=0 tx=0).stop 2023-07-05T18:56:15.473 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:15.469+0000 7ff4d4901700 1 -- 172.21.15.46:0/3222590985 shutdown_connections 2023-07-05T18:56:15.473 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:15.469+0000 7ff4d4901700 1 --2- 172.21.15.46:0/3222590985 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7ff4b006ace0 0x7ff4b006d190 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:15.473 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:15.469+0000 7ff4d4901700 1 --2- 172.21.15.46:0/3222590985 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7ff4d0157250 0x7ff4d01576c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:15.473 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:15.469+0000 7ff4d4901700 1 --2- 172.21.15.46:0/3222590985 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff4b8004d90 0x7ff4d00c7500 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:15.473 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:15.469+0000 7ff4d4901700 1 --2- 172.21.15.46:0/3222590985 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff4d01ef8c0 0x7ff4d00c5340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:15.473 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:15.469+0000 7ff4d4901700 1 -- 172.21.15.46:0/3222590985 >> 172.21.15.46:0/3222590985 conn(0x7ff4d0099e00 msgr2=0x7ff4d00b0060 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-05T18:56:15.474 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:15.469+0000 7ff4d4901700 1 -- 172.21.15.46:0/3222590985 shutdown_connections 2023-07-05T18:56:15.474 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:15.469+0000 7ff4d4901700 1 -- 172.21.15.46:0/3222590985 wait complete. 2023-07-05T18:56:15.483 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-05T18:56:15.610 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:15.606+0000 7f57971f5700 1 Processor -- start 2023-07-05T18:56:15.610 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:15.606+0000 7f57971f5700 1 -- start start 2023-07-05T18:56:15.610 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:15.607+0000 7f57971f5700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f57900cd2e0 0x7f57900d1450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:56:15.610 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:15.607+0000 7f57971f5700 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f57900cd8c0 con 0x7f579015c6c0 2023-07-05T18:56:15.610 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:15.607+0000 7f57971f5700 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f57900d0990 con 0x7f579015c2f0 2023-07-05T18:56:15.611 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:15.607+0000 7f57971f5700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f57900d0c70 con 0x7f57900cd2e0 2023-07-05T18:56:15.611 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:15.607+0000 7f578ffff700 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7f579015c6c0 0x7f57900b5ae0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:56940/0 (socket says 172.21.15.46:56940) 2023-07-05T18:56:15.611 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:15.607+0000 7f578ffff700 1 -- 172.21.15.46:0/1636488538 learned_addr learned my addr 172.21.15.46:0/1636488538 (peer_addr_for_me v1:172.21.15.46:0/0) 2023-07-05T18:56:15.611 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:15.607+0000 7f5795792700 1 --2- 172.21.15.46:0/1636488538 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f57900cd2e0 0x7f57900d1450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:56:15.611 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:15.607+0000 7f578f7fe700 1 -- 172.21.15.46:0/1636488538 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3138156958 0 0) 0x7f57900cd8c0 con 0x7f579015c6c0 2023-07-05T18:56:15.611 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:15.607+0000 7f578f7fe700 1 -- 172.21.15.46:0/1636488538 --> v1:172.21.15.46:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f57800035b0 con 0x7f579015c6c0 2023-07-05T18:56:15.611 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:15.607+0000 7f578f7fe700 1 -- 172.21.15.46:0/1636488538 <== mon.1 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 5017235 0 0) 0x7f57900d0990 con 0x7f579015c2f0 2023-07-05T18:56:15.611 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:15.608+0000 7f578f7fe700 1 -- 172.21.15.46:0/1636488538 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f57900cd8c0 con 0x7f579015c2f0 2023-07-05T18:56:15.612 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:15.608+0000 7f5795792700 1 -- 172.21.15.46:0/1636488538 >> v1:172.21.15.73:6789/0 conn(0x7f579015c2f0 legacy=0x7f579006c760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:56:15.612 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:15.608+0000 7f5795792700 1 -- 172.21.15.46:0/1636488538 >> v1:172.21.15.46:6789/0 conn(0x7f579015c6c0 legacy=0x7f57900b5ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:56:15.612 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:15.608+0000 7f5795792700 1 -- 172.21.15.46:0/1636488538 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f57900d0f50 con 0x7f57900cd2e0 2023-07-05T18:56:15.613 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:15.608+0000 7f5795792700 1 --2- 172.21.15.46:0/1636488538 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f57900cd2e0 0x7f57900d1450 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f5788009dc0 tx=0x7f578800b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9f6b0ee9dd967cb5 server_cookie=0 in_seq=0 out_seq=0 2023-07-05T18:56:15.613 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:15.608+0000 7f578f7fe700 1 -- 172.21.15.46:0/1636488538 <== mon.2 v2:172.21.15.73:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f578800e070 con 0x7f57900cd2e0 2023-07-05T18:56:15.613 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:15.608+0000 7f578f7fe700 1 -- 172.21.15.46:0/1636488538 <== mon.2 v2:172.21.15.73:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f578800bb20 con 0x7f57900cd2e0 2023-07-05T18:56:15.614 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:15.608+0000 7f578f7fe700 1 -- 172.21.15.46:0/1636488538 <== mon.2 v2:172.21.15.73:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5788012430 con 0x7f57900cd2e0 2023-07-05T18:56:15.619 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:15.608+0000 7f57971f5700 1 -- 172.21.15.46:0/1636488538 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f57900cd2e0 msgr2=0x7f57900d1450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:56:15.620 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:15.608+0000 7f57971f5700 1 --2- 172.21.15.46:0/1636488538 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f57900cd2e0 0x7f57900d1450 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f5788009dc0 tx=0x7f578800b330 comp rx=0 tx=0).stop 2023-07-05T18:56:15.620 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:15.609+0000 7f57971f5700 1 -- 172.21.15.46:0/1636488538 shutdown_connections 2023-07-05T18:56:15.621 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:15.609+0000 7f57971f5700 1 --2- 172.21.15.46:0/1636488538 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f57900cd2e0 0x7f57900d1450 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:15.621 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:15.609+0000 7f57971f5700 1 -- 172.21.15.46:0/1636488538 >> 172.21.15.46:0/1636488538 conn(0x7f579006afa0 msgr2=0x7f57900cf710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-05T18:56:15.621 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:15.609+0000 7f57971f5700 1 -- 172.21.15.46:0/1636488538 shutdown_connections 2023-07-05T18:56:15.621 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:15.609+0000 7f57971f5700 1 -- 172.21.15.46:0/1636488538 wait complete. 2023-07-05T18:56:15.622 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:15.610+0000 7f57971f5700 1 Processor -- start 2023-07-05T18:56:15.622 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:15.610+0000 7f57971f5700 1 -- start start 2023-07-05T18:56:15.622 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:15.611+0000 7f57971f5700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f57900cd2e0 0x7f57900cb830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:56:15.623 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:15.611+0000 7f57971f5700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f579015c2f0 0x7f5790149000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:56:15.623 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:15.611+0000 7f57971f5700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f579015c6c0 0x7f5790153ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:56:15.623 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:15.611+0000 7f57971f5700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57900cc320 con 0x7f579015c2f0 2023-07-05T18:56:15.623 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:15.611+0000 7f57971f5700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57900c6f40 con 0x7f57900cd2e0 2023-07-05T18:56:15.624 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:15.611+0000 7f57971f5700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f57900cbd70 con 0x7f579015c6c0 2023-07-05T18:56:15.624 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:15.611+0000 7f578ffff700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f579015c2f0 0x7f5790149000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:56:15.624 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:15.611+0000 7f578ffff700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f579015c2f0 0x7f5790149000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:57672/0 (socket says 172.21.15.46:57672) 2023-07-05T18:56:15.625 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:15.611+0000 7f578ffff700 1 -- 172.21.15.46:0/3629009102 learned_addr learned my addr 172.21.15.46:0/3629009102 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-07-05T18:56:15.625 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:15.611+0000 7f5795792700 1 --2- 172.21.15.46:0/3629009102 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f579015c6c0 0x7f5790153ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:56:15.625 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:15.611+0000 7f5794f91700 1 --2- 172.21.15.46:0/3629009102 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f57900cd2e0 0x7f57900cb830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:56:15.625 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:15.611+0000 7f578ffff700 1 -- 172.21.15.46:0/3629009102 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f579015c6c0 msgr2=0x7f5790153ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:56:15.626 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:15.611+0000 7f578ffff700 1 --2- 172.21.15.46:0/3629009102 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f579015c6c0 0x7f5790153ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:15.626 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:15.611+0000 7f578ffff700 1 -- 172.21.15.46:0/3629009102 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f57900cd2e0 msgr2=0x7f57900cb830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:56:15.626 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:15.611+0000 7f578ffff700 1 --2- 172.21.15.46:0/3629009102 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f57900cd2e0 0x7f57900cb830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:15.626 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:15.611+0000 7f578ffff700 1 -- 172.21.15.46:0/3629009102 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5788009a70 con 0x7f579015c2f0 2023-07-05T18:56:15.627 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:15.611+0000 7f5794f91700 1 --2- 172.21.15.46:0/3629009102 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f57900cd2e0 0x7f57900cb830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-05T18:56:15.627 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:15.611+0000 7f5795792700 1 --2- 172.21.15.46:0/3629009102 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f579015c6c0 0x7f5790153ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-05T18:56:15.627 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:15.611+0000 7f578ffff700 1 --2- 172.21.15.46:0/3629009102 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f579015c2f0 0x7f5790149000 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f577c001eb0 tx=0x7f577c00c860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-05T18:56:15.628 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:15.611+0000 7f578d7fa700 1 -- 172.21.15.46:0/3629009102 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f577c005d70 con 0x7f579015c2f0 2023-07-05T18:56:15.628 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:15.611+0000 7f578d7fa700 1 -- 172.21.15.46:0/3629009102 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f577c0070d0 con 0x7f579015c2f0 2023-07-05T18:56:15.628 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:15.611+0000 7f57971f5700 1 -- 172.21.15.46:0/3629009102 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f57900cc040 con 0x7f579015c2f0 2023-07-05T18:56:15.628 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:15.611+0000 7f578d7fa700 1 -- 172.21.15.46:0/3629009102 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f577c007460 con 0x7f579015c2f0 2023-07-05T18:56:15.628 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:15.612+0000 7f57971f5700 1 -- 172.21.15.46:0/3629009102 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f57900c6bd0 con 0x7f579015c2f0 2023-07-05T18:56:15.629 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:15.613+0000 7f578d7fa700 1 -- 172.21.15.46:0/3629009102 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f577c0075c0 con 0x7f579015c2f0 2023-07-05T18:56:15.629 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:15.613+0000 7f57971f5700 1 -- 172.21.15.46:0/3629009102 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f579004e1d0 con 0x7f579015c2f0 2023-07-05T18:56:15.629 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:15.613+0000 7f578d7fa700 1 --2- 172.21.15.46:0/3629009102 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7f577406ace0 0x7f577406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:56:15.629 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:15.613+0000 7f578d7fa700 1 -- 172.21.15.46:0/3629009102 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f577c088940 con 0x7f579015c2f0 2023-07-05T18:56:15.629 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:15.613+0000 7f5794f91700 1 --2- 172.21.15.46:0/3629009102 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7f577406ace0 0x7f577406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:56:15.629 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:15.614+0000 7f5794f91700 1 --2- 172.21.15.46:0/3629009102 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7f577406ace0 0x7f577406d190 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f57840011e0 tx=0x7f5784009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-05T18:56:15.630 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:15.618+0000 7f578d7fa700 1 -- 172.21.15.46:0/3629009102 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f577c053a80 con 0x7f579015c2f0 2023-07-05T18:56:15.823 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:15.818+0000 7f57971f5700 1 -- 172.21.15.46:0/3629009102 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f57900c7080 con 0x7f579015c2f0 2023-07-05T18:56:15.824 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:15.819+0000 7f578d7fa700 1 -- 172.21.15.46:0/3629009102 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+18174 (secure 0 0 0) 0x7f577c0570a0 con 0x7f579015c2f0 2023-07-05T18:56:15.825 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T18:56:15.825 INFO:teuthology.orchestra.run.smithi046.stdout:{"epoch":20,"fsid":"042652d3-d80c-4ad8-9366-3e94f2a0a512","created":"2023-07-05T18:55:56.455710+0000","modified":"2023-07-05T18:56:15.093620+0000","last_up_change":"2023-07-05T18:56:06.594022+0000","last_in_change":"2023-07-05T18:55:58.879340+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-07-05T18:56:07.729620+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2023-07-05T18:56:08.128122+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-07-05T18:56:12.954625+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-07-05T18:56:14.068396+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"20009183-9a47-4392-8751-883f88d2bfb1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6813","nonce":4151971443},{"type":"v1","addr":"172.21.15.46:6815","nonce":4151971443}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6817","nonce":4151971443},{"type":"v1","addr":"172.21.15.46:6818","nonce":4151971443}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6822","nonce":4151971443},{"type":"v1","addr":"172.21.15.46:6823","nonce":4151971443}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6820","nonce":4151971443},{"type":"v1","addr":"172.21.15.46:6821","nonce":4151971443}]},"public_addr":"172.21.15.46:6815/4151971443","cluster_addr":"172.21.15.46:6818/4151971443","heartbeat_back_addr":"172.21.15.46:6823/4151971443","heartbeat_front_addr":"172.21.15.46:6821/4151971443","state":["exists","up"]},{"osd":1,"uuid":"91b4a7b0-e4e4-4888-a1fe-9edb0d68004c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6808","nonce":502575881},{"type":"v1","addr":"172.21.15.46:6809","nonce":502575881}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6810","nonce":502575881},{"type":"v1","addr":"172.21.15.46:6811","nonce":502575881}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6816","nonce":502575881},{"type":"v1","addr":"172.21.15.46:6819","nonce":502575881}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6812","nonce":502575881},{"type":"v1","addr":"172.21.15.46:6814","nonce":502575881}]},"public_addr":"172.21.15.46:6809/502575881","cluster_addr":"172.21.15.46:6811/502575881","heartbeat_back_addr":"172.21.15.46:6819/502575881","heartbeat_front_addr":"172.21.15.46:6814/502575881","state":["exists","up"]},{"osd":2,"uuid":"669ff744-1331-47c5-8579-0440731c889a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6800","nonce":2115251461},{"type":"v1","addr":"172.21.15.46:6801","nonce":2115251461}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6802","nonce":2115251461},{"type":"v1","addr":"172.21.15.46:6803","nonce":2115251461}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6806","nonce":2115251461},{"type":"v1","addr":"172.21.15.46:6807","nonce":2115251461}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6804","nonce":2115251461},{"type":"v1","addr":"172.21.15.46:6805","nonce":2115251461}]},"public_addr":"172.21.15.46:6801/2115251461","cluster_addr":"172.21.15.46:6803/2115251461","heartbeat_back_addr":"172.21.15.46:6807/2115251461","heartbeat_front_addr":"172.21.15.46:6805/2115251461","state":["exists","up"]},{"osd":3,"uuid":"34e1b86d-ffad-415d-861c-07a5f08068a6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6824","nonce":2981388766},{"type":"v1","addr":"172.21.15.46:6825","nonce":2981388766}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6826","nonce":2981388766},{"type":"v1","addr":"172.21.15.46:6827","nonce":2981388766}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6830","nonce":2981388766},{"type":"v1","addr":"172.21.15.46:6831","nonce":2981388766}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6828","nonce":2981388766},{"type":"v1","addr":"172.21.15.46:6829","nonce":2981388766}]},"public_addr":"172.21.15.46:6825/2981388766","cluster_addr":"172.21.15.46:6827/2981388766","heartbeat_back_addr":"172.21.15.46:6831/2981388766","heartbeat_front_addr":"172.21.15.46:6829/2981388766","state":["exists","up"]},{"osd":4,"uuid":"57ffcb91-c7dc-4a69-ae71-4d9622a14a05","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6800","nonce":2083655348},{"type":"v1","addr":"172.21.15.73:6801","nonce":2083655348}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6802","nonce":2083655348},{"type":"v1","addr":"172.21.15.73:6803","nonce":2083655348}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6806","nonce":2083655348},{"type":"v1","addr":"172.21.15.73:6807","nonce":2083655348}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6804","nonce":2083655348},{"type":"v1","addr":"172.21.15.73:6805","nonce":2083655348}]},"public_addr":"172.21.15.73:6801/2083655348","cluster_addr":"172.21.15.73:6803/2083655348","heartbeat_back_addr":"172.21.15.73:6807/2083655348","heartbeat_front_addr":"172.21.15.73:6805/2083655348","state":["exists","up"]},{"osd":5,"uuid":"665f41c9-ee20-49cf-bf0e-fbe0c03d3aed","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6824","nonce":2803788401},{"type":"v1","addr":"172.21.15.73:6825","nonce":2803788401}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6826","nonce":2803788401},{"type":"v1","addr":"172.21.15.73:6827","nonce":2803788401}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6830","nonce":2803788401},{"type":"v1","addr":"172.21.15.73:6831","nonce":2803788401}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6828","nonce":2803788401},{"type":"v1","addr":"172.21.15.73:6829","nonce":2803788401}]},"public_addr":"172.21.15.73:6825/2803788401","cluster_addr":"172.21.15.73:6827/2803788401","heartbeat_back_addr":"172.21.15.73:6831/2803788401","heartbeat_front_addr":"172.21.15.73:6829/2803788401","state":["exists","up"]},{"osd":6,"uuid":"5790c6cc-bd56-4ce4-9a7c-0f0c3b59215c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6808","nonce":974108383},{"type":"v1","addr":"172.21.15.73:6809","nonce":974108383}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6810","nonce":974108383},{"type":"v1","addr":"172.21.15.73:6811","nonce":974108383}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6815","nonce":974108383},{"type":"v1","addr":"172.21.15.73:6817","nonce":974108383}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6812","nonce":974108383},{"type":"v1","addr":"172.21.15.73:6813","nonce":974108383}]},"public_addr":"172.21.15.73:6809/974108383","cluster_addr":"172.21.15.73:6811/974108383","heartbeat_back_addr":"172.21.15.73:6817/974108383","heartbeat_front_addr":"172.21.15.73:6813/974108383","state":["exists","up"]},{"osd":7,"uuid":"b66f4d2e-147e-4c9b-97dd-cbd59d33802e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6814","nonce":3772673248},{"type":"v1","addr":"172.21.15.73:6816","nonce":3772673248}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6818","nonce":3772673248},{"type":"v1","addr":"172.21.15.73:6819","nonce":3772673248}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6822","nonce":3772673248},{"type":"v1","addr":"172.21.15.73:6823","nonce":3772673248}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6820","nonce":3772673248},{"type":"v1","addr":"172.21.15.73:6821","nonce":3772673248}]},"public_addr":"172.21.15.73:6816/3772673248","cluster_addr":"172.21.15.73:6819/3772673248","heartbeat_back_addr":"172.21.15.73:6823/3772673248","heartbeat_front_addr":"172.21.15.73:6821/3772673248","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-05T18:56:04.115334+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-05T18:56:04.071250+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-05T18:56:04.044387+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-05T18:56:04.085389+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-05T18:56:04.090726+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-05T18:56:04.074529+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-05T18:56:04.058841+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-05T18:56:04.043054+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-05T18:56:15.826 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:15.821+0000 7f57971f5700 1 -- 172.21.15.46:0/3629009102 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7f577406ace0 msgr2=0x7f577406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:56:15.828 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:15.821+0000 7f57971f5700 1 --2- 172.21.15.46:0/3629009102 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7f577406ace0 0x7f577406d190 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f57840011e0 tx=0x7f5784009040 comp rx=0 tx=0).stop 2023-07-05T18:56:15.828 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:15.821+0000 7f57971f5700 1 -- 172.21.15.46:0/3629009102 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f579015c2f0 msgr2=0x7f5790149000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:56:15.828 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:15.821+0000 7f57971f5700 1 --2- 172.21.15.46:0/3629009102 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f579015c2f0 0x7f5790149000 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f577c001eb0 tx=0x7f577c00c860 comp rx=0 tx=0).stop 2023-07-05T18:56:15.829 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:15.822+0000 7f57971f5700 1 -- 172.21.15.46:0/3629009102 shutdown_connections 2023-07-05T18:56:15.829 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:15.822+0000 7f57971f5700 1 --2- 172.21.15.46:0/3629009102 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7f577406ace0 0x7f577406d190 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:15.830 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:15.822+0000 7f57971f5700 1 --2- 172.21.15.46:0/3629009102 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f579015c6c0 0x7f5790153ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:15.830 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:15.822+0000 7f57971f5700 1 --2- 172.21.15.46:0/3629009102 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f57900cd2e0 0x7f57900cb830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:15.830 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:15.822+0000 7f57971f5700 1 --2- 172.21.15.46:0/3629009102 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f579015c2f0 0x7f5790149000 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:15.830 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:15.822+0000 7f57971f5700 1 -- 172.21.15.46:0/3629009102 >> 172.21.15.46:0/3629009102 conn(0x7f579006afa0 msgr2=0x7f57900cf9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-05T18:56:15.830 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:15.822+0000 7f57971f5700 1 -- 172.21.15.46:0/3629009102 shutdown_connections 2023-07-05T18:56:15.830 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:15.822+0000 7f57971f5700 1 -- 172.21.15.46:0/3629009102 wait complete. 2023-07-05T18:56:15.837 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-07-05T18:56:15.965 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:15.962+0000 7f41ec574700 1 Processor -- start 2023-07-05T18:56:15.965 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:15.963+0000 7f41ec574700 1 -- start start 2023-07-05T18:56:15.974 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:15.963+0000 7f41ec574700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f41e40afe20 0x7f41e40ccb00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:56:15.974 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:15.963+0000 7f41ec574700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f41e40b1950 0x7f41e40cede0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:56:15.975 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:15.963+0000 7f41ec574700 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f41e40cf320 con 0x7f41e40ce990 2023-07-05T18:56:15.975 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:15.963+0000 7f41ec574700 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f41e40b01f0 con 0x7f41e40b1950 2023-07-05T18:56:15.975 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:15.963+0000 7f41ec574700 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f41e40b0490 con 0x7f41e40afe20 2023-07-05T18:56:15.975 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:15.964+0000 7f41eab11700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f41e40b1950 0x7f41e40cede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:56:15.976 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:15.964+0000 7f41eab11700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f41e40b1950 0x7f41e40cede0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:57682/0 (socket says 172.21.15.46:57682) 2023-07-05T18:56:15.976 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:15.964+0000 7f41e9b0f700 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7f41e40ce990 0x7f41e40cb0e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:56950/0 (socket says 172.21.15.46:56950) 2023-07-05T18:56:15.976 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:15.964+0000 7f41eab11700 1 -- 172.21.15.46:0/1249651025 learned_addr learned my addr 172.21.15.46:0/1249651025 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-07-05T18:56:15.977 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:15.964+0000 7f41ea310700 1 --2- 172.21.15.46:0/1249651025 >> v2:172.21.15.73:3300/0 conn(0x7f41e40afe20 0x7f41e40ccb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:56:15.977 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:15.964+0000 7f41eab11700 1 -- 172.21.15.46:0/1249651025 >> v2:172.21.15.73:3300/0 conn(0x7f41e40afe20 msgr2=0x7f41e40ccb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-05T18:56:15.977 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:15.964+0000 7f41eab11700 1 --2- 172.21.15.46:0/1249651025 >> v2:172.21.15.73:3300/0 conn(0x7f41e40afe20 0x7f41e40ccb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:15.977 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:15.964+0000 7f41eab11700 1 -- 172.21.15.46:0/1249651025 >> v1:172.21.15.46:6789/0 conn(0x7f41e40ce990 legacy=0x7f41e40cb0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:56:15.977 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:15.964+0000 7f41e930e700 1 -- 172.21.15.46:0/1249651025 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3468718985 0 0) 0x7f41e00011d0 con 0x7f41e40ce990 2023-07-05T18:56:15.977 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:15.964+0000 7f41eab11700 1 -- 172.21.15.46:0/1249651025 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f41e40cd7d0 con 0x7f41e40b1950 2023-07-05T18:56:15.977 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:15.964+0000 7f41eab11700 1 --2- 172.21.15.46:0/1249651025 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f41e40b1950 0x7f41e40cede0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f41e4073e10 tx=0x7f41dc00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7fdaff5485f818f7 server_cookie=0 in_seq=0 out_seq=0 2023-07-05T18:56:15.977 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:15.964+0000 7f41e930e700 1 -- 172.21.15.46:0/1249651025 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41dc00e070 con 0x7f41e40b1950 2023-07-05T18:56:15.978 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:15.964+0000 7f41e930e700 1 -- 172.21.15.46:0/1249651025 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f41dc00b9c0 con 0x7f41e40b1950 2023-07-05T18:56:15.978 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:15.964+0000 7f41e930e700 1 -- 172.21.15.46:0/1249651025 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41dc00bd70 con 0x7f41e40b1950 2023-07-05T18:56:15.978 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:15.965+0000 7f41ec574700 1 -- 172.21.15.46:0/1249651025 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f41e40b1950 msgr2=0x7f41e40cede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:56:15.978 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:15.965+0000 7f41ec574700 1 --2- 172.21.15.46:0/1249651025 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f41e40b1950 0x7f41e40cede0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f41e4073e10 tx=0x7f41dc00b330 comp rx=0 tx=0).stop 2023-07-05T18:56:15.978 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:15.965+0000 7f41ec574700 1 -- 172.21.15.46:0/1249651025 shutdown_connections 2023-07-05T18:56:15.978 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:15.965+0000 7f41ec574700 1 --2- 172.21.15.46:0/1249651025 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f41e40b1950 0x7f41e40cede0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:15.978 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:15.965+0000 7f41ec574700 1 --2- 172.21.15.46:0/1249651025 >> v2:172.21.15.73:3300/0 conn(0x7f41e40afe20 0x7f41e40ccb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:15.979 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:15.965+0000 7f41ec574700 1 -- 172.21.15.46:0/1249651025 >> 172.21.15.46:0/1249651025 conn(0x7f41e4099de0 msgr2=0x7f41e40d0a90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-05T18:56:15.979 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:15.965+0000 7f41ec574700 1 -- 172.21.15.46:0/1249651025 shutdown_connections 2023-07-05T18:56:15.979 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:15.965+0000 7f41ec574700 1 -- 172.21.15.46:0/1249651025 wait complete. 2023-07-05T18:56:15.979 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:15.966+0000 7f41ec574700 1 Processor -- start 2023-07-05T18:56:15.979 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:15.966+0000 7f41ec574700 1 -- start start 2023-07-05T18:56:15.979 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:15.967+0000 7f41ec574700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f41e40afe20 0x7f41e41589b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:56:15.979 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:15.967+0000 7f41ec574700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f41e40b1950 0x7f41e40b5c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:56:15.979 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:15.967+0000 7f41ec574700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f41e40ce990 0x7f41e41e50c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:56:15.980 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:15.967+0000 7f41ec574700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f41e40b6980 con 0x7f41e40ce990 2023-07-05T18:56:15.980 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:15.967+0000 7f41ec574700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f41e40c5570 con 0x7f41e40afe20 2023-07-05T18:56:15.980 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:15.967+0000 7f41ec574700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f41e40c4c80 con 0x7f41e40b1950 2023-07-05T18:56:15.980 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:15.967+0000 7f41eab11700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f41e40ce990 0x7f41e41e50c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:56:15.980 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:15.967+0000 7f41eab11700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f41e40ce990 0x7f41e41e50c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:57688/0 (socket says 172.21.15.46:57688) 2023-07-05T18:56:15.980 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:15.967+0000 7f41eab11700 1 -- 172.21.15.46:0/1237016357 learned_addr learned my addr 172.21.15.46:0/1237016357 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-07-05T18:56:15.980 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:15.967+0000 7f41ea310700 1 --2- 172.21.15.46:0/1237016357 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f41e40afe20 0x7f41e41589b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:56:15.981 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:15.967+0000 7f41e9b0f700 1 --2- 172.21.15.46:0/1237016357 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f41e40b1950 0x7f41e40b5c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:56:15.981 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:15.967+0000 7f41eab11700 1 -- 172.21.15.46:0/1237016357 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f41e40b1950 msgr2=0x7f41e40b5c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:56:15.981 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:15.967+0000 7f41eab11700 1 --2- 172.21.15.46:0/1237016357 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f41e40b1950 0x7f41e40b5c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:15.981 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:15.967+0000 7f41eab11700 1 -- 172.21.15.46:0/1237016357 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f41e40afe20 msgr2=0x7f41e41589b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:56:15.982 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:15.967+0000 7f41eab11700 1 --2- 172.21.15.46:0/1237016357 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f41e40afe20 0x7f41e41589b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:15.982 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:15.967+0000 7f41eab11700 1 -- 172.21.15.46:0/1237016357 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f41dc009b30 con 0x7f41e40ce990 2023-07-05T18:56:15.982 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:15.967+0000 7f41e9b0f700 1 --2- 172.21.15.46:0/1237016357 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f41e40b1950 0x7f41e40b5c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-05T18:56:15.982 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:15.967+0000 7f41ea310700 1 --2- 172.21.15.46:0/1237016357 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f41e40afe20 0x7f41e41589b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-05T18:56:15.982 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:15.967+0000 7f41eab11700 1 --2- 172.21.15.46:0/1237016357 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f41e40ce990 0x7f41e41e50c0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f41e40726d0 tx=0x7f41dc004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-05T18:56:15.982 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:15.968+0000 7f41daffd700 1 -- 172.21.15.46:0/1237016357 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41dc0099b0 con 0x7f41e40ce990 2023-07-05T18:56:15.982 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:15.968+0000 7f41daffd700 1 -- 172.21.15.46:0/1237016357 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f41dc0092e0 con 0x7f41e40ce990 2023-07-05T18:56:15.983 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:15.968+0000 7f41ec574700 1 -- 172.21.15.46:0/1237016357 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f41e40b66a0 con 0x7f41e40ce990 2023-07-05T18:56:15.983 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:15.968+0000 7f41daffd700 1 -- 172.21.15.46:0/1237016357 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41dc01b650 con 0x7f41e40ce990 2023-07-05T18:56:15.983 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:15.968+0000 7f41ec574700 1 -- 172.21.15.46:0/1237016357 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f41e40c5200 con 0x7f41e40ce990 2023-07-05T18:56:15.983 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:15.968+0000 7f41ec574700 1 -- 172.21.15.46:0/1237016357 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f41e40c5700 con 0x7f41e40ce990 2023-07-05T18:56:15.984 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:15.969+0000 7f41daffd700 1 -- 172.21.15.46:0/1237016357 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f41dc01b7b0 con 0x7f41e40ce990 2023-07-05T18:56:15.984 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:15.969+0000 7f41daffd700 1 --2- 172.21.15.46:0/1237016357 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7f41c806ace0 0x7f41c806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:56:15.984 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:15.970+0000 7f41daffd700 1 -- 172.21.15.46:0/1237016357 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f41dc08aa60 con 0x7f41e40ce990 2023-07-05T18:56:15.984 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:15.970+0000 7f41ea310700 1 --2- 172.21.15.46:0/1237016357 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7f41c806ace0 0x7f41c806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:56:15.984 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:15.970+0000 7f41ea310700 1 --2- 172.21.15.46:0/1237016357 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7f41c806ace0 0x7f41c806d190 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f41e409ea90 tx=0x7f41d4008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-05T18:56:15.985 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:15.974+0000 7f41daffd700 1 -- 172.21.15.46:0/1237016357 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f41dc055ba0 con 0x7f41e40ce990 2023-07-05T18:56:16.229 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:16.225+0000 7f41ec574700 1 -- 172.21.15.46:0/1237016357 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f41e40d0160 con 0x7f41e40ce990 2023-07-05T18:56:17.228 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:17.225+0000 7f41daffd700 1 -- 172.21.15.46:0/1237016357 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v7) v1 ==== 118+0+0 (secure 0 0 0) 0x7f41dc0591c0 con 0x7f41e40ce990 2023-07-05T18:56:17.231 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:17.228+0000 7f41ec574700 1 -- 172.21.15.46:0/1237016357 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7f41c806ace0 msgr2=0x7f41c806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:56:17.231 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:17.228+0000 7f41ec574700 1 --2- 172.21.15.46:0/1237016357 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7f41c806ace0 0x7f41c806d190 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f41e409ea90 tx=0x7f41d4008040 comp rx=0 tx=0).stop 2023-07-05T18:56:17.231 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:17.228+0000 7f41ec574700 1 -- 172.21.15.46:0/1237016357 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f41e40ce990 msgr2=0x7f41e41e50c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:56:17.231 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:17.228+0000 7f41ec574700 1 --2- 172.21.15.46:0/1237016357 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f41e40ce990 0x7f41e41e50c0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f41e40726d0 tx=0x7f41dc004ad0 comp rx=0 tx=0).stop 2023-07-05T18:56:17.231 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:17.228+0000 7f41ec574700 1 -- 172.21.15.46:0/1237016357 shutdown_connections 2023-07-05T18:56:17.231 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:17.228+0000 7f41ec574700 1 --2- 172.21.15.46:0/1237016357 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7f41c806ace0 0x7f41c806d190 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:17.232 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:17.228+0000 7f41ec574700 1 --2- 172.21.15.46:0/1237016357 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f41e40ce990 0x7f41e41e50c0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:17.232 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:17.228+0000 7f41ec574700 1 --2- 172.21.15.46:0/1237016357 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f41e40afe20 0x7f41e41589b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:17.232 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:17.228+0000 7f41ec574700 1 --2- 172.21.15.46:0/1237016357 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f41e40b1950 0x7f41e40b5c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:17.232 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:17.228+0000 7f41ec574700 1 -- 172.21.15.46:0/1237016357 >> 172.21.15.46:0/1237016357 conn(0x7f41e4099de0 msgr2=0x7f41e406f0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-05T18:56:17.232 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:17.228+0000 7f41ec574700 1 -- 172.21.15.46:0/1237016357 shutdown_connections 2023-07-05T18:56:17.232 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:17.228+0000 7f41ec574700 1 -- 172.21.15.46:0/1237016357 wait complete. 2023-07-05T18:56:17.246 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2023-07-05T18:56:17.247 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-07-05T18:56:17.382 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:17.381+0000 7f86f5cda700 1 Processor -- start 2023-07-05T18:56:17.383 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:17.381+0000 7f86f5cda700 1 -- start start 2023-07-05T18:56:17.391 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:17.381+0000 7f86f5cda700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f86f01594f0 0x7f86f00cd690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:56:17.391 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:17.381+0000 7f86f5cda700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f86f00b1b00 0x7f86f00c9fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:56:17.391 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:17.381+0000 7f86f5cda700 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f86f015e040 con 0x7f86f00cdbd0 2023-07-05T18:56:17.391 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:17.381+0000 7f86f5cda700 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f86f00ce200 con 0x7f86f00b1b00 2023-07-05T18:56:17.392 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:17.381+0000 7f86f5cda700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f86f015dbb0 con 0x7f86f01594f0 2023-07-05T18:56:17.392 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:17.382+0000 7f86eeffd700 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7f86f00cdbd0 0x7f86f00b13f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:56964/0 (socket says 172.21.15.46:56964) 2023-07-05T18:56:17.392 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:17.382+0000 7f86eeffd700 1 -- 172.21.15.46:0/3533578852 learned_addr learned my addr 172.21.15.46:0/3533578852 (peer_addr_for_me v1:172.21.15.46:0/0) 2023-07-05T18:56:17.392 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:17.382+0000 7f86ef7fe700 1 --2- 172.21.15.46:0/3533578852 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f86f01594f0 0x7f86f00cd690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:56:17.392 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:17.382+0000 7f86effff700 1 --2- 172.21.15.46:0/3533578852 >> v2:172.21.15.73:3300/0 conn(0x7f86f00b1b00 0x7f86f00c9fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:56:17.392 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:17.382+0000 7f86ee7fc700 1 -- 172.21.15.46:0/3533578852 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 503052579 0 0) 0x7f86f015e040 con 0x7f86f00cdbd0 2023-07-05T18:56:17.392 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:17.382+0000 7f86ee7fc700 1 -- 172.21.15.46:0/3533578852 --> v1:172.21.15.46:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f86d80035b0 con 0x7f86f00cdbd0 2023-07-05T18:56:17.393 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:17.382+0000 7f86ee7fc700 1 -- 172.21.15.46:0/3533578852 <== mon.0 v1:172.21.15.46:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 390181709 0 0) 0x7f86d80035b0 con 0x7f86f00cdbd0 2023-07-05T18:56:17.393 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:17.382+0000 7f86ee7fc700 1 -- 172.21.15.46:0/3533578852 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f86f01594f0 msgr2=0x7f86f00cd690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-05T18:56:17.393 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:17.382+0000 7f86ee7fc700 1 --2- 172.21.15.46:0/3533578852 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f86f01594f0 0x7f86f00cd690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:17.393 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:17.382+0000 7f86ee7fc700 1 -- 172.21.15.46:0/3533578852 >> v2:172.21.15.73:3300/0 conn(0x7f86f00b1b00 msgr2=0x7f86f00c9fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-05T18:56:17.393 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:17.382+0000 7f86ee7fc700 1 --2- 172.21.15.46:0/3533578852 >> v2:172.21.15.73:3300/0 conn(0x7f86f00b1b00 0x7f86f00c9fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:17.393 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:17.382+0000 7f86ee7fc700 1 -- 172.21.15.46:0/3533578852 --> v1:172.21.15.46:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f86f00cc1c0 con 0x7f86f00cdbd0 2023-07-05T18:56:17.393 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:17.382+0000 7f86ee7fc700 1 -- 172.21.15.46:0/3533578852 <== mon.0 v1:172.21.15.46:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2195585215 0 0) 0x7f86e0001690 con 0x7f86f00cdbd0 2023-07-05T18:56:17.393 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:17.382+0000 7f86ee7fc700 1 -- 172.21.15.46:0/3533578852 >> v1:172.21.15.46:6789/0 conn(0x7f86f00cdbd0 legacy=0x7f86f00b13f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:56:17.394 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:17.382+0000 7f86ee7fc700 1 --2- 172.21.15.46:0/3533578852 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f86f01594f0 0x7f86d8003a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:56:17.394 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:17.382+0000 7f86ee7fc700 1 --2- 172.21.15.46:0/3533578852 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f86d8003f80 0x7f86d8004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:56:17.394 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:17.382+0000 7f86ee7fc700 1 --2- 172.21.15.46:0/3533578852 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f86d8004d90 0x7f86d8005200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:56:17.394 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:17.382+0000 7f86ee7fc700 1 -- 172.21.15.46:0/3533578852 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86f00ce200 con 0x7f86d8003f80 2023-07-05T18:56:17.394 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:17.382+0000 7f86ee7fc700 1 -- 172.21.15.46:0/3533578852 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86f015dbb0 con 0x7f86d8004d90 2023-07-05T18:56:17.394 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:17.382+0000 7f86ee7fc700 1 -- 172.21.15.46:0/3533578852 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f86d800ba10 con 0x7f86f01594f0 2023-07-05T18:56:17.394 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:17.382+0000 7f86eeffd700 1 --2- 172.21.15.46:0/3533578852 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f86d8003f80 0x7f86d8004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:56:17.394 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:17.382+0000 7f86ef7fe700 1 --2- 172.21.15.46:0/3533578852 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f86f01594f0 0x7f86d8003a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:56:17.395 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:17.382+0000 7f86effff700 1 --2- 172.21.15.46:0/3533578852 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f86d8004d90 0x7f86d8005200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:56:17.395 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:17.383+0000 7f86eeffd700 1 -- 172.21.15.46:0/3533578852 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f86f01594f0 msgr2=0x7f86d8003a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-05T18:56:17.396 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:17.383+0000 7f86eeffd700 1 --2- 172.21.15.46:0/3533578852 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f86f01594f0 0x7f86d8003a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:17.396 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:17.383+0000 7f86eeffd700 1 -- 172.21.15.46:0/3533578852 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f86d8004d90 msgr2=0x7f86d8005200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-05T18:56:17.396 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:17.383+0000 7f86eeffd700 1 --2- 172.21.15.46:0/3533578852 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f86d8004d90 0x7f86d8005200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:17.396 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:17.383+0000 7f86eeffd700 1 -- 172.21.15.46:0/3533578852 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f86d80035b0 con 0x7f86d8003f80 2023-07-05T18:56:17.396 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:17.383+0000 7f86eeffd700 1 --2- 172.21.15.46:0/3533578852 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f86d8003f80 0x7f86d8004850 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f86f00cd190 tx=0x7f86d8005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=caf0fcfbfb20f24 server_cookie=0 in_seq=0 out_seq=0 2023-07-05T18:56:17.396 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:17.383+0000 7f86ee7fc700 1 -- 172.21.15.46:0/3533578852 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86e000ce00 con 0x7f86d8003f80 2023-07-05T18:56:17.397 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:17.383+0000 7f86ee7fc700 1 -- 172.21.15.46:0/3533578852 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f86e0005960 con 0x7f86d8003f80 2023-07-05T18:56:17.397 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:17.383+0000 7f86ee7fc700 1 -- 172.21.15.46:0/3533578852 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86e0005d10 con 0x7f86d8003f80 2023-07-05T18:56:17.397 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:17.383+0000 7f86f5cda700 1 -- 172.21.15.46:0/3533578852 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f86d8003f80 msgr2=0x7f86d8004850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:56:17.397 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:17.383+0000 7f86f5cda700 1 --2- 172.21.15.46:0/3533578852 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f86d8003f80 0x7f86d8004850 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f86f00cd190 tx=0x7f86d8005880 comp rx=0 tx=0).stop 2023-07-05T18:56:17.397 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:17.384+0000 7f86effff700 1 -- 172.21.15.46:0/3533578852 reap_dead start 2023-07-05T18:56:17.397 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:17.384+0000 7f86f5cda700 1 -- 172.21.15.46:0/3533578852 shutdown_connections 2023-07-05T18:56:17.397 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:17.384+0000 7f86f5cda700 1 -- 172.21.15.46:0/3533578852 >> 172.21.15.46:0/3533578852 conn(0x7f86f006bba0 msgr2=0x7f86f00cc3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-05T18:56:17.398 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:17.384+0000 7f86f5cda700 1 -- 172.21.15.46:0/3533578852 shutdown_connections 2023-07-05T18:56:17.398 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:17.384+0000 7f86f5cda700 1 -- 172.21.15.46:0/3533578852 wait complete. 2023-07-05T18:56:17.398 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:17.385+0000 7f86f5cda700 1 Processor -- start 2023-07-05T18:56:17.398 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:17.385+0000 7f86f5cda700 1 -- start start 2023-07-05T18:56:17.398 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:17.386+0000 7f86f5cda700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f86d8003f80 0x7f86f014fa50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:56:17.398 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:17.386+0000 7f86f5cda700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f86f00b27a0 0x7f86f00c3de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:56:17.398 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:17.386+0000 7f86f5cda700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f86f00b4aa0 0x7f86f00b4f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:56:17.398 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:17.386+0000 7f86f5cda700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86f00c4810 con 0x7f86f00b4aa0 2023-07-05T18:56:17.399 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:17.386+0000 7f86f5cda700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86f00b2c80 con 0x7f86d8003f80 2023-07-05T18:56:17.399 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:17.386+0000 7f86f5cda700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f86f00b2f60 con 0x7f86f00b27a0 2023-07-05T18:56:17.399 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:17.386+0000 7f86effff700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f86f00b4aa0 0x7f86f00b4f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:56:17.399 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:17.386+0000 7f86effff700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f86f00b4aa0 0x7f86f00b4f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:57708/0 (socket says 172.21.15.46:57708) 2023-07-05T18:56:17.399 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:17.386+0000 7f86effff700 1 -- 172.21.15.46:0/2028500905 learned_addr learned my addr 172.21.15.46:0/2028500905 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-07-05T18:56:17.399 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:17.386+0000 7f86eeffd700 1 --2- 172.21.15.46:0/2028500905 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f86f00b27a0 0x7f86f00c3de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:56:17.399 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:17.386+0000 7f86ef7fe700 1 --2- 172.21.15.46:0/2028500905 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f86d8003f80 0x7f86f014fa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:56:17.400 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:17.386+0000 7f86effff700 1 -- 172.21.15.46:0/2028500905 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f86f00b27a0 msgr2=0x7f86f00c3de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:56:17.400 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:17.386+0000 7f86effff700 1 --2- 172.21.15.46:0/2028500905 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f86f00b27a0 0x7f86f00c3de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:17.400 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:17.386+0000 7f86effff700 1 -- 172.21.15.46:0/2028500905 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f86d8003f80 msgr2=0x7f86f014fa50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:56:17.400 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:17.386+0000 7f86effff700 1 --2- 172.21.15.46:0/2028500905 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f86d8003f80 0x7f86f014fa50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:17.400 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:17.386+0000 7f86effff700 1 -- 172.21.15.46:0/2028500905 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f86f00b3240 con 0x7f86f00b4aa0 2023-07-05T18:56:17.400 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:17.386+0000 7f86ef7fe700 1 --2- 172.21.15.46:0/2028500905 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f86d8003f80 0x7f86f014fa50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-05T18:56:17.400 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:17.386+0000 7f86effff700 1 --2- 172.21.15.46:0/2028500905 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f86f00b4aa0 0x7f86f00b4f20 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f86f00cd160 tx=0x7f86e8011f80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-05T18:56:17.400 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:17.386+0000 7f86d7fff700 1 -- 172.21.15.46:0/2028500905 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86e800e040 con 0x7f86f00b4aa0 2023-07-05T18:56:17.401 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:17.386+0000 7f86d7fff700 1 -- 172.21.15.46:0/2028500905 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f86e800f040 con 0x7f86f00b4aa0 2023-07-05T18:56:17.401 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:17.386+0000 7f86d7fff700 1 -- 172.21.15.46:0/2028500905 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86e800fa00 con 0x7f86f00b4aa0 2023-07-05T18:56:17.401 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:17.386+0000 7f86f5cda700 1 -- 172.21.15.46:0/2028500905 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f86f00b5460 con 0x7f86f00b4aa0 2023-07-05T18:56:17.401 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:17.387+0000 7f86f5cda700 1 -- 172.21.15.46:0/2028500905 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f86f00b3520 con 0x7f86f00b4aa0 2023-07-05T18:56:17.401 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:17.388+0000 7f86f5cda700 1 -- 172.21.15.46:0/2028500905 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f86f015d820 con 0x7f86f00b4aa0 2023-07-05T18:56:17.401 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:17.388+0000 7f86d7fff700 1 -- 172.21.15.46:0/2028500905 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f86e800fb60 con 0x7f86f00b4aa0 2023-07-05T18:56:17.401 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:17.388+0000 7f86d7fff700 1 --2- 172.21.15.46:0/2028500905 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7f86dc06acd0 0x7f86dc06d180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:56:17.402 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:17.389+0000 7f86d7fff700 1 -- 172.21.15.46:0/2028500905 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f86e8089b80 con 0x7f86f00b4aa0 2023-07-05T18:56:17.402 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:17.389+0000 7f86ef7fe700 1 --2- 172.21.15.46:0/2028500905 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7f86dc06acd0 0x7f86dc06d180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:56:17.402 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:17.389+0000 7f86ef7fe700 1 --2- 172.21.15.46:0/2028500905 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7f86dc06acd0 0x7f86dc06d180 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f86e4009a80 tx=0x7f86e4008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-05T18:56:17.403 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:17.393+0000 7f86d7fff700 1 -- 172.21.15.46:0/2028500905 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f86f015d820 con 0x7f86f00b4aa0 2023-07-05T18:56:17.641 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:17.639+0000 7f86f5cda700 1 -- 172.21.15.46:0/2028500905 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f86f00c4660 con 0x7f86f00b4aa0 2023-07-05T18:56:18.232 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:18.230+0000 7f86d7fff700 1 -- 172.21.15.46:0/2028500905 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v8) v1 ==== 122+0+0 (secure 0 0 0) 0x7f86e8054cc0 con 0x7f86f00b4aa0 2023-07-05T18:56:18.234 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:18.232+0000 7f86f5cda700 1 -- 172.21.15.46:0/2028500905 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7f86dc06acd0 msgr2=0x7f86dc06d180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:56:18.235 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:18.232+0000 7f86f5cda700 1 --2- 172.21.15.46:0/2028500905 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7f86dc06acd0 0x7f86dc06d180 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f86e4009a80 tx=0x7f86e4008040 comp rx=0 tx=0).stop 2023-07-05T18:56:18.235 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:18.232+0000 7f86f5cda700 1 -- 172.21.15.46:0/2028500905 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f86f00b4aa0 msgr2=0x7f86f00b4f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:56:18.235 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:18.232+0000 7f86f5cda700 1 --2- 172.21.15.46:0/2028500905 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f86f00b4aa0 0x7f86f00b4f20 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f86f00cd160 tx=0x7f86e8011f80 comp rx=0 tx=0).stop 2023-07-05T18:56:18.235 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:18.232+0000 7f86f5cda700 1 -- 172.21.15.46:0/2028500905 shutdown_connections 2023-07-05T18:56:18.235 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:18.232+0000 7f86f5cda700 1 --2- 172.21.15.46:0/2028500905 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7f86dc06acd0 0x7f86dc06d180 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:18.235 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:18.232+0000 7f86f5cda700 1 --2- 172.21.15.46:0/2028500905 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f86f00b4aa0 0x7f86f00b4f20 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:18.236 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:18.232+0000 7f86f5cda700 1 --2- 172.21.15.46:0/2028500905 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f86d8003f80 0x7f86f014fa50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:18.236 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:18.232+0000 7f86f5cda700 1 --2- 172.21.15.46:0/2028500905 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f86f00b27a0 0x7f86f00c3de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:18.236 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:18.232+0000 7f86f5cda700 1 -- 172.21.15.46:0/2028500905 >> 172.21.15.46:0/2028500905 conn(0x7f86f006bba0 msgr2=0x7f86f006cf30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-05T18:56:18.236 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:18.232+0000 7f86f5cda700 1 -- 172.21.15.46:0/2028500905 shutdown_connections 2023-07-05T18:56:18.236 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:18.233+0000 7f86f5cda700 1 -- 172.21.15.46:0/2028500905 wait complete. 2023-07-05T18:56:18.249 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2023-07-05T18:56:18.250 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-05T18:56:18.382 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:18.380+0000 7fea393cf700 1 Processor -- start 2023-07-05T18:56:18.383 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:18.380+0000 7fea393cf700 1 -- start start 2023-07-05T18:56:18.386 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:18.381+0000 7fea393cf700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fea3415c2f0 0x7fea340cd2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:56:18.386 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:18.381+0000 7fea393cf700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fea3415c6c0 0x7fea3406c760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:56:18.386 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:18.381+0000 7fea393cf700 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fea340cd8c0 con 0x7fea340b5ae0 2023-07-05T18:56:18.387 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:18.381+0000 7fea393cf700 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fea340d0990 con 0x7fea3415c6c0 2023-07-05T18:56:18.387 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:18.381+0000 7fea393cf700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fea340d0c70 con 0x7fea3415c2f0 2023-07-05T18:56:18.387 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:18.381+0000 7fea337fe700 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7fea340b5ae0 0x7fea340d1450 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:56988/0 (socket says 172.21.15.46:56988) 2023-07-05T18:56:18.387 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:18.381+0000 7fea337fe700 1 -- 172.21.15.46:0/493202292 learned_addr learned my addr 172.21.15.46:0/493202292 (peer_addr_for_me v1:172.21.15.46:0/0) 2023-07-05T18:56:18.388 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:18.381+0000 7fea32ffd700 1 --2- 172.21.15.46:0/493202292 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fea3415c2f0 0x7fea340cd2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:56:18.388 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:18.382+0000 7fea327fc700 1 --2- 172.21.15.46:0/493202292 >> v2:172.21.15.73:3300/0 conn(0x7fea3415c6c0 0x7fea3406c760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:56:18.388 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:18.382+0000 7fea31ffb700 1 -- 172.21.15.46:0/493202292 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3780284061 0 0) 0x7fea340cd8c0 con 0x7fea340b5ae0 2023-07-05T18:56:18.389 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:18.382+0000 7fea31ffb700 1 -- 172.21.15.46:0/493202292 --> v1:172.21.15.46:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fea1c0035b0 con 0x7fea340b5ae0 2023-07-05T18:56:18.390 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:18.382+0000 7fea31ffb700 1 -- 172.21.15.46:0/493202292 <== mon.0 v1:172.21.15.46:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1481007008 0 0) 0x7fea1c0035b0 con 0x7fea340b5ae0 2023-07-05T18:56:18.390 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:18.382+0000 7fea31ffb700 1 -- 172.21.15.46:0/493202292 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fea3415c2f0 msgr2=0x7fea340cd2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-05T18:56:18.390 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:18.382+0000 7fea31ffb700 1 --2- 172.21.15.46:0/493202292 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fea3415c2f0 0x7fea340cd2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:18.391 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:18.382+0000 7fea31ffb700 1 -- 172.21.15.46:0/493202292 >> v2:172.21.15.73:3300/0 conn(0x7fea3415c6c0 msgr2=0x7fea3406c760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-05T18:56:18.391 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:18.382+0000 7fea31ffb700 1 --2- 172.21.15.46:0/493202292 >> v2:172.21.15.73:3300/0 conn(0x7fea3415c6c0 0x7fea3406c760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:18.392 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:18.382+0000 7fea31ffb700 1 -- 172.21.15.46:0/493202292 --> v1:172.21.15.46:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fea340d0f50 con 0x7fea340b5ae0 2023-07-05T18:56:18.392 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:18.382+0000 7fea31ffb700 1 -- 172.21.15.46:0/493202292 <== mon.0 v1:172.21.15.46:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2195585215 0 0) 0x7fea2c0019f0 con 0x7fea340b5ae0 2023-07-05T18:56:18.393 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:18.382+0000 7fea31ffb700 1 -- 172.21.15.46:0/493202292 >> v1:172.21.15.46:6789/0 conn(0x7fea340b5ae0 legacy=0x7fea340d1450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:56:18.393 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:18.382+0000 7fea31ffb700 1 --2- 172.21.15.46:0/493202292 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fea1c003a00 0x7fea1c003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:56:18.393 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:18.382+0000 7fea31ffb700 1 --2- 172.21.15.46:0/493202292 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fea1c004430 0x7fea1c0048f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:56:18.393 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:18.382+0000 7fea31ffb700 1 --2- 172.21.15.46:0/493202292 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fea1c004fb0 0x7fea1c00ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:56:18.393 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:18.382+0000 7fea31ffb700 1 -- 172.21.15.46:0/493202292 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea340d0990 con 0x7fea1c003a00 2023-07-05T18:56:18.393 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:18.382+0000 7fea31ffb700 1 -- 172.21.15.46:0/493202292 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea340d0c70 con 0x7fea1c004fb0 2023-07-05T18:56:18.394 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:18.382+0000 7fea31ffb700 1 -- 172.21.15.46:0/493202292 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fea1c00bf50 con 0x7fea1c004430 2023-07-05T18:56:18.394 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:18.382+0000 7fea327fc700 1 --2- 172.21.15.46:0/493202292 >> v2:172.21.15.73:3300/0 conn(0x7fea3415c6c0 0x7fea3406c760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-05T18:56:18.394 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:18.382+0000 7fea32ffd700 1 --2- 172.21.15.46:0/493202292 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fea3415c2f0 0x7fea340cd2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-05T18:56:18.394 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:18.382+0000 7fea32ffd700 1 --2- 172.21.15.46:0/493202292 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fea1c003a00 0x7fea1c003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:56:18.394 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:18.382+0000 7fea337fe700 1 --2- 172.21.15.46:0/493202292 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fea1c004fb0 0x7fea1c00ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:56:18.395 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:18.382+0000 7fea327fc700 1 --2- 172.21.15.46:0/493202292 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fea1c004430 0x7fea1c0048f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:56:18.395 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:18.382+0000 7fea32ffd700 1 -- 172.21.15.46:0/493202292 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fea1c004430 msgr2=0x7fea1c0048f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-05T18:56:18.395 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:18.382+0000 7fea32ffd700 1 --2- 172.21.15.46:0/493202292 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fea1c004430 0x7fea1c0048f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:18.395 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:18.382+0000 7fea32ffd700 1 -- 172.21.15.46:0/493202292 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fea1c004fb0 msgr2=0x7fea1c00ba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-05T18:56:18.395 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:18.382+0000 7fea32ffd700 1 --2- 172.21.15.46:0/493202292 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fea1c004fb0 0x7fea1c00ba10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:18.395 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:18.382+0000 7fea32ffd700 1 -- 172.21.15.46:0/493202292 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fea1c0035b0 con 0x7fea1c003a00 2023-07-05T18:56:18.396 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:18.382+0000 7fea337fe700 1 --2- 172.21.15.46:0/493202292 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fea1c004fb0 0x7fea1c00ba10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-05T18:56:18.396 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:18.383+0000 7fea32ffd700 1 --2- 172.21.15.46:0/493202292 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fea1c003a00 0x7fea1c003e10 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fea34073ea0 tx=0x7fea1c005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ae8d02579cf83407 server_cookie=0 in_seq=0 out_seq=0 2023-07-05T18:56:18.396 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:18.383+0000 7fea31ffb700 1 -- 172.21.15.46:0/493202292 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea28004030 con 0x7fea1c003a00 2023-07-05T18:56:18.396 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:18.383+0000 7fea31ffb700 1 -- 172.21.15.46:0/493202292 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fea28004190 con 0x7fea1c003a00 2023-07-05T18:56:18.396 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:18.383+0000 7fea31ffb700 1 -- 172.21.15.46:0/493202292 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea28004540 con 0x7fea1c003a00 2023-07-05T18:56:18.397 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:18.383+0000 7fea393cf700 1 -- 172.21.15.46:0/493202292 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fea1c003a00 msgr2=0x7fea1c003e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:56:18.397 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:18.383+0000 7fea393cf700 1 --2- 172.21.15.46:0/493202292 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fea1c003a00 0x7fea1c003e10 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fea34073ea0 tx=0x7fea1c005880 comp rx=0 tx=0).stop 2023-07-05T18:56:18.397 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:18.383+0000 7fea337fe700 1 -- 172.21.15.46:0/493202292 reap_dead start 2023-07-05T18:56:18.397 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:18.383+0000 7fea393cf700 1 -- 172.21.15.46:0/493202292 shutdown_connections 2023-07-05T18:56:18.398 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:18.383+0000 7fea393cf700 1 -- 172.21.15.46:0/493202292 >> 172.21.15.46:0/493202292 conn(0x7fea3406afa0 msgr2=0x7fea340cf710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-05T18:56:18.398 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:18.383+0000 7fea393cf700 1 -- 172.21.15.46:0/493202292 shutdown_connections 2023-07-05T18:56:18.398 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:18.383+0000 7fea393cf700 1 -- 172.21.15.46:0/493202292 wait complete. 2023-07-05T18:56:18.404 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:18.385+0000 7fea393cf700 1 Processor -- start 2023-07-05T18:56:18.404 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:18.385+0000 7fea393cf700 1 -- start start 2023-07-05T18:56:18.404 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:18.386+0000 7fea393cf700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fea1c003a00 0x7fea341571e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:56:18.405 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:18.386+0000 7fea393cf700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fea340c97e0 0x7fea340c71d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:56:18.405 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:18.386+0000 7fea393cf700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fea340cb820 0x7fea340cbc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:56:18.405 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:18.386+0000 7fea393cf700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea340c8650 con 0x7fea340cb820 2023-07-05T18:56:18.405 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:18.386+0000 7fea393cf700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea340cc1d0 con 0x7fea1c003a00 2023-07-05T18:56:18.405 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:18.386+0000 7fea393cf700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fea34157720 con 0x7fea340c97e0 2023-07-05T18:56:18.406 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:18.386+0000 7fea337fe700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fea340cb820 0x7fea340cbc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:56:18.406 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:18.386+0000 7fea337fe700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fea340cb820 0x7fea340cbc90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:57728/0 (socket says 172.21.15.46:57728) 2023-07-05T18:56:18.406 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:18.386+0000 7fea337fe700 1 -- 172.21.15.46:0/475148414 learned_addr learned my addr 172.21.15.46:0/475148414 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-07-05T18:56:18.406 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:18.386+0000 7fea32ffd700 1 --2- 172.21.15.46:0/475148414 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fea1c003a00 0x7fea341571e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:56:18.407 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:18.386+0000 7fea327fc700 1 --2- 172.21.15.46:0/475148414 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fea340c97e0 0x7fea340c71d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:56:18.407 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:18.386+0000 7fea337fe700 1 -- 172.21.15.46:0/475148414 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fea340c97e0 msgr2=0x7fea340c71d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:56:18.407 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:18.386+0000 7fea337fe700 1 --2- 172.21.15.46:0/475148414 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fea340c97e0 0x7fea340c71d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:18.407 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:18.386+0000 7fea337fe700 1 -- 172.21.15.46:0/475148414 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fea1c003a00 msgr2=0x7fea341571e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:56:18.407 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:18.386+0000 7fea337fe700 1 --2- 172.21.15.46:0/475148414 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fea1c003a00 0x7fea341571e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:18.407 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:18.386+0000 7fea337fe700 1 -- 172.21.15.46:0/475148414 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fea340c7ad0 con 0x7fea340cb820 2023-07-05T18:56:18.407 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:18.386+0000 7fea32ffd700 1 --2- 172.21.15.46:0/475148414 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fea1c003a00 0x7fea341571e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-05T18:56:18.408 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:18.386+0000 7fea327fc700 1 --2- 172.21.15.46:0/475148414 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fea340c97e0 0x7fea340c71d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-05T18:56:18.408 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:18.386+0000 7fea337fe700 1 --2- 172.21.15.46:0/475148414 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fea340cb820 0x7fea340cbc90 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fea2c001a80 tx=0x7fea2c007c90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-05T18:56:18.408 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:18.386+0000 7fea1b7fe700 1 -- 172.21.15.46:0/475148414 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea2c017070 con 0x7fea340cb820 2023-07-05T18:56:18.408 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:18.386+0000 7fea1b7fe700 1 -- 172.21.15.46:0/475148414 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fea2c00ece0 con 0x7fea340cb820 2023-07-05T18:56:18.408 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:18.386+0000 7fea393cf700 1 -- 172.21.15.46:0/475148414 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fea340c7db0 con 0x7fea340cb820 2023-07-05T18:56:18.408 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:18.386+0000 7fea1b7fe700 1 -- 172.21.15.46:0/475148414 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea2c00ee70 con 0x7fea340cb820 2023-07-05T18:56:18.409 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:18.386+0000 7fea393cf700 1 -- 172.21.15.46:0/475148414 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fea340c8370 con 0x7fea340cb820 2023-07-05T18:56:18.409 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:18.387+0000 7fea393cf700 1 -- 172.21.15.46:0/475148414 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fea3404e1d0 con 0x7fea340cb820 2023-07-05T18:56:18.409 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:18.388+0000 7fea1b7fe700 1 -- 172.21.15.46:0/475148414 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fea2c013420 con 0x7fea340cb820 2023-07-05T18:56:18.409 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:18.388+0000 7fea1b7fe700 1 --2- 172.21.15.46:0/475148414 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7fea2006ace0 0x7fea2006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:56:18.409 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:18.388+0000 7fea1b7fe700 1 -- 172.21.15.46:0/475148414 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fea2c089140 con 0x7fea340cb820 2023-07-05T18:56:18.409 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:18.388+0000 7fea32ffd700 1 --2- 172.21.15.46:0/475148414 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7fea2006ace0 0x7fea2006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:56:18.409 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:18.389+0000 7fea32ffd700 1 --2- 172.21.15.46:0/475148414 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7fea2006ace0 0x7fea2006d190 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fea340b56a0 tx=0x7fea28008070 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-05T18:56:18.409 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:18.393+0000 7fea1b7fe700 1 -- 172.21.15.46:0/475148414 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fea2c054280 con 0x7fea340cb820 2023-07-05T18:56:18.639 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:18.637+0000 7fea393cf700 1 -- 172.21.15.46:0/475148414 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fea340ce0a0 con 0x7fea340cb820 2023-07-05T18:56:18.640 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:18.638+0000 7fea1b7fe700 1 -- 172.21.15.46:0/475148414 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4656 (secure 0 0 0) 0x7fea2c0578a0 con 0x7fea340cb820 2023-07-05T18:56:18.641 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T18:56:18.641 INFO:teuthology.orchestra.run.smithi046.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4247,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.73:6837/75231790","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6835","nonce":75231790},{"type":"v1","addr":"172.21.15.73:6837","nonce":75231790}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4284,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.46:6834/378741372","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6832","nonce":378741372},{"type":"v1","addr":"172.21.15.46:6834","nonce":378741372}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4287,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.46:6835/1674703862","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6833","nonce":1674703862},{"type":"v1","addr":"172.21.15.46:6835","nonce":1674703862}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-07-05T18:56:15.093940+0000","modified":"2023-07-05T18:56:18.225033+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4296},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4296":{"gid":4296,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.73:6836/2654190748","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6834","nonce":2654190748},{"type":"v1","addr":"172.21.15.73:6836","nonce":2654190748}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-07-05T18:56:18.643 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:18.640+0000 7fea393cf700 1 -- 172.21.15.46:0/475148414 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7fea2006ace0 msgr2=0x7fea2006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:56:18.643 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:18.640+0000 7fea393cf700 1 --2- 172.21.15.46:0/475148414 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7fea2006ace0 0x7fea2006d190 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fea340b56a0 tx=0x7fea28008070 comp rx=0 tx=0).stop 2023-07-05T18:56:18.644 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:18.640+0000 7fea393cf700 1 -- 172.21.15.46:0/475148414 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fea340cb820 msgr2=0x7fea340cbc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:56:18.644 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:18.640+0000 7fea393cf700 1 --2- 172.21.15.46:0/475148414 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fea340cb820 0x7fea340cbc90 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fea2c001a80 tx=0x7fea2c007c90 comp rx=0 tx=0).stop 2023-07-05T18:56:18.644 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:18.640+0000 7fea393cf700 1 -- 172.21.15.46:0/475148414 shutdown_connections 2023-07-05T18:56:18.644 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:18.640+0000 7fea393cf700 1 --2- 172.21.15.46:0/475148414 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7fea2006ace0 0x7fea2006d190 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:18.644 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:18.640+0000 7fea393cf700 1 --2- 172.21.15.46:0/475148414 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fea340cb820 0x7fea340cbc90 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:18.644 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:18.640+0000 7fea393cf700 1 --2- 172.21.15.46:0/475148414 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fea1c003a00 0x7fea341571e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:18.644 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:18.640+0000 7fea393cf700 1 --2- 172.21.15.46:0/475148414 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fea340c97e0 0x7fea340c71d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:18.645 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:18.640+0000 7fea393cf700 1 -- 172.21.15.46:0/475148414 >> 172.21.15.46:0/475148414 conn(0x7fea3406afa0 msgr2=0x7fea340d21f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-05T18:56:18.645 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:18.640+0000 7fea393cf700 1 -- 172.21.15.46:0/475148414 shutdown_connections 2023-07-05T18:56:18.645 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:18.640+0000 7fea393cf700 1 -- 172.21.15.46:0/475148414 wait complete. 2023-07-05T18:56:18.645 INFO:teuthology.orchestra.run.smithi046.stderr:dumped fsmap epoch 8 2023-07-05T18:56:18.655 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-05T18:56:18.786 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:18.778+0000 7fd1799b1700 1 Processor -- start 2023-07-05T18:56:18.787 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:18.778+0000 7fd1799b1700 1 -- start start 2023-07-05T18:56:18.787 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:18.779+0000 7fd1799b1700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fd17415c6c0 0x7fd1740cd2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:56:18.787 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:18.779+0000 7fd1799b1700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fd1740b5ae0 0x7fd1740b5f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:56:18.787 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:18.779+0000 7fd1799b1700 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd1740cd8c0 con 0x7fd17415c2f0 2023-07-05T18:56:18.787 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:18.779+0000 7fd1799b1700 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd1740d0990 con 0x7fd1740b5ae0 2023-07-05T18:56:18.788 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:18.779+0000 7fd1799b1700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd1740d0c70 con 0x7fd17415c6c0 2023-07-05T18:56:18.788 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:18.779+0000 7fd172ffd700 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7fd17415c2f0 0x7fd17406c760 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:57004/0 (socket says 172.21.15.46:57004) 2023-07-05T18:56:18.788 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:18.779+0000 7fd172ffd700 1 -- 172.21.15.46:0/4188382810 learned_addr learned my addr 172.21.15.46:0/4188382810 (peer_addr_for_me v1:172.21.15.46:0/0) 2023-07-05T18:56:18.788 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:18.779+0000 7fd1727fc700 1 --2- 172.21.15.46:0/4188382810 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fd17415c6c0 0x7fd1740cd2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:56:18.788 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:18.779+0000 7fd1737fe700 1 --2- 172.21.15.46:0/4188382810 >> v2:172.21.15.73:3300/0 conn(0x7fd1740b5ae0 0x7fd1740b5f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:56:18.788 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:18.779+0000 7fd171ffb700 1 -- 172.21.15.46:0/4188382810 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 914881405 0 0) 0x7fd1740cd8c0 con 0x7fd17415c2f0 2023-07-05T18:56:18.788 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:18.779+0000 7fd171ffb700 1 -- 172.21.15.46:0/4188382810 --> v1:172.21.15.46:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd15c0035b0 con 0x7fd17415c2f0 2023-07-05T18:56:18.789 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:18.779+0000 7fd171ffb700 1 -- 172.21.15.46:0/4188382810 <== mon.0 v1:172.21.15.46:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3533780362 0 0) 0x7fd15c0035b0 con 0x7fd17415c2f0 2023-07-05T18:56:18.789 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:18.779+0000 7fd171ffb700 1 -- 172.21.15.46:0/4188382810 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fd17415c6c0 msgr2=0x7fd1740cd2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-05T18:56:18.789 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:18.779+0000 7fd171ffb700 1 --2- 172.21.15.46:0/4188382810 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fd17415c6c0 0x7fd1740cd2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:18.789 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:18.779+0000 7fd171ffb700 1 -- 172.21.15.46:0/4188382810 >> v2:172.21.15.73:3300/0 conn(0x7fd1740b5ae0 msgr2=0x7fd1740b5f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-05T18:56:18.789 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:18.779+0000 7fd171ffb700 1 --2- 172.21.15.46:0/4188382810 >> v2:172.21.15.73:3300/0 conn(0x7fd1740b5ae0 0x7fd1740b5f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:18.789 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:18.779+0000 7fd171ffb700 1 -- 172.21.15.46:0/4188382810 --> v1:172.21.15.46:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd1740d0f50 con 0x7fd17415c2f0 2023-07-05T18:56:18.789 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:18.779+0000 7fd171ffb700 1 -- 172.21.15.46:0/4188382810 <== mon.0 v1:172.21.15.46:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2195585215 0 0) 0x7fd164001670 con 0x7fd17415c2f0 2023-07-05T18:56:18.790 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:18.779+0000 7fd171ffb700 1 -- 172.21.15.46:0/4188382810 >> v1:172.21.15.46:6789/0 conn(0x7fd17415c2f0 legacy=0x7fd17406c760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:56:18.790 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:18.779+0000 7fd171ffb700 1 --2- 172.21.15.46:0/4188382810 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fd17415c6c0 0x7fd15c003a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:56:18.790 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:18.779+0000 7fd171ffb700 1 --2- 172.21.15.46:0/4188382810 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd15c003f80 0x7fd15c004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:56:18.790 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:18.779+0000 7fd171ffb700 1 --2- 172.21.15.46:0/4188382810 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd15c004d90 0x7fd15c005200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:56:18.790 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:18.779+0000 7fd171ffb700 1 -- 172.21.15.46:0/4188382810 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1740d0990 con 0x7fd15c003f80 2023-07-05T18:56:18.790 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:18.779+0000 7fd171ffb700 1 -- 172.21.15.46:0/4188382810 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1740d0c70 con 0x7fd15c004d90 2023-07-05T18:56:18.790 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:18.779+0000 7fd171ffb700 1 -- 172.21.15.46:0/4188382810 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd15c00ba40 con 0x7fd17415c6c0 2023-07-05T18:56:18.791 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:18.779+0000 7fd1727fc700 1 --2- 172.21.15.46:0/4188382810 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd15c003f80 0x7fd15c004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:56:18.791 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:18.780+0000 7fd172ffd700 1 --2- 172.21.15.46:0/4188382810 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fd17415c6c0 0x7fd15c003a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:56:18.791 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:18.780+0000 7fd1737fe700 1 --2- 172.21.15.46:0/4188382810 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd15c004d90 0x7fd15c005200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:56:18.791 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:18.780+0000 7fd1727fc700 1 -- 172.21.15.46:0/4188382810 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fd17415c6c0 msgr2=0x7fd15c003a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-05T18:56:18.791 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:18.780+0000 7fd1727fc700 1 --2- 172.21.15.46:0/4188382810 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fd17415c6c0 0x7fd15c003a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:18.791 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:18.780+0000 7fd1727fc700 1 -- 172.21.15.46:0/4188382810 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd15c004d90 msgr2=0x7fd15c005200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-05T18:56:18.791 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:18.780+0000 7fd1727fc700 1 --2- 172.21.15.46:0/4188382810 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd15c004d90 0x7fd15c005200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:18.791 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:18.780+0000 7fd1727fc700 1 -- 172.21.15.46:0/4188382810 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd15c0035b0 con 0x7fd15c003f80 2023-07-05T18:56:18.792 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:18.780+0000 7fd1737fe700 1 --2- 172.21.15.46:0/4188382810 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd15c004d90 0x7fd15c005200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-05T18:56:18.792 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:18.780+0000 7fd1727fc700 1 --2- 172.21.15.46:0/4188382810 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd15c003f80 0x7fd15c004850 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fd168009b30 tx=0x7fd15c005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=156054d1f9405248 server_cookie=0 in_seq=0 out_seq=0 2023-07-05T18:56:18.792 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:18.780+0000 7fd171ffb700 1 -- 172.21.15.46:0/4188382810 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd16800e660 con 0x7fd15c003f80 2023-07-05T18:56:18.792 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:18.780+0000 7fd171ffb700 1 -- 172.21.15.46:0/4188382810 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd16800e7c0 con 0x7fd15c003f80 2023-07-05T18:56:18.792 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:18.780+0000 7fd171ffb700 1 -- 172.21.15.46:0/4188382810 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd16800eb30 con 0x7fd15c003f80 2023-07-05T18:56:18.792 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:18.781+0000 7fd1799b1700 1 -- 172.21.15.46:0/4188382810 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd15c003f80 msgr2=0x7fd15c004850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:56:18.792 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:18.781+0000 7fd1799b1700 1 --2- 172.21.15.46:0/4188382810 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd15c003f80 0x7fd15c004850 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fd168009b30 tx=0x7fd15c005880 comp rx=0 tx=0).stop 2023-07-05T18:56:18.793 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:18.781+0000 7fd1737fe700 1 -- 172.21.15.46:0/4188382810 reap_dead start 2023-07-05T18:56:18.793 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:18.781+0000 7fd1799b1700 1 -- 172.21.15.46:0/4188382810 shutdown_connections 2023-07-05T18:56:18.793 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:18.781+0000 7fd1799b1700 1 -- 172.21.15.46:0/4188382810 >> 172.21.15.46:0/4188382810 conn(0x7fd17406afa0 msgr2=0x7fd1740cf710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-05T18:56:18.793 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:18.781+0000 7fd1799b1700 1 -- 172.21.15.46:0/4188382810 shutdown_connections 2023-07-05T18:56:18.793 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:18.781+0000 7fd1799b1700 1 -- 172.21.15.46:0/4188382810 wait complete. 2023-07-05T18:56:18.793 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:18.782+0000 7fd1799b1700 1 Processor -- start 2023-07-05T18:56:18.793 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:18.782+0000 7fd1799b1700 1 -- start start 2023-07-05T18:56:18.793 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:18.783+0000 7fd1799b1700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd15c003f80 0x7fd1741f2120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:56:18.794 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:18.783+0000 7fd1799b1700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fd17415aed0 0x7fd17415a6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:56:18.794 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:18.783+0000 7fd1799b1700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd1740cbc50 0x7fd17415ff90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:56:18.794 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:18.783+0000 7fd1799b1700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd17415ac30 con 0x7fd15c003f80 2023-07-05T18:56:18.795 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:18.783+0000 7fd1799b1700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1740cc550 con 0x7fd1740cbc50 2023-07-05T18:56:18.795 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:18.783+0000 7fd1799b1700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd1740cc830 con 0x7fd17415aed0 2023-07-05T18:56:18.795 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:18.783+0000 7fd172ffd700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd15c003f80 0x7fd1741f2120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:56:18.795 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:18.783+0000 7fd172ffd700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd15c003f80 0x7fd1741f2120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:57744/0 (socket says 172.21.15.46:57744) 2023-07-05T18:56:18.796 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:18.783+0000 7fd172ffd700 1 -- 172.21.15.46:0/1200281810 learned_addr learned my addr 172.21.15.46:0/1200281810 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-07-05T18:56:18.796 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:18.783+0000 7fd172ffd700 1 -- 172.21.15.46:0/1200281810 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fd17415aed0 msgr2=0x7fd17415a6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:56:18.796 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:18.783+0000 7fd172ffd700 1 --2- 172.21.15.46:0/1200281810 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fd17415aed0 0x7fd17415a6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:18.796 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:18.783+0000 7fd172ffd700 1 -- 172.21.15.46:0/1200281810 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd1740cbc50 msgr2=0x7fd17415ff90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:56:18.796 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:18.783+0000 7fd172ffd700 1 --2- 172.21.15.46:0/1200281810 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd1740cbc50 0x7fd17415ff90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:18.796 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:18.783+0000 7fd172ffd700 1 -- 172.21.15.46:0/1200281810 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd1740ccb10 con 0x7fd15c003f80 2023-07-05T18:56:18.796 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:18.783+0000 7fd172ffd700 1 --2- 172.21.15.46:0/1200281810 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd15c003f80 0x7fd1741f2120 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fd164000fb0 tx=0x7fd1640075f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-05T18:56:18.797 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:18.784+0000 7fd15bfff700 1 -- 172.21.15.46:0/1200281810 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1640077d0 con 0x7fd15c003f80 2023-07-05T18:56:18.797 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:18.784+0000 7fd15bfff700 1 -- 172.21.15.46:0/1200281810 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd16400f820 con 0x7fd15c003f80 2023-07-05T18:56:18.797 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:18.784+0000 7fd1799b1700 1 -- 172.21.15.46:0/1200281810 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd1740c67c0 con 0x7fd15c003f80 2023-07-05T18:56:18.797 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:18.784+0000 7fd15bfff700 1 -- 172.21.15.46:0/1200281810 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd16400fbd0 con 0x7fd15c003f80 2023-07-05T18:56:18.797 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:18.784+0000 7fd1799b1700 1 -- 172.21.15.46:0/1200281810 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd1740cc0d0 con 0x7fd15c003f80 2023-07-05T18:56:18.797 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:18.785+0000 7fd1799b1700 1 -- 172.21.15.46:0/1200281810 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd17404e1d0 con 0x7fd15c003f80 2023-07-05T18:56:18.798 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:18.785+0000 7fd15bfff700 1 -- 172.21.15.46:0/1200281810 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fd16400fd30 con 0x7fd15c003f80 2023-07-05T18:56:18.798 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:18.785+0000 7fd15bfff700 1 --2- 172.21.15.46:0/1200281810 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7fd16006ad10 0x7fd16006d1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:56:18.799 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:18.786+0000 7fd15bfff700 1 -- 172.21.15.46:0/1200281810 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fd1640894e0 con 0x7fd15c003f80 2023-07-05T18:56:18.799 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:18.786+0000 7fd1727fc700 1 --2- 172.21.15.46:0/1200281810 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7fd16006ad10 0x7fd16006d1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:56:18.799 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:18.786+0000 7fd1727fc700 1 --2- 172.21.15.46:0/1200281810 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7fd16006ad10 0x7fd16006d1c0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fd1740b45a0 tx=0x7fd168013000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-05T18:56:18.799 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:18.790+0000 7fd15bfff700 1 -- 172.21.15.46:0/1200281810 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fd164054590 con 0x7fd15c003f80 2023-07-05T18:56:18.991 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:18.990+0000 7fd1799b1700 1 -- 172.21.15.46:0/1200281810 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fd1740cc290 con 0x7fd15c003f80 2023-07-05T18:56:18.992 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:18.991+0000 7fd15bfff700 1 -- 172.21.15.46:0/1200281810 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) v1 ==== 74+0+18161 (secure 0 0 0) 0x7fd164057bb0 con 0x7fd15c003f80 2023-07-05T18:56:18.993 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T18:56:18.993 INFO:teuthology.orchestra.run.smithi046.stdout:{"epoch":21,"fsid":"042652d3-d80c-4ad8-9366-3e94f2a0a512","created":"2023-07-05T18:55:56.455710+0000","modified":"2023-07-05T18:56:16.095672+0000","last_up_change":"2023-07-05T18:56:06.594022+0000","last_in_change":"2023-07-05T18:55:58.879340+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-07-05T18:56:07.729620+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2023-07-05T18:56:08.128122+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-07-05T18:56:12.954625+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-07-05T18:56:14.068396+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"20009183-9a47-4392-8751-883f88d2bfb1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6813","nonce":4151971443},{"type":"v1","addr":"172.21.15.46:6815","nonce":4151971443}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6817","nonce":4151971443},{"type":"v1","addr":"172.21.15.46:6818","nonce":4151971443}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6822","nonce":4151971443},{"type":"v1","addr":"172.21.15.46:6823","nonce":4151971443}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6820","nonce":4151971443},{"type":"v1","addr":"172.21.15.46:6821","nonce":4151971443}]},"public_addr":"172.21.15.46:6815/4151971443","cluster_addr":"172.21.15.46:6818/4151971443","heartbeat_back_addr":"172.21.15.46:6823/4151971443","heartbeat_front_addr":"172.21.15.46:6821/4151971443","state":["exists","up"]},{"osd":1,"uuid":"91b4a7b0-e4e4-4888-a1fe-9edb0d68004c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6808","nonce":502575881},{"type":"v1","addr":"172.21.15.46:6809","nonce":502575881}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6810","nonce":502575881},{"type":"v1","addr":"172.21.15.46:6811","nonce":502575881}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6816","nonce":502575881},{"type":"v1","addr":"172.21.15.46:6819","nonce":502575881}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6812","nonce":502575881},{"type":"v1","addr":"172.21.15.46:6814","nonce":502575881}]},"public_addr":"172.21.15.46:6809/502575881","cluster_addr":"172.21.15.46:6811/502575881","heartbeat_back_addr":"172.21.15.46:6819/502575881","heartbeat_front_addr":"172.21.15.46:6814/502575881","state":["exists","up"]},{"osd":2,"uuid":"669ff744-1331-47c5-8579-0440731c889a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6800","nonce":2115251461},{"type":"v1","addr":"172.21.15.46:6801","nonce":2115251461}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6802","nonce":2115251461},{"type":"v1","addr":"172.21.15.46:6803","nonce":2115251461}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6806","nonce":2115251461},{"type":"v1","addr":"172.21.15.46:6807","nonce":2115251461}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6804","nonce":2115251461},{"type":"v1","addr":"172.21.15.46:6805","nonce":2115251461}]},"public_addr":"172.21.15.46:6801/2115251461","cluster_addr":"172.21.15.46:6803/2115251461","heartbeat_back_addr":"172.21.15.46:6807/2115251461","heartbeat_front_addr":"172.21.15.46:6805/2115251461","state":["exists","up"]},{"osd":3,"uuid":"34e1b86d-ffad-415d-861c-07a5f08068a6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6824","nonce":2981388766},{"type":"v1","addr":"172.21.15.46:6825","nonce":2981388766}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6826","nonce":2981388766},{"type":"v1","addr":"172.21.15.46:6827","nonce":2981388766}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6830","nonce":2981388766},{"type":"v1","addr":"172.21.15.46:6831","nonce":2981388766}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6828","nonce":2981388766},{"type":"v1","addr":"172.21.15.46:6829","nonce":2981388766}]},"public_addr":"172.21.15.46:6825/2981388766","cluster_addr":"172.21.15.46:6827/2981388766","heartbeat_back_addr":"172.21.15.46:6831/2981388766","heartbeat_front_addr":"172.21.15.46:6829/2981388766","state":["exists","up"]},{"osd":4,"uuid":"57ffcb91-c7dc-4a69-ae71-4d9622a14a05","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6800","nonce":2083655348},{"type":"v1","addr":"172.21.15.73:6801","nonce":2083655348}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6802","nonce":2083655348},{"type":"v1","addr":"172.21.15.73:6803","nonce":2083655348}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6806","nonce":2083655348},{"type":"v1","addr":"172.21.15.73:6807","nonce":2083655348}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6804","nonce":2083655348},{"type":"v1","addr":"172.21.15.73:6805","nonce":2083655348}]},"public_addr":"172.21.15.73:6801/2083655348","cluster_addr":"172.21.15.73:6803/2083655348","heartbeat_back_addr":"172.21.15.73:6807/2083655348","heartbeat_front_addr":"172.21.15.73:6805/2083655348","state":["exists","up"]},{"osd":5,"uuid":"665f41c9-ee20-49cf-bf0e-fbe0c03d3aed","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6824","nonce":2803788401},{"type":"v1","addr":"172.21.15.73:6825","nonce":2803788401}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6826","nonce":2803788401},{"type":"v1","addr":"172.21.15.73:6827","nonce":2803788401}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6830","nonce":2803788401},{"type":"v1","addr":"172.21.15.73:6831","nonce":2803788401}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6828","nonce":2803788401},{"type":"v1","addr":"172.21.15.73:6829","nonce":2803788401}]},"public_addr":"172.21.15.73:6825/2803788401","cluster_addr":"172.21.15.73:6827/2803788401","heartbeat_back_addr":"172.21.15.73:6831/2803788401","heartbeat_front_addr":"172.21.15.73:6829/2803788401","state":["exists","up"]},{"osd":6,"uuid":"5790c6cc-bd56-4ce4-9a7c-0f0c3b59215c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6808","nonce":974108383},{"type":"v1","addr":"172.21.15.73:6809","nonce":974108383}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6810","nonce":974108383},{"type":"v1","addr":"172.21.15.73:6811","nonce":974108383}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6815","nonce":974108383},{"type":"v1","addr":"172.21.15.73:6817","nonce":974108383}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6812","nonce":974108383},{"type":"v1","addr":"172.21.15.73:6813","nonce":974108383}]},"public_addr":"172.21.15.73:6809/974108383","cluster_addr":"172.21.15.73:6811/974108383","heartbeat_back_addr":"172.21.15.73:6817/974108383","heartbeat_front_addr":"172.21.15.73:6813/974108383","state":["exists","up"]},{"osd":7,"uuid":"b66f4d2e-147e-4c9b-97dd-cbd59d33802e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6814","nonce":3772673248},{"type":"v1","addr":"172.21.15.73:6816","nonce":3772673248}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6818","nonce":3772673248},{"type":"v1","addr":"172.21.15.73:6819","nonce":3772673248}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6822","nonce":3772673248},{"type":"v1","addr":"172.21.15.73:6823","nonce":3772673248}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6820","nonce":3772673248},{"type":"v1","addr":"172.21.15.73:6821","nonce":3772673248}]},"public_addr":"172.21.15.73:6816/3772673248","cluster_addr":"172.21.15.73:6819/3772673248","heartbeat_back_addr":"172.21.15.73:6823/3772673248","heartbeat_front_addr":"172.21.15.73:6821/3772673248","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-05T18:56:04.115334+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-05T18:56:04.071250+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-05T18:56:04.044387+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-05T18:56:04.085389+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-05T18:56:04.090726+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-05T18:56:04.074529+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-05T18:56:04.058841+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-05T18:56:04.043054+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-05T18:56:18.995 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:18.993+0000 7fd1799b1700 1 -- 172.21.15.46:0/1200281810 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7fd16006ad10 msgr2=0x7fd16006d1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:56:18.996 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:18.993+0000 7fd1799b1700 1 --2- 172.21.15.46:0/1200281810 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7fd16006ad10 0x7fd16006d1c0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fd1740b45a0 tx=0x7fd168013000 comp rx=0 tx=0).stop 2023-07-05T18:56:18.996 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:18.993+0000 7fd1799b1700 1 -- 172.21.15.46:0/1200281810 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd15c003f80 msgr2=0x7fd1741f2120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:56:18.996 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:18.993+0000 7fd1799b1700 1 --2- 172.21.15.46:0/1200281810 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd15c003f80 0x7fd1741f2120 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fd164000fb0 tx=0x7fd1640075f0 comp rx=0 tx=0).stop 2023-07-05T18:56:18.996 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:18.993+0000 7fd1799b1700 1 -- 172.21.15.46:0/1200281810 shutdown_connections 2023-07-05T18:56:18.996 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:18.993+0000 7fd1799b1700 1 --2- 172.21.15.46:0/1200281810 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7fd16006ad10 0x7fd16006d1c0 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:18.996 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:18.993+0000 7fd1799b1700 1 --2- 172.21.15.46:0/1200281810 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd1740cbc50 0x7fd17415ff90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:18.996 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:18.993+0000 7fd1799b1700 1 --2- 172.21.15.46:0/1200281810 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd15c003f80 0x7fd1741f2120 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:18.997 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:18.993+0000 7fd1799b1700 1 --2- 172.21.15.46:0/1200281810 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fd17415aed0 0x7fd17415a6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:18.997 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:18.993+0000 7fd1799b1700 1 -- 172.21.15.46:0/1200281810 >> 172.21.15.46:0/1200281810 conn(0x7fd17406afa0 msgr2=0x7fd1740b79d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-05T18:56:18.997 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:18.993+0000 7fd1799b1700 1 -- 172.21.15.46:0/1200281810 shutdown_connections 2023-07-05T18:56:18.997 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:18.993+0000 7fd1799b1700 1 -- 172.21.15.46:0/1200281810 wait complete. 2023-07-05T18:56:19.007 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-07-05T18:56:19.008 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-07-05T18:56:19.132 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:19.130+0000 7fe57b60a700 1 Processor -- start 2023-07-05T18:56:19.133 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:19.130+0000 7fe57b60a700 1 -- start start 2023-07-05T18:56:19.139 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:19.131+0000 7fe57b60a700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fe57415c500 0x7fe57406ed50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:56:19.139 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:19.131+0000 7fe57b60a700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fe5740b33c0 0x7fe574069e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:56:19.139 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:19.131+0000 7fe57b60a700 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe57406a780 con 0x7fe57406a340 2023-07-05T18:56:19.139 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:19.131+0000 7fe57b60a700 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe57415c8d0 con 0x7fe5740b33c0 2023-07-05T18:56:19.139 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:19.131+0000 7fe57b60a700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe5740b4850 con 0x7fe57415c500 2023-07-05T18:56:19.140 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:19.132+0000 7fe5793a6700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fe57415c500 0x7fe57406ed50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:56:19.140 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:19.132+0000 7fe578ba5700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fe5740b33c0 0x7fe574069e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:56:19.140 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:19.132+0000 7fe579ba7700 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7fe57406a340 0x7fe5740cf660 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.46:42944/0 (socket says 172.21.15.46:42944) 2023-07-05T18:56:19.140 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:19.132+0000 7fe579ba7700 1 -- 172.21.15.46:0/340339751 learned_addr learned my addr 172.21.15.46:0/340339751 (peer_addr_for_me v1:172.21.15.46:0/0) 2023-07-05T18:56:19.141 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:19.132+0000 7fe5793a6700 1 -- 172.21.15.46:0/340339751 >> v2:172.21.15.73:3300/0 conn(0x7fe5740b33c0 msgr2=0x7fe574069e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-05T18:56:19.141 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:19.132+0000 7fe567fff700 1 -- 172.21.15.46:0/340339751 <== mon.1 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3360872624 0 0) 0x7fe57406a780 con 0x7fe57406a340 2023-07-05T18:56:19.141 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:19.132+0000 7fe5793a6700 1 --2- 172.21.15.46:0/340339751 >> v2:172.21.15.73:3300/0 conn(0x7fe5740b33c0 0x7fe574069e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:19.141 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:19.132+0000 7fe5793a6700 1 -- 172.21.15.46:0/340339751 >> v1:172.21.15.73:6789/0 conn(0x7fe57406a340 legacy=0x7fe5740cf660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:56:19.141 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:19.132+0000 7fe5793a6700 1 -- 172.21.15.46:0/340339751 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe5740b4b30 con 0x7fe57415c500 2023-07-05T18:56:19.141 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:19.132+0000 7fe5793a6700 1 --2- 172.21.15.46:0/340339751 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fe57415c500 0x7fe57406ed50 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fe570009840 tx=0x7fe570009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1ab8d5bf4ecf24eb server_cookie=0 in_seq=0 out_seq=0 2023-07-05T18:56:19.141 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:19.132+0000 7fe567fff700 1 -- 172.21.15.46:0/340339751 <== mon.2 v2:172.21.15.73:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe570011830 con 0x7fe57415c500 2023-07-05T18:56:19.141 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:19.132+0000 7fe567fff700 1 -- 172.21.15.46:0/340339751 <== mon.2 v2:172.21.15.73:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe570011990 con 0x7fe57415c500 2023-07-05T18:56:19.142 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:19.132+0000 7fe567fff700 1 -- 172.21.15.46:0/340339751 <== mon.2 v2:172.21.15.73:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe570011d20 con 0x7fe57415c500 2023-07-05T18:56:19.142 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:19.133+0000 7fe57b60a700 1 -- 172.21.15.46:0/340339751 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fe57415c500 msgr2=0x7fe57406ed50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:56:19.142 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:19.133+0000 7fe57b60a700 1 --2- 172.21.15.46:0/340339751 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fe57415c500 0x7fe57406ed50 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fe570009840 tx=0x7fe570009b50 comp rx=0 tx=0).stop 2023-07-05T18:56:19.142 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:19.133+0000 7fe57b60a700 1 -- 172.21.15.46:0/340339751 shutdown_connections 2023-07-05T18:56:19.142 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:19.133+0000 7fe57b60a700 1 --2- 172.21.15.46:0/340339751 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fe57415c500 0x7fe57406ed50 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:19.142 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:19.133+0000 7fe57b60a700 1 --2- 172.21.15.46:0/340339751 >> v2:172.21.15.73:3300/0 conn(0x7fe5740b33c0 0x7fe574069e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:19.142 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:19.133+0000 7fe57b60a700 1 -- 172.21.15.46:0/340339751 >> 172.21.15.46:0/340339751 conn(0x7fe57406af10 msgr2=0x7fe57406b2e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-05T18:56:19.143 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:19.133+0000 7fe57b60a700 1 -- 172.21.15.46:0/340339751 shutdown_connections 2023-07-05T18:56:19.143 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:19.133+0000 7fe57b60a700 1 -- 172.21.15.46:0/340339751 wait complete. 2023-07-05T18:56:19.143 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:19.134+0000 7fe57b60a700 1 Processor -- start 2023-07-05T18:56:19.143 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:19.134+0000 7fe57b60a700 1 -- start start 2023-07-05T18:56:19.143 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:19.135+0000 7fe57b60a700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe57406a340 0x7fe5741f1720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:56:19.144 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:19.135+0000 7fe57b60a700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fe5740b33c0 0x7fe574157530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:56:19.144 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:19.135+0000 7fe57b60a700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe57415c500 0x7fe5740ce4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:56:19.144 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:19.135+0000 7fe57b60a700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5740cf630 con 0x7fe57406a340 2023-07-05T18:56:19.145 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:19.135+0000 7fe57b60a700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5740cf070 con 0x7fe57415c500 2023-07-05T18:56:19.145 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:19.135+0000 7fe57b60a700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe5740cf350 con 0x7fe5740b33c0 2023-07-05T18:56:19.145 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:19.135+0000 7fe5793a6700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe57406a340 0x7fe5741f1720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:56:19.146 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:19.135+0000 7fe5793a6700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe57406a340 0x7fe5741f1720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:57758/0 (socket says 172.21.15.46:57758) 2023-07-05T18:56:19.146 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:19.135+0000 7fe5793a6700 1 -- 172.21.15.46:0/3923871230 learned_addr learned my addr 172.21.15.46:0/3923871230 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-07-05T18:56:19.146 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:19.135+0000 7fe578ba5700 1 --2- 172.21.15.46:0/3923871230 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fe5740b33c0 0x7fe574157530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:56:19.146 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:19.135+0000 7fe579ba7700 1 --2- 172.21.15.46:0/3923871230 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe57415c500 0x7fe5740ce4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:56:19.146 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:19.135+0000 7fe5793a6700 1 -- 172.21.15.46:0/3923871230 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fe5740b33c0 msgr2=0x7fe574157530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:56:19.146 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:19.135+0000 7fe5793a6700 1 --2- 172.21.15.46:0/3923871230 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fe5740b33c0 0x7fe574157530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:19.146 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:19.135+0000 7fe5793a6700 1 -- 172.21.15.46:0/3923871230 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe57415c500 msgr2=0x7fe5740ce4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:56:19.147 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:19.135+0000 7fe5793a6700 1 --2- 172.21.15.46:0/3923871230 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe57415c500 0x7fe5740ce4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:19.147 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:19.135+0000 7fe5793a6700 1 -- 172.21.15.46:0/3923871230 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe5700094a0 con 0x7fe57406a340 2023-07-05T18:56:19.147 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:19.135+0000 7fe5793a6700 1 --2- 172.21.15.46:0/3923871230 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe57406a340 0x7fe5741f1720 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fe570009fd0 tx=0x7fe570004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-05T18:56:19.147 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:19.136+0000 7fe565ffb700 1 -- 172.21.15.46:0/3923871230 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5700036a0 con 0x7fe57406a340 2023-07-05T18:56:19.147 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:19.136+0000 7fe565ffb700 1 -- 172.21.15.46:0/3923871230 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe570003800 con 0x7fe57406a340 2023-07-05T18:56:19.147 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:19.136+0000 7fe57b60a700 1 -- 172.21.15.46:0/3923871230 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe574156d30 con 0x7fe57406a340 2023-07-05T18:56:19.147 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:19.136+0000 7fe565ffb700 1 -- 172.21.15.46:0/3923871230 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe570003bb0 con 0x7fe57406a340 2023-07-05T18:56:19.147 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:19.136+0000 7fe57b60a700 1 -- 172.21.15.46:0/3923871230 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe5741f21c0 con 0x7fe57406a340 2023-07-05T18:56:19.148 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:19.137+0000 7fe57b60a700 1 -- 172.21.15.46:0/3923871230 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe574156b90 con 0x7fe57406a340 2023-07-05T18:56:19.148 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:19.137+0000 7fe565ffb700 1 -- 172.21.15.46:0/3923871230 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fe570003d10 con 0x7fe57406a340 2023-07-05T18:56:19.149 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:19.137+0000 7fe565ffb700 1 --2- 172.21.15.46:0/3923871230 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7fe55806ace0 0x7fe55806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:56:19.151 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:19.138+0000 7fe565ffb700 1 -- 172.21.15.46:0/3923871230 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fe57008a970 con 0x7fe57406a340 2023-07-05T18:56:19.151 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:19.138+0000 7fe578ba5700 1 --2- 172.21.15.46:0/3923871230 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7fe55806ace0 0x7fe55806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:56:19.151 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:19.138+0000 7fe578ba5700 1 --2- 172.21.15.46:0/3923871230 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7fe55806ace0 0x7fe55806d190 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fe5741535c0 tx=0x7fe568008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-05T18:56:19.151 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:19.142+0000 7fe565ffb700 1 -- 172.21.15.46:0/3923871230 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fe574156b90 con 0x7fe57406a340 2023-07-05T18:56:19.338 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:19.336+0000 7fe57b60a700 1 -- 172.21.15.46:0/3923871230 --> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fe57406e550 con 0x7fe55806ace0 2023-07-05T18:56:19.348 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:19.345+0000 7fe565ffb700 1 -- 172.21.15.46:0/3923871230 <== mgr.4099 v2:172.21.15.73:6832/3033361733 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+286913 (secure 0 0 0) 0x7fe568011780 con 0x7fe55806ace0 2023-07-05T18:56:19.351 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T18:56:19.352 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:19.348+0000 7fe57b60a700 1 -- 172.21.15.46:0/3923871230 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7fe55806ace0 msgr2=0x7fe55806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:56:19.353 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:19.348+0000 7fe57b60a700 1 --2- 172.21.15.46:0/3923871230 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7fe55806ace0 0x7fe55806d190 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fe5741535c0 tx=0x7fe568008040 comp rx=0 tx=0).stop 2023-07-05T18:56:19.353 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:19.348+0000 7fe57b60a700 1 -- 172.21.15.46:0/3923871230 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe57406a340 msgr2=0x7fe5741f1720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:56:19.353 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:19.348+0000 7fe57b60a700 1 --2- 172.21.15.46:0/3923871230 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe57406a340 0x7fe5741f1720 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fe570009fd0 tx=0x7fe570004750 comp rx=0 tx=0).stop 2023-07-05T18:56:19.353 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:19.348+0000 7fe57b60a700 1 -- 172.21.15.46:0/3923871230 shutdown_connections 2023-07-05T18:56:19.353 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:19.348+0000 7fe57b60a700 1 --2- 172.21.15.46:0/3923871230 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7fe55806ace0 0x7fe55806d190 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:19.353 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:19.348+0000 7fe57b60a700 1 --2- 172.21.15.46:0/3923871230 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe57415c500 0x7fe5740ce4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:19.353 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:19.348+0000 7fe57b60a700 1 --2- 172.21.15.46:0/3923871230 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe57406a340 0x7fe5741f1720 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:19.354 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:19.348+0000 7fe57b60a700 1 --2- 172.21.15.46:0/3923871230 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fe5740b33c0 0x7fe574157530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:19.354 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:19.348+0000 7fe57b60a700 1 -- 172.21.15.46:0/3923871230 >> 172.21.15.46:0/3923871230 conn(0x7fe57406af10 msgr2=0x7fe5740cbba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-05T18:56:19.354 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:19.348+0000 7fe57b60a700 1 -- 172.21.15.46:0/3923871230 shutdown_connections 2023-07-05T18:56:19.354 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:19.348+0000 7fe57b60a700 1 -- 172.21.15.46:0/3923871230 wait complete. 2023-07-05T18:56:19.354 INFO:teuthology.orchestra.run.smithi046.stderr:dumped all 2023-07-05T18:56:19.362 INFO:teuthology.orchestra.run.smithi046.stdout:{"pg_ready":true,"pg_map":{"version":20,"stamp":"2023-07-05T18:56:18.072249+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":153,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":218484,"kb_used_data":2868,"kb_used_omap":0,"kb_used_meta":215552,"kb_avail":754756236,"statfs":{"total":773094113280,"available":772870385664,"internally_reserved":0,"allocated":2936832,"data_stored":1790679,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":220725248},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":27,"apply_latency_ms":27,"commit_latency_ns":27000000,"apply_latency_ns":27000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2362,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.406488"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-07-05T18:56:15.118147+0000","last_change":"2023-07-05T18:56:15.115312+0000","last_active":"2023-07-05T18:56:15.118147+0000","last_peered":"2023-07-05T18:56:15.118147+0000","last_clean":"2023-07-05T18:56:15.118147+0000","last_became_active":"2023-07-05T18:56:15.115039+0000","last_became_peered":"2023-07-05T18:56:15.115039+0000","last_unstale":"2023-07-05T18:56:15.118147+0000","last_undegraded":"2023-07-05T18:56:15.118147+0000","last_fullsized":"2023-07-05T18:56:15.118147+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T18:56:14.665171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T18:56:14.665171+0000","last_clean_scrub_stamp":"2023-07-05T18:56:14.665171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-06T19:40:27.233987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-05T18:56:16.104997+0000","last_change":"2023-07-05T18:56:15.113285+0000","last_active":"2023-07-05T18:56:16.104997+0000","last_peered":"2023-07-05T18:56:16.104997+0000","last_clean":"2023-07-05T18:56:16.104997+0000","last_became_active":"2023-07-05T18:56:15.113019+0000","last_became_peered":"2023-07-05T18:56:15.113019+0000","last_unstale":"2023-07-05T18:56:16.104997+0000","last_undegraded":"2023-07-05T18:56:16.104997+0000","last_fullsized":"2023-07-05T18:56:16.104997+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T18:56:14.665171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T18:56:14.665171+0000","last_clean_scrub_stamp":"2023-07-05T18:56:14.665171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-06T19:43:28.708822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-07-05T18:56:15.133649+0000","last_change":"2023-07-05T18:56:15.127147+0000","last_active":"2023-07-05T18:56:15.133649+0000","last_peered":"2023-07-05T18:56:15.133649+0000","last_clean":"2023-07-05T18:56:15.133649+0000","last_became_active":"2023-07-05T18:56:15.126775+0000","last_became_peered":"2023-07-05T18:56:15.126775+0000","last_unstale":"2023-07-05T18:56:15.133649+0000","last_undegraded":"2023-07-05T18:56:15.133649+0000","last_fullsized":"2023-07-05T18:56:15.133649+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T18:56:14.665171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T18:56:14.665171+0000","last_clean_scrub_stamp":"2023-07-05T18:56:14.665171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T01:07:17.521433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-05T18:56:16.105116+0000","last_change":"2023-07-05T18:56:15.119204+0000","last_active":"2023-07-05T18:56:16.105116+0000","last_peered":"2023-07-05T18:56:16.105116+0000","last_clean":"2023-07-05T18:56:16.105116+0000","last_became_active":"2023-07-05T18:56:15.118931+0000","last_became_peered":"2023-07-05T18:56:15.118931+0000","last_unstale":"2023-07-05T18:56:16.105116+0000","last_undegraded":"2023-07-05T18:56:16.105116+0000","last_fullsized":"2023-07-05T18:56:16.105116+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T18:56:14.665171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T18:56:14.665171+0000","last_clean_scrub_stamp":"2023-07-05T18:56:14.665171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T03:19:04.962412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-05T18:56:16.473979+0000","last_change":"2023-07-05T18:56:15.125822+0000","last_active":"2023-07-05T18:56:16.473979+0000","last_peered":"2023-07-05T18:56:16.473979+0000","last_clean":"2023-07-05T18:56:16.473979+0000","last_became_active":"2023-07-05T18:56:15.121836+0000","last_became_peered":"2023-07-05T18:56:15.121836+0000","last_unstale":"2023-07-05T18:56:16.473979+0000","last_undegraded":"2023-07-05T18:56:16.473979+0000","last_fullsized":"2023-07-05T18:56:16.473979+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T18:56:14.665171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T18:56:14.665171+0000","last_clean_scrub_stamp":"2023-07-05T18:56:14.665171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T02:49:05.937629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-07-05T18:56:15.133528+0000","last_change":"2023-07-05T18:56:15.125381+0000","last_active":"2023-07-05T18:56:15.133528+0000","last_peered":"2023-07-05T18:56:15.133528+0000","last_clean":"2023-07-05T18:56:15.133528+0000","last_became_active":"2023-07-05T18:56:15.124055+0000","last_became_peered":"2023-07-05T18:56:15.124055+0000","last_unstale":"2023-07-05T18:56:15.133528+0000","last_undegraded":"2023-07-05T18:56:15.133528+0000","last_fullsized":"2023-07-05T18:56:15.133528+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T18:56:14.665171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T18:56:14.665171+0000","last_clean_scrub_stamp":"2023-07-05T18:56:14.665171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-06T19:42:33.771965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-05T18:56:17.158259+0000","last_change":"2023-07-05T18:56:15.116938+0000","last_active":"2023-07-05T18:56:17.158259+0000","last_peered":"2023-07-05T18:56:17.158259+0000","last_clean":"2023-07-05T18:56:17.158259+0000","last_became_active":"2023-07-05T18:56:15.116592+0000","last_became_peered":"2023-07-05T18:56:15.116592+0000","last_unstale":"2023-07-05T18:56:17.158259+0000","last_undegraded":"2023-07-05T18:56:17.158259+0000","last_fullsized":"2023-07-05T18:56:17.158259+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T18:56:14.665171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T18:56:14.665171+0000","last_clean_scrub_stamp":"2023-07-05T18:56:14.665171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T02:30:29.740847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-05T18:56:16.104826+0000","last_change":"2023-07-05T18:56:15.127587+0000","last_active":"2023-07-05T18:56:16.104826+0000","last_peered":"2023-07-05T18:56:16.104826+0000","last_clean":"2023-07-05T18:56:16.104826+0000","last_became_active":"2023-07-05T18:56:15.127359+0000","last_became_peered":"2023-07-05T18:56:15.127359+0000","last_unstale":"2023-07-05T18:56:16.104826+0000","last_undegraded":"2023-07-05T18:56:16.104826+0000","last_fullsized":"2023-07-05T18:56:16.104826+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T18:56:14.665171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T18:56:14.665171+0000","last_clean_scrub_stamp":"2023-07-05T18:56:14.665171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T01:07:17.521433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-05T18:56:16.474116+0000","last_change":"2023-07-05T18:56:15.123724+0000","last_active":"2023-07-05T18:56:16.474116+0000","last_peered":"2023-07-05T18:56:16.474116+0000","last_clean":"2023-07-05T18:56:16.474116+0000","last_became_active":"2023-07-05T18:56:15.121678+0000","last_became_peered":"2023-07-05T18:56:15.121678+0000","last_unstale":"2023-07-05T18:56:16.474116+0000","last_undegraded":"2023-07-05T18:56:16.474116+0000","last_fullsized":"2023-07-05T18:56:16.474116+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T18:56:14.665171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T18:56:14.665171+0000","last_clean_scrub_stamp":"2023-07-05T18:56:14.665171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T02:24:35.873082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-05T18:56:16.105387+0000","last_change":"2023-07-05T18:56:15.121695+0000","last_active":"2023-07-05T18:56:16.105387+0000","last_peered":"2023-07-05T18:56:16.105387+0000","last_clean":"2023-07-05T18:56:16.105387+0000","last_became_active":"2023-07-05T18:56:15.121418+0000","last_became_peered":"2023-07-05T18:56:15.121418+0000","last_unstale":"2023-07-05T18:56:16.105387+0000","last_undegraded":"2023-07-05T18:56:16.105387+0000","last_fullsized":"2023-07-05T18:56:16.105387+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T18:56:14.665171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T18:56:14.665171+0000","last_clean_scrub_stamp":"2023-07-05T18:56:14.665171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-06T21:50:37.526388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-07-05T18:56:15.133668+0000","last_change":"2023-07-05T18:56:15.127138+0000","last_active":"2023-07-05T18:56:15.133668+0000","last_peered":"2023-07-05T18:56:15.133668+0000","last_clean":"2023-07-05T18:56:15.133668+0000","last_became_active":"2023-07-05T18:56:15.126770+0000","last_became_peered":"2023-07-05T18:56:15.126770+0000","last_unstale":"2023-07-05T18:56:15.133668+0000","last_undegraded":"2023-07-05T18:56:15.133668+0000","last_fullsized":"2023-07-05T18:56:15.133668+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T18:56:14.665171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T18:56:14.665171+0000","last_clean_scrub_stamp":"2023-07-05T18:56:14.665171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-06T23:52:22.775261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-07-05T18:56:15.127693+0000","last_change":"2023-07-05T18:56:15.127292+0000","last_active":"2023-07-05T18:56:15.127693+0000","last_peered":"2023-07-05T18:56:15.127693+0000","last_clean":"2023-07-05T18:56:15.127693+0000","last_became_active":"2023-07-05T18:56:15.127061+0000","last_became_peered":"2023-07-05T18:56:15.127061+0000","last_unstale":"2023-07-05T18:56:15.127693+0000","last_undegraded":"2023-07-05T18:56:15.127693+0000","last_fullsized":"2023-07-05T18:56:15.127693+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T18:56:14.665171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T18:56:14.665171+0000","last_clean_scrub_stamp":"2023-07-05T18:56:14.665171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T06:17:55.964119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-07-05T18:56:15.116160+0000","last_change":"2023-07-05T18:56:15.114803+0000","last_active":"2023-07-05T18:56:15.116160+0000","last_peered":"2023-07-05T18:56:15.116160+0000","last_clean":"2023-07-05T18:56:15.116160+0000","last_became_active":"2023-07-05T18:56:15.114491+0000","last_became_peered":"2023-07-05T18:56:15.114491+0000","last_unstale":"2023-07-05T18:56:15.116160+0000","last_undegraded":"2023-07-05T18:56:15.116160+0000","last_fullsized":"2023-07-05T18:56:15.116160+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T18:56:14.665171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T18:56:14.665171+0000","last_clean_scrub_stamp":"2023-07-05T18:56:14.665171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T00:07:37.342862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-05T18:56:16.105534+0000","last_change":"2023-07-05T18:56:15.108218+0000","last_active":"2023-07-05T18:56:16.105534+0000","last_peered":"2023-07-05T18:56:16.105534+0000","last_clean":"2023-07-05T18:56:16.105534+0000","last_became_active":"2023-07-05T18:56:15.107769+0000","last_became_peered":"2023-07-05T18:56:15.107769+0000","last_unstale":"2023-07-05T18:56:16.105534+0000","last_undegraded":"2023-07-05T18:56:16.105534+0000","last_fullsized":"2023-07-05T18:56:16.105534+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T18:56:14.665171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T18:56:14.665171+0000","last_clean_scrub_stamp":"2023-07-05T18:56:14.665171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T03:19:04.962412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-05T18:56:17.158599+0000","last_change":"2023-07-05T18:56:15.119803+0000","last_active":"2023-07-05T18:56:17.158599+0000","last_peered":"2023-07-05T18:56:17.158599+0000","last_clean":"2023-07-05T18:56:17.158599+0000","last_became_active":"2023-07-05T18:56:15.119429+0000","last_became_peered":"2023-07-05T18:56:15.119429+0000","last_unstale":"2023-07-05T18:56:17.158599+0000","last_undegraded":"2023-07-05T18:56:17.158599+0000","last_fullsized":"2023-07-05T18:56:17.158599+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T18:56:14.665171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T18:56:14.665171+0000","last_clean_scrub_stamp":"2023-07-05T18:56:14.665171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T03:39:30.527160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-07-05T18:56:15.133733+0000","last_change":"2023-07-05T18:56:15.128556+0000","last_active":"2023-07-05T18:56:15.133733+0000","last_peered":"2023-07-05T18:56:15.133733+0000","last_clean":"2023-07-05T18:56:15.133733+0000","last_became_active":"2023-07-05T18:56:15.128307+0000","last_became_peered":"2023-07-05T18:56:15.128307+0000","last_unstale":"2023-07-05T18:56:15.133733+0000","last_undegraded":"2023-07-05T18:56:15.133733+0000","last_fullsized":"2023-07-05T18:56:15.133733+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T18:56:14.665171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T18:56:14.665171+0000","last_clean_scrub_stamp":"2023-07-05T18:56:14.665171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T04:47:53.525224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-05T18:56:16.474111+0000","last_change":"2023-07-05T18:56:15.121918+0000","last_active":"2023-07-05T18:56:16.474111+0000","last_peered":"2023-07-05T18:56:16.474111+0000","last_clean":"2023-07-05T18:56:16.474111+0000","last_became_active":"2023-07-05T18:56:15.121400+0000","last_became_peered":"2023-07-05T18:56:15.121400+0000","last_unstale":"2023-07-05T18:56:16.474111+0000","last_undegraded":"2023-07-05T18:56:16.474111+0000","last_fullsized":"2023-07-05T18:56:16.474111+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T18:56:14.665171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T18:56:14.665171+0000","last_clean_scrub_stamp":"2023-07-05T18:56:14.665171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-06T21:50:37.526388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-07-05T18:56:15.133684+0000","last_change":"2023-07-05T18:56:15.127191+0000","last_active":"2023-07-05T18:56:15.133684+0000","last_peered":"2023-07-05T18:56:15.133684+0000","last_clean":"2023-07-05T18:56:15.133684+0000","last_became_active":"2023-07-05T18:56:15.126872+0000","last_became_peered":"2023-07-05T18:56:15.126872+0000","last_unstale":"2023-07-05T18:56:15.133684+0000","last_undegraded":"2023-07-05T18:56:15.133684+0000","last_fullsized":"2023-07-05T18:56:15.133684+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T18:56:14.665171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T18:56:14.665171+0000","last_clean_scrub_stamp":"2023-07-05T18:56:14.665171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-06T19:58:32.961693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-07-05T18:56:15.114012+0000","last_change":"2023-07-05T18:56:15.108982+0000","last_active":"2023-07-05T18:56:15.114012+0000","last_peered":"2023-07-05T18:56:15.114012+0000","last_clean":"2023-07-05T18:56:15.114012+0000","last_became_active":"2023-07-05T18:56:15.108461+0000","last_became_peered":"2023-07-05T18:56:15.108461+0000","last_unstale":"2023-07-05T18:56:15.114012+0000","last_undegraded":"2023-07-05T18:56:15.114012+0000","last_fullsized":"2023-07-05T18:56:15.114012+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T18:56:14.665171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T18:56:14.665171+0000","last_clean_scrub_stamp":"2023-07-05T18:56:14.665171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T05:30:14.562901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-07-05T18:56:15.133518+0000","last_change":"2023-07-05T18:56:15.124274+0000","last_active":"2023-07-05T18:56:15.133518+0000","last_peered":"2023-07-05T18:56:15.133518+0000","last_clean":"2023-07-05T18:56:15.133518+0000","last_became_active":"2023-07-05T18:56:15.123758+0000","last_became_peered":"2023-07-05T18:56:15.123758+0000","last_unstale":"2023-07-05T18:56:15.133518+0000","last_undegraded":"2023-07-05T18:56:15.133518+0000","last_fullsized":"2023-07-05T18:56:15.133518+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T18:56:14.665171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T18:56:14.665171+0000","last_clean_scrub_stamp":"2023-07-05T18:56:14.665171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-06T21:33:55.031584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-05T18:56:17.158642+0000","last_change":"2023-07-05T18:56:15.123685+0000","last_active":"2023-07-05T18:56:17.158642+0000","last_peered":"2023-07-05T18:56:17.158642+0000","last_clean":"2023-07-05T18:56:17.158642+0000","last_became_active":"2023-07-05T18:56:15.123431+0000","last_became_peered":"2023-07-05T18:56:15.123431+0000","last_unstale":"2023-07-05T18:56:17.158642+0000","last_undegraded":"2023-07-05T18:56:17.158642+0000","last_fullsized":"2023-07-05T18:56:17.158642+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T18:56:14.665171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T18:56:14.665171+0000","last_clean_scrub_stamp":"2023-07-05T18:56:14.665171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T04:41:48.823682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-05T18:56:16.473936+0000","last_change":"2023-07-05T18:56:15.116119+0000","last_active":"2023-07-05T18:56:16.473936+0000","last_peered":"2023-07-05T18:56:16.473936+0000","last_clean":"2023-07-05T18:56:16.473936+0000","last_became_active":"2023-07-05T18:56:15.115869+0000","last_became_peered":"2023-07-05T18:56:15.115869+0000","last_unstale":"2023-07-05T18:56:16.473936+0000","last_undegraded":"2023-07-05T18:56:16.473936+0000","last_fullsized":"2023-07-05T18:56:16.473936+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T18:56:14.665171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T18:56:14.665171+0000","last_clean_scrub_stamp":"2023-07-05T18:56:14.665171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-06T19:43:28.708822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-05T18:56:16.104324+0000","last_change":"2023-07-05T18:56:15.122698+0000","last_active":"2023-07-05T18:56:16.104324+0000","last_peered":"2023-07-05T18:56:16.104324+0000","last_clean":"2023-07-05T18:56:16.104324+0000","last_became_active":"2023-07-05T18:56:15.122391+0000","last_became_peered":"2023-07-05T18:56:15.122391+0000","last_unstale":"2023-07-05T18:56:16.104324+0000","last_undegraded":"2023-07-05T18:56:16.104324+0000","last_fullsized":"2023-07-05T18:56:16.104324+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T18:56:14.665171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T18:56:14.665171+0000","last_clean_scrub_stamp":"2023-07-05T18:56:14.665171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T03:02:00.204080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-05T18:56:17.158207+0000","last_change":"2023-07-05T18:56:15.125120+0000","last_active":"2023-07-05T18:56:17.158207+0000","last_peered":"2023-07-05T18:56:17.158207+0000","last_clean":"2023-07-05T18:56:17.158207+0000","last_became_active":"2023-07-05T18:56:15.124790+0000","last_became_peered":"2023-07-05T18:56:15.124790+0000","last_unstale":"2023-07-05T18:56:17.158207+0000","last_undegraded":"2023-07-05T18:56:17.158207+0000","last_fullsized":"2023-07-05T18:56:17.158207+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T18:56:14.665171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T18:56:14.665171+0000","last_clean_scrub_stamp":"2023-07-05T18:56:14.665171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-06T21:14:58.040487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-05T18:56:17.190914+0000","last_change":"2023-07-05T18:56:15.109580+0000","last_active":"2023-07-05T18:56:17.190914+0000","last_peered":"2023-07-05T18:56:17.190914+0000","last_clean":"2023-07-05T18:56:17.190914+0000","last_became_active":"2023-07-05T18:56:15.109054+0000","last_became_peered":"2023-07-05T18:56:15.109054+0000","last_unstale":"2023-07-05T18:56:17.190914+0000","last_undegraded":"2023-07-05T18:56:17.190914+0000","last_fullsized":"2023-07-05T18:56:17.190914+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T18:56:14.665171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T18:56:14.665171+0000","last_clean_scrub_stamp":"2023-07-05T18:56:14.665171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T04:53:59.163434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-05T18:56:17.191114+0000","last_change":"2023-07-05T18:56:15.103610+0000","last_active":"2023-07-05T18:56:17.191114+0000","last_peered":"2023-07-05T18:56:17.191114+0000","last_clean":"2023-07-05T18:56:17.191114+0000","last_became_active":"2023-07-05T18:56:15.103321+0000","last_became_peered":"2023-07-05T18:56:15.103321+0000","last_unstale":"2023-07-05T18:56:17.191114+0000","last_undegraded":"2023-07-05T18:56:17.191114+0000","last_fullsized":"2023-07-05T18:56:17.191114+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T18:56:14.665171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T18:56:14.665171+0000","last_clean_scrub_stamp":"2023-07-05T18:56:14.665171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T03:02:00.204080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-05T18:56:16.105649+0000","last_change":"2023-07-05T18:56:15.121207+0000","last_active":"2023-07-05T18:56:16.105649+0000","last_peered":"2023-07-05T18:56:16.105649+0000","last_clean":"2023-07-05T18:56:16.105649+0000","last_became_active":"2023-07-05T18:56:15.120697+0000","last_became_peered":"2023-07-05T18:56:15.120697+0000","last_unstale":"2023-07-05T18:56:16.105649+0000","last_undegraded":"2023-07-05T18:56:16.105649+0000","last_fullsized":"2023-07-05T18:56:16.105649+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T18:56:14.665171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T18:56:14.665171+0000","last_clean_scrub_stamp":"2023-07-05T18:56:14.665171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T03:08:48.441898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"20'1","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-07-05T18:56:15.125510+0000","last_change":"2023-07-05T18:56:14.692934+0000","last_active":"2023-07-05T18:56:15.125510+0000","last_peered":"2023-07-05T18:56:15.125510+0000","last_clean":"2023-07-05T18:56:15.125510+0000","last_became_active":"2023-07-05T18:56:14.692645+0000","last_became_peered":"2023-07-05T18:56:14.692645+0000","last_unstale":"2023-07-05T18:56:15.125510+0000","last_undegraded":"2023-07-05T18:56:15.125510+0000","last_fullsized":"2023-07-05T18:56:15.125510+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T18:56:13.659893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T18:56:13.659893+0000","last_clean_scrub_stamp":"2023-07-05T18:56:13.659893+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T05:13:26.630999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-05T18:56:16.104876+0000","last_change":"2023-07-05T18:56:15.112376+0000","last_active":"2023-07-05T18:56:16.104876+0000","last_peered":"2023-07-05T18:56:16.104876+0000","last_clean":"2023-07-05T18:56:16.104876+0000","last_became_active":"2023-07-05T18:56:15.111904+0000","last_became_peered":"2023-07-05T18:56:15.111904+0000","last_unstale":"2023-07-05T18:56:16.104876+0000","last_undegraded":"2023-07-05T18:56:16.104876+0000","last_fullsized":"2023-07-05T18:56:16.104876+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T18:56:14.665171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T18:56:14.665171+0000","last_clean_scrub_stamp":"2023-07-05T18:56:14.665171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T03:39:30.527160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-05T18:56:17.190892+0000","last_change":"2023-07-05T18:56:14.698190+0000","last_active":"2023-07-05T18:56:17.190892+0000","last_peered":"2023-07-05T18:56:17.190892+0000","last_clean":"2023-07-05T18:56:17.190892+0000","last_became_active":"2023-07-05T18:56:14.697916+0000","last_became_peered":"2023-07-05T18:56:14.697916+0000","last_unstale":"2023-07-05T18:56:17.190892+0000","last_undegraded":"2023-07-05T18:56:17.190892+0000","last_fullsized":"2023-07-05T18:56:17.190892+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T18:56:13.659893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T18:56:13.659893+0000","last_clean_scrub_stamp":"2023-07-05T18:56:13.659893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T05:13:26.630999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-05T18:56:16.474349+0000","last_change":"2023-07-05T18:56:15.121188+0000","last_active":"2023-07-05T18:56:16.474349+0000","last_peered":"2023-07-05T18:56:16.474349+0000","last_clean":"2023-07-05T18:56:16.474349+0000","last_became_active":"2023-07-05T18:56:15.120955+0000","last_became_peered":"2023-07-05T18:56:15.120955+0000","last_unstale":"2023-07-05T18:56:16.474349+0000","last_undegraded":"2023-07-05T18:56:16.474349+0000","last_fullsized":"2023-07-05T18:56:16.474349+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T18:56:14.665171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T18:56:14.665171+0000","last_clean_scrub_stamp":"2023-07-05T18:56:14.665171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-06T21:14:58.040487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-05T18:56:16.104435+0000","last_change":"2023-07-05T18:56:14.689037+0000","last_active":"2023-07-05T18:56:16.104435+0000","last_peered":"2023-07-05T18:56:16.104435+0000","last_clean":"2023-07-05T18:56:16.104435+0000","last_became_active":"2023-07-05T18:56:14.688728+0000","last_became_peered":"2023-07-05T18:56:14.688728+0000","last_unstale":"2023-07-05T18:56:16.104435+0000","last_undegraded":"2023-07-05T18:56:16.104435+0000","last_fullsized":"2023-07-05T18:56:16.104435+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T18:56:13.659893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T18:56:13.659893+0000","last_clean_scrub_stamp":"2023-07-05T18:56:13.659893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-06T22:32:10.488434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-05T18:56:16.105018+0000","last_change":"2023-07-05T18:56:15.115710+0000","last_active":"2023-07-05T18:56:16.105018+0000","last_peered":"2023-07-05T18:56:16.105018+0000","last_clean":"2023-07-05T18:56:16.105018+0000","last_became_active":"2023-07-05T18:56:15.115354+0000","last_became_peered":"2023-07-05T18:56:15.115354+0000","last_unstale":"2023-07-05T18:56:16.105018+0000","last_undegraded":"2023-07-05T18:56:16.105018+0000","last_fullsized":"2023-07-05T18:56:16.105018+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T18:56:14.665171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T18:56:14.665171+0000","last_clean_scrub_stamp":"2023-07-05T18:56:14.665171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T02:24:35.873082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-05T18:56:16.474292+0000","last_change":"2023-07-05T18:56:14.689657+0000","last_active":"2023-07-05T18:56:16.474292+0000","last_peered":"2023-07-05T18:56:16.474292+0000","last_clean":"2023-07-05T18:56:16.474292+0000","last_became_active":"2023-07-05T18:56:14.689065+0000","last_became_peered":"2023-07-05T18:56:14.689065+0000","last_unstale":"2023-07-05T18:56:16.474292+0000","last_undegraded":"2023-07-05T18:56:16.474292+0000","last_fullsized":"2023-07-05T18:56:16.474292+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T18:56:13.659893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T18:56:13.659893+0000","last_clean_scrub_stamp":"2023-07-05T18:56:13.659893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T01:35:59.096513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-05T18:56:16.104489+0000","last_change":"2023-07-05T18:56:15.113602+0000","last_active":"2023-07-05T18:56:16.104489+0000","last_peered":"2023-07-05T18:56:16.104489+0000","last_clean":"2023-07-05T18:56:16.104489+0000","last_became_active":"2023-07-05T18:56:15.113313+0000","last_became_peered":"2023-07-05T18:56:15.113313+0000","last_unstale":"2023-07-05T18:56:16.104489+0000","last_undegraded":"2023-07-05T18:56:16.104489+0000","last_fullsized":"2023-07-05T18:56:16.104489+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T18:56:14.665171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T18:56:14.665171+0000","last_clean_scrub_stamp":"2023-07-05T18:56:14.665171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-06T21:14:58.040487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-05T18:56:16.105135+0000","last_change":"2023-07-05T18:56:14.686543+0000","last_active":"2023-07-05T18:56:16.105135+0000","last_peered":"2023-07-05T18:56:16.105135+0000","last_clean":"2023-07-05T18:56:16.105135+0000","last_became_active":"2023-07-05T18:56:14.686277+0000","last_became_peered":"2023-07-05T18:56:14.686277+0000","last_unstale":"2023-07-05T18:56:16.105135+0000","last_undegraded":"2023-07-05T18:56:16.105135+0000","last_fullsized":"2023-07-05T18:56:16.105135+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T18:56:13.659893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T18:56:13.659893+0000","last_clean_scrub_stamp":"2023-07-05T18:56:13.659893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T05:13:26.630999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-05T18:56:16.104551+0000","last_change":"2023-07-05T18:56:15.117293+0000","last_active":"2023-07-05T18:56:16.104551+0000","last_peered":"2023-07-05T18:56:16.104551+0000","last_clean":"2023-07-05T18:56:16.104551+0000","last_became_active":"2023-07-05T18:56:15.114133+0000","last_became_peered":"2023-07-05T18:56:15.114133+0000","last_unstale":"2023-07-05T18:56:16.104551+0000","last_undegraded":"2023-07-05T18:56:16.104551+0000","last_fullsized":"2023-07-05T18:56:16.104551+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T18:56:14.665171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T18:56:14.665171+0000","last_clean_scrub_stamp":"2023-07-05T18:56:14.665171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T02:13:19.229598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"20'3","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-05T18:56:17.158600+0000","last_change":"2023-07-05T18:56:14.697955+0000","last_active":"2023-07-05T18:56:17.158600+0000","last_peered":"2023-07-05T18:56:17.158600+0000","last_clean":"2023-07-05T18:56:17.158600+0000","last_became_active":"2023-07-05T18:56:14.697729+0000","last_became_peered":"2023-07-05T18:56:14.697729+0000","last_unstale":"2023-07-05T18:56:17.158600+0000","last_undegraded":"2023-07-05T18:56:17.158600+0000","last_fullsized":"2023-07-05T18:56:17.158600+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T18:56:13.659893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T18:56:13.659893+0000","last_clean_scrub_stamp":"2023-07-05T18:56:13.659893+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T00:22:00.885983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-05T18:56:17.190602+0000","last_change":"2023-07-05T18:56:15.119531+0000","last_active":"2023-07-05T18:56:17.190602+0000","last_peered":"2023-07-05T18:56:17.190602+0000","last_clean":"2023-07-05T18:56:17.190602+0000","last_became_active":"2023-07-05T18:56:15.118905+0000","last_became_peered":"2023-07-05T18:56:15.118905+0000","last_unstale":"2023-07-05T18:56:17.190602+0000","last_undegraded":"2023-07-05T18:56:17.190602+0000","last_fullsized":"2023-07-05T18:56:17.190602+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T18:56:14.665171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T18:56:14.665171+0000","last_clean_scrub_stamp":"2023-07-05T18:56:14.665171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T01:07:17.521433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"20'6","reported_seq":17,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-07-05T18:56:15.136565+0000","last_change":"2023-07-05T18:56:14.686257+0000","last_active":"2023-07-05T18:56:15.136565+0000","last_peered":"2023-07-05T18:56:15.136565+0000","last_clean":"2023-07-05T18:56:15.136565+0000","last_became_active":"2023-07-05T18:56:14.685975+0000","last_became_peered":"2023-07-05T18:56:14.685975+0000","last_unstale":"2023-07-05T18:56:15.136565+0000","last_undegraded":"2023-07-05T18:56:15.136565+0000","last_fullsized":"2023-07-05T18:56:15.136565+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T18:56:13.659893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T18:56:13.659893+0000","last_clean_scrub_stamp":"2023-07-05T18:56:13.659893+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T02:49:04.932352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-07-05T18:56:15.130813+0000","last_change":"2023-07-05T18:56:15.123521+0000","last_active":"2023-07-05T18:56:15.130813+0000","last_peered":"2023-07-05T18:56:15.130813+0000","last_clean":"2023-07-05T18:56:15.130813+0000","last_became_active":"2023-07-05T18:56:15.123249+0000","last_became_peered":"2023-07-05T18:56:15.123249+0000","last_unstale":"2023-07-05T18:56:15.130813+0000","last_undegraded":"2023-07-05T18:56:15.130813+0000","last_fullsized":"2023-07-05T18:56:15.130813+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T18:56:14.665171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T18:56:14.665171+0000","last_clean_scrub_stamp":"2023-07-05T18:56:14.665171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T05:26:24.797742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.13","version":"20'2","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-05T18:56:17.158513+0000","last_change":"2023-07-05T18:56:14.688172+0000","last_active":"2023-07-05T18:56:17.158513+0000","last_peered":"2023-07-05T18:56:17.158513+0000","last_clean":"2023-07-05T18:56:17.158513+0000","last_became_active":"2023-07-05T18:56:14.687865+0000","last_became_peered":"2023-07-05T18:56:14.687865+0000","last_unstale":"2023-07-05T18:56:17.158513+0000","last_undegraded":"2023-07-05T18:56:17.158513+0000","last_fullsized":"2023-07-05T18:56:17.158513+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T18:56:13.659893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T18:56:13.659893+0000","last_clean_scrub_stamp":"2023-07-05T18:56:13.659893+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T01:08:18.213648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-05T18:56:16.104638+0000","last_change":"2023-07-05T18:56:15.122409+0000","last_active":"2023-07-05T18:56:16.104638+0000","last_peered":"2023-07-05T18:56:16.104638+0000","last_clean":"2023-07-05T18:56:16.104638+0000","last_became_active":"2023-07-05T18:56:15.122152+0000","last_became_peered":"2023-07-05T18:56:15.122152+0000","last_unstale":"2023-07-05T18:56:16.104638+0000","last_undegraded":"2023-07-05T18:56:16.104638+0000","last_fullsized":"2023-07-05T18:56:16.104638+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T18:56:14.665171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T18:56:14.665171+0000","last_clean_scrub_stamp":"2023-07-05T18:56:14.665171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T02:23:52.877499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-05T18:56:16.474220+0000","last_change":"2023-07-05T18:56:14.687246+0000","last_active":"2023-07-05T18:56:16.474220+0000","last_peered":"2023-07-05T18:56:16.474220+0000","last_clean":"2023-07-05T18:56:16.474220+0000","last_became_active":"2023-07-05T18:56:14.686917+0000","last_became_peered":"2023-07-05T18:56:14.686917+0000","last_unstale":"2023-07-05T18:56:16.474220+0000","last_undegraded":"2023-07-05T18:56:16.474220+0000","last_fullsized":"2023-07-05T18:56:16.474220+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T18:56:13.659893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T18:56:13.659893+0000","last_clean_scrub_stamp":"2023-07-05T18:56:13.659893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T03:01:59.198802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-05T18:56:16.105662+0000","last_change":"2023-07-05T18:56:15.120411+0000","last_active":"2023-07-05T18:56:16.105662+0000","last_peered":"2023-07-05T18:56:16.105662+0000","last_clean":"2023-07-05T18:56:16.105662+0000","last_became_active":"2023-07-05T18:56:15.117799+0000","last_became_peered":"2023-07-05T18:56:15.117799+0000","last_unstale":"2023-07-05T18:56:16.105662+0000","last_undegraded":"2023-07-05T18:56:16.105662+0000","last_fullsized":"2023-07-05T18:56:16.105662+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T18:56:14.665171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T18:56:14.665171+0000","last_clean_scrub_stamp":"2023-07-05T18:56:14.665171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-06T22:32:11.493711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-05T18:56:17.158276+0000","last_change":"2023-07-05T18:56:14.689699+0000","last_active":"2023-07-05T18:56:17.158276+0000","last_peered":"2023-07-05T18:56:17.158276+0000","last_clean":"2023-07-05T18:56:17.158276+0000","last_became_active":"2023-07-05T18:56:14.689136+0000","last_became_peered":"2023-07-05T18:56:14.689136+0000","last_unstale":"2023-07-05T18:56:17.158276+0000","last_undegraded":"2023-07-05T18:56:17.158276+0000","last_fullsized":"2023-07-05T18:56:17.158276+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T18:56:13.659893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T18:56:13.659893+0000","last_clean_scrub_stamp":"2023-07-05T18:56:13.659893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T02:13:18.224321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-05T18:56:16.474079+0000","last_change":"2023-07-05T18:56:15.121706+0000","last_active":"2023-07-05T18:56:16.474079+0000","last_peered":"2023-07-05T18:56:16.474079+0000","last_clean":"2023-07-05T18:56:16.474079+0000","last_became_active":"2023-07-05T18:56:15.121455+0000","last_became_peered":"2023-07-05T18:56:15.121455+0000","last_unstale":"2023-07-05T18:56:16.474079+0000","last_undegraded":"2023-07-05T18:56:16.474079+0000","last_fullsized":"2023-07-05T18:56:16.474079+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T18:56:14.665171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T18:56:14.665171+0000","last_clean_scrub_stamp":"2023-07-05T18:56:14.665171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T05:13:27.636276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"20'8","reported_seq":21,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-05T18:56:16.104386+0000","last_change":"2023-07-05T18:56:14.689000+0000","last_active":"2023-07-05T18:56:16.104386+0000","last_peered":"2023-07-05T18:56:16.104386+0000","last_clean":"2023-07-05T18:56:16.104386+0000","last_became_active":"2023-07-05T18:56:14.688670+0000","last_became_peered":"2023-07-05T18:56:14.688670+0000","last_unstale":"2023-07-05T18:56:16.104386+0000","last_undegraded":"2023-07-05T18:56:16.104386+0000","last_fullsized":"2023-07-05T18:56:16.104386+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T18:56:13.659893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T18:56:13.659893+0000","last_clean_scrub_stamp":"2023-07-05T18:56:13.659893+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-06T23:52:21.769984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-05T18:56:16.105133+0000","last_change":"2023-07-05T18:56:15.117236+0000","last_active":"2023-07-05T18:56:16.105133+0000","last_peered":"2023-07-05T18:56:16.105133+0000","last_clean":"2023-07-05T18:56:16.105133+0000","last_became_active":"2023-07-05T18:56:15.116848+0000","last_became_peered":"2023-07-05T18:56:15.116848+0000","last_unstale":"2023-07-05T18:56:16.105133+0000","last_undegraded":"2023-07-05T18:56:16.105133+0000","last_fullsized":"2023-07-05T18:56:16.105133+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T18:56:14.665171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T18:56:14.665171+0000","last_clean_scrub_stamp":"2023-07-05T18:56:14.665171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T04:41:48.823682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"20'1","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-05T18:56:17.158684+0000","last_change":"2023-07-05T18:56:14.688547+0000","last_active":"2023-07-05T18:56:17.158684+0000","last_peered":"2023-07-05T18:56:17.158684+0000","last_clean":"2023-07-05T18:56:17.158684+0000","last_became_active":"2023-07-05T18:56:14.688296+0000","last_became_peered":"2023-07-05T18:56:14.688296+0000","last_unstale":"2023-07-05T18:56:17.158684+0000","last_undegraded":"2023-07-05T18:56:17.158684+0000","last_fullsized":"2023-07-05T18:56:17.158684+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T18:56:13.659893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T18:56:13.659893+0000","last_clean_scrub_stamp":"2023-07-05T18:56:13.659893+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T02:16:58.460543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-05T18:56:16.105182+0000","last_change":"2023-07-05T18:56:15.117356+0000","last_active":"2023-07-05T18:56:16.105182+0000","last_peered":"2023-07-05T18:56:16.105182+0000","last_clean":"2023-07-05T18:56:16.105182+0000","last_became_active":"2023-07-05T18:56:15.117053+0000","last_became_peered":"2023-07-05T18:56:15.117053+0000","last_unstale":"2023-07-05T18:56:16.105182+0000","last_undegraded":"2023-07-05T18:56:16.105182+0000","last_fullsized":"2023-07-05T18:56:16.105182+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T18:56:14.665171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T18:56:14.665171+0000","last_clean_scrub_stamp":"2023-07-05T18:56:14.665171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T04:53:59.163434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"20'2","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-05T18:56:17.158412+0000","last_change":"2023-07-05T18:56:14.688203+0000","last_active":"2023-07-05T18:56:17.158412+0000","last_peered":"2023-07-05T18:56:17.158412+0000","last_clean":"2023-07-05T18:56:17.158412+0000","last_became_active":"2023-07-05T18:56:14.687907+0000","last_became_peered":"2023-07-05T18:56:14.687907+0000","last_unstale":"2023-07-05T18:56:17.158412+0000","last_undegraded":"2023-07-05T18:56:17.158412+0000","last_fullsized":"2023-07-05T18:56:17.158412+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T18:56:13.659893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T18:56:13.659893+0000","last_clean_scrub_stamp":"2023-07-05T18:56:13.659893+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T04:34:53.807856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-07-05T18:56:15.130776+0000","last_change":"2023-07-05T18:56:15.122876+0000","last_active":"2023-07-05T18:56:15.130776+0000","last_peered":"2023-07-05T18:56:15.130776+0000","last_clean":"2023-07-05T18:56:15.130776+0000","last_became_active":"2023-07-05T18:56:15.122580+0000","last_became_peered":"2023-07-05T18:56:15.122580+0000","last_unstale":"2023-07-05T18:56:15.130776+0000","last_undegraded":"2023-07-05T18:56:15.130776+0000","last_fullsized":"2023-07-05T18:56:15.130776+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T18:56:14.665171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T18:56:14.665171+0000","last_clean_scrub_stamp":"2023-07-05T18:56:14.665171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T02:02:14.785284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.d","version":"20'1","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-05T18:56:17.158635+0000","last_change":"2023-07-05T18:56:14.688520+0000","last_active":"2023-07-05T18:56:17.158635+0000","last_peered":"2023-07-05T18:56:17.158635+0000","last_clean":"2023-07-05T18:56:17.158635+0000","last_became_active":"2023-07-05T18:56:14.688106+0000","last_became_peered":"2023-07-05T18:56:14.688106+0000","last_unstale":"2023-07-05T18:56:17.158635+0000","last_undegraded":"2023-07-05T18:56:17.158635+0000","last_fullsized":"2023-07-05T18:56:17.158635+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T18:56:13.659893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T18:56:13.659893+0000","last_clean_scrub_stamp":"2023-07-05T18:56:13.659893+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-06T23:38:28.346200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-05T18:56:16.104261+0000","last_change":"2023-07-05T18:56:15.112983+0000","last_active":"2023-07-05T18:56:16.104261+0000","last_peered":"2023-07-05T18:56:16.104261+0000","last_clean":"2023-07-05T18:56:16.104261+0000","last_became_active":"2023-07-05T18:56:15.112573+0000","last_became_peered":"2023-07-05T18:56:15.112573+0000","last_unstale":"2023-07-05T18:56:16.104261+0000","last_undegraded":"2023-07-05T18:56:16.104261+0000","last_fullsized":"2023-07-05T18:56:16.104261+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T18:56:14.665171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T18:56:14.665171+0000","last_clean_scrub_stamp":"2023-07-05T18:56:14.665171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-06T19:43:28.708822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-05T18:56:16.105586+0000","last_change":"2023-07-05T18:56:14.683769+0000","last_active":"2023-07-05T18:56:16.105586+0000","last_peered":"2023-07-05T18:56:16.105586+0000","last_clean":"2023-07-05T18:56:16.105586+0000","last_became_active":"2023-07-05T18:56:14.683471+0000","last_became_peered":"2023-07-05T18:56:14.683471+0000","last_unstale":"2023-07-05T18:56:16.105586+0000","last_undegraded":"2023-07-05T18:56:16.105586+0000","last_fullsized":"2023-07-05T18:56:16.105586+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T18:56:13.659893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T18:56:13.659893+0000","last_clean_scrub_stamp":"2023-07-05T18:56:13.659893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T03:01:59.198802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-05T18:56:16.474241+0000","last_change":"2023-07-05T18:56:15.120318+0000","last_active":"2023-07-05T18:56:16.474241+0000","last_peered":"2023-07-05T18:56:16.474241+0000","last_clean":"2023-07-05T18:56:16.474241+0000","last_became_active":"2023-07-05T18:56:15.119781+0000","last_became_peered":"2023-07-05T18:56:15.119781+0000","last_unstale":"2023-07-05T18:56:16.474241+0000","last_undegraded":"2023-07-05T18:56:16.474241+0000","last_fullsized":"2023-07-05T18:56:16.474241+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T18:56:14.665171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T18:56:14.665171+0000","last_clean_scrub_stamp":"2023-07-05T18:56:14.665171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T03:08:48.441898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"20'2","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-05T18:56:16.104648+0000","last_change":"2023-07-05T18:56:14.697766+0000","last_active":"2023-07-05T18:56:16.104648+0000","last_peered":"2023-07-05T18:56:16.104648+0000","last_clean":"2023-07-05T18:56:16.104648+0000","last_became_active":"2023-07-05T18:56:14.697460+0000","last_became_peered":"2023-07-05T18:56:14.697460+0000","last_unstale":"2023-07-05T18:56:16.104648+0000","last_undegraded":"2023-07-05T18:56:16.104648+0000","last_fullsized":"2023-07-05T18:56:16.104648+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T18:56:13.659893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T18:56:13.659893+0000","last_clean_scrub_stamp":"2023-07-05T18:56:13.659893+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T05:47:50.661848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-07-05T18:56:15.133658+0000","last_change":"2023-07-05T18:56:15.126143+0000","last_active":"2023-07-05T18:56:15.133658+0000","last_peered":"2023-07-05T18:56:15.133658+0000","last_clean":"2023-07-05T18:56:15.133658+0000","last_became_active":"2023-07-05T18:56:15.125704+0000","last_became_peered":"2023-07-05T18:56:15.125704+0000","last_unstale":"2023-07-05T18:56:15.133658+0000","last_undegraded":"2023-07-05T18:56:15.133658+0000","last_fullsized":"2023-07-05T18:56:15.133658+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T18:56:14.665171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T18:56:14.665171+0000","last_clean_scrub_stamp":"2023-07-05T18:56:14.665171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-06T20:51:12.239710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-05T18:56:16.104166+0000","last_change":"2023-07-05T18:56:14.681768+0000","last_active":"2023-07-05T18:56:16.104166+0000","last_peered":"2023-07-05T18:56:16.104166+0000","last_clean":"2023-07-05T18:56:16.104166+0000","last_became_active":"2023-07-05T18:56:14.681488+0000","last_became_peered":"2023-07-05T18:56:14.681488+0000","last_unstale":"2023-07-05T18:56:16.104166+0000","last_undegraded":"2023-07-05T18:56:16.104166+0000","last_fullsized":"2023-07-05T18:56:16.104166+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T18:56:13.659893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T18:56:13.659893+0000","last_clean_scrub_stamp":"2023-07-05T18:56:13.659893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T01:07:16.516155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-07-05T18:56:15.136235+0000","last_change":"2023-07-05T18:56:15.131136+0000","last_active":"2023-07-05T18:56:15.136235+0000","last_peered":"2023-07-05T18:56:15.136235+0000","last_clean":"2023-07-05T18:56:15.136235+0000","last_became_active":"2023-07-05T18:56:15.130845+0000","last_became_peered":"2023-07-05T18:56:15.130845+0000","last_unstale":"2023-07-05T18:56:15.136235+0000","last_undegraded":"2023-07-05T18:56:15.136235+0000","last_fullsized":"2023-07-05T18:56:15.136235+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T18:56:14.665171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T18:56:14.665171+0000","last_clean_scrub_stamp":"2023-07-05T18:56:14.665171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T02:24:35.873082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-07-05T18:56:15.117140+0000","last_change":"2023-07-05T18:56:14.694531+0000","last_active":"2023-07-05T18:56:15.117140+0000","last_peered":"2023-07-05T18:56:15.117140+0000","last_clean":"2023-07-05T18:56:15.117140+0000","last_became_active":"2023-07-05T18:56:14.694255+0000","last_became_peered":"2023-07-05T18:56:14.694255+0000","last_unstale":"2023-07-05T18:56:15.117140+0000","last_undegraded":"2023-07-05T18:56:15.117140+0000","last_fullsized":"2023-07-05T18:56:15.117140+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T18:56:13.659893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T18:56:13.659893+0000","last_clean_scrub_stamp":"2023-07-05T18:56:13.659893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-06T19:43:27.703545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-07-05T18:56:15.133536+0000","last_change":"2023-07-05T18:56:15.125686+0000","last_active":"2023-07-05T18:56:15.133536+0000","last_peered":"2023-07-05T18:56:15.133536+0000","last_clean":"2023-07-05T18:56:15.133536+0000","last_became_active":"2023-07-05T18:56:15.124278+0000","last_became_peered":"2023-07-05T18:56:15.124278+0000","last_unstale":"2023-07-05T18:56:15.133536+0000","last_undegraded":"2023-07-05T18:56:15.133536+0000","last_fullsized":"2023-07-05T18:56:15.133536+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T18:56:14.665171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T18:56:14.665171+0000","last_clean_scrub_stamp":"2023-07-05T18:56:14.665171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-06T20:53:53.750240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-05T18:56:16.104272+0000","last_change":"2023-07-05T18:56:14.697776+0000","last_active":"2023-07-05T18:56:16.104272+0000","last_peered":"2023-07-05T18:56:16.104272+0000","last_clean":"2023-07-05T18:56:16.104272+0000","last_became_active":"2023-07-05T18:56:14.697446+0000","last_became_peered":"2023-07-05T18:56:14.697446+0000","last_unstale":"2023-07-05T18:56:16.104272+0000","last_undegraded":"2023-07-05T18:56:16.104272+0000","last_fullsized":"2023-07-05T18:56:16.104272+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T18:56:13.659893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T18:56:13.659893+0000","last_clean_scrub_stamp":"2023-07-05T18:56:13.659893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T03:19:03.957135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-05T18:56:17.191314+0000","last_change":"2023-07-05T18:56:15.119281+0000","last_active":"2023-07-05T18:56:17.191314+0000","last_peered":"2023-07-05T18:56:17.191314+0000","last_clean":"2023-07-05T18:56:17.191314+0000","last_became_active":"2023-07-05T18:56:15.118746+0000","last_became_peered":"2023-07-05T18:56:15.118746+0000","last_unstale":"2023-07-05T18:56:17.191314+0000","last_undegraded":"2023-07-05T18:56:17.191314+0000","last_fullsized":"2023-07-05T18:56:17.191314+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T18:56:14.665171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T18:56:14.665171+0000","last_clean_scrub_stamp":"2023-07-05T18:56:14.665171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-06T22:32:11.493711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"20'2","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-05T18:56:16.104993+0000","last_change":"2023-07-05T18:56:14.688850+0000","last_active":"2023-07-05T18:56:16.104993+0000","last_peered":"2023-07-05T18:56:16.104993+0000","last_clean":"2023-07-05T18:56:16.104993+0000","last_became_active":"2023-07-05T18:56:14.688549+0000","last_became_peered":"2023-07-05T18:56:14.688549+0000","last_unstale":"2023-07-05T18:56:16.104993+0000","last_undegraded":"2023-07-05T18:56:16.104993+0000","last_fullsized":"2023-07-05T18:56:16.104993+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T18:56:13.659893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T18:56:13.659893+0000","last_clean_scrub_stamp":"2023-07-05T18:56:13.659893+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-06T23:38:28.346200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":17,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-07-05T18:56:15.117521+0000","last_change":"2023-07-05T18:56:09.622184+0000","last_active":"2023-07-05T18:56:15.117521+0000","last_peered":"2023-07-05T18:56:15.117521+0000","last_clean":"2023-07-05T18:56:15.117521+0000","last_became_active":"2023-07-05T18:56:09.621796+0000","last_became_peered":"2023-07-05T18:56:09.621796+0000","last_unstale":"2023-07-05T18:56:15.117521+0000","last_undegraded":"2023-07-05T18:56:15.117521+0000","last_fullsized":"2023-07-05T18:56:15.117521+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T18:56:08.603137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T18:56:08.603137+0000","last_clean_scrub_stamp":"2023-07-05T18:56:08.603137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-06T21:50:31.464355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-05T18:56:16.104244+0000","last_change":"2023-07-05T18:56:15.117197+0000","last_active":"2023-07-05T18:56:16.104244+0000","last_peered":"2023-07-05T18:56:16.104244+0000","last_clean":"2023-07-05T18:56:16.104244+0000","last_became_active":"2023-07-05T18:56:15.116612+0000","last_became_peered":"2023-07-05T18:56:15.116612+0000","last_unstale":"2023-07-05T18:56:16.104244+0000","last_undegraded":"2023-07-05T18:56:16.104244+0000","last_fullsized":"2023-07-05T18:56:16.104244+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T18:56:14.665171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T18:56:14.665171+0000","last_clean_scrub_stamp":"2023-07-05T18:56:14.665171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T02:24:35.873082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":19,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-05T18:56:16.104703+0000","last_change":"2023-07-05T18:56:09.621596+0000","last_active":"2023-07-05T18:56:16.104703+0000","last_peered":"2023-07-05T18:56:16.104703+0000","last_clean":"2023-07-05T18:56:16.104703+0000","last_became_active":"2023-07-05T18:56:09.621315+0000","last_became_peered":"2023-07-05T18:56:09.621315+0000","last_unstale":"2023-07-05T18:56:16.104703+0000","last_undegraded":"2023-07-05T18:56:16.104703+0000","last_fullsized":"2023-07-05T18:56:16.104703+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T18:56:08.603137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T18:56:08.603137+0000","last_clean_scrub_stamp":"2023-07-05T18:56:08.603137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T01:08:13.156892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-05T18:56:16.474396+0000","last_change":"2023-07-05T18:56:14.693939+0000","last_active":"2023-07-05T18:56:16.474396+0000","last_peered":"2023-07-05T18:56:16.474396+0000","last_clean":"2023-07-05T18:56:16.474396+0000","last_became_active":"2023-07-05T18:56:14.693663+0000","last_became_peered":"2023-07-05T18:56:14.693663+0000","last_unstale":"2023-07-05T18:56:16.474396+0000","last_undegraded":"2023-07-05T18:56:16.474396+0000","last_fullsized":"2023-07-05T18:56:16.474396+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T18:56:13.659893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T18:56:13.659893+0000","last_clean_scrub_stamp":"2023-07-05T18:56:13.659893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T02:23:51.872222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-07-05T18:56:15.133685+0000","last_change":"2023-07-05T18:56:15.127817+0000","last_active":"2023-07-05T18:56:15.133685+0000","last_peered":"2023-07-05T18:56:15.133685+0000","last_clean":"2023-07-05T18:56:15.133685+0000","last_became_active":"2023-07-05T18:56:15.127512+0000","last_became_peered":"2023-07-05T18:56:15.127512+0000","last_unstale":"2023-07-05T18:56:15.133685+0000","last_undegraded":"2023-07-05T18:56:15.133685+0000","last_fullsized":"2023-07-05T18:56:15.133685+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T18:56:14.665171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T18:56:14.665171+0000","last_clean_scrub_stamp":"2023-07-05T18:56:14.665171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T02:43:21.743318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":19,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-05T18:56:17.190599+0000","last_change":"2023-07-05T18:56:09.617992+0000","last_active":"2023-07-05T18:56:17.190599+0000","last_peered":"2023-07-05T18:56:17.190599+0000","last_clean":"2023-07-05T18:56:17.190599+0000","last_became_active":"2023-07-05T18:56:09.617720+0000","last_became_peered":"2023-07-05T18:56:09.617720+0000","last_unstale":"2023-07-05T18:56:17.190599+0000","last_undegraded":"2023-07-05T18:56:17.190599+0000","last_fullsized":"2023-07-05T18:56:17.190599+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T18:56:08.603137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T18:56:08.603137+0000","last_clean_scrub_stamp":"2023-07-05T18:56:08.603137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-06T19:43:22.646788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"17'117","reported_seq":169,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-05T18:56:17.158224+0000","last_change":"2023-07-05T18:56:09.621746+0000","last_active":"2023-07-05T18:56:17.158224+0000","last_peered":"2023-07-05T18:56:17.158224+0000","last_clean":"2023-07-05T18:56:17.158224+0000","last_became_active":"2023-07-05T18:56:09.621421+0000","last_became_peered":"2023-07-05T18:56:09.621421+0000","last_unstale":"2023-07-05T18:56:17.158224+0000","last_undegraded":"2023-07-05T18:56:17.158224+0000","last_fullsized":"2023-07-05T18:56:17.158224+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T18:56:08.603137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T18:56:08.603137+0000","last_clean_scrub_stamp":"2023-07-05T18:56:08.603137+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T05:47:45.605092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-05T18:56:16.474394+0000","last_change":"2023-07-05T18:56:14.688968+0000","last_active":"2023-07-05T18:56:16.474394+0000","last_peered":"2023-07-05T18:56:16.474394+0000","last_clean":"2023-07-05T18:56:16.474394+0000","last_became_active":"2023-07-05T18:56:14.688664+0000","last_became_peered":"2023-07-05T18:56:14.688664+0000","last_unstale":"2023-07-05T18:56:16.474394+0000","last_undegraded":"2023-07-05T18:56:16.474394+0000","last_fullsized":"2023-07-05T18:56:16.474394+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T18:56:13.659893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T18:56:13.659893+0000","last_clean_scrub_stamp":"2023-07-05T18:56:13.659893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T02:13:18.224321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-05T18:56:16.474255+0000","last_change":"2023-07-05T18:56:15.121025+0000","last_active":"2023-07-05T18:56:16.474255+0000","last_peered":"2023-07-05T18:56:16.474255+0000","last_clean":"2023-07-05T18:56:16.474255+0000","last_became_active":"2023-07-05T18:56:15.120768+0000","last_became_peered":"2023-07-05T18:56:15.120768+0000","last_unstale":"2023-07-05T18:56:16.474255+0000","last_undegraded":"2023-07-05T18:56:16.474255+0000","last_fullsized":"2023-07-05T18:56:16.474255+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T18:56:14.665171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T18:56:14.665171+0000","last_clean_scrub_stamp":"2023-07-05T18:56:14.665171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-06T22:32:11.493711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":19,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-05T18:56:17.158181+0000","last_change":"2023-07-05T18:56:10.073940+0000","last_active":"2023-07-05T18:56:17.158181+0000","last_peered":"2023-07-05T18:56:17.158181+0000","last_clean":"2023-07-05T18:56:17.158181+0000","last_became_active":"2023-07-05T18:56:10.073617+0000","last_became_peered":"2023-07-05T18:56:10.073617+0000","last_unstale":"2023-07-05T18:56:17.158181+0000","last_undegraded":"2023-07-05T18:56:17.158181+0000","last_fullsized":"2023-07-05T18:56:17.158181+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T18:56:08.603137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T18:56:08.603137+0000","last_clean_scrub_stamp":"2023-07-05T18:56:08.603137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T02:23:46.815465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-05T18:56:17.190477+0000","last_change":"2023-07-05T18:56:14.694860+0000","last_active":"2023-07-05T18:56:17.190477+0000","last_peered":"2023-07-05T18:56:17.190477+0000","last_clean":"2023-07-05T18:56:17.190477+0000","last_became_active":"2023-07-05T18:56:14.694544+0000","last_became_peered":"2023-07-05T18:56:14.694544+0000","last_unstale":"2023-07-05T18:56:17.190477+0000","last_undegraded":"2023-07-05T18:56:17.190477+0000","last_fullsized":"2023-07-05T18:56:17.190477+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T18:56:13.659893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T18:56:13.659893+0000","last_clean_scrub_stamp":"2023-07-05T18:56:13.659893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-06T23:52:21.769984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-05T18:56:17.191246+0000","last_change":"2023-07-05T18:56:15.118635+0000","last_active":"2023-07-05T18:56:17.191246+0000","last_peered":"2023-07-05T18:56:17.191246+0000","last_clean":"2023-07-05T18:56:17.191246+0000","last_became_active":"2023-07-05T18:56:15.115781+0000","last_became_peered":"2023-07-05T18:56:15.115781+0000","last_unstale":"2023-07-05T18:56:17.191246+0000","last_undegraded":"2023-07-05T18:56:17.191246+0000","last_fullsized":"2023-07-05T18:56:17.191246+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T18:56:14.665171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T18:56:14.665171+0000","last_clean_scrub_stamp":"2023-07-05T18:56:14.665171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T03:08:48.441898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":19,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-05T18:56:17.158048+0000","last_change":"2023-07-05T18:56:10.073658+0000","last_active":"2023-07-05T18:56:17.158048+0000","last_peered":"2023-07-05T18:56:17.158048+0000","last_clean":"2023-07-05T18:56:17.158048+0000","last_became_active":"2023-07-05T18:56:10.073336+0000","last_became_peered":"2023-07-05T18:56:10.073336+0000","last_unstale":"2023-07-05T18:56:17.158048+0000","last_undegraded":"2023-07-05T18:56:17.158048+0000","last_fullsized":"2023-07-05T18:56:17.158048+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T18:56:08.603137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T18:56:08.603137+0000","last_clean_scrub_stamp":"2023-07-05T18:56:08.603137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T01:35:54.039757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-05T18:56:16.104468+0000","last_change":"2023-07-05T18:56:14.684990+0000","last_active":"2023-07-05T18:56:16.104468+0000","last_peered":"2023-07-05T18:56:16.104468+0000","last_clean":"2023-07-05T18:56:16.104468+0000","last_became_active":"2023-07-05T18:56:14.684539+0000","last_became_peered":"2023-07-05T18:56:14.684539+0000","last_unstale":"2023-07-05T18:56:16.104468+0000","last_undegraded":"2023-07-05T18:56:16.104468+0000","last_fullsized":"2023-07-05T18:56:16.104468+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T18:56:13.659893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T18:56:13.659893+0000","last_clean_scrub_stamp":"2023-07-05T18:56:13.659893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T01:35:59.096513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-05T18:56:16.104626+0000","last_change":"2023-07-05T18:56:15.128949+0000","last_active":"2023-07-05T18:56:16.104626+0000","last_peered":"2023-07-05T18:56:16.104626+0000","last_clean":"2023-07-05T18:56:16.104626+0000","last_became_active":"2023-07-05T18:56:15.128650+0000","last_became_peered":"2023-07-05T18:56:15.128650+0000","last_unstale":"2023-07-05T18:56:16.104626+0000","last_undegraded":"2023-07-05T18:56:16.104626+0000","last_fullsized":"2023-07-05T18:56:16.104626+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T18:56:14.665171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T18:56:14.665171+0000","last_clean_scrub_stamp":"2023-07-05T18:56:14.665171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T04:53:59.163434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":19,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-05T18:56:16.105025+0000","last_change":"2023-07-05T18:56:10.073693+0000","last_active":"2023-07-05T18:56:16.105025+0000","last_peered":"2023-07-05T18:56:16.105025+0000","last_clean":"2023-07-05T18:56:16.105025+0000","last_became_active":"2023-07-05T18:56:10.073356+0000","last_became_peered":"2023-07-05T18:56:10.073356+0000","last_unstale":"2023-07-05T18:56:16.105025+0000","last_undegraded":"2023-07-05T18:56:16.105025+0000","last_fullsized":"2023-07-05T18:56:16.105025+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T18:56:08.603137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T18:56:08.603137+0000","last_clean_scrub_stamp":"2023-07-05T18:56:08.603137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T02:48:59.875595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-07-05T18:56:15.117470+0000","last_change":"2023-07-05T18:56:14.694026+0000","last_active":"2023-07-05T18:56:15.117470+0000","last_peered":"2023-07-05T18:56:15.117470+0000","last_clean":"2023-07-05T18:56:15.117470+0000","last_became_active":"2023-07-05T18:56:14.693684+0000","last_became_peered":"2023-07-05T18:56:14.693684+0000","last_unstale":"2023-07-05T18:56:15.117470+0000","last_undegraded":"2023-07-05T18:56:15.117470+0000","last_fullsized":"2023-07-05T18:56:15.117470+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T18:56:13.659893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T18:56:13.659893+0000","last_clean_scrub_stamp":"2023-07-05T18:56:13.659893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T04:53:58.158157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-05T18:56:17.191015+0000","last_change":"2023-07-05T18:56:15.109026+0000","last_active":"2023-07-05T18:56:17.191015+0000","last_peered":"2023-07-05T18:56:17.191015+0000","last_clean":"2023-07-05T18:56:17.191015+0000","last_became_active":"2023-07-05T18:56:15.108685+0000","last_became_peered":"2023-07-05T18:56:15.108685+0000","last_unstale":"2023-07-05T18:56:17.191015+0000","last_undegraded":"2023-07-05T18:56:17.191015+0000","last_fullsized":"2023-07-05T18:56:17.191015+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T18:56:14.665171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T18:56:14.665171+0000","last_clean_scrub_stamp":"2023-07-05T18:56:14.665171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-06T21:50:37.526388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":19,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-05T18:56:16.104315+0000","last_change":"2023-07-05T18:56:10.073639+0000","last_active":"2023-07-05T18:56:16.104315+0000","last_peered":"2023-07-05T18:56:16.104315+0000","last_clean":"2023-07-05T18:56:16.104315+0000","last_became_active":"2023-07-05T18:56:10.073339+0000","last_became_peered":"2023-07-05T18:56:10.073339+0000","last_unstale":"2023-07-05T18:56:16.104315+0000","last_undegraded":"2023-07-05T18:56:16.104315+0000","last_fullsized":"2023-07-05T18:56:16.104315+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T18:56:08.603137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T18:56:08.603137+0000","last_clean_scrub_stamp":"2023-07-05T18:56:08.603137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T02:48:59.875595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-05T18:56:17.191009+0000","last_change":"2023-07-05T18:56:14.695868+0000","last_active":"2023-07-05T18:56:17.191009+0000","last_peered":"2023-07-05T18:56:17.191009+0000","last_clean":"2023-07-05T18:56:17.191009+0000","last_became_active":"2023-07-05T18:56:14.695540+0000","last_became_peered":"2023-07-05T18:56:14.695540+0000","last_unstale":"2023-07-05T18:56:17.191009+0000","last_undegraded":"2023-07-05T18:56:17.191009+0000","last_fullsized":"2023-07-05T18:56:17.191009+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T18:56:13.659893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T18:56:13.659893+0000","last_clean_scrub_stamp":"2023-07-05T18:56:13.659893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T02:24:34.867804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-05T18:56:16.474258+0000","last_change":"2023-07-05T18:56:15.120478+0000","last_active":"2023-07-05T18:56:16.474258+0000","last_peered":"2023-07-05T18:56:16.474258+0000","last_clean":"2023-07-05T18:56:16.474258+0000","last_became_active":"2023-07-05T18:56:15.120038+0000","last_became_peered":"2023-07-05T18:56:15.120038+0000","last_unstale":"2023-07-05T18:56:16.474258+0000","last_undegraded":"2023-07-05T18:56:16.474258+0000","last_fullsized":"2023-07-05T18:56:16.474258+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T18:56:14.665171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T18:56:14.665171+0000","last_clean_scrub_stamp":"2023-07-05T18:56:14.665171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T04:53:59.163434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":19,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-05T18:56:16.104808+0000","last_change":"2023-07-05T18:56:09.619299+0000","last_active":"2023-07-05T18:56:16.104808+0000","last_peered":"2023-07-05T18:56:16.104808+0000","last_clean":"2023-07-05T18:56:16.104808+0000","last_became_active":"2023-07-05T18:56:09.618958+0000","last_became_peered":"2023-07-05T18:56:09.618958+0000","last_unstale":"2023-07-05T18:56:16.104808+0000","last_undegraded":"2023-07-05T18:56:16.104808+0000","last_fullsized":"2023-07-05T18:56:16.104808+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T18:56:08.603137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T18:56:08.603137+0000","last_clean_scrub_stamp":"2023-07-05T18:56:08.603137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-06T21:50:31.464355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-05T18:56:16.105755+0000","last_change":"2023-07-05T18:56:14.684753+0000","last_active":"2023-07-05T18:56:16.105755+0000","last_peered":"2023-07-05T18:56:16.105755+0000","last_clean":"2023-07-05T18:56:16.105755+0000","last_became_active":"2023-07-05T18:56:14.684386+0000","last_became_peered":"2023-07-05T18:56:14.684386+0000","last_unstale":"2023-07-05T18:56:16.105755+0000","last_undegraded":"2023-07-05T18:56:16.105755+0000","last_fullsized":"2023-07-05T18:56:16.105755+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T18:56:13.659893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T18:56:13.659893+0000","last_clean_scrub_stamp":"2023-07-05T18:56:13.659893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T01:35:59.096513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-05T18:56:17.191032+0000","last_change":"2023-07-05T18:56:15.109419+0000","last_active":"2023-07-05T18:56:17.191032+0000","last_peered":"2023-07-05T18:56:17.191032+0000","last_clean":"2023-07-05T18:56:17.191032+0000","last_became_active":"2023-07-05T18:56:15.109114+0000","last_became_peered":"2023-07-05T18:56:15.109114+0000","last_unstale":"2023-07-05T18:56:17.191032+0000","last_undegraded":"2023-07-05T18:56:17.191032+0000","last_fullsized":"2023-07-05T18:56:17.191032+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T18:56:14.665171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T18:56:14.665171+0000","last_clean_scrub_stamp":"2023-07-05T18:56:14.665171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T03:19:04.962412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"20'1","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-05T18:56:16.474134+0000","last_change":"2023-07-05T18:56:14.693851+0000","last_active":"2023-07-05T18:56:16.474134+0000","last_peered":"2023-07-05T18:56:16.474134+0000","last_clean":"2023-07-05T18:56:16.474134+0000","last_became_active":"2023-07-05T18:56:14.693542+0000","last_became_peered":"2023-07-05T18:56:14.693542+0000","last_unstale":"2023-07-05T18:56:16.474134+0000","last_undegraded":"2023-07-05T18:56:16.474134+0000","last_fullsized":"2023-07-05T18:56:16.474134+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T18:56:13.659893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T18:56:13.659893+0000","last_clean_scrub_stamp":"2023-07-05T18:56:13.659893+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T03:19:03.957135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-07-05T18:56:15.109712+0000","last_change":"2023-07-05T18:56:15.103604+0000","last_active":"2023-07-05T18:56:15.109712+0000","last_peered":"2023-07-05T18:56:15.109712+0000","last_clean":"2023-07-05T18:56:15.109712+0000","last_became_active":"2023-07-05T18:56:15.103019+0000","last_became_peered":"2023-07-05T18:56:15.103019+0000","last_unstale":"2023-07-05T18:56:15.109712+0000","last_undegraded":"2023-07-05T18:56:15.109712+0000","last_fullsized":"2023-07-05T18:56:15.109712+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T18:56:14.665171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T18:56:14.665171+0000","last_clean_scrub_stamp":"2023-07-05T18:56:14.665171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T02:09:21.196469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"20'2","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-05T18:56:16.105517+0000","last_change":"2023-07-05T18:56:14.686203+0000","last_active":"2023-07-05T18:56:16.105517+0000","last_peered":"2023-07-05T18:56:16.105517+0000","last_clean":"2023-07-05T18:56:16.105517+0000","last_became_active":"2023-07-05T18:56:14.685948+0000","last_became_peered":"2023-07-05T18:56:14.685948+0000","last_unstale":"2023-07-05T18:56:16.105517+0000","last_undegraded":"2023-07-05T18:56:16.105517+0000","last_fullsized":"2023-07-05T18:56:16.105517+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T18:56:13.659893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T18:56:13.659893+0000","last_clean_scrub_stamp":"2023-07-05T18:56:13.659893+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T02:24:34.867804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-07-05T18:56:15.133614+0000","last_change":"2023-07-05T18:56:15.126615+0000","last_active":"2023-07-05T18:56:15.133614+0000","last_peered":"2023-07-05T18:56:15.133614+0000","last_clean":"2023-07-05T18:56:15.133614+0000","last_became_active":"2023-07-05T18:56:15.126354+0000","last_became_peered":"2023-07-05T18:56:15.126354+0000","last_unstale":"2023-07-05T18:56:15.133614+0000","last_undegraded":"2023-07-05T18:56:15.133614+0000","last_fullsized":"2023-07-05T18:56:15.133614+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T18:56:14.665171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T18:56:14.665171+0000","last_clean_scrub_stamp":"2023-07-05T18:56:14.665171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-06T20:02:22.890138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1d","version":"20'2","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-05T18:56:16.105769+0000","last_change":"2023-07-05T18:56:14.684691+0000","last_active":"2023-07-05T18:56:16.105769+0000","last_peered":"2023-07-05T18:56:16.105769+0000","last_clean":"2023-07-05T18:56:16.105769+0000","last_became_active":"2023-07-05T18:56:14.684098+0000","last_became_peered":"2023-07-05T18:56:14.684098+0000","last_unstale":"2023-07-05T18:56:16.105769+0000","last_undegraded":"2023-07-05T18:56:16.105769+0000","last_fullsized":"2023-07-05T18:56:16.105769+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T18:56:13.659893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T18:56:13.659893+0000","last_clean_scrub_stamp":"2023-07-05T18:56:13.659893+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T02:30:28.735569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-07-05T18:56:15.130924+0000","last_change":"2023-07-05T18:56:15.123781+0000","last_active":"2023-07-05T18:56:15.130924+0000","last_peered":"2023-07-05T18:56:15.130924+0000","last_clean":"2023-07-05T18:56:15.130924+0000","last_became_active":"2023-07-05T18:56:15.123062+0000","last_became_peered":"2023-07-05T18:56:15.123062+0000","last_unstale":"2023-07-05T18:56:15.130924+0000","last_undegraded":"2023-07-05T18:56:15.130924+0000","last_fullsized":"2023-07-05T18:56:15.130924+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T18:56:14.665171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T18:56:14.665171+0000","last_clean_scrub_stamp":"2023-07-05T18:56:14.665171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-06T21:17:50.248706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1e","version":"20'1","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-05T18:56:16.104884+0000","last_change":"2023-07-05T18:56:14.676047+0000","last_active":"2023-07-05T18:56:16.104884+0000","last_peered":"2023-07-05T18:56:16.104884+0000","last_clean":"2023-07-05T18:56:16.104884+0000","last_became_active":"2023-07-05T18:56:14.675717+0000","last_became_peered":"2023-07-05T18:56:14.675717+0000","last_unstale":"2023-07-05T18:56:16.104884+0000","last_undegraded":"2023-07-05T18:56:16.104884+0000","last_fullsized":"2023-07-05T18:56:16.104884+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T18:56:13.659893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T18:56:13.659893+0000","last_clean_scrub_stamp":"2023-07-05T18:56:13.659893+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T00:22:00.885983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-05T18:56:16.104536+0000","last_change":"2023-07-05T18:56:15.117463+0000","last_active":"2023-07-05T18:56:16.104536+0000","last_peered":"2023-07-05T18:56:16.104536+0000","last_clean":"2023-07-05T18:56:16.104536+0000","last_became_active":"2023-07-05T18:56:15.114489+0000","last_became_peered":"2023-07-05T18:56:15.114489+0000","last_unstale":"2023-07-05T18:56:16.104536+0000","last_undegraded":"2023-07-05T18:56:16.104536+0000","last_fullsized":"2023-07-05T18:56:16.104536+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T18:56:14.665171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T18:56:14.665171+0000","last_clean_scrub_stamp":"2023-07-05T18:56:14.665171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T02:30:29.740847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"20'4","reported_seq":17,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-05T18:56:16.474298+0000","last_change":"2023-07-05T18:56:14.689853+0000","last_active":"2023-07-05T18:56:16.474298+0000","last_peered":"2023-07-05T18:56:16.474298+0000","last_clean":"2023-07-05T18:56:16.474298+0000","last_became_active":"2023-07-05T18:56:14.689381+0000","last_became_peered":"2023-07-05T18:56:14.689381+0000","last_unstale":"2023-07-05T18:56:16.474298+0000","last_undegraded":"2023-07-05T18:56:16.474298+0000","last_fullsized":"2023-07-05T18:56:16.474298+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T18:56:13.659893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T18:56:13.659893+0000","last_clean_scrub_stamp":"2023-07-05T18:56:13.659893+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T02:30:28.735569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-07-05T18:56:15.130881+0000","last_change":"2023-07-05T18:56:15.123191+0000","last_active":"2023-07-05T18:56:15.130881+0000","last_peered":"2023-07-05T18:56:15.130881+0000","last_clean":"2023-07-05T18:56:15.130881+0000","last_became_active":"2023-07-05T18:56:15.122736+0000","last_became_peered":"2023-07-05T18:56:15.122736+0000","last_unstale":"2023-07-05T18:56:15.130881+0000","last_undegraded":"2023-07-05T18:56:15.130881+0000","last_fullsized":"2023-07-05T18:56:15.130881+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T18:56:14.665171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T18:56:14.665171+0000","last_clean_scrub_stamp":"2023-07-05T18:56:14.665171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T05:40:41.006597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-05T18:56:16.104533+0000","last_change":"2023-07-05T18:56:15.115767+0000","last_active":"2023-07-05T18:56:16.104533+0000","last_peered":"2023-07-05T18:56:16.104533+0000","last_clean":"2023-07-05T18:56:16.104533+0000","last_became_active":"2023-07-05T18:56:15.115052+0000","last_became_peered":"2023-07-05T18:56:15.115052+0000","last_unstale":"2023-07-05T18:56:16.104533+0000","last_undegraded":"2023-07-05T18:56:16.104533+0000","last_fullsized":"2023-07-05T18:56:16.104533+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T18:56:14.665171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T18:56:14.665171+0000","last_clean_scrub_stamp":"2023-07-05T18:56:14.665171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T05:13:27.636276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-05T18:56:16.104384+0000","last_change":"2023-07-05T18:56:15.112332+0000","last_active":"2023-07-05T18:56:16.104384+0000","last_peered":"2023-07-05T18:56:16.104384+0000","last_clean":"2023-07-05T18:56:16.104384+0000","last_became_active":"2023-07-05T18:56:15.112060+0000","last_became_peered":"2023-07-05T18:56:15.112060+0000","last_unstale":"2023-07-05T18:56:16.104384+0000","last_undegraded":"2023-07-05T18:56:16.104384+0000","last_fullsized":"2023-07-05T18:56:16.104384+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T18:56:14.665171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T18:56:14.665171+0000","last_clean_scrub_stamp":"2023-07-05T18:56:14.665171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T03:08:48.441898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-07-05T18:56:15.133589+0000","last_change":"2023-07-05T18:56:15.126220+0000","last_active":"2023-07-05T18:56:15.133589+0000","last_peered":"2023-07-05T18:56:15.133589+0000","last_clean":"2023-07-05T18:56:15.133589+0000","last_became_active":"2023-07-05T18:56:15.125927+0000","last_became_peered":"2023-07-05T18:56:15.125927+0000","last_unstale":"2023-07-05T18:56:15.133589+0000","last_undegraded":"2023-07-05T18:56:15.133589+0000","last_fullsized":"2023-07-05T18:56:15.133589+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T18:56:14.665171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T18:56:14.665171+0000","last_clean_scrub_stamp":"2023-07-05T18:56:14.665171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-06T22:34:04.489538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-05T18:56:16.104693+0000","last_change":"2023-07-05T18:56:15.118666+0000","last_active":"2023-07-05T18:56:16.104693+0000","last_peered":"2023-07-05T18:56:16.104693+0000","last_clean":"2023-07-05T18:56:16.104693+0000","last_became_active":"2023-07-05T18:56:15.116876+0000","last_became_peered":"2023-07-05T18:56:15.116876+0000","last_unstale":"2023-07-05T18:56:16.104693+0000","last_undegraded":"2023-07-05T18:56:16.104693+0000","last_fullsized":"2023-07-05T18:56:16.104693+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T18:56:14.665171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T18:56:14.665171+0000","last_clean_scrub_stamp":"2023-07-05T18:56:14.665171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T04:34:54.813133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-05T18:56:17.190834+0000","last_change":"2023-07-05T18:56:15.118889+0000","last_active":"2023-07-05T18:56:17.190834+0000","last_peered":"2023-07-05T18:56:17.190834+0000","last_clean":"2023-07-05T18:56:17.190834+0000","last_became_active":"2023-07-05T18:56:15.118609+0000","last_became_peered":"2023-07-05T18:56:15.118609+0000","last_unstale":"2023-07-05T18:56:17.190834+0000","last_undegraded":"2023-07-05T18:56:17.190834+0000","last_fullsized":"2023-07-05T18:56:17.190834+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T18:56:14.665171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T18:56:14.665171+0000","last_clean_scrub_stamp":"2023-07-05T18:56:14.665171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T02:49:05.937629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":8},{"poolid":2,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574852,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27760,"kb_used_data":808,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344080,"statfs":{"total":96636764160,"available":96608337920,"internally_reserved":0,"allocated":827392,"data_stored":664594,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65200000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70399999999999996}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61299999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68600000000000005}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40799999999999997}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.497}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59799999999999998}]}]},{"osd":6,"up_from":13,"seq":55834574854,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27164,"kb_used_data":212,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344676,"statfs":{"total":96636764160,"available":96608948224,"internally_reserved":0,"allocated":217088,"data_stored":79099,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.6200000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1299999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.307}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":6.181}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.32000000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38800000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.49199999999999999}]}]},{"osd":1,"up_from":13,"seq":55834574853,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27732,"kb_used_data":780,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344108,"statfs":{"total":96636764160,"available":96608366592,"internally_reserved":0,"allocated":798720,"data_stored":662814,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.32700000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36099999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48299999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78700000000000003}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64800000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.91900000000000004}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.89600000000000002}]}]},{"osd":0,"up_from":13,"seq":55834574853,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27168,"kb_used_data":216,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344672,"statfs":{"total":96636764160,"available":96608944128,"internally_reserved":0,"allocated":221184,"data_stored":79681,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.379}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.30399999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44700000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55200000000000005}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56299999999999994}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66700000000000004}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.505}]}]},{"osd":2,"up_from":13,"seq":55834574852,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27148,"kb_used_data":196,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344692,"statfs":{"total":96636764160,"available":96608964608,"internally_reserved":0,"allocated":200704,"data_stored":71485,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.27900000000000003}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.317}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.30399999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63900000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71699999999999997}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65900000000000003}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.625}]}]},{"osd":3,"up_from":13,"seq":55834574854,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27168,"kb_used_data":216,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344672,"statfs":{"total":96636764160,"available":96608944128,"internally_reserved":0,"allocated":221184,"data_stored":79189,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.32800000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.313}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39700000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59699999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65100000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66600000000000004}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61199999999999999}]}]},{"osd":4,"up_from":13,"seq":55834574854,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27172,"kb_used_data":220,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344668,"statfs":{"total":96636764160,"available":96608940032,"internally_reserved":0,"allocated":225280,"data_stored":74066,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70999999999999996}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64700000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65700000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69099999999999995}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53400000000000003}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47599999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51600000000000001}]}]},{"osd":5,"up_from":13,"seq":55834574853,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27172,"kb_used_data":220,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344668,"statfs":{"total":96636764160,"available":96608940032,"internally_reserved":0,"allocated":225280,"data_stored":79751,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38500000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.75800000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57399999999999995}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64300000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.624}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83999999999999997}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.93500000000000005}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1620,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":652,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1780,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-07-05T18:56:19.374 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-07-05T18:56:19.530 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:19.528+0000 7fc7e5b51700 1 Processor -- start 2023-07-05T18:56:19.531 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:19.528+0000 7fc7e5b51700 1 -- start start 2023-07-05T18:56:19.533 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:19.529+0000 7fc7e5b51700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fc7e0069e00 0x7fc7e006ed80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:56:19.533 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:19.529+0000 7fc7e5b51700 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc7e006e8f0 con 0x7fc7e006a1d0 2023-07-05T18:56:19.533 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:19.529+0000 7fc7e5b51700 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc7e006ca80 con 0x7fc7e015c9f0 2023-07-05T18:56:19.533 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:19.529+0000 7fc7e5b51700 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc7e00b3520 con 0x7fc7e0069e00 2023-07-05T18:56:19.534 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:19.529+0000 7fc7df7fe700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fc7e0069e00 0x7fc7e006ed80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:56:19.534 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:19.529+0000 7fc7deffd700 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7fc7e006a1d0 0x7fc7e00b29b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:57038/0 (socket says 172.21.15.46:57038) 2023-07-05T18:56:19.534 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:19.529+0000 7fc7deffd700 1 -- 172.21.15.46:0/662523543 learned_addr learned my addr 172.21.15.46:0/662523543 (peer_addr_for_me v1:172.21.15.46:0/0) 2023-07-05T18:56:19.534 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:19.529+0000 7fc7df7fe700 1 -- 172.21.15.46:0/662523543 >> v1:172.21.15.73:6789/0 conn(0x7fc7e015c9f0 legacy=0x7fc7e015ce70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-05T18:56:19.534 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:19.529+0000 7fc7df7fe700 1 -- 172.21.15.46:0/662523543 >> v1:172.21.15.46:6789/0 conn(0x7fc7e006a1d0 legacy=0x7fc7e00b29b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:56:19.534 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:19.529+0000 7fc7df7fe700 1 -- 172.21.15.46:0/662523543 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc7e006e2a0 con 0x7fc7e0069e00 2023-07-05T18:56:19.534 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:19.529+0000 7fc7de7fc700 1 -- 172.21.15.46:0/662523543 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1515368482 0 0) 0x7fc7e006e8f0 con 0x7fc7e006a1d0 2023-07-05T18:56:19.535 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:19.530+0000 7fc7df7fe700 1 --2- 172.21.15.46:0/662523543 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc7e0069e00 0x7fc7e006ed80 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fc7d0009840 tx=0x7fc7d0009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3bfa686af9d1b0c0 server_cookie=0 in_seq=0 out_seq=0 2023-07-05T18:56:19.536 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:19.530+0000 7fc7de7fc700 1 -- 172.21.15.46:0/662523543 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7d0011830 con 0x7fc7e0069e00 2023-07-05T18:56:19.536 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:19.530+0000 7fc7de7fc700 1 -- 172.21.15.46:0/662523543 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc7d0011990 con 0x7fc7e0069e00 2023-07-05T18:56:19.536 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:19.530+0000 7fc7de7fc700 1 -- 172.21.15.46:0/662523543 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7d0011d20 con 0x7fc7e0069e00 2023-07-05T18:56:19.536 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:19.530+0000 7fc7e5b51700 1 -- 172.21.15.46:0/662523543 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc7e0069e00 msgr2=0x7fc7e006ed80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:56:19.536 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:19.530+0000 7fc7e5b51700 1 --2- 172.21.15.46:0/662523543 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc7e0069e00 0x7fc7e006ed80 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fc7d0009840 tx=0x7fc7d0009b50 comp rx=0 tx=0).stop 2023-07-05T18:56:19.537 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:19.530+0000 7fc7e5b51700 1 -- 172.21.15.46:0/662523543 shutdown_connections 2023-07-05T18:56:19.537 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:19.530+0000 7fc7e5b51700 1 --2- 172.21.15.46:0/662523543 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc7e0069e00 0x7fc7e006ed80 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:19.537 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:19.530+0000 7fc7e5b51700 1 -- 172.21.15.46:0/662523543 >> 172.21.15.46:0/662523543 conn(0x7fc7e006af10 msgr2=0x7fc7e006b2e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-05T18:56:19.537 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:19.530+0000 7fc7e5b51700 1 -- 172.21.15.46:0/662523543 shutdown_connections 2023-07-05T18:56:19.537 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:19.530+0000 7fc7e5b51700 1 -- 172.21.15.46:0/662523543 wait complete. 2023-07-05T18:56:19.539 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:19.531+0000 7fc7e5b51700 1 Processor -- start 2023-07-05T18:56:19.539 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:19.532+0000 7fc7e5b51700 1 -- start start 2023-07-05T18:56:19.540 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:19.532+0000 7fc7e5b51700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc7e0069e00 0x7fc7e00cfa70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:56:19.540 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:19.532+0000 7fc7e5b51700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc7e006a1d0 0x7fc7e015af90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:56:19.540 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:19.532+0000 7fc7e5b51700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fc7e015c9f0 0x7fc7e014b410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:56:19.540 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:19.532+0000 7fc7e5b51700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7e015b4d0 con 0x7fc7e0069e00 2023-07-05T18:56:19.540 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:19.532+0000 7fc7e5b51700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7e0157090 con 0x7fc7e006a1d0 2023-07-05T18:56:19.540 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:19.532+0000 7fc7e5b51700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc7e015b700 con 0x7fc7e015c9f0 2023-07-05T18:56:19.540 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:19.533+0000 7fc7df7fe700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc7e0069e00 0x7fc7e00cfa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:56:19.541 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:19.533+0000 7fc7df7fe700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc7e0069e00 0x7fc7e00cfa70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:57772/0 (socket says 172.21.15.46:57772) 2023-07-05T18:56:19.541 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:19.533+0000 7fc7df7fe700 1 -- 172.21.15.46:0/3466589934 learned_addr learned my addr 172.21.15.46:0/3466589934 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-07-05T18:56:19.541 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:19.533+0000 7fc7deffd700 1 --2- 172.21.15.46:0/3466589934 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc7e006a1d0 0x7fc7e015af90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:56:19.541 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:19.533+0000 7fc7dffff700 1 --2- 172.21.15.46:0/3466589934 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fc7e015c9f0 0x7fc7e014b410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:56:19.541 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:19.533+0000 7fc7df7fe700 1 -- 172.21.15.46:0/3466589934 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fc7e015c9f0 msgr2=0x7fc7e014b410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:56:19.541 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:19.533+0000 7fc7df7fe700 1 --2- 172.21.15.46:0/3466589934 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fc7e015c9f0 0x7fc7e014b410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:19.541 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:19.533+0000 7fc7df7fe700 1 -- 172.21.15.46:0/3466589934 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc7e006a1d0 msgr2=0x7fc7e015af90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:56:19.541 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:19.533+0000 7fc7df7fe700 1 --2- 172.21.15.46:0/3466589934 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc7e006a1d0 0x7fc7e015af90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:19.542 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:19.533+0000 7fc7df7fe700 1 -- 172.21.15.46:0/3466589934 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc7d00094a0 con 0x7fc7e0069e00 2023-07-05T18:56:19.542 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:19.533+0000 7fc7dffff700 1 --2- 172.21.15.46:0/3466589934 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fc7e015c9f0 0x7fc7e014b410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-05T18:56:19.542 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:19.533+0000 7fc7df7fe700 1 --2- 172.21.15.46:0/3466589934 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc7e0069e00 0x7fc7e00cfa70 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fc7e006bec0 tx=0x7fc7d0004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-05T18:56:19.542 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:19.533+0000 7fc7d7fff700 1 -- 172.21.15.46:0/3466589934 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7d00036a0 con 0x7fc7e0069e00 2023-07-05T18:56:19.542 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:19.533+0000 7fc7d7fff700 1 -- 172.21.15.46:0/3466589934 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc7d001f070 con 0x7fc7e0069e00 2023-07-05T18:56:19.542 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:19.533+0000 7fc7e5b51700 1 -- 172.21.15.46:0/3466589934 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc7e015b9e0 con 0x7fc7e0069e00 2023-07-05T18:56:19.542 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:19.533+0000 7fc7d7fff700 1 -- 172.21.15.46:0/3466589934 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7d0003a60 con 0x7fc7e0069e00 2023-07-05T18:56:19.542 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:19.533+0000 7fc7e5b51700 1 -- 172.21.15.46:0/3466589934 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc7e014b950 con 0x7fc7e0069e00 2023-07-05T18:56:19.543 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:19.534+0000 7fc7e5b51700 1 -- 172.21.15.46:0/3466589934 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc7e0157260 con 0x7fc7e0069e00 2023-07-05T18:56:19.543 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:19.535+0000 7fc7d7fff700 1 -- 172.21.15.46:0/3466589934 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fc7d0003bc0 con 0x7fc7e0069e00 2023-07-05T18:56:19.543 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:19.535+0000 7fc7d7fff700 1 --2- 172.21.15.46:0/3466589934 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7fc7c006ace0 0x7fc7c006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:56:19.543 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:19.535+0000 7fc7d7fff700 1 -- 172.21.15.46:0/3466589934 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fc7d0021070 con 0x7fc7e0069e00 2023-07-05T18:56:19.543 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:19.535+0000 7fc7deffd700 1 --2- 172.21.15.46:0/3466589934 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7fc7c006ace0 0x7fc7c006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:56:19.543 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:19.536+0000 7fc7deffd700 1 --2- 172.21.15.46:0/3466589934 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7fc7c006ace0 0x7fc7c006d190 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fc7c8007b10 tx=0x7fc7c8007a60 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-05T18:56:19.545 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:19.539+0000 7fc7d7fff700 1 -- 172.21.15.46:0/3466589934 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fc7d0056210 con 0x7fc7e0069e00 2023-07-05T18:56:19.735 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:19.733+0000 7fc7e5b51700 1 -- 172.21.15.46:0/3466589934 --> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fc7e006e580 con 0x7fc7c006ace0 2023-07-05T18:56:19.743 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:19.742+0000 7fc7d7fff700 1 -- 172.21.15.46:0/3466589934 <== mgr.4099 v2:172.21.15.73:6832/3033361733 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+286913 (secure 0 0 0) 0x7fc7c8001330 con 0x7fc7c006ace0 2023-07-05T18:56:19.748 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T18:56:19.751 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:19.745+0000 7fc7e5b51700 1 -- 172.21.15.46:0/3466589934 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7fc7c006ace0 msgr2=0x7fc7c006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:56:19.751 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:19.745+0000 7fc7e5b51700 1 --2- 172.21.15.46:0/3466589934 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7fc7c006ace0 0x7fc7c006d190 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fc7c8007b10 tx=0x7fc7c8007a60 comp rx=0 tx=0).stop 2023-07-05T18:56:19.751 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:19.745+0000 7fc7e5b51700 1 -- 172.21.15.46:0/3466589934 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc7e0069e00 msgr2=0x7fc7e00cfa70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:56:19.751 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:19.745+0000 7fc7e5b51700 1 --2- 172.21.15.46:0/3466589934 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc7e0069e00 0x7fc7e00cfa70 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fc7e006bec0 tx=0x7fc7d0004750 comp rx=0 tx=0).stop 2023-07-05T18:56:19.751 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:19.745+0000 7fc7e5b51700 1 -- 172.21.15.46:0/3466589934 shutdown_connections 2023-07-05T18:56:19.752 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:19.745+0000 7fc7e5b51700 1 --2- 172.21.15.46:0/3466589934 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7fc7c006ace0 0x7fc7c006d190 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:19.752 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:19.745+0000 7fc7e5b51700 1 --2- 172.21.15.46:0/3466589934 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fc7e015c9f0 0x7fc7e014b410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:19.752 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:19.745+0000 7fc7e5b51700 1 --2- 172.21.15.46:0/3466589934 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc7e0069e00 0x7fc7e00cfa70 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:19.752 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:19.745+0000 7fc7e5b51700 1 --2- 172.21.15.46:0/3466589934 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc7e006a1d0 0x7fc7e015af90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:19.752 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:19.745+0000 7fc7e5b51700 1 -- 172.21.15.46:0/3466589934 >> 172.21.15.46:0/3466589934 conn(0x7fc7e006af10 msgr2=0x7fc7e01562b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-05T18:56:19.753 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:19.745+0000 7fc7e5b51700 1 -- 172.21.15.46:0/3466589934 shutdown_connections 2023-07-05T18:56:19.753 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:19.745+0000 7fc7e5b51700 1 -- 172.21.15.46:0/3466589934 wait complete. 2023-07-05T18:56:19.753 INFO:teuthology.orchestra.run.smithi046.stderr:dumped all 2023-07-05T18:56:19.760 INFO:teuthology.orchestra.run.smithi046.stdout:{"pg_ready":true,"pg_map":{"version":20,"stamp":"2023-07-05T18:56:18.072249+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":153,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":218484,"kb_used_data":2868,"kb_used_omap":0,"kb_used_meta":215552,"kb_avail":754756236,"statfs":{"total":773094113280,"available":772870385664,"internally_reserved":0,"allocated":2936832,"data_stored":1790679,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":220725248},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":27,"apply_latency_ms":27,"commit_latency_ns":27000000,"apply_latency_ns":27000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2362,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.406488"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-07-05T18:56:15.118147+0000","last_change":"2023-07-05T18:56:15.115312+0000","last_active":"2023-07-05T18:56:15.118147+0000","last_peered":"2023-07-05T18:56:15.118147+0000","last_clean":"2023-07-05T18:56:15.118147+0000","last_became_active":"2023-07-05T18:56:15.115039+0000","last_became_peered":"2023-07-05T18:56:15.115039+0000","last_unstale":"2023-07-05T18:56:15.118147+0000","last_undegraded":"2023-07-05T18:56:15.118147+0000","last_fullsized":"2023-07-05T18:56:15.118147+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T18:56:14.665171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T18:56:14.665171+0000","last_clean_scrub_stamp":"2023-07-05T18:56:14.665171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-06T19:40:27.233987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-05T18:56:16.104997+0000","last_change":"2023-07-05T18:56:15.113285+0000","last_active":"2023-07-05T18:56:16.104997+0000","last_peered":"2023-07-05T18:56:16.104997+0000","last_clean":"2023-07-05T18:56:16.104997+0000","last_became_active":"2023-07-05T18:56:15.113019+0000","last_became_peered":"2023-07-05T18:56:15.113019+0000","last_unstale":"2023-07-05T18:56:16.104997+0000","last_undegraded":"2023-07-05T18:56:16.104997+0000","last_fullsized":"2023-07-05T18:56:16.104997+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T18:56:14.665171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T18:56:14.665171+0000","last_clean_scrub_stamp":"2023-07-05T18:56:14.665171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-06T19:43:28.708822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-07-05T18:56:15.133649+0000","last_change":"2023-07-05T18:56:15.127147+0000","last_active":"2023-07-05T18:56:15.133649+0000","last_peered":"2023-07-05T18:56:15.133649+0000","last_clean":"2023-07-05T18:56:15.133649+0000","last_became_active":"2023-07-05T18:56:15.126775+0000","last_became_peered":"2023-07-05T18:56:15.126775+0000","last_unstale":"2023-07-05T18:56:15.133649+0000","last_undegraded":"2023-07-05T18:56:15.133649+0000","last_fullsized":"2023-07-05T18:56:15.133649+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T18:56:14.665171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T18:56:14.665171+0000","last_clean_scrub_stamp":"2023-07-05T18:56:14.665171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T01:07:17.521433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-05T18:56:16.105116+0000","last_change":"2023-07-05T18:56:15.119204+0000","last_active":"2023-07-05T18:56:16.105116+0000","last_peered":"2023-07-05T18:56:16.105116+0000","last_clean":"2023-07-05T18:56:16.105116+0000","last_became_active":"2023-07-05T18:56:15.118931+0000","last_became_peered":"2023-07-05T18:56:15.118931+0000","last_unstale":"2023-07-05T18:56:16.105116+0000","last_undegraded":"2023-07-05T18:56:16.105116+0000","last_fullsized":"2023-07-05T18:56:16.105116+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T18:56:14.665171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T18:56:14.665171+0000","last_clean_scrub_stamp":"2023-07-05T18:56:14.665171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T03:19:04.962412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-05T18:56:16.473979+0000","last_change":"2023-07-05T18:56:15.125822+0000","last_active":"2023-07-05T18:56:16.473979+0000","last_peered":"2023-07-05T18:56:16.473979+0000","last_clean":"2023-07-05T18:56:16.473979+0000","last_became_active":"2023-07-05T18:56:15.121836+0000","last_became_peered":"2023-07-05T18:56:15.121836+0000","last_unstale":"2023-07-05T18:56:16.473979+0000","last_undegraded":"2023-07-05T18:56:16.473979+0000","last_fullsized":"2023-07-05T18:56:16.473979+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T18:56:14.665171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T18:56:14.665171+0000","last_clean_scrub_stamp":"2023-07-05T18:56:14.665171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T02:49:05.937629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-07-05T18:56:15.133528+0000","last_change":"2023-07-05T18:56:15.125381+0000","last_active":"2023-07-05T18:56:15.133528+0000","last_peered":"2023-07-05T18:56:15.133528+0000","last_clean":"2023-07-05T18:56:15.133528+0000","last_became_active":"2023-07-05T18:56:15.124055+0000","last_became_peered":"2023-07-05T18:56:15.124055+0000","last_unstale":"2023-07-05T18:56:15.133528+0000","last_undegraded":"2023-07-05T18:56:15.133528+0000","last_fullsized":"2023-07-05T18:56:15.133528+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T18:56:14.665171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T18:56:14.665171+0000","last_clean_scrub_stamp":"2023-07-05T18:56:14.665171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-06T19:42:33.771965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-05T18:56:17.158259+0000","last_change":"2023-07-05T18:56:15.116938+0000","last_active":"2023-07-05T18:56:17.158259+0000","last_peered":"2023-07-05T18:56:17.158259+0000","last_clean":"2023-07-05T18:56:17.158259+0000","last_became_active":"2023-07-05T18:56:15.116592+0000","last_became_peered":"2023-07-05T18:56:15.116592+0000","last_unstale":"2023-07-05T18:56:17.158259+0000","last_undegraded":"2023-07-05T18:56:17.158259+0000","last_fullsized":"2023-07-05T18:56:17.158259+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T18:56:14.665171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T18:56:14.665171+0000","last_clean_scrub_stamp":"2023-07-05T18:56:14.665171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T02:30:29.740847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-05T18:56:16.104826+0000","last_change":"2023-07-05T18:56:15.127587+0000","last_active":"2023-07-05T18:56:16.104826+0000","last_peered":"2023-07-05T18:56:16.104826+0000","last_clean":"2023-07-05T18:56:16.104826+0000","last_became_active":"2023-07-05T18:56:15.127359+0000","last_became_peered":"2023-07-05T18:56:15.127359+0000","last_unstale":"2023-07-05T18:56:16.104826+0000","last_undegraded":"2023-07-05T18:56:16.104826+0000","last_fullsized":"2023-07-05T18:56:16.104826+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T18:56:14.665171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T18:56:14.665171+0000","last_clean_scrub_stamp":"2023-07-05T18:56:14.665171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T01:07:17.521433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-05T18:56:16.474116+0000","last_change":"2023-07-05T18:56:15.123724+0000","last_active":"2023-07-05T18:56:16.474116+0000","last_peered":"2023-07-05T18:56:16.474116+0000","last_clean":"2023-07-05T18:56:16.474116+0000","last_became_active":"2023-07-05T18:56:15.121678+0000","last_became_peered":"2023-07-05T18:56:15.121678+0000","last_unstale":"2023-07-05T18:56:16.474116+0000","last_undegraded":"2023-07-05T18:56:16.474116+0000","last_fullsized":"2023-07-05T18:56:16.474116+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T18:56:14.665171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T18:56:14.665171+0000","last_clean_scrub_stamp":"2023-07-05T18:56:14.665171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T02:24:35.873082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-05T18:56:16.105387+0000","last_change":"2023-07-05T18:56:15.121695+0000","last_active":"2023-07-05T18:56:16.105387+0000","last_peered":"2023-07-05T18:56:16.105387+0000","last_clean":"2023-07-05T18:56:16.105387+0000","last_became_active":"2023-07-05T18:56:15.121418+0000","last_became_peered":"2023-07-05T18:56:15.121418+0000","last_unstale":"2023-07-05T18:56:16.105387+0000","last_undegraded":"2023-07-05T18:56:16.105387+0000","last_fullsized":"2023-07-05T18:56:16.105387+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T18:56:14.665171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T18:56:14.665171+0000","last_clean_scrub_stamp":"2023-07-05T18:56:14.665171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-06T21:50:37.526388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-07-05T18:56:15.133668+0000","last_change":"2023-07-05T18:56:15.127138+0000","last_active":"2023-07-05T18:56:15.133668+0000","last_peered":"2023-07-05T18:56:15.133668+0000","last_clean":"2023-07-05T18:56:15.133668+0000","last_became_active":"2023-07-05T18:56:15.126770+0000","last_became_peered":"2023-07-05T18:56:15.126770+0000","last_unstale":"2023-07-05T18:56:15.133668+0000","last_undegraded":"2023-07-05T18:56:15.133668+0000","last_fullsized":"2023-07-05T18:56:15.133668+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T18:56:14.665171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T18:56:14.665171+0000","last_clean_scrub_stamp":"2023-07-05T18:56:14.665171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-06T23:52:22.775261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-07-05T18:56:15.127693+0000","last_change":"2023-07-05T18:56:15.127292+0000","last_active":"2023-07-05T18:56:15.127693+0000","last_peered":"2023-07-05T18:56:15.127693+0000","last_clean":"2023-07-05T18:56:15.127693+0000","last_became_active":"2023-07-05T18:56:15.127061+0000","last_became_peered":"2023-07-05T18:56:15.127061+0000","last_unstale":"2023-07-05T18:56:15.127693+0000","last_undegraded":"2023-07-05T18:56:15.127693+0000","last_fullsized":"2023-07-05T18:56:15.127693+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T18:56:14.665171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T18:56:14.665171+0000","last_clean_scrub_stamp":"2023-07-05T18:56:14.665171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T06:17:55.964119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-07-05T18:56:15.116160+0000","last_change":"2023-07-05T18:56:15.114803+0000","last_active":"2023-07-05T18:56:15.116160+0000","last_peered":"2023-07-05T18:56:15.116160+0000","last_clean":"2023-07-05T18:56:15.116160+0000","last_became_active":"2023-07-05T18:56:15.114491+0000","last_became_peered":"2023-07-05T18:56:15.114491+0000","last_unstale":"2023-07-05T18:56:15.116160+0000","last_undegraded":"2023-07-05T18:56:15.116160+0000","last_fullsized":"2023-07-05T18:56:15.116160+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T18:56:14.665171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T18:56:14.665171+0000","last_clean_scrub_stamp":"2023-07-05T18:56:14.665171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T00:07:37.342862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-05T18:56:16.105534+0000","last_change":"2023-07-05T18:56:15.108218+0000","last_active":"2023-07-05T18:56:16.105534+0000","last_peered":"2023-07-05T18:56:16.105534+0000","last_clean":"2023-07-05T18:56:16.105534+0000","last_became_active":"2023-07-05T18:56:15.107769+0000","last_became_peered":"2023-07-05T18:56:15.107769+0000","last_unstale":"2023-07-05T18:56:16.105534+0000","last_undegraded":"2023-07-05T18:56:16.105534+0000","last_fullsized":"2023-07-05T18:56:16.105534+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T18:56:14.665171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T18:56:14.665171+0000","last_clean_scrub_stamp":"2023-07-05T18:56:14.665171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T03:19:04.962412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-05T18:56:17.158599+0000","last_change":"2023-07-05T18:56:15.119803+0000","last_active":"2023-07-05T18:56:17.158599+0000","last_peered":"2023-07-05T18:56:17.158599+0000","last_clean":"2023-07-05T18:56:17.158599+0000","last_became_active":"2023-07-05T18:56:15.119429+0000","last_became_peered":"2023-07-05T18:56:15.119429+0000","last_unstale":"2023-07-05T18:56:17.158599+0000","last_undegraded":"2023-07-05T18:56:17.158599+0000","last_fullsized":"2023-07-05T18:56:17.158599+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T18:56:14.665171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T18:56:14.665171+0000","last_clean_scrub_stamp":"2023-07-05T18:56:14.665171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T03:39:30.527160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-07-05T18:56:15.133733+0000","last_change":"2023-07-05T18:56:15.128556+0000","last_active":"2023-07-05T18:56:15.133733+0000","last_peered":"2023-07-05T18:56:15.133733+0000","last_clean":"2023-07-05T18:56:15.133733+0000","last_became_active":"2023-07-05T18:56:15.128307+0000","last_became_peered":"2023-07-05T18:56:15.128307+0000","last_unstale":"2023-07-05T18:56:15.133733+0000","last_undegraded":"2023-07-05T18:56:15.133733+0000","last_fullsized":"2023-07-05T18:56:15.133733+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T18:56:14.665171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T18:56:14.665171+0000","last_clean_scrub_stamp":"2023-07-05T18:56:14.665171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T04:47:53.525224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-05T18:56:16.474111+0000","last_change":"2023-07-05T18:56:15.121918+0000","last_active":"2023-07-05T18:56:16.474111+0000","last_peered":"2023-07-05T18:56:16.474111+0000","last_clean":"2023-07-05T18:56:16.474111+0000","last_became_active":"2023-07-05T18:56:15.121400+0000","last_became_peered":"2023-07-05T18:56:15.121400+0000","last_unstale":"2023-07-05T18:56:16.474111+0000","last_undegraded":"2023-07-05T18:56:16.474111+0000","last_fullsized":"2023-07-05T18:56:16.474111+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T18:56:14.665171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T18:56:14.665171+0000","last_clean_scrub_stamp":"2023-07-05T18:56:14.665171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-06T21:50:37.526388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-07-05T18:56:15.133684+0000","last_change":"2023-07-05T18:56:15.127191+0000","last_active":"2023-07-05T18:56:15.133684+0000","last_peered":"2023-07-05T18:56:15.133684+0000","last_clean":"2023-07-05T18:56:15.133684+0000","last_became_active":"2023-07-05T18:56:15.126872+0000","last_became_peered":"2023-07-05T18:56:15.126872+0000","last_unstale":"2023-07-05T18:56:15.133684+0000","last_undegraded":"2023-07-05T18:56:15.133684+0000","last_fullsized":"2023-07-05T18:56:15.133684+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T18:56:14.665171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T18:56:14.665171+0000","last_clean_scrub_stamp":"2023-07-05T18:56:14.665171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-06T19:58:32.961693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-07-05T18:56:15.114012+0000","last_change":"2023-07-05T18:56:15.108982+0000","last_active":"2023-07-05T18:56:15.114012+0000","last_peered":"2023-07-05T18:56:15.114012+0000","last_clean":"2023-07-05T18:56:15.114012+0000","last_became_active":"2023-07-05T18:56:15.108461+0000","last_became_peered":"2023-07-05T18:56:15.108461+0000","last_unstale":"2023-07-05T18:56:15.114012+0000","last_undegraded":"2023-07-05T18:56:15.114012+0000","last_fullsized":"2023-07-05T18:56:15.114012+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T18:56:14.665171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T18:56:14.665171+0000","last_clean_scrub_stamp":"2023-07-05T18:56:14.665171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T05:30:14.562901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-07-05T18:56:15.133518+0000","last_change":"2023-07-05T18:56:15.124274+0000","last_active":"2023-07-05T18:56:15.133518+0000","last_peered":"2023-07-05T18:56:15.133518+0000","last_clean":"2023-07-05T18:56:15.133518+0000","last_became_active":"2023-07-05T18:56:15.123758+0000","last_became_peered":"2023-07-05T18:56:15.123758+0000","last_unstale":"2023-07-05T18:56:15.133518+0000","last_undegraded":"2023-07-05T18:56:15.133518+0000","last_fullsized":"2023-07-05T18:56:15.133518+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T18:56:14.665171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T18:56:14.665171+0000","last_clean_scrub_stamp":"2023-07-05T18:56:14.665171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-06T21:33:55.031584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-05T18:56:17.158642+0000","last_change":"2023-07-05T18:56:15.123685+0000","last_active":"2023-07-05T18:56:17.158642+0000","last_peered":"2023-07-05T18:56:17.158642+0000","last_clean":"2023-07-05T18:56:17.158642+0000","last_became_active":"2023-07-05T18:56:15.123431+0000","last_became_peered":"2023-07-05T18:56:15.123431+0000","last_unstale":"2023-07-05T18:56:17.158642+0000","last_undegraded":"2023-07-05T18:56:17.158642+0000","last_fullsized":"2023-07-05T18:56:17.158642+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T18:56:14.665171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T18:56:14.665171+0000","last_clean_scrub_stamp":"2023-07-05T18:56:14.665171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T04:41:48.823682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-05T18:56:16.473936+0000","last_change":"2023-07-05T18:56:15.116119+0000","last_active":"2023-07-05T18:56:16.473936+0000","last_peered":"2023-07-05T18:56:16.473936+0000","last_clean":"2023-07-05T18:56:16.473936+0000","last_became_active":"2023-07-05T18:56:15.115869+0000","last_became_peered":"2023-07-05T18:56:15.115869+0000","last_unstale":"2023-07-05T18:56:16.473936+0000","last_undegraded":"2023-07-05T18:56:16.473936+0000","last_fullsized":"2023-07-05T18:56:16.473936+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T18:56:14.665171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T18:56:14.665171+0000","last_clean_scrub_stamp":"2023-07-05T18:56:14.665171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-06T19:43:28.708822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-05T18:56:16.104324+0000","last_change":"2023-07-05T18:56:15.122698+0000","last_active":"2023-07-05T18:56:16.104324+0000","last_peered":"2023-07-05T18:56:16.104324+0000","last_clean":"2023-07-05T18:56:16.104324+0000","last_became_active":"2023-07-05T18:56:15.122391+0000","last_became_peered":"2023-07-05T18:56:15.122391+0000","last_unstale":"2023-07-05T18:56:16.104324+0000","last_undegraded":"2023-07-05T18:56:16.104324+0000","last_fullsized":"2023-07-05T18:56:16.104324+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T18:56:14.665171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T18:56:14.665171+0000","last_clean_scrub_stamp":"2023-07-05T18:56:14.665171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T03:02:00.204080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-05T18:56:17.158207+0000","last_change":"2023-07-05T18:56:15.125120+0000","last_active":"2023-07-05T18:56:17.158207+0000","last_peered":"2023-07-05T18:56:17.158207+0000","last_clean":"2023-07-05T18:56:17.158207+0000","last_became_active":"2023-07-05T18:56:15.124790+0000","last_became_peered":"2023-07-05T18:56:15.124790+0000","last_unstale":"2023-07-05T18:56:17.158207+0000","last_undegraded":"2023-07-05T18:56:17.158207+0000","last_fullsized":"2023-07-05T18:56:17.158207+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T18:56:14.665171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T18:56:14.665171+0000","last_clean_scrub_stamp":"2023-07-05T18:56:14.665171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-06T21:14:58.040487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-05T18:56:17.190914+0000","last_change":"2023-07-05T18:56:15.109580+0000","last_active":"2023-07-05T18:56:17.190914+0000","last_peered":"2023-07-05T18:56:17.190914+0000","last_clean":"2023-07-05T18:56:17.190914+0000","last_became_active":"2023-07-05T18:56:15.109054+0000","last_became_peered":"2023-07-05T18:56:15.109054+0000","last_unstale":"2023-07-05T18:56:17.190914+0000","last_undegraded":"2023-07-05T18:56:17.190914+0000","last_fullsized":"2023-07-05T18:56:17.190914+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T18:56:14.665171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T18:56:14.665171+0000","last_clean_scrub_stamp":"2023-07-05T18:56:14.665171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T04:53:59.163434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-05T18:56:17.191114+0000","last_change":"2023-07-05T18:56:15.103610+0000","last_active":"2023-07-05T18:56:17.191114+0000","last_peered":"2023-07-05T18:56:17.191114+0000","last_clean":"2023-07-05T18:56:17.191114+0000","last_became_active":"2023-07-05T18:56:15.103321+0000","last_became_peered":"2023-07-05T18:56:15.103321+0000","last_unstale":"2023-07-05T18:56:17.191114+0000","last_undegraded":"2023-07-05T18:56:17.191114+0000","last_fullsized":"2023-07-05T18:56:17.191114+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T18:56:14.665171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T18:56:14.665171+0000","last_clean_scrub_stamp":"2023-07-05T18:56:14.665171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T03:02:00.204080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-05T18:56:16.105649+0000","last_change":"2023-07-05T18:56:15.121207+0000","last_active":"2023-07-05T18:56:16.105649+0000","last_peered":"2023-07-05T18:56:16.105649+0000","last_clean":"2023-07-05T18:56:16.105649+0000","last_became_active":"2023-07-05T18:56:15.120697+0000","last_became_peered":"2023-07-05T18:56:15.120697+0000","last_unstale":"2023-07-05T18:56:16.105649+0000","last_undegraded":"2023-07-05T18:56:16.105649+0000","last_fullsized":"2023-07-05T18:56:16.105649+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T18:56:14.665171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T18:56:14.665171+0000","last_clean_scrub_stamp":"2023-07-05T18:56:14.665171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T03:08:48.441898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"20'1","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-07-05T18:56:15.125510+0000","last_change":"2023-07-05T18:56:14.692934+0000","last_active":"2023-07-05T18:56:15.125510+0000","last_peered":"2023-07-05T18:56:15.125510+0000","last_clean":"2023-07-05T18:56:15.125510+0000","last_became_active":"2023-07-05T18:56:14.692645+0000","last_became_peered":"2023-07-05T18:56:14.692645+0000","last_unstale":"2023-07-05T18:56:15.125510+0000","last_undegraded":"2023-07-05T18:56:15.125510+0000","last_fullsized":"2023-07-05T18:56:15.125510+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T18:56:13.659893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T18:56:13.659893+0000","last_clean_scrub_stamp":"2023-07-05T18:56:13.659893+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T05:13:26.630999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-05T18:56:16.104876+0000","last_change":"2023-07-05T18:56:15.112376+0000","last_active":"2023-07-05T18:56:16.104876+0000","last_peered":"2023-07-05T18:56:16.104876+0000","last_clean":"2023-07-05T18:56:16.104876+0000","last_became_active":"2023-07-05T18:56:15.111904+0000","last_became_peered":"2023-07-05T18:56:15.111904+0000","last_unstale":"2023-07-05T18:56:16.104876+0000","last_undegraded":"2023-07-05T18:56:16.104876+0000","last_fullsized":"2023-07-05T18:56:16.104876+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T18:56:14.665171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T18:56:14.665171+0000","last_clean_scrub_stamp":"2023-07-05T18:56:14.665171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T03:39:30.527160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-05T18:56:17.190892+0000","last_change":"2023-07-05T18:56:14.698190+0000","last_active":"2023-07-05T18:56:17.190892+0000","last_peered":"2023-07-05T18:56:17.190892+0000","last_clean":"2023-07-05T18:56:17.190892+0000","last_became_active":"2023-07-05T18:56:14.697916+0000","last_became_peered":"2023-07-05T18:56:14.697916+0000","last_unstale":"2023-07-05T18:56:17.190892+0000","last_undegraded":"2023-07-05T18:56:17.190892+0000","last_fullsized":"2023-07-05T18:56:17.190892+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T18:56:13.659893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T18:56:13.659893+0000","last_clean_scrub_stamp":"2023-07-05T18:56:13.659893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T05:13:26.630999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-05T18:56:16.474349+0000","last_change":"2023-07-05T18:56:15.121188+0000","last_active":"2023-07-05T18:56:16.474349+0000","last_peered":"2023-07-05T18:56:16.474349+0000","last_clean":"2023-07-05T18:56:16.474349+0000","last_became_active":"2023-07-05T18:56:15.120955+0000","last_became_peered":"2023-07-05T18:56:15.120955+0000","last_unstale":"2023-07-05T18:56:16.474349+0000","last_undegraded":"2023-07-05T18:56:16.474349+0000","last_fullsized":"2023-07-05T18:56:16.474349+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T18:56:14.665171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T18:56:14.665171+0000","last_clean_scrub_stamp":"2023-07-05T18:56:14.665171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-06T21:14:58.040487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-05T18:56:16.104435+0000","last_change":"2023-07-05T18:56:14.689037+0000","last_active":"2023-07-05T18:56:16.104435+0000","last_peered":"2023-07-05T18:56:16.104435+0000","last_clean":"2023-07-05T18:56:16.104435+0000","last_became_active":"2023-07-05T18:56:14.688728+0000","last_became_peered":"2023-07-05T18:56:14.688728+0000","last_unstale":"2023-07-05T18:56:16.104435+0000","last_undegraded":"2023-07-05T18:56:16.104435+0000","last_fullsized":"2023-07-05T18:56:16.104435+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T18:56:13.659893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T18:56:13.659893+0000","last_clean_scrub_stamp":"2023-07-05T18:56:13.659893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-06T22:32:10.488434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-05T18:56:16.105018+0000","last_change":"2023-07-05T18:56:15.115710+0000","last_active":"2023-07-05T18:56:16.105018+0000","last_peered":"2023-07-05T18:56:16.105018+0000","last_clean":"2023-07-05T18:56:16.105018+0000","last_became_active":"2023-07-05T18:56:15.115354+0000","last_became_peered":"2023-07-05T18:56:15.115354+0000","last_unstale":"2023-07-05T18:56:16.105018+0000","last_undegraded":"2023-07-05T18:56:16.105018+0000","last_fullsized":"2023-07-05T18:56:16.105018+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T18:56:14.665171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T18:56:14.665171+0000","last_clean_scrub_stamp":"2023-07-05T18:56:14.665171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T02:24:35.873082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-05T18:56:16.474292+0000","last_change":"2023-07-05T18:56:14.689657+0000","last_active":"2023-07-05T18:56:16.474292+0000","last_peered":"2023-07-05T18:56:16.474292+0000","last_clean":"2023-07-05T18:56:16.474292+0000","last_became_active":"2023-07-05T18:56:14.689065+0000","last_became_peered":"2023-07-05T18:56:14.689065+0000","last_unstale":"2023-07-05T18:56:16.474292+0000","last_undegraded":"2023-07-05T18:56:16.474292+0000","last_fullsized":"2023-07-05T18:56:16.474292+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T18:56:13.659893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T18:56:13.659893+0000","last_clean_scrub_stamp":"2023-07-05T18:56:13.659893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T01:35:59.096513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-05T18:56:16.104489+0000","last_change":"2023-07-05T18:56:15.113602+0000","last_active":"2023-07-05T18:56:16.104489+0000","last_peered":"2023-07-05T18:56:16.104489+0000","last_clean":"2023-07-05T18:56:16.104489+0000","last_became_active":"2023-07-05T18:56:15.113313+0000","last_became_peered":"2023-07-05T18:56:15.113313+0000","last_unstale":"2023-07-05T18:56:16.104489+0000","last_undegraded":"2023-07-05T18:56:16.104489+0000","last_fullsized":"2023-07-05T18:56:16.104489+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T18:56:14.665171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T18:56:14.665171+0000","last_clean_scrub_stamp":"2023-07-05T18:56:14.665171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-06T21:14:58.040487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-05T18:56:16.105135+0000","last_change":"2023-07-05T18:56:14.686543+0000","last_active":"2023-07-05T18:56:16.105135+0000","last_peered":"2023-07-05T18:56:16.105135+0000","last_clean":"2023-07-05T18:56:16.105135+0000","last_became_active":"2023-07-05T18:56:14.686277+0000","last_became_peered":"2023-07-05T18:56:14.686277+0000","last_unstale":"2023-07-05T18:56:16.105135+0000","last_undegraded":"2023-07-05T18:56:16.105135+0000","last_fullsized":"2023-07-05T18:56:16.105135+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T18:56:13.659893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T18:56:13.659893+0000","last_clean_scrub_stamp":"2023-07-05T18:56:13.659893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T05:13:26.630999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-05T18:56:16.104551+0000","last_change":"2023-07-05T18:56:15.117293+0000","last_active":"2023-07-05T18:56:16.104551+0000","last_peered":"2023-07-05T18:56:16.104551+0000","last_clean":"2023-07-05T18:56:16.104551+0000","last_became_active":"2023-07-05T18:56:15.114133+0000","last_became_peered":"2023-07-05T18:56:15.114133+0000","last_unstale":"2023-07-05T18:56:16.104551+0000","last_undegraded":"2023-07-05T18:56:16.104551+0000","last_fullsized":"2023-07-05T18:56:16.104551+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T18:56:14.665171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T18:56:14.665171+0000","last_clean_scrub_stamp":"2023-07-05T18:56:14.665171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T02:13:19.229598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"20'3","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-05T18:56:17.158600+0000","last_change":"2023-07-05T18:56:14.697955+0000","last_active":"2023-07-05T18:56:17.158600+0000","last_peered":"2023-07-05T18:56:17.158600+0000","last_clean":"2023-07-05T18:56:17.158600+0000","last_became_active":"2023-07-05T18:56:14.697729+0000","last_became_peered":"2023-07-05T18:56:14.697729+0000","last_unstale":"2023-07-05T18:56:17.158600+0000","last_undegraded":"2023-07-05T18:56:17.158600+0000","last_fullsized":"2023-07-05T18:56:17.158600+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T18:56:13.659893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T18:56:13.659893+0000","last_clean_scrub_stamp":"2023-07-05T18:56:13.659893+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T00:22:00.885983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-05T18:56:17.190602+0000","last_change":"2023-07-05T18:56:15.119531+0000","last_active":"2023-07-05T18:56:17.190602+0000","last_peered":"2023-07-05T18:56:17.190602+0000","last_clean":"2023-07-05T18:56:17.190602+0000","last_became_active":"2023-07-05T18:56:15.118905+0000","last_became_peered":"2023-07-05T18:56:15.118905+0000","last_unstale":"2023-07-05T18:56:17.190602+0000","last_undegraded":"2023-07-05T18:56:17.190602+0000","last_fullsized":"2023-07-05T18:56:17.190602+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T18:56:14.665171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T18:56:14.665171+0000","last_clean_scrub_stamp":"2023-07-05T18:56:14.665171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T01:07:17.521433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"20'6","reported_seq":17,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-07-05T18:56:15.136565+0000","last_change":"2023-07-05T18:56:14.686257+0000","last_active":"2023-07-05T18:56:15.136565+0000","last_peered":"2023-07-05T18:56:15.136565+0000","last_clean":"2023-07-05T18:56:15.136565+0000","last_became_active":"2023-07-05T18:56:14.685975+0000","last_became_peered":"2023-07-05T18:56:14.685975+0000","last_unstale":"2023-07-05T18:56:15.136565+0000","last_undegraded":"2023-07-05T18:56:15.136565+0000","last_fullsized":"2023-07-05T18:56:15.136565+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T18:56:13.659893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T18:56:13.659893+0000","last_clean_scrub_stamp":"2023-07-05T18:56:13.659893+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T02:49:04.932352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-07-05T18:56:15.130813+0000","last_change":"2023-07-05T18:56:15.123521+0000","last_active":"2023-07-05T18:56:15.130813+0000","last_peered":"2023-07-05T18:56:15.130813+0000","last_clean":"2023-07-05T18:56:15.130813+0000","last_became_active":"2023-07-05T18:56:15.123249+0000","last_became_peered":"2023-07-05T18:56:15.123249+0000","last_unstale":"2023-07-05T18:56:15.130813+0000","last_undegraded":"2023-07-05T18:56:15.130813+0000","last_fullsized":"2023-07-05T18:56:15.130813+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T18:56:14.665171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T18:56:14.665171+0000","last_clean_scrub_stamp":"2023-07-05T18:56:14.665171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T05:26:24.797742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.13","version":"20'2","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-05T18:56:17.158513+0000","last_change":"2023-07-05T18:56:14.688172+0000","last_active":"2023-07-05T18:56:17.158513+0000","last_peered":"2023-07-05T18:56:17.158513+0000","last_clean":"2023-07-05T18:56:17.158513+0000","last_became_active":"2023-07-05T18:56:14.687865+0000","last_became_peered":"2023-07-05T18:56:14.687865+0000","last_unstale":"2023-07-05T18:56:17.158513+0000","last_undegraded":"2023-07-05T18:56:17.158513+0000","last_fullsized":"2023-07-05T18:56:17.158513+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T18:56:13.659893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T18:56:13.659893+0000","last_clean_scrub_stamp":"2023-07-05T18:56:13.659893+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T01:08:18.213648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-05T18:56:16.104638+0000","last_change":"2023-07-05T18:56:15.122409+0000","last_active":"2023-07-05T18:56:16.104638+0000","last_peered":"2023-07-05T18:56:16.104638+0000","last_clean":"2023-07-05T18:56:16.104638+0000","last_became_active":"2023-07-05T18:56:15.122152+0000","last_became_peered":"2023-07-05T18:56:15.122152+0000","last_unstale":"2023-07-05T18:56:16.104638+0000","last_undegraded":"2023-07-05T18:56:16.104638+0000","last_fullsized":"2023-07-05T18:56:16.104638+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T18:56:14.665171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T18:56:14.665171+0000","last_clean_scrub_stamp":"2023-07-05T18:56:14.665171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T02:23:52.877499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-05T18:56:16.474220+0000","last_change":"2023-07-05T18:56:14.687246+0000","last_active":"2023-07-05T18:56:16.474220+0000","last_peered":"2023-07-05T18:56:16.474220+0000","last_clean":"2023-07-05T18:56:16.474220+0000","last_became_active":"2023-07-05T18:56:14.686917+0000","last_became_peered":"2023-07-05T18:56:14.686917+0000","last_unstale":"2023-07-05T18:56:16.474220+0000","last_undegraded":"2023-07-05T18:56:16.474220+0000","last_fullsized":"2023-07-05T18:56:16.474220+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T18:56:13.659893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T18:56:13.659893+0000","last_clean_scrub_stamp":"2023-07-05T18:56:13.659893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T03:01:59.198802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-05T18:56:16.105662+0000","last_change":"2023-07-05T18:56:15.120411+0000","last_active":"2023-07-05T18:56:16.105662+0000","last_peered":"2023-07-05T18:56:16.105662+0000","last_clean":"2023-07-05T18:56:16.105662+0000","last_became_active":"2023-07-05T18:56:15.117799+0000","last_became_peered":"2023-07-05T18:56:15.117799+0000","last_unstale":"2023-07-05T18:56:16.105662+0000","last_undegraded":"2023-07-05T18:56:16.105662+0000","last_fullsized":"2023-07-05T18:56:16.105662+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T18:56:14.665171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T18:56:14.665171+0000","last_clean_scrub_stamp":"2023-07-05T18:56:14.665171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-06T22:32:11.493711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-05T18:56:17.158276+0000","last_change":"2023-07-05T18:56:14.689699+0000","last_active":"2023-07-05T18:56:17.158276+0000","last_peered":"2023-07-05T18:56:17.158276+0000","last_clean":"2023-07-05T18:56:17.158276+0000","last_became_active":"2023-07-05T18:56:14.689136+0000","last_became_peered":"2023-07-05T18:56:14.689136+0000","last_unstale":"2023-07-05T18:56:17.158276+0000","last_undegraded":"2023-07-05T18:56:17.158276+0000","last_fullsized":"2023-07-05T18:56:17.158276+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T18:56:13.659893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T18:56:13.659893+0000","last_clean_scrub_stamp":"2023-07-05T18:56:13.659893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T02:13:18.224321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-05T18:56:16.474079+0000","last_change":"2023-07-05T18:56:15.121706+0000","last_active":"2023-07-05T18:56:16.474079+0000","last_peered":"2023-07-05T18:56:16.474079+0000","last_clean":"2023-07-05T18:56:16.474079+0000","last_became_active":"2023-07-05T18:56:15.121455+0000","last_became_peered":"2023-07-05T18:56:15.121455+0000","last_unstale":"2023-07-05T18:56:16.474079+0000","last_undegraded":"2023-07-05T18:56:16.474079+0000","last_fullsized":"2023-07-05T18:56:16.474079+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T18:56:14.665171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T18:56:14.665171+0000","last_clean_scrub_stamp":"2023-07-05T18:56:14.665171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T05:13:27.636276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"20'8","reported_seq":21,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-05T18:56:16.104386+0000","last_change":"2023-07-05T18:56:14.689000+0000","last_active":"2023-07-05T18:56:16.104386+0000","last_peered":"2023-07-05T18:56:16.104386+0000","last_clean":"2023-07-05T18:56:16.104386+0000","last_became_active":"2023-07-05T18:56:14.688670+0000","last_became_peered":"2023-07-05T18:56:14.688670+0000","last_unstale":"2023-07-05T18:56:16.104386+0000","last_undegraded":"2023-07-05T18:56:16.104386+0000","last_fullsized":"2023-07-05T18:56:16.104386+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T18:56:13.659893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T18:56:13.659893+0000","last_clean_scrub_stamp":"2023-07-05T18:56:13.659893+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-06T23:52:21.769984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-05T18:56:16.105133+0000","last_change":"2023-07-05T18:56:15.117236+0000","last_active":"2023-07-05T18:56:16.105133+0000","last_peered":"2023-07-05T18:56:16.105133+0000","last_clean":"2023-07-05T18:56:16.105133+0000","last_became_active":"2023-07-05T18:56:15.116848+0000","last_became_peered":"2023-07-05T18:56:15.116848+0000","last_unstale":"2023-07-05T18:56:16.105133+0000","last_undegraded":"2023-07-05T18:56:16.105133+0000","last_fullsized":"2023-07-05T18:56:16.105133+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T18:56:14.665171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T18:56:14.665171+0000","last_clean_scrub_stamp":"2023-07-05T18:56:14.665171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T04:41:48.823682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"20'1","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-05T18:56:17.158684+0000","last_change":"2023-07-05T18:56:14.688547+0000","last_active":"2023-07-05T18:56:17.158684+0000","last_peered":"2023-07-05T18:56:17.158684+0000","last_clean":"2023-07-05T18:56:17.158684+0000","last_became_active":"2023-07-05T18:56:14.688296+0000","last_became_peered":"2023-07-05T18:56:14.688296+0000","last_unstale":"2023-07-05T18:56:17.158684+0000","last_undegraded":"2023-07-05T18:56:17.158684+0000","last_fullsized":"2023-07-05T18:56:17.158684+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T18:56:13.659893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T18:56:13.659893+0000","last_clean_scrub_stamp":"2023-07-05T18:56:13.659893+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T02:16:58.460543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-05T18:56:16.105182+0000","last_change":"2023-07-05T18:56:15.117356+0000","last_active":"2023-07-05T18:56:16.105182+0000","last_peered":"2023-07-05T18:56:16.105182+0000","last_clean":"2023-07-05T18:56:16.105182+0000","last_became_active":"2023-07-05T18:56:15.117053+0000","last_became_peered":"2023-07-05T18:56:15.117053+0000","last_unstale":"2023-07-05T18:56:16.105182+0000","last_undegraded":"2023-07-05T18:56:16.105182+0000","last_fullsized":"2023-07-05T18:56:16.105182+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T18:56:14.665171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T18:56:14.665171+0000","last_clean_scrub_stamp":"2023-07-05T18:56:14.665171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T04:53:59.163434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"20'2","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-05T18:56:17.158412+0000","last_change":"2023-07-05T18:56:14.688203+0000","last_active":"2023-07-05T18:56:17.158412+0000","last_peered":"2023-07-05T18:56:17.158412+0000","last_clean":"2023-07-05T18:56:17.158412+0000","last_became_active":"2023-07-05T18:56:14.687907+0000","last_became_peered":"2023-07-05T18:56:14.687907+0000","last_unstale":"2023-07-05T18:56:17.158412+0000","last_undegraded":"2023-07-05T18:56:17.158412+0000","last_fullsized":"2023-07-05T18:56:17.158412+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T18:56:13.659893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T18:56:13.659893+0000","last_clean_scrub_stamp":"2023-07-05T18:56:13.659893+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T04:34:53.807856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-07-05T18:56:15.130776+0000","last_change":"2023-07-05T18:56:15.122876+0000","last_active":"2023-07-05T18:56:15.130776+0000","last_peered":"2023-07-05T18:56:15.130776+0000","last_clean":"2023-07-05T18:56:15.130776+0000","last_became_active":"2023-07-05T18:56:15.122580+0000","last_became_peered":"2023-07-05T18:56:15.122580+0000","last_unstale":"2023-07-05T18:56:15.130776+0000","last_undegraded":"2023-07-05T18:56:15.130776+0000","last_fullsized":"2023-07-05T18:56:15.130776+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T18:56:14.665171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T18:56:14.665171+0000","last_clean_scrub_stamp":"2023-07-05T18:56:14.665171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T02:02:14.785284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.d","version":"20'1","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-05T18:56:17.158635+0000","last_change":"2023-07-05T18:56:14.688520+0000","last_active":"2023-07-05T18:56:17.158635+0000","last_peered":"2023-07-05T18:56:17.158635+0000","last_clean":"2023-07-05T18:56:17.158635+0000","last_became_active":"2023-07-05T18:56:14.688106+0000","last_became_peered":"2023-07-05T18:56:14.688106+0000","last_unstale":"2023-07-05T18:56:17.158635+0000","last_undegraded":"2023-07-05T18:56:17.158635+0000","last_fullsized":"2023-07-05T18:56:17.158635+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T18:56:13.659893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T18:56:13.659893+0000","last_clean_scrub_stamp":"2023-07-05T18:56:13.659893+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-06T23:38:28.346200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-05T18:56:16.104261+0000","last_change":"2023-07-05T18:56:15.112983+0000","last_active":"2023-07-05T18:56:16.104261+0000","last_peered":"2023-07-05T18:56:16.104261+0000","last_clean":"2023-07-05T18:56:16.104261+0000","last_became_active":"2023-07-05T18:56:15.112573+0000","last_became_peered":"2023-07-05T18:56:15.112573+0000","last_unstale":"2023-07-05T18:56:16.104261+0000","last_undegraded":"2023-07-05T18:56:16.104261+0000","last_fullsized":"2023-07-05T18:56:16.104261+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T18:56:14.665171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T18:56:14.665171+0000","last_clean_scrub_stamp":"2023-07-05T18:56:14.665171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-06T19:43:28.708822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-05T18:56:16.105586+0000","last_change":"2023-07-05T18:56:14.683769+0000","last_active":"2023-07-05T18:56:16.105586+0000","last_peered":"2023-07-05T18:56:16.105586+0000","last_clean":"2023-07-05T18:56:16.105586+0000","last_became_active":"2023-07-05T18:56:14.683471+0000","last_became_peered":"2023-07-05T18:56:14.683471+0000","last_unstale":"2023-07-05T18:56:16.105586+0000","last_undegraded":"2023-07-05T18:56:16.105586+0000","last_fullsized":"2023-07-05T18:56:16.105586+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T18:56:13.659893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T18:56:13.659893+0000","last_clean_scrub_stamp":"2023-07-05T18:56:13.659893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T03:01:59.198802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-05T18:56:16.474241+0000","last_change":"2023-07-05T18:56:15.120318+0000","last_active":"2023-07-05T18:56:16.474241+0000","last_peered":"2023-07-05T18:56:16.474241+0000","last_clean":"2023-07-05T18:56:16.474241+0000","last_became_active":"2023-07-05T18:56:15.119781+0000","last_became_peered":"2023-07-05T18:56:15.119781+0000","last_unstale":"2023-07-05T18:56:16.474241+0000","last_undegraded":"2023-07-05T18:56:16.474241+0000","last_fullsized":"2023-07-05T18:56:16.474241+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T18:56:14.665171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T18:56:14.665171+0000","last_clean_scrub_stamp":"2023-07-05T18:56:14.665171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T03:08:48.441898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"20'2","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-05T18:56:16.104648+0000","last_change":"2023-07-05T18:56:14.697766+0000","last_active":"2023-07-05T18:56:16.104648+0000","last_peered":"2023-07-05T18:56:16.104648+0000","last_clean":"2023-07-05T18:56:16.104648+0000","last_became_active":"2023-07-05T18:56:14.697460+0000","last_became_peered":"2023-07-05T18:56:14.697460+0000","last_unstale":"2023-07-05T18:56:16.104648+0000","last_undegraded":"2023-07-05T18:56:16.104648+0000","last_fullsized":"2023-07-05T18:56:16.104648+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T18:56:13.659893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T18:56:13.659893+0000","last_clean_scrub_stamp":"2023-07-05T18:56:13.659893+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T05:47:50.661848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-07-05T18:56:15.133658+0000","last_change":"2023-07-05T18:56:15.126143+0000","last_active":"2023-07-05T18:56:15.133658+0000","last_peered":"2023-07-05T18:56:15.133658+0000","last_clean":"2023-07-05T18:56:15.133658+0000","last_became_active":"2023-07-05T18:56:15.125704+0000","last_became_peered":"2023-07-05T18:56:15.125704+0000","last_unstale":"2023-07-05T18:56:15.133658+0000","last_undegraded":"2023-07-05T18:56:15.133658+0000","last_fullsized":"2023-07-05T18:56:15.133658+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T18:56:14.665171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T18:56:14.665171+0000","last_clean_scrub_stamp":"2023-07-05T18:56:14.665171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-06T20:51:12.239710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-05T18:56:16.104166+0000","last_change":"2023-07-05T18:56:14.681768+0000","last_active":"2023-07-05T18:56:16.104166+0000","last_peered":"2023-07-05T18:56:16.104166+0000","last_clean":"2023-07-05T18:56:16.104166+0000","last_became_active":"2023-07-05T18:56:14.681488+0000","last_became_peered":"2023-07-05T18:56:14.681488+0000","last_unstale":"2023-07-05T18:56:16.104166+0000","last_undegraded":"2023-07-05T18:56:16.104166+0000","last_fullsized":"2023-07-05T18:56:16.104166+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T18:56:13.659893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T18:56:13.659893+0000","last_clean_scrub_stamp":"2023-07-05T18:56:13.659893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T01:07:16.516155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-07-05T18:56:15.136235+0000","last_change":"2023-07-05T18:56:15.131136+0000","last_active":"2023-07-05T18:56:15.136235+0000","last_peered":"2023-07-05T18:56:15.136235+0000","last_clean":"2023-07-05T18:56:15.136235+0000","last_became_active":"2023-07-05T18:56:15.130845+0000","last_became_peered":"2023-07-05T18:56:15.130845+0000","last_unstale":"2023-07-05T18:56:15.136235+0000","last_undegraded":"2023-07-05T18:56:15.136235+0000","last_fullsized":"2023-07-05T18:56:15.136235+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T18:56:14.665171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T18:56:14.665171+0000","last_clean_scrub_stamp":"2023-07-05T18:56:14.665171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T02:24:35.873082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-07-05T18:56:15.117140+0000","last_change":"2023-07-05T18:56:14.694531+0000","last_active":"2023-07-05T18:56:15.117140+0000","last_peered":"2023-07-05T18:56:15.117140+0000","last_clean":"2023-07-05T18:56:15.117140+0000","last_became_active":"2023-07-05T18:56:14.694255+0000","last_became_peered":"2023-07-05T18:56:14.694255+0000","last_unstale":"2023-07-05T18:56:15.117140+0000","last_undegraded":"2023-07-05T18:56:15.117140+0000","last_fullsized":"2023-07-05T18:56:15.117140+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T18:56:13.659893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T18:56:13.659893+0000","last_clean_scrub_stamp":"2023-07-05T18:56:13.659893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-06T19:43:27.703545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-07-05T18:56:15.133536+0000","last_change":"2023-07-05T18:56:15.125686+0000","last_active":"2023-07-05T18:56:15.133536+0000","last_peered":"2023-07-05T18:56:15.133536+0000","last_clean":"2023-07-05T18:56:15.133536+0000","last_became_active":"2023-07-05T18:56:15.124278+0000","last_became_peered":"2023-07-05T18:56:15.124278+0000","last_unstale":"2023-07-05T18:56:15.133536+0000","last_undegraded":"2023-07-05T18:56:15.133536+0000","last_fullsized":"2023-07-05T18:56:15.133536+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T18:56:14.665171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T18:56:14.665171+0000","last_clean_scrub_stamp":"2023-07-05T18:56:14.665171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-06T20:53:53.750240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-05T18:56:16.104272+0000","last_change":"2023-07-05T18:56:14.697776+0000","last_active":"2023-07-05T18:56:16.104272+0000","last_peered":"2023-07-05T18:56:16.104272+0000","last_clean":"2023-07-05T18:56:16.104272+0000","last_became_active":"2023-07-05T18:56:14.697446+0000","last_became_peered":"2023-07-05T18:56:14.697446+0000","last_unstale":"2023-07-05T18:56:16.104272+0000","last_undegraded":"2023-07-05T18:56:16.104272+0000","last_fullsized":"2023-07-05T18:56:16.104272+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T18:56:13.659893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T18:56:13.659893+0000","last_clean_scrub_stamp":"2023-07-05T18:56:13.659893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T03:19:03.957135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-05T18:56:17.191314+0000","last_change":"2023-07-05T18:56:15.119281+0000","last_active":"2023-07-05T18:56:17.191314+0000","last_peered":"2023-07-05T18:56:17.191314+0000","last_clean":"2023-07-05T18:56:17.191314+0000","last_became_active":"2023-07-05T18:56:15.118746+0000","last_became_peered":"2023-07-05T18:56:15.118746+0000","last_unstale":"2023-07-05T18:56:17.191314+0000","last_undegraded":"2023-07-05T18:56:17.191314+0000","last_fullsized":"2023-07-05T18:56:17.191314+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T18:56:14.665171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T18:56:14.665171+0000","last_clean_scrub_stamp":"2023-07-05T18:56:14.665171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-06T22:32:11.493711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"20'2","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-05T18:56:16.104993+0000","last_change":"2023-07-05T18:56:14.688850+0000","last_active":"2023-07-05T18:56:16.104993+0000","last_peered":"2023-07-05T18:56:16.104993+0000","last_clean":"2023-07-05T18:56:16.104993+0000","last_became_active":"2023-07-05T18:56:14.688549+0000","last_became_peered":"2023-07-05T18:56:14.688549+0000","last_unstale":"2023-07-05T18:56:16.104993+0000","last_undegraded":"2023-07-05T18:56:16.104993+0000","last_fullsized":"2023-07-05T18:56:16.104993+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T18:56:13.659893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T18:56:13.659893+0000","last_clean_scrub_stamp":"2023-07-05T18:56:13.659893+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-06T23:38:28.346200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":17,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-07-05T18:56:15.117521+0000","last_change":"2023-07-05T18:56:09.622184+0000","last_active":"2023-07-05T18:56:15.117521+0000","last_peered":"2023-07-05T18:56:15.117521+0000","last_clean":"2023-07-05T18:56:15.117521+0000","last_became_active":"2023-07-05T18:56:09.621796+0000","last_became_peered":"2023-07-05T18:56:09.621796+0000","last_unstale":"2023-07-05T18:56:15.117521+0000","last_undegraded":"2023-07-05T18:56:15.117521+0000","last_fullsized":"2023-07-05T18:56:15.117521+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T18:56:08.603137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T18:56:08.603137+0000","last_clean_scrub_stamp":"2023-07-05T18:56:08.603137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-06T21:50:31.464355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-05T18:56:16.104244+0000","last_change":"2023-07-05T18:56:15.117197+0000","last_active":"2023-07-05T18:56:16.104244+0000","last_peered":"2023-07-05T18:56:16.104244+0000","last_clean":"2023-07-05T18:56:16.104244+0000","last_became_active":"2023-07-05T18:56:15.116612+0000","last_became_peered":"2023-07-05T18:56:15.116612+0000","last_unstale":"2023-07-05T18:56:16.104244+0000","last_undegraded":"2023-07-05T18:56:16.104244+0000","last_fullsized":"2023-07-05T18:56:16.104244+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T18:56:14.665171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T18:56:14.665171+0000","last_clean_scrub_stamp":"2023-07-05T18:56:14.665171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T02:24:35.873082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":19,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-05T18:56:16.104703+0000","last_change":"2023-07-05T18:56:09.621596+0000","last_active":"2023-07-05T18:56:16.104703+0000","last_peered":"2023-07-05T18:56:16.104703+0000","last_clean":"2023-07-05T18:56:16.104703+0000","last_became_active":"2023-07-05T18:56:09.621315+0000","last_became_peered":"2023-07-05T18:56:09.621315+0000","last_unstale":"2023-07-05T18:56:16.104703+0000","last_undegraded":"2023-07-05T18:56:16.104703+0000","last_fullsized":"2023-07-05T18:56:16.104703+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T18:56:08.603137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T18:56:08.603137+0000","last_clean_scrub_stamp":"2023-07-05T18:56:08.603137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T01:08:13.156892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-05T18:56:16.474396+0000","last_change":"2023-07-05T18:56:14.693939+0000","last_active":"2023-07-05T18:56:16.474396+0000","last_peered":"2023-07-05T18:56:16.474396+0000","last_clean":"2023-07-05T18:56:16.474396+0000","last_became_active":"2023-07-05T18:56:14.693663+0000","last_became_peered":"2023-07-05T18:56:14.693663+0000","last_unstale":"2023-07-05T18:56:16.474396+0000","last_undegraded":"2023-07-05T18:56:16.474396+0000","last_fullsized":"2023-07-05T18:56:16.474396+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T18:56:13.659893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T18:56:13.659893+0000","last_clean_scrub_stamp":"2023-07-05T18:56:13.659893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T02:23:51.872222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-07-05T18:56:15.133685+0000","last_change":"2023-07-05T18:56:15.127817+0000","last_active":"2023-07-05T18:56:15.133685+0000","last_peered":"2023-07-05T18:56:15.133685+0000","last_clean":"2023-07-05T18:56:15.133685+0000","last_became_active":"2023-07-05T18:56:15.127512+0000","last_became_peered":"2023-07-05T18:56:15.127512+0000","last_unstale":"2023-07-05T18:56:15.133685+0000","last_undegraded":"2023-07-05T18:56:15.133685+0000","last_fullsized":"2023-07-05T18:56:15.133685+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T18:56:14.665171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T18:56:14.665171+0000","last_clean_scrub_stamp":"2023-07-05T18:56:14.665171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T02:43:21.743318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":19,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-05T18:56:17.190599+0000","last_change":"2023-07-05T18:56:09.617992+0000","last_active":"2023-07-05T18:56:17.190599+0000","last_peered":"2023-07-05T18:56:17.190599+0000","last_clean":"2023-07-05T18:56:17.190599+0000","last_became_active":"2023-07-05T18:56:09.617720+0000","last_became_peered":"2023-07-05T18:56:09.617720+0000","last_unstale":"2023-07-05T18:56:17.190599+0000","last_undegraded":"2023-07-05T18:56:17.190599+0000","last_fullsized":"2023-07-05T18:56:17.190599+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T18:56:08.603137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T18:56:08.603137+0000","last_clean_scrub_stamp":"2023-07-05T18:56:08.603137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-06T19:43:22.646788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"17'117","reported_seq":169,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-05T18:56:17.158224+0000","last_change":"2023-07-05T18:56:09.621746+0000","last_active":"2023-07-05T18:56:17.158224+0000","last_peered":"2023-07-05T18:56:17.158224+0000","last_clean":"2023-07-05T18:56:17.158224+0000","last_became_active":"2023-07-05T18:56:09.621421+0000","last_became_peered":"2023-07-05T18:56:09.621421+0000","last_unstale":"2023-07-05T18:56:17.158224+0000","last_undegraded":"2023-07-05T18:56:17.158224+0000","last_fullsized":"2023-07-05T18:56:17.158224+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T18:56:08.603137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T18:56:08.603137+0000","last_clean_scrub_stamp":"2023-07-05T18:56:08.603137+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T05:47:45.605092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-05T18:56:16.474394+0000","last_change":"2023-07-05T18:56:14.688968+0000","last_active":"2023-07-05T18:56:16.474394+0000","last_peered":"2023-07-05T18:56:16.474394+0000","last_clean":"2023-07-05T18:56:16.474394+0000","last_became_active":"2023-07-05T18:56:14.688664+0000","last_became_peered":"2023-07-05T18:56:14.688664+0000","last_unstale":"2023-07-05T18:56:16.474394+0000","last_undegraded":"2023-07-05T18:56:16.474394+0000","last_fullsized":"2023-07-05T18:56:16.474394+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T18:56:13.659893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T18:56:13.659893+0000","last_clean_scrub_stamp":"2023-07-05T18:56:13.659893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T02:13:18.224321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-05T18:56:16.474255+0000","last_change":"2023-07-05T18:56:15.121025+0000","last_active":"2023-07-05T18:56:16.474255+0000","last_peered":"2023-07-05T18:56:16.474255+0000","last_clean":"2023-07-05T18:56:16.474255+0000","last_became_active":"2023-07-05T18:56:15.120768+0000","last_became_peered":"2023-07-05T18:56:15.120768+0000","last_unstale":"2023-07-05T18:56:16.474255+0000","last_undegraded":"2023-07-05T18:56:16.474255+0000","last_fullsized":"2023-07-05T18:56:16.474255+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T18:56:14.665171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T18:56:14.665171+0000","last_clean_scrub_stamp":"2023-07-05T18:56:14.665171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-06T22:32:11.493711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":19,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-05T18:56:17.158181+0000","last_change":"2023-07-05T18:56:10.073940+0000","last_active":"2023-07-05T18:56:17.158181+0000","last_peered":"2023-07-05T18:56:17.158181+0000","last_clean":"2023-07-05T18:56:17.158181+0000","last_became_active":"2023-07-05T18:56:10.073617+0000","last_became_peered":"2023-07-05T18:56:10.073617+0000","last_unstale":"2023-07-05T18:56:17.158181+0000","last_undegraded":"2023-07-05T18:56:17.158181+0000","last_fullsized":"2023-07-05T18:56:17.158181+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T18:56:08.603137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T18:56:08.603137+0000","last_clean_scrub_stamp":"2023-07-05T18:56:08.603137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T02:23:46.815465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-05T18:56:17.190477+0000","last_change":"2023-07-05T18:56:14.694860+0000","last_active":"2023-07-05T18:56:17.190477+0000","last_peered":"2023-07-05T18:56:17.190477+0000","last_clean":"2023-07-05T18:56:17.190477+0000","last_became_active":"2023-07-05T18:56:14.694544+0000","last_became_peered":"2023-07-05T18:56:14.694544+0000","last_unstale":"2023-07-05T18:56:17.190477+0000","last_undegraded":"2023-07-05T18:56:17.190477+0000","last_fullsized":"2023-07-05T18:56:17.190477+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T18:56:13.659893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T18:56:13.659893+0000","last_clean_scrub_stamp":"2023-07-05T18:56:13.659893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-06T23:52:21.769984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-05T18:56:17.191246+0000","last_change":"2023-07-05T18:56:15.118635+0000","last_active":"2023-07-05T18:56:17.191246+0000","last_peered":"2023-07-05T18:56:17.191246+0000","last_clean":"2023-07-05T18:56:17.191246+0000","last_became_active":"2023-07-05T18:56:15.115781+0000","last_became_peered":"2023-07-05T18:56:15.115781+0000","last_unstale":"2023-07-05T18:56:17.191246+0000","last_undegraded":"2023-07-05T18:56:17.191246+0000","last_fullsized":"2023-07-05T18:56:17.191246+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T18:56:14.665171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T18:56:14.665171+0000","last_clean_scrub_stamp":"2023-07-05T18:56:14.665171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T03:08:48.441898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":19,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-05T18:56:17.158048+0000","last_change":"2023-07-05T18:56:10.073658+0000","last_active":"2023-07-05T18:56:17.158048+0000","last_peered":"2023-07-05T18:56:17.158048+0000","last_clean":"2023-07-05T18:56:17.158048+0000","last_became_active":"2023-07-05T18:56:10.073336+0000","last_became_peered":"2023-07-05T18:56:10.073336+0000","last_unstale":"2023-07-05T18:56:17.158048+0000","last_undegraded":"2023-07-05T18:56:17.158048+0000","last_fullsized":"2023-07-05T18:56:17.158048+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T18:56:08.603137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T18:56:08.603137+0000","last_clean_scrub_stamp":"2023-07-05T18:56:08.603137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T01:35:54.039757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-05T18:56:16.104468+0000","last_change":"2023-07-05T18:56:14.684990+0000","last_active":"2023-07-05T18:56:16.104468+0000","last_peered":"2023-07-05T18:56:16.104468+0000","last_clean":"2023-07-05T18:56:16.104468+0000","last_became_active":"2023-07-05T18:56:14.684539+0000","last_became_peered":"2023-07-05T18:56:14.684539+0000","last_unstale":"2023-07-05T18:56:16.104468+0000","last_undegraded":"2023-07-05T18:56:16.104468+0000","last_fullsized":"2023-07-05T18:56:16.104468+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T18:56:13.659893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T18:56:13.659893+0000","last_clean_scrub_stamp":"2023-07-05T18:56:13.659893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T01:35:59.096513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-05T18:56:16.104626+0000","last_change":"2023-07-05T18:56:15.128949+0000","last_active":"2023-07-05T18:56:16.104626+0000","last_peered":"2023-07-05T18:56:16.104626+0000","last_clean":"2023-07-05T18:56:16.104626+0000","last_became_active":"2023-07-05T18:56:15.128650+0000","last_became_peered":"2023-07-05T18:56:15.128650+0000","last_unstale":"2023-07-05T18:56:16.104626+0000","last_undegraded":"2023-07-05T18:56:16.104626+0000","last_fullsized":"2023-07-05T18:56:16.104626+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T18:56:14.665171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T18:56:14.665171+0000","last_clean_scrub_stamp":"2023-07-05T18:56:14.665171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T04:53:59.163434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":19,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-05T18:56:16.105025+0000","last_change":"2023-07-05T18:56:10.073693+0000","last_active":"2023-07-05T18:56:16.105025+0000","last_peered":"2023-07-05T18:56:16.105025+0000","last_clean":"2023-07-05T18:56:16.105025+0000","last_became_active":"2023-07-05T18:56:10.073356+0000","last_became_peered":"2023-07-05T18:56:10.073356+0000","last_unstale":"2023-07-05T18:56:16.105025+0000","last_undegraded":"2023-07-05T18:56:16.105025+0000","last_fullsized":"2023-07-05T18:56:16.105025+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T18:56:08.603137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T18:56:08.603137+0000","last_clean_scrub_stamp":"2023-07-05T18:56:08.603137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T02:48:59.875595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-07-05T18:56:15.117470+0000","last_change":"2023-07-05T18:56:14.694026+0000","last_active":"2023-07-05T18:56:15.117470+0000","last_peered":"2023-07-05T18:56:15.117470+0000","last_clean":"2023-07-05T18:56:15.117470+0000","last_became_active":"2023-07-05T18:56:14.693684+0000","last_became_peered":"2023-07-05T18:56:14.693684+0000","last_unstale":"2023-07-05T18:56:15.117470+0000","last_undegraded":"2023-07-05T18:56:15.117470+0000","last_fullsized":"2023-07-05T18:56:15.117470+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T18:56:13.659893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T18:56:13.659893+0000","last_clean_scrub_stamp":"2023-07-05T18:56:13.659893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T04:53:58.158157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-05T18:56:17.191015+0000","last_change":"2023-07-05T18:56:15.109026+0000","last_active":"2023-07-05T18:56:17.191015+0000","last_peered":"2023-07-05T18:56:17.191015+0000","last_clean":"2023-07-05T18:56:17.191015+0000","last_became_active":"2023-07-05T18:56:15.108685+0000","last_became_peered":"2023-07-05T18:56:15.108685+0000","last_unstale":"2023-07-05T18:56:17.191015+0000","last_undegraded":"2023-07-05T18:56:17.191015+0000","last_fullsized":"2023-07-05T18:56:17.191015+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T18:56:14.665171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T18:56:14.665171+0000","last_clean_scrub_stamp":"2023-07-05T18:56:14.665171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-06T21:50:37.526388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":19,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-05T18:56:16.104315+0000","last_change":"2023-07-05T18:56:10.073639+0000","last_active":"2023-07-05T18:56:16.104315+0000","last_peered":"2023-07-05T18:56:16.104315+0000","last_clean":"2023-07-05T18:56:16.104315+0000","last_became_active":"2023-07-05T18:56:10.073339+0000","last_became_peered":"2023-07-05T18:56:10.073339+0000","last_unstale":"2023-07-05T18:56:16.104315+0000","last_undegraded":"2023-07-05T18:56:16.104315+0000","last_fullsized":"2023-07-05T18:56:16.104315+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T18:56:08.603137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T18:56:08.603137+0000","last_clean_scrub_stamp":"2023-07-05T18:56:08.603137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T02:48:59.875595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-05T18:56:17.191009+0000","last_change":"2023-07-05T18:56:14.695868+0000","last_active":"2023-07-05T18:56:17.191009+0000","last_peered":"2023-07-05T18:56:17.191009+0000","last_clean":"2023-07-05T18:56:17.191009+0000","last_became_active":"2023-07-05T18:56:14.695540+0000","last_became_peered":"2023-07-05T18:56:14.695540+0000","last_unstale":"2023-07-05T18:56:17.191009+0000","last_undegraded":"2023-07-05T18:56:17.191009+0000","last_fullsized":"2023-07-05T18:56:17.191009+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T18:56:13.659893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T18:56:13.659893+0000","last_clean_scrub_stamp":"2023-07-05T18:56:13.659893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T02:24:34.867804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-05T18:56:16.474258+0000","last_change":"2023-07-05T18:56:15.120478+0000","last_active":"2023-07-05T18:56:16.474258+0000","last_peered":"2023-07-05T18:56:16.474258+0000","last_clean":"2023-07-05T18:56:16.474258+0000","last_became_active":"2023-07-05T18:56:15.120038+0000","last_became_peered":"2023-07-05T18:56:15.120038+0000","last_unstale":"2023-07-05T18:56:16.474258+0000","last_undegraded":"2023-07-05T18:56:16.474258+0000","last_fullsized":"2023-07-05T18:56:16.474258+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T18:56:14.665171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T18:56:14.665171+0000","last_clean_scrub_stamp":"2023-07-05T18:56:14.665171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T04:53:59.163434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":19,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-05T18:56:16.104808+0000","last_change":"2023-07-05T18:56:09.619299+0000","last_active":"2023-07-05T18:56:16.104808+0000","last_peered":"2023-07-05T18:56:16.104808+0000","last_clean":"2023-07-05T18:56:16.104808+0000","last_became_active":"2023-07-05T18:56:09.618958+0000","last_became_peered":"2023-07-05T18:56:09.618958+0000","last_unstale":"2023-07-05T18:56:16.104808+0000","last_undegraded":"2023-07-05T18:56:16.104808+0000","last_fullsized":"2023-07-05T18:56:16.104808+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T18:56:08.603137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T18:56:08.603137+0000","last_clean_scrub_stamp":"2023-07-05T18:56:08.603137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-06T21:50:31.464355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-05T18:56:16.105755+0000","last_change":"2023-07-05T18:56:14.684753+0000","last_active":"2023-07-05T18:56:16.105755+0000","last_peered":"2023-07-05T18:56:16.105755+0000","last_clean":"2023-07-05T18:56:16.105755+0000","last_became_active":"2023-07-05T18:56:14.684386+0000","last_became_peered":"2023-07-05T18:56:14.684386+0000","last_unstale":"2023-07-05T18:56:16.105755+0000","last_undegraded":"2023-07-05T18:56:16.105755+0000","last_fullsized":"2023-07-05T18:56:16.105755+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T18:56:13.659893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T18:56:13.659893+0000","last_clean_scrub_stamp":"2023-07-05T18:56:13.659893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T01:35:59.096513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-05T18:56:17.191032+0000","last_change":"2023-07-05T18:56:15.109419+0000","last_active":"2023-07-05T18:56:17.191032+0000","last_peered":"2023-07-05T18:56:17.191032+0000","last_clean":"2023-07-05T18:56:17.191032+0000","last_became_active":"2023-07-05T18:56:15.109114+0000","last_became_peered":"2023-07-05T18:56:15.109114+0000","last_unstale":"2023-07-05T18:56:17.191032+0000","last_undegraded":"2023-07-05T18:56:17.191032+0000","last_fullsized":"2023-07-05T18:56:17.191032+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T18:56:14.665171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T18:56:14.665171+0000","last_clean_scrub_stamp":"2023-07-05T18:56:14.665171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T03:19:04.962412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"20'1","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-05T18:56:16.474134+0000","last_change":"2023-07-05T18:56:14.693851+0000","last_active":"2023-07-05T18:56:16.474134+0000","last_peered":"2023-07-05T18:56:16.474134+0000","last_clean":"2023-07-05T18:56:16.474134+0000","last_became_active":"2023-07-05T18:56:14.693542+0000","last_became_peered":"2023-07-05T18:56:14.693542+0000","last_unstale":"2023-07-05T18:56:16.474134+0000","last_undegraded":"2023-07-05T18:56:16.474134+0000","last_fullsized":"2023-07-05T18:56:16.474134+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T18:56:13.659893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T18:56:13.659893+0000","last_clean_scrub_stamp":"2023-07-05T18:56:13.659893+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T03:19:03.957135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-07-05T18:56:15.109712+0000","last_change":"2023-07-05T18:56:15.103604+0000","last_active":"2023-07-05T18:56:15.109712+0000","last_peered":"2023-07-05T18:56:15.109712+0000","last_clean":"2023-07-05T18:56:15.109712+0000","last_became_active":"2023-07-05T18:56:15.103019+0000","last_became_peered":"2023-07-05T18:56:15.103019+0000","last_unstale":"2023-07-05T18:56:15.109712+0000","last_undegraded":"2023-07-05T18:56:15.109712+0000","last_fullsized":"2023-07-05T18:56:15.109712+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T18:56:14.665171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T18:56:14.665171+0000","last_clean_scrub_stamp":"2023-07-05T18:56:14.665171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T02:09:21.196469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"20'2","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-05T18:56:16.105517+0000","last_change":"2023-07-05T18:56:14.686203+0000","last_active":"2023-07-05T18:56:16.105517+0000","last_peered":"2023-07-05T18:56:16.105517+0000","last_clean":"2023-07-05T18:56:16.105517+0000","last_became_active":"2023-07-05T18:56:14.685948+0000","last_became_peered":"2023-07-05T18:56:14.685948+0000","last_unstale":"2023-07-05T18:56:16.105517+0000","last_undegraded":"2023-07-05T18:56:16.105517+0000","last_fullsized":"2023-07-05T18:56:16.105517+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T18:56:13.659893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T18:56:13.659893+0000","last_clean_scrub_stamp":"2023-07-05T18:56:13.659893+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T02:24:34.867804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-07-05T18:56:15.133614+0000","last_change":"2023-07-05T18:56:15.126615+0000","last_active":"2023-07-05T18:56:15.133614+0000","last_peered":"2023-07-05T18:56:15.133614+0000","last_clean":"2023-07-05T18:56:15.133614+0000","last_became_active":"2023-07-05T18:56:15.126354+0000","last_became_peered":"2023-07-05T18:56:15.126354+0000","last_unstale":"2023-07-05T18:56:15.133614+0000","last_undegraded":"2023-07-05T18:56:15.133614+0000","last_fullsized":"2023-07-05T18:56:15.133614+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T18:56:14.665171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T18:56:14.665171+0000","last_clean_scrub_stamp":"2023-07-05T18:56:14.665171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-06T20:02:22.890138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1d","version":"20'2","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-05T18:56:16.105769+0000","last_change":"2023-07-05T18:56:14.684691+0000","last_active":"2023-07-05T18:56:16.105769+0000","last_peered":"2023-07-05T18:56:16.105769+0000","last_clean":"2023-07-05T18:56:16.105769+0000","last_became_active":"2023-07-05T18:56:14.684098+0000","last_became_peered":"2023-07-05T18:56:14.684098+0000","last_unstale":"2023-07-05T18:56:16.105769+0000","last_undegraded":"2023-07-05T18:56:16.105769+0000","last_fullsized":"2023-07-05T18:56:16.105769+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T18:56:13.659893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T18:56:13.659893+0000","last_clean_scrub_stamp":"2023-07-05T18:56:13.659893+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T02:30:28.735569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-07-05T18:56:15.130924+0000","last_change":"2023-07-05T18:56:15.123781+0000","last_active":"2023-07-05T18:56:15.130924+0000","last_peered":"2023-07-05T18:56:15.130924+0000","last_clean":"2023-07-05T18:56:15.130924+0000","last_became_active":"2023-07-05T18:56:15.123062+0000","last_became_peered":"2023-07-05T18:56:15.123062+0000","last_unstale":"2023-07-05T18:56:15.130924+0000","last_undegraded":"2023-07-05T18:56:15.130924+0000","last_fullsized":"2023-07-05T18:56:15.130924+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T18:56:14.665171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T18:56:14.665171+0000","last_clean_scrub_stamp":"2023-07-05T18:56:14.665171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-06T21:17:50.248706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1e","version":"20'1","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-05T18:56:16.104884+0000","last_change":"2023-07-05T18:56:14.676047+0000","last_active":"2023-07-05T18:56:16.104884+0000","last_peered":"2023-07-05T18:56:16.104884+0000","last_clean":"2023-07-05T18:56:16.104884+0000","last_became_active":"2023-07-05T18:56:14.675717+0000","last_became_peered":"2023-07-05T18:56:14.675717+0000","last_unstale":"2023-07-05T18:56:16.104884+0000","last_undegraded":"2023-07-05T18:56:16.104884+0000","last_fullsized":"2023-07-05T18:56:16.104884+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T18:56:13.659893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T18:56:13.659893+0000","last_clean_scrub_stamp":"2023-07-05T18:56:13.659893+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T00:22:00.885983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-05T18:56:16.104536+0000","last_change":"2023-07-05T18:56:15.117463+0000","last_active":"2023-07-05T18:56:16.104536+0000","last_peered":"2023-07-05T18:56:16.104536+0000","last_clean":"2023-07-05T18:56:16.104536+0000","last_became_active":"2023-07-05T18:56:15.114489+0000","last_became_peered":"2023-07-05T18:56:15.114489+0000","last_unstale":"2023-07-05T18:56:16.104536+0000","last_undegraded":"2023-07-05T18:56:16.104536+0000","last_fullsized":"2023-07-05T18:56:16.104536+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T18:56:14.665171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T18:56:14.665171+0000","last_clean_scrub_stamp":"2023-07-05T18:56:14.665171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T02:30:29.740847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"20'4","reported_seq":17,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-05T18:56:16.474298+0000","last_change":"2023-07-05T18:56:14.689853+0000","last_active":"2023-07-05T18:56:16.474298+0000","last_peered":"2023-07-05T18:56:16.474298+0000","last_clean":"2023-07-05T18:56:16.474298+0000","last_became_active":"2023-07-05T18:56:14.689381+0000","last_became_peered":"2023-07-05T18:56:14.689381+0000","last_unstale":"2023-07-05T18:56:16.474298+0000","last_undegraded":"2023-07-05T18:56:16.474298+0000","last_fullsized":"2023-07-05T18:56:16.474298+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T18:56:13.659893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T18:56:13.659893+0000","last_clean_scrub_stamp":"2023-07-05T18:56:13.659893+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T02:30:28.735569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-07-05T18:56:15.130881+0000","last_change":"2023-07-05T18:56:15.123191+0000","last_active":"2023-07-05T18:56:15.130881+0000","last_peered":"2023-07-05T18:56:15.130881+0000","last_clean":"2023-07-05T18:56:15.130881+0000","last_became_active":"2023-07-05T18:56:15.122736+0000","last_became_peered":"2023-07-05T18:56:15.122736+0000","last_unstale":"2023-07-05T18:56:15.130881+0000","last_undegraded":"2023-07-05T18:56:15.130881+0000","last_fullsized":"2023-07-05T18:56:15.130881+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T18:56:14.665171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T18:56:14.665171+0000","last_clean_scrub_stamp":"2023-07-05T18:56:14.665171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T05:40:41.006597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-05T18:56:16.104533+0000","last_change":"2023-07-05T18:56:15.115767+0000","last_active":"2023-07-05T18:56:16.104533+0000","last_peered":"2023-07-05T18:56:16.104533+0000","last_clean":"2023-07-05T18:56:16.104533+0000","last_became_active":"2023-07-05T18:56:15.115052+0000","last_became_peered":"2023-07-05T18:56:15.115052+0000","last_unstale":"2023-07-05T18:56:16.104533+0000","last_undegraded":"2023-07-05T18:56:16.104533+0000","last_fullsized":"2023-07-05T18:56:16.104533+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T18:56:14.665171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T18:56:14.665171+0000","last_clean_scrub_stamp":"2023-07-05T18:56:14.665171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T05:13:27.636276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-05T18:56:16.104384+0000","last_change":"2023-07-05T18:56:15.112332+0000","last_active":"2023-07-05T18:56:16.104384+0000","last_peered":"2023-07-05T18:56:16.104384+0000","last_clean":"2023-07-05T18:56:16.104384+0000","last_became_active":"2023-07-05T18:56:15.112060+0000","last_became_peered":"2023-07-05T18:56:15.112060+0000","last_unstale":"2023-07-05T18:56:16.104384+0000","last_undegraded":"2023-07-05T18:56:16.104384+0000","last_fullsized":"2023-07-05T18:56:16.104384+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T18:56:14.665171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T18:56:14.665171+0000","last_clean_scrub_stamp":"2023-07-05T18:56:14.665171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T03:08:48.441898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-07-05T18:56:15.133589+0000","last_change":"2023-07-05T18:56:15.126220+0000","last_active":"2023-07-05T18:56:15.133589+0000","last_peered":"2023-07-05T18:56:15.133589+0000","last_clean":"2023-07-05T18:56:15.133589+0000","last_became_active":"2023-07-05T18:56:15.125927+0000","last_became_peered":"2023-07-05T18:56:15.125927+0000","last_unstale":"2023-07-05T18:56:15.133589+0000","last_undegraded":"2023-07-05T18:56:15.133589+0000","last_fullsized":"2023-07-05T18:56:15.133589+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T18:56:14.665171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T18:56:14.665171+0000","last_clean_scrub_stamp":"2023-07-05T18:56:14.665171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-06T22:34:04.489538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-05T18:56:16.104693+0000","last_change":"2023-07-05T18:56:15.118666+0000","last_active":"2023-07-05T18:56:16.104693+0000","last_peered":"2023-07-05T18:56:16.104693+0000","last_clean":"2023-07-05T18:56:16.104693+0000","last_became_active":"2023-07-05T18:56:15.116876+0000","last_became_peered":"2023-07-05T18:56:15.116876+0000","last_unstale":"2023-07-05T18:56:16.104693+0000","last_undegraded":"2023-07-05T18:56:16.104693+0000","last_fullsized":"2023-07-05T18:56:16.104693+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T18:56:14.665171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T18:56:14.665171+0000","last_clean_scrub_stamp":"2023-07-05T18:56:14.665171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T04:34:54.813133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-05T18:56:17.190834+0000","last_change":"2023-07-05T18:56:15.118889+0000","last_active":"2023-07-05T18:56:17.190834+0000","last_peered":"2023-07-05T18:56:17.190834+0000","last_clean":"2023-07-05T18:56:17.190834+0000","last_became_active":"2023-07-05T18:56:15.118609+0000","last_became_peered":"2023-07-05T18:56:15.118609+0000","last_unstale":"2023-07-05T18:56:17.190834+0000","last_undegraded":"2023-07-05T18:56:17.190834+0000","last_fullsized":"2023-07-05T18:56:17.190834+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T18:56:14.665171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T18:56:14.665171+0000","last_clean_scrub_stamp":"2023-07-05T18:56:14.665171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T02:49:05.937629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":8},{"poolid":2,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574852,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27760,"kb_used_data":808,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344080,"statfs":{"total":96636764160,"available":96608337920,"internally_reserved":0,"allocated":827392,"data_stored":664594,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65200000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70399999999999996}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61299999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68600000000000005}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40799999999999997}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.497}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59799999999999998}]}]},{"osd":6,"up_from":13,"seq":55834574854,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27164,"kb_used_data":212,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344676,"statfs":{"total":96636764160,"available":96608948224,"internally_reserved":0,"allocated":217088,"data_stored":79099,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.6200000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1299999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.307}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":6.181}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.32000000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38800000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.49199999999999999}]}]},{"osd":1,"up_from":13,"seq":55834574853,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27732,"kb_used_data":780,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344108,"statfs":{"total":96636764160,"available":96608366592,"internally_reserved":0,"allocated":798720,"data_stored":662814,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.32700000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36099999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48299999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78700000000000003}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64800000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.91900000000000004}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.89600000000000002}]}]},{"osd":0,"up_from":13,"seq":55834574853,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27168,"kb_used_data":216,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344672,"statfs":{"total":96636764160,"available":96608944128,"internally_reserved":0,"allocated":221184,"data_stored":79681,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.379}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.30399999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44700000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55200000000000005}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56299999999999994}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66700000000000004}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.505}]}]},{"osd":2,"up_from":13,"seq":55834574852,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27148,"kb_used_data":196,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344692,"statfs":{"total":96636764160,"available":96608964608,"internally_reserved":0,"allocated":200704,"data_stored":71485,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.27900000000000003}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.317}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.30399999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63900000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71699999999999997}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65900000000000003}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.625}]}]},{"osd":3,"up_from":13,"seq":55834574854,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27168,"kb_used_data":216,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344672,"statfs":{"total":96636764160,"available":96608944128,"internally_reserved":0,"allocated":221184,"data_stored":79189,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.32800000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.313}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39700000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59699999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65100000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66600000000000004}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61199999999999999}]}]},{"osd":4,"up_from":13,"seq":55834574854,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27172,"kb_used_data":220,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344668,"statfs":{"total":96636764160,"available":96608940032,"internally_reserved":0,"allocated":225280,"data_stored":74066,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70999999999999996}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64700000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65700000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69099999999999995}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53400000000000003}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47599999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51600000000000001}]}]},{"osd":5,"up_from":13,"seq":55834574853,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27172,"kb_used_data":220,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344668,"statfs":{"total":96636764160,"available":96608940032,"internally_reserved":0,"allocated":225280,"data_stored":79751,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38500000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.75800000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57399999999999995}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64300000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.624}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83999999999999997}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.93500000000000005}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1620,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":652,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1780,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-07-05T18:56:19.771 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-07-05T18:56:19.772 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2023-07-05T18:56:19.772 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2023-07-05T18:56:19.773 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2023-07-05T18:56:19.774 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2023-07-05T18:56:19.924 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:19.922+0000 7fa69c006700 1 Processor -- start 2023-07-05T18:56:19.925 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:19.922+0000 7fa69c006700 1 -- start start 2023-07-05T18:56:19.933 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:19.923+0000 7fa69c006700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fa6940cb090 0x7fa6940cdc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:56:19.934 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:19.923+0000 7fa69c006700 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa694159eb0 con 0x7fa69415a340 2023-07-05T18:56:19.934 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:19.923+0000 7fa69c006700 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa69415db90 con 0x7fa69413f540 2023-07-05T18:56:19.934 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:19.923+0000 7fa69c006700 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa6940ca310 con 0x7fa6940cb090 2023-07-05T18:56:19.934 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:19.923+0000 7fa6995a1700 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7fa69415a340 0x7fa6940ca980 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:57050/0 (socket says 172.21.15.46:57050) 2023-07-05T18:56:19.934 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:19.923+0000 7fa6995a1700 1 -- 172.21.15.46:0/1143417894 learned_addr learned my addr 172.21.15.46:0/1143417894 (peer_addr_for_me v1:172.21.15.46:0/0) 2023-07-05T18:56:19.935 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:19.923+0000 7fa69a5a3700 1 --2- 172.21.15.46:0/1143417894 >> v2:172.21.15.73:3300/0 conn(0x7fa6940cb090 0x7fa6940cdc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:56:19.935 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:19.923+0000 7fa698da0700 1 -- 172.21.15.46:0/1143417894 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1500514483 0 0) 0x7fa694159eb0 con 0x7fa69415a340 2023-07-05T18:56:19.935 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:19.923+0000 7fa698da0700 1 -- 172.21.15.46:0/1143417894 --> v1:172.21.15.46:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa6800035b0 con 0x7fa69415a340 2023-07-05T18:56:19.936 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:19.924+0000 7fa698da0700 1 -- 172.21.15.46:0/1143417894 <== mon.0 v1:172.21.15.46:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4130317374 0 0) 0x7fa6800035b0 con 0x7fa69415a340 2023-07-05T18:56:19.936 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:19.924+0000 7fa698da0700 1 -- 172.21.15.46:0/1143417894 >> v2:172.21.15.73:3300/0 conn(0x7fa6940cb090 msgr2=0x7fa6940cdc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-05T18:56:19.936 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:19.924+0000 7fa698da0700 1 --2- 172.21.15.46:0/1143417894 >> v2:172.21.15.73:3300/0 conn(0x7fa6940cb090 0x7fa6940cdc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:19.936 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:19.924+0000 7fa698da0700 1 -- 172.21.15.46:0/1143417894 >> v1:172.21.15.73:6789/0 conn(0x7fa69413f540 legacy=0x7fa69415cd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:56:19.937 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:19.924+0000 7fa698da0700 1 -- 172.21.15.46:0/1143417894 --> v1:172.21.15.46:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa69415d8b0 con 0x7fa69415a340 2023-07-05T18:56:19.937 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:19.924+0000 7fa698da0700 1 -- 172.21.15.46:0/1143417894 <== mon.0 v1:172.21.15.46:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2195585215 0 0) 0x7fa690001670 con 0x7fa69415a340 2023-07-05T18:56:19.937 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:19.924+0000 7fa698da0700 1 -- 172.21.15.46:0/1143417894 >> v1:172.21.15.46:6789/0 conn(0x7fa69415a340 legacy=0x7fa6940ca980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:56:19.938 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:19.924+0000 7fa698da0700 1 --2- 172.21.15.46:0/1143417894 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa680003a00 0x7fa680003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:56:19.938 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:19.924+0000 7fa698da0700 1 --2- 172.21.15.46:0/1143417894 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fa680004850 0x7fa680004cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:56:19.939 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:19.924+0000 7fa698da0700 1 --2- 172.21.15.46:0/1143417894 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa680005200 0x7fa68000ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:56:19.939 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:19.924+0000 7fa698da0700 1 -- 172.21.15.46:0/1143417894 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa6940ca310 con 0x7fa680005200 2023-07-05T18:56:19.940 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:19.924+0000 7fa698da0700 1 -- 172.21.15.46:0/1143417894 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa68000c080 con 0x7fa680003a00 2023-07-05T18:56:19.940 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:19.924+0000 7fa698da0700 1 -- 172.21.15.46:0/1143417894 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa68000c240 con 0x7fa680004850 2023-07-05T18:56:19.940 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:19.924+0000 7fa69a5a3700 1 --2- 172.21.15.46:0/1143417894 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa680005200 0x7fa68000ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:56:19.943 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:19.924+0000 7fa699da2700 1 --2- 172.21.15.46:0/1143417894 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa680003a00 0x7fa680003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:56:19.943 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:19.924+0000 7fa6995a1700 1 --2- 172.21.15.46:0/1143417894 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fa680004850 0x7fa680004cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:56:19.943 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:19.924+0000 7fa69a5a3700 1 -- 172.21.15.46:0/1143417894 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fa680004850 msgr2=0x7fa680004cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-05T18:56:19.943 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:19.924+0000 7fa69a5a3700 1 --2- 172.21.15.46:0/1143417894 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fa680004850 0x7fa680004cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:19.944 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:19.924+0000 7fa69a5a3700 1 -- 172.21.15.46:0/1143417894 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa680003a00 msgr2=0x7fa680003e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-05T18:56:19.944 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:19.924+0000 7fa69a5a3700 1 --2- 172.21.15.46:0/1143417894 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa680003a00 0x7fa680003e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:19.944 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:19.924+0000 7fa69a5a3700 1 -- 172.21.15.46:0/1143417894 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa6800035b0 con 0x7fa680005200 2023-07-05T18:56:19.945 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:19.924+0000 7fa699da2700 1 --2- 172.21.15.46:0/1143417894 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa680003a00 0x7fa680003e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-05T18:56:19.945 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:19.924+0000 7fa69a5a3700 1 -- 172.21.15.46:0/1143417894 reap_dead start 2023-07-05T18:56:19.945 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:19.924+0000 7fa69a5a3700 1 --2- 172.21.15.46:0/1143417894 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa680005200 0x7fa68000ba10 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fa68c009bd0 tx=0x7fa680005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3711d92c8d4b4826 server_cookie=0 in_seq=0 out_seq=0 2023-07-05T18:56:19.946 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:19.924+0000 7fa698da0700 1 -- 172.21.15.46:0/1143417894 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa68c003c20 con 0x7fa680005200 2023-07-05T18:56:19.946 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:19.924+0000 7fa698da0700 1 -- 172.21.15.46:0/1143417894 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa68c00f040 con 0x7fa680005200 2023-07-05T18:56:19.946 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:19.924+0000 7fa698da0700 1 -- 172.21.15.46:0/1143417894 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa68c00e9d0 con 0x7fa680005200 2023-07-05T18:56:19.946 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:19.925+0000 7fa69c006700 1 -- 172.21.15.46:0/1143417894 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa680005200 msgr2=0x7fa68000ba10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:56:19.946 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:19.925+0000 7fa69c006700 1 --2- 172.21.15.46:0/1143417894 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa680005200 0x7fa68000ba10 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fa68c009bd0 tx=0x7fa680005880 comp rx=0 tx=0).stop 2023-07-05T18:56:19.946 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:19.925+0000 7fa69c006700 1 -- 172.21.15.46:0/1143417894 shutdown_connections 2023-07-05T18:56:19.947 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:19.925+0000 7fa69c006700 1 --2- 172.21.15.46:0/1143417894 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa680005200 0x7fa68000ba10 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:19.947 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:19.925+0000 7fa69c006700 1 -- 172.21.15.46:0/1143417894 >> 172.21.15.46:0/1143417894 conn(0x7fa6940b16b0 msgr2=0x7fa6940b1a80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-05T18:56:19.947 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:19.925+0000 7fa69c006700 1 -- 172.21.15.46:0/1143417894 shutdown_connections 2023-07-05T18:56:19.947 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:19.925+0000 7fa69c006700 1 -- 172.21.15.46:0/1143417894 wait complete. 2023-07-05T18:56:19.947 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:19.926+0000 7fa69c006700 1 Processor -- start 2023-07-05T18:56:19.947 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:19.926+0000 7fa69c006700 1 -- start start 2023-07-05T18:56:19.947 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:19.927+0000 7fa69c006700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fa680005200 0x7fa694154720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:56:19.948 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:19.927+0000 7fa69c006700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa6940cc1b0 0x7fa6940cc620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:56:19.948 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:19.927+0000 7fa69c006700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa694157180 0x7fa6941575f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:56:19.948 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:19.927+0000 7fa69c006700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa6940b54e0 con 0x7fa694157180 2023-07-05T18:56:19.948 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:19.927+0000 7fa69c006700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa6940ccb60 con 0x7fa6940cc1b0 2023-07-05T18:56:19.948 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:19.927+0000 7fa69c006700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa694154c60 con 0x7fa680005200 2023-07-05T18:56:19.948 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:19.927+0000 7fa69a5a3700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa694157180 0x7fa6941575f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:56:19.948 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:19.927+0000 7fa69a5a3700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa694157180 0x7fa6941575f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:57794/0 (socket says 172.21.15.46:57794) 2023-07-05T18:56:19.949 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:19.927+0000 7fa69a5a3700 1 -- 172.21.15.46:0/3004304823 learned_addr learned my addr 172.21.15.46:0/3004304823 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-07-05T18:56:19.949 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:19.927+0000 7fa6995a1700 1 --2- 172.21.15.46:0/3004304823 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa6940cc1b0 0x7fa6940cc620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:56:19.949 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:19.927+0000 7fa699da2700 1 --2- 172.21.15.46:0/3004304823 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fa680005200 0x7fa694154720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:56:19.949 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:19.927+0000 7fa69a5a3700 1 -- 172.21.15.46:0/3004304823 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fa680005200 msgr2=0x7fa694154720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:56:19.949 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:19.927+0000 7fa69a5a3700 1 --2- 172.21.15.46:0/3004304823 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fa680005200 0x7fa694154720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:19.949 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:19.927+0000 7fa69a5a3700 1 -- 172.21.15.46:0/3004304823 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa6940cc1b0 msgr2=0x7fa6940cc620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:56:19.949 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:19.927+0000 7fa69a5a3700 1 --2- 172.21.15.46:0/3004304823 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa6940cc1b0 0x7fa6940cc620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:19.949 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:19.927+0000 7fa69a5a3700 1 -- 172.21.15.46:0/3004304823 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa694157b30 con 0x7fa694157180 2023-07-05T18:56:19.950 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:19.927+0000 7fa6995a1700 1 --2- 172.21.15.46:0/3004304823 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa6940cc1b0 0x7fa6940cc620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-05T18:56:19.950 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:19.928+0000 7fa69a5a3700 1 --2- 172.21.15.46:0/3004304823 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa694157180 0x7fa6941575f0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fa69406f2b0 tx=0x7fa68c009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-05T18:56:19.950 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:19.928+0000 7fa68a7fc700 1 -- 172.21.15.46:0/3004304823 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa68c004430 con 0x7fa694157180 2023-07-05T18:56:19.950 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:19.928+0000 7fa68a7fc700 1 -- 172.21.15.46:0/3004304823 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa68c003e90 con 0x7fa694157180 2023-07-05T18:56:19.950 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:19.928+0000 7fa69c006700 1 -- 172.21.15.46:0/3004304823 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa694157e00 con 0x7fa694157180 2023-07-05T18:56:19.950 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:19.928+0000 7fa68a7fc700 1 -- 172.21.15.46:0/3004304823 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa68c0047d0 con 0x7fa694157180 2023-07-05T18:56:19.950 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:19.928+0000 7fa69c006700 1 -- 172.21.15.46:0/3004304823 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa6941583c0 con 0x7fa694157180 2023-07-05T18:56:19.950 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:19.929+0000 7fa69c006700 1 -- 172.21.15.46:0/3004304823 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa6940672e0 con 0x7fa694157180 2023-07-05T18:56:19.951 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:19.930+0000 7fa68a7fc700 1 -- 172.21.15.46:0/3004304823 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fa68c02e440 con 0x7fa694157180 2023-07-05T18:56:19.951 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:19.930+0000 7fa68a7fc700 1 --2- 172.21.15.46:0/3004304823 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7fa67806ace0 0x7fa67806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:56:19.951 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:19.930+0000 7fa68a7fc700 1 -- 172.21.15.46:0/3004304823 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fa68c016070 con 0x7fa694157180 2023-07-05T18:56:19.951 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:19.930+0000 7fa699da2700 1 --2- 172.21.15.46:0/3004304823 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7fa67806ace0 0x7fa67806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:56:19.951 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:19.930+0000 7fa699da2700 1 --2- 172.21.15.46:0/3004304823 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7fa67806ace0 0x7fa67806d190 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fa6840013e0 tx=0x7fa684009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-05T18:56:19.952 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:19.934+0000 7fa68a7fc700 1 -- 172.21.15.46:0/3004304823 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fa68c057c30 con 0x7fa694157180 2023-07-05T18:56:20.190 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:20.188+0000 7fa69c006700 1 -- 172.21.15.46:0/3004304823 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) v1 -- 0x7fa69413ed60 con 0x7fa694157180 2023-07-05T18:56:20.197 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:20.191+0000 7fa68a7fc700 1 -- 172.21.15.46:0/3004304823 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v5) v1 ==== 74+0+170842 (secure 0 0 0) 0x7fa68c029090 con 0x7fa694157180 2023-07-05T18:56:20.198 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T18:56:20.200 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:20.194+0000 7fa69c006700 1 -- 172.21.15.46:0/3004304823 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7fa67806ace0 msgr2=0x7fa67806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:56:20.200 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:20.194+0000 7fa69c006700 1 --2- 172.21.15.46:0/3004304823 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7fa67806ace0 0x7fa67806d190 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fa6840013e0 tx=0x7fa684009040 comp rx=0 tx=0).stop 2023-07-05T18:56:20.200 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:20.194+0000 7fa69c006700 1 -- 172.21.15.46:0/3004304823 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa694157180 msgr2=0x7fa6941575f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:56:20.200 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:20.194+0000 7fa69c006700 1 --2- 172.21.15.46:0/3004304823 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa694157180 0x7fa6941575f0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fa69406f2b0 tx=0x7fa68c009750 comp rx=0 tx=0).stop 2023-07-05T18:56:20.200 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:20.194+0000 7fa69c006700 1 -- 172.21.15.46:0/3004304823 shutdown_connections 2023-07-05T18:56:20.200 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:20.194+0000 7fa69c006700 1 --2- 172.21.15.46:0/3004304823 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7fa67806ace0 0x7fa67806d190 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:20.201 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:20.194+0000 7fa69c006700 1 --2- 172.21.15.46:0/3004304823 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa694157180 0x7fa6941575f0 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:20.201 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:20.194+0000 7fa69c006700 1 --2- 172.21.15.46:0/3004304823 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fa680005200 0x7fa694154720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:20.201 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:20.194+0000 7fa69c006700 1 --2- 172.21.15.46:0/3004304823 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa6940cc1b0 0x7fa6940cc620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:20.201 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:20.194+0000 7fa69c006700 1 -- 172.21.15.46:0/3004304823 >> 172.21.15.46:0/3004304823 conn(0x7fa6940b16b0 msgr2=0x7fa6940ce460 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-05T18:56:20.201 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:20.194+0000 7fa69c006700 1 -- 172.21.15.46:0/3004304823 shutdown_connections 2023-07-05T18:56:20.201 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:20.194+0000 7fa69c006700 1 -- 172.21.15.46:0/3004304823 wait complete. 2023-07-05T18:56:20.208 INFO:teuthology.orchestra.run.smithi046.stdout:{"epoch":5,"active_gid":4099,"active_name":"x","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6832","nonce":3033361733},{"type":"v1","addr":"172.21.15.73:6833","nonce":3033361733}]},"active_addr":"172.21.15.73:6833/3033361733","active_change":"2023-07-05T18:56:02.064431+0000","active_mgr_features":4540138322906710015,"available":true,"standbys":[{"gid":4110,"name":"y","mgr_features":4540138322906710015,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"alertmanager_web_password":{"name":"alertmanager_web_password","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"Alertmanager web password","long_desc":"","tags":[],"see_also":[]},"alertmanager_web_user":{"name":"alertmanager_web_user","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"Alertmanager web user","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"secs","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"prometheus_web_password":{"name":"prometheus_web_password","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"Prometheus web password","long_desc":"","tags":[],"see_also":[]},"prometheus_web_user":{"name":"prometheus_web_user","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"Prometheus web user","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"noautoscale":{"name":"noautoscale","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"global autoscale flag","long_desc":"Option to turn on/off the autoscaler for all pools","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"drive_group_interval":{"name":"drive_group_interval","type":"float","level":"advanced","flags":0,"default_value":"300.0","min":"","max":"","enum_allowed":[],"desc":"interval in seconds between re-application of applied drive_groups","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"alertmanager_web_password":{"name":"alertmanager_web_password","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"Alertmanager web password","long_desc":"","tags":[],"see_also":[]},"alertmanager_web_user":{"name":"alertmanager_web_user","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"Alertmanager web user","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"secs","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"prometheus_web_password":{"name":"prometheus_web_password","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"Prometheus web password","long_desc":"","tags":[],"see_also":[]},"prometheus_web_user":{"name":"prometheus_web_user","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"Prometheus web user","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"noautoscale":{"name":"noautoscale","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"global autoscale flag","long_desc":"Option to turn on/off the autoscaler for all pools","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"drive_group_interval":{"name":"drive_group_interval","type":"float","level":"advanced","flags":0,"default_value":"300.0","min":"","max":"","enum_allowed":[],"desc":"interval in seconds between re-application of applied drive_groups","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":0,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.73:0","nonce":1717768812}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.73:0","nonce":3195230177}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.73:0","nonce":3699587735}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.73:0","nonce":2981662797}]}]} 2023-07-05T18:56:20.212 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2023-07-05T18:56:20.213 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2023-07-05T18:56:20.213 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-05T18:56:20.340 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:20.338+0000 7f53573d9700 1 Processor -- start 2023-07-05T18:56:20.340 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:20.338+0000 7f53573d9700 1 -- start start 2023-07-05T18:56:20.342 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:20.339+0000 7f53573d9700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f5350159d60 0x7f5350163ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:56:20.342 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:20.339+0000 7f53573d9700 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5350070520 con 0x7f5350070af0 2023-07-05T18:56:20.343 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:20.339+0000 7f53573d9700 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f53500b3f90 con 0x7f5350159280 2023-07-05T18:56:20.343 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:20.339+0000 7f53573d9700 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f53500cbc00 con 0x7f5350159d60 2023-07-05T18:56:20.343 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:20.339+0000 7f5355976700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f5350159d60 0x7f5350163ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:56:20.343 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:20.339+0000 7f5354974700 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7f5350070af0 0x7f5350159650 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:57072/0 (socket says 172.21.15.46:57072) 2023-07-05T18:56:20.343 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:20.339+0000 7f5354974700 1 -- 172.21.15.46:0/1193016039 learned_addr learned my addr 172.21.15.46:0/1193016039 (peer_addr_for_me v1:172.21.15.46:0/0) 2023-07-05T18:56:20.343 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:20.339+0000 7f5355976700 1 -- 172.21.15.46:0/1193016039 >> v1:172.21.15.73:6789/0 conn(0x7f5350159280 legacy=0x7f535006fe10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-05T18:56:20.344 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:20.339+0000 7f5355976700 1 -- 172.21.15.46:0/1193016039 >> v1:172.21.15.46:6789/0 conn(0x7f5350070af0 legacy=0x7f5350159650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:56:20.344 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:20.339+0000 7f5355976700 1 -- 172.21.15.46:0/1193016039 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f53500b3190 con 0x7f5350159d60 2023-07-05T18:56:20.344 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:20.339+0000 7f5347fff700 1 -- 172.21.15.46:0/1193016039 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2953509449 0 0) 0x7f5340001110 con 0x7f5350070af0 2023-07-05T18:56:20.344 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:20.339+0000 7f5355976700 1 --2- 172.21.15.46:0/1193016039 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5350159d60 0x7f5350163ee0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f5348009d90 tx=0x7f534800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8478583ddff34db3 server_cookie=0 in_seq=0 out_seq=0 2023-07-05T18:56:20.344 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:20.339+0000 7f5347fff700 1 -- 172.21.15.46:0/1193016039 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f534800e070 con 0x7f5350159d60 2023-07-05T18:56:20.344 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:20.339+0000 7f5347fff700 1 -- 172.21.15.46:0/1193016039 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f534800bb90 con 0x7f5350159d60 2023-07-05T18:56:20.344 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:20.339+0000 7f5347fff700 1 -- 172.21.15.46:0/1193016039 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5348003a20 con 0x7f5350159d60 2023-07-05T18:56:20.345 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:20.340+0000 7f53573d9700 1 -- 172.21.15.46:0/1193016039 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5350159d60 msgr2=0x7f5350163ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:56:20.345 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:20.340+0000 7f53573d9700 1 --2- 172.21.15.46:0/1193016039 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5350159d60 0x7f5350163ee0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f5348009d90 tx=0x7f534800b330 comp rx=0 tx=0).stop 2023-07-05T18:56:20.345 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:20.340+0000 7f53573d9700 1 -- 172.21.15.46:0/1193016039 shutdown_connections 2023-07-05T18:56:20.345 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:20.340+0000 7f53573d9700 1 --2- 172.21.15.46:0/1193016039 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5350159d60 0x7f5350163ee0 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:20.345 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:20.340+0000 7f53573d9700 1 -- 172.21.15.46:0/1193016039 >> 172.21.15.46:0/1193016039 conn(0x7f53500b0d50 msgr2=0x7f53500b1150 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-05T18:56:20.345 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:20.340+0000 7f53573d9700 1 -- 172.21.15.46:0/1193016039 shutdown_connections 2023-07-05T18:56:20.345 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:20.340+0000 7f53573d9700 1 -- 172.21.15.46:0/1193016039 wait complete. 2023-07-05T18:56:20.347 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:20.342+0000 7f53573d9700 1 Processor -- start 2023-07-05T18:56:20.349 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:20.342+0000 7f53573d9700 1 -- start start 2023-07-05T18:56:20.349 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:20.343+0000 7f53573d9700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5350070af0 0x7f535014ae50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:56:20.349 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:20.343+0000 7f53573d9700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f5350159280 0x7f53501517d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:56:20.349 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:20.343+0000 7f53573d9700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5350159d60 0x7f535014e210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:56:20.349 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:20.343+0000 7f53573d9700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5350151340 con 0x7f5350159d60 2023-07-05T18:56:20.350 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:20.343+0000 7f53573d9700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53501f0d60 con 0x7f5350070af0 2023-07-05T18:56:20.350 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:20.343+0000 7f53573d9700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5350150490 con 0x7f5350159280 2023-07-05T18:56:20.350 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:20.343+0000 7f5355976700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5350159d60 0x7f535014e210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:56:20.350 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:20.343+0000 7f5355976700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5350159d60 0x7f535014e210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:57808/0 (socket says 172.21.15.46:57808) 2023-07-05T18:56:20.350 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:20.343+0000 7f5355976700 1 -- 172.21.15.46:0/2144918251 learned_addr learned my addr 172.21.15.46:0/2144918251 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-07-05T18:56:20.350 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:20.343+0000 7f5355175700 1 --2- 172.21.15.46:0/2144918251 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5350070af0 0x7f535014ae50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:56:20.350 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:20.343+0000 7f5355976700 1 -- 172.21.15.46:0/2144918251 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f5350159280 msgr2=0x7f53501517d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:56:20.350 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:20.343+0000 7f5355976700 1 --2- 172.21.15.46:0/2144918251 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f5350159280 0x7f53501517d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:20.351 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:20.343+0000 7f5355976700 1 -- 172.21.15.46:0/2144918251 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5350070af0 msgr2=0x7f535014ae50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:56:20.351 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:20.343+0000 7f5355976700 1 --2- 172.21.15.46:0/2144918251 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5350070af0 0x7f535014ae50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:20.351 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:20.343+0000 7f5355976700 1 -- 172.21.15.46:0/2144918251 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5348009a70 con 0x7f5350159d60 2023-07-05T18:56:20.351 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:20.343+0000 7f5355976700 1 --2- 172.21.15.46:0/2144918251 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5350159d60 0x7f535014e210 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f535006e780 tx=0x7f5348004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-05T18:56:20.351 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:20.343+0000 7f5345ffb700 1 -- 172.21.15.46:0/2144918251 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5348012840 con 0x7f5350159d60 2023-07-05T18:56:20.351 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:20.343+0000 7f5345ffb700 1 -- 172.21.15.46:0/2144918251 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f53480129c0 con 0x7f5350159d60 2023-07-05T18:56:20.351 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:20.343+0000 7f53573d9700 1 -- 172.21.15.46:0/2144918251 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5350150730 con 0x7f5350159d60 2023-07-05T18:56:20.352 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:20.343+0000 7f5345ffb700 1 -- 172.21.15.46:0/2144918251 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5348012d70 con 0x7f5350159d60 2023-07-05T18:56:20.352 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:20.344+0000 7f53573d9700 1 -- 172.21.15.46:0/2144918251 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5350150cf0 con 0x7f5350159d60 2023-07-05T18:56:20.352 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:20.345+0000 7f53573d9700 1 -- 172.21.15.46:0/2144918251 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f53501514f0 con 0x7f5350159d60 2023-07-05T18:56:20.352 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:20.345+0000 7f5345ffb700 1 -- 172.21.15.46:0/2144918251 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f534801d420 con 0x7f5350159d60 2023-07-05T18:56:20.352 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:20.345+0000 7f5345ffb700 1 --2- 172.21.15.46:0/2144918251 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7f533406ace0 0x7f533406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:56:20.352 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:20.346+0000 7f5345ffb700 1 -- 172.21.15.46:0/2144918251 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f534808b610 con 0x7f5350159d60 2023-07-05T18:56:20.352 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:20.346+0000 7f5355175700 1 --2- 172.21.15.46:0/2144918251 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7f533406ace0 0x7f533406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:56:20.353 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:20.346+0000 7f5355175700 1 --2- 172.21.15.46:0/2144918251 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7f533406ace0 0x7f533406d190 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f534c003e60 tx=0x7f534c009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-05T18:56:20.354 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:20.350+0000 7f5345ffb700 1 -- 172.21.15.46:0/2144918251 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f53501514f0 con 0x7f5350159d60 2023-07-05T18:56:20.552 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:20.550+0000 7f53573d9700 1 -- 172.21.15.46:0/2144918251 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f535015bdf0 con 0x7f5350159d60 2023-07-05T18:56:20.553 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:20.551+0000 7f5345ffb700 1 -- 172.21.15.46:0/2144918251 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) v1 ==== 74+0+18161 (secure 0 0 0) 0x7f534805a1e0 con 0x7f5350159d60 2023-07-05T18:56:20.554 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T18:56:20.554 INFO:teuthology.orchestra.run.smithi046.stdout:{"epoch":21,"fsid":"042652d3-d80c-4ad8-9366-3e94f2a0a512","created":"2023-07-05T18:55:56.455710+0000","modified":"2023-07-05T18:56:16.095672+0000","last_up_change":"2023-07-05T18:56:06.594022+0000","last_in_change":"2023-07-05T18:55:58.879340+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-07-05T18:56:07.729620+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2023-07-05T18:56:08.128122+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-07-05T18:56:12.954625+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-07-05T18:56:14.068396+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"20009183-9a47-4392-8751-883f88d2bfb1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6813","nonce":4151971443},{"type":"v1","addr":"172.21.15.46:6815","nonce":4151971443}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6817","nonce":4151971443},{"type":"v1","addr":"172.21.15.46:6818","nonce":4151971443}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6822","nonce":4151971443},{"type":"v1","addr":"172.21.15.46:6823","nonce":4151971443}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6820","nonce":4151971443},{"type":"v1","addr":"172.21.15.46:6821","nonce":4151971443}]},"public_addr":"172.21.15.46:6815/4151971443","cluster_addr":"172.21.15.46:6818/4151971443","heartbeat_back_addr":"172.21.15.46:6823/4151971443","heartbeat_front_addr":"172.21.15.46:6821/4151971443","state":["exists","up"]},{"osd":1,"uuid":"91b4a7b0-e4e4-4888-a1fe-9edb0d68004c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6808","nonce":502575881},{"type":"v1","addr":"172.21.15.46:6809","nonce":502575881}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6810","nonce":502575881},{"type":"v1","addr":"172.21.15.46:6811","nonce":502575881}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6816","nonce":502575881},{"type":"v1","addr":"172.21.15.46:6819","nonce":502575881}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6812","nonce":502575881},{"type":"v1","addr":"172.21.15.46:6814","nonce":502575881}]},"public_addr":"172.21.15.46:6809/502575881","cluster_addr":"172.21.15.46:6811/502575881","heartbeat_back_addr":"172.21.15.46:6819/502575881","heartbeat_front_addr":"172.21.15.46:6814/502575881","state":["exists","up"]},{"osd":2,"uuid":"669ff744-1331-47c5-8579-0440731c889a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6800","nonce":2115251461},{"type":"v1","addr":"172.21.15.46:6801","nonce":2115251461}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6802","nonce":2115251461},{"type":"v1","addr":"172.21.15.46:6803","nonce":2115251461}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6806","nonce":2115251461},{"type":"v1","addr":"172.21.15.46:6807","nonce":2115251461}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6804","nonce":2115251461},{"type":"v1","addr":"172.21.15.46:6805","nonce":2115251461}]},"public_addr":"172.21.15.46:6801/2115251461","cluster_addr":"172.21.15.46:6803/2115251461","heartbeat_back_addr":"172.21.15.46:6807/2115251461","heartbeat_front_addr":"172.21.15.46:6805/2115251461","state":["exists","up"]},{"osd":3,"uuid":"34e1b86d-ffad-415d-861c-07a5f08068a6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6824","nonce":2981388766},{"type":"v1","addr":"172.21.15.46:6825","nonce":2981388766}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6826","nonce":2981388766},{"type":"v1","addr":"172.21.15.46:6827","nonce":2981388766}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6830","nonce":2981388766},{"type":"v1","addr":"172.21.15.46:6831","nonce":2981388766}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6828","nonce":2981388766},{"type":"v1","addr":"172.21.15.46:6829","nonce":2981388766}]},"public_addr":"172.21.15.46:6825/2981388766","cluster_addr":"172.21.15.46:6827/2981388766","heartbeat_back_addr":"172.21.15.46:6831/2981388766","heartbeat_front_addr":"172.21.15.46:6829/2981388766","state":["exists","up"]},{"osd":4,"uuid":"57ffcb91-c7dc-4a69-ae71-4d9622a14a05","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6800","nonce":2083655348},{"type":"v1","addr":"172.21.15.73:6801","nonce":2083655348}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6802","nonce":2083655348},{"type":"v1","addr":"172.21.15.73:6803","nonce":2083655348}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6806","nonce":2083655348},{"type":"v1","addr":"172.21.15.73:6807","nonce":2083655348}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6804","nonce":2083655348},{"type":"v1","addr":"172.21.15.73:6805","nonce":2083655348}]},"public_addr":"172.21.15.73:6801/2083655348","cluster_addr":"172.21.15.73:6803/2083655348","heartbeat_back_addr":"172.21.15.73:6807/2083655348","heartbeat_front_addr":"172.21.15.73:6805/2083655348","state":["exists","up"]},{"osd":5,"uuid":"665f41c9-ee20-49cf-bf0e-fbe0c03d3aed","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6824","nonce":2803788401},{"type":"v1","addr":"172.21.15.73:6825","nonce":2803788401}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6826","nonce":2803788401},{"type":"v1","addr":"172.21.15.73:6827","nonce":2803788401}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6830","nonce":2803788401},{"type":"v1","addr":"172.21.15.73:6831","nonce":2803788401}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6828","nonce":2803788401},{"type":"v1","addr":"172.21.15.73:6829","nonce":2803788401}]},"public_addr":"172.21.15.73:6825/2803788401","cluster_addr":"172.21.15.73:6827/2803788401","heartbeat_back_addr":"172.21.15.73:6831/2803788401","heartbeat_front_addr":"172.21.15.73:6829/2803788401","state":["exists","up"]},{"osd":6,"uuid":"5790c6cc-bd56-4ce4-9a7c-0f0c3b59215c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6808","nonce":974108383},{"type":"v1","addr":"172.21.15.73:6809","nonce":974108383}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6810","nonce":974108383},{"type":"v1","addr":"172.21.15.73:6811","nonce":974108383}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6815","nonce":974108383},{"type":"v1","addr":"172.21.15.73:6817","nonce":974108383}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6812","nonce":974108383},{"type":"v1","addr":"172.21.15.73:6813","nonce":974108383}]},"public_addr":"172.21.15.73:6809/974108383","cluster_addr":"172.21.15.73:6811/974108383","heartbeat_back_addr":"172.21.15.73:6817/974108383","heartbeat_front_addr":"172.21.15.73:6813/974108383","state":["exists","up"]},{"osd":7,"uuid":"b66f4d2e-147e-4c9b-97dd-cbd59d33802e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6814","nonce":3772673248},{"type":"v1","addr":"172.21.15.73:6816","nonce":3772673248}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6818","nonce":3772673248},{"type":"v1","addr":"172.21.15.73:6819","nonce":3772673248}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6822","nonce":3772673248},{"type":"v1","addr":"172.21.15.73:6823","nonce":3772673248}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6820","nonce":3772673248},{"type":"v1","addr":"172.21.15.73:6821","nonce":3772673248}]},"public_addr":"172.21.15.73:6816/3772673248","cluster_addr":"172.21.15.73:6819/3772673248","heartbeat_back_addr":"172.21.15.73:6823/3772673248","heartbeat_front_addr":"172.21.15.73:6821/3772673248","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-05T18:56:04.115334+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-05T18:56:04.071250+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-05T18:56:04.044387+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-05T18:56:04.085389+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-05T18:56:04.090726+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-05T18:56:04.074529+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-05T18:56:04.058841+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-05T18:56:04.043054+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-05T18:56:20.556 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:20.554+0000 7f53573d9700 1 -- 172.21.15.46:0/2144918251 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7f533406ace0 msgr2=0x7f533406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:56:20.556 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:20.554+0000 7f53573d9700 1 --2- 172.21.15.46:0/2144918251 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7f533406ace0 0x7f533406d190 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f534c003e60 tx=0x7f534c009040 comp rx=0 tx=0).stop 2023-07-05T18:56:20.556 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:20.554+0000 7f53573d9700 1 -- 172.21.15.46:0/2144918251 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5350159d60 msgr2=0x7f535014e210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:56:20.556 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:20.554+0000 7f53573d9700 1 --2- 172.21.15.46:0/2144918251 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5350159d60 0x7f535014e210 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f535006e780 tx=0x7f5348004ad0 comp rx=0 tx=0).stop 2023-07-05T18:56:20.556 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:20.554+0000 7f53573d9700 1 -- 172.21.15.46:0/2144918251 shutdown_connections 2023-07-05T18:56:20.556 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:20.554+0000 7f53573d9700 1 --2- 172.21.15.46:0/2144918251 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7f533406ace0 0x7f533406d190 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:20.557 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:20.554+0000 7f53573d9700 1 --2- 172.21.15.46:0/2144918251 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5350159d60 0x7f535014e210 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:20.557 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:20.554+0000 7f53573d9700 1 --2- 172.21.15.46:0/2144918251 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5350070af0 0x7f535014ae50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:20.557 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:20.554+0000 7f53573d9700 1 --2- 172.21.15.46:0/2144918251 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f5350159280 0x7f53501517d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:20.557 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:20.554+0000 7f53573d9700 1 -- 172.21.15.46:0/2144918251 >> 172.21.15.46:0/2144918251 conn(0x7f53500b0d50 msgr2=0x7f535015b6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-05T18:56:20.557 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:20.554+0000 7f53573d9700 1 -- 172.21.15.46:0/2144918251 shutdown_connections 2023-07-05T18:56:20.558 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:20.554+0000 7f53573d9700 1 -- 172.21.15.46:0/2144918251 wait complete. 2023-07-05T18:56:20.568 INFO:tasks.ceph.ceph_manager.ceph:all up! 2023-07-05T18:56:20.569 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-05T18:56:20.696 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:20.692+0000 7f1f175eb700 1 Processor -- start 2023-07-05T18:56:20.697 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:20.692+0000 7f1f175eb700 1 -- start start 2023-07-05T18:56:20.697 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:20.693+0000 7f1f175eb700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f1f100b1e40 0x7f1f100cbc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:56:20.697 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:20.693+0000 7f1f175eb700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f1f100b2210 0x7f1f100ce6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:56:20.697 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:20.693+0000 7f1f175eb700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f1f100ccd70 0x7f1f100cec10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:56:20.697 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:20.693+0000 7f1f175eb700 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1f1006ac50 con 0x7f1f100b1e40 2023-07-05T18:56:20.698 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:20.693+0000 7f1f175eb700 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1f100cc170 con 0x7f1f100ccd70 2023-07-05T18:56:20.698 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:20.693+0000 7f1f175eb700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1f100cc440 con 0x7f1f100b2210 2023-07-05T18:56:20.698 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:20.693+0000 7f1f15387700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f1f100b1e40 0x7f1f100cbc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:56:20.698 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:20.693+0000 7f1f15387700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f1f100b1e40 0x7f1f100cbc30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:57812/0 (socket says 172.21.15.46:57812) 2023-07-05T18:56:20.698 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:20.693+0000 7f1f15387700 1 -- 172.21.15.46:0/3757447794 learned_addr learned my addr 172.21.15.46:0/3757447794 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-07-05T18:56:20.698 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:20.693+0000 7f1f15b88700 1 --2- 172.21.15.46:0/3757447794 >> v2:172.21.15.73:3300/0 conn(0x7f1f100ccd70 0x7f1f100cec10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:56:20.698 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:20.693+0000 7f1f14b86700 1 --2- 172.21.15.46:0/3757447794 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f1f100b2210 0x7f1f100ce6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:56:20.698 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:20.693+0000 7f1f15387700 1 -- 172.21.15.46:0/3757447794 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f1f100b2210 msgr2=0x7f1f100ce6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-05T18:56:20.699 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:20.693+0000 7f1f15387700 1 --2- 172.21.15.46:0/3757447794 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f1f100b2210 0x7f1f100ce6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:20.699 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:20.693+0000 7f1f15387700 1 -- 172.21.15.46:0/3757447794 >> v2:172.21.15.73:3300/0 conn(0x7f1f100ccd70 msgr2=0x7f1f100cec10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-05T18:56:20.699 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:20.693+0000 7f1f15387700 1 --2- 172.21.15.46:0/3757447794 >> v2:172.21.15.73:3300/0 conn(0x7f1f100ccd70 0x7f1f100cec10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:20.699 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:20.693+0000 7f1f15387700 1 -- 172.21.15.46:0/3757447794 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1f100cc720 con 0x7f1f100b1e40 2023-07-05T18:56:20.699 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:20.693+0000 7f1f15b88700 1 --2- 172.21.15.46:0/3757447794 >> v2:172.21.15.73:3300/0 conn(0x7f1f100ccd70 0x7f1f100cec10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-05T18:56:20.699 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:20.693+0000 7f1f14b86700 1 --2- 172.21.15.46:0/3757447794 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f1f100b2210 0x7f1f100ce6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-05T18:56:20.699 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:20.693+0000 7f1f15387700 1 --2- 172.21.15.46:0/3757447794 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1f100b1e40 0x7f1f100cbc30 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f1f100716d0 tx=0x7f1f0c009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7b9d30dd2b733f92 server_cookie=0 in_seq=0 out_seq=0 2023-07-05T18:56:20.699 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:20.693+0000 7f1f07fff700 1 -- 172.21.15.46:0/3757447794 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f0c00b870 con 0x7f1f100b1e40 2023-07-05T18:56:20.700 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:20.693+0000 7f1f07fff700 1 -- 172.21.15.46:0/3757447794 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1f0c00b9d0 con 0x7f1f100b1e40 2023-07-05T18:56:20.700 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:20.693+0000 7f1f07fff700 1 -- 172.21.15.46:0/3757447794 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f0c00bd60 con 0x7f1f100b1e40 2023-07-05T18:56:20.700 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:20.694+0000 7f1f175eb700 1 -- 172.21.15.46:0/3757447794 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1f100b1e40 msgr2=0x7f1f100cbc30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:56:20.700 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:20.694+0000 7f1f175eb700 1 --2- 172.21.15.46:0/3757447794 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1f100b1e40 0x7f1f100cbc30 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f1f100716d0 tx=0x7f1f0c009bd0 comp rx=0 tx=0).stop 2023-07-05T18:56:20.700 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:20.694+0000 7f1f175eb700 1 -- 172.21.15.46:0/3757447794 shutdown_connections 2023-07-05T18:56:20.700 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:20.694+0000 7f1f175eb700 1 --2- 172.21.15.46:0/3757447794 >> v2:172.21.15.73:3300/0 conn(0x7f1f100ccd70 0x7f1f100cec10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:20.700 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:20.694+0000 7f1f175eb700 1 --2- 172.21.15.46:0/3757447794 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1f100b1e40 0x7f1f100cbc30 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:20.701 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:20.694+0000 7f1f175eb700 1 --2- 172.21.15.46:0/3757447794 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f1f100b2210 0x7f1f100ce6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:20.701 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:20.694+0000 7f1f175eb700 1 -- 172.21.15.46:0/3757447794 >> 172.21.15.46:0/3757447794 conn(0x7f1f10099e20 msgr2=0x7f1f100d0b00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-05T18:56:20.701 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:20.694+0000 7f1f175eb700 1 -- 172.21.15.46:0/3757447794 shutdown_connections 2023-07-05T18:56:20.701 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:20.694+0000 7f1f175eb700 1 -- 172.21.15.46:0/3757447794 wait complete. 2023-07-05T18:56:20.707 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:20.695+0000 7f1f175eb700 1 Processor -- start 2023-07-05T18:56:20.707 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:20.695+0000 7f1f175eb700 1 -- start start 2023-07-05T18:56:20.707 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:20.696+0000 7f1f175eb700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f1f100b1e40 0x7f1f1006eb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:56:20.708 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:20.696+0000 7f1f175eb700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1f100ccd70 0x7f1f101e6470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:56:20.710 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:20.696+0000 7f1f175eb700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1f1015a0f0 0x7f1f1014e9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:56:20.710 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:20.696+0000 7f1f175eb700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f101e71c0 con 0x7f1f100ccd70 2023-07-05T18:56:20.710 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:20.696+0000 7f1f175eb700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f100c91a0 con 0x7f1f1015a0f0 2023-07-05T18:56:20.710 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:20.696+0000 7f1f175eb700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1f101e6ee0 con 0x7f1f100b1e40 2023-07-05T18:56:20.710 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:20.696+0000 7f1f14b86700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1f100ccd70 0x7f1f101e6470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:56:20.711 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:20.696+0000 7f1f14b86700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1f100ccd70 0x7f1f101e6470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:57820/0 (socket says 172.21.15.46:57820) 2023-07-05T18:56:20.711 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:20.696+0000 7f1f14b86700 1 -- 172.21.15.46:0/1465243141 learned_addr learned my addr 172.21.15.46:0/1465243141 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-07-05T18:56:20.711 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:20.696+0000 7f1f15b88700 1 --2- 172.21.15.46:0/1465243141 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1f1015a0f0 0x7f1f1014e9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:56:20.711 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:20.696+0000 7f1f15387700 1 --2- 172.21.15.46:0/1465243141 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f1f100b1e40 0x7f1f1006eb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:56:20.711 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:20.697+0000 7f1f14b86700 1 -- 172.21.15.46:0/1465243141 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f1f100b1e40 msgr2=0x7f1f1006eb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:56:20.711 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:20.697+0000 7f1f14b86700 1 --2- 172.21.15.46:0/1465243141 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f1f100b1e40 0x7f1f1006eb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:20.712 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:20.697+0000 7f1f14b86700 1 -- 172.21.15.46:0/1465243141 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1f1015a0f0 msgr2=0x7f1f1014e9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:56:20.712 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:20.697+0000 7f1f14b86700 1 --2- 172.21.15.46:0/1465243141 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1f1015a0f0 0x7f1f1014e9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:20.712 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:20.697+0000 7f1f14b86700 1 -- 172.21.15.46:0/1465243141 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1f0c009550 con 0x7f1f100ccd70 2023-07-05T18:56:20.712 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:20.697+0000 7f1f15387700 1 --2- 172.21.15.46:0/1465243141 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f1f100b1e40 0x7f1f1006eb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-05T18:56:20.712 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:20.697+0000 7f1f14b86700 1 --2- 172.21.15.46:0/1465243141 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1f100ccd70 0x7f1f101e6470 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f1f0000d800 tx=0x7f1f0000dbc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-05T18:56:20.712 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:20.697+0000 7f1f05ffb700 1 -- 172.21.15.46:0/1465243141 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f00004030 con 0x7f1f100ccd70 2023-07-05T18:56:20.713 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:20.697+0000 7f1f05ffb700 1 -- 172.21.15.46:0/1465243141 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1f00004190 con 0x7f1f100ccd70 2023-07-05T18:56:20.713 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:20.697+0000 7f1f175eb700 1 -- 172.21.15.46:0/1465243141 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1f100c8ae0 con 0x7f1f100ccd70 2023-07-05T18:56:20.713 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:20.697+0000 7f1f05ffb700 1 -- 172.21.15.46:0/1465243141 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f00004520 con 0x7f1f100ccd70 2023-07-05T18:56:20.713 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:20.697+0000 7f1f175eb700 1 -- 172.21.15.46:0/1465243141 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1f1006f0d0 con 0x7f1f100ccd70 2023-07-05T18:56:20.713 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:20.698+0000 7f1f175eb700 1 -- 172.21.15.46:0/1465243141 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1f1006f2c0 con 0x7f1f100ccd70 2023-07-05T18:56:20.713 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:20.698+0000 7f1f05ffb700 1 -- 172.21.15.46:0/1465243141 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f1f000036a0 con 0x7f1f100ccd70 2023-07-05T18:56:20.714 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:20.699+0000 7f1f05ffb700 1 --2- 172.21.15.46:0/1465243141 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7f1ef406ace0 0x7f1ef406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:56:20.714 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:20.699+0000 7f1f05ffb700 1 -- 172.21.15.46:0/1465243141 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f1f00089a30 con 0x7f1f100ccd70 2023-07-05T18:56:20.714 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:20.699+0000 7f1f15387700 1 --2- 172.21.15.46:0/1465243141 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7f1ef406ace0 0x7f1ef406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:56:20.714 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:20.699+0000 7f1f15387700 1 --2- 172.21.15.46:0/1465243141 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7f1ef406ace0 0x7f1ef406d190 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f1f0c009130 tx=0x7f1f0c008030 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-05T18:56:20.714 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:20.703+0000 7f1f05ffb700 1 -- 172.21.15.46:0/1465243141 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f1f00058570 con 0x7f1f100ccd70 2023-07-05T18:56:20.749 INFO:tasks.ceph.mds.b.smithi073.stderr:2023-07-05T18:56:20.748+0000 7f0dc8c8f700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-07-05T18:56:20.903 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:20.901+0000 7f1f175eb700 1 -- 172.21.15.46:0/1465243141 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f1f100c8940 con 0x7f1f100ccd70 2023-07-05T18:56:20.904 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:20.902+0000 7f1f05ffb700 1 -- 172.21.15.46:0/1465243141 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) v1 ==== 74+0+18161 (secure 0 0 0) 0x7f1f100c8940 con 0x7f1f100ccd70 2023-07-05T18:56:20.905 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T18:56:20.905 INFO:teuthology.orchestra.run.smithi046.stdout:{"epoch":21,"fsid":"042652d3-d80c-4ad8-9366-3e94f2a0a512","created":"2023-07-05T18:55:56.455710+0000","modified":"2023-07-05T18:56:16.095672+0000","last_up_change":"2023-07-05T18:56:06.594022+0000","last_in_change":"2023-07-05T18:55:58.879340+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-07-05T18:56:07.729620+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2023-07-05T18:56:08.128122+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-07-05T18:56:12.954625+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-07-05T18:56:14.068396+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"20009183-9a47-4392-8751-883f88d2bfb1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6813","nonce":4151971443},{"type":"v1","addr":"172.21.15.46:6815","nonce":4151971443}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6817","nonce":4151971443},{"type":"v1","addr":"172.21.15.46:6818","nonce":4151971443}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6822","nonce":4151971443},{"type":"v1","addr":"172.21.15.46:6823","nonce":4151971443}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6820","nonce":4151971443},{"type":"v1","addr":"172.21.15.46:6821","nonce":4151971443}]},"public_addr":"172.21.15.46:6815/4151971443","cluster_addr":"172.21.15.46:6818/4151971443","heartbeat_back_addr":"172.21.15.46:6823/4151971443","heartbeat_front_addr":"172.21.15.46:6821/4151971443","state":["exists","up"]},{"osd":1,"uuid":"91b4a7b0-e4e4-4888-a1fe-9edb0d68004c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6808","nonce":502575881},{"type":"v1","addr":"172.21.15.46:6809","nonce":502575881}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6810","nonce":502575881},{"type":"v1","addr":"172.21.15.46:6811","nonce":502575881}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6816","nonce":502575881},{"type":"v1","addr":"172.21.15.46:6819","nonce":502575881}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6812","nonce":502575881},{"type":"v1","addr":"172.21.15.46:6814","nonce":502575881}]},"public_addr":"172.21.15.46:6809/502575881","cluster_addr":"172.21.15.46:6811/502575881","heartbeat_back_addr":"172.21.15.46:6819/502575881","heartbeat_front_addr":"172.21.15.46:6814/502575881","state":["exists","up"]},{"osd":2,"uuid":"669ff744-1331-47c5-8579-0440731c889a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6800","nonce":2115251461},{"type":"v1","addr":"172.21.15.46:6801","nonce":2115251461}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6802","nonce":2115251461},{"type":"v1","addr":"172.21.15.46:6803","nonce":2115251461}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6806","nonce":2115251461},{"type":"v1","addr":"172.21.15.46:6807","nonce":2115251461}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6804","nonce":2115251461},{"type":"v1","addr":"172.21.15.46:6805","nonce":2115251461}]},"public_addr":"172.21.15.46:6801/2115251461","cluster_addr":"172.21.15.46:6803/2115251461","heartbeat_back_addr":"172.21.15.46:6807/2115251461","heartbeat_front_addr":"172.21.15.46:6805/2115251461","state":["exists","up"]},{"osd":3,"uuid":"34e1b86d-ffad-415d-861c-07a5f08068a6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6824","nonce":2981388766},{"type":"v1","addr":"172.21.15.46:6825","nonce":2981388766}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6826","nonce":2981388766},{"type":"v1","addr":"172.21.15.46:6827","nonce":2981388766}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6830","nonce":2981388766},{"type":"v1","addr":"172.21.15.46:6831","nonce":2981388766}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6828","nonce":2981388766},{"type":"v1","addr":"172.21.15.46:6829","nonce":2981388766}]},"public_addr":"172.21.15.46:6825/2981388766","cluster_addr":"172.21.15.46:6827/2981388766","heartbeat_back_addr":"172.21.15.46:6831/2981388766","heartbeat_front_addr":"172.21.15.46:6829/2981388766","state":["exists","up"]},{"osd":4,"uuid":"57ffcb91-c7dc-4a69-ae71-4d9622a14a05","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6800","nonce":2083655348},{"type":"v1","addr":"172.21.15.73:6801","nonce":2083655348}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6802","nonce":2083655348},{"type":"v1","addr":"172.21.15.73:6803","nonce":2083655348}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6806","nonce":2083655348},{"type":"v1","addr":"172.21.15.73:6807","nonce":2083655348}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6804","nonce":2083655348},{"type":"v1","addr":"172.21.15.73:6805","nonce":2083655348}]},"public_addr":"172.21.15.73:6801/2083655348","cluster_addr":"172.21.15.73:6803/2083655348","heartbeat_back_addr":"172.21.15.73:6807/2083655348","heartbeat_front_addr":"172.21.15.73:6805/2083655348","state":["exists","up"]},{"osd":5,"uuid":"665f41c9-ee20-49cf-bf0e-fbe0c03d3aed","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6824","nonce":2803788401},{"type":"v1","addr":"172.21.15.73:6825","nonce":2803788401}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6826","nonce":2803788401},{"type":"v1","addr":"172.21.15.73:6827","nonce":2803788401}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6830","nonce":2803788401},{"type":"v1","addr":"172.21.15.73:6831","nonce":2803788401}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6828","nonce":2803788401},{"type":"v1","addr":"172.21.15.73:6829","nonce":2803788401}]},"public_addr":"172.21.15.73:6825/2803788401","cluster_addr":"172.21.15.73:6827/2803788401","heartbeat_back_addr":"172.21.15.73:6831/2803788401","heartbeat_front_addr":"172.21.15.73:6829/2803788401","state":["exists","up"]},{"osd":6,"uuid":"5790c6cc-bd56-4ce4-9a7c-0f0c3b59215c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6808","nonce":974108383},{"type":"v1","addr":"172.21.15.73:6809","nonce":974108383}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6810","nonce":974108383},{"type":"v1","addr":"172.21.15.73:6811","nonce":974108383}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6815","nonce":974108383},{"type":"v1","addr":"172.21.15.73:6817","nonce":974108383}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6812","nonce":974108383},{"type":"v1","addr":"172.21.15.73:6813","nonce":974108383}]},"public_addr":"172.21.15.73:6809/974108383","cluster_addr":"172.21.15.73:6811/974108383","heartbeat_back_addr":"172.21.15.73:6817/974108383","heartbeat_front_addr":"172.21.15.73:6813/974108383","state":["exists","up"]},{"osd":7,"uuid":"b66f4d2e-147e-4c9b-97dd-cbd59d33802e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6814","nonce":3772673248},{"type":"v1","addr":"172.21.15.73:6816","nonce":3772673248}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6818","nonce":3772673248},{"type":"v1","addr":"172.21.15.73:6819","nonce":3772673248}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6822","nonce":3772673248},{"type":"v1","addr":"172.21.15.73:6823","nonce":3772673248}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6820","nonce":3772673248},{"type":"v1","addr":"172.21.15.73:6821","nonce":3772673248}]},"public_addr":"172.21.15.73:6816/3772673248","cluster_addr":"172.21.15.73:6819/3772673248","heartbeat_back_addr":"172.21.15.73:6823/3772673248","heartbeat_front_addr":"172.21.15.73:6821/3772673248","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-05T18:56:04.115334+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-05T18:56:04.071250+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-05T18:56:04.044387+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-05T18:56:04.085389+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-05T18:56:04.090726+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-05T18:56:04.074529+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-05T18:56:04.058841+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-05T18:56:04.043054+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-05T18:56:20.909 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:20.905+0000 7f1f175eb700 1 -- 172.21.15.46:0/1465243141 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7f1ef406ace0 msgr2=0x7f1ef406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:56:20.909 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:20.905+0000 7f1f175eb700 1 --2- 172.21.15.46:0/1465243141 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7f1ef406ace0 0x7f1ef406d190 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f1f0c009130 tx=0x7f1f0c008030 comp rx=0 tx=0).stop 2023-07-05T18:56:20.909 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:20.905+0000 7f1f175eb700 1 -- 172.21.15.46:0/1465243141 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1f100ccd70 msgr2=0x7f1f101e6470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:56:20.909 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:20.905+0000 7f1f175eb700 1 --2- 172.21.15.46:0/1465243141 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1f100ccd70 0x7f1f101e6470 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f1f0000d800 tx=0x7f1f0000dbc0 comp rx=0 tx=0).stop 2023-07-05T18:56:20.910 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:20.905+0000 7f1f175eb700 1 -- 172.21.15.46:0/1465243141 shutdown_connections 2023-07-05T18:56:20.910 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:20.905+0000 7f1f175eb700 1 --2- 172.21.15.46:0/1465243141 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7f1ef406ace0 0x7f1ef406d190 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:20.910 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:20.905+0000 7f1f175eb700 1 --2- 172.21.15.46:0/1465243141 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1f1015a0f0 0x7f1f1014e9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:20.910 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:20.905+0000 7f1f175eb700 1 --2- 172.21.15.46:0/1465243141 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f1f100b1e40 0x7f1f1006eb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:20.910 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:20.905+0000 7f1f175eb700 1 --2- 172.21.15.46:0/1465243141 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1f100ccd70 0x7f1f101e6470 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:20.911 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:20.905+0000 7f1f175eb700 1 -- 172.21.15.46:0/1465243141 >> 172.21.15.46:0/1465243141 conn(0x7f1f10099e20 msgr2=0x7f1f1006d7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-05T18:56:20.911 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:20.905+0000 7f1f175eb700 1 -- 172.21.15.46:0/1465243141 shutdown_connections 2023-07-05T18:56:20.911 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:20.905+0000 7f1f175eb700 1 -- 172.21.15.46:0/1465243141 wait complete. 2023-07-05T18:56:20.921 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2023-07-05T18:56:20.922 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2023-07-05T18:56:20.923 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2023-07-05T18:56:20.923 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2023-07-05T18:56:20.923 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 flush_pg_stats 2023-07-05T18:56:20.924 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 flush_pg_stats 2023-07-05T18:56:20.925 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 flush_pg_stats 2023-07-05T18:56:20.925 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 flush_pg_stats 2023-07-05T18:56:21.142 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.140+0000 7f0562833700 1 Processor -- start 2023-07-05T18:56:21.143 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.140+0000 7f0562833700 1 -- start start 2023-07-05T18:56:21.145 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.141+0000 7f0562833700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f055c06f5b0 0x7f055c06f980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:56:21.145 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.141+0000 7f0562833700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f055c0cc840 0x7f055c0cd650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:56:21.146 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.141+0000 7f0562833700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f055c15cdd0 0x7f055c15d270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:56:21.146 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.141+0000 7f0562833700 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f055c0c9400 con 0x7f055c06f5b0 2023-07-05T18:56:21.146 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.141+0000 7f0562833700 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f055c06fec0 con 0x7f055c15cdd0 2023-07-05T18:56:21.146 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.141+0000 7f0562833700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f055c1596a0 con 0x7f055c0cc840 2023-07-05T18:56:21.146 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.142+0000 7f0560dd0700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f055c15cdd0 0x7f055c15d270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:56:21.146 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.142+0000 7f0560dd0700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f055c15cdd0 0x7f055c15d270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.46:57312/0 (socket says 172.21.15.46:57312) 2023-07-05T18:56:21.146 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.142+0000 7f0560dd0700 1 -- 172.21.15.46:0/3290504533 learned_addr learned my addr 172.21.15.46:0/3290504533 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-07-05T18:56:21.147 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.143+0000 7f0560dd0700 1 -- 172.21.15.46:0/3290504533 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f055c0cc840 msgr2=0x7f055c0cd650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-05T18:56:21.147 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.143+0000 7f0560dd0700 1 --2- 172.21.15.46:0/3290504533 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f055c0cc840 0x7f055c0cd650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:21.147 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.143+0000 7f0560dd0700 1 -- 172.21.15.46:0/3290504533 >> v2:172.21.15.46:3300/0 conn(0x7f055c06f5b0 msgr2=0x7f055c06f980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-05T18:56:21.147 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.143+0000 7f0560dd0700 1 --2- 172.21.15.46:0/3290504533 >> v2:172.21.15.46:3300/0 conn(0x7f055c06f5b0 0x7f055c06f980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:21.147 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.143+0000 7f0560dd0700 1 -- 172.21.15.46:0/3290504533 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f055c0c9670 con 0x7f055c15cdd0 2023-07-05T18:56:21.147 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.143+0000 7f0560dd0700 1 --2- 172.21.15.46:0/3290504533 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f055c15cdd0 0x7f055c15d270 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f055c15de90 tx=0x7f055400b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=cac7453316067a3b server_cookie=0 in_seq=0 out_seq=0 2023-07-05T18:56:21.147 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.143+0000 7f055affd700 1 -- 172.21.15.46:0/3290504533 <== mon.1 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f055400e070 con 0x7f055c15cdd0 2023-07-05T18:56:21.148 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.143+0000 7f055affd700 1 -- 172.21.15.46:0/3290504533 <== mon.1 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f055400b9c0 con 0x7f055c15cdd0 2023-07-05T18:56:21.148 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.143+0000 7f055affd700 1 -- 172.21.15.46:0/3290504533 <== mon.1 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f055400bd70 con 0x7f055c15cdd0 2023-07-05T18:56:21.149 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.144+0000 7f31c8810700 1 Processor -- start 2023-07-05T18:56:21.149 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.143+0000 7ff6a9d3c700 1 Processor -- start 2023-07-05T18:56:21.150 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.143+0000 7ff6a9d3c700 1 -- start start 2023-07-05T18:56:21.150 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.144+0000 7f0562833700 1 -- 172.21.15.46:0/3290504533 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f055c15cdd0 msgr2=0x7f055c15d270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:56:21.150 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.144+0000 7f0562833700 1 --2- 172.21.15.46:0/3290504533 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f055c15cdd0 0x7f055c15d270 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f055c15de90 tx=0x7f055400b330 comp rx=0 tx=0).stop 2023-07-05T18:56:21.150 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.145+0000 7ff6a9d3c700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7ff6a406c8e0 0x7ff6a4164e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:56:21.151 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.145+0000 7ff6a9d3c700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7ff6a4069e00 0x7ff6a406a220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:56:21.151 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.145+0000 7ff6a9d3c700 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff6a4165390 con 0x7ff6a41608f0 2023-07-05T18:56:21.151 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.145+0000 7ff6a9d3c700 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff6a4147d00 con 0x7ff6a4069e00 2023-07-05T18:56:21.151 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.145+0000 7ff6a9d3c700 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff6a406cd60 con 0x7ff6a406c8e0 2023-07-05T18:56:21.151 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.145+0000 7f5e8cda7700 1 Processor -- start 2023-07-05T18:56:21.152 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.145+0000 7f0562833700 1 -- 172.21.15.46:0/3290504533 shutdown_connections 2023-07-05T18:56:21.152 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.145+0000 7f0562833700 1 --2- 172.21.15.46:0/3290504533 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f055c15cdd0 0x7f055c15d270 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:21.152 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.145+0000 7f0562833700 1 --2- 172.21.15.46:0/3290504533 >> v2:172.21.15.46:3300/0 conn(0x7f055c06f5b0 0x7f055c06f980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:21.152 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.145+0000 7f0562833700 1 --2- 172.21.15.46:0/3290504533 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f055c0cc840 0x7f055c0cd650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:21.153 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.145+0000 7f0562833700 1 -- 172.21.15.46:0/3290504533 >> 172.21.15.46:0/3290504533 conn(0x7f055c0b0fc0 msgr2=0x7f055c0ce860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-05T18:56:21.153 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.145+0000 7f0562833700 1 -- 172.21.15.46:0/3290504533 shutdown_connections 2023-07-05T18:56:21.153 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.144+0000 7f31c8810700 1 -- start start 2023-07-05T18:56:21.153 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.145+0000 7f31c8810700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f31c4142480 0x7f31c40b41d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:56:21.154 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.145+0000 7ff6a37fe700 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7ff6a41608f0 0x7ff6a41475f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.46:43020/0 (socket says 172.21.15.46:43020) 2023-07-05T18:56:21.154 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.145+0000 7ff6a37fe700 1 -- 172.21.15.46:0/2020874744 learned_addr learned my addr 172.21.15.46:0/2020874744 (peer_addr_for_me v1:172.21.15.46:0/0) 2023-07-05T18:56:21.155 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.145+0000 7f31c8810700 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f31c406c8d0 con 0x7f31c40b4710 2023-07-05T18:56:21.155 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.145+0000 7f31c8810700 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f31c406cbb0 con 0x7f31c413f4c0 2023-07-05T18:56:21.155 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.145+0000 7f31c8810700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f31c406ce90 con 0x7f31c4142480 2023-07-05T18:56:21.156 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.146+0000 7f96fc736700 1 Processor -- start 2023-07-05T18:56:21.157 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.146+0000 7ff6a2ffd700 1 --2- 172.21.15.46:0/2020874744 >> v2:172.21.15.73:3300/0 conn(0x7ff6a406c8e0 0x7ff6a4164e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:56:21.157 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.146+0000 7f31c1d9b700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f31c4142480 0x7f31c40b41d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:56:21.158 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.146+0000 7f31c1d9b700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f31c4142480 0x7f31c40b41d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3301/0 says I am v2:172.21.15.46:41524/0 (socket says 172.21.15.46:41524) 2023-07-05T18:56:21.158 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.146+0000 7f31c1d9b700 1 -- 172.21.15.46:0/3505627458 learned_addr learned my addr 172.21.15.46:0/3505627458 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-07-05T18:56:21.158 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.146+0000 7ff6a3fff700 1 --2- 172.21.15.46:0/2020874744 >> v2:172.21.15.46:3300/0 conn(0x7ff6a4069e00 0x7ff6a406a220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:56:21.159 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.146+0000 7f31c1d9b700 1 -- 172.21.15.46:0/3505627458 >> v1:172.21.15.73:6789/0 conn(0x7f31c413f4c0 legacy=0x7f31c415d6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-05T18:56:21.159 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.146+0000 7f31c1d9b700 1 -- 172.21.15.46:0/3505627458 >> v1:172.21.15.46:6789/0 conn(0x7f31c40b4710 legacy=0x7f31c406d140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:56:21.159 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.146+0000 7f31c1d9b700 1 -- 172.21.15.46:0/3505627458 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f31c40b39d0 con 0x7f31c4142480 2023-07-05T18:56:21.160 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.145+0000 7f5e8cda7700 1 -- start start 2023-07-05T18:56:21.160 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.146+0000 7f5e8cda7700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f5e8815c2f0 0x7f5e880cd2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:56:21.160 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.146+0000 7f5e8cda7700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f5e880b5ae0 0x7f5e880b5f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:56:21.160 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.146+0000 7f5e8cda7700 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5e880cd8c0 con 0x7f5e8815c6c0 2023-07-05T18:56:21.161 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.146+0000 7f5e8cda7700 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5e880d0990 con 0x7f5e880b5ae0 2023-07-05T18:56:21.161 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.146+0000 7f5e8cda7700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5e880d0c70 con 0x7f5e8815c2f0 2023-07-05T18:56:21.162 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.146+0000 7ff6a2ffd700 1 -- 172.21.15.46:0/2020874744 >> v2:172.21.15.46:3300/0 conn(0x7ff6a4069e00 msgr2=0x7ff6a406a220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-05T18:56:21.162 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.146+0000 7ff6a2ffd700 1 --2- 172.21.15.46:0/2020874744 >> v2:172.21.15.46:3300/0 conn(0x7ff6a4069e00 0x7ff6a406a220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:21.162 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.146+0000 7ff6a2ffd700 1 -- 172.21.15.46:0/2020874744 >> v1:172.21.15.73:6789/0 conn(0x7ff6a41608f0 legacy=0x7ff6a41475f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:56:21.162 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.147+0000 7ff6a2ffd700 1 -- 172.21.15.46:0/2020874744 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff6a406a760 con 0x7ff6a406c8e0 2023-07-05T18:56:21.163 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.147+0000 7ff6a2ffd700 1 --2- 172.21.15.46:0/2020874744 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff6a406c8e0 0x7ff6a4164e50 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7ff6a414a790 tx=0x7ff694009b20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6be82f680161a2fe server_cookie=0 in_seq=0 out_seq=0 2023-07-05T18:56:21.163 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.147+0000 7f5e86d9d700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f5e880b5ae0 0x7f5e880b5f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:56:21.163 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.147+0000 7f5e86d9d700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f5e880b5ae0 0x7f5e880b5f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.46:57328/0 (socket says 172.21.15.46:57328) 2023-07-05T18:56:21.163 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.147+0000 7f5e86d9d700 1 -- 172.21.15.46:0/3627612270 learned_addr learned my addr 172.21.15.46:0/3627612270 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-07-05T18:56:21.163 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.145+0000 7f0562833700 1 -- 172.21.15.46:0/3290504533 wait complete. 2023-07-05T18:56:21.164 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.147+0000 7ff6a27fc700 1 -- 172.21.15.46:0/2020874744 <== mon.1 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff694004230 con 0x7ff6a406c8e0 2023-07-05T18:56:21.164 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.147+0000 7ff6a27fc700 1 -- 172.21.15.46:0/2020874744 <== mon.1 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff694004390 con 0x7ff6a406c8e0 2023-07-05T18:56:21.164 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.147+0000 7ff6a27fc700 1 -- 172.21.15.46:0/2020874744 <== mon.1 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6940036a0 con 0x7ff6a406c8e0 2023-07-05T18:56:21.165 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.147+0000 7f96fc736700 1 -- start start 2023-07-05T18:56:21.165 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.147+0000 7f5e86d9d700 1 -- 172.21.15.46:0/3627612270 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f5e8815c2f0 msgr2=0x7f5e880cd2e0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-07-05T18:56:21.165 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.147+0000 7f5e86d9d700 1 --2- 172.21.15.46:0/3627612270 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f5e8815c2f0 0x7f5e880cd2e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:21.165 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.147+0000 7f5e86d9d700 1 -- 172.21.15.46:0/3627612270 >> v1:172.21.15.73:6789/0 conn(0x7f5e8815c6c0 legacy=0x7f5e8806c760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:56:21.166 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.147+0000 7f5e86d9d700 1 -- 172.21.15.46:0/3627612270 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5e880d0f50 con 0x7f5e880b5ae0 2023-07-05T18:56:21.166 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.147+0000 7f31c1d9b700 1 --2- 172.21.15.46:0/3505627458 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f31c4142480 0x7f31c40b41d0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f31b400bbc0 tx=0x7f31b400bed0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ffd532c98ca1e4f3 server_cookie=0 in_seq=0 out_seq=0 2023-07-05T18:56:21.166 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.147+0000 7f0562833700 1 Processor -- start 2023-07-05T18:56:21.167 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.148+0000 7f5e86d9d700 1 --2- 172.21.15.46:0/3627612270 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5e880b5ae0 0x7f5e880b5f00 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f5e80009e50 tx=0x7f5e8000b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=11afe9eb218d32b9 server_cookie=0 in_seq=0 out_seq=0 2023-07-05T18:56:21.167 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.148+0000 7ff6a9d3c700 1 -- 172.21.15.46:0/2020874744 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff6a406c8e0 msgr2=0x7ff6a4164e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:56:21.167 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.148+0000 7ff6a9d3c700 1 --2- 172.21.15.46:0/2020874744 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff6a406c8e0 0x7ff6a4164e50 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7ff6a414a790 tx=0x7ff694009b20 comp rx=0 tx=0).stop 2023-07-05T18:56:21.168 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.148+0000 7f5e8559a700 1 -- 172.21.15.46:0/3627612270 <== mon.1 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e8000e070 con 0x7f5e880b5ae0 2023-07-05T18:56:21.168 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.148+0000 7f5e8559a700 1 -- 172.21.15.46:0/3627612270 <== mon.1 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5e8000b9c0 con 0x7f5e880b5ae0 2023-07-05T18:56:21.168 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.148+0000 7f5e8559a700 1 -- 172.21.15.46:0/3627612270 <== mon.1 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e8000bd70 con 0x7f5e880b5ae0 2023-07-05T18:56:21.168 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.148+0000 7ff6a9d3c700 1 -- 172.21.15.46:0/2020874744 shutdown_connections 2023-07-05T18:56:21.169 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.148+0000 7ff6a9d3c700 1 --2- 172.21.15.46:0/2020874744 >> v2:172.21.15.46:3300/0 conn(0x7ff6a4069e00 0x7ff6a406a220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:21.169 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.148+0000 7ff6a9d3c700 1 --2- 172.21.15.46:0/2020874744 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff6a406c8e0 0x7ff6a4164e50 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:21.169 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.148+0000 7ff6a9d3c700 1 -- 172.21.15.46:0/2020874744 >> 172.21.15.46:0/2020874744 conn(0x7ff6a406af10 msgr2=0x7ff6a406b2e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-05T18:56:21.170 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.149+0000 7f96fc736700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f96f4164540 0x7f96f40cc760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:56:21.170 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.149+0000 7f96fc736700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f96f4069e00 0x7f96f406a280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:56:21.170 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.149+0000 7f96fc736700 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f96f40ae110 con 0x7f96f4160a60 2023-07-05T18:56:21.170 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.149+0000 7f96fc736700 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f96f406a7c0 con 0x7f96f4069e00 2023-07-05T18:56:21.170 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.149+0000 7f96fc736700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f96f4160e30 con 0x7f96f4164540 2023-07-05T18:56:21.171 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.149+0000 7ff6a9d3c700 1 -- 172.21.15.46:0/2020874744 shutdown_connections 2023-07-05T18:56:21.173 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.149+0000 7f96facd3700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f96f4069e00 0x7f96f406a280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:56:21.173 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.149+0000 7f96facd3700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f96f4069e00 0x7f96f406a280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:57852/0 (socket says 172.21.15.46:57852) 2023-07-05T18:56:21.174 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.149+0000 7f96fa4d2700 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7f96f4160a60 0x7f96f40ada00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:57122/0 (socket says 172.21.15.46:57122) 2023-07-05T18:56:21.174 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.149+0000 7f96facd3700 1 -- 172.21.15.46:0/1182503717 learned_addr learned my addr 172.21.15.46:0/1182503717 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-07-05T18:56:21.174 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.148+0000 7f0562833700 1 -- start start 2023-07-05T18:56:21.174 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.149+0000 7f0562833700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f055c06f5b0 0x7f055c202b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:56:21.175 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.149+0000 7f0562833700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f055c0cc840 0x7f055c1feaf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:56:21.175 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.149+0000 7f0562833700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f055c15cdd0 0x7f055c201830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:56:21.175 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.149+0000 7f0562833700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f055c1ff320 con 0x7f055c06f5b0 2023-07-05T18:56:21.175 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.149+0000 7f0562833700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f055c1ff600 con 0x7f055c0cc840 2023-07-05T18:56:21.175 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.149+0000 7f0562833700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f055c1ff8e0 con 0x7f055c15cdd0 2023-07-05T18:56:21.175 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.149+0000 7f055b7fe700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f055c0cc840 0x7f055c1feaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:56:21.175 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.149+0000 7f055bfff700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f055c06f5b0 0x7f055c202b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:56:21.176 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.149+0000 7f5e8cda7700 1 -- 172.21.15.46:0/3627612270 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5e880b5ae0 msgr2=0x7f5e880b5f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:56:21.176 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.149+0000 7f5e8cda7700 1 --2- 172.21.15.46:0/3627612270 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5e880b5ae0 0x7f5e880b5f00 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f5e80009e50 tx=0x7f5e8000b330 comp rx=0 tx=0).stop 2023-07-05T18:56:21.176 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.149+0000 7f5e8cda7700 1 -- 172.21.15.46:0/3627612270 shutdown_connections 2023-07-05T18:56:21.176 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.149+0000 7f5e8cda7700 1 --2- 172.21.15.46:0/3627612270 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f5e8815c2f0 0x7f5e880cd2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:21.176 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.149+0000 7f5e8cda7700 1 --2- 172.21.15.46:0/3627612270 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5e880b5ae0 0x7f5e880b5f00 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:21.177 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.149+0000 7f5e8cda7700 1 -- 172.21.15.46:0/3627612270 >> 172.21.15.46:0/3627612270 conn(0x7f5e8806afa0 msgr2=0x7f5e880cf710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-05T18:56:21.177 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.150+0000 7f5e8cda7700 1 -- 172.21.15.46:0/3627612270 shutdown_connections 2023-07-05T18:56:21.177 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.149+0000 7f31c159a700 1 -- 172.21.15.46:0/3505627458 <== mon.2 v2:172.21.15.73:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31b400dd50 con 0x7f31c4142480 2023-07-05T18:56:21.177 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.149+0000 7f31c159a700 1 -- 172.21.15.46:0/3505627458 <== mon.2 v2:172.21.15.73:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f31b4004030 con 0x7f31c4142480 2023-07-05T18:56:21.177 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.149+0000 7f31c159a700 1 -- 172.21.15.46:0/3505627458 <== mon.2 v2:172.21.15.73:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31b40043a0 con 0x7f31c4142480 2023-07-05T18:56:21.178 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.149+0000 7f055bfff700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f055c06f5b0 0x7f055c202b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:57854/0 (socket says 172.21.15.46:57854) 2023-07-05T18:56:21.178 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.149+0000 7f055bfff700 1 -- 172.21.15.46:0/3381999807 learned_addr learned my addr 172.21.15.46:0/3381999807 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-07-05T18:56:21.178 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.149+0000 7f0560dd0700 1 --2- 172.21.15.46:0/3381999807 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f055c15cdd0 0x7f055c201830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:56:21.178 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.150+0000 7f055b7fe700 1 -- 172.21.15.46:0/3381999807 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f055c15cdd0 msgr2=0x7f055c201830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:56:21.178 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.150+0000 7f055b7fe700 1 --2- 172.21.15.46:0/3381999807 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f055c15cdd0 0x7f055c201830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:21.179 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.150+0000 7f055b7fe700 1 -- 172.21.15.46:0/3381999807 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f055c06f5b0 msgr2=0x7f055c202b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:56:21.179 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.150+0000 7f055b7fe700 1 --2- 172.21.15.46:0/3381999807 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f055c06f5b0 0x7f055c202b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:21.179 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.150+0000 7f055b7fe700 1 -- 172.21.15.46:0/3381999807 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0554009b30 con 0x7f055c0cc840 2023-07-05T18:56:21.179 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.150+0000 7f96f94d0700 1 -- 172.21.15.46:0/1182503717 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2076955333 0 0) 0x7f96f40ae110 con 0x7f96f4160a60 2023-07-05T18:56:21.179 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.150+0000 7f96f94d0700 1 -- 172.21.15.46:0/1182503717 --> v1:172.21.15.46:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f96e00035b0 con 0x7f96f4160a60 2023-07-05T18:56:21.180 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.150+0000 7f31c8810700 1 -- 172.21.15.46:0/3505627458 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f31c4142480 msgr2=0x7f31c40b41d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:56:21.180 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.150+0000 7f31c8810700 1 --2- 172.21.15.46:0/3505627458 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f31c4142480 0x7f31c40b41d0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f31b400bbc0 tx=0x7f31b400bed0 comp rx=0 tx=0).stop 2023-07-05T18:56:21.180 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.150+0000 7f96f94d0700 1 -- 172.21.15.46:0/1182503717 <== mon.0 v1:172.21.15.46:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2043224748 0 0) 0x7f96e00035b0 con 0x7f96f4160a60 2023-07-05T18:56:21.180 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.150+0000 7f96f94d0700 1 -- 172.21.15.46:0/1182503717 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f96f4164540 msgr2=0x7f96f40cc760 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-07-05T18:56:21.181 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.150+0000 7f96f94d0700 1 --2- 172.21.15.46:0/1182503717 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f96f4164540 0x7f96f40cc760 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:21.181 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.151+0000 7f96f94d0700 1 -- 172.21.15.46:0/1182503717 >> v2:172.21.15.46:3300/0 conn(0x7f96f4069e00 msgr2=0x7f96f406a280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-05T18:56:21.181 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.151+0000 7f96f94d0700 1 --2- 172.21.15.46:0/1182503717 >> v2:172.21.15.46:3300/0 conn(0x7f96f4069e00 0x7f96f406a280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:21.181 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.151+0000 7f96f94d0700 1 -- 172.21.15.46:0/1182503717 --> v1:172.21.15.46:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f96f4164a00 con 0x7f96f4160a60 2023-07-05T18:56:21.181 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.151+0000 7f96f94d0700 1 -- 172.21.15.46:0/1182503717 <== mon.0 v1:172.21.15.46:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2195585215 0 0) 0x7f96f0001670 con 0x7f96f4160a60 2023-07-05T18:56:21.181 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.151+0000 7f96f94d0700 1 -- 172.21.15.46:0/1182503717 >> v1:172.21.15.46:6789/0 conn(0x7f96f4160a60 legacy=0x7f96f40ada00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:56:21.182 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.151+0000 7f96f94d0700 1 --2- 172.21.15.46:0/1182503717 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f96e0003a00 0x7f96e0003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:56:21.182 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.149+0000 7ff6a9d3c700 1 -- 172.21.15.46:0/2020874744 wait complete. 2023-07-05T18:56:21.182 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.151+0000 7f96f94d0700 1 --2- 172.21.15.46:0/1182503717 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f96e0004430 0x7f96e00048f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:56:21.182 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.151+0000 7f96f94d0700 1 --2- 172.21.15.46:0/1182503717 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f96e00050a0 0x7f96e000ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:56:21.183 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.151+0000 7f96f94d0700 1 -- 172.21.15.46:0/1182503717 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96f406a7c0 con 0x7f96e0003a00 2023-07-05T18:56:21.183 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.151+0000 7f96f94d0700 1 -- 172.21.15.46:0/1182503717 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96f4160e30 con 0x7f96e00050a0 2023-07-05T18:56:21.183 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.151+0000 7f96f94d0700 1 -- 172.21.15.46:0/1182503717 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f96e000c030 con 0x7f96e0004430 2023-07-05T18:56:21.183 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.151+0000 7ff6a9d3c700 1 Processor -- start 2023-07-05T18:56:21.184 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.151+0000 7f96facd3700 1 --2- 172.21.15.46:0/1182503717 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f96e00050a0 0x7f96e000ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:56:21.184 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.151+0000 7f96fa4d2700 1 --2- 172.21.15.46:0/1182503717 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f96e0003a00 0x7f96e0003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:56:21.184 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.150+0000 7f5e8cda7700 1 -- 172.21.15.46:0/3627612270 wait complete. 2023-07-05T18:56:21.185 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.151+0000 7f055b7fe700 1 --2- 172.21.15.46:0/3381999807 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f055c0cc840 0x7f055c1feaf0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f055c0ccc10 tx=0x7f054c00b730 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-05T18:56:21.185 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.152+0000 7f5e8cda7700 1 Processor -- start 2023-07-05T18:56:21.185 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.152+0000 7f96f9cd1700 1 --2- 172.21.15.46:0/1182503717 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f96e0004430 0x7f96e00048f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:56:21.186 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.152+0000 7f0558ff9700 1 -- 172.21.15.46:0/3381999807 <== mon.1 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f054c011830 con 0x7f055c0cc840 2023-07-05T18:56:21.186 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.152+0000 7f0558ff9700 1 -- 172.21.15.46:0/3381999807 <== mon.1 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f054c011990 con 0x7f055c0cc840 2023-07-05T18:56:21.186 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.152+0000 7f0558ff9700 1 -- 172.21.15.46:0/3381999807 <== mon.1 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f054c011d40 con 0x7f055c0cc840 2023-07-05T18:56:21.186 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.152+0000 7f0562833700 1 -- 172.21.15.46:0/3381999807 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f055c0b2c00 con 0x7f055c0cc840 2023-07-05T18:56:21.187 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.152+0000 7f0562833700 1 -- 172.21.15.46:0/3381999807 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f055c0b2880 con 0x7f055c0cc840 2023-07-05T18:56:21.187 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.152+0000 7f96fa4d2700 1 -- 172.21.15.46:0/1182503717 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f96e0004430 msgr2=0x7f96e00048f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-05T18:56:21.187 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.152+0000 7f96fa4d2700 1 --2- 172.21.15.46:0/1182503717 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f96e0004430 0x7f96e00048f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:21.187 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.152+0000 7f96fa4d2700 1 -- 172.21.15.46:0/1182503717 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f96e00050a0 msgr2=0x7f96e000ba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-05T18:56:21.187 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.152+0000 7f96fa4d2700 1 --2- 172.21.15.46:0/1182503717 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f96e00050a0 0x7f96e000ba10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:21.188 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.152+0000 7f96fa4d2700 1 -- 172.21.15.46:0/1182503717 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f96f4164a00 con 0x7f96e0003a00 2023-07-05T18:56:21.188 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.152+0000 7f96fa4d2700 1 --2- 172.21.15.46:0/1182503717 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f96e0003a00 0x7f96e0003e10 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f96f0001eb0 tx=0x7f96e0005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5d27b6c34002452a server_cookie=0 in_seq=0 out_seq=0 2023-07-05T18:56:21.188 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.153+0000 7f31c8810700 1 -- 172.21.15.46:0/3505627458 shutdown_connections 2023-07-05T18:56:21.188 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.153+0000 7f31c8810700 1 --2- 172.21.15.46:0/3505627458 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f31c4142480 0x7f31c40b41d0 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:21.188 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.153+0000 7f31c8810700 1 -- 172.21.15.46:0/3505627458 >> 172.21.15.46:0/3505627458 conn(0x7f31c406af10 msgr2=0x7f31c406b2e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-05T18:56:21.189 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.152+0000 7f5e8cda7700 1 -- start start 2023-07-05T18:56:21.189 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.153+0000 7f31c8810700 1 -- 172.21.15.46:0/3505627458 shutdown_connections 2023-07-05T18:56:21.190 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.153+0000 7f96f94d0700 1 -- 172.21.15.46:0/1182503717 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96f000cd30 con 0x7f96e0003a00 2023-07-05T18:56:21.190 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.153+0000 7f96f94d0700 1 -- 172.21.15.46:0/1182503717 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f96f000ce90 con 0x7f96e0003a00 2023-07-05T18:56:21.190 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.153+0000 7f96f94d0700 1 -- 172.21.15.46:0/1182503717 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96f0005ae0 con 0x7f96e0003a00 2023-07-05T18:56:21.190 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.154+0000 7f96fc736700 1 -- 172.21.15.46:0/1182503717 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f96e0003a00 msgr2=0x7f96e0003e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:56:21.190 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.154+0000 7f96fc736700 1 --2- 172.21.15.46:0/1182503717 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f96e0003a00 0x7f96e0003e10 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f96f0001eb0 tx=0x7f96e0005880 comp rx=0 tx=0).stop 2023-07-05T18:56:21.190 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.154+0000 7f96facd3700 1 -- 172.21.15.46:0/1182503717 reap_dead start 2023-07-05T18:56:21.190 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.154+0000 7f96fc736700 1 -- 172.21.15.46:0/1182503717 shutdown_connections 2023-07-05T18:56:21.191 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.154+0000 7f96fc736700 1 -- 172.21.15.46:0/1182503717 >> 172.21.15.46:0/1182503717 conn(0x7f96f40b0fc0 msgr2=0x7f96f40ce860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-05T18:56:21.191 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.154+0000 7f96fc736700 1 -- 172.21.15.46:0/1182503717 shutdown_connections 2023-07-05T18:56:21.191 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.153+0000 7f31c8810700 1 -- 172.21.15.46:0/3505627458 wait complete. 2023-07-05T18:56:21.191 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.155+0000 7f31c8810700 1 Processor -- start 2023-07-05T18:56:21.192 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.153+0000 7f0562833700 1 -- 172.21.15.46:0/3381999807 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f053c000fc0 con 0x7f055c0cc840 2023-07-05T18:56:21.192 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.151+0000 7ff6a9d3c700 1 -- start start 2023-07-05T18:56:21.192 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.152+0000 7ff6a9d3c700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7ff6a4069e00 0x7ff6a41fe670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:56:21.192 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.152+0000 7ff6a9d3c700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff6a406c8e0 0x7ff6a4148fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:56:21.192 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.152+0000 7ff6a9d3c700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff6a41608f0 0x7ff6a4149500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:56:21.192 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.152+0000 7ff6a9d3c700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6a413d3d0 con 0x7ff6a41608f0 2023-07-05T18:56:21.193 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.152+0000 7ff6a9d3c700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6a40b06d0 con 0x7ff6a406c8e0 2023-07-05T18:56:21.193 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.152+0000 7ff6a9d3c700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff6a413cd30 con 0x7ff6a4069e00 2023-07-05T18:56:21.193 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.153+0000 7ff6a37fe700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7ff6a4069e00 0x7ff6a41fe670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:56:21.194 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.154+0000 7ff6a2ffd700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff6a406c8e0 0x7ff6a4148fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:56:21.194 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.154+0000 7ff6a2ffd700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff6a406c8e0 0x7ff6a4148fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.46:57360/0 (socket says 172.21.15.46:57360) 2023-07-05T18:56:21.194 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.154+0000 7ff6a2ffd700 1 -- 172.21.15.46:0/3269100102 learned_addr learned my addr 172.21.15.46:0/3269100102 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-07-05T18:56:21.194 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.154+0000 7ff6a37fe700 1 -- 172.21.15.46:0/3269100102 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff6a406c8e0 msgr2=0x7ff6a4148fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:56:21.194 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.154+0000 7ff6a37fe700 1 --2- 172.21.15.46:0/3269100102 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff6a406c8e0 0x7ff6a4148fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:21.194 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.154+0000 7ff6a37fe700 1 -- 172.21.15.46:0/3269100102 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff6a41608f0 msgr2=0x7ff6a4149500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:56:21.194 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.154+0000 7ff6a37fe700 1 --2- 172.21.15.46:0/3269100102 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff6a41608f0 0x7ff6a4149500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:21.195 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.154+0000 7ff6a37fe700 1 -- 172.21.15.46:0/3269100102 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff6940094a0 con 0x7ff6a4069e00 2023-07-05T18:56:21.195 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.154+0000 7ff6a37fe700 1 --2- 172.21.15.46:0/3269100102 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7ff6a4069e00 0x7ff6a41fe670 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7ff69c002070 tx=0x7ff69c00a340 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-05T18:56:21.195 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.155+0000 7ff68bfff700 1 -- 172.21.15.46:0/3269100102 <== mon.2 v2:172.21.15.73:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff69c00ae40 con 0x7ff6a4069e00 2023-07-05T18:56:21.195 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.155+0000 7ff68bfff700 1 -- 172.21.15.46:0/3269100102 <== mon.2 v2:172.21.15.73:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff69c0070d0 con 0x7ff6a4069e00 2023-07-05T18:56:21.195 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.155+0000 7ff68bfff700 1 -- 172.21.15.46:0/3269100102 <== mon.2 v2:172.21.15.73:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff69c007480 con 0x7ff6a4069e00 2023-07-05T18:56:21.195 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.155+0000 7ff6a9d3c700 1 -- 172.21.15.46:0/3269100102 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff6a40b03f0 con 0x7ff6a4069e00 2023-07-05T18:56:21.195 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.155+0000 7ff6a9d3c700 1 -- 172.21.15.46:0/3269100102 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff6a40af6c0 con 0x7ff6a4069e00 2023-07-05T18:56:21.196 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.153+0000 7f5e8cda7700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5e880b5ae0 0x7f5e88070a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:56:21.196 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.153+0000 7f5e8cda7700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5e8815c2f0 0x7f5e88158a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:56:21.196 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.153+0000 7f5e8cda7700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f5e8815c6c0 0x7f5e881f3db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:56:21.196 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.153+0000 7f5e8cda7700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e881f3990 con 0x7f5e880b5ae0 2023-07-05T18:56:21.196 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.153+0000 7f5e8cda7700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e88070fd0 con 0x7f5e8815c2f0 2023-07-05T18:56:21.197 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.153+0000 7f5e8cda7700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5e881f2d10 con 0x7f5e8815c6c0 2023-07-05T18:56:21.197 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.153+0000 7f5e8659c700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5e880b5ae0 0x7f5e88070a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:56:21.197 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.153+0000 7f5e8659c700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5e880b5ae0 0x7f5e88070a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:57870/0 (socket says 172.21.15.46:57870) 2023-07-05T18:56:21.197 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.153+0000 7f5e8659c700 1 -- 172.21.15.46:0/3828466446 learned_addr learned my addr 172.21.15.46:0/3828466446 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-07-05T18:56:21.197 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.154+0000 7f5e8659c700 1 -- 172.21.15.46:0/3828466446 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f5e8815c6c0 msgr2=0x7f5e881f3db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:56:21.197 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.154+0000 7f5e8659c700 1 --2- 172.21.15.46:0/3828466446 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f5e8815c6c0 0x7f5e881f3db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:21.198 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.154+0000 7f5e8659c700 1 -- 172.21.15.46:0/3828466446 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5e8815c2f0 msgr2=0x7f5e88158a30 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-07-05T18:56:21.198 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.154+0000 7f5e8659c700 1 --2- 172.21.15.46:0/3828466446 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5e8815c2f0 0x7f5e88158a30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:21.198 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.154+0000 7f5e8659c700 1 -- 172.21.15.46:0/3828466446 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5e80009b30 con 0x7f5e880b5ae0 2023-07-05T18:56:21.198 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.155+0000 7f5e8659c700 1 --2- 172.21.15.46:0/3828466446 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5e880b5ae0 0x7f5e88070a90 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f5e7c00b550 tx=0x7f5e7c00b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-05T18:56:21.198 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.155+0000 7f5e76ffd700 1 -- 172.21.15.46:0/3828466446 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e7c011830 con 0x7f5e880b5ae0 2023-07-05T18:56:21.199 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.155+0000 7f5e76ffd700 1 -- 172.21.15.46:0/3828466446 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5e7c011990 con 0x7f5e880b5ae0 2023-07-05T18:56:21.199 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.155+0000 7f5e76ffd700 1 -- 172.21.15.46:0/3828466446 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e7c011d40 con 0x7f5e880b5ae0 2023-07-05T18:56:21.199 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.154+0000 7f96fc736700 1 -- 172.21.15.46:0/1182503717 wait complete. 2023-07-05T18:56:21.199 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.156+0000 7f96fc736700 1 Processor -- start 2023-07-05T18:56:21.200 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.156+0000 7f96fc736700 1 -- start start 2023-07-05T18:56:21.200 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.155+0000 7f31c8810700 1 -- start start 2023-07-05T18:56:21.200 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.156+0000 7f31c8810700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f31c40b4710 0x7f31c41f97c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:56:21.200 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.157+0000 7f31c8810700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f31c413f4c0 0x7f31c40cdb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:56:21.200 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.157+0000 7f31c8810700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f31c4142480 0x7f31c41eff20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:56:21.200 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.157+0000 7f31c8810700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31c40ce080 con 0x7f31c413f4c0 2023-07-05T18:56:21.201 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.157+0000 7f31c8810700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31c40b14f0 con 0x7f31c4142480 2023-07-05T18:56:21.201 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.157+0000 7f31c8810700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f31c41f6300 con 0x7f31c40b4710 2023-07-05T18:56:21.201 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.157+0000 7f31c259c700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f31c40b4710 0x7f31c41f97c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:56:21.201 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.157+0000 7f31c259c700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f31c40b4710 0x7f31c41f97c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3301/0 says I am v2:172.21.15.46:41576/0 (socket says 172.21.15.46:41576) 2023-07-05T18:56:21.201 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.157+0000 7f31c259c700 1 -- 172.21.15.46:0/3502608859 learned_addr learned my addr 172.21.15.46:0/3502608859 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-07-05T18:56:21.201 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.157+0000 7f31c2d9d700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f31c4142480 0x7f31c41eff20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:56:21.202 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.155+0000 7f0558ff9700 1 -- 172.21.15.46:0/3381999807 <== mon.1 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f054c01a400 con 0x7f055c0cc840 2023-07-05T18:56:21.202 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.156+0000 7f0558ff9700 1 --2- 172.21.15.46:0/3381999807 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7f054806ace0 0x7f054806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:56:21.202 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.156+0000 7f0558ff9700 1 -- 172.21.15.46:0/3381999807 <== mon.1 v2:172.21.15.73:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f054c089a80 con 0x7f055c0cc840 2023-07-05T18:56:21.202 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.156+0000 7f055bfff700 1 --2- 172.21.15.46:0/3381999807 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7f054806ace0 0x7f054806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:56:21.202 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.156+0000 7f0558ff9700 1 --2- 172.21.15.46:0/3381999807 >> [v2:172.21.15.73:6800/2083655348,v1:172.21.15.73:6801/2083655348] conn(0x7f0548073590 0x7f05480759a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:56:21.202 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.156+0000 7f0558ff9700 1 -- 172.21.15.46:0/3381999807 --> [v2:172.21.15.73:6800/2083655348,v1:172.21.15.73:6801/2083655348] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f0548076050 con 0x7f0548073590 2023-07-05T18:56:21.203 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.156+0000 7f0558ff9700 1 -- 172.21.15.46:0/3381999807 <== mon.1 v2:172.21.15.73:3300/0 6 ==== mon_get_version_reply(handle=1 version=21) v2 ==== 24+0+0 (secure 0 0 0) 0x7f054c089e30 con 0x7f055c0cc840 2023-07-05T18:56:21.203 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.157+0000 7f0560dd0700 1 --2- 172.21.15.46:0/3381999807 >> [v2:172.21.15.73:6800/2083655348,v1:172.21.15.73:6801/2083655348] conn(0x7f0548073590 0x7f05480759a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:56:21.203 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.153+0000 7f1256c45700 1 Processor -- start 2023-07-05T18:56:21.203 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.154+0000 7f1256c45700 1 -- start start 2023-07-05T18:56:21.203 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.155+0000 7f1256c45700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f1250071690 0x7f12500ca520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:56:21.203 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.155+0000 7f1256c45700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f12500cdfb0 0x7f1250069e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:56:21.204 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.155+0000 7f1256c45700 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f125008adb0 con 0x7f12500712c0 2023-07-05T18:56:21.204 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.155+0000 7f1256c45700 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f12500cac20 con 0x7f12500cdfb0 2023-07-05T18:56:21.204 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.155+0000 7f1256c45700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f12500caf00 con 0x7f1250071690 2023-07-05T18:56:21.204 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.156+0000 7f12549e1700 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7f12500712c0 0x7f125016d720 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.46:43068/0 (socket says 172.21.15.46:43068) 2023-07-05T18:56:21.204 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.156+0000 7f12549e1700 1 -- 172.21.15.46:0/1340371873 learned_addr learned my addr 172.21.15.46:0/1340371873 (peer_addr_for_me v1:172.21.15.46:0/0) 2023-07-05T18:56:21.204 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.156+0000 7f12551e2700 1 --2- 172.21.15.46:0/1340371873 >> v2:172.21.15.73:3300/0 conn(0x7f12500cdfb0 0x7f1250069e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:56:21.204 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.157+0000 7f124f7fe700 1 -- 172.21.15.46:0/1340371873 <== mon.1 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 626393369 0 0) 0x7f125008adb0 con 0x7f12500712c0 2023-07-05T18:56:21.205 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.157+0000 7f124f7fe700 1 -- 172.21.15.46:0/1340371873 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f12400035b0 con 0x7f12500712c0 2023-07-05T18:56:21.205 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.157+0000 7f96fc736700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f96e0003a00 0x7f96f40b3ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:56:21.205 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.157+0000 7f96fc736700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f96f4160f70 0x7f96f4154910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:56:21.205 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.157+0000 7f96fc736700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f96f40cc760 0x7f96f40ccbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:56:21.206 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.157+0000 7f96fc736700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96f40cd110 con 0x7f96e0003a00 2023-07-05T18:56:21.206 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.157+0000 7f96fc736700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96f41613e0 con 0x7f96f40cc760 2023-07-05T18:56:21.206 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.157+0000 7f96fc736700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f96f4161670 con 0x7f96f4160f70 2023-07-05T18:56:21.206 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.157+0000 7f31c1d9b700 1 --2- 172.21.15.46:0/3502608859 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f31c413f4c0 0x7f31c40cdb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:56:21.206 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.157+0000 7f31c2d9d700 1 -- 172.21.15.46:0/3502608859 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f31c40b4710 msgr2=0x7f31c41f97c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:56:21.207 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.157+0000 7f31c2d9d700 1 --2- 172.21.15.46:0/3502608859 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f31c40b4710 0x7f31c41f97c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:21.207 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.157+0000 7f31c2d9d700 1 -- 172.21.15.46:0/3502608859 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f31c413f4c0 msgr2=0x7f31c40cdb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:56:21.207 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.157+0000 7f31c2d9d700 1 --2- 172.21.15.46:0/3502608859 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f31c413f4c0 0x7f31c40cdb40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:21.207 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.157+0000 7f31c2d9d700 1 -- 172.21.15.46:0/3502608859 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f31b400b7f0 con 0x7f31c4142480 2023-07-05T18:56:21.207 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.157+0000 7f055bfff700 1 --2- 172.21.15.46:0/3381999807 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7f054806ace0 0x7f054806d190 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f0550006fd0 tx=0x7f0550008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-05T18:56:21.208 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.157+0000 7f124f7fe700 1 -- 172.21.15.46:0/1340371873 <== mon.1 v1:172.21.15.73:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 779655375 0 0) 0x7f12400035b0 con 0x7f12500712c0 2023-07-05T18:56:21.208 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.157+0000 7f124f7fe700 1 -- 172.21.15.46:0/1340371873 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f1250071690 msgr2=0x7f12500ca520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-05T18:56:21.208 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.157+0000 7f124f7fe700 1 --2- 172.21.15.46:0/1340371873 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f1250071690 0x7f12500ca520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:21.208 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.157+0000 7f124f7fe700 1 -- 172.21.15.46:0/1340371873 >> v2:172.21.15.73:3300/0 conn(0x7f12500cdfb0 msgr2=0x7f1250069e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-05T18:56:21.208 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.157+0000 7f124f7fe700 1 --2- 172.21.15.46:0/1340371873 >> v2:172.21.15.73:3300/0 conn(0x7f12500cdfb0 0x7f1250069e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:21.208 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.157+0000 7f124f7fe700 1 -- 172.21.15.46:0/1340371873 --> v1:172.21.15.73:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f125016cf20 con 0x7f12500712c0 2023-07-05T18:56:21.209 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.157+0000 7f124f7fe700 1 -- 172.21.15.46:0/1340371873 <== mon.1 v1:172.21.15.73:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2195585215 0 0) 0x7f1244001670 con 0x7f12500712c0 2023-07-05T18:56:21.209 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.157+0000 7f124f7fe700 1 -- 172.21.15.46:0/1340371873 >> v1:172.21.15.73:6789/0 conn(0x7f12500712c0 legacy=0x7f125016d720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:56:21.209 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.157+0000 7f124f7fe700 1 --2- 172.21.15.46:0/1340371873 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f1240003a00 0x7f1240003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:56:21.209 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.157+0000 7f124f7fe700 1 --2- 172.21.15.46:0/1340371873 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f12400043e0 0x7f12400048b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:56:21.209 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.157+0000 7f124f7fe700 1 --2- 172.21.15.46:0/1340371873 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1240004df0 0x7f1240005260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:56:21.209 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.157+0000 7f124f7fe700 1 -- 172.21.15.46:0/1340371873 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12500cac20 con 0x7f1240004df0 2023-07-05T18:56:21.209 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.157+0000 7f124f7fe700 1 -- 172.21.15.46:0/1340371873 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12500caf00 con 0x7f12400043e0 2023-07-05T18:56:21.210 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.157+0000 7f124f7fe700 1 -- 172.21.15.46:0/1340371873 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1240014850 con 0x7f1240003a00 2023-07-05T18:56:21.210 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.158+0000 7f96facd3700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f96f40cc760 0x7f96f40ccbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:56:21.210 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.158+0000 7f96facd3700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f96f40cc760 0x7f96f40ccbd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.46:57386/0 (socket says 172.21.15.46:57386) 2023-07-05T18:56:21.210 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.158+0000 7f96facd3700 1 -- 172.21.15.46:0/1222774497 learned_addr learned my addr 172.21.15.46:0/1222774497 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-07-05T18:56:21.210 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.158+0000 7f96f9cd1700 1 --2- 172.21.15.46:0/1222774497 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f96f4160f70 0x7f96f4154910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:56:21.211 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.158+0000 7f96facd3700 1 -- 172.21.15.46:0/1222774497 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f96f4160f70 msgr2=0x7f96f4154910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:56:21.211 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.158+0000 7f96facd3700 1 --2- 172.21.15.46:0/1222774497 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f96f4160f70 0x7f96f4154910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:21.211 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.158+0000 7f96facd3700 1 -- 172.21.15.46:0/1222774497 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f96e0003a00 msgr2=0x7f96f40b3ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:56:21.211 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.158+0000 7f96facd3700 1 --2- 172.21.15.46:0/1222774497 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f96e0003a00 0x7f96f40b3ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:21.211 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.158+0000 7f96facd3700 1 -- 172.21.15.46:0/1222774497 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f96f4161950 con 0x7f96f40cc760 2023-07-05T18:56:21.211 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.158+0000 7f31c2d9d700 1 --2- 172.21.15.46:0/3502608859 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f31c4142480 0x7f31c41eff20 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f31bc00cae0 tx=0x7f31bc00cdf0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-05T18:56:21.212 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.158+0000 7ff6a9d3c700 1 -- 172.21.15.46:0/3269100102 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7ff684000fc0 con 0x7ff6a4069e00 2023-07-05T18:56:21.212 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.157+0000 7f5e8cda7700 1 -- 172.21.15.46:0/3828466446 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5e881f2ff0 con 0x7f5e880b5ae0 2023-07-05T18:56:21.213 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.157+0000 7f5e8cda7700 1 -- 172.21.15.46:0/3828466446 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5e881f35b0 con 0x7f5e880b5ae0 2023-07-05T18:56:21.213 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.158+0000 7f12549e1700 1 --2- 172.21.15.46:0/1340371873 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f1240003a00 0x7f1240003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:56:21.213 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.158+0000 7f124ffff700 1 --2- 172.21.15.46:0/1340371873 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f12400043e0 0x7f12400048b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:56:21.213 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.158+0000 7f12551e2700 1 --2- 172.21.15.46:0/1340371873 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1240004df0 0x7f1240005260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:56:21.214 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.158+0000 7f12549e1700 1 -- 172.21.15.46:0/1340371873 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f12400043e0 msgr2=0x7f12400048b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-05T18:56:21.214 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.158+0000 7f12549e1700 1 --2- 172.21.15.46:0/1340371873 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f12400043e0 0x7f12400048b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:21.214 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.158+0000 7f12549e1700 1 -- 172.21.15.46:0/1340371873 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1240004df0 msgr2=0x7f1240005260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-05T18:56:21.214 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.158+0000 7f12549e1700 1 --2- 172.21.15.46:0/1340371873 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1240004df0 0x7f1240005260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:21.214 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.158+0000 7f12549e1700 1 -- 172.21.15.46:0/1340371873 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f125016cf20 con 0x7f1240003a00 2023-07-05T18:56:21.215 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.158+0000 7f96facd3700 1 --2- 172.21.15.46:0/1222774497 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f96f40cc760 0x7f96f40ccbd0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f96f40cf640 tx=0x7f96e4011b40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-05T18:56:21.215 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.158+0000 7f0560dd0700 1 --2- 172.21.15.46:0/3381999807 >> [v2:172.21.15.73:6800/2083655348,v1:172.21.15.73:6801/2083655348] conn(0x7f0548073590 0x7f05480759a0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-05T18:56:21.215 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.158+0000 7f12549e1700 1 --2- 172.21.15.46:0/1340371873 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f1240003a00 0x7f1240003e10 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f124400c340 tx=0x7f1240005880 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6515dbe767da75b4 server_cookie=0 in_seq=0 out_seq=0 2023-07-05T18:56:21.216 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.158+0000 7f31b2ffd700 1 -- 172.21.15.46:0/3502608859 <== mon.1 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31bc003c00 con 0x7f31c4142480 2023-07-05T18:56:21.216 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.158+0000 7f31b2ffd700 1 -- 172.21.15.46:0/3502608859 <== mon.1 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f31bc003d60 con 0x7f31c4142480 2023-07-05T18:56:21.216 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.158+0000 7f31b2ffd700 1 -- 172.21.15.46:0/3502608859 <== mon.1 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31bc00aaa0 con 0x7f31c4142480 2023-07-05T18:56:21.217 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.159+0000 7ff68bfff700 1 -- 172.21.15.46:0/3269100102 <== mon.2 v2:172.21.15.73:3301/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7ff69c0075e0 con 0x7ff6a4069e00 2023-07-05T18:56:21.217 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.159+0000 7f31c8810700 1 -- 172.21.15.46:0/3502608859 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f31c41f9da0 con 0x7f31c4142480 2023-07-05T18:56:21.217 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.159+0000 7f31c8810700 1 -- 172.21.15.46:0/3502608859 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f31c41fa360 con 0x7f31c4142480 2023-07-05T18:56:21.217 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.160+0000 7f31c8810700 1 -- 172.21.15.46:0/3502608859 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f31a8000fc0 con 0x7f31c4142480 2023-07-05T18:56:21.218 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.159+0000 7f96eaffd700 1 -- 172.21.15.46:0/1222774497 <== mon.1 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96e4004240 con 0x7f96f40cc760 2023-07-05T18:56:21.218 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.159+0000 7f96eaffd700 1 -- 172.21.15.46:0/1222774497 <== mon.1 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f96e40043c0 con 0x7f96f40cc760 2023-07-05T18:56:21.218 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.159+0000 7f96eaffd700 1 -- 172.21.15.46:0/1222774497 <== mon.1 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96e40038e0 con 0x7f96f40cc760 2023-07-05T18:56:21.218 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.159+0000 7f96fc736700 1 -- 172.21.15.46:0/1222774497 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f96f4161c30 con 0x7f96f40cc760 2023-07-05T18:56:21.218 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.159+0000 7f96fc736700 1 -- 172.21.15.46:0/1222774497 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f96f41621f0 con 0x7f96f40cc760 2023-07-05T18:56:21.219 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.160+0000 7f5e8cda7700 1 -- 172.21.15.46:0/3828466446 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f5e880cdba0 con 0x7f5e880b5ae0 2023-07-05T18:56:21.219 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.160+0000 7f124f7fe700 1 -- 172.21.15.46:0/1340371873 <== mon.2 v2:172.21.15.73:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f124400ce40 con 0x7f1240003a00 2023-07-05T18:56:21.219 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.160+0000 7f124f7fe700 1 -- 172.21.15.46:0/1340371873 <== mon.2 v2:172.21.15.73:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1244005960 con 0x7f1240003a00 2023-07-05T18:56:21.219 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.160+0000 7f124f7fe700 1 -- 172.21.15.46:0/1340371873 <== mon.2 v2:172.21.15.73:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1244005d10 con 0x7f1240003a00 2023-07-05T18:56:21.220 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.160+0000 7ff68bfff700 1 --2- 172.21.15.46:0/3269100102 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7ff69006ace0 0x7ff69006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:56:21.220 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.160+0000 7ff68bfff700 1 -- 172.21.15.46:0/3269100102 <== mon.2 v2:172.21.15.73:3301/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6062+0+0 (secure 0 0 0) 0x7ff69c089070 con 0x7ff6a4069e00 2023-07-05T18:56:21.221 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.160+0000 7ff68bfff700 1 --2- 172.21.15.46:0/3269100102 >> [v2:172.21.15.73:6824/2803788401,v1:172.21.15.73:6825/2803788401] conn(0x7ff690073510 0x7ff690075920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:56:21.221 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.160+0000 7ff68bfff700 1 -- 172.21.15.46:0/3269100102 --> [v2:172.21.15.73:6824/2803788401,v1:172.21.15.73:6825/2803788401] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7ff690075fd0 con 0x7ff690073510 2023-07-05T18:56:21.221 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.160+0000 7f0558ff9700 1 -- 172.21.15.46:0/3381999807 <== osd.4 v2:172.21.15.73:6800/2083655348 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7f0548076050 con 0x7f0548073590 2023-07-05T18:56:21.222 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.160+0000 7ff68bfff700 1 -- 172.21.15.46:0/3269100102 <== mon.2 v2:172.21.15.73:3301/0 6 ==== mon_get_version_reply(handle=1 version=21) v2 ==== 24+0+0 (secure 0 0 0) 0x7ff69c054080 con 0x7ff6a4069e00 2023-07-05T18:56:21.222 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.160+0000 7ff6a2ffd700 1 --2- 172.21.15.46:0/3269100102 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7ff69006ace0 0x7ff69006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:56:21.222 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.161+0000 7f1256c45700 1 -- 172.21.15.46:0/1340371873 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f1240003a00 msgr2=0x7f1240003e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:56:21.222 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.161+0000 7f1256c45700 1 --2- 172.21.15.46:0/1340371873 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f1240003a00 0x7f1240003e10 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f124400c340 tx=0x7f1240005880 comp rx=0 tx=0).stop 2023-07-05T18:56:21.223 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.161+0000 7ff6a3fff700 1 --2- 172.21.15.46:0/3269100102 >> [v2:172.21.15.73:6824/2803788401,v1:172.21.15.73:6825/2803788401] conn(0x7ff690073510 0x7ff690075920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:56:21.223 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.161+0000 7f96fc736700 1 -- 172.21.15.46:0/1222774497 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f96dc000fc0 con 0x7f96f40cc760 2023-07-05T18:56:21.223 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.161+0000 7f12551e2700 1 -- 172.21.15.46:0/1340371873 reap_dead start 2023-07-05T18:56:21.224 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.161+0000 7ff6a2ffd700 1 --2- 172.21.15.46:0/3269100102 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7ff69006ace0 0x7ff69006d190 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7ff6a415e840 tx=0x7ff694008030 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-05T18:56:21.224 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.161+0000 7f5e76ffd700 1 -- 172.21.15.46:0/3828466446 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f5e7c01a400 con 0x7f5e880b5ae0 2023-07-05T18:56:21.224 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.162+0000 7f5e76ffd700 1 --2- 172.21.15.46:0/3828466446 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7f5e6806ad30 0x7f5e6806d1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:56:21.225 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.162+0000 7f31b2ffd700 1 -- 172.21.15.46:0/3502608859 <== mon.1 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f31bc00ac00 con 0x7f31c4142480 2023-07-05T18:56:21.225 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.162+0000 7ff6a3fff700 1 --2- 172.21.15.46:0/3269100102 >> [v2:172.21.15.73:6824/2803788401,v1:172.21.15.73:6825/2803788401] conn(0x7ff690073510 0x7ff690075920 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-05T18:56:21.225 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.162+0000 7f1256c45700 1 -- 172.21.15.46:0/1340371873 shutdown_connections 2023-07-05T18:56:21.225 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.162+0000 7f1256c45700 1 -- 172.21.15.46:0/1340371873 >> 172.21.15.46:0/1340371873 conn(0x7f12500ce860 msgr2=0x7f12500cec30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-05T18:56:21.226 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.162+0000 7f5e76ffd700 1 -- 172.21.15.46:0/3828466446 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f5e7c089430 con 0x7f5e880b5ae0 2023-07-05T18:56:21.226 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.162+0000 7f96eaffd700 1 -- 172.21.15.46:0/1222774497 <== mon.1 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f96e4003a40 con 0x7f96f40cc760 2023-07-05T18:56:21.226 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.162+0000 7f96eaffd700 1 --2- 172.21.15.46:0/1222774497 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7f96d806ad30 0x7f96d806d1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:56:21.226 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.163+0000 7f96eaffd700 1 -- 172.21.15.46:0/1222774497 <== mon.1 v2:172.21.15.73:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f96e4089440 con 0x7f96f40cc760 2023-07-05T18:56:21.227 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.162+0000 7f31b2ffd700 1 --2- 172.21.15.46:0/3502608859 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7f31a406adb0 0x7f31a406d260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:56:21.227 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.162+0000 7f31b2ffd700 1 -- 172.21.15.46:0/3502608859 <== mon.1 v2:172.21.15.73:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f31bc089de0 con 0x7f31c4142480 2023-07-05T18:56:21.227 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.162+0000 7f31b2ffd700 1 --2- 172.21.15.46:0/3502608859 >> [v2:172.21.15.46:6800/2115251461,v1:172.21.15.46:6801/2115251461] conn(0x7f31a4073660 0x7f31a4075a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:56:21.227 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.162+0000 7f31b2ffd700 1 -- 172.21.15.46:0/3502608859 --> [v2:172.21.15.46:6800/2115251461,v1:172.21.15.46:6801/2115251461] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f31a4076120 con 0x7f31a4073660 2023-07-05T18:56:21.227 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.162+0000 7f31b2ffd700 1 -- 172.21.15.46:0/3502608859 <== mon.1 v2:172.21.15.73:3300/0 6 ==== mon_get_version_reply(handle=1 version=21) v2 ==== 24+0+0 (secure 0 0 0) 0x7f31bc08a190 con 0x7f31c4142480 2023-07-05T18:56:21.227 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.163+0000 7f31c259c700 1 --2- 172.21.15.46:0/3502608859 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7f31a406adb0 0x7f31a406d260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:56:21.228 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.162+0000 7f5e76ffd700 1 --2- 172.21.15.46:0/3828466446 >> [v2:172.21.15.73:6808/974108383,v1:172.21.15.73:6809/974108383] conn(0x7f5e680735e0 0x7f5e680759f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:56:21.228 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.162+0000 7f5e76ffd700 1 -- 172.21.15.46:0/3828466446 --> [v2:172.21.15.73:6808/974108383,v1:172.21.15.73:6809/974108383] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f5e680760a0 con 0x7f5e680735e0 2023-07-05T18:56:21.228 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.162+0000 7f5e76ffd700 1 -- 172.21.15.46:0/3828466446 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_get_version_reply(handle=1 version=21) v2 ==== 24+0+0 (secure 0 0 0) 0x7f5e7c08bb40 con 0x7f5e880b5ae0 2023-07-05T18:56:21.228 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.162+0000 7f5e85d9b700 1 --2- 172.21.15.46:0/3828466446 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7f5e6806ad30 0x7f5e6806d1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:56:21.228 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.162+0000 7f1256c45700 1 -- 172.21.15.46:0/1340371873 shutdown_connections 2023-07-05T18:56:21.229 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.162+0000 7f1256c45700 1 -- 172.21.15.46:0/1340371873 wait complete. 2023-07-05T18:56:21.229 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.162+0000 7f5e86d9d700 1 --2- 172.21.15.46:0/3828466446 >> [v2:172.21.15.73:6808/974108383,v1:172.21.15.73:6809/974108383] conn(0x7f5e680735e0 0x7f5e680759f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:56:21.229 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.162+0000 7f5e86d9d700 1 --2- 172.21.15.46:0/3828466446 >> [v2:172.21.15.73:6808/974108383,v1:172.21.15.73:6809/974108383] conn(0x7f5e680735e0 0x7f5e680759f0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-05T18:56:21.229 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.163+0000 7f96eaffd700 1 --2- 172.21.15.46:0/1222774497 >> [v2:172.21.15.46:6808/502575881,v1:172.21.15.46:6809/502575881] conn(0x7f96d80735e0 0x7f96d80759f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:56:21.230 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.163+0000 7f96fa4d2700 1 --2- 172.21.15.46:0/1222774497 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7f96d806ad30 0x7f96d806d1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:56:21.230 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.163+0000 7f96eaffd700 1 -- 172.21.15.46:0/1222774497 --> [v2:172.21.15.46:6808/502575881,v1:172.21.15.46:6809/502575881] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f96d80760a0 con 0x7f96d80735e0 2023-07-05T18:56:21.230 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.163+0000 7f96eaffd700 1 -- 172.21.15.46:0/1222774497 <== mon.1 v2:172.21.15.73:3300/0 6 ==== mon_get_version_reply(handle=1 version=21) v2 ==== 24+0+0 (secure 0 0 0) 0x7f96e408bb50 con 0x7f96f40cc760 2023-07-05T18:56:21.230 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.163+0000 7fc365071700 1 Processor -- start 2023-07-05T18:56:21.230 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.163+0000 7fc365071700 1 -- start start 2023-07-05T18:56:21.231 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.164+0000 7fc365071700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fc36006a510 0x7fc3601646d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:56:21.231 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.164+0000 7fc365071700 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc3600c1f00 con 0x7fc3600cdfb0 2023-07-05T18:56:21.231 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.164+0000 7fc365071700 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc3600ae030 con 0x7fc3601609d0 2023-07-05T18:56:21.231 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.164+0000 7fc365071700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc360070ec0 con 0x7fc36006a510 2023-07-05T18:56:21.231 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.164+0000 7fc35e59c700 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7fc3600cdfb0 0x7fc360069e00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:57198/0 (socket says 172.21.15.46:57198) 2023-07-05T18:56:21.231 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.165+0000 7fc35e59c700 1 -- 172.21.15.46:0/2863116334 learned_addr learned my addr 172.21.15.46:0/2863116334 (peer_addr_for_me v1:172.21.15.46:0/0) 2023-07-05T18:56:21.232 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.165+0000 7fc35f59e700 1 --2- 172.21.15.46:0/2863116334 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fc36006a510 0x7fc3601646d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:56:21.232 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.163+0000 7f96f9cd1700 1 --2- 172.21.15.46:0/1222774497 >> [v2:172.21.15.46:6808/502575881,v1:172.21.15.46:6809/502575881] conn(0x7f96d80735e0 0x7f96d80759f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:56:21.232 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.164+0000 7f96fa4d2700 1 --2- 172.21.15.46:0/1222774497 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7f96d806ad30 0x7f96d806d1e0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f96f0000c00 tx=0x7f96f000f000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-05T18:56:21.232 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.164+0000 7f96f9cd1700 1 --2- 172.21.15.46:0/1222774497 >> [v2:172.21.15.46:6808/502575881,v1:172.21.15.46:6809/502575881] conn(0x7f96d80735e0 0x7f96d80759f0 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-05T18:56:21.233 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.164+0000 7f912aa31700 1 Processor -- start 2023-07-05T18:56:21.233 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.164+0000 7f912aa31700 1 -- start start 2023-07-05T18:56:21.233 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.165+0000 7f912aa31700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f912406f5b0 0x7f912406f980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:56:21.233 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.165+0000 7f912aa31700 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f91240c9400 con 0x7f91240ca150 2023-07-05T18:56:21.234 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.163+0000 7ff68bfff700 1 -- 172.21.15.46:0/3269100102 <== osd.5 v2:172.21.15.73:6824/2803788401 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7ff690075fd0 con 0x7ff690073510 2023-07-05T18:56:21.234 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.164+0000 7f5e76ffd700 1 -- 172.21.15.46:0/3828466446 <== osd.6 v2:172.21.15.73:6808/974108383 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7f5e680760a0 con 0x7f5e680735e0 2023-07-05T18:56:21.234 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.164+0000 7f1256c45700 1 Processor -- start 2023-07-05T18:56:21.235 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.165+0000 7f912aa31700 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f91240cdd60 con 0x7f91240cc840 2023-07-05T18:56:21.235 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.165+0000 7f912aa31700 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f912406fec0 con 0x7f912406f5b0 2023-07-05T18:56:21.235 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.164+0000 7f1256c45700 1 -- start start 2023-07-05T18:56:21.235 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.165+0000 7f1256c45700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f1240003a00 0x7f1250168e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:56:21.235 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.165+0000 7f1256c45700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f12500c83b0 0x7f12500c9c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:56:21.236 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.165+0000 7f1256c45700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f12501fecf0 0x7f12501ff190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:56:21.236 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.165+0000 7f1256c45700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12500c5e00 con 0x7f12501fecf0 2023-07-05T18:56:21.236 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.165+0000 7f1256c45700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12500c8820 con 0x7f12500c83b0 2023-07-05T18:56:21.236 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.165+0000 7f1256c45700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f125006d700 con 0x7f1240003a00 2023-07-05T18:56:21.236 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.165+0000 7f124ffff700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f12500c83b0 0x7f12500c9c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:56:21.236 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.165+0000 7f124ffff700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f12500c83b0 0x7f12500c9c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.46:57414/0 (socket says 172.21.15.46:57414) 2023-07-05T18:56:21.236 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.165+0000 7f124ffff700 1 -- 172.21.15.46:0/2477797282 learned_addr learned my addr 172.21.15.46:0/2477797282 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-07-05T18:56:21.237 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.165+0000 7f12549e1700 1 --2- 172.21.15.46:0/2477797282 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f1240003a00 0x7f1250168e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:56:21.237 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.165+0000 7f12551e2700 1 --2- 172.21.15.46:0/2477797282 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f12501fecf0 0x7f12501ff190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:56:21.237 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.165+0000 7f91237fe700 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7f91240cc840 0x7f91240cd650 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.46:43124/0 (socket says 172.21.15.46:43124) 2023-07-05T18:56:21.237 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.165+0000 7f91237fe700 1 -- 172.21.15.46:0/2523365728 learned_addr learned my addr 172.21.15.46:0/2523365728 (peer_addr_for_me v1:172.21.15.46:0/0) 2023-07-05T18:56:21.238 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.166+0000 7fc35f59e700 1 -- 172.21.15.46:0/2863116334 >> v1:172.21.15.73:6789/0 conn(0x7fc3601609d0 legacy=0x7fc3600ad750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:56:21.238 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.166+0000 7fc35f59e700 1 -- 172.21.15.46:0/2863116334 >> v1:172.21.15.46:6789/0 conn(0x7fc3600cdfb0 legacy=0x7fc360069e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:56:21.238 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.166+0000 7fc35f59e700 1 -- 172.21.15.46:0/2863116334 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc3600711a0 con 0x7fc36006a510 2023-07-05T18:56:21.238 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.166+0000 7f9122ffd700 1 -- 172.21.15.46:0/2523365728 <== mon.1 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 212691940 0 0) 0x7f91240cdd60 con 0x7f91240cc840 2023-07-05T18:56:21.239 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.166+0000 7f9122ffd700 1 -- 172.21.15.46:0/2523365728 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f910c0057c0 con 0x7f91240cc840 2023-07-05T18:56:21.239 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.166+0000 7f9123fff700 1 --2- 172.21.15.46:0/2523365728 >> v2:172.21.15.73:3300/0 conn(0x7f912406f5b0 0x7f912406f980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:56:21.239 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.166+0000 7fc35f59e700 1 --2- 172.21.15.46:0/2863116334 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fc36006a510 0x7fc3601646d0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fc350009870 tx=0x7fc350009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3f3fd5a072c5a612 server_cookie=0 in_seq=0 out_seq=0 2023-07-05T18:56:21.240 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.166+0000 7f9122ffd700 1 -- 172.21.15.46:0/2523365728 <== mon.1 v1:172.21.15.73:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1827855642 0 0) 0x7f910c0057c0 con 0x7f91240cc840 2023-07-05T18:56:21.240 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.166+0000 7f9122ffd700 1 -- 172.21.15.46:0/2523365728 >> v2:172.21.15.73:3300/0 conn(0x7f912406f5b0 msgr2=0x7f912406f980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-05T18:56:21.240 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.166+0000 7f9122ffd700 1 --2- 172.21.15.46:0/2523365728 >> v2:172.21.15.73:3300/0 conn(0x7f912406f5b0 0x7f912406f980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:21.240 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.166+0000 7f9122ffd700 1 -- 172.21.15.46:0/2523365728 >> v1:172.21.15.46:6789/0 conn(0x7f91240ca150 legacy=0x7f91240ca5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-05T18:56:21.240 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.166+0000 7f9122ffd700 1 -- 172.21.15.46:0/2523365728 --> v1:172.21.15.73:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f91241596a0 con 0x7f91240cc840 2023-07-05T18:56:21.241 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.166+0000 7f9122ffd700 1 -- 172.21.15.46:0/2523365728 <== mon.1 v1:172.21.15.73:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2195585215 0 0) 0x7f9118001670 con 0x7f91240cc840 2023-07-05T18:56:21.241 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.166+0000 7f9122ffd700 1 -- 172.21.15.46:0/2523365728 >> v1:172.21.15.73:6789/0 conn(0x7f91240cc840 legacy=0x7f91240cd650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:56:21.241 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.166+0000 7f9122ffd700 1 --2- 172.21.15.46:0/2523365728 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f910c005c10 0x7f910c006000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:56:21.241 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.166+0000 7f9122ffd700 1 --2- 172.21.15.46:0/2523365728 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f910c006a60 0x7f910c006ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:56:21.241 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.166+0000 7f9122ffd700 1 --2- 172.21.15.46:0/2523365728 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f910c007410 0x7f910c00dc20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:56:21.241 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.166+0000 7f9122ffd700 1 -- 172.21.15.46:0/2523365728 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f912406fec0 con 0x7f910c005c10 2023-07-05T18:56:21.241 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.166+0000 7f9122ffd700 1 -- 172.21.15.46:0/2523365728 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f910c00e270 con 0x7f910c007410 2023-07-05T18:56:21.241 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.166+0000 7f9122ffd700 1 -- 172.21.15.46:0/2523365728 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f910c00e430 con 0x7f910c006a60 2023-07-05T18:56:21.242 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.167+0000 7f91237fe700 1 --2- 172.21.15.46:0/2523365728 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f910c006a60 0x7f910c006ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:56:21.242 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.167+0000 7f9123fff700 1 --2- 172.21.15.46:0/2523365728 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f910c005c10 0x7f910c006000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:56:21.242 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.167+0000 7f96eaffd700 1 -- 172.21.15.46:0/1222774497 <== osd.1 v2:172.21.15.46:6808/502575881 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7f96d80760a0 con 0x7f96d80735e0 2023-07-05T18:56:21.242 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.163+0000 7f31c259c700 1 --2- 172.21.15.46:0/3502608859 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7f31a406adb0 0x7f31a406d260 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f31c40b44b0 tx=0x7f31b8009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-05T18:56:21.243 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.168+0000 7fc35dd9b700 1 -- 172.21.15.46:0/2863116334 <== mon.2 v2:172.21.15.73:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc350004230 con 0x7fc36006a510 2023-07-05T18:56:21.243 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.168+0000 7fc35dd9b700 1 -- 172.21.15.46:0/2863116334 <== mon.2 v2:172.21.15.73:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc350004390 con 0x7fc36006a510 2023-07-05T18:56:21.243 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.168+0000 7fc35dd9b700 1 -- 172.21.15.46:0/2863116334 <== mon.2 v2:172.21.15.73:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3500036a0 con 0x7fc36006a510 2023-07-05T18:56:21.243 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.167+0000 7f9123fff700 1 -- 172.21.15.46:0/2523365728 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f910c006a60 msgr2=0x7f910c006ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-05T18:56:21.244 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.167+0000 7f9123fff700 1 --2- 172.21.15.46:0/2523365728 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f910c006a60 0x7f910c006ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:21.244 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.167+0000 7f9123fff700 1 -- 172.21.15.46:0/2523365728 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f910c007410 msgr2=0x7f910c00dc20 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-07-05T18:56:21.244 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.167+0000 7f9123fff700 1 --2- 172.21.15.46:0/2523365728 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f910c007410 0x7f910c00dc20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:21.244 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.167+0000 7f9123fff700 1 -- 172.21.15.46:0/2523365728 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f91241596a0 con 0x7f910c005c10 2023-07-05T18:56:21.244 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.167+0000 7f9123fff700 1 --2- 172.21.15.46:0/2523365728 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f910c005c10 0x7f910c006000 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f91140096d0 tx=0x7f910c007a90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5637030492738bd5 server_cookie=0 in_seq=0 out_seq=0 2023-07-05T18:56:21.244 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.168+0000 7f9122ffd700 1 -- 172.21.15.46:0/2523365728 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9114004020 con 0x7f910c005c10 2023-07-05T18:56:21.245 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.168+0000 7f9128fce700 1 -- 172.21.15.46:0/2523365728 reap_dead start 2023-07-05T18:56:21.245 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.168+0000 7f9122ffd700 1 -- 172.21.15.46:0/2523365728 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9114004180 con 0x7f910c005c10 2023-07-05T18:56:21.245 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.168+0000 7f9122ffd700 1 -- 172.21.15.46:0/2523365728 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91140044f0 con 0x7f910c005c10 2023-07-05T18:56:21.245 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.169+0000 7f912aa31700 1 -- 172.21.15.46:0/2523365728 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f910c005c10 msgr2=0x7f910c006000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:56:21.245 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.169+0000 7f912aa31700 1 --2- 172.21.15.46:0/2523365728 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f910c005c10 0x7f910c006000 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f91140096d0 tx=0x7f910c007a90 comp rx=0 tx=0).stop 2023-07-05T18:56:21.245 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.169+0000 7fc365071700 1 -- 172.21.15.46:0/2863116334 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fc36006a510 msgr2=0x7fc3601646d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:56:21.246 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.169+0000 7fc365071700 1 --2- 172.21.15.46:0/2863116334 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fc36006a510 0x7fc3601646d0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fc350009870 tx=0x7fc350009b80 comp rx=0 tx=0).stop 2023-07-05T18:56:21.246 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.169+0000 7f912aa31700 1 -- 172.21.15.46:0/2523365728 shutdown_connections 2023-07-05T18:56:21.246 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.169+0000 7f912aa31700 1 --2- 172.21.15.46:0/2523365728 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f910c005c10 0x7f910c006000 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:21.246 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.169+0000 7f912aa31700 1 -- 172.21.15.46:0/2523365728 >> 172.21.15.46:0/2523365728 conn(0x7f91240b0fc0 msgr2=0x7f91240ce860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-05T18:56:21.247 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.169+0000 7fc365071700 1 -- 172.21.15.46:0/2863116334 shutdown_connections 2023-07-05T18:56:21.247 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.169+0000 7fc365071700 1 --2- 172.21.15.46:0/2863116334 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fc36006a510 0x7fc3601646d0 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:21.247 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.169+0000 7fc365071700 1 -- 172.21.15.46:0/2863116334 >> 172.21.15.46:0/2863116334 conn(0x7fc3600ce860 msgr2=0x7fc3600cec30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-05T18:56:21.247 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.169+0000 7fc365071700 1 -- 172.21.15.46:0/2863116334 shutdown_connections 2023-07-05T18:56:21.247 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.169+0000 7fc365071700 1 -- 172.21.15.46:0/2863116334 wait complete. 2023-07-05T18:56:21.248 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.169+0000 7f912aa31700 1 -- 172.21.15.46:0/2523365728 shutdown_connections 2023-07-05T18:56:21.248 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.169+0000 7f912aa31700 1 -- 172.21.15.46:0/2523365728 wait complete. 2023-07-05T18:56:21.248 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.171+0000 7f912aa31700 1 Processor -- start 2023-07-05T18:56:21.249 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.172+0000 7fc365071700 1 Processor -- start 2023-07-05T18:56:21.249 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.172+0000 7fc365071700 1 -- start start 2023-07-05T18:56:21.249 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.172+0000 7f912aa31700 1 -- start start 2023-07-05T18:56:21.250 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.172+0000 7f912aa31700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f910c005c10 0x7f91240c6cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:56:21.250 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.172+0000 7f912aa31700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f91240c7710 0x7f91241ed7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:56:21.250 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.172+0000 7f912aa31700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f91240c5930 0x7f91240c5db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:56:21.250 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.172+0000 7f912aa31700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9124157630 con 0x7f910c005c10 2023-07-05T18:56:21.250 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.172+0000 7f912aa31700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91241ee050 con 0x7f91240c5930 2023-07-05T18:56:21.250 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.172+0000 7f912aa31700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f91241ee330 con 0x7f91240c7710 2023-07-05T18:56:21.250 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.173+0000 7f9123fff700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f910c005c10 0x7f91240c6cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:56:21.251 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.173+0000 7f31c1d9b700 1 --2- 172.21.15.46:0/3502608859 >> [v2:172.21.15.46:6800/2115251461,v1:172.21.15.46:6801/2115251461] conn(0x7f31a4073660 0x7f31a4075a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:56:21.251 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.173+0000 7fc365071700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fc36006a510 0x7fc36015b310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:56:21.251 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.173+0000 7fc365071700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc3600cdfb0 0x7fc36006c000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:56:21.251 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.173+0000 7fc365071700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc3601609d0 0x7fc36006c540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:56:21.252 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.173+0000 7fc365071700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3600c4d80 con 0x7fc3601609d0 2023-07-05T18:56:21.252 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.173+0000 7fc365071700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3600c4170 con 0x7fc3600cdfb0 2023-07-05T18:56:21.252 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.173+0000 7fc365071700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc3600c4450 con 0x7fc36006a510 2023-07-05T18:56:21.252 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.165+0000 7f124ffff700 1 -- 172.21.15.46:0/2477797282 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f1240003a00 msgr2=0x7f1250168e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:56:21.252 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.166+0000 7f124ffff700 1 --2- 172.21.15.46:0/2477797282 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f1240003a00 0x7f1250168e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:21.252 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.166+0000 7f124ffff700 1 -- 172.21.15.46:0/2477797282 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f12501fecf0 msgr2=0x7f12501ff190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:56:21.253 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.166+0000 7f124ffff700 1 --2- 172.21.15.46:0/2477797282 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f12501fecf0 0x7f12501ff190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:21.253 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.166+0000 7f124ffff700 1 -- 172.21.15.46:0/2477797282 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f125006d9e0 con 0x7f12500c83b0 2023-07-05T18:56:21.253 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.166+0000 7f12549e1700 1 --2- 172.21.15.46:0/2477797282 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f1240003a00 0x7f1250168e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-05T18:56:21.253 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.166+0000 7f12551e2700 1 --2- 172.21.15.46:0/2477797282 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f12501fecf0 0x7f12501ff190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-05T18:56:21.253 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.166+0000 7f124ffff700 1 --2- 172.21.15.46:0/2477797282 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f12500c83b0 0x7f12500c9c60 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f123c00d440 tx=0x7f123c00d800 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-05T18:56:21.253 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.166+0000 7f124d7fa700 1 -- 172.21.15.46:0/2477797282 <== mon.1 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f123c0125f0 con 0x7f12500c83b0 2023-07-05T18:56:21.253 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.166+0000 7f124d7fa700 1 -- 172.21.15.46:0/2477797282 <== mon.1 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f123c012750 con 0x7f12500c83b0 2023-07-05T18:56:21.253 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.166+0000 7f124d7fa700 1 -- 172.21.15.46:0/2477797282 <== mon.1 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f123c012b00 con 0x7f12500c83b0 2023-07-05T18:56:21.254 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.166+0000 7f1256c45700 1 -- 172.21.15.46:0/2477797282 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f12500c6050 con 0x7f12500c83b0 2023-07-05T18:56:21.254 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.167+0000 7f1256c45700 1 -- 172.21.15.46:0/2477797282 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f12500c6610 con 0x7f12500c83b0 2023-07-05T18:56:21.254 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.168+0000 7f124d7fa700 1 -- 172.21.15.46:0/2477797282 <== mon.1 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f123c012c60 con 0x7f12500c83b0 2023-07-05T18:56:21.254 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.169+0000 7f124d7fa700 1 --2- 172.21.15.46:0/2477797282 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7f123406ad60 0x7f123406d210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:56:21.254 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.169+0000 7f124d7fa700 1 -- 172.21.15.46:0/2477797282 <== mon.1 v2:172.21.15.73:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f123c089440 con 0x7f12500c83b0 2023-07-05T18:56:21.254 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.169+0000 7f12549e1700 1 --2- 172.21.15.46:0/2477797282 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7f123406ad60 0x7f123406d210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:56:21.255 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.173+0000 7f9123fff700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f910c005c10 0x7f91240c6cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:57948/0 (socket says 172.21.15.46:57948) 2023-07-05T18:56:21.255 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.173+0000 7f9123fff700 1 -- 172.21.15.46:0/1405589495 learned_addr learned my addr 172.21.15.46:0/1405589495 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-07-05T18:56:21.255 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.173+0000 7f91237fe700 1 --2- 172.21.15.46:0/1405589495 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f91240c7710 0x7f91241ed7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:56:21.255 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.173+0000 7f9123fff700 1 -- 172.21.15.46:0/1405589495 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f91240c7710 msgr2=0x7f91241ed7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:56:21.255 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.173+0000 7f9123fff700 1 --2- 172.21.15.46:0/1405589495 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f91240c7710 0x7f91241ed7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:21.255 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.173+0000 7f9123fff700 1 -- 172.21.15.46:0/1405589495 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f91240c5930 msgr2=0x7f91240c5db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:56:21.255 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.173+0000 7f9123fff700 1 --2- 172.21.15.46:0/1405589495 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f91240c5930 0x7f91240c5db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:21.256 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.173+0000 7f9123fff700 1 -- 172.21.15.46:0/1405589495 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f91241ee610 con 0x7f910c005c10 2023-07-05T18:56:21.256 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.173+0000 7fc35ed9d700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fc36006a510 0x7fc36015b310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:56:21.256 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.173+0000 7fc35f59e700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc3601609d0 0x7fc36006c540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:56:21.256 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.173+0000 7fc35e59c700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc3600cdfb0 0x7fc36006c000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:56:21.257 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.173+0000 7fc35ed9d700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fc36006a510 0x7fc36015b310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3301/0 says I am v2:172.21.15.46:41640/0 (socket says 172.21.15.46:41640) 2023-07-05T18:56:21.257 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.173+0000 7fc35f59e700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc3601609d0 0x7fc36006c540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:57956/0 (socket says 172.21.15.46:57956) 2023-07-05T18:56:21.257 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.173+0000 7fc35ed9d700 1 -- 172.21.15.46:0/3571971883 learned_addr learned my addr 172.21.15.46:0/3571971883 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-07-05T18:56:21.257 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.174+0000 7fc35e59c700 1 -- 172.21.15.46:0/3571971883 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fc36006a510 msgr2=0x7fc36015b310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:56:21.257 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.174+0000 7fc35e59c700 1 --2- 172.21.15.46:0/3571971883 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fc36006a510 0x7fc36015b310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:21.257 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.174+0000 7fc35e59c700 1 -- 172.21.15.46:0/3571971883 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc3601609d0 msgr2=0x7fc36006c540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:56:21.257 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.174+0000 7fc35e59c700 1 --2- 172.21.15.46:0/3571971883 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc3601609d0 0x7fc36006c540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:21.258 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.174+0000 7fc35e59c700 1 -- 172.21.15.46:0/3571971883 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc3500094a0 con 0x7fc3600cdfb0 2023-07-05T18:56:21.258 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.174+0000 7fc35f59e700 1 --2- 172.21.15.46:0/3571971883 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc3601609d0 0x7fc36006c540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-05T18:56:21.258 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.174+0000 7f9123fff700 1 --2- 172.21.15.46:0/1405589495 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f910c005c10 0x7f91240c6cd0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f91140090b0 tx=0x7f91140047c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-05T18:56:21.258 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.174+0000 7fc35e59c700 1 --2- 172.21.15.46:0/3571971883 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc3600cdfb0 0x7fc36006c000 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fc35800cc00 tx=0x7fc35800cf10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-05T18:56:21.259 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.174+0000 7f9120ff9700 1 -- 172.21.15.46:0/1405589495 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9114003a30 con 0x7f910c005c10 2023-07-05T18:56:21.259 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.174+0000 7f9120ff9700 1 -- 172.21.15.46:0/1405589495 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9114003bd0 con 0x7f910c005c10 2023-07-05T18:56:21.259 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.174+0000 7f9120ff9700 1 -- 172.21.15.46:0/1405589495 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9114003f80 con 0x7f910c005c10 2023-07-05T18:56:21.259 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.174+0000 7f912aa31700 1 -- 172.21.15.46:0/1405589495 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f91240b1690 con 0x7f910c005c10 2023-07-05T18:56:21.259 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.174+0000 7f912aa31700 1 -- 172.21.15.46:0/1405589495 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f91241edcf0 con 0x7f910c005c10 2023-07-05T18:56:21.260 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.173+0000 7f5e85d9b700 1 --2- 172.21.15.46:0/3828466446 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7f5e6806ad30 0x7f5e6806d1e0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f5e78000f60 tx=0x7f5e78007a40 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-05T18:56:21.260 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.175+0000 7fc3477fe700 1 -- 172.21.15.46:0/3571971883 <== mon.1 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc35800aa80 con 0x7fc3600cdfb0 2023-07-05T18:56:21.260 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.175+0000 7fc3477fe700 1 -- 172.21.15.46:0/3571971883 <== mon.1 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc35800abe0 con 0x7fc3600cdfb0 2023-07-05T18:56:21.261 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.175+0000 7fc3477fe700 1 -- 172.21.15.46:0/3571971883 <== mon.1 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3580070d0 con 0x7fc3600cdfb0 2023-07-05T18:56:21.261 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.175+0000 7f31c1d9b700 1 --2- 172.21.15.46:0/3502608859 >> [v2:172.21.15.46:6800/2115251461,v1:172.21.15.46:6801/2115251461] conn(0x7f31a4073660 0x7f31a4075a70 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-05T18:56:21.261 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.175+0000 7fc365071700 1 -- 172.21.15.46:0/3571971883 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc3600c4730 con 0x7fc3600cdfb0 2023-07-05T18:56:21.262 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.175+0000 7fc365071700 1 -- 172.21.15.46:0/3571971883 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc3600c3400 con 0x7fc3600cdfb0 2023-07-05T18:56:21.262 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.177+0000 7fc3477fe700 1 -- 172.21.15.46:0/3571971883 <== mon.1 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fc358007230 con 0x7fc3600cdfb0 2023-07-05T18:56:21.262 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.178+0000 7fc3477fe700 1 --2- 172.21.15.46:0/3571971883 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7fc34c06ad30 0x7fc34c06d1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:56:21.262 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.178+0000 7fc3477fe700 1 -- 172.21.15.46:0/3571971883 <== mon.1 v2:172.21.15.73:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fc358089290 con 0x7fc3600cdfb0 2023-07-05T18:56:21.262 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.179+0000 7fc35ed9d700 1 --2- 172.21.15.46:0/3571971883 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7fc34c06ad30 0x7fc34c06d1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:56:21.262 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.179+0000 7fc35ed9d700 1 --2- 172.21.15.46:0/3571971883 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7fc34c06ad30 0x7fc34c06d1e0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fc354001a40 tx=0x7fc354009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-05T18:56:21.263 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.177+0000 7f9120ff9700 1 -- 172.21.15.46:0/1405589495 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f9114013650 con 0x7f910c005c10 2023-07-05T18:56:21.263 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.178+0000 7f9120ff9700 1 --2- 172.21.15.46:0/1405589495 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7f911006ace0 0x7f911006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:56:21.263 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.178+0000 7f9120ff9700 1 -- 172.21.15.46:0/1405589495 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f911408ef20 con 0x7f910c005c10 2023-07-05T18:56:21.263 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.178+0000 7f912aa31700 1 --2- 172.21.15.46:0/1405589495 >> [v2:172.21.15.46:6824/2981388766,v1:172.21.15.46:6825/2981388766] conn(0x7f9124157da0 0x7f9124158190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:56:21.263 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.178+0000 7f912aa31700 1 -- 172.21.15.46:0/1405589495 --> [v2:172.21.15.46:6824/2981388766,v1:172.21.15.46:6825/2981388766] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f91240c9670 con 0x7f9124157da0 2023-07-05T18:56:21.263 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.178+0000 7f91237fe700 1 --2- 172.21.15.46:0/1405589495 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7f911006ace0 0x7f911006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:56:21.264 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.179+0000 7f9128fce700 1 --2- 172.21.15.46:0/1405589495 >> [v2:172.21.15.46:6824/2981388766,v1:172.21.15.46:6825/2981388766] conn(0x7f9124157da0 0x7f9124158190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:56:21.264 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.179+0000 7f91237fe700 1 --2- 172.21.15.46:0/1405589495 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7f911006ace0 0x7f911006d190 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f9118007fd0 tx=0x7f9118007ca0 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-05T18:56:21.264 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.179+0000 7f9128fce700 1 --2- 172.21.15.46:0/1405589495 >> [v2:172.21.15.46:6824/2981388766,v1:172.21.15.46:6825/2981388766] conn(0x7f9124157da0 0x7f9124158190 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-05T18:56:21.264 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.180+0000 7fc365071700 1 --2- 172.21.15.46:0/3571971883 >> [v2:172.21.15.46:6813/4151971443,v1:172.21.15.46:6815/4151971443] conn(0x7fc3400015e0 0x7fc340003a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:56:21.264 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.180+0000 7fc365071700 1 -- 172.21.15.46:0/3571971883 --> [v2:172.21.15.46:6813/4151971443,v1:172.21.15.46:6815/4151971443] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fc340006bc0 con 0x7fc3400015e0 2023-07-05T18:56:21.265 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.175+0000 7f1256c45700 1 --2- 172.21.15.46:0/2477797282 >> [v2:172.21.15.73:6814/3772673248,v1:172.21.15.73:6816/3772673248] conn(0x7f12300015e0 0x7f1230003a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:56:21.265 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.175+0000 7f1256c45700 1 -- 172.21.15.46:0/2477797282 --> [v2:172.21.15.73:6814/3772673248,v1:172.21.15.73:6816/3772673248] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f1230006bc0 con 0x7f12300015e0 2023-07-05T18:56:21.265 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.175+0000 7f12551e2700 1 --2- 172.21.15.46:0/2477797282 >> [v2:172.21.15.73:6814/3772673248,v1:172.21.15.73:6816/3772673248] conn(0x7f12300015e0 0x7f1230003a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:56:21.265 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.176+0000 7f12551e2700 1 --2- 172.21.15.46:0/2477797282 >> [v2:172.21.15.73:6814/3772673248,v1:172.21.15.73:6816/3772673248] conn(0x7f12300015e0 0x7f1230003a90 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-05T18:56:21.265 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.177+0000 7f124d7fa700 1 -- 172.21.15.46:0/2477797282 <== osd.7 v2:172.21.15.73:6814/3772673248 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7f1230006bc0 con 0x7f12300015e0 2023-07-05T18:56:21.266 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.177+0000 7f31b2ffd700 1 -- 172.21.15.46:0/3502608859 <== osd.2 v2:172.21.15.46:6800/2115251461 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7f31a4076120 con 0x7f31a4073660 2023-07-05T18:56:21.266 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.182+0000 7f12549e1700 1 --2- 172.21.15.46:0/2477797282 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7f123406ad60 0x7f123406d210 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f1244015040 tx=0x7f124400a000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-05T18:56:21.266 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.184+0000 7fc35f59e700 1 --2- 172.21.15.46:0/3571971883 >> [v2:172.21.15.46:6813/4151971443,v1:172.21.15.46:6815/4151971443] conn(0x7fc3400015e0 0x7fc340003a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:56:21.267 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.184+0000 7fc35f59e700 1 --2- 172.21.15.46:0/3571971883 >> [v2:172.21.15.46:6813/4151971443,v1:172.21.15.46:6815/4151971443] conn(0x7fc3400015e0 0x7fc340003a90 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-05T18:56:21.267 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.187+0000 7fc3477fe700 1 -- 172.21.15.46:0/3571971883 <== osd.0 v2:172.21.15.46:6813/4151971443 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7fc340006bc0 con 0x7fc3400015e0 2023-07-05T18:56:21.267 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.190+0000 7f9120ff9700 1 -- 172.21.15.46:0/1405589495 <== osd.3 v2:172.21.15.46:6824/2981388766 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7f911c004300 con 0x7f9124157da0 2023-07-05T18:56:21.267 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.190+0000 7f5e8cda7700 1 -- 172.21.15.46:0/3828466446 --> [v2:172.21.15.73:6808/974108383,v1:172.21.15.73:6809/974108383] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f5e8804e1d0 con 0x7f5e680735e0 2023-07-05T18:56:21.268 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.191+0000 7f5e76ffd700 1 -- 172.21.15.46:0/3828466446 <== osd.6 v2:172.21.15.73:6808/974108383 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f5e8804e1d0 con 0x7f5e680735e0 2023-07-05T18:56:21.268 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.194+0000 7f5e8cda7700 1 -- 172.21.15.46:0/3828466446 >> [v2:172.21.15.73:6808/974108383,v1:172.21.15.73:6809/974108383] conn(0x7f5e680735e0 msgr2=0x7f5e680759f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:56:21.269 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.194+0000 7f5e8cda7700 1 --2- 172.21.15.46:0/3828466446 >> [v2:172.21.15.73:6808/974108383,v1:172.21.15.73:6809/974108383] conn(0x7f5e680735e0 0x7f5e680759f0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:21.269 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.194+0000 7f5e8cda7700 1 -- 172.21.15.46:0/3828466446 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7f5e6806ad30 msgr2=0x7f5e6806d1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:56:21.269 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.194+0000 7f5e8cda7700 1 --2- 172.21.15.46:0/3828466446 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7f5e6806ad30 0x7f5e6806d1e0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f5e78000f60 tx=0x7f5e78007a40 comp rx=0 tx=0).stop 2023-07-05T18:56:21.269 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.194+0000 7f5e8cda7700 1 -- 172.21.15.46:0/3828466446 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5e880b5ae0 msgr2=0x7f5e88070a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:56:21.269 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.194+0000 7f5e8cda7700 1 --2- 172.21.15.46:0/3828466446 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5e880b5ae0 0x7f5e88070a90 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f5e7c00b550 tx=0x7f5e7c00b910 comp rx=0 tx=0).stop 2023-07-05T18:56:21.269 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.194+0000 7f5e86d9d700 1 -- 172.21.15.46:0/3828466446 reap_dead start 2023-07-05T18:56:21.269 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.194+0000 7f5e8cda7700 1 -- 172.21.15.46:0/3828466446 shutdown_connections 2023-07-05T18:56:21.270 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.194+0000 7f5e8cda7700 1 -- 172.21.15.46:0/3828466446 >> 172.21.15.46:0/3828466446 conn(0x7f5e8806afa0 msgr2=0x7f5e8815d9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-05T18:56:21.270 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.194+0000 7f0562833700 1 -- 172.21.15.46:0/3381999807 --> [v2:172.21.15.73:6800/2083655348,v1:172.21.15.73:6801/2083655348] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f053c002d40 con 0x7f0548073590 2023-07-05T18:56:21.270 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.195+0000 7f0558ff9700 1 -- 172.21.15.46:0/3381999807 <== osd.4 v2:172.21.15.73:6800/2083655348 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f053c002d40 con 0x7f0548073590 2023-07-05T18:56:21.271 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.196+0000 7ff6a9d3c700 1 -- 172.21.15.46:0/3269100102 --> [v2:172.21.15.73:6824/2803788401,v1:172.21.15.73:6825/2803788401] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7ff684002d40 con 0x7ff690073510 2023-07-05T18:56:21.271 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.197+0000 7f5e8cda7700 1 -- 172.21.15.46:0/3828466446 shutdown_connections 2023-07-05T18:56:21.271 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.197+0000 7f5e8cda7700 1 -- 172.21.15.46:0/3828466446 wait complete. 2023-07-05T18:56:21.271 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.197+0000 7ff68bfff700 1 -- 172.21.15.46:0/3269100102 <== osd.5 v2:172.21.15.73:6824/2803788401 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7ff684002d40 con 0x7ff690073510 2023-07-05T18:56:21.272 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.197+0000 7ff6a9d3c700 1 -- 172.21.15.46:0/3269100102 >> [v2:172.21.15.73:6824/2803788401,v1:172.21.15.73:6825/2803788401] conn(0x7ff690073510 msgr2=0x7ff690075920 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:56:21.272 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.197+0000 7ff6a9d3c700 1 --2- 172.21.15.46:0/3269100102 >> [v2:172.21.15.73:6824/2803788401,v1:172.21.15.73:6825/2803788401] conn(0x7ff690073510 0x7ff690075920 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:21.272 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.197+0000 7ff6a9d3c700 1 -- 172.21.15.46:0/3269100102 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7ff69006ace0 msgr2=0x7ff69006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:56:21.272 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.197+0000 7ff6a9d3c700 1 --2- 172.21.15.46:0/3269100102 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7ff69006ace0 0x7ff69006d190 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7ff6a415e840 tx=0x7ff694008030 comp rx=0 tx=0).stop 2023-07-05T18:56:21.273 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.197+0000 7ff6a9d3c700 1 -- 172.21.15.46:0/3269100102 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7ff6a4069e00 msgr2=0x7ff6a41fe670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:56:21.273 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.197+0000 7ff6a9d3c700 1 --2- 172.21.15.46:0/3269100102 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7ff6a4069e00 0x7ff6a41fe670 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7ff69c002070 tx=0x7ff69c00a340 comp rx=0 tx=0).stop 2023-07-05T18:56:21.273 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.198+0000 7ff6a3fff700 1 -- 172.21.15.46:0/3269100102 reap_dead start 2023-07-05T18:56:21.273 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.198+0000 7ff6a9d3c700 1 -- 172.21.15.46:0/3269100102 shutdown_connections 2023-07-05T18:56:21.273 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.198+0000 7ff6a9d3c700 1 -- 172.21.15.46:0/3269100102 >> 172.21.15.46:0/3269100102 conn(0x7ff6a406af10 msgr2=0x7ff6a415c170 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-05T18:56:21.273 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.200+0000 7f0562833700 1 -- 172.21.15.46:0/3381999807 >> [v2:172.21.15.73:6800/2083655348,v1:172.21.15.73:6801/2083655348] conn(0x7f0548073590 msgr2=0x7f05480759a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:56:21.274 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.200+0000 7f0562833700 1 --2- 172.21.15.46:0/3381999807 >> [v2:172.21.15.73:6800/2083655348,v1:172.21.15.73:6801/2083655348] conn(0x7f0548073590 0x7f05480759a0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:21.274 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.200+0000 7f0562833700 1 -- 172.21.15.46:0/3381999807 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7f054806ace0 msgr2=0x7f054806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:56:21.274 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.200+0000 7f0562833700 1 --2- 172.21.15.46:0/3381999807 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7f054806ace0 0x7f054806d190 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f0550006fd0 tx=0x7f0550008040 comp rx=0 tx=0).stop 2023-07-05T18:56:21.274 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.200+0000 7f0562833700 1 -- 172.21.15.46:0/3381999807 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f055c0cc840 msgr2=0x7f055c1feaf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:56:21.274 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.200+0000 7f0562833700 1 --2- 172.21.15.46:0/3381999807 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f055c0cc840 0x7f055c1feaf0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f055c0ccc10 tx=0x7f054c00b730 comp rx=0 tx=0).stop 2023-07-05T18:56:21.275 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.200+0000 7ff6a9d3c700 1 -- 172.21.15.46:0/3269100102 shutdown_connections 2023-07-05T18:56:21.275 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.200+0000 7ff6a9d3c700 1 -- 172.21.15.46:0/3269100102 wait complete. 2023-07-05T18:56:21.275 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.202+0000 7f96fc736700 1 -- 172.21.15.46:0/1222774497 --> [v2:172.21.15.46:6808/502575881,v1:172.21.15.46:6809/502575881] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f96dc002d40 con 0x7f96d80735e0 2023-07-05T18:56:21.275 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.202+0000 7f31c8810700 1 -- 172.21.15.46:0/3502608859 --> [v2:172.21.15.46:6800/2115251461,v1:172.21.15.46:6801/2115251461] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f31a8002d40 con 0x7f31a4073660 2023-07-05T18:56:21.276 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.203+0000 7f96eaffd700 1 -- 172.21.15.46:0/1222774497 <== osd.1 v2:172.21.15.46:6808/502575881 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f96dc002d40 con 0x7f96d80735e0 2023-07-05T18:56:21.276 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.203+0000 7f31b2ffd700 1 -- 172.21.15.46:0/3502608859 <== osd.2 v2:172.21.15.46:6800/2115251461 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f31a8002d40 con 0x7f31a4073660 2023-07-05T18:56:21.277 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.203+0000 7f31c8810700 1 -- 172.21.15.46:0/3502608859 >> [v2:172.21.15.46:6800/2115251461,v1:172.21.15.46:6801/2115251461] conn(0x7f31a4073660 msgr2=0x7f31a4075a70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:56:21.277 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.203+0000 7f31c8810700 1 --2- 172.21.15.46:0/3502608859 >> [v2:172.21.15.46:6800/2115251461,v1:172.21.15.46:6801/2115251461] conn(0x7f31a4073660 0x7f31a4075a70 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:21.277 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.204+0000 7f96fc736700 1 -- 172.21.15.46:0/1222774497 >> [v2:172.21.15.46:6808/502575881,v1:172.21.15.46:6809/502575881] conn(0x7f96d80735e0 msgr2=0x7f96d80759f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:56:21.277 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.204+0000 7f96fc736700 1 --2- 172.21.15.46:0/1222774497 >> [v2:172.21.15.46:6808/502575881,v1:172.21.15.46:6809/502575881] conn(0x7f96d80735e0 0x7f96d80759f0 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:21.278 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.204+0000 7f31c8810700 1 -- 172.21.15.46:0/3502608859 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7f31a406adb0 msgr2=0x7f31a406d260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:56:21.278 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.204+0000 7f31c8810700 1 --2- 172.21.15.46:0/3502608859 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7f31a406adb0 0x7f31a406d260 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f31c40b44b0 tx=0x7f31b8009040 comp rx=0 tx=0).stop 2023-07-05T18:56:21.278 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.204+0000 7f31c8810700 1 -- 172.21.15.46:0/3502608859 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f31c4142480 msgr2=0x7f31c41eff20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:56:21.278 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.204+0000 7f31c8810700 1 --2- 172.21.15.46:0/3502608859 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f31c4142480 0x7f31c41eff20 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f31bc00cae0 tx=0x7f31bc00cdf0 comp rx=0 tx=0).stop 2023-07-05T18:56:21.278 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.205+0000 7f31c2d9d700 1 -- 172.21.15.46:0/3502608859 reap_dead start 2023-07-05T18:56:21.278 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.205+0000 7f31c8810700 1 -- 172.21.15.46:0/3502608859 shutdown_connections 2023-07-05T18:56:21.278 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.205+0000 7f31c8810700 1 -- 172.21.15.46:0/3502608859 >> 172.21.15.46:0/3502608859 conn(0x7f31c406af10 msgr2=0x7f31c413fa10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-05T18:56:21.279 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.205+0000 7f1256c45700 1 -- 172.21.15.46:0/2477797282 --> [v2:172.21.15.73:6814/3772673248,v1:172.21.15.73:6816/3772673248] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f1230005c40 con 0x7f12300015e0 2023-07-05T18:56:21.279 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.205+0000 7f96fc736700 1 -- 172.21.15.46:0/1222774497 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7f96d806ad30 msgr2=0x7f96d806d1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:56:21.279 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.205+0000 7f96fc736700 1 --2- 172.21.15.46:0/1222774497 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7f96d806ad30 0x7f96d806d1e0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f96f0000c00 tx=0x7f96f000f000 comp rx=0 tx=0).stop 2023-07-05T18:56:21.279 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.205+0000 7f96fc736700 1 -- 172.21.15.46:0/1222774497 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f96f40cc760 msgr2=0x7f96f40ccbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:56:21.279 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.205+0000 7f96fc736700 1 --2- 172.21.15.46:0/1222774497 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f96f40cc760 0x7f96f40ccbd0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f96f40cf640 tx=0x7f96e4011b40 comp rx=0 tx=0).stop 2023-07-05T18:56:21.280 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.206+0000 7f124d7fa700 1 -- 172.21.15.46:0/2477797282 <== osd.7 v2:172.21.15.73:6814/3772673248 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f1230005c40 con 0x7f12300015e0 2023-07-05T18:56:21.280 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.206+0000 7f1256c45700 1 -- 172.21.15.46:0/2477797282 >> [v2:172.21.15.73:6814/3772673248,v1:172.21.15.73:6816/3772673248] conn(0x7f12300015e0 msgr2=0x7f1230003a90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:56:21.281 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.206+0000 7f1256c45700 1 --2- 172.21.15.46:0/2477797282 >> [v2:172.21.15.73:6814/3772673248,v1:172.21.15.73:6816/3772673248] conn(0x7f12300015e0 0x7f1230003a90 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:21.281 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.206+0000 7f1256c45700 1 -- 172.21.15.46:0/2477797282 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7f123406ad60 msgr2=0x7f123406d210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:56:21.281 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.206+0000 7f1256c45700 1 --2- 172.21.15.46:0/2477797282 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7f123406ad60 0x7f123406d210 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f1244015040 tx=0x7f124400a000 comp rx=0 tx=0).stop 2023-07-05T18:56:21.281 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.206+0000 7f1256c45700 1 -- 172.21.15.46:0/2477797282 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f12500c83b0 msgr2=0x7f12500c9c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:56:21.281 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.206+0000 7f1256c45700 1 --2- 172.21.15.46:0/2477797282 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f12500c83b0 0x7f12500c9c60 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f123c00d440 tx=0x7f123c00d800 comp rx=0 tx=0).stop 2023-07-05T18:56:21.281 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.206+0000 7f12551e2700 1 -- 172.21.15.46:0/2477797282 reap_dead start 2023-07-05T18:56:21.282 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.207+0000 7f31c8810700 1 -- 172.21.15.46:0/3502608859 shutdown_connections 2023-07-05T18:56:21.282 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.207+0000 7f31c8810700 1 -- 172.21.15.46:0/3502608859 wait complete. 2023-07-05T18:56:21.282 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.209+0000 7f96facd3700 1 -- 172.21.15.46:0/1222774497 reap_dead start 2023-07-05T18:56:21.282 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.209+0000 7f96fc736700 1 -- 172.21.15.46:0/1222774497 shutdown_connections 2023-07-05T18:56:21.283 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.209+0000 7f96fc736700 1 -- 172.21.15.46:0/1222774497 >> 172.21.15.46:0/1222774497 conn(0x7f96f40b0fc0 msgr2=0x7f96f40afbe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-05T18:56:21.283 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.209+0000 7f0560dd0700 1 -- 172.21.15.46:0/3381999807 reap_dead start 2023-07-05T18:56:21.283 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.209+0000 7f0562833700 1 -- 172.21.15.46:0/3381999807 shutdown_connections 2023-07-05T18:56:21.283 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.209+0000 7f0562833700 1 -- 172.21.15.46:0/3381999807 >> 172.21.15.46:0/3381999807 conn(0x7f055c0b0fc0 msgr2=0x7f055c155420 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-05T18:56:21.283 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.212+0000 7f0562833700 1 -- 172.21.15.46:0/3381999807 shutdown_connections 2023-07-05T18:56:21.284 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.212+0000 7f1256c45700 1 -- 172.21.15.46:0/2477797282 shutdown_connections 2023-07-05T18:56:21.284 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.212+0000 7f1256c45700 1 -- 172.21.15.46:0/2477797282 >> 172.21.15.46:0/2477797282 conn(0x7f12500ce860 msgr2=0x7f12500afb40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-05T18:56:21.284 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.212+0000 7f0562833700 1 -- 172.21.15.46:0/3381999807 wait complete. 2023-07-05T18:56:21.285 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.212+0000 7f96fc736700 1 -- 172.21.15.46:0/1222774497 shutdown_connections 2023-07-05T18:56:21.285 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.212+0000 7f96fc736700 1 -- 172.21.15.46:0/1222774497 wait complete. 2023-07-05T18:56:21.285 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.212+0000 7f1256c45700 1 -- 172.21.15.46:0/2477797282 shutdown_connections 2023-07-05T18:56:21.285 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.212+0000 7f1256c45700 1 -- 172.21.15.46:0/2477797282 wait complete. 2023-07-05T18:56:21.286 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.215+0000 7fc365071700 1 -- 172.21.15.46:0/3571971883 --> [v2:172.21.15.46:6813/4151971443,v1:172.21.15.46:6815/4151971443] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fc340005c40 con 0x7fc3400015e0 2023-07-05T18:56:21.286 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.216+0000 7fc3477fe700 1 -- 172.21.15.46:0/3571971883 <== osd.0 v2:172.21.15.46:6813/4151971443 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fc340005c40 con 0x7fc3400015e0 2023-07-05T18:56:21.286 INFO:teuthology.orchestra.run.smithi046.stdout:55834574854 2023-07-05T18:56:21.287 INFO:teuthology.orchestra.run.smithi046.stdout:55834574855 2023-07-05T18:56:21.288 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2023-07-05T18:56:21.288 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2023-07-05T18:56:21.289 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.220+0000 7f912aa31700 1 -- 172.21.15.46:0/1405589495 --> [v2:172.21.15.46:6824/2981388766,v1:172.21.15.46:6825/2981388766] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f91240c9c30 con 0x7f9124157da0 2023-07-05T18:56:21.289 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.220+0000 7fc365071700 1 -- 172.21.15.46:0/3571971883 >> [v2:172.21.15.46:6813/4151971443,v1:172.21.15.46:6815/4151971443] conn(0x7fc3400015e0 msgr2=0x7fc340003a90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:56:21.290 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.220+0000 7fc365071700 1 --2- 172.21.15.46:0/3571971883 >> [v2:172.21.15.46:6813/4151971443,v1:172.21.15.46:6815/4151971443] conn(0x7fc3400015e0 0x7fc340003a90 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:21.290 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.220+0000 7f9120ff9700 1 -- 172.21.15.46:0/1405589495 <== osd.3 v2:172.21.15.46:6824/2981388766 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f911c0046a0 con 0x7f9124157da0 2023-07-05T18:56:21.290 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.220+0000 7fc365071700 1 -- 172.21.15.46:0/3571971883 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7fc34c06ad30 msgr2=0x7fc34c06d1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:56:21.290 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.220+0000 7fc365071700 1 --2- 172.21.15.46:0/3571971883 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7fc34c06ad30 0x7fc34c06d1e0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fc354001a40 tx=0x7fc354009040 comp rx=0 tx=0).stop 2023-07-05T18:56:21.291 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.220+0000 7fc365071700 1 -- 172.21.15.46:0/3571971883 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc3600cdfb0 msgr2=0x7fc36006c000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:56:21.291 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.220+0000 7fc365071700 1 --2- 172.21.15.46:0/3571971883 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc3600cdfb0 0x7fc36006c000 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fc35800cc00 tx=0x7fc35800cf10 comp rx=0 tx=0).stop 2023-07-05T18:56:21.291 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.221+0000 7fc35f59e700 1 -- 172.21.15.46:0/3571971883 reap_dead start 2023-07-05T18:56:21.291 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.221+0000 7fc365071700 1 -- 172.21.15.46:0/3571971883 shutdown_connections 2023-07-05T18:56:21.292 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.221+0000 7fc365071700 1 -- 172.21.15.46:0/3571971883 >> 172.21.15.46:0/3571971883 conn(0x7fc3600ce860 msgr2=0x7fc36006b6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-05T18:56:21.292 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.221+0000 7fc365071700 1 -- 172.21.15.46:0/3571971883 shutdown_connections 2023-07-05T18:56:21.292 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.221+0000 7fc365071700 1 -- 172.21.15.46:0/3571971883 wait complete. 2023-07-05T18:56:21.293 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.221+0000 7f912aa31700 1 -- 172.21.15.46:0/1405589495 >> [v2:172.21.15.46:6824/2981388766,v1:172.21.15.46:6825/2981388766] conn(0x7f9124157da0 msgr2=0x7f9124158190 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:56:21.293 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.221+0000 7f912aa31700 1 --2- 172.21.15.46:0/1405589495 >> [v2:172.21.15.46:6824/2981388766,v1:172.21.15.46:6825/2981388766] conn(0x7f9124157da0 0x7f9124158190 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:21.293 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.221+0000 7f912aa31700 1 -- 172.21.15.46:0/1405589495 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7f911006ace0 msgr2=0x7f911006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:56:21.293 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.221+0000 7f912aa31700 1 --2- 172.21.15.46:0/1405589495 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7f911006ace0 0x7f911006d190 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f9118007fd0 tx=0x7f9118007ca0 comp rx=0 tx=0).stop 2023-07-05T18:56:21.293 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.221+0000 7f912aa31700 1 -- 172.21.15.46:0/1405589495 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f910c005c10 msgr2=0x7f91240c6cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:56:21.293 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.221+0000 7f912aa31700 1 --2- 172.21.15.46:0/1405589495 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f910c005c10 0x7f91240c6cd0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f91140090b0 tx=0x7f91140047c0 comp rx=0 tx=0).stop 2023-07-05T18:56:21.294 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.221+0000 7f9128fce700 1 -- 172.21.15.46:0/1405589495 reap_dead start 2023-07-05T18:56:21.294 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.221+0000 7f912aa31700 1 -- 172.21.15.46:0/1405589495 shutdown_connections 2023-07-05T18:56:21.294 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.221+0000 7f912aa31700 1 -- 172.21.15.46:0/1405589495 >> 172.21.15.46:0/1405589495 conn(0x7f91240b0fc0 msgr2=0x7f912406bf50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-05T18:56:21.294 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.222+0000 7f912aa31700 1 -- 172.21.15.46:0/1405589495 shutdown_connections 2023-07-05T18:56:21.294 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.222+0000 7f912aa31700 1 -- 172.21.15.46:0/1405589495 wait complete. 2023-07-05T18:56:21.295 INFO:teuthology.orchestra.run.smithi046.stdout:55834574853 2023-07-05T18:56:21.295 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-07-05T18:56:21.296 INFO:teuthology.orchestra.run.smithi046.stdout:55834574854 2023-07-05T18:56:21.296 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-07-05T18:56:21.297 INFO:teuthology.orchestra.run.smithi046.stdout:55834574855 2023-07-05T18:56:21.297 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2023-07-05T18:56:21.298 INFO:teuthology.orchestra.run.smithi046.stdout:55834574853 2023-07-05T18:56:21.298 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2023-07-05T18:56:21.299 INFO:teuthology.orchestra.run.smithi046.stdout:55834574854 2023-07-05T18:56:21.300 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-07-05T18:56:21.300 INFO:teuthology.orchestra.run.smithi046.stdout:55834574855 2023-07-05T18:56:21.301 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-07-05T18:56:21.320 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-05T18:56:21.350 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-05T18:56:21.555 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.553+0000 7fc48936f700 1 Processor -- start 2023-07-05T18:56:21.557 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.554+0000 7fc48936f700 1 -- start start 2023-07-05T18:56:21.557 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.555+0000 7fc48936f700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fc4841584b0 0x7fc48415c100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:56:21.557 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.555+0000 7fc48936f700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fc48406a510 0x7fc4840ccb40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:56:21.557 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.555+0000 7fc48936f700 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc484071110 con 0x7fc4840ade50 2023-07-05T18:56:21.557 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.555+0000 7fc48936f700 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc484071930 con 0x7fc48406a510 2023-07-05T18:56:21.558 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.555+0000 7fc48936f700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc4840713b0 con 0x7fc4841584b0 2023-07-05T18:56:21.559 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.555+0000 7fc4827fc700 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7fc4840ade50 0x7fc484069e00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:57244/0 (socket says 172.21.15.46:57244) 2023-07-05T18:56:21.559 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.555+0000 7fc4827fc700 1 -- 172.21.15.46:0/1079814714 learned_addr learned my addr 172.21.15.46:0/1079814714 (peer_addr_for_me v1:172.21.15.46:0/0) 2023-07-05T18:56:21.559 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.555+0000 7fc482ffd700 1 --2- 172.21.15.46:0/1079814714 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fc4841584b0 0x7fc48415c100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:56:21.559 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.556+0000 7fc4837fe700 1 --2- 172.21.15.46:0/1079814714 >> v2:172.21.15.73:3300/0 conn(0x7fc48406a510 0x7fc4840ccb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:56:21.560 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.556+0000 7fc481ffb700 1 -- 172.21.15.46:0/1079814714 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3857926767 0 0) 0x7fc484071110 con 0x7fc4840ade50 2023-07-05T18:56:21.560 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.556+0000 7fc481ffb700 1 -- 172.21.15.46:0/1079814714 --> v1:172.21.15.46:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc46c0035b0 con 0x7fc4840ade50 2023-07-05T18:56:21.560 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.556+0000 7fc482ffd700 1 -- 172.21.15.46:0/1079814714 >> v2:172.21.15.73:3300/0 conn(0x7fc48406a510 msgr2=0x7fc4840ccb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-05T18:56:21.560 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.556+0000 7fc482ffd700 1 --2- 172.21.15.46:0/1079814714 >> v2:172.21.15.73:3300/0 conn(0x7fc48406a510 0x7fc4840ccb40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:21.560 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.556+0000 7fc482ffd700 1 -- 172.21.15.46:0/1079814714 >> v1:172.21.15.46:6789/0 conn(0x7fc4840ade50 legacy=0x7fc484069e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:56:21.560 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.556+0000 7fc482ffd700 1 -- 172.21.15.46:0/1079814714 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc48406fc70 con 0x7fc4841584b0 2023-07-05T18:56:21.561 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.556+0000 7fc482ffd700 1 --2- 172.21.15.46:0/1079814714 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fc4841584b0 0x7fc48415c100 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fc474009870 tx=0x7fc474009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=500c75df03ec882b server_cookie=0 in_seq=0 out_seq=0 2023-07-05T18:56:21.561 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.556+0000 7fc481ffb700 1 -- 172.21.15.46:0/1079814714 <== mon.2 v2:172.21.15.73:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc474004230 con 0x7fc4841584b0 2023-07-05T18:56:21.561 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.557+0000 7fc481ffb700 1 -- 172.21.15.46:0/1079814714 <== mon.2 v2:172.21.15.73:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc474004390 con 0x7fc4841584b0 2023-07-05T18:56:21.561 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.557+0000 7fc481ffb700 1 -- 172.21.15.46:0/1079814714 <== mon.2 v2:172.21.15.73:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4740036a0 con 0x7fc4841584b0 2023-07-05T18:56:21.563 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.557+0000 7fc48936f700 1 -- 172.21.15.46:0/1079814714 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fc4841584b0 msgr2=0x7fc48415c100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:56:21.564 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.557+0000 7fc48936f700 1 --2- 172.21.15.46:0/1079814714 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fc4841584b0 0x7fc48415c100 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fc474009870 tx=0x7fc474009b80 comp rx=0 tx=0).stop 2023-07-05T18:56:21.564 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.558+0000 7fc48936f700 1 -- 172.21.15.46:0/1079814714 shutdown_connections 2023-07-05T18:56:21.564 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.558+0000 7fc48936f700 1 --2- 172.21.15.46:0/1079814714 >> v2:172.21.15.73:3300/0 conn(0x7fc48406a510 0x7fc4840ccb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:21.565 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.558+0000 7fc48936f700 1 --2- 172.21.15.46:0/1079814714 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fc4841584b0 0x7fc48415c100 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:21.565 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.558+0000 7fc48936f700 1 -- 172.21.15.46:0/1079814714 >> 172.21.15.46:0/1079814714 conn(0x7fc4840ce860 msgr2=0x7fc4840cec30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-05T18:56:21.565 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.558+0000 7fc48936f700 1 -- 172.21.15.46:0/1079814714 shutdown_connections 2023-07-05T18:56:21.566 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.558+0000 7fc48936f700 1 -- 172.21.15.46:0/1079814714 wait complete. 2023-07-05T18:56:21.566 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.560+0000 7fc48936f700 1 Processor -- start 2023-07-05T18:56:21.566 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.560+0000 7fc48936f700 1 -- start start 2023-07-05T18:56:21.567 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.561+0000 7fd583369700 1 Processor -- start 2023-07-05T18:56:21.567 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.561+0000 7fc48936f700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc48406a510 0x7fc484158b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:56:21.568 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.561+0000 7fc48936f700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc4840ade50 0x7fc4841f9e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:56:21.568 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.561+0000 7fc48936f700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fc4841584b0 0x7fc4841fa370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:56:21.569 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.561+0000 7fc48936f700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc484159f60 con 0x7fc48406a510 2023-07-05T18:56:21.569 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.561+0000 7fc48936f700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc48415a3f0 con 0x7fc4840ade50 2023-07-05T18:56:21.569 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.561+0000 7fc48936f700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc484159350 con 0x7fc4841584b0 2023-07-05T18:56:21.570 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.561+0000 7ffa57564700 1 Processor -- start 2023-07-05T18:56:21.570 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.561+0000 7ffa57564700 1 -- start start 2023-07-05T18:56:21.571 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.562+0000 7fc4837fe700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fc4841584b0 0x7fc4841fa370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:56:21.572 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.562+0000 7fc4837fe700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fc4841584b0 0x7fc4841fa370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3301/0 says I am v2:172.21.15.46:41664/0 (socket says 172.21.15.46:41664) 2023-07-05T18:56:21.572 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.562+0000 7fc4837fe700 1 -- 172.21.15.46:0/225230340 learned_addr learned my addr 172.21.15.46:0/225230340 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-07-05T18:56:21.572 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.562+0000 7fc4827fc700 1 --2- 172.21.15.46:0/225230340 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc4840ade50 0x7fc4841f9e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:56:21.573 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.562+0000 7fc482ffd700 1 --2- 172.21.15.46:0/225230340 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc48406a510 0x7fc484158b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:56:21.573 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.562+0000 7fc4827fc700 1 -- 172.21.15.46:0/225230340 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fc4841584b0 msgr2=0x7fc4841fa370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:56:21.573 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.562+0000 7fc4827fc700 1 --2- 172.21.15.46:0/225230340 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fc4841584b0 0x7fc4841fa370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:21.574 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.562+0000 7fc4827fc700 1 -- 172.21.15.46:0/225230340 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc48406a510 msgr2=0x7fc484158b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:56:21.575 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.562+0000 7fc4827fc700 1 --2- 172.21.15.46:0/225230340 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc48406a510 0x7fc484158b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:21.575 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.562+0000 7fc4827fc700 1 -- 172.21.15.46:0/225230340 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc4740094a0 con 0x7fc4840ade50 2023-07-05T18:56:21.576 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.561+0000 7fd583369700 1 -- start start 2023-07-05T18:56:21.576 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.563+0000 7fd583369700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fd57c142480 0x7fd57c0b41d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:56:21.577 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.563+0000 7fd583369700 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd57c06c8d0 con 0x7fd57c0b4710 2023-07-05T18:56:21.577 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.563+0000 7fd583369700 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd57c06cbb0 con 0x7fd57c13f4c0 2023-07-05T18:56:21.577 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.563+0000 7fd583369700 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd57c06ce90 con 0x7fd57c142480 2023-07-05T18:56:21.577 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.563+0000 7ffa57564700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7ffa501609d0 0x7ffa500ad750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:56:21.577 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.563+0000 7ffa57564700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7ffa500cdfb0 0x7ffa50069e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:56:21.578 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.563+0000 7ffa57564700 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffa500c1f00 con 0x7ffa5006a340 2023-07-05T18:56:21.578 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.563+0000 7ffa57564700 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffa5006a7c0 con 0x7ffa501609d0 2023-07-05T18:56:21.578 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.563+0000 7ffa57564700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffa500ae030 con 0x7ffa500cdfb0 2023-07-05T18:56:21.578 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.563+0000 7ffa55300700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7ffa501609d0 0x7ffa500ad750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:56:21.578 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.563+0000 7ffa55300700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7ffa501609d0 0x7ffa500ad750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:57992/0 (socket says 172.21.15.46:57992) 2023-07-05T18:56:21.578 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.563+0000 7ffa55300700 1 -- 172.21.15.46:0/2463558764 learned_addr learned my addr 172.21.15.46:0/2463558764 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-07-05T18:56:21.578 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.563+0000 7ffa54aff700 1 --2- 172.21.15.46:0/2463558764 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7ffa500cdfb0 0x7ffa50069e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:56:21.579 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.563+0000 7fd581105700 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7fd57c13f4c0 0x7fd57c15d6a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.46:43170/0 (socket says 172.21.15.46:43170) 2023-07-05T18:56:21.579 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.563+0000 7fd581105700 1 -- 172.21.15.46:0/3609648808 learned_addr learned my addr 172.21.15.46:0/3609648808 (peer_addr_for_me v1:172.21.15.46:0/0) 2023-07-05T18:56:21.579 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.563+0000 7fd580904700 1 --2- 172.21.15.46:0/3609648808 >> v2:172.21.15.73:3300/0 conn(0x7fd57c142480 0x7fd57c0b41d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:56:21.579 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.563+0000 7ffa55300700 1 -- 172.21.15.46:0/2463558764 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7ffa500cdfb0 msgr2=0x7ffa50069e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-05T18:56:21.579 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.563+0000 7ffa55300700 1 --2- 172.21.15.46:0/2463558764 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7ffa500cdfb0 0x7ffa50069e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:21.580 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.563+0000 7ffa55300700 1 -- 172.21.15.46:0/2463558764 >> v1:172.21.15.73:6789/0 conn(0x7ffa5006a340 legacy=0x7ffa501646d0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-07-05T18:56:21.580 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.563+0000 7ffa55300700 1 -- 172.21.15.46:0/2463558764 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa50070ec0 con 0x7ffa501609d0 2023-07-05T18:56:21.580 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.563+0000 7fd580904700 1 -- 172.21.15.46:0/3609648808 >> v1:172.21.15.73:6789/0 conn(0x7fd57c13f4c0 legacy=0x7fd57c15d6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:56:21.580 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.563+0000 7fd580904700 1 -- 172.21.15.46:0/3609648808 >> v1:172.21.15.46:6789/0 conn(0x7fd57c0b4710 legacy=0x7fd57c06d140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:56:21.581 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.564+0000 7fd580904700 1 -- 172.21.15.46:0/3609648808 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd57c0b39d0 con 0x7fd57c142480 2023-07-05T18:56:21.581 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.564+0000 7fd580904700 1 --2- 172.21.15.46:0/3609648808 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd57c142480 0x7fd57c0b41d0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fd57800bae0 tx=0x7fd57800bdf0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2753ff15d9d0685a server_cookie=0 in_seq=0 out_seq=0 2023-07-05T18:56:21.582 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.564+0000 7ffa55300700 1 --2- 172.21.15.46:0/2463558764 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ffa501609d0 0x7ffa500ad750 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7ffa400098f0 tx=0x7ffa40009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3539891ad3cb2cb3 server_cookie=0 in_seq=0 out_seq=0 2023-07-05T18:56:21.582 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.564+0000 7ffa47fff700 1 -- 172.21.15.46:0/2463558764 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa40004230 con 0x7ffa501609d0 2023-07-05T18:56:21.582 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.564+0000 7ffa47fff700 1 -- 172.21.15.46:0/2463558764 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffa40004390 con 0x7ffa501609d0 2023-07-05T18:56:21.582 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.564+0000 7ffa47fff700 1 -- 172.21.15.46:0/2463558764 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa400036a0 con 0x7ffa501609d0 2023-07-05T18:56:21.582 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.565+0000 7ffa57564700 1 -- 172.21.15.46:0/2463558764 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ffa501609d0 msgr2=0x7ffa500ad750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:56:21.583 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.565+0000 7ffa57564700 1 --2- 172.21.15.46:0/2463558764 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ffa501609d0 0x7ffa500ad750 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7ffa400098f0 tx=0x7ffa40009c00 comp rx=0 tx=0).stop 2023-07-05T18:56:21.583 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.565+0000 7ffa57564700 1 -- 172.21.15.46:0/2463558764 shutdown_connections 2023-07-05T18:56:21.583 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.565+0000 7ffa57564700 1 --2- 172.21.15.46:0/2463558764 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ffa501609d0 0x7ffa500ad750 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:21.583 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.565+0000 7ffa57564700 1 --2- 172.21.15.46:0/2463558764 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7ffa500cdfb0 0x7ffa50069e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:21.583 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.565+0000 7ffa57564700 1 -- 172.21.15.46:0/2463558764 >> 172.21.15.46:0/2463558764 conn(0x7ffa500ce860 msgr2=0x7ffa500cec30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-05T18:56:21.583 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.565+0000 7ffa57564700 1 -- 172.21.15.46:0/2463558764 shutdown_connections 2023-07-05T18:56:21.583 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.566+0000 7ffa57564700 1 -- 172.21.15.46:0/2463558764 wait complete. 2023-07-05T18:56:21.584 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.566+0000 7fc4827fc700 1 --2- 172.21.15.46:0/225230340 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc4840ade50 0x7fc4841f9e30 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fc478000c00 tx=0x7fc47800c800 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-05T18:56:21.584 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.566+0000 7fd573fff700 1 -- 172.21.15.46:0/3609648808 <== mon.1 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd57800dc30 con 0x7fd57c142480 2023-07-05T18:56:21.584 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.566+0000 7fd573fff700 1 -- 172.21.15.46:0/3609648808 <== mon.1 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd57800dd90 con 0x7fd57c142480 2023-07-05T18:56:21.585 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.566+0000 7fd573fff700 1 -- 172.21.15.46:0/3609648808 <== mon.1 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd578004230 con 0x7fd57c142480 2023-07-05T18:56:21.585 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.566+0000 7fc215721700 1 Processor -- start 2023-07-05T18:56:21.585 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.567+0000 7fc215721700 1 -- start start 2023-07-05T18:56:21.586 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.567+0000 7f1da4954700 1 Processor -- start 2023-07-05T18:56:21.586 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.567+0000 7fd583369700 1 -- 172.21.15.46:0/3609648808 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd57c142480 msgr2=0x7fd57c0b41d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:56:21.586 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.567+0000 7fd583369700 1 --2- 172.21.15.46:0/3609648808 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd57c142480 0x7fd57c0b41d0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fd57800bae0 tx=0x7fd57800bdf0 comp rx=0 tx=0).stop 2023-07-05T18:56:21.587 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.567+0000 7fd583369700 1 -- 172.21.15.46:0/3609648808 shutdown_connections 2023-07-05T18:56:21.587 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.567+0000 7fd583369700 1 --2- 172.21.15.46:0/3609648808 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd57c142480 0x7fd57c0b41d0 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:21.587 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.567+0000 7fd583369700 1 -- 172.21.15.46:0/3609648808 >> 172.21.15.46:0/3609648808 conn(0x7fd57c06af10 msgr2=0x7fd57c06b2e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-05T18:56:21.587 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.568+0000 7ffa57564700 1 Processor -- start 2023-07-05T18:56:21.587 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.568+0000 7fd583369700 1 -- 172.21.15.46:0/3609648808 shutdown_connections 2023-07-05T18:56:21.588 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.567+0000 7f1da4954700 1 -- start start 2023-07-05T18:56:21.588 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.568+0000 7f1da4954700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f1da0069e00 0x7f1da0161950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:56:21.588 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.568+0000 7f1da4954700 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1da0161e90 con 0x7f1da006c8c0 2023-07-05T18:56:21.588 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.568+0000 7f1da4954700 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1da01644c0 con 0x7f1da00b2bf0 2023-07-05T18:56:21.588 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.568+0000 7f1da4954700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1da0164760 con 0x7f1da0069e00 2023-07-05T18:56:21.589 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.568+0000 7fc215721700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fc2100adea0 0x7fc210070eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:56:21.589 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.568+0000 7fc215721700 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc2100cc760 con 0x7fc2100713f0 2023-07-05T18:56:21.589 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.568+0000 7fc215721700 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc21015a890 con 0x7fc21006fff0 2023-07-05T18:56:21.589 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.568+0000 7fc215721700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc210070470 con 0x7fc2100adea0 2023-07-05T18:56:21.590 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.568+0000 7fc20e7fc700 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7fc2100713f0 0x7fc21006f8e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:57268/0 (socket says 172.21.15.46:57268) 2023-07-05T18:56:21.590 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.568+0000 7fc20e7fc700 1 -- 172.21.15.46:0/3019959065 learned_addr learned my addr 172.21.15.46:0/3019959065 (peer_addr_for_me v1:172.21.15.46:0/0) 2023-07-05T18:56:21.590 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.568+0000 7fd583369700 1 -- 172.21.15.46:0/3609648808 wait complete. 2023-07-05T18:56:21.590 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.569+0000 7f1d9dd9b700 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7f1da006c8c0 0x7f1da006a1d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:57274/0 (socket says 172.21.15.46:57274) 2023-07-05T18:56:21.591 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.569+0000 7f1d9dd9b700 1 -- 172.21.15.46:0/2797313791 learned_addr learned my addr 172.21.15.46:0/2797313791 (peer_addr_for_me v1:172.21.15.46:0/0) 2023-07-05T18:56:21.591 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.569+0000 7fc20dffb700 1 -- 172.21.15.46:0/3019959065 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3947413757 0 0) 0x7fc2100cc760 con 0x7fc2100713f0 2023-07-05T18:56:21.591 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.569+0000 7fc20effd700 1 --2- 172.21.15.46:0/3019959065 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fc2100adea0 0x7fc210070eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:56:21.591 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.569+0000 7fc20dffb700 1 -- 172.21.15.46:0/3019959065 --> v1:172.21.15.46:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc1f80035b0 con 0x7fc2100713f0 2023-07-05T18:56:21.592 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.568+0000 7ffa57564700 1 -- start start 2023-07-05T18:56:21.592 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.569+0000 7ffa57564700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7ffa5006a340 0x7ffa5015e9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:56:21.592 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.569+0000 7ffa57564700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ffa500cdfb0 0x7ffa50160da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:56:21.592 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.569+0000 7ffa57564700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ffa501609d0 0x7ffa501612e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:56:21.593 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.569+0000 7ffa57564700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa500b4070 con 0x7ffa501609d0 2023-07-05T18:56:21.593 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.569+0000 7ffa57564700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa5015eef0 con 0x7ffa500cdfb0 2023-07-05T18:56:21.593 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.569+0000 7ffa57564700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffa500c6c10 con 0x7ffa5006a340 2023-07-05T18:56:21.593 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.569+0000 7fc46b7fe700 1 -- 172.21.15.46:0/225230340 <== mon.1 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc47800cea0 con 0x7fc4840ade50 2023-07-05T18:56:21.594 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.569+0000 7fc46b7fe700 1 -- 172.21.15.46:0/225230340 <== mon.1 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc4780070d0 con 0x7fc4840ade50 2023-07-05T18:56:21.594 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.569+0000 7fc46b7fe700 1 -- 172.21.15.46:0/225230340 <== mon.1 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc478007480 con 0x7fc4840ade50 2023-07-05T18:56:21.594 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.569+0000 7fc48936f700 1 -- 172.21.15.46:0/225230340 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc484159630 con 0x7fc4840ade50 2023-07-05T18:56:21.594 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.569+0000 7fc48936f700 1 -- 172.21.15.46:0/225230340 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc484159bf0 con 0x7fc4840ade50 2023-07-05T18:56:21.594 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.570+0000 7fd583369700 1 Processor -- start 2023-07-05T18:56:21.595 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.570+0000 7ffa55b01700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ffa501609d0 0x7ffa501612e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:56:21.595 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.570+0000 7ffa55b01700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ffa501609d0 0x7ffa501612e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:58008/0 (socket says 172.21.15.46:58008) 2023-07-05T18:56:21.595 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.570+0000 7ffa55b01700 1 -- 172.21.15.46:0/755488746 learned_addr learned my addr 172.21.15.46:0/755488746 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-07-05T18:56:21.596 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.570+0000 7fd583369700 1 -- start start 2023-07-05T18:56:21.596 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.569+0000 7f1d9e59c700 1 --2- 172.21.15.46:0/2797313791 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f1da0069e00 0x7f1da0161950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:56:21.596 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.570+0000 7f1d9e59c700 1 -- 172.21.15.46:0/2797313791 >> v1:172.21.15.73:6789/0 conn(0x7f1da00b2bf0 legacy=0x7f1da00b3070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:56:21.596 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.570+0000 7f1d9e59c700 1 -- 172.21.15.46:0/2797313791 >> v1:172.21.15.46:6789/0 conn(0x7f1da006c8c0 legacy=0x7f1da006a1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:56:21.596 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.570+0000 7f1d9e59c700 1 -- 172.21.15.46:0/2797313791 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1da0164a40 con 0x7f1da0069e00 2023-07-05T18:56:21.597 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.570+0000 7ffa55b01700 1 -- 172.21.15.46:0/755488746 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7ffa5006a340 msgr2=0x7ffa5015e9b0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-07-05T18:56:21.597 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.570+0000 7ffa55b01700 1 --2- 172.21.15.46:0/755488746 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7ffa5006a340 0x7ffa5015e9b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:21.597 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.570+0000 7ffa55b01700 1 -- 172.21.15.46:0/755488746 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ffa500cdfb0 msgr2=0x7ffa50160da0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-07-05T18:56:21.597 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.570+0000 7ffa55b01700 1 --2- 172.21.15.46:0/755488746 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ffa500cdfb0 0x7ffa50160da0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:21.597 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.570+0000 7ffa55b01700 1 -- 172.21.15.46:0/755488746 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa40009550 con 0x7ffa501609d0 2023-07-05T18:56:21.598 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.571+0000 7f1d9e59c700 1 --2- 172.21.15.46:0/2797313791 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f1da0069e00 0x7f1da0161950 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f1d900097f0 tx=0x7f1d90009b00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4f4c641f035225e6 server_cookie=0 in_seq=0 out_seq=0 2023-07-05T18:56:21.598 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.571+0000 7fd583369700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd57c0b4710 0x7fd57c137c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:56:21.598 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.571+0000 7fd583369700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd57c13f4c0 0x7fd57c1581b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:56:21.598 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.571+0000 7fd583369700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fd57c142480 0x7fd57c1f5b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:56:21.599 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.571+0000 7fd583369700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd57c1fa690 con 0x7fd57c13f4c0 2023-07-05T18:56:21.599 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.571+0000 7fd583369700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd57c1f6050 con 0x7fd57c0b4710 2023-07-05T18:56:21.599 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.571+0000 7fd583369700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd57c1fa110 con 0x7fd57c142480 2023-07-05T18:56:21.599 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.571+0000 7fd581105700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd57c0b4710 0x7fd57c137c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:56:21.599 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.571+0000 7fd581105700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd57c0b4710 0x7fd57c137c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.46:57496/0 (socket says 172.21.15.46:57496) 2023-07-05T18:56:21.599 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.571+0000 7fd581105700 1 -- 172.21.15.46:0/2445161947 learned_addr learned my addr 172.21.15.46:0/2445161947 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-07-05T18:56:21.599 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.571+0000 7fd581906700 1 --2- 172.21.15.46:0/2445161947 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fd57c142480 0x7fd57c1f5b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:56:21.600 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.571+0000 7fd580904700 1 --2- 172.21.15.46:0/2445161947 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd57c13f4c0 0x7fd57c1581b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:56:21.600 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.571+0000 7f1d9d59a700 1 -- 172.21.15.46:0/2797313791 <== mon.2 v2:172.21.15.73:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d90004230 con 0x7f1da0069e00 2023-07-05T18:56:21.600 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.571+0000 7f1d9d59a700 1 -- 172.21.15.46:0/2797313791 <== mon.2 v2:172.21.15.73:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1d90004390 con 0x7f1da0069e00 2023-07-05T18:56:21.600 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.571+0000 7f1d9d59a700 1 -- 172.21.15.46:0/2797313791 <== mon.2 v2:172.21.15.73:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d900036a0 con 0x7f1da0069e00 2023-07-05T18:56:21.601 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.570+0000 7fc20dffb700 1 -- 172.21.15.46:0/3019959065 <== mon.1 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3847808139 0 0) 0x7fc21015a890 con 0x7fc21006fff0 2023-07-05T18:56:21.601 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.570+0000 7fc20dffb700 1 -- 172.21.15.46:0/3019959065 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc2100cc760 con 0x7fc21006fff0 2023-07-05T18:56:21.601 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.570+0000 7fc20effd700 1 -- 172.21.15.46:0/3019959065 >> v1:172.21.15.73:6789/0 conn(0x7fc21006fff0 legacy=0x7fc21006cac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:56:21.601 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.570+0000 7fc20effd700 1 -- 172.21.15.46:0/3019959065 >> v1:172.21.15.46:6789/0 conn(0x7fc2100713f0 legacy=0x7fc21006f8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:56:21.601 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.570+0000 7fc20effd700 1 -- 172.21.15.46:0/3019959065 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc2100caed0 con 0x7fc2100adea0 2023-07-05T18:56:21.601 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.571+0000 7fc20effd700 1 --2- 172.21.15.46:0/3019959065 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fc2100adea0 0x7fc210070eb0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fc208009dc0 tx=0x7fc20800b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ec52e3883a6821db server_cookie=0 in_seq=0 out_seq=0 2023-07-05T18:56:21.601 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.571+0000 7fc20dffb700 1 -- 172.21.15.46:0/3019959065 <== mon.2 v2:172.21.15.73:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc208014ce0 con 0x7fc2100adea0 2023-07-05T18:56:21.602 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.571+0000 7fc20dffb700 1 -- 172.21.15.46:0/3019959065 <== mon.2 v2:172.21.15.73:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc208014e40 con 0x7fc2100adea0 2023-07-05T18:56:21.602 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.571+0000 7fc20dffb700 1 -- 172.21.15.46:0/3019959065 <== mon.2 v2:172.21.15.73:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc208003c60 con 0x7fc2100adea0 2023-07-05T18:56:21.603 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.572+0000 7fd581105700 1 -- 172.21.15.46:0/2445161947 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fd57c142480 msgr2=0x7fd57c1f5b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:56:21.603 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.572+0000 7fd581105700 1 --2- 172.21.15.46:0/2445161947 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fd57c142480 0x7fd57c1f5b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:21.603 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.572+0000 7fd581105700 1 -- 172.21.15.46:0/2445161947 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd57c13f4c0 msgr2=0x7fd57c1581b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:56:21.603 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.572+0000 7fd581105700 1 --2- 172.21.15.46:0/2445161947 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd57c13f4c0 0x7fd57c1581b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:21.603 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.572+0000 7fd581105700 1 -- 172.21.15.46:0/2445161947 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd57800b740 con 0x7fd57c0b4710 2023-07-05T18:56:21.603 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.572+0000 7fd581105700 1 --2- 172.21.15.46:0/2445161947 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd57c0b4710 0x7fd57c137c40 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fd56c00c500 tx=0x7fd56c00c810 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-05T18:56:21.604 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.572+0000 7fc48936f700 1 -- 172.21.15.46:0/225230340 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc48415a0d0 con 0x7fc4840ade50 2023-07-05T18:56:21.604 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.572+0000 7fc215721700 1 -- 172.21.15.46:0/3019959065 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fc2100adea0 msgr2=0x7fc210070eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:56:21.604 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.572+0000 7fc215721700 1 --2- 172.21.15.46:0/3019959065 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fc2100adea0 0x7fc210070eb0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fc208009dc0 tx=0x7fc20800b330 comp rx=0 tx=0).stop 2023-07-05T18:56:21.605 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.572+0000 7ffa55b01700 1 --2- 172.21.15.46:0/755488746 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ffa501609d0 0x7ffa501612e0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7ffa4800b780 tx=0x7ffa4800bb40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-05T18:56:21.605 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.572+0000 7fd571ffb700 1 -- 172.21.15.46:0/2445161947 <== mon.1 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd56c005d70 con 0x7fd57c0b4710 2023-07-05T18:56:21.605 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.572+0000 7fd571ffb700 1 -- 172.21.15.46:0/2445161947 <== mon.1 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd56c0070d0 con 0x7fd57c0b4710 2023-07-05T18:56:21.606 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.572+0000 7fd571ffb700 1 -- 172.21.15.46:0/2445161947 <== mon.1 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd56c007460 con 0x7fd57c0b4710 2023-07-05T18:56:21.606 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.572+0000 7fd583369700 1 -- 172.21.15.46:0/2445161947 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd57c0cfaa0 con 0x7fd57c0b4710 2023-07-05T18:56:21.606 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.572+0000 7fc215721700 1 -- 172.21.15.46:0/3019959065 shutdown_connections 2023-07-05T18:56:21.607 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.572+0000 7fc215721700 1 --2- 172.21.15.46:0/3019959065 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fc2100adea0 0x7fc210070eb0 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:21.607 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.572+0000 7fc215721700 1 -- 172.21.15.46:0/3019959065 >> 172.21.15.46:0/3019959065 conn(0x7fc2100ce860 msgr2=0x7fc2100cec30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-05T18:56:21.607 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.572+0000 7fc215721700 1 -- 172.21.15.46:0/3019959065 shutdown_connections 2023-07-05T18:56:21.607 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.572+0000 7fc215721700 1 -- 172.21.15.46:0/3019959065 wait complete. 2023-07-05T18:56:21.607 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.573+0000 7f0e5452f700 1 Processor -- start 2023-07-05T18:56:21.608 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.573+0000 7f0e5452f700 1 -- start start 2023-07-05T18:56:21.608 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.574+0000 7fc215721700 1 Processor -- start 2023-07-05T18:56:21.608 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.574+0000 7ffa45ffb700 1 -- 172.21.15.46:0/755488746 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa4800f840 con 0x7ffa501609d0 2023-07-05T18:56:21.608 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.574+0000 7ffa45ffb700 1 -- 172.21.15.46:0/755488746 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffa4800f9a0 con 0x7ffa501609d0 2023-07-05T18:56:21.608 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.574+0000 7ffa45ffb700 1 -- 172.21.15.46:0/755488746 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa4800fd30 con 0x7ffa501609d0 2023-07-05T18:56:21.609 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.574+0000 7ffa57564700 1 -- 172.21.15.46:0/755488746 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffa500c6e90 con 0x7ffa501609d0 2023-07-05T18:56:21.609 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.574+0000 7ffa57564700 1 -- 172.21.15.46:0/755488746 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffa50163990 con 0x7ffa501609d0 2023-07-05T18:56:21.609 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.573+0000 7fc46b7fe700 1 -- 172.21.15.46:0/225230340 <== mon.1 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fc4780075e0 con 0x7fc4840ade50 2023-07-05T18:56:21.609 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.573+0000 7fc46b7fe700 1 --2- 172.21.15.46:0/225230340 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7fc47006ad30 0x7fc47006d1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:56:21.609 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.574+0000 7fc46b7fe700 1 -- 172.21.15.46:0/225230340 <== mon.1 v2:172.21.15.73:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fc478088f00 con 0x7fc4840ade50 2023-07-05T18:56:21.610 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.572+0000 7fd583369700 1 -- 172.21.15.46:0/2445161947 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd57c0cf4e0 con 0x7fd57c0b4710 2023-07-05T18:56:21.610 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.572+0000 7f1da4954700 1 -- 172.21.15.46:0/2797313791 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f1da0069e00 msgr2=0x7f1da0161950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:56:21.611 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.572+0000 7f1da4954700 1 --2- 172.21.15.46:0/2797313791 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f1da0069e00 0x7f1da0161950 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f1d900097f0 tx=0x7f1d90009b00 comp rx=0 tx=0).stop 2023-07-05T18:56:21.611 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.573+0000 7f1da4954700 1 -- 172.21.15.46:0/2797313791 shutdown_connections 2023-07-05T18:56:21.611 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.573+0000 7f1da4954700 1 --2- 172.21.15.46:0/2797313791 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f1da0069e00 0x7f1da0161950 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:21.611 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.573+0000 7f1da4954700 1 -- 172.21.15.46:0/2797313791 >> 172.21.15.46:0/2797313791 conn(0x7f1da006af10 msgr2=0x7f1da006b2e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-05T18:56:21.612 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.575+0000 7fd571ffb700 1 -- 172.21.15.46:0/2445161947 <== mon.1 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fd56c0075c0 con 0x7fd57c0b4710 2023-07-05T18:56:21.612 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.575+0000 7fc482ffd700 1 --2- 172.21.15.46:0/225230340 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7fc47006ad30 0x7fc47006d1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:56:21.613 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.574+0000 7f0e5452f700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f0e4c15c8c0 0x7f0e4c069e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:56:21.613 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.575+0000 7f0e5452f700 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0e4c0ccf10 con 0x7f0e4c15c4f0 2023-07-05T18:56:21.613 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.575+0000 7f0e5452f700 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0e4c0cdab0 con 0x7f0e4c06a340 2023-07-05T18:56:21.613 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.575+0000 7f0e5452f700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0e4c06a7c0 con 0x7f0e4c15c8c0 2023-07-05T18:56:21.613 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.575+0000 7f0e52acc700 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7f0e4c06a340 0x7f0e4c06f5b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.46:43208/0 (socket says 172.21.15.46:43208) 2023-07-05T18:56:21.614 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.575+0000 7f0e52acc700 1 -- 172.21.15.46:0/3978413591 learned_addr learned my addr 172.21.15.46:0/3978413591 (peer_addr_for_me v1:172.21.15.46:0/0) 2023-07-05T18:56:21.614 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.575+0000 7f0e51aca700 1 --2- 172.21.15.46:0/3978413591 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f0e4c15c8c0 0x7f0e4c069e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:56:21.614 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.575+0000 7fd571ffb700 1 --2- 172.21.15.46:0/2445161947 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7fd56006ad30 0x7fd56006d1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:56:21.615 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.575+0000 7fc215721700 1 -- start start 2023-07-05T18:56:21.616 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.576+0000 7fc215721700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc21006fff0 0x7fc2100c46f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:56:21.616 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.576+0000 7fc215721700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc2100713f0 0x7fc2100b41d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:56:21.616 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.576+0000 7fc215721700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fc2100adea0 0x7fc210144760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:56:21.617 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.576+0000 7fc215721700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc210145720 con 0x7fc21006fff0 2023-07-05T18:56:21.617 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.576+0000 7fc215721700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2100b3730 con 0x7fc2100713f0 2023-07-05T18:56:21.617 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.576+0000 7fc215721700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc210145160 con 0x7fc2100adea0 2023-07-05T18:56:21.617 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.576+0000 7fc20effd700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc21006fff0 0x7fc2100c46f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:56:21.617 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.576+0000 7fc20effd700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc21006fff0 0x7fc2100c46f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:58028/0 (socket says 172.21.15.46:58028) 2023-07-05T18:56:21.617 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.576+0000 7fc20effd700 1 -- 172.21.15.46:0/2224576256 learned_addr learned my addr 172.21.15.46:0/2224576256 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-07-05T18:56:21.617 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.576+0000 7fc20e7fc700 1 --2- 172.21.15.46:0/2224576256 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc2100713f0 0x7fc2100b41d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:56:21.618 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.576+0000 7f1da4954700 1 -- 172.21.15.46:0/2797313791 shutdown_connections 2023-07-05T18:56:21.618 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.576+0000 7f1da4954700 1 -- 172.21.15.46:0/2797313791 wait complete. 2023-07-05T18:56:21.618 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.576+0000 7fc20f7fe700 1 --2- 172.21.15.46:0/2224576256 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fc2100adea0 0x7fc210144760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:56:21.618 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.576+0000 7fc20effd700 1 -- 172.21.15.46:0/2224576256 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fc2100adea0 msgr2=0x7fc210144760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:56:21.619 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.576+0000 7fc20effd700 1 --2- 172.21.15.46:0/2224576256 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fc2100adea0 0x7fc210144760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:21.619 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.576+0000 7fc20effd700 1 -- 172.21.15.46:0/2224576256 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc2100713f0 msgr2=0x7fc2100b41d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:56:21.619 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.576+0000 7fc20effd700 1 --2- 172.21.15.46:0/2224576256 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc2100713f0 0x7fc2100b41d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:21.619 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.576+0000 7fc20effd700 1 -- 172.21.15.46:0/2224576256 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc208009a70 con 0x7fc21006fff0 2023-07-05T18:56:21.619 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.577+0000 7fd583369700 1 -- 172.21.15.46:0/2445161947 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd57c0cf340 con 0x7fd57c0b4710 2023-07-05T18:56:21.620 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.577+0000 7fc482ffd700 1 --2- 172.21.15.46:0/225230340 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7fc47006ad30 0x7fc47006d1e0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fc474000c00 tx=0x7fc474008030 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-05T18:56:21.620 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.577+0000 7f0e512c9700 1 -- 172.21.15.46:0/3978413591 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2251549513 0 0) 0x7f0e4c0ccf10 con 0x7f0e4c15c4f0 2023-07-05T18:56:21.620 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.577+0000 7f0e512c9700 1 -- 172.21.15.46:0/3978413591 --> v1:172.21.15.46:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0e380035b0 con 0x7f0e4c15c4f0 2023-07-05T18:56:21.621 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.577+0000 7fc20effd700 1 --2- 172.21.15.46:0/2224576256 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc21006fff0 0x7fc2100c46f0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fc20800b370 tx=0x7fc208004b40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-05T18:56:21.621 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.577+0000 7f0e51aca700 1 -- 172.21.15.46:0/3978413591 >> v1:172.21.15.73:6789/0 conn(0x7f0e4c06a340 legacy=0x7f0e4c06f5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:56:21.621 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.577+0000 7f0e51aca700 1 -- 172.21.15.46:0/3978413591 >> v1:172.21.15.46:6789/0 conn(0x7f0e4c15c4f0 legacy=0x7f0e4c0cd3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:56:21.621 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.577+0000 7f0e51aca700 1 -- 172.21.15.46:0/3978413591 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e4c0cc8e0 con 0x7f0e4c15c8c0 2023-07-05T18:56:21.622 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.577+0000 7ffa57564700 1 -- 172.21.15.46:0/755488746 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffa300052f0 con 0x7ffa501609d0 2023-07-05T18:56:21.622 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.577+0000 7fd580904700 1 --2- 172.21.15.46:0/2445161947 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7fd56006ad30 0x7fd56006d1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:56:21.622 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.577+0000 7f0e51aca700 1 --2- 172.21.15.46:0/3978413591 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f0e4c15c8c0 0x7f0e4c069e00 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f0e48009870 tx=0x7f0e48009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=157668e6cbe8df71 server_cookie=0 in_seq=0 out_seq=0 2023-07-05T18:56:21.622 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.577+0000 7f0e512c9700 1 -- 172.21.15.46:0/3978413591 <== mon.2 v2:172.21.15.73:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e48011830 con 0x7f0e4c15c8c0 2023-07-05T18:56:21.623 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.577+0000 7f0e512c9700 1 -- 172.21.15.46:0/3978413591 <== mon.2 v2:172.21.15.73:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0e48011990 con 0x7f0e4c15c8c0 2023-07-05T18:56:21.623 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.577+0000 7f0e512c9700 1 -- 172.21.15.46:0/3978413591 <== mon.2 v2:172.21.15.73:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e48011d00 con 0x7f0e4c15c8c0 2023-07-05T18:56:21.623 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.578+0000 7fc1f77fe700 1 -- 172.21.15.46:0/2224576256 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc208010040 con 0x7fc21006fff0 2023-07-05T18:56:21.624 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.578+0000 7fc1f77fe700 1 -- 172.21.15.46:0/2224576256 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc2080144f0 con 0x7fc21006fff0 2023-07-05T18:56:21.624 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.578+0000 7fc1f77fe700 1 -- 172.21.15.46:0/2224576256 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2080098f0 con 0x7fc21006fff0 2023-07-05T18:56:21.624 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.578+0000 7ffa45ffb700 1 -- 172.21.15.46:0/755488746 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7ffa48017400 con 0x7ffa501609d0 2023-07-05T18:56:21.624 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.578+0000 7fc215721700 1 -- 172.21.15.46:0/2224576256 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc210145440 con 0x7fc21006fff0 2023-07-05T18:56:21.625 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.578+0000 7f1da4954700 1 Processor -- start 2023-07-05T18:56:21.625 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.578+0000 7ffa45ffb700 1 --2- 172.21.15.46:0/755488746 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7ffa3406ad30 0x7ffa3406d1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:56:21.625 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.578+0000 7fc215721700 1 -- 172.21.15.46:0/2224576256 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc2100b3cb0 con 0x7fc21006fff0 2023-07-05T18:56:21.626 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.578+0000 7ffa45ffb700 1 -- 172.21.15.46:0/755488746 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6062+0+0 (secure 0 0 0) 0x7ffa48089850 con 0x7ffa501609d0 2023-07-05T18:56:21.626 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.578+0000 7fd580904700 1 --2- 172.21.15.46:0/2445161947 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7fd56006ad30 0x7fd56006d1e0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fd578000c00 tx=0x7fd578013000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-05T18:56:21.627 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.578+0000 7f0e5452f700 1 -- 172.21.15.46:0/3978413591 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f0e4c15c8c0 msgr2=0x7f0e4c069e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:56:21.627 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.578+0000 7f0e5452f700 1 --2- 172.21.15.46:0/3978413591 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f0e4c15c8c0 0x7f0e4c069e00 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f0e48009870 tx=0x7f0e48009b80 comp rx=0 tx=0).stop 2023-07-05T18:56:21.627 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.579+0000 7ffa55300700 1 --2- 172.21.15.46:0/755488746 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7ffa3406ad30 0x7ffa3406d1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:56:21.627 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.578+0000 7f1da4954700 1 -- start start 2023-07-05T18:56:21.628 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.579+0000 7f0e5452f700 1 -- 172.21.15.46:0/3978413591 shutdown_connections 2023-07-05T18:56:21.628 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.579+0000 7f0e5452f700 1 --2- 172.21.15.46:0/3978413591 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f0e4c15c8c0 0x7f0e4c069e00 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:21.628 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.579+0000 7f0e5452f700 1 -- 172.21.15.46:0/3978413591 >> 172.21.15.46:0/3978413591 conn(0x7f0e4c0ce860 msgr2=0x7f0e4c0cec30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-05T18:56:21.628 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.579+0000 7f0e5452f700 1 -- 172.21.15.46:0/3978413591 shutdown_connections 2023-07-05T18:56:21.629 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.579+0000 7f0e5452f700 1 -- 172.21.15.46:0/3978413591 wait complete. 2023-07-05T18:56:21.629 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.579+0000 7ffa55300700 1 --2- 172.21.15.46:0/755488746 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7ffa3406ad30 0x7ffa3406d1e0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7ffa40000c00 tx=0x7ffa40008030 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-05T18:56:21.629 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.579+0000 7fc46b7fe700 1 -- 172.21.15.46:0/225230340 <== mon.1 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fc478054090 con 0x7fc4840ade50 2023-07-05T18:56:21.630 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.579+0000 7f1da4954700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1da0069e00 0x7f1da014f800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:56:21.630 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.579+0000 7f1da4954700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1da00b2bf0 0x7f1da015db10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:56:21.630 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.579+0000 7f1da4954700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f1da015e050 0x7f1da015fb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:56:21.630 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.579+0000 7f1da4954700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1da01f60f0 con 0x7f1da00b2bf0 2023-07-05T18:56:21.630 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.579+0000 7f1da4954700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1da015bae0 con 0x7f1da0069e00 2023-07-05T18:56:21.630 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.579+0000 7f1da4954700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1da015bdc0 con 0x7f1da015e050 2023-07-05T18:56:21.631 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.580+0000 7fd571ffb700 1 -- 172.21.15.46:0/2445161947 <== mon.1 v2:172.21.15.73:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fd56c05d0d0 con 0x7fd57c0b4710 2023-07-05T18:56:21.631 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.580+0000 7f1d9ed9d700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f1da015e050 0x7f1da015fb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:56:21.631 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.580+0000 7f1d9ed9d700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f1da015e050 0x7f1da015fb40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3301/0 says I am v2:172.21.15.46:41722/0 (socket says 172.21.15.46:41722) 2023-07-05T18:56:21.631 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.580+0000 7f1d9ed9d700 1 -- 172.21.15.46:0/3759578861 learned_addr learned my addr 172.21.15.46:0/3759578861 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-07-05T18:56:21.632 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.580+0000 7f1d9dd9b700 1 --2- 172.21.15.46:0/3759578861 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1da00b2bf0 0x7f1da015db10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:56:21.632 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.580+0000 7f1d9e59c700 1 --2- 172.21.15.46:0/3759578861 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1da0069e00 0x7f1da014f800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:56:21.632 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.580+0000 7f1d9dd9b700 1 -- 172.21.15.46:0/3759578861 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f1da015e050 msgr2=0x7f1da015fb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:56:21.632 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.580+0000 7f1d9dd9b700 1 --2- 172.21.15.46:0/3759578861 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f1da015e050 0x7f1da015fb40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:21.632 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.580+0000 7f1d9dd9b700 1 -- 172.21.15.46:0/3759578861 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1da0069e00 msgr2=0x7f1da014f800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:56:21.632 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.580+0000 7f1d9dd9b700 1 --2- 172.21.15.46:0/3759578861 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1da0069e00 0x7f1da014f800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:21.632 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.580+0000 7f1d9dd9b700 1 -- 172.21.15.46:0/3759578861 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1d900094a0 con 0x7f1da00b2bf0 2023-07-05T18:56:21.633 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.581+0000 7f1d9dd9b700 1 --2- 172.21.15.46:0/3759578861 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1da00b2bf0 0x7f1da015db10 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f1d9400c500 tx=0x7f1d9400c810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-05T18:56:21.633 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.581+0000 7f0e5452f700 1 Processor -- start 2023-07-05T18:56:21.634 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.581+0000 7f0e5452f700 1 -- start start 2023-07-05T18:56:21.634 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.582+0000 7f0e5452f700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0e4c06a340 0x7f0e4c0c5b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:56:21.634 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.582+0000 7f0e5452f700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0e4c15c4f0 0x7f0e4c0c1d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:56:21.634 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.582+0000 7f0e5452f700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f0e4c15c8c0 0x7f0e4c0c7000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:56:21.634 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.582+0000 7f0e5452f700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e4c0c4670 con 0x7f0e4c06a340 2023-07-05T18:56:21.634 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.582+0000 7f0e5452f700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e4c0c39f0 con 0x7f0e4c15c4f0 2023-07-05T18:56:21.634 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.582+0000 7f0e5452f700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0e4c0c3cd0 con 0x7f0e4c15c8c0 2023-07-05T18:56:21.635 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.582+0000 7fc215721700 1 -- 172.21.15.46:0/2224576256 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc210071860 con 0x7fc21006fff0 2023-07-05T18:56:21.635 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.582+0000 7f0e52acc700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f0e4c15c8c0 0x7f0e4c0c7000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:56:21.636 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.582+0000 7f0e522cb700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0e4c06a340 0x7f0e4c0c5b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:56:21.636 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.582+0000 7f0e52acc700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f0e4c15c8c0 0x7f0e4c0c7000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3301/0 says I am v2:172.21.15.46:41728/0 (socket says 172.21.15.46:41728) 2023-07-05T18:56:21.636 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.582+0000 7f0e52acc700 1 -- 172.21.15.46:0/62338764 learned_addr learned my addr 172.21.15.46:0/62338764 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-07-05T18:56:21.636 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.583+0000 7f0e51aca700 1 --2- 172.21.15.46:0/62338764 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0e4c15c4f0 0x7f0e4c0c1d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:56:21.636 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.583+0000 7f0e522cb700 1 -- 172.21.15.46:0/62338764 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f0e4c15c8c0 msgr2=0x7f0e4c0c7000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:56:21.637 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.583+0000 7f0e522cb700 1 --2- 172.21.15.46:0/62338764 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f0e4c15c8c0 0x7f0e4c0c7000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:21.637 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.583+0000 7f0e522cb700 1 -- 172.21.15.46:0/62338764 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0e4c15c4f0 msgr2=0x7f0e4c0c1d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:56:21.637 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.583+0000 7f0e522cb700 1 --2- 172.21.15.46:0/62338764 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0e4c15c4f0 0x7f0e4c0c1d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:21.637 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.583+0000 7f0e522cb700 1 -- 172.21.15.46:0/62338764 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e480094a0 con 0x7f0e4c06a340 2023-07-05T18:56:21.637 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.583+0000 7f0e51aca700 1 --2- 172.21.15.46:0/62338764 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0e4c15c4f0 0x7f0e4c0c1d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-05T18:56:21.637 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.583+0000 7f0e522cb700 1 --2- 172.21.15.46:0/62338764 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0e4c06a340 0x7f0e4c0c5b30 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f0e3c00c450 tx=0x7f0e3c00c760 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-05T18:56:21.638 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.584+0000 7fd571ffb700 1 -- 172.21.15.46:0/2445161947 <== mon.1 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fd57c0cf340 con 0x7fd57c0b4710 2023-07-05T18:56:21.638 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.585+0000 7f1d8effd700 1 -- 172.21.15.46:0/3759578861 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d94005d70 con 0x7f1da00b2bf0 2023-07-05T18:56:21.638 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.585+0000 7f1da4954700 1 -- 172.21.15.46:0/3759578861 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1da015c0a0 con 0x7f1da00b2bf0 2023-07-05T18:56:21.638 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.585+0000 7f1da4954700 1 -- 172.21.15.46:0/3759578861 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1da015c660 con 0x7f1da00b2bf0 2023-07-05T18:56:21.639 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.585+0000 7f0e42ffd700 1 -- 172.21.15.46:0/62338764 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e3c0052d0 con 0x7f0e4c06a340 2023-07-05T18:56:21.639 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.585+0000 7f0e5452f700 1 -- 172.21.15.46:0/62338764 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0e4c0c3fb0 con 0x7f0e4c06a340 2023-07-05T18:56:21.639 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.585+0000 7f0e5452f700 1 -- 172.21.15.46:0/62338764 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0e4c0c6360 con 0x7f0e4c06a340 2023-07-05T18:56:21.639 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.587+0000 7f1da4954700 1 -- 172.21.15.46:0/3759578861 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1da015c880 con 0x7f1da00b2bf0 2023-07-05T18:56:21.639 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.587+0000 7f1d8effd700 1 -- 172.21.15.46:0/3759578861 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1d940011c0 con 0x7f1da00b2bf0 2023-07-05T18:56:21.640 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.587+0000 7f1d8effd700 1 -- 172.21.15.46:0/3759578861 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d94007270 con 0x7f1da00b2bf0 2023-07-05T18:56:21.640 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.587+0000 7f0e42ffd700 1 -- 172.21.15.46:0/62338764 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0e3c005430 con 0x7f0e4c06a340 2023-07-05T18:56:21.640 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.587+0000 7f0e42ffd700 1 -- 172.21.15.46:0/62338764 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e3c003880 con 0x7f0e4c06a340 2023-07-05T18:56:21.640 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.588+0000 7fc1f77fe700 1 -- 172.21.15.46:0/2224576256 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fc208004240 con 0x7fc21006fff0 2023-07-05T18:56:21.641 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.589+0000 7fc1f77fe700 1 --2- 172.21.15.46:0/2224576256 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7fc1fc06ad30 0x7fc1fc06d1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:56:21.641 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.589+0000 7fc1f77fe700 1 -- 172.21.15.46:0/2224576256 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fc20808b5d0 con 0x7fc21006fff0 2023-07-05T18:56:21.641 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.588+0000 7ffa45ffb700 1 -- 172.21.15.46:0/755488746 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7ffa48058370 con 0x7ffa501609d0 2023-07-05T18:56:21.641 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.588+0000 7f0e5452f700 1 -- 172.21.15.46:0/62338764 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0e340052f0 con 0x7f0e4c06a340 2023-07-05T18:56:21.642 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.589+0000 7fdda9d4a700 1 Processor -- start 2023-07-05T18:56:21.643 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.590+0000 7fdda9d4a700 1 -- start start 2023-07-05T18:56:21.643 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.591+0000 7fdda9d4a700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fdda415a610 0x7fdda40d0a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:56:21.643 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.591+0000 7fdda9d4a700 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdda40b1cd0 con 0x7fdda40cf090 2023-07-05T18:56:21.643 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.591+0000 7fdda9d4a700 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdda40b10c0 con 0x7fdda40b2160 2023-07-05T18:56:21.644 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.591+0000 7fdda9d4a700 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdda40b13a0 con 0x7fdda415a610 2023-07-05T18:56:21.644 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.591+0000 7fdda3fff700 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7fdda40cf090 0x7fdda40ad700 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:57326/0 (socket says 172.21.15.46:57326) 2023-07-05T18:56:21.644 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.591+0000 7fdda3fff700 1 -- 172.21.15.46:0/90116568 learned_addr learned my addr 172.21.15.46:0/90116568 (peer_addr_for_me v1:172.21.15.46:0/0) 2023-07-05T18:56:21.644 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.591+0000 7fdda37fe700 1 --2- 172.21.15.46:0/90116568 >> v2:172.21.15.73:3300/0 conn(0x7fdda415a610 0x7fdda40d0a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:56:21.644 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.592+0000 7fdda37fe700 1 -- 172.21.15.46:0/90116568 >> v1:172.21.15.73:6789/0 conn(0x7fdda40b2160 legacy=0x7fdda40ce980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-05T18:56:21.645 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.592+0000 7fdda37fe700 1 -- 172.21.15.46:0/90116568 >> v1:172.21.15.46:6789/0 conn(0x7fdda40cf090 legacy=0x7fdda40ad700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:56:21.645 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.592+0000 7fdda37fe700 1 -- 172.21.15.46:0/90116568 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdda40b1680 con 0x7fdda415a610 2023-07-05T18:56:21.645 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.592+0000 7fdda37fe700 1 --2- 172.21.15.46:0/90116568 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fdda415a610 0x7fdda40d0a80 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fdd9c009d90 tx=0x7fdd9c00b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8f799fc635ecdff2 server_cookie=0 in_seq=0 out_seq=0 2023-07-05T18:56:21.645 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.592+0000 7fdda27fc700 1 -- 172.21.15.46:0/90116568 <== mon.1 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd9c00e070 con 0x7fdda415a610 2023-07-05T18:56:21.645 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.592+0000 7fdda27fc700 1 -- 172.21.15.46:0/90116568 <== mon.1 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdd9c00bb90 con 0x7fdda415a610 2023-07-05T18:56:21.645 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.592+0000 7fdda27fc700 1 -- 172.21.15.46:0/90116568 <== mon.1 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd9c003a20 con 0x7fdda415a610 2023-07-05T18:56:21.646 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.593+0000 7fc20e7fc700 1 --2- 172.21.15.46:0/2224576256 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7fc1fc06ad30 0x7fc1fc06d1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:56:21.647 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.593+0000 7fdda9d4a700 1 -- 172.21.15.46:0/90116568 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fdda415a610 msgr2=0x7fdda40d0a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:56:21.647 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.593+0000 7fdda9d4a700 1 --2- 172.21.15.46:0/90116568 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fdda415a610 0x7fdda40d0a80 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fdd9c009d90 tx=0x7fdd9c00b330 comp rx=0 tx=0).stop 2023-07-05T18:56:21.647 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.593+0000 7fc20e7fc700 1 --2- 172.21.15.46:0/2224576256 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7fc1fc06ad30 0x7fc1fc06d1e0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fc210156590 tx=0x7fc204009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-05T18:56:21.648 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.594+0000 7fdda9d4a700 1 -- 172.21.15.46:0/90116568 shutdown_connections 2023-07-05T18:56:21.648 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.594+0000 7fdda9d4a700 1 --2- 172.21.15.46:0/90116568 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fdda415a610 0x7fdda40d0a80 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:21.648 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.594+0000 7fdda9d4a700 1 -- 172.21.15.46:0/90116568 >> 172.21.15.46:0/90116568 conn(0x7fdda40664b0 msgr2=0x7fdda4099e10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-05T18:56:21.649 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.594+0000 7fdda9d4a700 1 -- 172.21.15.46:0/90116568 shutdown_connections 2023-07-05T18:56:21.649 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.594+0000 7fdda9d4a700 1 -- 172.21.15.46:0/90116568 wait complete. 2023-07-05T18:56:21.649 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.595+0000 7fc1f77fe700 1 -- 172.21.15.46:0/2224576256 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fc20805a3a0 con 0x7fc21006fff0 2023-07-05T18:56:21.649 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.595+0000 7fdda9d4a700 1 Processor -- start 2023-07-05T18:56:21.651 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.597+0000 7f1d8effd700 1 -- 172.21.15.46:0/3759578861 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f1d940073d0 con 0x7f1da00b2bf0 2023-07-05T18:56:21.651 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.597+0000 7f1d8effd700 1 --2- 172.21.15.46:0/3759578861 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7f1d8006acb0 0x7f1d8006d160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:56:21.651 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.597+0000 7f1d8effd700 1 -- 172.21.15.46:0/3759578861 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f1d94088b70 con 0x7f1da00b2bf0 2023-07-05T18:56:21.651 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.597+0000 7f1d9e59c700 1 --2- 172.21.15.46:0/3759578861 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7f1d8006acb0 0x7f1d8006d160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:56:21.652 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.598+0000 7f0e42ffd700 1 -- 172.21.15.46:0/62338764 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f0e3c0039e0 con 0x7f0e4c06a340 2023-07-05T18:56:21.652 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.598+0000 7f0e42ffd700 1 --2- 172.21.15.46:0/62338764 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7f0e3006ace0 0x7f0e3006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:56:21.652 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.598+0000 7f0e42ffd700 1 -- 172.21.15.46:0/62338764 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f0e3c089290 con 0x7f0e4c06a340 2023-07-05T18:56:21.652 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.598+0000 7f0e51aca700 1 --2- 172.21.15.46:0/62338764 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7f0e3006ace0 0x7f0e3006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:56:21.653 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.598+0000 7f1d9e59c700 1 --2- 172.21.15.46:0/3759578861 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7f1d8006acb0 0x7f1d8006d160 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f1d900090b0 tx=0x7f1d90008030 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-05T18:56:21.653 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.599+0000 7f0e51aca700 1 --2- 172.21.15.46:0/62338764 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7f0e3006ace0 0x7f0e3006d190 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f0e4c15c380 tx=0x7f0e48008030 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-05T18:56:21.655 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.603+0000 7fdda9d4a700 1 -- start start 2023-07-05T18:56:21.655 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.603+0000 7fdda9d4a700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fdda40b2160 0x7fdda40c70f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:56:21.655 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.603+0000 7fdda9d4a700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fdda40cf090 0x7fdda40b4bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:56:21.655 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.603+0000 7fdda9d4a700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fdda415a610 0x7fdda4153050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:56:21.655 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.603+0000 7fdda9d4a700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdda40af580 con 0x7fdda415a610 2023-07-05T18:56:21.655 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.603+0000 7fdda9d4a700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdda40aea40 con 0x7fdda40b2160 2023-07-05T18:56:21.656 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.603+0000 7fdda9d4a700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdda40aece0 con 0x7fdda40cf090 2023-07-05T18:56:21.656 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.604+0000 7fdda3fff700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fdda415a610 0x7fdda4153050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:56:21.656 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.604+0000 7fdda3fff700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fdda415a610 0x7fdda4153050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:58062/0 (socket says 172.21.15.46:58062) 2023-07-05T18:56:21.656 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.604+0000 7fdda3fff700 1 -- 172.21.15.46:0/1236695969 learned_addr learned my addr 172.21.15.46:0/1236695969 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-07-05T18:56:21.657 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.604+0000 7fdda2ffd700 1 --2- 172.21.15.46:0/1236695969 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fdda40cf090 0x7fdda40b4bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:56:21.657 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.604+0000 7fdda37fe700 1 --2- 172.21.15.46:0/1236695969 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fdda40b2160 0x7fdda40c70f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:56:21.657 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.604+0000 7fdda2ffd700 1 -- 172.21.15.46:0/1236695969 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fdda40b2160 msgr2=0x7fdda40c70f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:56:21.657 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.604+0000 7fdda2ffd700 1 --2- 172.21.15.46:0/1236695969 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fdda40b2160 0x7fdda40c70f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:21.657 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.604+0000 7fdda2ffd700 1 -- 172.21.15.46:0/1236695969 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fdda415a610 msgr2=0x7fdda4153050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:56:21.658 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.604+0000 7fdda2ffd700 1 --2- 172.21.15.46:0/1236695969 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fdda415a610 0x7fdda4153050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:21.658 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.604+0000 7fdda2ffd700 1 -- 172.21.15.46:0/1236695969 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdd9c009a70 con 0x7fdda40cf090 2023-07-05T18:56:21.658 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.604+0000 7fdda3fff700 1 --2- 172.21.15.46:0/1236695969 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fdda415a610 0x7fdda4153050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-05T18:56:21.659 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.604+0000 7fdda2ffd700 1 --2- 172.21.15.46:0/1236695969 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fdda40cf090 0x7fdda40b4bf0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fdda40b25e0 tx=0x7fdd9800c6e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-05T18:56:21.659 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.605+0000 7fdd8bfff700 1 -- 172.21.15.46:0/1236695969 <== mon.2 v2:172.21.15.73:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd98012620 con 0x7fdda40cf090 2023-07-05T18:56:21.659 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.605+0000 7fdd8bfff700 1 -- 172.21.15.46:0/1236695969 <== mon.2 v2:172.21.15.73:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdd98012780 con 0x7fdda40cf090 2023-07-05T18:56:21.659 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.605+0000 7fdd8bfff700 1 -- 172.21.15.46:0/1236695969 <== mon.2 v2:172.21.15.73:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd98012b30 con 0x7fdda40cf090 2023-07-05T18:56:21.659 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.605+0000 7fdda9d4a700 1 -- 172.21.15.46:0/1236695969 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdda40aefc0 con 0x7fdda40cf090 2023-07-05T18:56:21.659 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.605+0000 7fdda9d4a700 1 -- 172.21.15.46:0/1236695969 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdda40b46d0 con 0x7fdda40cf090 2023-07-05T18:56:21.660 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.606+0000 7f1d8effd700 1 -- 172.21.15.46:0/3759578861 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f1d94053dd0 con 0x7f1da00b2bf0 2023-07-05T18:56:21.660 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.607+0000 7fdd8bfff700 1 -- 172.21.15.46:0/1236695969 <== mon.2 v2:172.21.15.73:3301/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fdd98012c90 con 0x7fdda40cf090 2023-07-05T18:56:21.660 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.608+0000 7fdd8bfff700 1 --2- 172.21.15.46:0/1236695969 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7fdd9006ace0 0x7fdd9006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:56:21.661 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.608+0000 7fdda9d4a700 1 -- 172.21.15.46:0/1236695969 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdda40b48f0 con 0x7fdda40cf090 2023-07-05T18:56:21.661 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.608+0000 7fdd8bfff700 1 -- 172.21.15.46:0/1236695969 <== mon.2 v2:172.21.15.73:3301/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fdd98088fa0 con 0x7fdda40cf090 2023-07-05T18:56:21.661 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.608+0000 7fdda37fe700 1 --2- 172.21.15.46:0/1236695969 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7fdd9006ace0 0x7fdd9006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:56:21.661 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.609+0000 7fdda37fe700 1 --2- 172.21.15.46:0/1236695969 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7fdd9006ace0 0x7fdd9006d190 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fdd9c000f80 tx=0x7fdd9c011000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-05T18:56:21.662 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.611+0000 7fb37c2cf700 1 Processor -- start 2023-07-05T18:56:21.662 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.611+0000 7fb37c2cf700 1 -- start start 2023-07-05T18:56:21.662 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.613+0000 7fb37c2cf700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fb3740715c0 0x7fb37406f8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:56:21.663 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.613+0000 7fb37c2cf700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fb37406fe20 0x7fb37406cac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:56:21.663 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.613+0000 7fb37c2cf700 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb3740cc760 con 0x7fb3740adea0 2023-07-05T18:56:21.663 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.613+0000 7fb37c2cf700 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb37415a890 con 0x7fb3740715c0 2023-07-05T18:56:21.663 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.613+0000 7fb37c2cf700 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb3740cd770 con 0x7fb37406fe20 2023-07-05T18:56:21.663 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.613+0000 7fb37a86c700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fb37406fe20 0x7fb37406cac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:56:21.663 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.613+0000 7fb37a86c700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fb37406fe20 0x7fb37406cac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.46:57556/0 (socket says 172.21.15.46:57556) 2023-07-05T18:56:21.663 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.613+0000 7fb37a86c700 1 -- 172.21.15.46:0/4193058011 learned_addr learned my addr 172.21.15.46:0/4193058011 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-07-05T18:56:21.664 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.613+0000 7fb37a86c700 1 -- 172.21.15.46:0/4193058011 >> v2:172.21.15.46:3300/0 conn(0x7fb3740715c0 msgr2=0x7fb37406f8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-05T18:56:21.664 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.613+0000 7fb37a86c700 1 --2- 172.21.15.46:0/4193058011 >> v2:172.21.15.46:3300/0 conn(0x7fb3740715c0 0x7fb37406f8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:21.664 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.613+0000 7fb37a86c700 1 -- 172.21.15.46:0/4193058011 >> v1:172.21.15.46:6789/0 conn(0x7fb3740adea0 legacy=0x7fb374070eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-05T18:56:21.664 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.614+0000 7fb37a86c700 1 -- 172.21.15.46:0/4193058011 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb3740cc9b0 con 0x7fb37406fe20 2023-07-05T18:56:21.664 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.614+0000 7fb37a86c700 1 --2- 172.21.15.46:0/4193058011 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb37406fe20 0x7fb37406cac0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fb374070c70 tx=0x7fb364009bd0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=46beb70b8acd1afd server_cookie=0 in_seq=0 out_seq=0 2023-07-05T18:56:21.665 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.615+0000 7fdd8bfff700 1 -- 172.21.15.46:0/1236695969 <== mon.2 v2:172.21.15.73:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fdd980540e0 con 0x7fdda40cf090 2023-07-05T18:56:21.666 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.615+0000 7fb379069700 1 -- 172.21.15.46:0/4193058011 <== mon.1 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb364004230 con 0x7fb37406fe20 2023-07-05T18:56:21.666 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.615+0000 7fb379069700 1 -- 172.21.15.46:0/4193058011 <== mon.1 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb364004390 con 0x7fb37406fe20 2023-07-05T18:56:21.666 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.615+0000 7fb379069700 1 -- 172.21.15.46:0/4193058011 <== mon.1 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3640036a0 con 0x7fb37406fe20 2023-07-05T18:56:21.666 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.616+0000 7fb37c2cf700 1 -- 172.21.15.46:0/4193058011 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb37406fe20 msgr2=0x7fb37406cac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:56:21.666 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.616+0000 7fb37c2cf700 1 --2- 172.21.15.46:0/4193058011 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb37406fe20 0x7fb37406cac0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fb374070c70 tx=0x7fb364009bd0 comp rx=0 tx=0).stop 2023-07-05T18:56:21.667 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.616+0000 7fb37c2cf700 1 -- 172.21.15.46:0/4193058011 shutdown_connections 2023-07-05T18:56:21.667 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.616+0000 7fb37c2cf700 1 --2- 172.21.15.46:0/4193058011 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb37406fe20 0x7fb37406cac0 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:21.667 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.616+0000 7fb37c2cf700 1 --2- 172.21.15.46:0/4193058011 >> v2:172.21.15.46:3300/0 conn(0x7fb3740715c0 0x7fb37406f8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:21.667 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.616+0000 7fb37c2cf700 1 -- 172.21.15.46:0/4193058011 >> 172.21.15.46:0/4193058011 conn(0x7fb3740ce860 msgr2=0x7fb3740cec30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-05T18:56:21.667 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.617+0000 7fb37c2cf700 1 -- 172.21.15.46:0/4193058011 shutdown_connections 2023-07-05T18:56:21.668 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.617+0000 7fb37c2cf700 1 -- 172.21.15.46:0/4193058011 wait complete. 2023-07-05T18:56:21.668 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.619+0000 7fb37c2cf700 1 Processor -- start 2023-07-05T18:56:21.668 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.619+0000 7fb37c2cf700 1 -- start start 2023-07-05T18:56:21.668 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.620+0000 7fb37c2cf700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb37406fe20 0x7fb3740aae60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:56:21.668 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.620+0000 7fb37c2cf700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fb3740715c0 0x7fb3742029b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:56:21.668 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.620+0000 7fb37c2cf700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb3740adea0 0x7fb3740b3ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:56:21.669 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.620+0000 7fb37c2cf700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb3742032b0 con 0x7fb37406fe20 2023-07-05T18:56:21.669 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.620+0000 7fb37c2cf700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb374203590 con 0x7fb3740adea0 2023-07-05T18:56:21.669 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.620+0000 7fb37c2cf700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb374203870 con 0x7fb3740715c0 2023-07-05T18:56:21.669 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.621+0000 7fb37a06b700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb37406fe20 0x7fb3740aae60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:56:21.669 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.621+0000 7fb37a06b700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb37406fe20 0x7fb3740aae60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:58076/0 (socket says 172.21.15.46:58076) 2023-07-05T18:56:21.669 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.621+0000 7fb37a06b700 1 -- 172.21.15.46:0/3396543896 learned_addr learned my addr 172.21.15.46:0/3396543896 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-07-05T18:56:21.669 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.621+0000 7fb37a06b700 1 -- 172.21.15.46:0/3396543896 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fb3740715c0 msgr2=0x7fb3742029b0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-07-05T18:56:21.670 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.621+0000 7fb37a06b700 1 --2- 172.21.15.46:0/3396543896 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fb3740715c0 0x7fb3742029b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:21.670 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.621+0000 7fb37a06b700 1 -- 172.21.15.46:0/3396543896 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb3740adea0 msgr2=0x7fb3740b3ad0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-07-05T18:56:21.670 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.621+0000 7fb37a06b700 1 --2- 172.21.15.46:0/3396543896 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb3740adea0 0x7fb3740b3ad0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:21.670 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.621+0000 7fb37a06b700 1 -- 172.21.15.46:0/3396543896 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb364009550 con 0x7fb37406fe20 2023-07-05T18:56:21.670 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.622+0000 7fb37a06b700 1 --2- 172.21.15.46:0/3396543896 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb37406fe20 0x7fb3740aae60 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fb36c00c8c0 tx=0x7fb36c00cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-05T18:56:21.670 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.622+0000 7fb36affd700 1 -- 172.21.15.46:0/3396543896 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb36c003e10 con 0x7fb37406fe20 2023-07-05T18:56:21.671 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.622+0000 7fb36affd700 1 -- 172.21.15.46:0/3396543896 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb36c00ce60 con 0x7fb37406fe20 2023-07-05T18:56:21.671 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.622+0000 7fb36affd700 1 -- 172.21.15.46:0/3396543896 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb36c0052b0 con 0x7fb37406fe20 2023-07-05T18:56:21.671 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.622+0000 7fb37c2cf700 1 -- 172.21.15.46:0/3396543896 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb3740a8500 con 0x7fb37406fe20 2023-07-05T18:56:21.671 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.622+0000 7fb37c2cf700 1 -- 172.21.15.46:0/3396543896 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb3740ab3a0 con 0x7fb37406fe20 2023-07-05T18:56:21.671 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.618+0000 7f0e42ffd700 1 -- 172.21.15.46:0/62338764 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f0e3c054590 con 0x7f0e4c06a340 2023-07-05T18:56:21.672 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.626+0000 7fb36affd700 1 -- 172.21.15.46:0/3396543896 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fb36c005410 con 0x7fb37406fe20 2023-07-05T18:56:21.673 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.627+0000 7fb36affd700 1 --2- 172.21.15.46:0/3396543896 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7fb36006af10 0x7fb36006d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:56:21.673 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.627+0000 7fb36affd700 1 -- 172.21.15.46:0/3396543896 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fb36c088c20 con 0x7fb37406fe20 2023-07-05T18:56:21.673 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.627+0000 7fb37c2cf700 1 -- 172.21.15.46:0/3396543896 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb3740a8a20 con 0x7fb37406fe20 2023-07-05T18:56:21.673 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.634+0000 7fb37986a700 1 --2- 172.21.15.46:0/3396543896 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7fb36006af10 0x7fb36006d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:56:21.673 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.637+0000 7fb36affd700 1 -- 172.21.15.46:0/3396543896 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fb3740a8a20 con 0x7fb37406fe20 2023-07-05T18:56:21.673 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.638+0000 7fb37986a700 1 --2- 172.21.15.46:0/3396543896 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7fb36006af10 0x7fb36006d3c0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fb37416a580 tx=0x7fb370006c10 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-05T18:56:21.975 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.973+0000 7ffa57564700 1 -- 172.21.15.46:0/755488746 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7ffa300055a0 con 0x7ffa501609d0 2023-07-05T18:56:21.976 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.974+0000 7ffa45ffb700 1 -- 172.21.15.46:0/755488746 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7ffa48057f00 con 0x7ffa501609d0 2023-07-05T18:56:21.979 INFO:teuthology.orchestra.run.smithi046.stdout:55834574853 2023-07-05T18:56:21.979 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.977+0000 7ffa57564700 1 -- 172.21.15.46:0/755488746 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7ffa3406ad30 msgr2=0x7ffa3406d1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:56:21.979 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.977+0000 7ffa57564700 1 --2- 172.21.15.46:0/755488746 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7ffa3406ad30 0x7ffa3406d1e0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7ffa40000c00 tx=0x7ffa40008030 comp rx=0 tx=0).stop 2023-07-05T18:56:21.980 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.977+0000 7ffa57564700 1 -- 172.21.15.46:0/755488746 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ffa501609d0 msgr2=0x7ffa501612e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:56:21.980 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.977+0000 7ffa57564700 1 --2- 172.21.15.46:0/755488746 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ffa501609d0 0x7ffa501612e0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7ffa4800b780 tx=0x7ffa4800bb40 comp rx=0 tx=0).stop 2023-07-05T18:56:21.980 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.978+0000 7ffa57564700 1 -- 172.21.15.46:0/755488746 shutdown_connections 2023-07-05T18:56:21.981 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.978+0000 7ffa57564700 1 --2- 172.21.15.46:0/755488746 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7ffa3406ad30 0x7ffa3406d1e0 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:21.981 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.978+0000 7ffa57564700 1 --2- 172.21.15.46:0/755488746 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ffa501609d0 0x7ffa501612e0 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:21.981 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.978+0000 7ffa57564700 1 --2- 172.21.15.46:0/755488746 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7ffa5006a340 0x7ffa5015e9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:21.981 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.978+0000 7ffa57564700 1 --2- 172.21.15.46:0/755488746 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ffa500cdfb0 0x7ffa50160da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:21.981 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.978+0000 7ffa57564700 1 -- 172.21.15.46:0/755488746 >> 172.21.15.46:0/755488746 conn(0x7ffa500ce860 msgr2=0x7ffa500ae300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-05T18:56:21.981 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.978+0000 7ffa57564700 1 -- 172.21.15.46:0/755488746 shutdown_connections 2023-07-05T18:56:21.981 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.978+0000 7ffa57564700 1 -- 172.21.15.46:0/755488746 wait complete. 2023-07-05T18:56:21.994 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.992+0000 7fc48936f700 1 -- 172.21.15.46:0/225230340 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) v1 -- 0x7fc48404e1d0 con 0x7fc4840ade50 2023-07-05T18:56:21.995 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.993+0000 7fc46b7fe700 1 -- 172.21.15.46:0/225230340 <== mon.1 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fc4780576b0 con 0x7fc4840ade50 2023-07-05T18:56:21.996 INFO:teuthology.orchestra.run.smithi046.stdout:55834574854 2023-07-05T18:56:21.997 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.993+0000 7fd583369700 1 -- 172.21.15.46:0/2445161947 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) v1 -- 0x7fd57c0cf340 con 0x7fd57c0b4710 2023-07-05T18:56:21.997 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.994+0000 7fd571ffb700 1 -- 172.21.15.46:0/2445161947 <== mon.1 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fd57c0cf340 con 0x7fd57c0b4710 2023-07-05T18:56:21.997 INFO:teuthology.orchestra.run.smithi046.stdout:55834574852 2023-07-05T18:56:22.000 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574853 for osd.1 2023-07-05T18:56:22.001 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.997+0000 7fc48936f700 1 -- 172.21.15.46:0/225230340 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7fc47006ad30 msgr2=0x7fc47006d1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:56:22.001 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.997+0000 7fc48936f700 1 --2- 172.21.15.46:0/225230340 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7fc47006ad30 0x7fc47006d1e0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fc474000c00 tx=0x7fc474008030 comp rx=0 tx=0).stop 2023-07-05T18:56:22.001 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.997+0000 7fc48936f700 1 -- 172.21.15.46:0/225230340 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc4840ade50 msgr2=0x7fc4841f9e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:56:22.001 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.997+0000 7fc48936f700 1 --2- 172.21.15.46:0/225230340 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc4840ade50 0x7fc4841f9e30 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fc478000c00 tx=0x7fc47800c800 comp rx=0 tx=0).stop 2023-07-05T18:56:22.001 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.997+0000 7fc48936f700 1 -- 172.21.15.46:0/225230340 shutdown_connections 2023-07-05T18:56:22.001 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.997+0000 7fc48936f700 1 --2- 172.21.15.46:0/225230340 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7fc47006ad30 0x7fc47006d1e0 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:22.002 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.997+0000 7fc48936f700 1 --2- 172.21.15.46:0/225230340 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fc4841584b0 0x7fc4841fa370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:22.002 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.997+0000 7fc48936f700 1 --2- 172.21.15.46:0/225230340 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc48406a510 0x7fc484158b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:22.002 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.997+0000 7fc48936f700 1 --2- 172.21.15.46:0/225230340 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc4840ade50 0x7fc4841f9e30 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:22.002 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.997+0000 7fc48936f700 1 -- 172.21.15.46:0/225230340 >> 172.21.15.46:0/225230340 conn(0x7fc4840ce860 msgr2=0x7fc4840b3f20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-05T18:56:22.003 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.998+0000 7fd583369700 1 -- 172.21.15.46:0/2445161947 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7fd56006ad30 msgr2=0x7fd56006d1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:56:22.003 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.998+0000 7fd583369700 1 --2- 172.21.15.46:0/2445161947 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7fd56006ad30 0x7fd56006d1e0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fd578000c00 tx=0x7fd578013000 comp rx=0 tx=0).stop 2023-07-05T18:56:22.003 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.998+0000 7fd583369700 1 -- 172.21.15.46:0/2445161947 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd57c0b4710 msgr2=0x7fd57c137c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:56:22.003 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.998+0000 7fd583369700 1 --2- 172.21.15.46:0/2445161947 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd57c0b4710 0x7fd57c137c40 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fd56c00c500 tx=0x7fd56c00c810 comp rx=0 tx=0).stop 2023-07-05T18:56:22.003 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.998+0000 7fc48936f700 1 -- 172.21.15.46:0/225230340 shutdown_connections 2023-07-05T18:56:22.004 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.998+0000 7fc48936f700 1 -- 172.21.15.46:0/225230340 wait complete. 2023-07-05T18:56:22.004 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.998+0000 7fd583369700 1 -- 172.21.15.46:0/2445161947 shutdown_connections 2023-07-05T18:56:22.004 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.998+0000 7fd583369700 1 --2- 172.21.15.46:0/2445161947 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7fd56006ad30 0x7fd56006d1e0 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:22.006 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.998+0000 7fd583369700 1 --2- 172.21.15.46:0/2445161947 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fd57c142480 0x7fd57c1f5b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:22.006 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.998+0000 7fd583369700 1 --2- 172.21.15.46:0/2445161947 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd57c0b4710 0x7fd57c137c40 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:22.006 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.998+0000 7fd583369700 1 --2- 172.21.15.46:0/2445161947 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd57c13f4c0 0x7fd57c1581b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:22.007 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.998+0000 7fd583369700 1 -- 172.21.15.46:0/2445161947 >> 172.21.15.46:0/2445161947 conn(0x7fd57c06af10 msgr2=0x7fd57c0af620 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-05T18:56:22.007 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.998+0000 7fd583369700 1 -- 172.21.15.46:0/2445161947 shutdown_connections 2023-07-05T18:56:22.007 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:21.998+0000 7fd583369700 1 -- 172.21.15.46:0/2445161947 wait complete. 2023-07-05T18:56:22.014 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:22.012+0000 7fdda9d4a700 1 -- 172.21.15.46:0/1236695969 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fdda404e1d0 con 0x7fdda40cf090 2023-07-05T18:56:22.014 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:22.013+0000 7fdd8bfff700 1 -- 172.21.15.46:0/1236695969 <== mon.2 v2:172.21.15.73:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fdd98057700 con 0x7fdda40cf090 2023-07-05T18:56:22.018 INFO:teuthology.orchestra.run.smithi046.stdout:55834574853 2023-07-05T18:56:22.019 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574855 got 55834574854 for osd.4 2023-07-05T18:56:22.019 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:22.016+0000 7fc215721700 1 -- 172.21.15.46:0/2224576256 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) v1 -- 0x7fc210071860 con 0x7fc21006fff0 2023-07-05T18:56:22.020 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:22.017+0000 7fdda9d4a700 1 -- 172.21.15.46:0/1236695969 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7fdd9006ace0 msgr2=0x7fdd9006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:56:22.020 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:22.017+0000 7fdda9d4a700 1 --2- 172.21.15.46:0/1236695969 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7fdd9006ace0 0x7fdd9006d190 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fdd9c000f80 tx=0x7fdd9c011000 comp rx=0 tx=0).stop 2023-07-05T18:56:22.020 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:22.017+0000 7fdda9d4a700 1 -- 172.21.15.46:0/1236695969 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fdda40cf090 msgr2=0x7fdda40b4bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:56:22.020 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:22.017+0000 7fdda9d4a700 1 --2- 172.21.15.46:0/1236695969 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fdda40cf090 0x7fdda40b4bf0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fdda40b25e0 tx=0x7fdd9800c6e0 comp rx=0 tx=0).stop 2023-07-05T18:56:22.021 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:22.017+0000 7fc1f77fe700 1 -- 172.21.15.46:0/2224576256 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fc208059f30 con 0x7fc21006fff0 2023-07-05T18:56:22.021 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:22.017+0000 7fdda9d4a700 1 -- 172.21.15.46:0/1236695969 shutdown_connections 2023-07-05T18:56:22.022 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:22.017+0000 7fdda9d4a700 1 --2- 172.21.15.46:0/1236695969 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7fdd9006ace0 0x7fdd9006d190 secure :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fdd9c000f80 tx=0x7fdd9c011000 comp rx=0 tx=0).stop 2023-07-05T18:56:22.023 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:22.017+0000 7fdda9d4a700 1 --2- 172.21.15.46:0/1236695969 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fdda415a610 0x7fdda4153050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:22.023 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:22.017+0000 7fdda9d4a700 1 --2- 172.21.15.46:0/1236695969 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fdda40b2160 0x7fdda40c70f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:22.023 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:22.017+0000 7fdda9d4a700 1 --2- 172.21.15.46:0/1236695969 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fdda40cf090 0x7fdda40b4bf0 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:22.023 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:22.017+0000 7fdda9d4a700 1 -- 172.21.15.46:0/1236695969 >> 172.21.15.46:0/1236695969 conn(0x7fdda40664b0 msgr2=0x7fdda4159390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-05T18:56:22.024 INFO:teuthology.orchestra.run.smithi046.stdout:55834574853 2023-07-05T18:56:22.024 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:22.017+0000 7f1da4954700 1 -- 172.21.15.46:0/3759578861 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) v1 -- 0x7f1da00672e0 con 0x7f1da00b2bf0 2023-07-05T18:56:22.025 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:22.017+0000 7f1d8effd700 1 -- 172.21.15.46:0/3759578861 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f1d94017090 con 0x7f1da00b2bf0 2023-07-05T18:56:22.025 INFO:teuthology.orchestra.run.smithi046.stdout:55834574854 2023-07-05T18:56:22.027 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:22.019+0000 7fc215721700 1 -- 172.21.15.46:0/2224576256 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7fc1fc06ad30 msgr2=0x7fc1fc06d1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:56:22.027 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:22.019+0000 7fc215721700 1 --2- 172.21.15.46:0/2224576256 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7fc1fc06ad30 0x7fc1fc06d1e0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fc210156590 tx=0x7fc204009040 comp rx=0 tx=0).stop 2023-07-05T18:56:22.028 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:22.019+0000 7fc215721700 1 -- 172.21.15.46:0/2224576256 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc21006fff0 msgr2=0x7fc2100c46f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:56:22.028 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:22.019+0000 7fc215721700 1 --2- 172.21.15.46:0/2224576256 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc21006fff0 0x7fc2100c46f0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fc20800b370 tx=0x7fc208004b40 comp rx=0 tx=0).stop 2023-07-05T18:56:22.029 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:22.019+0000 7fc215721700 1 -- 172.21.15.46:0/2224576256 shutdown_connections 2023-07-05T18:56:22.029 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:22.019+0000 7fc215721700 1 --2- 172.21.15.46:0/2224576256 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7fc1fc06ad30 0x7fc1fc06d1e0 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:22.029 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:22.019+0000 7fc215721700 1 --2- 172.21.15.46:0/2224576256 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fc2100adea0 0x7fc210144760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:22.029 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:22.019+0000 7fc215721700 1 --2- 172.21.15.46:0/2224576256 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc21006fff0 0x7fc2100c46f0 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:22.030 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:22.019+0000 7fc215721700 1 --2- 172.21.15.46:0/2224576256 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc2100713f0 0x7fc2100b41d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:22.030 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:22.019+0000 7fc215721700 1 -- 172.21.15.46:0/2224576256 >> 172.21.15.46:0/2224576256 conn(0x7fc2100ce860 msgr2=0x7fc2100af9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-05T18:56:22.030 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:22.019+0000 7fc215721700 1 -- 172.21.15.46:0/2224576256 shutdown_connections 2023-07-05T18:56:22.031 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:22.019+0000 7fc215721700 1 -- 172.21.15.46:0/2224576256 wait complete. 2023-07-05T18:56:22.031 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:22.021+0000 7fdda9d4a700 1 -- 172.21.15.46:0/1236695969 shutdown_connections 2023-07-05T18:56:22.032 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:22.021+0000 7fdda9d4a700 1 -- 172.21.15.46:0/1236695969 wait complete. 2023-07-05T18:56:22.033 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:22.023+0000 7f1da4954700 1 -- 172.21.15.46:0/3759578861 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7f1d8006acb0 msgr2=0x7f1d8006d160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:56:22.033 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:22.023+0000 7f1da4954700 1 --2- 172.21.15.46:0/3759578861 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7f1d8006acb0 0x7f1d8006d160 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f1d900090b0 tx=0x7f1d90008030 comp rx=0 tx=0).stop 2023-07-05T18:56:22.033 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:22.023+0000 7f1da4954700 1 -- 172.21.15.46:0/3759578861 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1da00b2bf0 msgr2=0x7f1da015db10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:56:22.033 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:22.023+0000 7f1da4954700 1 --2- 172.21.15.46:0/3759578861 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1da00b2bf0 0x7f1da015db10 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f1d9400c500 tx=0x7f1d9400c810 comp rx=0 tx=0).stop 2023-07-05T18:56:22.034 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:22.023+0000 7f1da4954700 1 -- 172.21.15.46:0/3759578861 shutdown_connections 2023-07-05T18:56:22.034 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:22.023+0000 7f1da4954700 1 --2- 172.21.15.46:0/3759578861 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7f1d8006acb0 0x7f1d8006d160 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:22.034 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:22.023+0000 7f1da4954700 1 --2- 172.21.15.46:0/3759578861 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f1da015e050 0x7f1da015fb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:22.034 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:22.023+0000 7f1da4954700 1 --2- 172.21.15.46:0/3759578861 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1da0069e00 0x7f1da014f800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:22.035 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:22.023+0000 7f1da4954700 1 --2- 172.21.15.46:0/3759578861 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1da00b2bf0 0x7f1da015db10 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:22.035 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:22.023+0000 7f1da4954700 1 -- 172.21.15.46:0/3759578861 >> 172.21.15.46:0/3759578861 conn(0x7f1da006af10 msgr2=0x7f1da006e9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-05T18:56:22.035 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:22.024+0000 7f1da4954700 1 -- 172.21.15.46:0/3759578861 shutdown_connections 2023-07-05T18:56:22.035 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:22.024+0000 7f1da4954700 1 -- 172.21.15.46:0/3759578861 wait complete. 2023-07-05T18:56:22.036 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574853 got 55834574852 for osd.7 2023-07-05T18:56:22.036 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:22.032+0000 7f0e5452f700 1 -- 172.21.15.46:0/62338764 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f0e34005870 con 0x7f0e4c06a340 2023-07-05T18:56:22.037 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:22.032+0000 7f0e42ffd700 1 -- 172.21.15.46:0/62338764 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f0e3c017020 con 0x7f0e4c06a340 2023-07-05T18:56:22.037 INFO:teuthology.orchestra.run.smithi046.stdout:55834574854 2023-07-05T18:56:22.038 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:22.036+0000 7f0e5452f700 1 -- 172.21.15.46:0/62338764 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7f0e3006ace0 msgr2=0x7f0e3006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:56:22.038 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:22.036+0000 7f0e5452f700 1 --2- 172.21.15.46:0/62338764 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7f0e3006ace0 0x7f0e3006d190 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f0e4c15c380 tx=0x7f0e48008030 comp rx=0 tx=0).stop 2023-07-05T18:56:22.039 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:22.036+0000 7f0e5452f700 1 -- 172.21.15.46:0/62338764 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0e4c06a340 msgr2=0x7f0e4c0c5b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:56:22.039 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:22.036+0000 7f0e5452f700 1 --2- 172.21.15.46:0/62338764 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0e4c06a340 0x7f0e4c0c5b30 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f0e3c00c450 tx=0x7f0e3c00c760 comp rx=0 tx=0).stop 2023-07-05T18:56:22.039 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:22.036+0000 7f0e5452f700 1 -- 172.21.15.46:0/62338764 shutdown_connections 2023-07-05T18:56:22.039 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:22.036+0000 7f0e5452f700 1 --2- 172.21.15.46:0/62338764 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7f0e3006ace0 0x7f0e3006d190 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:22.039 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:22.036+0000 7f0e5452f700 1 --2- 172.21.15.46:0/62338764 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f0e4c15c8c0 0x7f0e4c0c7000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:22.039 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:22.036+0000 7f0e5452f700 1 --2- 172.21.15.46:0/62338764 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0e4c06a340 0x7f0e4c0c5b30 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:22.039 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:22.036+0000 7f0e5452f700 1 --2- 172.21.15.46:0/62338764 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0e4c15c4f0 0x7f0e4c0c1d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:22.039 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:22.036+0000 7f0e5452f700 1 -- 172.21.15.46:0/62338764 >> 172.21.15.46:0/62338764 conn(0x7f0e4c0ce860 msgr2=0x7f0e4c15b980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-05T18:56:22.040 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:22.037+0000 7f0e5452f700 1 -- 172.21.15.46:0/62338764 shutdown_connections 2023-07-05T18:56:22.040 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:22.037+0000 7f0e5452f700 1 -- 172.21.15.46:0/62338764 wait complete. 2023-07-05T18:56:22.041 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574853 for osd.0 2023-07-05T18:56:22.042 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574855 got 55834574854 for osd.6 2023-07-05T18:56:22.043 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574853 for osd.5 2023-07-05T18:56:22.043 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:22.040+0000 7fb37c2cf700 1 -- 172.21.15.46:0/3396543896 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fb3740a8a20 con 0x7fb37406fe20 2023-07-05T18:56:22.044 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:22.041+0000 7fb36affd700 1 -- 172.21.15.46:0/3396543896 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fb36c017090 con 0x7fb37406fe20 2023-07-05T18:56:22.044 INFO:teuthology.orchestra.run.smithi046.stdout:55834574852 2023-07-05T18:56:22.045 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:22.043+0000 7fb37c2cf700 1 -- 172.21.15.46:0/3396543896 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7fb36006af10 msgr2=0x7fb36006d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:56:22.045 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:22.043+0000 7fb37c2cf700 1 --2- 172.21.15.46:0/3396543896 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7fb36006af10 0x7fb36006d3c0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fb37416a580 tx=0x7fb370006c10 comp rx=0 tx=0).stop 2023-07-05T18:56:22.045 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:22.043+0000 7fb37c2cf700 1 -- 172.21.15.46:0/3396543896 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb37406fe20 msgr2=0x7fb3740aae60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:56:22.045 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:22.043+0000 7fb37c2cf700 1 --2- 172.21.15.46:0/3396543896 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb37406fe20 0x7fb3740aae60 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fb36c00c8c0 tx=0x7fb36c00cc80 comp rx=0 tx=0).stop 2023-07-05T18:56:22.047 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:22.045+0000 7fb37c2cf700 1 -- 172.21.15.46:0/3396543896 shutdown_connections 2023-07-05T18:56:22.047 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:22.045+0000 7fb37c2cf700 1 --2- 172.21.15.46:0/3396543896 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7fb36006af10 0x7fb36006d3c0 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:22.047 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:22.045+0000 7fb37c2cf700 1 --2- 172.21.15.46:0/3396543896 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb3740adea0 0x7fb3740b3ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:22.047 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:22.045+0000 7fb37c2cf700 1 --2- 172.21.15.46:0/3396543896 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb37406fe20 0x7fb3740aae60 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:22.047 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:22.045+0000 7fb37c2cf700 1 --2- 172.21.15.46:0/3396543896 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fb3740715c0 0x7fb3742029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:22.047 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:22.045+0000 7fb37c2cf700 1 -- 172.21.15.46:0/3396543896 >> 172.21.15.46:0/3396543896 conn(0x7fb3740ce860 msgr2=0x7fb374152d40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-05T18:56:22.047 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:22.045+0000 7fb37c2cf700 1 -- 172.21.15.46:0/3396543896 shutdown_connections 2023-07-05T18:56:22.048 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:22.045+0000 7fb37c2cf700 1 -- 172.21.15.46:0/3396543896 wait complete. 2023-07-05T18:56:22.053 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574855 got 55834574854 for osd.3 2023-07-05T18:56:22.060 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574853 got 55834574852 for osd.2 2023-07-05T18:56:23.002 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-07-05T18:56:23.020 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2023-07-05T18:56:23.037 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2023-07-05T18:56:23.046 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-07-05T18:56:23.047 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2023-07-05T18:56:23.047 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2023-07-05T18:56:23.056 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-07-05T18:56:23.062 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-07-05T18:56:23.231 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:23.228+0000 7efdf4c6c700 1 Processor -- start 2023-07-05T18:56:23.232 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:23.229+0000 7efdf4c6c700 1 -- start start 2023-07-05T18:56:23.234 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:23.231+0000 7efdf4c6c700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7efdf00afa10 0x7efdf00cf450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:56:23.234 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:23.231+0000 7efdf4c6c700 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efdf006c440 con 0x7efdf00aff60 2023-07-05T18:56:23.234 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:23.231+0000 7efdf4c6c700 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efdf006cf10 con 0x7efdf00c3a80 2023-07-05T18:56:23.234 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:23.231+0000 7efdf4c6c700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efdf00ce920 con 0x7efdf00afa10 2023-07-05T18:56:23.237 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:23.235+0000 7efdee59c700 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7efdf00c3a80 0x7efdf00c3e50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.46:43272/0 (socket says 172.21.15.46:43272) 2023-07-05T18:56:23.237 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:23.235+0000 7efdee59c700 1 -- 172.21.15.46:0/1902866670 learned_addr learned my addr 172.21.15.46:0/1902866670 (peer_addr_for_me v1:172.21.15.46:0/0) 2023-07-05T18:56:23.240 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:23.238+0000 7efded59a700 1 -- 172.21.15.46:0/1902866670 <== mon.1 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 463276042 0 0) 0x7efdf006cf10 con 0x7efdf00c3a80 2023-07-05T18:56:23.240 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:23.238+0000 7efded59a700 1 -- 172.21.15.46:0/1902866670 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7efdd80035b0 con 0x7efdf00c3a80 2023-07-05T18:56:23.245 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:23.244+0000 7efdeed9d700 1 --2- 172.21.15.46:0/1902866670 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7efdf00afa10 0x7efdf00cf450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:56:23.246 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:23.244+0000 7efdeed9d700 1 -- 172.21.15.46:0/1902866670 >> v1:172.21.15.73:6789/0 conn(0x7efdf00c3a80 legacy=0x7efdf00c3e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:56:23.246 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:23.244+0000 7efdeed9d700 1 -- 172.21.15.46:0/1902866670 >> v1:172.21.15.46:6789/0 conn(0x7efdf00aff60 legacy=0x7efdf00ced40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:56:23.246 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:23.244+0000 7efdeed9d700 1 -- 172.21.15.46:0/1902866670 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efdf006c670 con 0x7efdf00afa10 2023-07-05T18:56:23.246 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:23.244+0000 7efdeed9d700 1 --2- 172.21.15.46:0/1902866670 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7efdf00afa10 0x7efdf00cf450 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7efde8009dc0 tx=0x7efde800b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ffcb436f7447653f server_cookie=0 in_seq=0 out_seq=0 2023-07-05T18:56:23.248 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:23.247+0000 7efded59a700 1 -- 172.21.15.46:0/1902866670 <== mon.2 v2:172.21.15.73:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efde800e070 con 0x7efdf00afa10 2023-07-05T18:56:23.249 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:23.247+0000 7efded59a700 1 -- 172.21.15.46:0/1902866670 <== mon.2 v2:172.21.15.73:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efde8003a20 con 0x7efdf00afa10 2023-07-05T18:56:23.249 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:23.247+0000 7efded59a700 1 -- 172.21.15.46:0/1902866670 <== mon.2 v2:172.21.15.73:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efde4001700 con 0x7efdf00afa10 2023-07-05T18:56:23.250 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:23.248+0000 7efdf4c6c700 1 -- 172.21.15.46:0/1902866670 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7efdf00afa10 msgr2=0x7efdf00cf450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:56:23.250 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:23.248+0000 7efdf4c6c700 1 --2- 172.21.15.46:0/1902866670 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7efdf00afa10 0x7efdf00cf450 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7efde8009dc0 tx=0x7efde800b330 comp rx=0 tx=0).stop 2023-07-05T18:56:23.251 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:23.249+0000 7fc88f602700 1 Processor -- start 2023-07-05T18:56:23.253 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:23.251+0000 7efdf4c6c700 1 -- 172.21.15.46:0/1902866670 shutdown_connections 2023-07-05T18:56:23.253 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:23.251+0000 7efdf4c6c700 1 --2- 172.21.15.46:0/1902866670 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7efdf00afa10 0x7efdf00cf450 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:23.253 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:23.251+0000 7efdf4c6c700 1 -- 172.21.15.46:0/1902866670 >> 172.21.15.46:0/1902866670 conn(0x7efdf0099de0 msgr2=0x7efdf00d0ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-05T18:56:23.254 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:23.250+0000 7fc88f602700 1 -- start start 2023-07-05T18:56:23.254 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:23.251+0000 7fc88f602700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fc8880ade50 0x7fc888069e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:56:23.254 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:23.251+0000 7fc88f602700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fc88806da80 0x7fc88806a340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:56:23.254 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:23.251+0000 7fc88f602700 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc888071110 con 0x7fc8881584b0 2023-07-05T18:56:23.254 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:23.251+0000 7fc88f602700 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc888071930 con 0x7fc8880ade50 2023-07-05T18:56:23.255 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:23.251+0000 7fc88f602700 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc8880713b0 con 0x7fc88806da80 2023-07-05T18:56:23.255 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:23.251+0000 7fc88d39e700 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7fc8881584b0 0x7fc88815c100 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:57358/0 (socket says 172.21.15.46:57358) 2023-07-05T18:56:23.255 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:23.251+0000 7fc88d39e700 1 -- 172.21.15.46:0/1228004338 learned_addr learned my addr 172.21.15.46:0/1228004338 (peer_addr_for_me v1:172.21.15.46:0/0) 2023-07-05T18:56:23.255 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:23.251+0000 7fc88cb9d700 1 --2- 172.21.15.46:0/1228004338 >> v2:172.21.15.46:3300/0 conn(0x7fc8880ade50 0x7fc888069e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:56:23.255 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:23.251+0000 7fc88db9f700 1 --2- 172.21.15.46:0/1228004338 >> v2:172.21.15.73:3300/0 conn(0x7fc88806da80 0x7fc88806a340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:56:23.256 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:23.252+0000 7efdf4c6c700 1 -- 172.21.15.46:0/1902866670 shutdown_connections 2023-07-05T18:56:23.256 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:23.252+0000 7efdf4c6c700 1 -- 172.21.15.46:0/1902866670 wait complete. 2023-07-05T18:56:23.256 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:23.252+0000 7fc88cb9d700 1 -- 172.21.15.46:0/1228004338 >> v2:172.21.15.73:3300/0 conn(0x7fc88806da80 msgr2=0x7fc88806a340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-05T18:56:23.257 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:23.252+0000 7fc88cb9d700 1 --2- 172.21.15.46:0/1228004338 >> v2:172.21.15.73:3300/0 conn(0x7fc88806da80 0x7fc88806a340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:23.257 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:23.252+0000 7fc88cb9d700 1 -- 172.21.15.46:0/1228004338 >> v1:172.21.15.46:6789/0 conn(0x7fc8881584b0 legacy=0x7fc88815c100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:56:23.257 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:23.252+0000 7fc88cb9d700 1 -- 172.21.15.46:0/1228004338 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc88806fc70 con 0x7fc8880ade50 2023-07-05T18:56:23.257 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:23.252+0000 7fc88cb9d700 1 --2- 172.21.15.46:0/1228004338 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc8880ade50 0x7fc888069e00 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fc88806dee0 tx=0x7fc87c00acc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c8e7eb2c4064dd49 server_cookie=0 in_seq=0 out_seq=0 2023-07-05T18:56:23.257 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:23.253+0000 7fc887fff700 1 -- 172.21.15.46:0/1228004338 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc87c00cb70 con 0x7fc8880ade50 2023-07-05T18:56:23.257 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:23.253+0000 7fc887fff700 1 -- 172.21.15.46:0/1228004338 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc87c00ccd0 con 0x7fc8880ade50 2023-07-05T18:56:23.257 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:23.253+0000 7fc887fff700 1 -- 172.21.15.46:0/1228004338 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc87c018620 con 0x7fc8880ade50 2023-07-05T18:56:23.258 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:23.254+0000 7efdf4c6c700 1 Processor -- start 2023-07-05T18:56:23.259 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:23.254+0000 7fc88f602700 1 -- 172.21.15.46:0/1228004338 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc8880ade50 msgr2=0x7fc888069e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:56:23.259 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:23.254+0000 7fc88f602700 1 --2- 172.21.15.46:0/1228004338 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc8880ade50 0x7fc888069e00 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fc88806dee0 tx=0x7fc87c00acc0 comp rx=0 tx=0).stop 2023-07-05T18:56:23.259 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:23.254+0000 7fc88f602700 1 -- 172.21.15.46:0/1228004338 shutdown_connections 2023-07-05T18:56:23.259 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:23.254+0000 7fc88f602700 1 --2- 172.21.15.46:0/1228004338 >> v2:172.21.15.73:3300/0 conn(0x7fc88806da80 0x7fc88806a340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:23.259 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:23.254+0000 7fc88f602700 1 --2- 172.21.15.46:0/1228004338 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc8880ade50 0x7fc888069e00 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:23.260 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:23.254+0000 7fc88f602700 1 -- 172.21.15.46:0/1228004338 >> 172.21.15.46:0/1228004338 conn(0x7fc8880ce860 msgr2=0x7fc8880cec30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-05T18:56:23.260 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:23.254+0000 7fc88f602700 1 -- 172.21.15.46:0/1228004338 shutdown_connections 2023-07-05T18:56:23.260 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:23.254+0000 7fc88f602700 1 -- 172.21.15.46:0/1228004338 wait complete. 2023-07-05T18:56:23.261 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:23.255+0000 7f9c80d44700 1 Processor -- start 2023-07-05T18:56:23.262 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:23.254+0000 7efdf4c6c700 1 -- start start 2023-07-05T18:56:23.262 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:23.255+0000 7efdf4c6c700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7efdf00afa10 0x7efdf00c8590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:56:23.262 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:23.255+0000 7efdf4c6c700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7efdf00aff60 0x7efdf015cd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:56:23.262 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:23.255+0000 7efdf4c6c700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7efdf00c3a80 0x7efdf00cf6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:56:23.263 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:23.255+0000 7efdf4c6c700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efdf00c5f20 con 0x7efdf00c3a80 2023-07-05T18:56:23.263 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:23.255+0000 7efdf4c6c700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efdf00c6200 con 0x7efdf00afa10 2023-07-05T18:56:23.263 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:23.255+0000 7efdf4c6c700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efdf00c64e0 con 0x7efdf00aff60 2023-07-05T18:56:23.263 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:23.256+0000 7fc88f602700 1 Processor -- start 2023-07-05T18:56:23.264 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:23.255+0000 7f9c80d44700 1 -- start start 2023-07-05T18:56:23.265 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:23.257+0000 7f9c80d44700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f9c7c06a510 0x7f9c7c0ccb40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:56:23.265 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:23.257+0000 7f9c80d44700 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9c7c071110 con 0x7f9c7c0ade50 2023-07-05T18:56:23.265 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:23.257+0000 7f9c80d44700 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9c7c0713b0 con 0x7f9c7c1584b0 2023-07-05T18:56:23.265 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:23.257+0000 7f9c80d44700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9c7c071930 con 0x7f9c7c06a510 2023-07-05T18:56:23.265 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:23.257+0000 7fc88f602700 1 -- start start 2023-07-05T18:56:23.266 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:23.258+0000 7f9c79d9b700 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7f9c7c0ade50 0x7f9c7c069e00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:57370/0 (socket says 172.21.15.46:57370) 2023-07-05T18:56:23.266 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:23.258+0000 7f9c79d9b700 1 -- 172.21.15.46:0/2991284377 learned_addr learned my addr 172.21.15.46:0/2991284377 (peer_addr_for_me v1:172.21.15.46:0/0) 2023-07-05T18:56:23.267 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:23.258+0000 7fc88f602700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc88806da80 0x7fc88814a890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:56:23.267 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:23.258+0000 7fc88f602700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc8880ade50 0x7fc888152930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:56:23.268 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:23.258+0000 7fc88f602700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fc8881584b0 0x7fc88814bfb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:56:23.269 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:23.258+0000 7fc88f602700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8880c2370 con 0x7fc88806da80 2023-07-05T18:56:23.269 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:23.258+0000 7fc88f602700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc88814ba80 con 0x7fc8880ade50 2023-07-05T18:56:23.269 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:23.258+0000 7fc88f602700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc88814af00 con 0x7fc8881584b0 2023-07-05T18:56:23.269 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:23.258+0000 7fc88d39e700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc88806da80 0x7fc88814a890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:56:23.269 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:23.258+0000 7fc88d39e700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc88806da80 0x7fc88814a890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:58104/0 (socket says 172.21.15.46:58104) 2023-07-05T18:56:23.270 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:23.258+0000 7fc88d39e700 1 -- 172.21.15.46:0/1965667519 learned_addr learned my addr 172.21.15.46:0/1965667519 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-07-05T18:56:23.270 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:23.258+0000 7fc88cb9d700 1 --2- 172.21.15.46:0/1965667519 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc8880ade50 0x7fc888152930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:56:23.270 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:23.256+0000 7efdeed9d700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7efdf00c3a80 0x7efdf00cf6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:56:23.271 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:23.257+0000 7efdeed9d700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7efdf00c3a80 0x7efdf00cf6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:58092/0 (socket says 172.21.15.46:58092) 2023-07-05T18:56:23.271 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:23.257+0000 7efdeed9d700 1 -- 172.21.15.46:0/3653010261 learned_addr learned my addr 172.21.15.46:0/3653010261 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-07-05T18:56:23.271 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:23.257+0000 7efdee59c700 1 --2- 172.21.15.46:0/3653010261 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7efdf00afa10 0x7efdf00c8590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:56:23.271 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:23.257+0000 7efdedd9b700 1 --2- 172.21.15.46:0/3653010261 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7efdf00aff60 0x7efdf015cd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:56:23.272 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:23.257+0000 7efdee59c700 1 -- 172.21.15.46:0/3653010261 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7efdf00aff60 msgr2=0x7efdf015cd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:56:23.272 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:23.257+0000 7efdee59c700 1 --2- 172.21.15.46:0/3653010261 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7efdf00aff60 0x7efdf015cd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:23.272 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:23.257+0000 7efdee59c700 1 -- 172.21.15.46:0/3653010261 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7efdf00c3a80 msgr2=0x7efdf00cf6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:56:23.272 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:23.257+0000 7efdee59c700 1 --2- 172.21.15.46:0/3653010261 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7efdf00c3a80 0x7efdf00cf6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:23.273 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:23.257+0000 7efdee59c700 1 -- 172.21.15.46:0/3653010261 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efde8009a70 con 0x7efdf00afa10 2023-07-05T18:56:23.273 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:23.258+0000 7efdee59c700 1 --2- 172.21.15.46:0/3653010261 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7efdf00afa10 0x7efdf00c8590 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7efde400c710 tx=0x7efde400ca20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-05T18:56:23.273 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:23.258+0000 7efddeffd700 1 -- 172.21.15.46:0/3653010261 <== mon.1 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efde4004c80 con 0x7efdf00afa10 2023-07-05T18:56:23.273 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:23.258+0000 7efddeffd700 1 -- 172.21.15.46:0/3653010261 <== mon.1 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efde4004e00 con 0x7efdf00afa10 2023-07-05T18:56:23.273 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:23.258+0000 7efddeffd700 1 -- 172.21.15.46:0/3653010261 <== mon.1 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efde4007310 con 0x7efdf00afa10 2023-07-05T18:56:23.274 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:23.259+0000 7fc88d39e700 1 -- 172.21.15.46:0/1965667519 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fc8881584b0 msgr2=0x7fc88814bfb0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-07-05T18:56:23.274 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:23.259+0000 7fc88d39e700 1 --2- 172.21.15.46:0/1965667519 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fc8881584b0 0x7fc88814bfb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:23.275 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:23.259+0000 7fc88d39e700 1 -- 172.21.15.46:0/1965667519 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc8880ade50 msgr2=0x7fc888152930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:56:23.275 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:23.259+0000 7fc88d39e700 1 --2- 172.21.15.46:0/1965667519 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc8880ade50 0x7fc888152930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:23.276 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:23.259+0000 7fc88d39e700 1 -- 172.21.15.46:0/1965667519 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc87c00a640 con 0x7fc88806da80 2023-07-05T18:56:23.276 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:23.259+0000 7f9c7ad9d700 1 --2- 172.21.15.46:0/2991284377 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f9c7c06a510 0x7f9c7c0ccb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:56:23.277 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:23.259+0000 7fc88d39e700 1 --2- 172.21.15.46:0/1965667519 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc88806da80 0x7fc88814a890 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fc88000c520 tx=0x7fc88000c830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-05T18:56:23.277 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:23.259+0000 7efdf4c6c700 1 -- 172.21.15.46:0/3653010261 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efdf00c67c0 con 0x7efdf00afa10 2023-07-05T18:56:23.277 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:23.259+0000 7efdf4c6c700 1 -- 172.21.15.46:0/3653010261 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efdf00c5bb0 con 0x7efdf00afa10 2023-07-05T18:56:23.278 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:23.260+0000 7f9c7959a700 1 -- 172.21.15.46:0/2991284377 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2028855172 0 0) 0x7f9c7c071110 con 0x7f9c7c0ade50 2023-07-05T18:56:23.278 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:23.260+0000 7f9c7959a700 1 -- 172.21.15.46:0/2991284377 --> v1:172.21.15.46:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9c640034d0 con 0x7f9c7c0ade50 2023-07-05T18:56:23.279 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:23.260+0000 7f9c7959a700 1 -- 172.21.15.46:0/2991284377 <== mon.1 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1374921427 0 0) 0x7f9c7c0713b0 con 0x7f9c7c1584b0 2023-07-05T18:56:23.279 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:23.260+0000 7f9c7959a700 1 -- 172.21.15.46:0/2991284377 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9c7c071110 con 0x7f9c7c1584b0 2023-07-05T18:56:23.279 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:23.260+0000 7fc885ffb700 1 -- 172.21.15.46:0/1965667519 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc880005d70 con 0x7fc88806da80 2023-07-05T18:56:23.280 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:23.260+0000 7fc885ffb700 1 -- 172.21.15.46:0/1965667519 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc8800070d0 con 0x7fc88806da80 2023-07-05T18:56:23.280 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:23.260+0000 7fc885ffb700 1 -- 172.21.15.46:0/1965667519 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc880007440 con 0x7fc88806da80 2023-07-05T18:56:23.280 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:23.260+0000 7fc88f602700 1 -- 172.21.15.46:0/1965667519 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc88814b1e0 con 0x7fc88806da80 2023-07-05T18:56:23.280 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:23.260+0000 7fc88f602700 1 -- 172.21.15.46:0/1965667519 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc88814b7a0 con 0x7fc88806da80 2023-07-05T18:56:23.281 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:23.261+0000 7fc88f602700 1 -- 172.21.15.46:0/1965667519 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc8880c24e0 con 0x7fc88806da80 2023-07-05T18:56:23.281 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:23.261+0000 7f9c7959a700 1 -- 172.21.15.46:0/2991284377 <== mon.0 v1:172.21.15.46:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1123457495 0 0) 0x7f9c640034d0 con 0x7f9c7c0ade50 2023-07-05T18:56:23.282 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:23.262+0000 7f9c7959a700 1 -- 172.21.15.46:0/2991284377 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f9c7c06a510 msgr2=0x7f9c7c0ccb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-05T18:56:23.282 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:23.262+0000 7f9c7959a700 1 --2- 172.21.15.46:0/2991284377 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f9c7c06a510 0x7f9c7c0ccb40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:23.282 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:23.262+0000 7f9c7959a700 1 -- 172.21.15.46:0/2991284377 >> v1:172.21.15.73:6789/0 conn(0x7f9c7c1584b0 legacy=0x7f9c7c15c100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:56:23.282 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:23.262+0000 7f9c7959a700 1 -- 172.21.15.46:0/2991284377 --> v1:172.21.15.46:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c7c06fc70 con 0x7f9c7c0ade50 2023-07-05T18:56:23.283 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:23.262+0000 7f9c7959a700 1 -- 172.21.15.46:0/2991284377 <== mon.0 v1:172.21.15.46:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2195585215 0 0) 0x7f9c70004d60 con 0x7f9c7c0ade50 2023-07-05T18:56:23.283 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:23.262+0000 7f9c7959a700 1 -- 172.21.15.46:0/2991284377 >> v1:172.21.15.46:6789/0 conn(0x7f9c7c0ade50 legacy=0x7f9c7c069e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:56:23.283 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:23.262+0000 7f9c7959a700 1 --2- 172.21.15.46:0/2991284377 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9c64003cb0 0x7f9c640040a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:56:23.283 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:23.262+0000 7f9c7959a700 1 --2- 172.21.15.46:0/2991284377 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f9c640067b0 0x7f9c64006c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:56:23.284 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:23.262+0000 7f9c7959a700 1 --2- 172.21.15.46:0/2991284377 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9c640072f0 0x7f9c6400fd10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:56:23.284 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:23.262+0000 7f9c7959a700 1 -- 172.21.15.46:0/2991284377 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c7c071930 con 0x7f9c64003cb0 2023-07-05T18:56:23.284 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:23.262+0000 7f9c7959a700 1 -- 172.21.15.46:0/2991284377 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c640103e0 con 0x7f9c640072f0 2023-07-05T18:56:23.284 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:23.262+0000 7f9c7959a700 1 -- 172.21.15.46:0/2991284377 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9c640105a0 con 0x7f9c640067b0 2023-07-05T18:56:23.285 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:23.262+0000 7efddeffd700 1 -- 172.21.15.46:0/3653010261 <== mon.1 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7efde4007470 con 0x7efdf00afa10 2023-07-05T18:56:23.286 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:23.263+0000 7efddeffd700 1 --2- 172.21.15.46:0/3653010261 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7efdd006adb0 0x7efdd006d260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:56:23.286 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:23.263+0000 7efddeffd700 1 -- 172.21.15.46:0/3653010261 <== mon.1 v2:172.21.15.73:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6062+0+0 (secure 0 0 0) 0x7efde4089170 con 0x7efdf00afa10 2023-07-05T18:56:23.287 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:23.263+0000 7f9c79d9b700 1 --2- 172.21.15.46:0/2991284377 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f9c640067b0 0x7f9c64006c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:56:23.287 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:23.264+0000 7efdedd9b700 1 --2- 172.21.15.46:0/3653010261 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7efdd006adb0 0x7efdd006d260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:56:23.294 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:23.264+0000 7f9c79d9b700 1 -- 172.21.15.46:0/2991284377 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9c640072f0 msgr2=0x7f9c6400fd10 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-07-05T18:56:23.294 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:23.264+0000 7f9c79d9b700 1 --2- 172.21.15.46:0/2991284377 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9c640072f0 0x7f9c6400fd10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:23.294 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:23.264+0000 7f9c79d9b700 1 -- 172.21.15.46:0/2991284377 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9c64003cb0 msgr2=0x7f9c640040a0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-07-05T18:56:23.294 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:23.264+0000 7f9c79d9b700 1 --2- 172.21.15.46:0/2991284377 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9c64003cb0 0x7f9c640040a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:23.294 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:23.264+0000 7f9c79d9b700 1 -- 172.21.15.46:0/2991284377 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c7c06fc70 con 0x7f9c640067b0 2023-07-05T18:56:23.295 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:23.264+0000 7fc885ffb700 1 -- 172.21.15.46:0/1965667519 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fc8800075a0 con 0x7fc88806da80 2023-07-05T18:56:23.295 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:23.264+0000 7fc885ffb700 1 --2- 172.21.15.46:0/1965667519 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7fc87406adb0 0x7fc87406d260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:56:23.295 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:23.264+0000 7fc885ffb700 1 -- 172.21.15.46:0/1965667519 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fc880088ee0 con 0x7fc88806da80 2023-07-05T18:56:23.295 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:23.265+0000 7f9c79d9b700 1 --2- 172.21.15.46:0/2991284377 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f9c640067b0 0x7f9c64006c20 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f9c7000d3d0 tx=0x7f9c64003780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6925a4d1a83a8d28 server_cookie=0 in_seq=0 out_seq=0 2023-07-05T18:56:23.296 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:23.265+0000 7fc88cb9d700 1 --2- 172.21.15.46:0/1965667519 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7fc87406adb0 0x7fc87406d260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:56:23.296 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:23.265+0000 7efdedd9b700 1 --2- 172.21.15.46:0/3653010261 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7efdd006adb0 0x7efdd006d260 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7efdf015ecf0 tx=0x7efde0009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-05T18:56:23.296 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:23.265+0000 7f9c7959a700 1 -- 172.21.15.46:0/2991284377 <== mon.2 v2:172.21.15.73:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c7000f400 con 0x7f9c640067b0 2023-07-05T18:56:23.296 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:23.265+0000 7f9c7959a700 1 -- 172.21.15.46:0/2991284377 <== mon.2 v2:172.21.15.73:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9c7000f560 con 0x7f9c640067b0 2023-07-05T18:56:23.297 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:23.265+0000 7f9c7959a700 1 -- 172.21.15.46:0/2991284377 <== mon.2 v2:172.21.15.73:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c7000f910 con 0x7f9c640067b0 2023-07-05T18:56:23.297 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:23.266+0000 7f9c80d44700 1 -- 172.21.15.46:0/2991284377 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f9c640067b0 msgr2=0x7f9c64006c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:56:23.297 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:23.266+0000 7f9c80d44700 1 --2- 172.21.15.46:0/2991284377 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f9c640067b0 0x7f9c64006c20 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f9c7000d3d0 tx=0x7f9c64003780 comp rx=0 tx=0).stop 2023-07-05T18:56:23.297 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:23.265+0000 7fc88cb9d700 1 --2- 172.21.15.46:0/1965667519 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7fc87406adb0 0x7fc87406d260 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fc8880ae2d0 tx=0x7fc87c012000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-05T18:56:23.298 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:23.266+0000 7f9c7ad9d700 1 -- 172.21.15.46:0/2991284377 reap_dead start 2023-07-05T18:56:23.298 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:23.266+0000 7f9c80d44700 1 -- 172.21.15.46:0/2991284377 shutdown_connections 2023-07-05T18:56:23.298 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:23.266+0000 7f9c80d44700 1 -- 172.21.15.46:0/2991284377 >> 172.21.15.46:0/2991284377 conn(0x7f9c7c0ce860 msgr2=0x7f9c7c0cec30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-05T18:56:23.298 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:23.266+0000 7f9c80d44700 1 -- 172.21.15.46:0/2991284377 shutdown_connections 2023-07-05T18:56:23.298 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:23.267+0000 7f9c80d44700 1 -- 172.21.15.46:0/2991284377 wait complete. 2023-07-05T18:56:23.299 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:23.268+0000 7fa67acda700 1 Processor -- start 2023-07-05T18:56:23.299 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:23.269+0000 7f9c80d44700 1 Processor -- start 2023-07-05T18:56:23.299 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:23.268+0000 7fa67acda700 1 -- start start 2023-07-05T18:56:23.300 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:23.269+0000 7efdf4c6c700 1 -- 172.21.15.46:0/3653010261 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efdf015d3e0 con 0x7efdf00afa10 2023-07-05T18:56:23.300 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:23.270+0000 7fa67acda700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fa674160ce0 0x7fa6740c98f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:56:23.300 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:23.270+0000 7fa67acda700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fa67406b830 0x7fa6740c1db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:56:23.300 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:23.270+0000 7fa67acda700 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa674164ca0 con 0x7fa674164700 2023-07-05T18:56:23.301 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:23.270+0000 7fa67acda700 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa6740cd310 con 0x7fa67406b830 2023-07-05T18:56:23.301 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:23.270+0000 7fa67acda700 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa6741610b0 con 0x7fa674160ce0 2023-07-05T18:56:23.301 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:23.270+0000 7fa673fff700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fa67406b830 0x7fa6740c1db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:56:23.301 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:23.270+0000 7fa673fff700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fa67406b830 0x7fa6740c1db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:58120/0 (socket says 172.21.15.46:58120) 2023-07-05T18:56:23.301 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:23.270+0000 7fa673fff700 1 -- 172.21.15.46:0/640238459 learned_addr learned my addr 172.21.15.46:0/640238459 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-07-05T18:56:23.301 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:23.270+0000 7fa678a76700 1 --2- 172.21.15.46:0/640238459 >> v2:172.21.15.73:3300/0 conn(0x7fa674160ce0 0x7fa6740c98f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:56:23.301 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:23.271+0000 7fa673fff700 1 -- 172.21.15.46:0/640238459 >> v2:172.21.15.73:3300/0 conn(0x7fa674160ce0 msgr2=0x7fa6740c98f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-05T18:56:23.301 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:23.271+0000 7fa673fff700 1 --2- 172.21.15.46:0/640238459 >> v2:172.21.15.73:3300/0 conn(0x7fa674160ce0 0x7fa6740c98f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:23.302 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:23.271+0000 7fa673fff700 1 -- 172.21.15.46:0/640238459 >> v1:172.21.15.46:6789/0 conn(0x7fa674164700 legacy=0x7fa6740cd730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-05T18:56:23.302 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:23.270+0000 7fc885ffb700 1 -- 172.21.15.46:0/1965667519 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fc8800540b0 con 0x7fc88806da80 2023-07-05T18:56:23.302 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:23.269+0000 7f9c80d44700 1 -- start start 2023-07-05T18:56:23.302 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:23.271+0000 7f9c80d44700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f9c7c146b50 0x7f9c7c15b140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:56:23.303 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:23.271+0000 7f9c80d44700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9c7c146f20 0x7f9c7c0a8460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:56:23.303 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:23.271+0000 7f9c80d44700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9c7c15b680 0x7f9c7c0a89a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:56:23.303 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:23.271+0000 7f9c80d44700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c7c0c7ae0 con 0x7f9c7c146f20 2023-07-05T18:56:23.303 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:23.271+0000 7f9c80d44700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c7c0c7dc0 con 0x7f9c7c15b680 2023-07-05T18:56:23.303 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:23.271+0000 7f9c80d44700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9c7c0c80a0 con 0x7f9c7c146b50 2023-07-05T18:56:23.303 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:23.271+0000 7fa673fff700 1 -- 172.21.15.46:0/640238459 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa674164f80 con 0x7fa67406b830 2023-07-05T18:56:23.304 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:23.271+0000 7f9c7a59c700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f9c7c146b50 0x7f9c7c15b140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:56:23.305 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:23.271+0000 7f9c7a59c700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f9c7c146b50 0x7f9c7c15b140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3301/0 says I am v2:172.21.15.46:41814/0 (socket says 172.21.15.46:41814) 2023-07-05T18:56:23.305 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:23.271+0000 7f9c7a59c700 1 -- 172.21.15.46:0/318677343 learned_addr learned my addr 172.21.15.46:0/318677343 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-07-05T18:56:23.305 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:23.271+0000 7f9c7ad9d700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9c7c15b680 0x7f9c7c0a89a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:56:23.305 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:23.271+0000 7f9c79d9b700 1 --2- 172.21.15.46:0/318677343 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9c7c146f20 0x7f9c7c0a8460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:56:23.305 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:23.271+0000 7fa673fff700 1 --2- 172.21.15.46:0/640238459 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa67406b830 0x7fa6740c1db0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fa67404e7b0 tx=0x7fa66c00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=39dc99c09c72f371 server_cookie=0 in_seq=0 out_seq=0 2023-07-05T18:56:23.306 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:23.271+0000 7f9c7a59c700 1 -- 172.21.15.46:0/318677343 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9c7c15b680 msgr2=0x7f9c7c0a89a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:56:23.306 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:23.271+0000 7f9c7a59c700 1 --2- 172.21.15.46:0/318677343 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9c7c15b680 0x7f9c7c0a89a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:23.307 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:23.271+0000 7f9c7a59c700 1 -- 172.21.15.46:0/318677343 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9c7c146f20 msgr2=0x7f9c7c0a8460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:56:23.307 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:23.271+0000 7f9c7a59c700 1 --2- 172.21.15.46:0/318677343 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9c7c146f20 0x7f9c7c0a8460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:23.307 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:23.271+0000 7f9c7a59c700 1 -- 172.21.15.46:0/318677343 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c7c0c8380 con 0x7f9c7c146b50 2023-07-05T18:56:23.307 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:23.272+0000 7f9c7ad9d700 1 --2- 172.21.15.46:0/318677343 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9c7c15b680 0x7f9c7c0a89a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-05T18:56:23.307 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:23.268+0000 7ff29e01e700 1 Processor -- start 2023-07-05T18:56:23.308 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:23.268+0000 7ff29e01e700 1 -- start start 2023-07-05T18:56:23.308 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:23.269+0000 7ff29e01e700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7ff298142480 0x7ff2980b41d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:56:23.308 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:23.269+0000 7ff29e01e700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7ff2980b4710 0x7ff29806d140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:56:23.308 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:23.270+0000 7ff29e01e700 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff29806c8d0 con 0x7ff29813f4c0 2023-07-05T18:56:23.308 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:23.270+0000 7ff29e01e700 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff29806ce90 con 0x7ff298142480 2023-07-05T18:56:23.308 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:23.270+0000 7ff29e01e700 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff29806cbb0 con 0x7ff2980b4710 2023-07-05T18:56:23.308 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:23.270+0000 7ff2977fe700 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7ff29813f4c0 0x7ff29815d6a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.46:43310/0 (socket says 172.21.15.46:43310) 2023-07-05T18:56:23.309 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:23.270+0000 7ff2977fe700 1 -- 172.21.15.46:0/3539496872 learned_addr learned my addr 172.21.15.46:0/3539496872 (peer_addr_for_me v1:172.21.15.46:0/0) 2023-07-05T18:56:23.309 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:23.270+0000 7ff296ffd700 1 --2- 172.21.15.46:0/3539496872 >> v2:172.21.15.46:3300/0 conn(0x7ff298142480 0x7ff2980b41d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:56:23.310 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:23.270+0000 7ff297fff700 1 --2- 172.21.15.46:0/3539496872 >> v2:172.21.15.73:3300/0 conn(0x7ff2980b4710 0x7ff29806d140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:56:23.310 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:23.271+0000 7ff297fff700 1 -- 172.21.15.46:0/3539496872 >> v2:172.21.15.46:3300/0 conn(0x7ff298142480 msgr2=0x7ff2980b41d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-05T18:56:23.310 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:23.271+0000 7ff297fff700 1 --2- 172.21.15.46:0/3539496872 >> v2:172.21.15.46:3300/0 conn(0x7ff298142480 0x7ff2980b41d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:23.310 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:23.271+0000 7ff297fff700 1 -- 172.21.15.46:0/3539496872 >> v1:172.21.15.73:6789/0 conn(0x7ff29813f4c0 legacy=0x7ff29815d6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:56:23.311 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:23.271+0000 7ff297fff700 1 -- 172.21.15.46:0/3539496872 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff2980b39d0 con 0x7ff2980b4710 2023-07-05T18:56:23.311 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:23.271+0000 7ff297fff700 1 --2- 172.21.15.46:0/3539496872 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff2980b4710 0x7ff29806d140 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7ff2981428f0 tx=0x7ff28c009b20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f6a527234ec849e5 server_cookie=0 in_seq=0 out_seq=0 2023-07-05T18:56:23.311 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:23.272+0000 7fa6737fe700 1 -- 172.21.15.46:0/640238459 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa66c00e070 con 0x7fa67406b830 2023-07-05T18:56:23.312 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:23.272+0000 7f9c7a59c700 1 --2- 172.21.15.46:0/318677343 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f9c7c146b50 0x7f9c7c15b140 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f9c7400cfd0 tx=0x7f9c740021a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-05T18:56:23.312 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:23.272+0000 7fa6737fe700 1 -- 172.21.15.46:0/640238459 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa66c00b9c0 con 0x7fa67406b830 2023-07-05T18:56:23.312 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:23.272+0000 7fa6737fe700 1 -- 172.21.15.46:0/640238459 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa66c00bd70 con 0x7fa67406b830 2023-07-05T18:56:23.313 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:23.272+0000 7f9c6affd700 1 -- 172.21.15.46:0/318677343 <== mon.2 v2:172.21.15.73:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c74003c00 con 0x7f9c7c146b50 2023-07-05T18:56:23.313 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:23.272+0000 7f9c6affd700 1 -- 172.21.15.46:0/318677343 <== mon.2 v2:172.21.15.73:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9c74003d80 con 0x7f9c7c146b50 2023-07-05T18:56:23.313 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:23.272+0000 7f9c6affd700 1 -- 172.21.15.46:0/318677343 <== mon.2 v2:172.21.15.73:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c7400ab40 con 0x7f9c7c146b50 2023-07-05T18:56:23.313 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:23.272+0000 7f9c80d44700 1 -- 172.21.15.46:0/318677343 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9c7c0c8660 con 0x7f9c7c146b50 2023-07-05T18:56:23.314 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:23.272+0000 7f9c80d44700 1 -- 172.21.15.46:0/318677343 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9c7c0c5930 con 0x7f9c7c146b50 2023-07-05T18:56:23.314 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:23.273+0000 7fa67acda700 1 -- 172.21.15.46:0/640238459 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa67406b830 msgr2=0x7fa6740c1db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:56:23.315 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:23.273+0000 7fa67acda700 1 --2- 172.21.15.46:0/640238459 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa67406b830 0x7fa6740c1db0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fa67404e7b0 tx=0x7fa66c00b330 comp rx=0 tx=0).stop 2023-07-05T18:56:23.315 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:23.274+0000 7fa67acda700 1 -- 172.21.15.46:0/640238459 shutdown_connections 2023-07-05T18:56:23.315 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:23.274+0000 7fa67acda700 1 --2- 172.21.15.46:0/640238459 >> v2:172.21.15.73:3300/0 conn(0x7fa674160ce0 0x7fa6740c98f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:23.315 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:23.274+0000 7fa67acda700 1 --2- 172.21.15.46:0/640238459 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa67406b830 0x7fa6740c1db0 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:23.315 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:23.274+0000 7fa67acda700 1 -- 172.21.15.46:0/640238459 >> 172.21.15.46:0/640238459 conn(0x7fa6740cb860 msgr2=0x7fa6740cbc60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-05T18:56:23.316 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:23.274+0000 7f9c6affd700 1 -- 172.21.15.46:0/318677343 <== mon.2 v2:172.21.15.73:3301/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f9c7400aca0 con 0x7f9c7c146b50 2023-07-05T18:56:23.316 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:23.274+0000 7f9c80d44700 1 -- 172.21.15.46:0/318677343 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9c600052f0 con 0x7f9c7c146b50 2023-07-05T18:56:23.317 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:23.274+0000 7ff2967fc700 1 -- 172.21.15.46:0/3539496872 <== mon.1 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff28c011830 con 0x7ff2980b4710 2023-07-05T18:56:23.317 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:23.274+0000 7ff2967fc700 1 -- 172.21.15.46:0/3539496872 <== mon.1 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff28c011990 con 0x7ff2980b4710 2023-07-05T18:56:23.317 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:23.274+0000 7ff2967fc700 1 -- 172.21.15.46:0/3539496872 <== mon.1 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff28c011d20 con 0x7ff2980b4710 2023-07-05T18:56:23.317 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:23.275+0000 7efddeffd700 1 -- 172.21.15.46:0/3653010261 <== mon.1 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7efde4054290 con 0x7efdf00afa10 2023-07-05T18:56:23.318 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:23.275+0000 7f9c6affd700 1 --2- 172.21.15.46:0/318677343 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7f9c5c06ad10 0x7f9c5c06d1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:56:23.318 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:23.275+0000 7f9c6affd700 1 -- 172.21.15.46:0/318677343 <== mon.2 v2:172.21.15.73:3301/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f9c74089490 con 0x7f9c7c146b50 2023-07-05T18:56:23.318 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:23.275+0000 7f9c79d9b700 1 --2- 172.21.15.46:0/318677343 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7f9c5c06ad10 0x7f9c5c06d1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:56:23.318 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:23.275+0000 7f9c79d9b700 1 --2- 172.21.15.46:0/318677343 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7f9c5c06ad10 0x7f9c5c06d1c0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f9c7c1fa620 tx=0x7f9c70011000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-05T18:56:23.319 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:23.275+0000 7ff29e01e700 1 -- 172.21.15.46:0/3539496872 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff2980b4710 msgr2=0x7ff29806d140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:56:23.319 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:23.275+0000 7ff29e01e700 1 --2- 172.21.15.46:0/3539496872 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff2980b4710 0x7ff29806d140 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7ff2981428f0 tx=0x7ff28c009b20 comp rx=0 tx=0).stop 2023-07-05T18:56:23.319 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:23.276+0000 7ff29e01e700 1 -- 172.21.15.46:0/3539496872 shutdown_connections 2023-07-05T18:56:23.319 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:23.276+0000 7ff29e01e700 1 --2- 172.21.15.46:0/3539496872 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff2980b4710 0x7ff29806d140 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:23.319 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:23.276+0000 7ff29e01e700 1 --2- 172.21.15.46:0/3539496872 >> v2:172.21.15.46:3300/0 conn(0x7ff298142480 0x7ff2980b41d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:23.320 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:23.276+0000 7ff29e01e700 1 -- 172.21.15.46:0/3539496872 >> 172.21.15.46:0/3539496872 conn(0x7ff29806af10 msgr2=0x7ff29806b2e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-05T18:56:23.320 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:23.276+0000 7ff29e01e700 1 -- 172.21.15.46:0/3539496872 shutdown_connections 2023-07-05T18:56:23.320 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:23.276+0000 7ff29e01e700 1 -- 172.21.15.46:0/3539496872 wait complete. 2023-07-05T18:56:23.320 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:23.277+0000 7fa67acda700 1 -- 172.21.15.46:0/640238459 shutdown_connections 2023-07-05T18:56:23.321 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:23.278+0000 7ff29e01e700 1 Processor -- start 2023-07-05T18:56:23.321 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:23.278+0000 7ff29e01e700 1 -- start start 2023-07-05T18:56:23.321 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:23.279+0000 7ff29e01e700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff2980b4710 0x7ff2981f1a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:56:23.321 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:23.279+0000 7ff29e01e700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7ff29813f4c0 0x7ff2981410b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:56:23.322 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:23.279+0000 7ff29e01e700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff298142480 0x7ff29813b510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:56:23.322 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:23.279+0000 7ff29e01e700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2980ad5f0 con 0x7ff2980b4710 2023-07-05T18:56:23.322 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:23.279+0000 7ff29e01e700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2981415f0 con 0x7ff298142480 2023-07-05T18:56:23.322 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:23.279+0000 7ff29e01e700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff2981f2070 con 0x7ff29813f4c0 2023-07-05T18:56:23.322 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:23.279+0000 7ff2977fe700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff2980b4710 0x7ff2981f1a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:56:23.322 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:23.279+0000 7ff2977fe700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff2980b4710 0x7ff2981f1a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:58136/0 (socket says 172.21.15.46:58136) 2023-07-05T18:56:23.322 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:23.279+0000 7ff2977fe700 1 -- 172.21.15.46:0/2906513877 learned_addr learned my addr 172.21.15.46:0/2906513877 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-07-05T18:56:23.323 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:23.279+0000 7f9c6affd700 1 -- 172.21.15.46:0/318677343 <== mon.2 v2:172.21.15.73:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f9c74054540 con 0x7f9c7c146b50 2023-07-05T18:56:23.323 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:23.279+0000 7ff296ffd700 1 --2- 172.21.15.46:0/2906513877 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7ff29813f4c0 0x7ff2981410b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:56:23.324 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:23.279+0000 7ff2977fe700 1 -- 172.21.15.46:0/2906513877 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7ff29813f4c0 msgr2=0x7ff2981410b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:56:23.324 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:23.279+0000 7ff2977fe700 1 --2- 172.21.15.46:0/2906513877 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7ff29813f4c0 0x7ff2981410b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:23.324 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:23.279+0000 7ff2977fe700 1 -- 172.21.15.46:0/2906513877 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff298142480 msgr2=0x7ff29813b510 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-07-05T18:56:23.324 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:23.279+0000 7ff2977fe700 1 --2- 172.21.15.46:0/2906513877 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff298142480 0x7ff29813b510 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:23.324 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:23.279+0000 7ff2977fe700 1 -- 172.21.15.46:0/2906513877 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff28c0094a0 con 0x7ff2980b4710 2023-07-05T18:56:23.324 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:23.280+0000 7ff2977fe700 1 --2- 172.21.15.46:0/2906513877 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff2980b4710 0x7ff2981f1a40 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7ff29000cba0 tx=0x7ff29000cf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-05T18:56:23.325 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:23.280+0000 7ff27ffff700 1 -- 172.21.15.46:0/2906513877 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff29000ab80 con 0x7ff2980b4710 2023-07-05T18:56:23.325 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:23.280+0000 7ff27ffff700 1 -- 172.21.15.46:0/2906513877 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff29000ace0 con 0x7ff2980b4710 2023-07-05T18:56:23.325 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:23.280+0000 7ff29e01e700 1 -- 172.21.15.46:0/2906513877 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff2981f2350 con 0x7ff2980b4710 2023-07-05T18:56:23.325 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:23.280+0000 7ff29e01e700 1 -- 172.21.15.46:0/2906513877 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff2981f2910 con 0x7ff2980b4710 2023-07-05T18:56:23.325 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:23.281+0000 7ff27ffff700 1 -- 172.21.15.46:0/2906513877 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff290012600 con 0x7ff2980b4710 2023-07-05T18:56:23.325 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:23.283+0000 7ff27ffff700 1 -- 172.21.15.46:0/2906513877 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7ff29001b3b0 con 0x7ff2980b4710 2023-07-05T18:56:23.326 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:23.282+0000 7f8af8ac4700 1 Processor -- start 2023-07-05T18:56:23.326 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:23.282+0000 7f8af8ac4700 1 -- start start 2023-07-05T18:56:23.326 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:23.283+0000 7f8af8ac4700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f8af4071690 0x7f8af40ca520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:56:23.326 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:23.283+0000 7f8af8ac4700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f8af40cdfb0 0x7f8af4069e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:56:23.326 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:23.283+0000 7f8af8ac4700 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8af408adb0 con 0x7f8af40712c0 2023-07-05T18:56:23.327 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:23.283+0000 7f8af8ac4700 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8af40cac20 con 0x7f8af40cdfb0 2023-07-05T18:56:23.327 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:23.283+0000 7f8af8ac4700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8af40caf00 con 0x7f8af4071690 2023-07-05T18:56:23.327 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:23.284+0000 7f8af1d9b700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f8af4071690 0x7f8af40ca520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:56:23.327 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:23.284+0000 7f8af1d9b700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f8af4071690 0x7f8af40ca520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3301/0 says I am v2:172.21.15.46:41830/0 (socket says 172.21.15.46:41830) 2023-07-05T18:56:23.327 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:23.284+0000 7f8af1d9b700 1 -- 172.21.15.46:0/948687098 learned_addr learned my addr 172.21.15.46:0/948687098 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-07-05T18:56:23.328 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:23.284+0000 7ff27ffff700 1 --2- 172.21.15.46:0/2906513877 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7ff28406ace0 0x7ff28406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:56:23.328 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:23.284+0000 7f8af1d9b700 1 -- 172.21.15.46:0/948687098 >> v2:172.21.15.46:3300/0 conn(0x7f8af40cdfb0 msgr2=0x7f8af4069e00 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-07-05T18:56:23.328 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:23.284+0000 7f8af1d9b700 1 --2- 172.21.15.46:0/948687098 >> v2:172.21.15.46:3300/0 conn(0x7f8af40cdfb0 0x7f8af4069e00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:23.329 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:23.284+0000 7f8af1d9b700 1 -- 172.21.15.46:0/948687098 >> v1:172.21.15.73:6789/0 conn(0x7f8af40712c0 legacy=0x7f8af416d720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:56:23.329 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:23.284+0000 7f8af1d9b700 1 -- 172.21.15.46:0/948687098 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8af416cf20 con 0x7f8af4071690 2023-07-05T18:56:23.329 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:23.284+0000 7ff27ffff700 1 -- 172.21.15.46:0/2906513877 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6062+0+0 (secure 0 0 0) 0x7ff290089190 con 0x7ff2980b4710 2023-07-05T18:56:23.329 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:23.284+0000 7f8af1d9b700 1 --2- 172.21.15.46:0/948687098 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f8af4071690 0x7f8af40ca520 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f8ae80089f0 tx=0x7f8ae800d330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c3b55ac9dfe4b3fb server_cookie=0 in_seq=0 out_seq=0 2023-07-05T18:56:23.330 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:23.284+0000 7ff296ffd700 1 --2- 172.21.15.46:0/2906513877 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7ff28406ace0 0x7ff28406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:56:23.330 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:23.284+0000 7f8af159a700 1 -- 172.21.15.46:0/948687098 <== mon.2 v2:172.21.15.73:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ae8010070 con 0x7f8af4071690 2023-07-05T18:56:23.330 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:23.284+0000 7f8af159a700 1 -- 172.21.15.46:0/948687098 <== mon.2 v2:172.21.15.73:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8ae800d9c0 con 0x7f8af4071690 2023-07-05T18:56:23.331 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:23.284+0000 7f8af159a700 1 -- 172.21.15.46:0/948687098 <== mon.2 v2:172.21.15.73:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ae800dd70 con 0x7f8af4071690 2023-07-05T18:56:23.331 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:23.285+0000 7ff296ffd700 1 --2- 172.21.15.46:0/2906513877 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7ff28406ace0 0x7ff28406d190 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7ff2980b1600 tx=0x7ff288008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-05T18:56:23.331 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:23.285+0000 7f8af8ac4700 1 -- 172.21.15.46:0/948687098 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f8af4071690 msgr2=0x7f8af40ca520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:56:23.331 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:23.285+0000 7f8af8ac4700 1 --2- 172.21.15.46:0/948687098 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f8af4071690 0x7f8af40ca520 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f8ae80089f0 tx=0x7f8ae800d330 comp rx=0 tx=0).stop 2023-07-05T18:56:23.333 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:23.286+0000 7fa67acda700 1 -- 172.21.15.46:0/640238459 wait complete. 2023-07-05T18:56:23.333 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:23.287+0000 7fa67acda700 1 Processor -- start 2023-07-05T18:56:23.333 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:23.288+0000 7fa67acda700 1 -- start start 2023-07-05T18:56:23.333 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:23.289+0000 7fa67acda700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fa67406b830 0x7fa6741551b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:56:23.333 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:23.289+0000 7fa67acda700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa674160ce0 0x7fa6740b0d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:56:23.333 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:23.289+0000 7fa67acda700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa674164700 0x7fa6740c6370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:56:23.334 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:23.289+0000 7fa67acda700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa6741556f0 con 0x7fa674164700 2023-07-05T18:56:23.334 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:23.289+0000 7fa67acda700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa6740b1620 con 0x7fa674160ce0 2023-07-05T18:56:23.334 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:23.289+0000 7fa67acda700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa6740b20d0 con 0x7fa67406b830 2023-07-05T18:56:23.334 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:23.289+0000 7fa678a76700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fa67406b830 0x7fa6741551b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:56:23.334 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:23.289+0000 7fa678a76700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fa67406b830 0x7fa6741551b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3301/0 says I am v2:172.21.15.46:41834/0 (socket says 172.21.15.46:41834) 2023-07-05T18:56:23.334 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:23.289+0000 7fa678a76700 1 -- 172.21.15.46:0/2826775603 learned_addr learned my addr 172.21.15.46:0/2826775603 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-07-05T18:56:23.334 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:23.290+0000 7fa679277700 1 --2- 172.21.15.46:0/2826775603 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa674164700 0x7fa6740c6370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:56:23.334 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:23.290+0000 7fa678a76700 1 -- 172.21.15.46:0/2826775603 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa674160ce0 msgr2=0x7fa6740b0d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:56:23.335 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:23.290+0000 7fa678a76700 1 --2- 172.21.15.46:0/2826775603 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa674160ce0 0x7fa6740b0d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:23.335 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:23.290+0000 7fa678a76700 1 -- 172.21.15.46:0/2826775603 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa674164700 msgr2=0x7fa6740c6370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:56:23.335 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:23.290+0000 7fa678a76700 1 --2- 172.21.15.46:0/2826775603 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa674164700 0x7fa6740c6370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:23.335 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:23.290+0000 7fa678a76700 1 -- 172.21.15.46:0/2826775603 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa66c009b30 con 0x7fa67406b830 2023-07-05T18:56:23.335 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:23.290+0000 7fa678a76700 1 --2- 172.21.15.46:0/2826775603 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fa67406b830 0x7fa6741551b0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fa66400d800 tx=0x7fa66400dbc0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-05T18:56:23.335 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:23.290+0000 7fa6717fa700 1 -- 172.21.15.46:0/2826775603 <== mon.2 v2:172.21.15.73:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6640125f0 con 0x7fa67406b830 2023-07-05T18:56:23.335 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:23.290+0000 7fa6717fa700 1 -- 172.21.15.46:0/2826775603 <== mon.2 v2:172.21.15.73:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa664012750 con 0x7fa67406b830 2023-07-05T18:56:23.336 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:23.291+0000 7fa6717fa700 1 -- 172.21.15.46:0/2826775603 <== mon.2 v2:172.21.15.73:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa664012b00 con 0x7fa67406b830 2023-07-05T18:56:23.336 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:23.291+0000 7fa67acda700 1 -- 172.21.15.46:0/2826775603 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa6740b23b0 con 0x7fa67406b830 2023-07-05T18:56:23.336 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:23.291+0000 7fa67acda700 1 -- 172.21.15.46:0/2826775603 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa6740b2970 con 0x7fa67406b830 2023-07-05T18:56:23.336 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:23.292+0000 7fa67acda700 1 -- 172.21.15.46:0/2826775603 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa674066ae0 con 0x7fa67406b830 2023-07-05T18:56:23.336 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:23.293+0000 7fa6717fa700 1 -- 172.21.15.46:0/2826775603 <== mon.2 v2:172.21.15.73:3301/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fa664012c60 con 0x7fa67406b830 2023-07-05T18:56:23.336 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:23.294+0000 7fa6717fa700 1 --2- 172.21.15.46:0/2826775603 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7fa65c06adf0 0x7fa65c06d2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:56:23.336 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:23.294+0000 7fa6717fa700 1 -- 172.21.15.46:0/2826775603 <== mon.2 v2:172.21.15.73:3301/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fa66408a1b0 con 0x7fa67406b830 2023-07-05T18:56:23.337 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:23.286+0000 7ff29e01e700 1 -- 172.21.15.46:0/2906513877 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff2780052f0 con 0x7ff2980b4710 2023-07-05T18:56:23.337 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:23.294+0000 7ff27ffff700 1 -- 172.21.15.46:0/2906513877 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7ff290054250 con 0x7ff2980b4710 2023-07-05T18:56:23.337 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:23.297+0000 7fa673fff700 1 --2- 172.21.15.46:0/2826775603 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7fa65c06adf0 0x7fa65c06d2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:56:23.337 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:23.297+0000 7fa6717fa700 1 -- 172.21.15.46:0/2826775603 <== mon.2 v2:172.21.15.73:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fa6640553d0 con 0x7fa67406b830 2023-07-05T18:56:23.338 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:23.298+0000 7fa673fff700 1 --2- 172.21.15.46:0/2826775603 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7fa65c06adf0 0x7fa65c06d2a0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fa66c000f80 tx=0x7fa66c010000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-05T18:56:23.339 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:23.304+0000 7f8af8ac4700 1 -- 172.21.15.46:0/948687098 shutdown_connections 2023-07-05T18:56:23.339 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:23.304+0000 7f8af8ac4700 1 --2- 172.21.15.46:0/948687098 >> v2:172.21.15.46:3300/0 conn(0x7f8af40cdfb0 0x7f8af4069e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:23.339 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:23.304+0000 7f8af8ac4700 1 --2- 172.21.15.46:0/948687098 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f8af4071690 0x7f8af40ca520 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:23.339 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:23.304+0000 7f8af8ac4700 1 -- 172.21.15.46:0/948687098 >> 172.21.15.46:0/948687098 conn(0x7f8af40ce860 msgr2=0x7f8af40cec30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-05T18:56:23.340 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:23.304+0000 7f8af8ac4700 1 -- 172.21.15.46:0/948687098 shutdown_connections 2023-07-05T18:56:23.340 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:23.304+0000 7f8af8ac4700 1 -- 172.21.15.46:0/948687098 wait complete. 2023-07-05T18:56:23.340 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:23.306+0000 7f8af8ac4700 1 Processor -- start 2023-07-05T18:56:23.340 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:23.306+0000 7f8af8ac4700 1 -- start start 2023-07-05T18:56:23.340 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:23.308+0000 7f8af8ac4700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8af40712c0 0x7f8af4168b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:56:23.340 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:23.308+0000 7f8af8ac4700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f8af4071690 0x7f8af40c3d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:56:23.340 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:23.308+0000 7f8af8ac4700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8af40cdfb0 0x7f8af40c4240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:56:23.341 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:23.308+0000 7f8af8ac4700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8af41f36c0 con 0x7f8af40cdfb0 2023-07-05T18:56:23.341 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:23.308+0000 7f8af8ac4700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8af40c3820 con 0x7f8af40712c0 2023-07-05T18:56:23.341 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:23.308+0000 7f8af8ac4700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8af41f52f0 con 0x7f8af4071690 2023-07-05T18:56:23.341 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:23.313+0000 7f8af1d9b700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f8af4071690 0x7f8af40c3d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:56:23.341 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:23.313+0000 7f8af2d9d700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8af40cdfb0 0x7f8af40c4240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:56:23.341 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:23.313+0000 7f8af2d9d700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8af40cdfb0 0x7f8af40c4240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:58160/0 (socket says 172.21.15.46:58160) 2023-07-05T18:56:23.341 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:23.313+0000 7f8af2d9d700 1 -- 172.21.15.46:0/20708277 learned_addr learned my addr 172.21.15.46:0/20708277 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-07-05T18:56:23.342 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:23.314+0000 7f8af2d9d700 1 -- 172.21.15.46:0/20708277 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f8af4071690 msgr2=0x7f8af40c3d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:56:23.342 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:23.314+0000 7f8af2d9d700 1 --2- 172.21.15.46:0/20708277 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f8af4071690 0x7f8af40c3d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:23.342 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:23.314+0000 7f8af2d9d700 1 -- 172.21.15.46:0/20708277 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8af40712c0 msgr2=0x7f8af4168b40 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-07-05T18:56:23.342 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:23.314+0000 7f8af2d9d700 1 --2- 172.21.15.46:0/20708277 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8af40712c0 0x7f8af4168b40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:23.342 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:23.314+0000 7f8af2d9d700 1 -- 172.21.15.46:0/20708277 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ae80086d0 con 0x7f8af40cdfb0 2023-07-05T18:56:23.342 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:23.314+0000 7f8af2d9d700 1 --2- 172.21.15.46:0/20708277 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8af40cdfb0 0x7f8af40c4240 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f8aec00b9c0 tx=0x7f8aec00bcd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-05T18:56:23.342 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:23.317+0000 7f8ae2ffd700 1 -- 172.21.15.46:0/20708277 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8aec00c930 con 0x7f8af40cdfb0 2023-07-05T18:56:23.343 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:23.317+0000 7f8ae2ffd700 1 -- 172.21.15.46:0/20708277 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8aec00ca90 con 0x7f8af40cdfb0 2023-07-05T18:56:23.343 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:23.317+0000 7f8ae2ffd700 1 -- 172.21.15.46:0/20708277 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8aec00ce40 con 0x7f8af40cdfb0 2023-07-05T18:56:23.343 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:23.317+0000 7f8af8ac4700 1 -- 172.21.15.46:0/20708277 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8af41f2d20 con 0x7f8af40cdfb0 2023-07-05T18:56:23.343 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:23.317+0000 7f8af8ac4700 1 -- 172.21.15.46:0/20708277 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8af41f32e0 con 0x7f8af40cdfb0 2023-07-05T18:56:23.343 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:23.321+0000 7f8ae2ffd700 1 -- 172.21.15.46:0/20708277 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f8aec01d3b0 con 0x7f8af40cdfb0 2023-07-05T18:56:23.343 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:23.322+0000 7f8ae2ffd700 1 --2- 172.21.15.46:0/20708277 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7f8adc06aec0 0x7f8adc06d370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:56:23.343 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:23.322+0000 7f8ae2ffd700 1 -- 172.21.15.46:0/20708277 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f8aec089160 con 0x7f8af40cdfb0 2023-07-05T18:56:23.343 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:23.323+0000 7f8af8ac4700 1 -- 172.21.15.46:0/20708277 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8ad80052f0 con 0x7f8af40cdfb0 2023-07-05T18:56:23.344 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:23.323+0000 7f8af259c700 1 --2- 172.21.15.46:0/20708277 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7f8adc06aec0 0x7f8adc06d370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:56:23.344 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:23.333+0000 7f8ae2ffd700 1 -- 172.21.15.46:0/20708277 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f8aec054280 con 0x7f8af40cdfb0 2023-07-05T18:56:23.350 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:23.344+0000 7f8af259c700 1 --2- 172.21.15.46:0/20708277 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7f8adc06aec0 0x7f8adc06d370 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f8ae4000f60 tx=0x7f8ae4007a40 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-05T18:56:23.362 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:23.359+0000 7fdfdfc86700 1 Processor -- start 2023-07-05T18:56:23.362 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:23.359+0000 7fdfdfc86700 1 -- start start 2023-07-05T18:56:23.363 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:23.360+0000 7fdfdfc86700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fdfd80cdfb0 0x7fdfd8069e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:56:23.363 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:23.360+0000 7fdfdfc86700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fdfd806a340 0x7fdfd81646d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:56:23.363 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:23.360+0000 7fdfdfc86700 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdfd80c1f00 con 0x7fdfd81609d0 2023-07-05T18:56:23.364 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:23.360+0000 7fdfdfc86700 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdfd806a7c0 con 0x7fdfd80cdfb0 2023-07-05T18:56:23.364 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:23.360+0000 7fdfdfc86700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdfd80ae030 con 0x7fdfd806a340 2023-07-05T18:56:23.364 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:23.361+0000 7fdfdda22700 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7fdfd81609d0 0x7fdfd80ad750 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:57436/0 (socket says 172.21.15.46:57436) 2023-07-05T18:56:23.364 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:23.361+0000 7fdfdda22700 1 -- 172.21.15.46:0/809178423 learned_addr learned my addr 172.21.15.46:0/809178423 (peer_addr_for_me v1:172.21.15.46:0/0) 2023-07-05T18:56:23.364 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:23.361+0000 7fdfde223700 1 --2- 172.21.15.46:0/809178423 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fdfd806a340 0x7fdfd81646d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:56:23.365 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:23.361+0000 7fdfdd221700 1 --2- 172.21.15.46:0/809178423 >> v2:172.21.15.73:3300/0 conn(0x7fdfd80cdfb0 0x7fdfd8069e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:56:23.365 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:23.361+0000 7fdfdca20700 1 -- 172.21.15.46:0/809178423 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2377181574 0 0) 0x7fdfd80c1f00 con 0x7fdfd81609d0 2023-07-05T18:56:23.365 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:23.361+0000 7fdfdca20700 1 -- 172.21.15.46:0/809178423 --> v1:172.21.15.46:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdfc40035b0 con 0x7fdfd81609d0 2023-07-05T18:56:23.367 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:23.362+0000 7fdfdca20700 1 -- 172.21.15.46:0/809178423 <== mon.0 v1:172.21.15.46:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1224828955 0 0) 0x7fdfc40035b0 con 0x7fdfd81609d0 2023-07-05T18:56:23.367 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:23.362+0000 7fdfdca20700 1 -- 172.21.15.46:0/809178423 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fdfd806a340 msgr2=0x7fdfd81646d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-05T18:56:23.367 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:23.362+0000 7fdfdca20700 1 --2- 172.21.15.46:0/809178423 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fdfd806a340 0x7fdfd81646d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:23.367 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:23.362+0000 7fdfdca20700 1 -- 172.21.15.46:0/809178423 >> v2:172.21.15.73:3300/0 conn(0x7fdfd80cdfb0 msgr2=0x7fdfd8069e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-05T18:56:23.367 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:23.362+0000 7fdfdca20700 1 --2- 172.21.15.46:0/809178423 >> v2:172.21.15.73:3300/0 conn(0x7fdfd80cdfb0 0x7fdfd8069e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:23.368 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:23.362+0000 7fdfdca20700 1 -- 172.21.15.46:0/809178423 --> v1:172.21.15.46:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdfd8070ec0 con 0x7fdfd81609d0 2023-07-05T18:56:23.368 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:23.362+0000 7fdfdca20700 1 -- 172.21.15.46:0/809178423 <== mon.0 v1:172.21.15.46:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2195585215 0 0) 0x7fdfd00019f0 con 0x7fdfd81609d0 2023-07-05T18:56:23.368 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:23.362+0000 7fdfdca20700 1 -- 172.21.15.46:0/809178423 >> v1:172.21.15.46:6789/0 conn(0x7fdfd81609d0 legacy=0x7fdfd80ad750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:56:23.368 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:23.362+0000 7fdfdca20700 1 --2- 172.21.15.46:0/809178423 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fdfc4003a00 0x7fdfc4003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:56:23.368 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:23.362+0000 7fdfdca20700 1 --2- 172.21.15.46:0/809178423 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fdfc4004390 0x7fdfc4004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:56:23.368 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:23.362+0000 7fdfdca20700 1 --2- 172.21.15.46:0/809178423 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fdfc4004ec0 0x7fdfc400ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:56:23.368 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:23.362+0000 7fdfdca20700 1 -- 172.21.15.46:0/809178423 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdfd806a7c0 con 0x7fdfc4004390 2023-07-05T18:56:23.368 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:23.362+0000 7fdfdca20700 1 -- 172.21.15.46:0/809178423 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdfd80ae030 con 0x7fdfc4004ec0 2023-07-05T18:56:23.369 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:23.362+0000 7fdfdca20700 1 -- 172.21.15.46:0/809178423 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdfc400bf50 con 0x7fdfc4003a00 2023-07-05T18:56:23.369 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:23.362+0000 7fdfdd221700 1 --2- 172.21.15.46:0/809178423 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fdfc4004390 0x7fdfc4004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:56:23.369 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:23.362+0000 7fdfdda22700 1 --2- 172.21.15.46:0/809178423 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fdfc4003a00 0x7fdfc4003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:56:23.369 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:23.362+0000 7fdfdd221700 1 -- 172.21.15.46:0/809178423 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fdfc4003a00 msgr2=0x7fdfc4003e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-05T18:56:23.369 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:23.362+0000 7fdfdd221700 1 --2- 172.21.15.46:0/809178423 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fdfc4003a00 0x7fdfc4003e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:23.369 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:23.362+0000 7fdfdd221700 1 -- 172.21.15.46:0/809178423 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fdfc4004ec0 msgr2=0x7fdfc400ba10 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-07-05T18:56:23.369 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:23.362+0000 7fdfdd221700 1 --2- 172.21.15.46:0/809178423 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fdfc4004ec0 0x7fdfc400ba10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:23.370 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:23.362+0000 7fdfdd221700 1 -- 172.21.15.46:0/809178423 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdfd8070ec0 con 0x7fdfc4004390 2023-07-05T18:56:23.370 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:23.363+0000 7fdfdd221700 1 --2- 172.21.15.46:0/809178423 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fdfc4004390 0x7fdfc4004850 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fdfc8009b40 tx=0x7fdfc4005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=599389e16435a22a server_cookie=0 in_seq=0 out_seq=0 2023-07-05T18:56:23.370 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:23.363+0000 7fdfdca20700 1 -- 172.21.15.46:0/809178423 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdfc8004020 con 0x7fdfc4004390 2023-07-05T18:56:23.370 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:23.363+0000 7fdfdca20700 1 -- 172.21.15.46:0/809178423 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdfc8004180 con 0x7fdfc4004390 2023-07-05T18:56:23.370 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:23.363+0000 7fdfdca20700 1 -- 172.21.15.46:0/809178423 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdfc80044f0 con 0x7fdfc4004390 2023-07-05T18:56:23.370 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:23.364+0000 7fdfdfc86700 1 -- 172.21.15.46:0/809178423 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fdfc4004390 msgr2=0x7fdfc4004850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:56:23.370 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:23.364+0000 7fdfdfc86700 1 --2- 172.21.15.46:0/809178423 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fdfc4004390 0x7fdfc4004850 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fdfc8009b40 tx=0x7fdfc4005880 comp rx=0 tx=0).stop 2023-07-05T18:56:23.370 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:23.364+0000 7fdfde223700 1 -- 172.21.15.46:0/809178423 reap_dead start 2023-07-05T18:56:23.371 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:23.364+0000 7fdfdfc86700 1 -- 172.21.15.46:0/809178423 shutdown_connections 2023-07-05T18:56:23.371 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:23.364+0000 7fdfdfc86700 1 -- 172.21.15.46:0/809178423 >> 172.21.15.46:0/809178423 conn(0x7fdfd80ce860 msgr2=0x7fdfd80cec30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-05T18:56:23.371 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:23.364+0000 7fdfdfc86700 1 -- 172.21.15.46:0/809178423 shutdown_connections 2023-07-05T18:56:23.372 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:23.364+0000 7fdfdfc86700 1 -- 172.21.15.46:0/809178423 wait complete. 2023-07-05T18:56:23.372 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:23.365+0000 7fdfdfc86700 1 Processor -- start 2023-07-05T18:56:23.372 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:23.366+0000 7fdfdfc86700 1 -- start start 2023-07-05T18:56:23.372 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:23.366+0000 7fdfdfc86700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fdfd80c4ff0 0x7fdfd8163800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:56:23.372 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:23.366+0000 7fdfdfc86700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fdfd80c2080 0x7fdfd8162280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:56:23.373 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:23.366+0000 7fdfdfc86700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fdfd81627c0 0x7fdfd81f9b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:56:23.373 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:23.366+0000 7fdfdfc86700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdfd8161df0 con 0x7fdfd80c2080 2023-07-05T18:56:23.373 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:23.366+0000 7fdfdfc86700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdfd8161200 con 0x7fdfd80c4ff0 2023-07-05T18:56:23.373 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:23.366+0000 7fdfdfc86700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdfd81614c0 con 0x7fdfd81627c0 2023-07-05T18:56:23.373 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:23.367+0000 7fdfde223700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fdfd81627c0 0x7fdfd81f9b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:56:23.373 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:23.367+0000 7fdfde223700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fdfd81627c0 0x7fdfd81f9b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3301/0 says I am v2:172.21.15.46:41862/0 (socket says 172.21.15.46:41862) 2023-07-05T18:56:23.373 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:23.367+0000 7fdfde223700 1 -- 172.21.15.46:0/1715071217 learned_addr learned my addr 172.21.15.46:0/1715071217 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-07-05T18:56:23.373 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:23.367+0000 7fdfdd221700 1 --2- 172.21.15.46:0/1715071217 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fdfd80c2080 0x7fdfd8162280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:56:23.374 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:23.367+0000 7fdfdd221700 1 -- 172.21.15.46:0/1715071217 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fdfd81627c0 msgr2=0x7fdfd81f9b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:56:23.374 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:23.367+0000 7fdfdd221700 1 --2- 172.21.15.46:0/1715071217 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fdfd81627c0 0x7fdfd81f9b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:23.374 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:23.367+0000 7fdfdd221700 1 -- 172.21.15.46:0/1715071217 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fdfd80c4ff0 msgr2=0x7fdfd8163800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:56:23.374 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:23.367+0000 7fdfdd221700 1 --2- 172.21.15.46:0/1715071217 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fdfd80c4ff0 0x7fdfd8163800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:23.374 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:23.367+0000 7fdfdd221700 1 -- 172.21.15.46:0/1715071217 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdfd81617a0 con 0x7fdfd80c2080 2023-07-05T18:56:23.374 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:23.367+0000 7fdfdd221700 1 --2- 172.21.15.46:0/1715071217 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fdfd80c2080 0x7fdfd8162280 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fdfc8018000 tx=0x7fdfc80047c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-05T18:56:23.376 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:23.369+0000 7f33ba335700 1 Processor -- start 2023-07-05T18:56:23.377 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:23.369+0000 7f33ba335700 1 -- start start 2023-07-05T18:56:23.377 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:23.370+0000 7f33ba335700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f33b41584b0 0x7f33b415c100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:56:23.377 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:23.370+0000 7f33ba335700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f33b406a510 0x7f33b40ccb40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:56:23.377 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:23.370+0000 7f33ba335700 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f33b4071110 con 0x7f33b40ade50 2023-07-05T18:56:23.377 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:23.370+0000 7f33ba335700 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f33b4071930 con 0x7f33b41584b0 2023-07-05T18:56:23.377 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:23.370+0000 7f33ba335700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f33b40713b0 con 0x7f33b406a510 2023-07-05T18:56:23.378 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:23.370+0000 7f33b3fff700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f33b41584b0 0x7f33b415c100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:56:23.378 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:23.370+0000 7f33b3fff700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f33b41584b0 0x7f33b415c100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.46:57664/0 (socket says 172.21.15.46:57664) 2023-07-05T18:56:23.378 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:23.370+0000 7f33b3fff700 1 -- 172.21.15.46:0/2212334069 learned_addr learned my addr 172.21.15.46:0/2212334069 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-07-05T18:56:23.378 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:23.370+0000 7f33b3fff700 1 -- 172.21.15.46:0/2212334069 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f33b406a510 msgr2=0x7f33b40ccb40 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-07-05T18:56:23.378 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:23.370+0000 7f33b3fff700 1 --2- 172.21.15.46:0/2212334069 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f33b406a510 0x7f33b40ccb40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:23.378 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:23.370+0000 7f33b3fff700 1 -- 172.21.15.46:0/2212334069 >> v1:172.21.15.73:6789/0 conn(0x7f33b40ade50 legacy=0x7f33b4069e00 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-07-05T18:56:23.378 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:23.370+0000 7f33b3fff700 1 -- 172.21.15.46:0/2212334069 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f33b406fc70 con 0x7f33b41584b0 2023-07-05T18:56:23.379 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:23.370+0000 7f33b3fff700 1 --2- 172.21.15.46:0/2212334069 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f33b41584b0 0x7f33b415c100 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f33a400b260 tx=0x7f33a400b570 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f161b90ac7f3a65 server_cookie=0 in_seq=0 out_seq=0 2023-07-05T18:56:23.382 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:23.380+0000 7fdfce7fc700 1 -- 172.21.15.46:0/1715071217 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdfc8020070 con 0x7fdfd80c2080 2023-07-05T18:56:23.382 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:23.380+0000 7fdfce7fc700 1 -- 172.21.15.46:0/1715071217 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdfc800ed70 con 0x7fdfd80c2080 2023-07-05T18:56:23.382 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:23.380+0000 7fdfce7fc700 1 -- 172.21.15.46:0/1715071217 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdfc80038e0 con 0x7fdfd80c2080 2023-07-05T18:56:23.383 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:23.380+0000 7f33b2ffd700 1 -- 172.21.15.46:0/2212334069 <== mon.1 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33a4004230 con 0x7f33b41584b0 2023-07-05T18:56:23.383 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:23.380+0000 7f33b2ffd700 1 -- 172.21.15.46:0/2212334069 <== mon.1 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f33a4004390 con 0x7f33b41584b0 2023-07-05T18:56:23.384 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:23.380+0000 7f33b2ffd700 1 -- 172.21.15.46:0/2212334069 <== mon.1 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33a40036a0 con 0x7f33b41584b0 2023-07-05T18:56:23.384 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:23.380+0000 7fdfdfc86700 1 -- 172.21.15.46:0/1715071217 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdfd8161a80 con 0x7fdfd80c2080 2023-07-05T18:56:23.384 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:23.380+0000 7fdfdfc86700 1 -- 172.21.15.46:0/1715071217 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdfd80c53c0 con 0x7fdfd80c2080 2023-07-05T18:56:23.384 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:23.382+0000 7f33ba335700 1 -- 172.21.15.46:0/2212334069 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f33b41584b0 msgr2=0x7f33b415c100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:56:23.385 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:23.382+0000 7f33ba335700 1 --2- 172.21.15.46:0/2212334069 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f33b41584b0 0x7f33b415c100 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f33a400b260 tx=0x7f33a400b570 comp rx=0 tx=0).stop 2023-07-05T18:56:23.385 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:23.383+0000 7fdfdfc86700 1 -- 172.21.15.46:0/1715071217 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdfc00052f0 con 0x7fdfd80c2080 2023-07-05T18:56:23.385 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:23.384+0000 7f33ba335700 1 -- 172.21.15.46:0/2212334069 shutdown_connections 2023-07-05T18:56:23.386 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:23.384+0000 7f33ba335700 1 --2- 172.21.15.46:0/2212334069 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f33b406a510 0x7f33b40ccb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:23.386 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:23.384+0000 7f33ba335700 1 --2- 172.21.15.46:0/2212334069 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f33b41584b0 0x7f33b415c100 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:23.386 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:23.384+0000 7f33ba335700 1 -- 172.21.15.46:0/2212334069 >> 172.21.15.46:0/2212334069 conn(0x7f33b40ce860 msgr2=0x7f33b40cec30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-05T18:56:23.387 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:23.384+0000 7fdfce7fc700 1 -- 172.21.15.46:0/1715071217 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fdfc8024070 con 0x7fdfd80c2080 2023-07-05T18:56:23.391 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:23.385+0000 7fdfce7fc700 1 --2- 172.21.15.46:0/1715071217 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7fdfbc06ad30 0x7fdfbc06d1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:56:23.391 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:23.385+0000 7fdfce7fc700 1 -- 172.21.15.46:0/1715071217 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fdfc808a070 con 0x7fdfd80c2080 2023-07-05T18:56:23.391 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:23.386+0000 7fdfdda22700 1 --2- 172.21.15.46:0/1715071217 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7fdfbc06ad30 0x7fdfbc06d1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:56:23.391 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:23.386+0000 7fdfdda22700 1 --2- 172.21.15.46:0/1715071217 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7fdfbc06ad30 0x7fdfbc06d1e0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fdfd0001b60 tx=0x7fdfd0009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-05T18:56:23.392 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:23.389+0000 7fdfce7fc700 1 -- 172.21.15.46:0/1715071217 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fdfc80553b0 con 0x7fdfd80c2080 2023-07-05T18:56:23.396 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:23.393+0000 7f33ba335700 1 -- 172.21.15.46:0/2212334069 shutdown_connections 2023-07-05T18:56:23.397 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:23.393+0000 7f33ba335700 1 -- 172.21.15.46:0/2212334069 wait complete. 2023-07-05T18:56:23.397 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:23.395+0000 7f33ba335700 1 Processor -- start 2023-07-05T18:56:23.402 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:23.395+0000 7f33ba335700 1 -- start start 2023-07-05T18:56:23.402 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:23.396+0000 7f33ba335700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f33b406a510 0x7f33b4159ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:56:23.402 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:23.396+0000 7f33ba335700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f33b40ade50 0x7f33b41f79c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:56:23.402 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:23.396+0000 7f33ba335700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f33b41584b0 0x7f33b40c43b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:56:23.402 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:23.396+0000 7f33ba335700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33b41f6ce0 con 0x7f33b406a510 2023-07-05T18:56:23.403 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:23.396+0000 7f33ba335700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33b415a220 con 0x7f33b41584b0 2023-07-05T18:56:23.403 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:23.396+0000 7f33ba335700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f33b40c5180 con 0x7f33b40ade50 2023-07-05T18:56:23.403 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:23.397+0000 7f33b3fff700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f33b406a510 0x7f33b4159ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:56:23.403 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:23.397+0000 7f33b3fff700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f33b406a510 0x7f33b4159ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:58186/0 (socket says 172.21.15.46:58186) 2023-07-05T18:56:23.403 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:23.397+0000 7f33b3fff700 1 -- 172.21.15.46:0/974400630 learned_addr learned my addr 172.21.15.46:0/974400630 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-07-05T18:56:23.403 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:23.397+0000 7f33b88d2700 1 --2- 172.21.15.46:0/974400630 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f33b41584b0 0x7f33b40c43b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:56:23.403 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:23.397+0000 7f33b37fe700 1 --2- 172.21.15.46:0/974400630 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f33b40ade50 0x7f33b41f79c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:56:23.404 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:23.397+0000 7f33b88d2700 1 -- 172.21.15.46:0/974400630 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f33b40ade50 msgr2=0x7f33b41f79c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:56:23.404 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:23.397+0000 7f33b88d2700 1 --2- 172.21.15.46:0/974400630 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f33b40ade50 0x7f33b41f79c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:23.404 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:23.397+0000 7f33b88d2700 1 -- 172.21.15.46:0/974400630 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f33b406a510 msgr2=0x7f33b4159ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:56:23.404 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:23.397+0000 7f33b88d2700 1 --2- 172.21.15.46:0/974400630 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f33b406a510 0x7f33b4159ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:23.404 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:23.397+0000 7f33b88d2700 1 -- 172.21.15.46:0/974400630 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f33a4009de0 con 0x7f33b41584b0 2023-07-05T18:56:23.404 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:23.398+0000 7f33b88d2700 1 --2- 172.21.15.46:0/974400630 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f33b41584b0 0x7f33b40c43b0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f33ac00bb00 tx=0x7f33ac00be10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-05T18:56:23.416 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:23.413+0000 7f33b0ff9700 1 -- 172.21.15.46:0/974400630 <== mon.1 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33ac00c930 con 0x7f33b41584b0 2023-07-05T18:56:23.417 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:23.413+0000 7f33b0ff9700 1 -- 172.21.15.46:0/974400630 <== mon.1 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f33ac00ca90 con 0x7f33b41584b0 2023-07-05T18:56:23.417 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:23.413+0000 7f33b0ff9700 1 -- 172.21.15.46:0/974400630 <== mon.1 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33ac00ce40 con 0x7f33b41584b0 2023-07-05T18:56:23.417 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:23.413+0000 7f33ba335700 1 -- 172.21.15.46:0/974400630 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f33b41f7f00 con 0x7f33b41584b0 2023-07-05T18:56:23.417 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:23.413+0000 7f33ba335700 1 -- 172.21.15.46:0/974400630 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f33b40c3490 con 0x7f33b41584b0 2023-07-05T18:56:23.422 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:23.420+0000 7f33b0ff9700 1 -- 172.21.15.46:0/974400630 <== mon.1 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f33ac01d3b0 con 0x7f33b41584b0 2023-07-05T18:56:23.423 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:23.420+0000 7f33b0ff9700 1 --2- 172.21.15.46:0/974400630 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7f339c06aea0 0x7f339c06d350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:56:23.423 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:23.420+0000 7f33b0ff9700 1 -- 172.21.15.46:0/974400630 <== mon.1 v2:172.21.15.73:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f33ac0890e0 con 0x7f33b41584b0 2023-07-05T18:56:23.423 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:23.421+0000 7f33ba335700 1 -- 172.21.15.46:0/974400630 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f33940052f0 con 0x7f33b41584b0 2023-07-05T18:56:23.423 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:23.421+0000 7f33b3fff700 1 --2- 172.21.15.46:0/974400630 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7f339c06aea0 0x7f339c06d350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:56:23.424 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:23.422+0000 7f33b3fff700 1 --2- 172.21.15.46:0/974400630 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7f339c06aea0 0x7f339c06d350 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f33a400c010 tx=0x7f33a4008030 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-05T18:56:23.428 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:23.426+0000 7f33b0ff9700 1 -- 172.21.15.46:0/974400630 <== mon.1 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f33ac054200 con 0x7f33b41584b0 2023-07-05T18:56:23.678 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:23.676+0000 7fc88f602700 1 -- 172.21.15.46:0/1965667519 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) v1 -- 0x7fc8880c24b0 con 0x7fc88806da80 2023-07-05T18:56:23.678 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:23.676+0000 7fc885ffb700 1 -- 172.21.15.46:0/1965667519 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fc880017020 con 0x7fc88806da80 2023-07-05T18:56:23.681 INFO:teuthology.orchestra.run.smithi046.stdout:55834574853 2023-07-05T18:56:23.682 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:23.680+0000 7fc88f602700 1 -- 172.21.15.46:0/1965667519 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7fc87406adb0 msgr2=0x7fc87406d260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:56:23.682 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:23.680+0000 7fc88f602700 1 --2- 172.21.15.46:0/1965667519 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7fc87406adb0 0x7fc87406d260 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fc8880ae2d0 tx=0x7fc87c012000 comp rx=0 tx=0).stop 2023-07-05T18:56:23.682 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:23.680+0000 7fc88f602700 1 -- 172.21.15.46:0/1965667519 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc88806da80 msgr2=0x7fc88814a890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:56:23.682 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:23.680+0000 7fc88f602700 1 --2- 172.21.15.46:0/1965667519 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc88806da80 0x7fc88814a890 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fc88000c520 tx=0x7fc88000c830 comp rx=0 tx=0).stop 2023-07-05T18:56:23.683 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:23.680+0000 7fc88f602700 1 -- 172.21.15.46:0/1965667519 shutdown_connections 2023-07-05T18:56:23.683 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:23.680+0000 7fc88f602700 1 --2- 172.21.15.46:0/1965667519 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7fc87406adb0 0x7fc87406d260 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:23.683 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:23.680+0000 7fc88f602700 1 --2- 172.21.15.46:0/1965667519 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fc8881584b0 0x7fc88814bfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:23.683 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:23.680+0000 7fc88f602700 1 --2- 172.21.15.46:0/1965667519 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc88806da80 0x7fc88814a890 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:23.683 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:23.680+0000 7fc88f602700 1 --2- 172.21.15.46:0/1965667519 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc8880ade50 0x7fc888152930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:23.684 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:23.680+0000 7fc88f602700 1 -- 172.21.15.46:0/1965667519 >> 172.21.15.46:0/1965667519 conn(0x7fc8880ce860 msgr2=0x7fc8880ae680 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-05T18:56:23.684 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:23.681+0000 7fc88f602700 1 -- 172.21.15.46:0/1965667519 shutdown_connections 2023-07-05T18:56:23.684 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:23.681+0000 7fc88f602700 1 -- 172.21.15.46:0/1965667519 wait complete. 2023-07-05T18:56:23.701 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574853 got 55834574853 for osd.7 2023-07-05T18:56:23.702 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:23.699+0000 7efdf4c6c700 1 -- 172.21.15.46:0/3653010261 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7efdf004e1d0 con 0x7efdf00afa10 2023-07-05T18:56:23.702 DEBUG:teuthology.parallel:result is None 2023-07-05T18:56:23.702 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:23.700+0000 7efddeffd700 1 -- 172.21.15.46:0/3653010261 <== mon.1 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7efde405d030 con 0x7efdf00afa10 2023-07-05T18:56:23.703 INFO:teuthology.orchestra.run.smithi046.stdout:55834574854 2023-07-05T18:56:23.707 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:23.705+0000 7ff29e01e700 1 -- 172.21.15.46:0/2906513877 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) v1 -- 0x7ff2780055a0 con 0x7ff2980b4710 2023-07-05T18:56:23.707 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:23.705+0000 7ff27ffff700 1 -- 172.21.15.46:0/2906513877 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7ff290017030 con 0x7ff2980b4710 2023-07-05T18:56:23.708 INFO:teuthology.orchestra.run.smithi046.stdout:55834574855 2023-07-05T18:56:23.709 INFO:teuthology.orchestra.run.smithi046.stdout:55834574855 2023-07-05T18:56:23.709 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:23.705+0000 7fa67acda700 1 -- 172.21.15.46:0/2826775603 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) v1 -- 0x7fa6740b2210 con 0x7fa67406b830 2023-07-05T18:56:23.710 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:23.705+0000 7fa6717fa700 1 -- 172.21.15.46:0/2826775603 <== mon.2 v2:172.21.15.73:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fa6740b2210 con 0x7fa67406b830 2023-07-05T18:56:23.711 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:23.706+0000 7efdf4c6c700 1 -- 172.21.15.46:0/3653010261 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7efdd006adb0 msgr2=0x7efdd006d260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:56:23.711 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:23.706+0000 7efdf4c6c700 1 --2- 172.21.15.46:0/3653010261 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7efdd006adb0 0x7efdd006d260 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7efdf015ecf0 tx=0x7efde0009040 comp rx=0 tx=0).stop 2023-07-05T18:56:23.711 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:23.706+0000 7efdf4c6c700 1 -- 172.21.15.46:0/3653010261 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7efdf00afa10 msgr2=0x7efdf00c8590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:56:23.712 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:23.706+0000 7efdf4c6c700 1 --2- 172.21.15.46:0/3653010261 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7efdf00afa10 0x7efdf00c8590 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7efde400c710 tx=0x7efde400ca20 comp rx=0 tx=0).stop 2023-07-05T18:56:23.713 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:23.707+0000 7f9c80d44700 1 -- 172.21.15.46:0/318677343 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f9c60005870 con 0x7f9c7c146b50 2023-07-05T18:56:23.713 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:23.708+0000 7f9c6affd700 1 -- 172.21.15.46:0/318677343 <== mon.2 v2:172.21.15.73:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f9c74001d20 con 0x7f9c7c146b50 2023-07-05T18:56:23.714 INFO:teuthology.orchestra.run.smithi046.stdout:55834574854 2023-07-05T18:56:23.715 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:23.708+0000 7efdf4c6c700 1 -- 172.21.15.46:0/3653010261 shutdown_connections 2023-07-05T18:56:23.715 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:23.708+0000 7efdf4c6c700 1 --2- 172.21.15.46:0/3653010261 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7efdd006adb0 0x7efdd006d260 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:23.715 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:23.708+0000 7efdf4c6c700 1 --2- 172.21.15.46:0/3653010261 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7efdf00c3a80 0x7efdf00cf6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:23.715 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:23.708+0000 7efdf4c6c700 1 --2- 172.21.15.46:0/3653010261 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7efdf00afa10 0x7efdf00c8590 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:23.716 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:23.708+0000 7efdf4c6c700 1 --2- 172.21.15.46:0/3653010261 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7efdf00aff60 0x7efdf015cd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:23.716 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:23.708+0000 7efdf4c6c700 1 -- 172.21.15.46:0/3653010261 >> 172.21.15.46:0/3653010261 conn(0x7efdf0099de0 msgr2=0x7efdf00ae0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-05T18:56:23.716 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:23.708+0000 7efdf4c6c700 1 -- 172.21.15.46:0/3653010261 shutdown_connections 2023-07-05T18:56:23.716 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:23.708+0000 7efdf4c6c700 1 -- 172.21.15.46:0/3653010261 wait complete. 2023-07-05T18:56:23.717 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:23.708+0000 7ff29e01e700 1 -- 172.21.15.46:0/2906513877 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7ff28406ace0 msgr2=0x7ff28406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:56:23.717 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:23.708+0000 7ff29e01e700 1 --2- 172.21.15.46:0/2906513877 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7ff28406ace0 0x7ff28406d190 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7ff2980b1600 tx=0x7ff288008040 comp rx=0 tx=0).stop 2023-07-05T18:56:23.717 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:23.708+0000 7ff29e01e700 1 -- 172.21.15.46:0/2906513877 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff2980b4710 msgr2=0x7ff2981f1a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:56:23.717 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:23.708+0000 7ff29e01e700 1 --2- 172.21.15.46:0/2906513877 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff2980b4710 0x7ff2981f1a40 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7ff29000cba0 tx=0x7ff29000cf60 comp rx=0 tx=0).stop 2023-07-05T18:56:23.718 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:23.709+0000 7fa67acda700 1 -- 172.21.15.46:0/2826775603 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7fa65c06adf0 msgr2=0x7fa65c06d2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:56:23.718 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:23.709+0000 7fa67acda700 1 --2- 172.21.15.46:0/2826775603 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7fa65c06adf0 0x7fa65c06d2a0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fa66c000f80 tx=0x7fa66c010000 comp rx=0 tx=0).stop 2023-07-05T18:56:23.718 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:23.709+0000 7fa67acda700 1 -- 172.21.15.46:0/2826775603 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fa67406b830 msgr2=0x7fa6741551b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:56:23.718 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:23.709+0000 7fa67acda700 1 --2- 172.21.15.46:0/2826775603 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fa67406b830 0x7fa6741551b0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fa66400d800 tx=0x7fa66400dbc0 comp rx=0 tx=0).stop 2023-07-05T18:56:23.718 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:23.710+0000 7fa67acda700 1 -- 172.21.15.46:0/2826775603 shutdown_connections 2023-07-05T18:56:23.718 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:23.710+0000 7fa67acda700 1 --2- 172.21.15.46:0/2826775603 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7fa65c06adf0 0x7fa65c06d2a0 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:23.718 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:23.710+0000 7fa67acda700 1 --2- 172.21.15.46:0/2826775603 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa674164700 0x7fa6740c6370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:23.719 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:23.710+0000 7fa67acda700 1 --2- 172.21.15.46:0/2826775603 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fa67406b830 0x7fa6741551b0 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:23.719 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:23.710+0000 7fa67acda700 1 --2- 172.21.15.46:0/2826775603 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa674160ce0 0x7fa6740b0d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:23.719 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:23.710+0000 7fa67acda700 1 -- 172.21.15.46:0/2826775603 >> 172.21.15.46:0/2826775603 conn(0x7fa6740cb860 msgr2=0x7fa6740abdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-05T18:56:23.720 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:23.711+0000 7ff29e01e700 1 -- 172.21.15.46:0/2906513877 shutdown_connections 2023-07-05T18:56:23.720 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:23.711+0000 7ff29e01e700 1 --2- 172.21.15.46:0/2906513877 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7ff28406ace0 0x7ff28406d190 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:23.720 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:23.711+0000 7ff29e01e700 1 --2- 172.21.15.46:0/2906513877 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff298142480 0x7ff29813b510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:23.720 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:23.711+0000 7ff29e01e700 1 --2- 172.21.15.46:0/2906513877 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff2980b4710 0x7ff2981f1a40 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:23.720 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:23.711+0000 7ff29e01e700 1 --2- 172.21.15.46:0/2906513877 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7ff29813f4c0 0x7ff2981410b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:23.721 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:23.711+0000 7ff29e01e700 1 -- 172.21.15.46:0/2906513877 >> 172.21.15.46:0/2906513877 conn(0x7ff29806af10 msgr2=0x7ff2981575e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-05T18:56:23.721 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:23.711+0000 7ff29e01e700 1 -- 172.21.15.46:0/2906513877 shutdown_connections 2023-07-05T18:56:23.721 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:23.711+0000 7ff29e01e700 1 -- 172.21.15.46:0/2906513877 wait complete. 2023-07-05T18:56:23.722 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:23.711+0000 7f9c80d44700 1 -- 172.21.15.46:0/318677343 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7f9c5c06ad10 msgr2=0x7f9c5c06d1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:56:23.722 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:23.711+0000 7f9c80d44700 1 --2- 172.21.15.46:0/318677343 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7f9c5c06ad10 0x7f9c5c06d1c0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f9c7c1fa620 tx=0x7f9c70011000 comp rx=0 tx=0).stop 2023-07-05T18:56:23.722 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:23.711+0000 7f9c80d44700 1 -- 172.21.15.46:0/318677343 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f9c7c146b50 msgr2=0x7f9c7c15b140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:56:23.722 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:23.711+0000 7f9c80d44700 1 --2- 172.21.15.46:0/318677343 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f9c7c146b50 0x7f9c7c15b140 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f9c7400cfd0 tx=0x7f9c740021a0 comp rx=0 tx=0).stop 2023-07-05T18:56:23.723 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:23.712+0000 7f9c80d44700 1 -- 172.21.15.46:0/318677343 shutdown_connections 2023-07-05T18:56:23.723 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:23.712+0000 7f9c80d44700 1 --2- 172.21.15.46:0/318677343 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7f9c5c06ad10 0x7f9c5c06d1c0 secure :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f9c7c1fa620 tx=0x7f9c70011000 comp rx=0 tx=0).stop 2023-07-05T18:56:23.723 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:23.712+0000 7f9c80d44700 1 --2- 172.21.15.46:0/318677343 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9c7c15b680 0x7f9c7c0a89a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:23.723 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:23.712+0000 7f9c80d44700 1 --2- 172.21.15.46:0/318677343 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f9c7c146b50 0x7f9c7c15b140 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:23.723 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:23.712+0000 7f9c80d44700 1 --2- 172.21.15.46:0/318677343 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9c7c146f20 0x7f9c7c0a8460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:23.724 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:23.712+0000 7f9c80d44700 1 -- 172.21.15.46:0/318677343 >> 172.21.15.46:0/318677343 conn(0x7f9c7c0ce860 msgr2=0x7f9c7c0cc9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-05T18:56:23.724 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:23.716+0000 7fa67acda700 1 -- 172.21.15.46:0/2826775603 shutdown_connections 2023-07-05T18:56:23.724 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:23.716+0000 7f9c80d44700 1 -- 172.21.15.46:0/318677343 shutdown_connections 2023-07-05T18:56:23.725 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:23.716+0000 7fa67acda700 1 -- 172.21.15.46:0/2826775603 wait complete. 2023-07-05T18:56:23.725 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:23.716+0000 7f9c80d44700 1 -- 172.21.15.46:0/318677343 wait complete. 2023-07-05T18:56:23.730 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574854 for osd.1 2023-07-05T18:56:23.730 DEBUG:teuthology.parallel:result is None 2023-07-05T18:56:23.733 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574855 got 55834574855 for osd.6 2023-07-05T18:56:23.734 DEBUG:teuthology.parallel:result is None 2023-07-05T18:56:23.741 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574854 for osd.0 2023-07-05T18:56:23.742 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:23.737+0000 7f8af8ac4700 1 -- 172.21.15.46:0/20708277 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) v1 -- 0x7f8ad80055a0 con 0x7f8af40cdfb0 2023-07-05T18:56:23.742 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:23.737+0000 7f8ae2ffd700 1 -- 172.21.15.46:0/20708277 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f8aec019030 con 0x7f8af40cdfb0 2023-07-05T18:56:23.743 DEBUG:teuthology.parallel:result is None 2023-07-05T18:56:23.744 INFO:teuthology.orchestra.run.smithi046.stdout:55834574854 2023-07-05T18:56:23.744 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:23.739+0000 7f8af8ac4700 1 -- 172.21.15.46:0/20708277 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7f8adc06aec0 msgr2=0x7f8adc06d370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:56:23.745 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:23.739+0000 7f8af8ac4700 1 --2- 172.21.15.46:0/20708277 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7f8adc06aec0 0x7f8adc06d370 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f8ae4000f60 tx=0x7f8ae4007a40 comp rx=0 tx=0).stop 2023-07-05T18:56:23.745 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:23.739+0000 7f8af8ac4700 1 -- 172.21.15.46:0/20708277 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8af40cdfb0 msgr2=0x7f8af40c4240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:56:23.745 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:23.739+0000 7f8af8ac4700 1 --2- 172.21.15.46:0/20708277 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8af40cdfb0 0x7f8af40c4240 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f8aec00b9c0 tx=0x7f8aec00bcd0 comp rx=0 tx=0).stop 2023-07-05T18:56:23.745 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:23.740+0000 7f8af8ac4700 1 -- 172.21.15.46:0/20708277 shutdown_connections 2023-07-05T18:56:23.745 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:23.740+0000 7f8af8ac4700 1 --2- 172.21.15.46:0/20708277 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7f8adc06aec0 0x7f8adc06d370 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:23.745 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:23.740+0000 7f8af8ac4700 1 --2- 172.21.15.46:0/20708277 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8af40cdfb0 0x7f8af40c4240 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:23.745 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:23.740+0000 7f8af8ac4700 1 --2- 172.21.15.46:0/20708277 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8af40712c0 0x7f8af4168b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:23.746 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:23.740+0000 7f8af8ac4700 1 --2- 172.21.15.46:0/20708277 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f8af4071690 0x7f8af40c3d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:23.746 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:23.740+0000 7f8af8ac4700 1 -- 172.21.15.46:0/20708277 >> 172.21.15.46:0/20708277 conn(0x7f8af40ce860 msgr2=0x7f8af40b1690 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-05T18:56:23.746 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574855 got 55834574855 for osd.4 2023-07-05T18:56:23.747 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:23.745+0000 7f8af8ac4700 1 -- 172.21.15.46:0/20708277 shutdown_connections 2023-07-05T18:56:23.747 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:23.745+0000 7f8af8ac4700 1 -- 172.21.15.46:0/20708277 wait complete. 2023-07-05T18:56:23.747 DEBUG:teuthology.parallel:result is None 2023-07-05T18:56:23.759 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574854 for osd.5 2023-07-05T18:56:23.759 DEBUG:teuthology.parallel:result is None 2023-07-05T18:56:23.774 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:23.772+0000 7fdfdfc86700 1 -- 172.21.15.46:0/1715071217 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fdfc0005870 con 0x7fdfd80c2080 2023-07-05T18:56:23.774 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:23.772+0000 7fdfce7fc700 1 -- 172.21.15.46:0/1715071217 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fdfc80589d0 con 0x7fdfd80c2080 2023-07-05T18:56:23.775 INFO:teuthology.orchestra.run.smithi046.stdout:55834574853 2023-07-05T18:56:23.777 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:23.775+0000 7fdfdfc86700 1 -- 172.21.15.46:0/1715071217 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7fdfbc06ad30 msgr2=0x7fdfbc06d1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:56:23.778 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:23.775+0000 7fdfdfc86700 1 --2- 172.21.15.46:0/1715071217 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7fdfbc06ad30 0x7fdfbc06d1e0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fdfd0001b60 tx=0x7fdfd0009040 comp rx=0 tx=0).stop 2023-07-05T18:56:23.778 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:23.775+0000 7fdfdfc86700 1 -- 172.21.15.46:0/1715071217 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fdfd80c2080 msgr2=0x7fdfd8162280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:56:23.778 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:23.775+0000 7fdfdfc86700 1 --2- 172.21.15.46:0/1715071217 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fdfd80c2080 0x7fdfd8162280 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fdfc8018000 tx=0x7fdfc80047c0 comp rx=0 tx=0).stop 2023-07-05T18:56:23.778 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:23.775+0000 7fdfdfc86700 1 -- 172.21.15.46:0/1715071217 shutdown_connections 2023-07-05T18:56:23.778 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:23.775+0000 7fdfdfc86700 1 --2- 172.21.15.46:0/1715071217 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7fdfbc06ad30 0x7fdfbc06d1e0 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:23.778 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:23.775+0000 7fdfdfc86700 1 --2- 172.21.15.46:0/1715071217 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fdfd81627c0 0x7fdfd81f9b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:23.778 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:23.775+0000 7fdfdfc86700 1 --2- 172.21.15.46:0/1715071217 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fdfd80c4ff0 0x7fdfd8163800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:23.779 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:23.775+0000 7fdfdfc86700 1 --2- 172.21.15.46:0/1715071217 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fdfd80c2080 0x7fdfd8162280 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:23.779 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:23.775+0000 7fdfdfc86700 1 -- 172.21.15.46:0/1715071217 >> 172.21.15.46:0/1715071217 conn(0x7fdfd80ce860 msgr2=0x7fdfd806c590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-05T18:56:23.779 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:23.775+0000 7fdfdfc86700 1 -- 172.21.15.46:0/1715071217 shutdown_connections 2023-07-05T18:56:23.779 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:23.775+0000 7fdfdfc86700 1 -- 172.21.15.46:0/1715071217 wait complete. 2023-07-05T18:56:23.793 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574853 got 55834574853 for osd.2 2023-07-05T18:56:23.794 DEBUG:teuthology.parallel:result is None 2023-07-05T18:56:23.812 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:23.810+0000 7f33ba335700 1 -- 172.21.15.46:0/974400630 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f3394005870 con 0x7f33b41584b0 2023-07-05T18:56:23.813 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:23.811+0000 7f33b0ff9700 1 -- 172.21.15.46:0/974400630 <== mon.1 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f33ac019030 con 0x7f33b41584b0 2023-07-05T18:56:23.813 INFO:teuthology.orchestra.run.smithi046.stdout:55834574855 2023-07-05T18:56:23.815 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:23.813+0000 7f33ba335700 1 -- 172.21.15.46:0/974400630 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7f339c06aea0 msgr2=0x7f339c06d350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:56:23.816 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:23.813+0000 7f33ba335700 1 --2- 172.21.15.46:0/974400630 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7f339c06aea0 0x7f339c06d350 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f33a400c010 tx=0x7f33a4008030 comp rx=0 tx=0).stop 2023-07-05T18:56:23.816 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:23.813+0000 7f33ba335700 1 -- 172.21.15.46:0/974400630 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f33b41584b0 msgr2=0x7f33b40c43b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:56:23.817 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:23.813+0000 7f33ba335700 1 --2- 172.21.15.46:0/974400630 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f33b41584b0 0x7f33b40c43b0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f33ac00bb00 tx=0x7f33ac00be10 comp rx=0 tx=0).stop 2023-07-05T18:56:23.817 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:23.813+0000 7f33ba335700 1 -- 172.21.15.46:0/974400630 shutdown_connections 2023-07-05T18:56:23.817 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:23.813+0000 7f33ba335700 1 --2- 172.21.15.46:0/974400630 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7f339c06aea0 0x7f339c06d350 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:23.817 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:23.813+0000 7f33ba335700 1 --2- 172.21.15.46:0/974400630 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f33b41584b0 0x7f33b40c43b0 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:23.818 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:23.813+0000 7f33ba335700 1 --2- 172.21.15.46:0/974400630 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f33b406a510 0x7f33b4159ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:23.818 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:23.813+0000 7f33ba335700 1 --2- 172.21.15.46:0/974400630 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f33b40ade50 0x7f33b41f79c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:23.818 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:23.813+0000 7f33ba335700 1 -- 172.21.15.46:0/974400630 >> 172.21.15.46:0/974400630 conn(0x7f33b40ce860 msgr2=0x7f33b40ae300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-05T18:56:23.819 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:23.813+0000 7f33ba335700 1 -- 172.21.15.46:0/974400630 shutdown_connections 2023-07-05T18:56:23.819 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:23.813+0000 7f33ba335700 1 -- 172.21.15.46:0/974400630 wait complete. 2023-07-05T18:56:23.827 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574855 got 55834574855 for osd.3 2023-07-05T18:56:23.827 DEBUG:teuthology.parallel:result is None 2023-07-05T18:56:23.828 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2023-07-05T18:56:23.828 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-07-05T18:56:23.992 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:23.991+0000 7fd77b3fc700 1 Processor -- start 2023-07-05T18:56:23.993 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:23.991+0000 7fd77b3fc700 1 -- start start 2023-07-05T18:56:23.994 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:23.992+0000 7fd77b3fc700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fd774069e00 0x7fd77406a280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:56:23.994 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:23.992+0000 7fd77b3fc700 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd774160f60 con 0x7fd7740cd8d0 2023-07-05T18:56:23.994 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:23.992+0000 7fd77b3fc700 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd7741603e0 con 0x7fd774156a70 2023-07-05T18:56:23.994 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:23.992+0000 7fd77b3fc700 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd77406a7c0 con 0x7fd774069e00 2023-07-05T18:56:23.994 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:23.992+0000 7fd778997700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fd774069e00 0x7fd77406a280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:56:23.995 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:23.992+0000 7fd779999700 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7fd7740cd8d0 0x7fd7740cdd10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:57470/0 (socket says 172.21.15.46:57470) 2023-07-05T18:56:23.995 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:23.992+0000 7fd779999700 1 -- 172.21.15.46:0/877029436 learned_addr learned my addr 172.21.15.46:0/877029436 (peer_addr_for_me v1:172.21.15.46:0/0) 2023-07-05T18:56:23.995 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:23.992+0000 7fd778997700 1 -- 172.21.15.46:0/877029436 >> v1:172.21.15.73:6789/0 conn(0x7fd774156a70 legacy=0x7fd77415d4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-05T18:56:23.995 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:23.992+0000 7fd778997700 1 -- 172.21.15.46:0/877029436 >> v1:172.21.15.46:6789/0 conn(0x7fd7740cd8d0 legacy=0x7fd7740cdd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:56:23.995 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:23.992+0000 7fd778997700 1 -- 172.21.15.46:0/877029436 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd7741606c0 con 0x7fd774069e00 2023-07-05T18:56:23.995 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:23.992+0000 7fd778997700 1 --2- 172.21.15.46:0/877029436 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd774069e00 0x7fd77406a280 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fd764009840 tx=0x7fd764009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e53cc9085e74f196 server_cookie=0 in_seq=0 out_seq=0 2023-07-05T18:56:23.996 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:23.992+0000 7fd76bfff700 1 -- 172.21.15.46:0/877029436 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd764004230 con 0x7fd774069e00 2023-07-05T18:56:23.996 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:23.992+0000 7fd76bfff700 1 -- 172.21.15.46:0/877029436 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd764004390 con 0x7fd774069e00 2023-07-05T18:56:23.997 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:23.992+0000 7fd76bfff700 1 -- 172.21.15.46:0/877029436 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7640036a0 con 0x7fd774069e00 2023-07-05T18:56:23.997 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:23.993+0000 7fd77b3fc700 1 -- 172.21.15.46:0/877029436 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd774069e00 msgr2=0x7fd77406a280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:56:23.997 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:23.993+0000 7fd77b3fc700 1 --2- 172.21.15.46:0/877029436 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd774069e00 0x7fd77406a280 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fd764009840 tx=0x7fd764009b50 comp rx=0 tx=0).stop 2023-07-05T18:56:23.997 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:23.993+0000 7fd77b3fc700 1 -- 172.21.15.46:0/877029436 shutdown_connections 2023-07-05T18:56:23.997 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:23.993+0000 7fd77b3fc700 1 --2- 172.21.15.46:0/877029436 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd774069e00 0x7fd77406a280 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:23.997 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:23.993+0000 7fd77b3fc700 1 -- 172.21.15.46:0/877029436 >> 172.21.15.46:0/877029436 conn(0x7fd7740b16b0 msgr2=0x7fd7740b1a80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-05T18:56:23.997 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:23.993+0000 7fd77b3fc700 1 -- 172.21.15.46:0/877029436 shutdown_connections 2023-07-05T18:56:23.998 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:23.993+0000 7fd77b3fc700 1 -- 172.21.15.46:0/877029436 wait complete. 2023-07-05T18:56:23.999 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:23.994+0000 7fd77b3fc700 1 Processor -- start 2023-07-05T18:56:23.999 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:23.994+0000 7fd77b3fc700 1 -- start start 2023-07-05T18:56:24.003 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:23.995+0000 7fd77b3fc700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd774069e00 0x7fd7741e6fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:56:24.004 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:23.995+0000 7fd77b3fc700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd7740cd8d0 0x7fd77415efb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:56:24.005 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:23.995+0000 7fd77b3fc700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fd774156a70 0x7fd774152450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:56:24.005 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:23.995+0000 7fd77b3fc700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd77415f4f0 con 0x7fd774069e00 2023-07-05T18:56:24.006 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:23.995+0000 7fd77b3fc700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7741e7660 con 0x7fd7740cd8d0 2023-07-05T18:56:24.007 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:23.995+0000 7fd77b3fc700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd7741e7940 con 0x7fd774156a70 2023-07-05T18:56:24.007 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:23.995+0000 7fd779198700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd774069e00 0x7fd7741e6fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:56:24.008 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:23.995+0000 7fd779198700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd774069e00 0x7fd7741e6fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:58200/0 (socket says 172.21.15.46:58200) 2023-07-05T18:56:24.008 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:23.995+0000 7fd779198700 1 -- 172.21.15.46:0/636712382 learned_addr learned my addr 172.21.15.46:0/636712382 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-07-05T18:56:24.008 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:23.995+0000 7fd779999700 1 --2- 172.21.15.46:0/636712382 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fd774156a70 0x7fd774152450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:56:24.009 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:23.995+0000 7fd778997700 1 --2- 172.21.15.46:0/636712382 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd7740cd8d0 0x7fd77415efb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:56:24.009 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:23.995+0000 7fd779198700 1 -- 172.21.15.46:0/636712382 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fd774156a70 msgr2=0x7fd774152450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:56:24.009 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:23.995+0000 7fd779198700 1 --2- 172.21.15.46:0/636712382 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fd774156a70 0x7fd774152450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:24.010 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:23.995+0000 7fd779198700 1 -- 172.21.15.46:0/636712382 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd7740cd8d0 msgr2=0x7fd77415efb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:56:24.011 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:23.995+0000 7fd779198700 1 --2- 172.21.15.46:0/636712382 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd7740cd8d0 0x7fd77415efb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:24.011 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:23.995+0000 7fd779198700 1 -- 172.21.15.46:0/636712382 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd7640094a0 con 0x7fd774069e00 2023-07-05T18:56:24.011 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:23.995+0000 7fd778997700 1 --2- 172.21.15.46:0/636712382 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd7740cd8d0 0x7fd77415efb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-05T18:56:24.011 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:23.996+0000 7fd779198700 1 --2- 172.21.15.46:0/636712382 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd774069e00 0x7fd7741e6fc0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fd77000b4a0 tx=0x7fd77000b860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-05T18:56:24.012 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:23.996+0000 7fd769ffb700 1 -- 172.21.15.46:0/636712382 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd770011830 con 0x7fd774069e00 2023-07-05T18:56:24.012 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:23.996+0000 7fd769ffb700 1 -- 172.21.15.46:0/636712382 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd770011990 con 0x7fd774069e00 2023-07-05T18:56:24.012 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:23.996+0000 7fd77b3fc700 1 -- 172.21.15.46:0/636712382 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd7741e7c20 con 0x7fd774069e00 2023-07-05T18:56:24.012 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:23.996+0000 7fd769ffb700 1 -- 172.21.15.46:0/636712382 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd770011d40 con 0x7fd774069e00 2023-07-05T18:56:24.013 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:23.996+0000 7fd77b3fc700 1 -- 172.21.15.46:0/636712382 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd7741e81e0 con 0x7fd774069e00 2023-07-05T18:56:24.013 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:23.997+0000 7fd77b3fc700 1 -- 172.21.15.46:0/636712382 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd7740672e0 con 0x7fd774069e00 2023-07-05T18:56:24.013 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:23.997+0000 7fd769ffb700 1 -- 172.21.15.46:0/636712382 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fd77001a400 con 0x7fd774069e00 2023-07-05T18:56:24.014 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:23.997+0000 7fd769ffb700 1 --2- 172.21.15.46:0/636712382 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7fd75806ace0 0x7fd75806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:56:24.014 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:23.998+0000 7fd769ffb700 1 -- 172.21.15.46:0/636712382 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fd770089200 con 0x7fd774069e00 2023-07-05T18:56:24.014 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:23.998+0000 7fd778997700 1 --2- 172.21.15.46:0/636712382 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7fd75806ace0 0x7fd75806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:56:24.014 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:23.998+0000 7fd778997700 1 --2- 172.21.15.46:0/636712382 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7fd75806ace0 0x7fd75806d190 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fd77406e270 tx=0x7fd764008030 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-05T18:56:24.016 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:24.002+0000 7fd769ffb700 1 -- 172.21.15.46:0/636712382 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fd7700542b0 con 0x7fd774069e00 2023-07-05T18:56:24.199 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:24.197+0000 7fd77b3fc700 1 -- 172.21.15.46:0/636712382 --> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fd774160c80 con 0x7fd75806ace0 2023-07-05T18:56:24.207 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:24.205+0000 7fd769ffb700 1 -- 172.21.15.46:0/636712382 <== mgr.4099 v2:172.21.15.73:6832/3033361733 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+286791 (secure 0 0 0) 0x7fd7640040b0 con 0x7fd75806ace0 2023-07-05T18:56:24.211 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T18:56:24.213 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:24.208+0000 7fd77b3fc700 1 -- 172.21.15.46:0/636712382 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7fd75806ace0 msgr2=0x7fd75806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:56:24.214 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:24.208+0000 7fd77b3fc700 1 --2- 172.21.15.46:0/636712382 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7fd75806ace0 0x7fd75806d190 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fd77406e270 tx=0x7fd764008030 comp rx=0 tx=0).stop 2023-07-05T18:56:24.214 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:24.208+0000 7fd77b3fc700 1 -- 172.21.15.46:0/636712382 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd774069e00 msgr2=0x7fd7741e6fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:56:24.214 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:24.208+0000 7fd77b3fc700 1 --2- 172.21.15.46:0/636712382 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd774069e00 0x7fd7741e6fc0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fd77000b4a0 tx=0x7fd77000b860 comp rx=0 tx=0).stop 2023-07-05T18:56:24.214 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:24.208+0000 7fd77b3fc700 1 -- 172.21.15.46:0/636712382 shutdown_connections 2023-07-05T18:56:24.214 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:24.208+0000 7fd77b3fc700 1 --2- 172.21.15.46:0/636712382 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7fd75806ace0 0x7fd75806d190 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:24.214 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:24.208+0000 7fd77b3fc700 1 --2- 172.21.15.46:0/636712382 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fd774156a70 0x7fd774152450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:24.215 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:24.208+0000 7fd77b3fc700 1 --2- 172.21.15.46:0/636712382 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd774069e00 0x7fd7741e6fc0 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:24.215 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:24.208+0000 7fd77b3fc700 1 --2- 172.21.15.46:0/636712382 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd7740cd8d0 0x7fd77415efb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:24.215 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:24.208+0000 7fd77b3fc700 1 -- 172.21.15.46:0/636712382 >> 172.21.15.46:0/636712382 conn(0x7fd7740b16b0 msgr2=0x7fd7740cccf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-05T18:56:24.215 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:24.209+0000 7fd77b3fc700 1 -- 172.21.15.46:0/636712382 shutdown_connections 2023-07-05T18:56:24.215 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:24.209+0000 7fd77b3fc700 1 -- 172.21.15.46:0/636712382 wait complete. 2023-07-05T18:56:24.215 INFO:teuthology.orchestra.run.smithi046.stderr:dumped all 2023-07-05T18:56:24.223 INFO:teuthology.orchestra.run.smithi046.stdout:{"pg_ready":true,"pg_map":{"version":23,"stamp":"2023-07-05T18:56:24.073933+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":218532,"kb_used_data":2916,"kb_used_omap":0,"kb_used_meta":215552,"kb_avail":754756188,"statfs":{"total":773094113280,"available":772870336512,"internally_reserved":0,"allocated":2985984,"data_stored":1817291,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":220725248},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2362,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.972041"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-05T18:56:17.658270+0000","last_change":"2023-07-05T18:56:15.115312+0000","last_active":"2023-07-05T18:56:17.658270+0000","last_peered":"2023-07-05T18:56:17.658270+0000","last_clean":"2023-07-05T18:56:17.658270+0000","last_became_active":"2023-07-05T18:56:15.115039+0000","last_became_peered":"2023-07-05T18:56:15.115039+0000","last_unstale":"2023-07-05T18:56:17.658270+0000","last_undegraded":"2023-07-05T18:56:17.658270+0000","last_fullsized":"2023-07-05T18:56:17.658270+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T18:56:14.665171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T18:56:14.665171+0000","last_clean_scrub_stamp":"2023-07-05T18:56:14.665171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T04:47:53.525224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-05T18:56:16.104997+0000","last_change":"2023-07-05T18:56:15.113285+0000","last_active":"2023-07-05T18:56:16.104997+0000","last_peered":"2023-07-05T18:56:16.104997+0000","last_clean":"2023-07-05T18:56:16.104997+0000","last_became_active":"2023-07-05T18:56:15.113019+0000","last_became_peered":"2023-07-05T18:56:15.113019+0000","last_unstale":"2023-07-05T18:56:16.104997+0000","last_undegraded":"2023-07-05T18:56:16.104997+0000","last_fullsized":"2023-07-05T18:56:16.104997+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T18:56:14.665171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T18:56:14.665171+0000","last_clean_scrub_stamp":"2023-07-05T18:56:14.665171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-06T19:43:28.708822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-05T18:56:17.658939+0000","last_change":"2023-07-05T18:56:15.127147+0000","last_active":"2023-07-05T18:56:17.658939+0000","last_peered":"2023-07-05T18:56:17.658939+0000","last_clean":"2023-07-05T18:56:17.658939+0000","last_became_active":"2023-07-05T18:56:15.126775+0000","last_became_peered":"2023-07-05T18:56:15.126775+0000","last_unstale":"2023-07-05T18:56:17.658939+0000","last_undegraded":"2023-07-05T18:56:17.658939+0000","last_fullsized":"2023-07-05T18:56:17.658939+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T18:56:14.665171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T18:56:14.665171+0000","last_clean_scrub_stamp":"2023-07-05T18:56:14.665171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T04:41:48.823682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-05T18:56:16.105116+0000","last_change":"2023-07-05T18:56:15.119204+0000","last_active":"2023-07-05T18:56:16.105116+0000","last_peered":"2023-07-05T18:56:16.105116+0000","last_clean":"2023-07-05T18:56:16.105116+0000","last_became_active":"2023-07-05T18:56:15.118931+0000","last_became_peered":"2023-07-05T18:56:15.118931+0000","last_unstale":"2023-07-05T18:56:16.105116+0000","last_undegraded":"2023-07-05T18:56:16.105116+0000","last_fullsized":"2023-07-05T18:56:16.105116+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T18:56:14.665171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T18:56:14.665171+0000","last_clean_scrub_stamp":"2023-07-05T18:56:14.665171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T03:19:04.962412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-05T18:56:16.473979+0000","last_change":"2023-07-05T18:56:15.125822+0000","last_active":"2023-07-05T18:56:16.473979+0000","last_peered":"2023-07-05T18:56:16.473979+0000","last_clean":"2023-07-05T18:56:16.473979+0000","last_became_active":"2023-07-05T18:56:15.121836+0000","last_became_peered":"2023-07-05T18:56:15.121836+0000","last_unstale":"2023-07-05T18:56:16.473979+0000","last_undegraded":"2023-07-05T18:56:16.473979+0000","last_fullsized":"2023-07-05T18:56:16.473979+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T18:56:14.665171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T18:56:14.665171+0000","last_clean_scrub_stamp":"2023-07-05T18:56:14.665171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T02:49:05.937629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-05T18:56:17.658488+0000","last_change":"2023-07-05T18:56:15.125381+0000","last_active":"2023-07-05T18:56:17.658488+0000","last_peered":"2023-07-05T18:56:17.658488+0000","last_clean":"2023-07-05T18:56:17.658488+0000","last_became_active":"2023-07-05T18:56:15.124055+0000","last_became_peered":"2023-07-05T18:56:15.124055+0000","last_unstale":"2023-07-05T18:56:17.658488+0000","last_undegraded":"2023-07-05T18:56:17.658488+0000","last_fullsized":"2023-07-05T18:56:17.658488+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T18:56:14.665171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T18:56:14.665171+0000","last_clean_scrub_stamp":"2023-07-05T18:56:14.665171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T02:13:19.229598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-05T18:56:17.158259+0000","last_change":"2023-07-05T18:56:15.116938+0000","last_active":"2023-07-05T18:56:17.158259+0000","last_peered":"2023-07-05T18:56:17.158259+0000","last_clean":"2023-07-05T18:56:17.158259+0000","last_became_active":"2023-07-05T18:56:15.116592+0000","last_became_peered":"2023-07-05T18:56:15.116592+0000","last_unstale":"2023-07-05T18:56:17.158259+0000","last_undegraded":"2023-07-05T18:56:17.158259+0000","last_fullsized":"2023-07-05T18:56:17.158259+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T18:56:14.665171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T18:56:14.665171+0000","last_clean_scrub_stamp":"2023-07-05T18:56:14.665171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T02:30:29.740847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-05T18:56:16.104826+0000","last_change":"2023-07-05T18:56:15.127587+0000","last_active":"2023-07-05T18:56:16.104826+0000","last_peered":"2023-07-05T18:56:16.104826+0000","last_clean":"2023-07-05T18:56:16.104826+0000","last_became_active":"2023-07-05T18:56:15.127359+0000","last_became_peered":"2023-07-05T18:56:15.127359+0000","last_unstale":"2023-07-05T18:56:16.104826+0000","last_undegraded":"2023-07-05T18:56:16.104826+0000","last_fullsized":"2023-07-05T18:56:16.104826+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T18:56:14.665171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T18:56:14.665171+0000","last_clean_scrub_stamp":"2023-07-05T18:56:14.665171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T01:07:17.521433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-05T18:56:16.474116+0000","last_change":"2023-07-05T18:56:15.123724+0000","last_active":"2023-07-05T18:56:16.474116+0000","last_peered":"2023-07-05T18:56:16.474116+0000","last_clean":"2023-07-05T18:56:16.474116+0000","last_became_active":"2023-07-05T18:56:15.121678+0000","last_became_peered":"2023-07-05T18:56:15.121678+0000","last_unstale":"2023-07-05T18:56:16.474116+0000","last_undegraded":"2023-07-05T18:56:16.474116+0000","last_fullsized":"2023-07-05T18:56:16.474116+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T18:56:14.665171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T18:56:14.665171+0000","last_clean_scrub_stamp":"2023-07-05T18:56:14.665171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T02:24:35.873082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-05T18:56:16.105387+0000","last_change":"2023-07-05T18:56:15.121695+0000","last_active":"2023-07-05T18:56:16.105387+0000","last_peered":"2023-07-05T18:56:16.105387+0000","last_clean":"2023-07-05T18:56:16.105387+0000","last_became_active":"2023-07-05T18:56:15.121418+0000","last_became_peered":"2023-07-05T18:56:15.121418+0000","last_unstale":"2023-07-05T18:56:16.105387+0000","last_undegraded":"2023-07-05T18:56:16.105387+0000","last_fullsized":"2023-07-05T18:56:16.105387+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T18:56:14.665171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T18:56:14.665171+0000","last_clean_scrub_stamp":"2023-07-05T18:56:14.665171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-06T21:50:37.526388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-05T18:56:17.658944+0000","last_change":"2023-07-05T18:56:15.127138+0000","last_active":"2023-07-05T18:56:17.658944+0000","last_peered":"2023-07-05T18:56:17.658944+0000","last_clean":"2023-07-05T18:56:17.658944+0000","last_became_active":"2023-07-05T18:56:15.126770+0000","last_became_peered":"2023-07-05T18:56:15.126770+0000","last_unstale":"2023-07-05T18:56:17.658944+0000","last_undegraded":"2023-07-05T18:56:17.658944+0000","last_fullsized":"2023-07-05T18:56:17.658944+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T18:56:14.665171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T18:56:14.665171+0000","last_clean_scrub_stamp":"2023-07-05T18:56:14.665171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-06T23:38:29.351477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-05T18:56:17.658156+0000","last_change":"2023-07-05T18:56:15.127292+0000","last_active":"2023-07-05T18:56:17.658156+0000","last_peered":"2023-07-05T18:56:17.658156+0000","last_clean":"2023-07-05T18:56:17.658156+0000","last_became_active":"2023-07-05T18:56:15.127061+0000","last_became_peered":"2023-07-05T18:56:15.127061+0000","last_unstale":"2023-07-05T18:56:17.658156+0000","last_undegraded":"2023-07-05T18:56:17.658156+0000","last_fullsized":"2023-07-05T18:56:17.658156+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T18:56:14.665171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T18:56:14.665171+0000","last_clean_scrub_stamp":"2023-07-05T18:56:14.665171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-06T21:17:50.248706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-05T18:56:17.658107+0000","last_change":"2023-07-05T18:56:15.114803+0000","last_active":"2023-07-05T18:56:17.658107+0000","last_peered":"2023-07-05T18:56:17.658107+0000","last_clean":"2023-07-05T18:56:17.658107+0000","last_became_active":"2023-07-05T18:56:15.114491+0000","last_became_peered":"2023-07-05T18:56:15.114491+0000","last_unstale":"2023-07-05T18:56:17.658107+0000","last_undegraded":"2023-07-05T18:56:17.658107+0000","last_fullsized":"2023-07-05T18:56:17.658107+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T18:56:14.665171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T18:56:14.665171+0000","last_clean_scrub_stamp":"2023-07-05T18:56:14.665171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T03:29:08.291790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-05T18:56:16.105534+0000","last_change":"2023-07-05T18:56:15.108218+0000","last_active":"2023-07-05T18:56:16.105534+0000","last_peered":"2023-07-05T18:56:16.105534+0000","last_clean":"2023-07-05T18:56:16.105534+0000","last_became_active":"2023-07-05T18:56:15.107769+0000","last_became_peered":"2023-07-05T18:56:15.107769+0000","last_unstale":"2023-07-05T18:56:16.105534+0000","last_undegraded":"2023-07-05T18:56:16.105534+0000","last_fullsized":"2023-07-05T18:56:16.105534+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T18:56:14.665171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T18:56:14.665171+0000","last_clean_scrub_stamp":"2023-07-05T18:56:14.665171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T03:19:04.962412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-05T18:56:17.158599+0000","last_change":"2023-07-05T18:56:15.119803+0000","last_active":"2023-07-05T18:56:17.158599+0000","last_peered":"2023-07-05T18:56:17.158599+0000","last_clean":"2023-07-05T18:56:17.158599+0000","last_became_active":"2023-07-05T18:56:15.119429+0000","last_became_peered":"2023-07-05T18:56:15.119429+0000","last_unstale":"2023-07-05T18:56:17.158599+0000","last_undegraded":"2023-07-05T18:56:17.158599+0000","last_fullsized":"2023-07-05T18:56:17.158599+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T18:56:14.665171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T18:56:14.665171+0000","last_clean_scrub_stamp":"2023-07-05T18:56:14.665171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T03:39:30.527160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-05T18:56:17.658447+0000","last_change":"2023-07-05T18:56:15.128556+0000","last_active":"2023-07-05T18:56:17.658447+0000","last_peered":"2023-07-05T18:56:17.658447+0000","last_clean":"2023-07-05T18:56:17.658447+0000","last_became_active":"2023-07-05T18:56:15.128307+0000","last_became_peered":"2023-07-05T18:56:15.128307+0000","last_unstale":"2023-07-05T18:56:17.658447+0000","last_undegraded":"2023-07-05T18:56:17.658447+0000","last_fullsized":"2023-07-05T18:56:17.658447+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T18:56:14.665171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T18:56:14.665171+0000","last_clean_scrub_stamp":"2023-07-05T18:56:14.665171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-06T22:32:11.493711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-05T18:56:16.474111+0000","last_change":"2023-07-05T18:56:15.121918+0000","last_active":"2023-07-05T18:56:16.474111+0000","last_peered":"2023-07-05T18:56:16.474111+0000","last_clean":"2023-07-05T18:56:16.474111+0000","last_became_active":"2023-07-05T18:56:15.121400+0000","last_became_peered":"2023-07-05T18:56:15.121400+0000","last_unstale":"2023-07-05T18:56:16.474111+0000","last_undegraded":"2023-07-05T18:56:16.474111+0000","last_fullsized":"2023-07-05T18:56:16.474111+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T18:56:14.665171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T18:56:14.665171+0000","last_clean_scrub_stamp":"2023-07-05T18:56:14.665171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-06T21:50:37.526388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-05T18:56:17.659108+0000","last_change":"2023-07-05T18:56:15.127191+0000","last_active":"2023-07-05T18:56:17.659108+0000","last_peered":"2023-07-05T18:56:17.659108+0000","last_clean":"2023-07-05T18:56:17.659108+0000","last_became_active":"2023-07-05T18:56:15.126872+0000","last_became_peered":"2023-07-05T18:56:15.126872+0000","last_unstale":"2023-07-05T18:56:17.659108+0000","last_undegraded":"2023-07-05T18:56:17.659108+0000","last_fullsized":"2023-07-05T18:56:17.659108+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T18:56:14.665171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T18:56:14.665171+0000","last_clean_scrub_stamp":"2023-07-05T18:56:14.665171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T02:22:27.543361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-05T18:56:17.658229+0000","last_change":"2023-07-05T18:56:15.108982+0000","last_active":"2023-07-05T18:56:17.658229+0000","last_peered":"2023-07-05T18:56:17.658229+0000","last_clean":"2023-07-05T18:56:17.658229+0000","last_became_active":"2023-07-05T18:56:15.108461+0000","last_became_peered":"2023-07-05T18:56:15.108461+0000","last_unstale":"2023-07-05T18:56:17.658229+0000","last_undegraded":"2023-07-05T18:56:17.658229+0000","last_fullsized":"2023-07-05T18:56:17.658229+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T18:56:14.665171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T18:56:14.665171+0000","last_clean_scrub_stamp":"2023-07-05T18:56:14.665171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T05:40:41.006597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-05T18:56:17.658840+0000","last_change":"2023-07-05T18:56:15.124274+0000","last_active":"2023-07-05T18:56:17.658840+0000","last_peered":"2023-07-05T18:56:17.658840+0000","last_clean":"2023-07-05T18:56:17.658840+0000","last_became_active":"2023-07-05T18:56:15.123758+0000","last_became_peered":"2023-07-05T18:56:15.123758+0000","last_unstale":"2023-07-05T18:56:17.658840+0000","last_undegraded":"2023-07-05T18:56:17.658840+0000","last_fullsized":"2023-07-05T18:56:17.658840+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T18:56:14.665171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T18:56:14.665171+0000","last_clean_scrub_stamp":"2023-07-05T18:56:14.665171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T03:39:30.527160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-05T18:56:17.158642+0000","last_change":"2023-07-05T18:56:15.123685+0000","last_active":"2023-07-05T18:56:17.158642+0000","last_peered":"2023-07-05T18:56:17.158642+0000","last_clean":"2023-07-05T18:56:17.158642+0000","last_became_active":"2023-07-05T18:56:15.123431+0000","last_became_peered":"2023-07-05T18:56:15.123431+0000","last_unstale":"2023-07-05T18:56:17.158642+0000","last_undegraded":"2023-07-05T18:56:17.158642+0000","last_fullsized":"2023-07-05T18:56:17.158642+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T18:56:14.665171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T18:56:14.665171+0000","last_clean_scrub_stamp":"2023-07-05T18:56:14.665171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T04:41:48.823682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-05T18:56:16.473936+0000","last_change":"2023-07-05T18:56:15.116119+0000","last_active":"2023-07-05T18:56:16.473936+0000","last_peered":"2023-07-05T18:56:16.473936+0000","last_clean":"2023-07-05T18:56:16.473936+0000","last_became_active":"2023-07-05T18:56:15.115869+0000","last_became_peered":"2023-07-05T18:56:15.115869+0000","last_unstale":"2023-07-05T18:56:16.473936+0000","last_undegraded":"2023-07-05T18:56:16.473936+0000","last_fullsized":"2023-07-05T18:56:16.473936+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T18:56:14.665171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T18:56:14.665171+0000","last_clean_scrub_stamp":"2023-07-05T18:56:14.665171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-06T19:43:28.708822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-05T18:56:16.104324+0000","last_change":"2023-07-05T18:56:15.122698+0000","last_active":"2023-07-05T18:56:16.104324+0000","last_peered":"2023-07-05T18:56:16.104324+0000","last_clean":"2023-07-05T18:56:16.104324+0000","last_became_active":"2023-07-05T18:56:15.122391+0000","last_became_peered":"2023-07-05T18:56:15.122391+0000","last_unstale":"2023-07-05T18:56:16.104324+0000","last_undegraded":"2023-07-05T18:56:16.104324+0000","last_fullsized":"2023-07-05T18:56:16.104324+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T18:56:14.665171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T18:56:14.665171+0000","last_clean_scrub_stamp":"2023-07-05T18:56:14.665171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T03:02:00.204080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-05T18:56:17.158207+0000","last_change":"2023-07-05T18:56:15.125120+0000","last_active":"2023-07-05T18:56:17.158207+0000","last_peered":"2023-07-05T18:56:17.158207+0000","last_clean":"2023-07-05T18:56:17.158207+0000","last_became_active":"2023-07-05T18:56:15.124790+0000","last_became_peered":"2023-07-05T18:56:15.124790+0000","last_unstale":"2023-07-05T18:56:17.158207+0000","last_undegraded":"2023-07-05T18:56:17.158207+0000","last_fullsized":"2023-07-05T18:56:17.158207+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T18:56:14.665171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T18:56:14.665171+0000","last_clean_scrub_stamp":"2023-07-05T18:56:14.665171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-06T21:14:58.040487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-05T18:56:17.190914+0000","last_change":"2023-07-05T18:56:15.109580+0000","last_active":"2023-07-05T18:56:17.190914+0000","last_peered":"2023-07-05T18:56:17.190914+0000","last_clean":"2023-07-05T18:56:17.190914+0000","last_became_active":"2023-07-05T18:56:15.109054+0000","last_became_peered":"2023-07-05T18:56:15.109054+0000","last_unstale":"2023-07-05T18:56:17.190914+0000","last_undegraded":"2023-07-05T18:56:17.190914+0000","last_fullsized":"2023-07-05T18:56:17.190914+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T18:56:14.665171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T18:56:14.665171+0000","last_clean_scrub_stamp":"2023-07-05T18:56:14.665171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T04:53:59.163434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-05T18:56:17.191114+0000","last_change":"2023-07-05T18:56:15.103610+0000","last_active":"2023-07-05T18:56:17.191114+0000","last_peered":"2023-07-05T18:56:17.191114+0000","last_clean":"2023-07-05T18:56:17.191114+0000","last_became_active":"2023-07-05T18:56:15.103321+0000","last_became_peered":"2023-07-05T18:56:15.103321+0000","last_unstale":"2023-07-05T18:56:17.191114+0000","last_undegraded":"2023-07-05T18:56:17.191114+0000","last_fullsized":"2023-07-05T18:56:17.191114+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T18:56:14.665171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T18:56:14.665171+0000","last_clean_scrub_stamp":"2023-07-05T18:56:14.665171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T03:02:00.204080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-05T18:56:16.105649+0000","last_change":"2023-07-05T18:56:15.121207+0000","last_active":"2023-07-05T18:56:16.105649+0000","last_peered":"2023-07-05T18:56:16.105649+0000","last_clean":"2023-07-05T18:56:16.105649+0000","last_became_active":"2023-07-05T18:56:15.120697+0000","last_became_peered":"2023-07-05T18:56:15.120697+0000","last_unstale":"2023-07-05T18:56:16.105649+0000","last_undegraded":"2023-07-05T18:56:16.105649+0000","last_fullsized":"2023-07-05T18:56:16.105649+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T18:56:14.665171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T18:56:14.665171+0000","last_clean_scrub_stamp":"2023-07-05T18:56:14.665171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T03:08:48.441898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"20'1","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-05T18:56:17.658707+0000","last_change":"2023-07-05T18:56:14.692934+0000","last_active":"2023-07-05T18:56:17.658707+0000","last_peered":"2023-07-05T18:56:17.658707+0000","last_clean":"2023-07-05T18:56:17.658707+0000","last_became_active":"2023-07-05T18:56:14.692645+0000","last_became_peered":"2023-07-05T18:56:14.692645+0000","last_unstale":"2023-07-05T18:56:17.658707+0000","last_undegraded":"2023-07-05T18:56:17.658707+0000","last_fullsized":"2023-07-05T18:56:17.658707+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T18:56:13.659893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T18:56:13.659893+0000","last_clean_scrub_stamp":"2023-07-05T18:56:13.659893+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T04:34:53.807856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-05T18:56:16.104876+0000","last_change":"2023-07-05T18:56:15.112376+0000","last_active":"2023-07-05T18:56:16.104876+0000","last_peered":"2023-07-05T18:56:16.104876+0000","last_clean":"2023-07-05T18:56:16.104876+0000","last_became_active":"2023-07-05T18:56:15.111904+0000","last_became_peered":"2023-07-05T18:56:15.111904+0000","last_unstale":"2023-07-05T18:56:16.104876+0000","last_undegraded":"2023-07-05T18:56:16.104876+0000","last_fullsized":"2023-07-05T18:56:16.104876+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T18:56:14.665171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T18:56:14.665171+0000","last_clean_scrub_stamp":"2023-07-05T18:56:14.665171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T03:39:30.527160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-05T18:56:17.190892+0000","last_change":"2023-07-05T18:56:14.698190+0000","last_active":"2023-07-05T18:56:17.190892+0000","last_peered":"2023-07-05T18:56:17.190892+0000","last_clean":"2023-07-05T18:56:17.190892+0000","last_became_active":"2023-07-05T18:56:14.697916+0000","last_became_peered":"2023-07-05T18:56:14.697916+0000","last_unstale":"2023-07-05T18:56:17.190892+0000","last_undegraded":"2023-07-05T18:56:17.190892+0000","last_fullsized":"2023-07-05T18:56:17.190892+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T18:56:13.659893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T18:56:13.659893+0000","last_clean_scrub_stamp":"2023-07-05T18:56:13.659893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T05:13:26.630999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-05T18:56:16.474349+0000","last_change":"2023-07-05T18:56:15.121188+0000","last_active":"2023-07-05T18:56:16.474349+0000","last_peered":"2023-07-05T18:56:16.474349+0000","last_clean":"2023-07-05T18:56:16.474349+0000","last_became_active":"2023-07-05T18:56:15.120955+0000","last_became_peered":"2023-07-05T18:56:15.120955+0000","last_unstale":"2023-07-05T18:56:16.474349+0000","last_undegraded":"2023-07-05T18:56:16.474349+0000","last_fullsized":"2023-07-05T18:56:16.474349+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T18:56:14.665171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T18:56:14.665171+0000","last_clean_scrub_stamp":"2023-07-05T18:56:14.665171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-06T21:14:58.040487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-05T18:56:16.104435+0000","last_change":"2023-07-05T18:56:14.689037+0000","last_active":"2023-07-05T18:56:16.104435+0000","last_peered":"2023-07-05T18:56:16.104435+0000","last_clean":"2023-07-05T18:56:16.104435+0000","last_became_active":"2023-07-05T18:56:14.688728+0000","last_became_peered":"2023-07-05T18:56:14.688728+0000","last_unstale":"2023-07-05T18:56:16.104435+0000","last_undegraded":"2023-07-05T18:56:16.104435+0000","last_fullsized":"2023-07-05T18:56:16.104435+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T18:56:13.659893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T18:56:13.659893+0000","last_clean_scrub_stamp":"2023-07-05T18:56:13.659893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-06T22:32:10.488434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-05T18:56:16.105018+0000","last_change":"2023-07-05T18:56:15.115710+0000","last_active":"2023-07-05T18:56:16.105018+0000","last_peered":"2023-07-05T18:56:16.105018+0000","last_clean":"2023-07-05T18:56:16.105018+0000","last_became_active":"2023-07-05T18:56:15.115354+0000","last_became_peered":"2023-07-05T18:56:15.115354+0000","last_unstale":"2023-07-05T18:56:16.105018+0000","last_undegraded":"2023-07-05T18:56:16.105018+0000","last_fullsized":"2023-07-05T18:56:16.105018+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T18:56:14.665171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T18:56:14.665171+0000","last_clean_scrub_stamp":"2023-07-05T18:56:14.665171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T02:24:35.873082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-05T18:56:16.474292+0000","last_change":"2023-07-05T18:56:14.689657+0000","last_active":"2023-07-05T18:56:16.474292+0000","last_peered":"2023-07-05T18:56:16.474292+0000","last_clean":"2023-07-05T18:56:16.474292+0000","last_became_active":"2023-07-05T18:56:14.689065+0000","last_became_peered":"2023-07-05T18:56:14.689065+0000","last_unstale":"2023-07-05T18:56:16.474292+0000","last_undegraded":"2023-07-05T18:56:16.474292+0000","last_fullsized":"2023-07-05T18:56:16.474292+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T18:56:13.659893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T18:56:13.659893+0000","last_clean_scrub_stamp":"2023-07-05T18:56:13.659893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T01:35:59.096513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-05T18:56:16.104489+0000","last_change":"2023-07-05T18:56:15.113602+0000","last_active":"2023-07-05T18:56:16.104489+0000","last_peered":"2023-07-05T18:56:16.104489+0000","last_clean":"2023-07-05T18:56:16.104489+0000","last_became_active":"2023-07-05T18:56:15.113313+0000","last_became_peered":"2023-07-05T18:56:15.113313+0000","last_unstale":"2023-07-05T18:56:16.104489+0000","last_undegraded":"2023-07-05T18:56:16.104489+0000","last_fullsized":"2023-07-05T18:56:16.104489+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T18:56:14.665171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T18:56:14.665171+0000","last_clean_scrub_stamp":"2023-07-05T18:56:14.665171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-06T21:14:58.040487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-05T18:56:16.105135+0000","last_change":"2023-07-05T18:56:14.686543+0000","last_active":"2023-07-05T18:56:16.105135+0000","last_peered":"2023-07-05T18:56:16.105135+0000","last_clean":"2023-07-05T18:56:16.105135+0000","last_became_active":"2023-07-05T18:56:14.686277+0000","last_became_peered":"2023-07-05T18:56:14.686277+0000","last_unstale":"2023-07-05T18:56:16.105135+0000","last_undegraded":"2023-07-05T18:56:16.105135+0000","last_fullsized":"2023-07-05T18:56:16.105135+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T18:56:13.659893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T18:56:13.659893+0000","last_clean_scrub_stamp":"2023-07-05T18:56:13.659893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T05:13:26.630999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-05T18:56:16.104551+0000","last_change":"2023-07-05T18:56:15.117293+0000","last_active":"2023-07-05T18:56:16.104551+0000","last_peered":"2023-07-05T18:56:16.104551+0000","last_clean":"2023-07-05T18:56:16.104551+0000","last_became_active":"2023-07-05T18:56:15.114133+0000","last_became_peered":"2023-07-05T18:56:15.114133+0000","last_unstale":"2023-07-05T18:56:16.104551+0000","last_undegraded":"2023-07-05T18:56:16.104551+0000","last_fullsized":"2023-07-05T18:56:16.104551+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T18:56:14.665171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T18:56:14.665171+0000","last_clean_scrub_stamp":"2023-07-05T18:56:14.665171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T02:13:19.229598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"20'3","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-05T18:56:17.158600+0000","last_change":"2023-07-05T18:56:14.697955+0000","last_active":"2023-07-05T18:56:17.158600+0000","last_peered":"2023-07-05T18:56:17.158600+0000","last_clean":"2023-07-05T18:56:17.158600+0000","last_became_active":"2023-07-05T18:56:14.697729+0000","last_became_peered":"2023-07-05T18:56:14.697729+0000","last_unstale":"2023-07-05T18:56:17.158600+0000","last_undegraded":"2023-07-05T18:56:17.158600+0000","last_fullsized":"2023-07-05T18:56:17.158600+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T18:56:13.659893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T18:56:13.659893+0000","last_clean_scrub_stamp":"2023-07-05T18:56:13.659893+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T00:22:00.885983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-05T18:56:17.190602+0000","last_change":"2023-07-05T18:56:15.119531+0000","last_active":"2023-07-05T18:56:17.190602+0000","last_peered":"2023-07-05T18:56:17.190602+0000","last_clean":"2023-07-05T18:56:17.190602+0000","last_became_active":"2023-07-05T18:56:15.118905+0000","last_became_peered":"2023-07-05T18:56:15.118905+0000","last_unstale":"2023-07-05T18:56:17.190602+0000","last_undegraded":"2023-07-05T18:56:17.190602+0000","last_fullsized":"2023-07-05T18:56:17.190602+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T18:56:14.665171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T18:56:14.665171+0000","last_clean_scrub_stamp":"2023-07-05T18:56:14.665171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T01:07:17.521433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"20'6","reported_seq":19,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-05T18:56:17.659058+0000","last_change":"2023-07-05T18:56:14.686257+0000","last_active":"2023-07-05T18:56:17.659058+0000","last_peered":"2023-07-05T18:56:17.659058+0000","last_clean":"2023-07-05T18:56:17.659058+0000","last_became_active":"2023-07-05T18:56:14.685975+0000","last_became_peered":"2023-07-05T18:56:14.685975+0000","last_unstale":"2023-07-05T18:56:17.659058+0000","last_undegraded":"2023-07-05T18:56:17.659058+0000","last_fullsized":"2023-07-05T18:56:17.659058+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T18:56:13.659893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T18:56:13.659893+0000","last_clean_scrub_stamp":"2023-07-05T18:56:13.659893+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T01:36:07.431270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-05T18:56:17.658806+0000","last_change":"2023-07-05T18:56:15.123521+0000","last_active":"2023-07-05T18:56:17.658806+0000","last_peered":"2023-07-05T18:56:17.658806+0000","last_clean":"2023-07-05T18:56:17.658806+0000","last_became_active":"2023-07-05T18:56:15.123249+0000","last_became_peered":"2023-07-05T18:56:15.123249+0000","last_unstale":"2023-07-05T18:56:17.658806+0000","last_undegraded":"2023-07-05T18:56:17.658806+0000","last_fullsized":"2023-07-05T18:56:17.658806+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T18:56:14.665171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T18:56:14.665171+0000","last_clean_scrub_stamp":"2023-07-05T18:56:14.665171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T01:08:19.218925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.13","version":"20'2","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-05T18:56:17.158513+0000","last_change":"2023-07-05T18:56:14.688172+0000","last_active":"2023-07-05T18:56:17.158513+0000","last_peered":"2023-07-05T18:56:17.158513+0000","last_clean":"2023-07-05T18:56:17.158513+0000","last_became_active":"2023-07-05T18:56:14.687865+0000","last_became_peered":"2023-07-05T18:56:14.687865+0000","last_unstale":"2023-07-05T18:56:17.158513+0000","last_undegraded":"2023-07-05T18:56:17.158513+0000","last_fullsized":"2023-07-05T18:56:17.158513+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T18:56:13.659893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T18:56:13.659893+0000","last_clean_scrub_stamp":"2023-07-05T18:56:13.659893+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T01:08:18.213648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-05T18:56:16.104638+0000","last_change":"2023-07-05T18:56:15.122409+0000","last_active":"2023-07-05T18:56:16.104638+0000","last_peered":"2023-07-05T18:56:16.104638+0000","last_clean":"2023-07-05T18:56:16.104638+0000","last_became_active":"2023-07-05T18:56:15.122152+0000","last_became_peered":"2023-07-05T18:56:15.122152+0000","last_unstale":"2023-07-05T18:56:16.104638+0000","last_undegraded":"2023-07-05T18:56:16.104638+0000","last_fullsized":"2023-07-05T18:56:16.104638+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T18:56:14.665171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T18:56:14.665171+0000","last_clean_scrub_stamp":"2023-07-05T18:56:14.665171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T02:23:52.877499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-05T18:56:16.474220+0000","last_change":"2023-07-05T18:56:14.687246+0000","last_active":"2023-07-05T18:56:16.474220+0000","last_peered":"2023-07-05T18:56:16.474220+0000","last_clean":"2023-07-05T18:56:16.474220+0000","last_became_active":"2023-07-05T18:56:14.686917+0000","last_became_peered":"2023-07-05T18:56:14.686917+0000","last_unstale":"2023-07-05T18:56:16.474220+0000","last_undegraded":"2023-07-05T18:56:16.474220+0000","last_fullsized":"2023-07-05T18:56:16.474220+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T18:56:13.659893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T18:56:13.659893+0000","last_clean_scrub_stamp":"2023-07-05T18:56:13.659893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T03:01:59.198802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-05T18:56:16.105662+0000","last_change":"2023-07-05T18:56:15.120411+0000","last_active":"2023-07-05T18:56:16.105662+0000","last_peered":"2023-07-05T18:56:16.105662+0000","last_clean":"2023-07-05T18:56:16.105662+0000","last_became_active":"2023-07-05T18:56:15.117799+0000","last_became_peered":"2023-07-05T18:56:15.117799+0000","last_unstale":"2023-07-05T18:56:16.105662+0000","last_undegraded":"2023-07-05T18:56:16.105662+0000","last_fullsized":"2023-07-05T18:56:16.105662+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T18:56:14.665171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T18:56:14.665171+0000","last_clean_scrub_stamp":"2023-07-05T18:56:14.665171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-06T22:32:11.493711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-05T18:56:17.158276+0000","last_change":"2023-07-05T18:56:14.689699+0000","last_active":"2023-07-05T18:56:17.158276+0000","last_peered":"2023-07-05T18:56:17.158276+0000","last_clean":"2023-07-05T18:56:17.158276+0000","last_became_active":"2023-07-05T18:56:14.689136+0000","last_became_peered":"2023-07-05T18:56:14.689136+0000","last_unstale":"2023-07-05T18:56:17.158276+0000","last_undegraded":"2023-07-05T18:56:17.158276+0000","last_fullsized":"2023-07-05T18:56:17.158276+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T18:56:13.659893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T18:56:13.659893+0000","last_clean_scrub_stamp":"2023-07-05T18:56:13.659893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T02:13:18.224321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-05T18:56:16.474079+0000","last_change":"2023-07-05T18:56:15.121706+0000","last_active":"2023-07-05T18:56:16.474079+0000","last_peered":"2023-07-05T18:56:16.474079+0000","last_clean":"2023-07-05T18:56:16.474079+0000","last_became_active":"2023-07-05T18:56:15.121455+0000","last_became_peered":"2023-07-05T18:56:15.121455+0000","last_unstale":"2023-07-05T18:56:16.474079+0000","last_undegraded":"2023-07-05T18:56:16.474079+0000","last_fullsized":"2023-07-05T18:56:16.474079+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T18:56:14.665171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T18:56:14.665171+0000","last_clean_scrub_stamp":"2023-07-05T18:56:14.665171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T05:13:27.636276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"20'8","reported_seq":21,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-05T18:56:16.104386+0000","last_change":"2023-07-05T18:56:14.689000+0000","last_active":"2023-07-05T18:56:16.104386+0000","last_peered":"2023-07-05T18:56:16.104386+0000","last_clean":"2023-07-05T18:56:16.104386+0000","last_became_active":"2023-07-05T18:56:14.688670+0000","last_became_peered":"2023-07-05T18:56:14.688670+0000","last_unstale":"2023-07-05T18:56:16.104386+0000","last_undegraded":"2023-07-05T18:56:16.104386+0000","last_fullsized":"2023-07-05T18:56:16.104386+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T18:56:13.659893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T18:56:13.659893+0000","last_clean_scrub_stamp":"2023-07-05T18:56:13.659893+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-06T23:52:21.769984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-05T18:56:16.105133+0000","last_change":"2023-07-05T18:56:15.117236+0000","last_active":"2023-07-05T18:56:16.105133+0000","last_peered":"2023-07-05T18:56:16.105133+0000","last_clean":"2023-07-05T18:56:16.105133+0000","last_became_active":"2023-07-05T18:56:15.116848+0000","last_became_peered":"2023-07-05T18:56:15.116848+0000","last_unstale":"2023-07-05T18:56:16.105133+0000","last_undegraded":"2023-07-05T18:56:16.105133+0000","last_fullsized":"2023-07-05T18:56:16.105133+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T18:56:14.665171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T18:56:14.665171+0000","last_clean_scrub_stamp":"2023-07-05T18:56:14.665171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T04:41:48.823682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"20'1","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-05T18:56:17.158684+0000","last_change":"2023-07-05T18:56:14.688547+0000","last_active":"2023-07-05T18:56:17.158684+0000","last_peered":"2023-07-05T18:56:17.158684+0000","last_clean":"2023-07-05T18:56:17.158684+0000","last_became_active":"2023-07-05T18:56:14.688296+0000","last_became_peered":"2023-07-05T18:56:14.688296+0000","last_unstale":"2023-07-05T18:56:17.158684+0000","last_undegraded":"2023-07-05T18:56:17.158684+0000","last_fullsized":"2023-07-05T18:56:17.158684+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T18:56:13.659893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T18:56:13.659893+0000","last_clean_scrub_stamp":"2023-07-05T18:56:13.659893+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T02:16:58.460543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-05T18:56:16.105182+0000","last_change":"2023-07-05T18:56:15.117356+0000","last_active":"2023-07-05T18:56:16.105182+0000","last_peered":"2023-07-05T18:56:16.105182+0000","last_clean":"2023-07-05T18:56:16.105182+0000","last_became_active":"2023-07-05T18:56:15.117053+0000","last_became_peered":"2023-07-05T18:56:15.117053+0000","last_unstale":"2023-07-05T18:56:16.105182+0000","last_undegraded":"2023-07-05T18:56:16.105182+0000","last_fullsized":"2023-07-05T18:56:16.105182+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T18:56:14.665171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T18:56:14.665171+0000","last_clean_scrub_stamp":"2023-07-05T18:56:14.665171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T04:53:59.163434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"20'2","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-05T18:56:17.158412+0000","last_change":"2023-07-05T18:56:14.688203+0000","last_active":"2023-07-05T18:56:17.158412+0000","last_peered":"2023-07-05T18:56:17.158412+0000","last_clean":"2023-07-05T18:56:17.158412+0000","last_became_active":"2023-07-05T18:56:14.687907+0000","last_became_peered":"2023-07-05T18:56:14.687907+0000","last_unstale":"2023-07-05T18:56:17.158412+0000","last_undegraded":"2023-07-05T18:56:17.158412+0000","last_fullsized":"2023-07-05T18:56:17.158412+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T18:56:13.659893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T18:56:13.659893+0000","last_clean_scrub_stamp":"2023-07-05T18:56:13.659893+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T04:34:53.807856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-05T18:56:17.658461+0000","last_change":"2023-07-05T18:56:15.122876+0000","last_active":"2023-07-05T18:56:17.658461+0000","last_peered":"2023-07-05T18:56:17.658461+0000","last_clean":"2023-07-05T18:56:17.658461+0000","last_became_active":"2023-07-05T18:56:15.122580+0000","last_became_peered":"2023-07-05T18:56:15.122580+0000","last_unstale":"2023-07-05T18:56:17.658461+0000","last_undegraded":"2023-07-05T18:56:17.658461+0000","last_fullsized":"2023-07-05T18:56:17.658461+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T18:56:14.665171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T18:56:14.665171+0000","last_clean_scrub_stamp":"2023-07-05T18:56:14.665171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T02:30:29.740847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.d","version":"20'1","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-05T18:56:17.158635+0000","last_change":"2023-07-05T18:56:14.688520+0000","last_active":"2023-07-05T18:56:17.158635+0000","last_peered":"2023-07-05T18:56:17.158635+0000","last_clean":"2023-07-05T18:56:17.158635+0000","last_became_active":"2023-07-05T18:56:14.688106+0000","last_became_peered":"2023-07-05T18:56:14.688106+0000","last_unstale":"2023-07-05T18:56:17.158635+0000","last_undegraded":"2023-07-05T18:56:17.158635+0000","last_fullsized":"2023-07-05T18:56:17.158635+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T18:56:13.659893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T18:56:13.659893+0000","last_clean_scrub_stamp":"2023-07-05T18:56:13.659893+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-06T23:38:28.346200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-05T18:56:16.104261+0000","last_change":"2023-07-05T18:56:15.112983+0000","last_active":"2023-07-05T18:56:16.104261+0000","last_peered":"2023-07-05T18:56:16.104261+0000","last_clean":"2023-07-05T18:56:16.104261+0000","last_became_active":"2023-07-05T18:56:15.112573+0000","last_became_peered":"2023-07-05T18:56:15.112573+0000","last_unstale":"2023-07-05T18:56:16.104261+0000","last_undegraded":"2023-07-05T18:56:16.104261+0000","last_fullsized":"2023-07-05T18:56:16.104261+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T18:56:14.665171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T18:56:14.665171+0000","last_clean_scrub_stamp":"2023-07-05T18:56:14.665171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-06T19:43:28.708822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-05T18:56:16.105586+0000","last_change":"2023-07-05T18:56:14.683769+0000","last_active":"2023-07-05T18:56:16.105586+0000","last_peered":"2023-07-05T18:56:16.105586+0000","last_clean":"2023-07-05T18:56:16.105586+0000","last_became_active":"2023-07-05T18:56:14.683471+0000","last_became_peered":"2023-07-05T18:56:14.683471+0000","last_unstale":"2023-07-05T18:56:16.105586+0000","last_undegraded":"2023-07-05T18:56:16.105586+0000","last_fullsized":"2023-07-05T18:56:16.105586+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T18:56:13.659893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T18:56:13.659893+0000","last_clean_scrub_stamp":"2023-07-05T18:56:13.659893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T03:01:59.198802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-05T18:56:16.474241+0000","last_change":"2023-07-05T18:56:15.120318+0000","last_active":"2023-07-05T18:56:16.474241+0000","last_peered":"2023-07-05T18:56:16.474241+0000","last_clean":"2023-07-05T18:56:16.474241+0000","last_became_active":"2023-07-05T18:56:15.119781+0000","last_became_peered":"2023-07-05T18:56:15.119781+0000","last_unstale":"2023-07-05T18:56:16.474241+0000","last_undegraded":"2023-07-05T18:56:16.474241+0000","last_fullsized":"2023-07-05T18:56:16.474241+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T18:56:14.665171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T18:56:14.665171+0000","last_clean_scrub_stamp":"2023-07-05T18:56:14.665171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T03:08:48.441898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"20'2","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-05T18:56:16.104648+0000","last_change":"2023-07-05T18:56:14.697766+0000","last_active":"2023-07-05T18:56:16.104648+0000","last_peered":"2023-07-05T18:56:16.104648+0000","last_clean":"2023-07-05T18:56:16.104648+0000","last_became_active":"2023-07-05T18:56:14.697460+0000","last_became_peered":"2023-07-05T18:56:14.697460+0000","last_unstale":"2023-07-05T18:56:16.104648+0000","last_undegraded":"2023-07-05T18:56:16.104648+0000","last_fullsized":"2023-07-05T18:56:16.104648+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T18:56:13.659893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T18:56:13.659893+0000","last_clean_scrub_stamp":"2023-07-05T18:56:13.659893+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T05:47:50.661848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-05T18:56:17.659034+0000","last_change":"2023-07-05T18:56:15.126143+0000","last_active":"2023-07-05T18:56:17.659034+0000","last_peered":"2023-07-05T18:56:17.659034+0000","last_clean":"2023-07-05T18:56:17.659034+0000","last_became_active":"2023-07-05T18:56:15.125704+0000","last_became_peered":"2023-07-05T18:56:15.125704+0000","last_unstale":"2023-07-05T18:56:17.659034+0000","last_undegraded":"2023-07-05T18:56:17.659034+0000","last_fullsized":"2023-07-05T18:56:17.659034+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T18:56:14.665171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T18:56:14.665171+0000","last_clean_scrub_stamp":"2023-07-05T18:56:14.665171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T02:16:59.465821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-05T18:56:16.104166+0000","last_change":"2023-07-05T18:56:14.681768+0000","last_active":"2023-07-05T18:56:16.104166+0000","last_peered":"2023-07-05T18:56:16.104166+0000","last_clean":"2023-07-05T18:56:16.104166+0000","last_became_active":"2023-07-05T18:56:14.681488+0000","last_became_peered":"2023-07-05T18:56:14.681488+0000","last_unstale":"2023-07-05T18:56:16.104166+0000","last_undegraded":"2023-07-05T18:56:16.104166+0000","last_fullsized":"2023-07-05T18:56:16.104166+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T18:56:13.659893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T18:56:13.659893+0000","last_clean_scrub_stamp":"2023-07-05T18:56:13.659893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T01:07:16.516155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-05T18:56:17.659215+0000","last_change":"2023-07-05T18:56:15.131136+0000","last_active":"2023-07-05T18:56:17.659215+0000","last_peered":"2023-07-05T18:56:17.659215+0000","last_clean":"2023-07-05T18:56:17.659215+0000","last_became_active":"2023-07-05T18:56:15.130845+0000","last_became_peered":"2023-07-05T18:56:15.130845+0000","last_unstale":"2023-07-05T18:56:17.659215+0000","last_undegraded":"2023-07-05T18:56:17.659215+0000","last_fullsized":"2023-07-05T18:56:17.659215+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T18:56:14.665171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T18:56:14.665171+0000","last_clean_scrub_stamp":"2023-07-05T18:56:14.665171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-06T20:32:29.656581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-05T18:56:17.658694+0000","last_change":"2023-07-05T18:56:14.694531+0000","last_active":"2023-07-05T18:56:17.658694+0000","last_peered":"2023-07-05T18:56:17.658694+0000","last_clean":"2023-07-05T18:56:17.658694+0000","last_became_active":"2023-07-05T18:56:14.694255+0000","last_became_peered":"2023-07-05T18:56:14.694255+0000","last_unstale":"2023-07-05T18:56:17.658694+0000","last_undegraded":"2023-07-05T18:56:17.658694+0000","last_fullsized":"2023-07-05T18:56:17.658694+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T18:56:13.659893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T18:56:13.659893+0000","last_clean_scrub_stamp":"2023-07-05T18:56:13.659893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T05:47:50.661848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-05T18:56:17.659049+0000","last_change":"2023-07-05T18:56:15.125686+0000","last_active":"2023-07-05T18:56:17.659049+0000","last_peered":"2023-07-05T18:56:17.659049+0000","last_clean":"2023-07-05T18:56:17.659049+0000","last_became_active":"2023-07-05T18:56:15.124278+0000","last_became_peered":"2023-07-05T18:56:15.124278+0000","last_unstale":"2023-07-05T18:56:17.659049+0000","last_undegraded":"2023-07-05T18:56:17.659049+0000","last_fullsized":"2023-07-05T18:56:17.659049+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T18:56:14.665171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T18:56:14.665171+0000","last_clean_scrub_stamp":"2023-07-05T18:56:14.665171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T05:54:49.290188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-05T18:56:16.104272+0000","last_change":"2023-07-05T18:56:14.697776+0000","last_active":"2023-07-05T18:56:16.104272+0000","last_peered":"2023-07-05T18:56:16.104272+0000","last_clean":"2023-07-05T18:56:16.104272+0000","last_became_active":"2023-07-05T18:56:14.697446+0000","last_became_peered":"2023-07-05T18:56:14.697446+0000","last_unstale":"2023-07-05T18:56:16.104272+0000","last_undegraded":"2023-07-05T18:56:16.104272+0000","last_fullsized":"2023-07-05T18:56:16.104272+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T18:56:13.659893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T18:56:13.659893+0000","last_clean_scrub_stamp":"2023-07-05T18:56:13.659893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T03:19:03.957135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-05T18:56:17.191314+0000","last_change":"2023-07-05T18:56:15.119281+0000","last_active":"2023-07-05T18:56:17.191314+0000","last_peered":"2023-07-05T18:56:17.191314+0000","last_clean":"2023-07-05T18:56:17.191314+0000","last_became_active":"2023-07-05T18:56:15.118746+0000","last_became_peered":"2023-07-05T18:56:15.118746+0000","last_unstale":"2023-07-05T18:56:17.191314+0000","last_undegraded":"2023-07-05T18:56:17.191314+0000","last_fullsized":"2023-07-05T18:56:17.191314+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T18:56:14.665171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T18:56:14.665171+0000","last_clean_scrub_stamp":"2023-07-05T18:56:14.665171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-06T22:32:11.493711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"20'2","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-05T18:56:16.104993+0000","last_change":"2023-07-05T18:56:14.688850+0000","last_active":"2023-07-05T18:56:16.104993+0000","last_peered":"2023-07-05T18:56:16.104993+0000","last_clean":"2023-07-05T18:56:16.104993+0000","last_became_active":"2023-07-05T18:56:14.688549+0000","last_became_peered":"2023-07-05T18:56:14.688549+0000","last_unstale":"2023-07-05T18:56:16.104993+0000","last_undegraded":"2023-07-05T18:56:16.104993+0000","last_fullsized":"2023-07-05T18:56:16.104993+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T18:56:13.659893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T18:56:13.659893+0000","last_clean_scrub_stamp":"2023-07-05T18:56:13.659893+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-06T23:38:28.346200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":19,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-05T18:56:17.659116+0000","last_change":"2023-07-05T18:56:09.622184+0000","last_active":"2023-07-05T18:56:17.659116+0000","last_peered":"2023-07-05T18:56:17.659116+0000","last_clean":"2023-07-05T18:56:17.659116+0000","last_became_active":"2023-07-05T18:56:09.621796+0000","last_became_peered":"2023-07-05T18:56:09.621796+0000","last_unstale":"2023-07-05T18:56:17.659116+0000","last_undegraded":"2023-07-05T18:56:17.659116+0000","last_fullsized":"2023-07-05T18:56:17.659116+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T18:56:08.603137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T18:56:08.603137+0000","last_clean_scrub_stamp":"2023-07-05T18:56:08.603137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T00:53:51.106729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-05T18:56:16.104244+0000","last_change":"2023-07-05T18:56:15.117197+0000","last_active":"2023-07-05T18:56:16.104244+0000","last_peered":"2023-07-05T18:56:16.104244+0000","last_clean":"2023-07-05T18:56:16.104244+0000","last_became_active":"2023-07-05T18:56:15.116612+0000","last_became_peered":"2023-07-05T18:56:15.116612+0000","last_unstale":"2023-07-05T18:56:16.104244+0000","last_undegraded":"2023-07-05T18:56:16.104244+0000","last_fullsized":"2023-07-05T18:56:16.104244+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T18:56:14.665171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T18:56:14.665171+0000","last_clean_scrub_stamp":"2023-07-05T18:56:14.665171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T02:24:35.873082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":19,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-05T18:56:16.104703+0000","last_change":"2023-07-05T18:56:09.621596+0000","last_active":"2023-07-05T18:56:16.104703+0000","last_peered":"2023-07-05T18:56:16.104703+0000","last_clean":"2023-07-05T18:56:16.104703+0000","last_became_active":"2023-07-05T18:56:09.621315+0000","last_became_peered":"2023-07-05T18:56:09.621315+0000","last_unstale":"2023-07-05T18:56:16.104703+0000","last_undegraded":"2023-07-05T18:56:16.104703+0000","last_fullsized":"2023-07-05T18:56:16.104703+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T18:56:08.603137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T18:56:08.603137+0000","last_clean_scrub_stamp":"2023-07-05T18:56:08.603137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T01:08:13.156892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"21'1","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-05T18:56:17.235254+0000","last_change":"2023-07-05T18:56:14.693939+0000","last_active":"2023-07-05T18:56:17.235254+0000","last_peered":"2023-07-05T18:56:17.235254+0000","last_clean":"2023-07-05T18:56:17.235254+0000","last_became_active":"2023-07-05T18:56:14.693663+0000","last_became_peered":"2023-07-05T18:56:14.693663+0000","last_unstale":"2023-07-05T18:56:17.235254+0000","last_undegraded":"2023-07-05T18:56:17.235254+0000","last_fullsized":"2023-07-05T18:56:17.235254+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T18:56:13.659893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T18:56:13.659893+0000","last_clean_scrub_stamp":"2023-07-05T18:56:13.659893+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T02:23:51.872222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-05T18:56:17.658492+0000","last_change":"2023-07-05T18:56:15.127817+0000","last_active":"2023-07-05T18:56:17.658492+0000","last_peered":"2023-07-05T18:56:17.658492+0000","last_clean":"2023-07-05T18:56:17.658492+0000","last_became_active":"2023-07-05T18:56:15.127512+0000","last_became_peered":"2023-07-05T18:56:15.127512+0000","last_unstale":"2023-07-05T18:56:17.658492+0000","last_undegraded":"2023-07-05T18:56:17.658492+0000","last_fullsized":"2023-07-05T18:56:17.658492+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T18:56:14.665171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T18:56:14.665171+0000","last_clean_scrub_stamp":"2023-07-05T18:56:14.665171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T01:36:00.101790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":19,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-05T18:56:17.190599+0000","last_change":"2023-07-05T18:56:09.617992+0000","last_active":"2023-07-05T18:56:17.190599+0000","last_peered":"2023-07-05T18:56:17.190599+0000","last_clean":"2023-07-05T18:56:17.190599+0000","last_became_active":"2023-07-05T18:56:09.617720+0000","last_became_peered":"2023-07-05T18:56:09.617720+0000","last_unstale":"2023-07-05T18:56:17.190599+0000","last_undegraded":"2023-07-05T18:56:17.190599+0000","last_fullsized":"2023-07-05T18:56:17.190599+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T18:56:08.603137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T18:56:08.603137+0000","last_clean_scrub_stamp":"2023-07-05T18:56:08.603137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-06T19:43:22.646788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"17'117","reported_seq":169,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-05T18:56:17.158224+0000","last_change":"2023-07-05T18:56:09.621746+0000","last_active":"2023-07-05T18:56:17.158224+0000","last_peered":"2023-07-05T18:56:17.158224+0000","last_clean":"2023-07-05T18:56:17.158224+0000","last_became_active":"2023-07-05T18:56:09.621421+0000","last_became_peered":"2023-07-05T18:56:09.621421+0000","last_unstale":"2023-07-05T18:56:17.158224+0000","last_undegraded":"2023-07-05T18:56:17.158224+0000","last_fullsized":"2023-07-05T18:56:17.158224+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T18:56:08.603137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T18:56:08.603137+0000","last_clean_scrub_stamp":"2023-07-05T18:56:08.603137+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T05:47:45.605092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-05T18:56:16.474394+0000","last_change":"2023-07-05T18:56:14.688968+0000","last_active":"2023-07-05T18:56:16.474394+0000","last_peered":"2023-07-05T18:56:16.474394+0000","last_clean":"2023-07-05T18:56:16.474394+0000","last_became_active":"2023-07-05T18:56:14.688664+0000","last_became_peered":"2023-07-05T18:56:14.688664+0000","last_unstale":"2023-07-05T18:56:16.474394+0000","last_undegraded":"2023-07-05T18:56:16.474394+0000","last_fullsized":"2023-07-05T18:56:16.474394+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T18:56:13.659893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T18:56:13.659893+0000","last_clean_scrub_stamp":"2023-07-05T18:56:13.659893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T02:13:18.224321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-05T18:56:16.474255+0000","last_change":"2023-07-05T18:56:15.121025+0000","last_active":"2023-07-05T18:56:16.474255+0000","last_peered":"2023-07-05T18:56:16.474255+0000","last_clean":"2023-07-05T18:56:16.474255+0000","last_became_active":"2023-07-05T18:56:15.120768+0000","last_became_peered":"2023-07-05T18:56:15.120768+0000","last_unstale":"2023-07-05T18:56:16.474255+0000","last_undegraded":"2023-07-05T18:56:16.474255+0000","last_fullsized":"2023-07-05T18:56:16.474255+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T18:56:14.665171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T18:56:14.665171+0000","last_clean_scrub_stamp":"2023-07-05T18:56:14.665171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-06T22:32:11.493711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":19,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-05T18:56:17.158181+0000","last_change":"2023-07-05T18:56:10.073940+0000","last_active":"2023-07-05T18:56:17.158181+0000","last_peered":"2023-07-05T18:56:17.158181+0000","last_clean":"2023-07-05T18:56:17.158181+0000","last_became_active":"2023-07-05T18:56:10.073617+0000","last_became_peered":"2023-07-05T18:56:10.073617+0000","last_unstale":"2023-07-05T18:56:17.158181+0000","last_undegraded":"2023-07-05T18:56:17.158181+0000","last_fullsized":"2023-07-05T18:56:17.158181+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T18:56:08.603137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T18:56:08.603137+0000","last_clean_scrub_stamp":"2023-07-05T18:56:08.603137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T02:23:46.815465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-05T18:56:17.190477+0000","last_change":"2023-07-05T18:56:14.694860+0000","last_active":"2023-07-05T18:56:17.190477+0000","last_peered":"2023-07-05T18:56:17.190477+0000","last_clean":"2023-07-05T18:56:17.190477+0000","last_became_active":"2023-07-05T18:56:14.694544+0000","last_became_peered":"2023-07-05T18:56:14.694544+0000","last_unstale":"2023-07-05T18:56:17.190477+0000","last_undegraded":"2023-07-05T18:56:17.190477+0000","last_fullsized":"2023-07-05T18:56:17.190477+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T18:56:13.659893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T18:56:13.659893+0000","last_clean_scrub_stamp":"2023-07-05T18:56:13.659893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-06T23:52:21.769984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-05T18:56:17.191246+0000","last_change":"2023-07-05T18:56:15.118635+0000","last_active":"2023-07-05T18:56:17.191246+0000","last_peered":"2023-07-05T18:56:17.191246+0000","last_clean":"2023-07-05T18:56:17.191246+0000","last_became_active":"2023-07-05T18:56:15.115781+0000","last_became_peered":"2023-07-05T18:56:15.115781+0000","last_unstale":"2023-07-05T18:56:17.191246+0000","last_undegraded":"2023-07-05T18:56:17.191246+0000","last_fullsized":"2023-07-05T18:56:17.191246+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T18:56:14.665171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T18:56:14.665171+0000","last_clean_scrub_stamp":"2023-07-05T18:56:14.665171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T03:08:48.441898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":19,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-05T18:56:17.158048+0000","last_change":"2023-07-05T18:56:10.073658+0000","last_active":"2023-07-05T18:56:17.158048+0000","last_peered":"2023-07-05T18:56:17.158048+0000","last_clean":"2023-07-05T18:56:17.158048+0000","last_became_active":"2023-07-05T18:56:10.073336+0000","last_became_peered":"2023-07-05T18:56:10.073336+0000","last_unstale":"2023-07-05T18:56:17.158048+0000","last_undegraded":"2023-07-05T18:56:17.158048+0000","last_fullsized":"2023-07-05T18:56:17.158048+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T18:56:08.603137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T18:56:08.603137+0000","last_clean_scrub_stamp":"2023-07-05T18:56:08.603137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T01:35:54.039757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-05T18:56:16.104468+0000","last_change":"2023-07-05T18:56:14.684990+0000","last_active":"2023-07-05T18:56:16.104468+0000","last_peered":"2023-07-05T18:56:16.104468+0000","last_clean":"2023-07-05T18:56:16.104468+0000","last_became_active":"2023-07-05T18:56:14.684539+0000","last_became_peered":"2023-07-05T18:56:14.684539+0000","last_unstale":"2023-07-05T18:56:16.104468+0000","last_undegraded":"2023-07-05T18:56:16.104468+0000","last_fullsized":"2023-07-05T18:56:16.104468+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T18:56:13.659893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T18:56:13.659893+0000","last_clean_scrub_stamp":"2023-07-05T18:56:13.659893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T01:35:59.096513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-05T18:56:16.104626+0000","last_change":"2023-07-05T18:56:15.128949+0000","last_active":"2023-07-05T18:56:16.104626+0000","last_peered":"2023-07-05T18:56:16.104626+0000","last_clean":"2023-07-05T18:56:16.104626+0000","last_became_active":"2023-07-05T18:56:15.128650+0000","last_became_peered":"2023-07-05T18:56:15.128650+0000","last_unstale":"2023-07-05T18:56:16.104626+0000","last_undegraded":"2023-07-05T18:56:16.104626+0000","last_fullsized":"2023-07-05T18:56:16.104626+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T18:56:14.665171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T18:56:14.665171+0000","last_clean_scrub_stamp":"2023-07-05T18:56:14.665171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T04:53:59.163434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":19,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-05T18:56:16.105025+0000","last_change":"2023-07-05T18:56:10.073693+0000","last_active":"2023-07-05T18:56:16.105025+0000","last_peered":"2023-07-05T18:56:16.105025+0000","last_clean":"2023-07-05T18:56:16.105025+0000","last_became_active":"2023-07-05T18:56:10.073356+0000","last_became_peered":"2023-07-05T18:56:10.073356+0000","last_unstale":"2023-07-05T18:56:16.105025+0000","last_undegraded":"2023-07-05T18:56:16.105025+0000","last_fullsized":"2023-07-05T18:56:16.105025+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T18:56:08.603137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T18:56:08.603137+0000","last_clean_scrub_stamp":"2023-07-05T18:56:08.603137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T02:48:59.875595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-05T18:56:17.659009+0000","last_change":"2023-07-05T18:56:14.694026+0000","last_active":"2023-07-05T18:56:17.659009+0000","last_peered":"2023-07-05T18:56:17.659009+0000","last_clean":"2023-07-05T18:56:17.659009+0000","last_became_active":"2023-07-05T18:56:14.693684+0000","last_became_peered":"2023-07-05T18:56:14.693684+0000","last_unstale":"2023-07-05T18:56:17.659009+0000","last_undegraded":"2023-07-05T18:56:17.659009+0000","last_fullsized":"2023-07-05T18:56:17.659009+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T18:56:13.659893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T18:56:13.659893+0000","last_clean_scrub_stamp":"2023-07-05T18:56:13.659893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-06T23:47:47.938498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-05T18:56:17.191015+0000","last_change":"2023-07-05T18:56:15.109026+0000","last_active":"2023-07-05T18:56:17.191015+0000","last_peered":"2023-07-05T18:56:17.191015+0000","last_clean":"2023-07-05T18:56:17.191015+0000","last_became_active":"2023-07-05T18:56:15.108685+0000","last_became_peered":"2023-07-05T18:56:15.108685+0000","last_unstale":"2023-07-05T18:56:17.191015+0000","last_undegraded":"2023-07-05T18:56:17.191015+0000","last_fullsized":"2023-07-05T18:56:17.191015+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T18:56:14.665171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T18:56:14.665171+0000","last_clean_scrub_stamp":"2023-07-05T18:56:14.665171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-06T21:50:37.526388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":19,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-05T18:56:16.104315+0000","last_change":"2023-07-05T18:56:10.073639+0000","last_active":"2023-07-05T18:56:16.104315+0000","last_peered":"2023-07-05T18:56:16.104315+0000","last_clean":"2023-07-05T18:56:16.104315+0000","last_became_active":"2023-07-05T18:56:10.073339+0000","last_became_peered":"2023-07-05T18:56:10.073339+0000","last_unstale":"2023-07-05T18:56:16.104315+0000","last_undegraded":"2023-07-05T18:56:16.104315+0000","last_fullsized":"2023-07-05T18:56:16.104315+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T18:56:08.603137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T18:56:08.603137+0000","last_clean_scrub_stamp":"2023-07-05T18:56:08.603137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T02:48:59.875595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-05T18:56:17.191009+0000","last_change":"2023-07-05T18:56:14.695868+0000","last_active":"2023-07-05T18:56:17.191009+0000","last_peered":"2023-07-05T18:56:17.191009+0000","last_clean":"2023-07-05T18:56:17.191009+0000","last_became_active":"2023-07-05T18:56:14.695540+0000","last_became_peered":"2023-07-05T18:56:14.695540+0000","last_unstale":"2023-07-05T18:56:17.191009+0000","last_undegraded":"2023-07-05T18:56:17.191009+0000","last_fullsized":"2023-07-05T18:56:17.191009+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T18:56:13.659893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T18:56:13.659893+0000","last_clean_scrub_stamp":"2023-07-05T18:56:13.659893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T02:24:34.867804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-05T18:56:16.474258+0000","last_change":"2023-07-05T18:56:15.120478+0000","last_active":"2023-07-05T18:56:16.474258+0000","last_peered":"2023-07-05T18:56:16.474258+0000","last_clean":"2023-07-05T18:56:16.474258+0000","last_became_active":"2023-07-05T18:56:15.120038+0000","last_became_peered":"2023-07-05T18:56:15.120038+0000","last_unstale":"2023-07-05T18:56:16.474258+0000","last_undegraded":"2023-07-05T18:56:16.474258+0000","last_fullsized":"2023-07-05T18:56:16.474258+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T18:56:14.665171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T18:56:14.665171+0000","last_clean_scrub_stamp":"2023-07-05T18:56:14.665171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T04:53:59.163434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":19,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-05T18:56:16.104808+0000","last_change":"2023-07-05T18:56:09.619299+0000","last_active":"2023-07-05T18:56:16.104808+0000","last_peered":"2023-07-05T18:56:16.104808+0000","last_clean":"2023-07-05T18:56:16.104808+0000","last_became_active":"2023-07-05T18:56:09.618958+0000","last_became_peered":"2023-07-05T18:56:09.618958+0000","last_unstale":"2023-07-05T18:56:16.104808+0000","last_undegraded":"2023-07-05T18:56:16.104808+0000","last_fullsized":"2023-07-05T18:56:16.104808+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T18:56:08.603137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T18:56:08.603137+0000","last_clean_scrub_stamp":"2023-07-05T18:56:08.603137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-06T21:50:31.464355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-05T18:56:16.105755+0000","last_change":"2023-07-05T18:56:14.684753+0000","last_active":"2023-07-05T18:56:16.105755+0000","last_peered":"2023-07-05T18:56:16.105755+0000","last_clean":"2023-07-05T18:56:16.105755+0000","last_became_active":"2023-07-05T18:56:14.684386+0000","last_became_peered":"2023-07-05T18:56:14.684386+0000","last_unstale":"2023-07-05T18:56:16.105755+0000","last_undegraded":"2023-07-05T18:56:16.105755+0000","last_fullsized":"2023-07-05T18:56:16.105755+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T18:56:13.659893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T18:56:13.659893+0000","last_clean_scrub_stamp":"2023-07-05T18:56:13.659893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T01:35:59.096513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-05T18:56:17.191032+0000","last_change":"2023-07-05T18:56:15.109419+0000","last_active":"2023-07-05T18:56:17.191032+0000","last_peered":"2023-07-05T18:56:17.191032+0000","last_clean":"2023-07-05T18:56:17.191032+0000","last_became_active":"2023-07-05T18:56:15.109114+0000","last_became_peered":"2023-07-05T18:56:15.109114+0000","last_unstale":"2023-07-05T18:56:17.191032+0000","last_undegraded":"2023-07-05T18:56:17.191032+0000","last_fullsized":"2023-07-05T18:56:17.191032+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T18:56:14.665171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T18:56:14.665171+0000","last_clean_scrub_stamp":"2023-07-05T18:56:14.665171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T03:19:04.962412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"20'1","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-05T18:56:16.474134+0000","last_change":"2023-07-05T18:56:14.693851+0000","last_active":"2023-07-05T18:56:16.474134+0000","last_peered":"2023-07-05T18:56:16.474134+0000","last_clean":"2023-07-05T18:56:16.474134+0000","last_became_active":"2023-07-05T18:56:14.693542+0000","last_became_peered":"2023-07-05T18:56:14.693542+0000","last_unstale":"2023-07-05T18:56:16.474134+0000","last_undegraded":"2023-07-05T18:56:16.474134+0000","last_fullsized":"2023-07-05T18:56:16.474134+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T18:56:13.659893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T18:56:13.659893+0000","last_clean_scrub_stamp":"2023-07-05T18:56:13.659893+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T03:19:03.957135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-05T18:56:17.658314+0000","last_change":"2023-07-05T18:56:15.103604+0000","last_active":"2023-07-05T18:56:17.658314+0000","last_peered":"2023-07-05T18:56:17.658314+0000","last_clean":"2023-07-05T18:56:17.658314+0000","last_became_active":"2023-07-05T18:56:15.103019+0000","last_became_peered":"2023-07-05T18:56:15.103019+0000","last_unstale":"2023-07-05T18:56:17.658314+0000","last_undegraded":"2023-07-05T18:56:17.658314+0000","last_fullsized":"2023-07-05T18:56:17.658314+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T18:56:14.665171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T18:56:14.665171+0000","last_clean_scrub_stamp":"2023-07-05T18:56:14.665171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T02:43:21.743318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"20'2","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-05T18:56:16.105517+0000","last_change":"2023-07-05T18:56:14.686203+0000","last_active":"2023-07-05T18:56:16.105517+0000","last_peered":"2023-07-05T18:56:16.105517+0000","last_clean":"2023-07-05T18:56:16.105517+0000","last_became_active":"2023-07-05T18:56:14.685948+0000","last_became_peered":"2023-07-05T18:56:14.685948+0000","last_unstale":"2023-07-05T18:56:16.105517+0000","last_undegraded":"2023-07-05T18:56:16.105517+0000","last_fullsized":"2023-07-05T18:56:16.105517+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T18:56:13.659893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T18:56:13.659893+0000","last_clean_scrub_stamp":"2023-07-05T18:56:13.659893+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T02:24:34.867804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-05T18:56:17.658649+0000","last_change":"2023-07-05T18:56:15.126615+0000","last_active":"2023-07-05T18:56:17.658649+0000","last_peered":"2023-07-05T18:56:17.658649+0000","last_clean":"2023-07-05T18:56:17.658649+0000","last_became_active":"2023-07-05T18:56:15.126354+0000","last_became_peered":"2023-07-05T18:56:15.126354+0000","last_unstale":"2023-07-05T18:56:17.658649+0000","last_undegraded":"2023-07-05T18:56:17.658649+0000","last_fullsized":"2023-07-05T18:56:17.658649+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T18:56:14.665171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T18:56:14.665171+0000","last_clean_scrub_stamp":"2023-07-05T18:56:14.665171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T02:23:52.877499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1d","version":"20'2","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-05T18:56:16.105769+0000","last_change":"2023-07-05T18:56:14.684691+0000","last_active":"2023-07-05T18:56:16.105769+0000","last_peered":"2023-07-05T18:56:16.105769+0000","last_clean":"2023-07-05T18:56:16.105769+0000","last_became_active":"2023-07-05T18:56:14.684098+0000","last_became_peered":"2023-07-05T18:56:14.684098+0000","last_unstale":"2023-07-05T18:56:16.105769+0000","last_undegraded":"2023-07-05T18:56:16.105769+0000","last_fullsized":"2023-07-05T18:56:16.105769+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T18:56:13.659893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T18:56:13.659893+0000","last_clean_scrub_stamp":"2023-07-05T18:56:13.659893+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T02:30:28.735569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-05T18:56:17.658893+0000","last_change":"2023-07-05T18:56:15.123781+0000","last_active":"2023-07-05T18:56:17.658893+0000","last_peered":"2023-07-05T18:56:17.658893+0000","last_clean":"2023-07-05T18:56:17.658893+0000","last_became_active":"2023-07-05T18:56:15.123062+0000","last_became_peered":"2023-07-05T18:56:15.123062+0000","last_unstale":"2023-07-05T18:56:17.658893+0000","last_undegraded":"2023-07-05T18:56:17.658893+0000","last_fullsized":"2023-07-05T18:56:17.658893+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T18:56:14.665171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T18:56:14.665171+0000","last_clean_scrub_stamp":"2023-07-05T18:56:14.665171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T00:22:01.891261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1e","version":"20'1","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-05T18:56:16.104884+0000","last_change":"2023-07-05T18:56:14.676047+0000","last_active":"2023-07-05T18:56:16.104884+0000","last_peered":"2023-07-05T18:56:16.104884+0000","last_clean":"2023-07-05T18:56:16.104884+0000","last_became_active":"2023-07-05T18:56:14.675717+0000","last_became_peered":"2023-07-05T18:56:14.675717+0000","last_unstale":"2023-07-05T18:56:16.104884+0000","last_undegraded":"2023-07-05T18:56:16.104884+0000","last_fullsized":"2023-07-05T18:56:16.104884+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T18:56:13.659893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T18:56:13.659893+0000","last_clean_scrub_stamp":"2023-07-05T18:56:13.659893+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T00:22:00.885983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-05T18:56:16.104536+0000","last_change":"2023-07-05T18:56:15.117463+0000","last_active":"2023-07-05T18:56:16.104536+0000","last_peered":"2023-07-05T18:56:16.104536+0000","last_clean":"2023-07-05T18:56:16.104536+0000","last_became_active":"2023-07-05T18:56:15.114489+0000","last_became_peered":"2023-07-05T18:56:15.114489+0000","last_unstale":"2023-07-05T18:56:16.104536+0000","last_undegraded":"2023-07-05T18:56:16.104536+0000","last_fullsized":"2023-07-05T18:56:16.104536+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T18:56:14.665171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T18:56:14.665171+0000","last_clean_scrub_stamp":"2023-07-05T18:56:14.665171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T02:30:29.740847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"20'4","reported_seq":17,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-05T18:56:16.474298+0000","last_change":"2023-07-05T18:56:14.689853+0000","last_active":"2023-07-05T18:56:16.474298+0000","last_peered":"2023-07-05T18:56:16.474298+0000","last_clean":"2023-07-05T18:56:16.474298+0000","last_became_active":"2023-07-05T18:56:14.689381+0000","last_became_peered":"2023-07-05T18:56:14.689381+0000","last_unstale":"2023-07-05T18:56:16.474298+0000","last_undegraded":"2023-07-05T18:56:16.474298+0000","last_fullsized":"2023-07-05T18:56:16.474298+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T18:56:13.659893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T18:56:13.659893+0000","last_clean_scrub_stamp":"2023-07-05T18:56:13.659893+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T02:30:28.735569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-05T18:56:17.658379+0000","last_change":"2023-07-05T18:56:15.123191+0000","last_active":"2023-07-05T18:56:17.658379+0000","last_peered":"2023-07-05T18:56:17.658379+0000","last_clean":"2023-07-05T18:56:17.658379+0000","last_became_active":"2023-07-05T18:56:15.122736+0000","last_became_peered":"2023-07-05T18:56:15.122736+0000","last_unstale":"2023-07-05T18:56:17.658379+0000","last_undegraded":"2023-07-05T18:56:17.658379+0000","last_fullsized":"2023-07-05T18:56:17.658379+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T18:56:14.665171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T18:56:14.665171+0000","last_clean_scrub_stamp":"2023-07-05T18:56:14.665171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T03:08:48.441898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-05T18:56:16.104533+0000","last_change":"2023-07-05T18:56:15.115767+0000","last_active":"2023-07-05T18:56:16.104533+0000","last_peered":"2023-07-05T18:56:16.104533+0000","last_clean":"2023-07-05T18:56:16.104533+0000","last_became_active":"2023-07-05T18:56:15.115052+0000","last_became_peered":"2023-07-05T18:56:15.115052+0000","last_unstale":"2023-07-05T18:56:16.104533+0000","last_undegraded":"2023-07-05T18:56:16.104533+0000","last_fullsized":"2023-07-05T18:56:16.104533+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T18:56:14.665171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T18:56:14.665171+0000","last_clean_scrub_stamp":"2023-07-05T18:56:14.665171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T05:13:27.636276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-05T18:56:16.104384+0000","last_change":"2023-07-05T18:56:15.112332+0000","last_active":"2023-07-05T18:56:16.104384+0000","last_peered":"2023-07-05T18:56:16.104384+0000","last_clean":"2023-07-05T18:56:16.104384+0000","last_became_active":"2023-07-05T18:56:15.112060+0000","last_became_peered":"2023-07-05T18:56:15.112060+0000","last_unstale":"2023-07-05T18:56:16.104384+0000","last_undegraded":"2023-07-05T18:56:16.104384+0000","last_fullsized":"2023-07-05T18:56:16.104384+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T18:56:14.665171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T18:56:14.665171+0000","last_clean_scrub_stamp":"2023-07-05T18:56:14.665171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T03:08:48.441898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-05T18:56:17.658512+0000","last_change":"2023-07-05T18:56:15.126220+0000","last_active":"2023-07-05T18:56:17.658512+0000","last_peered":"2023-07-05T18:56:17.658512+0000","last_clean":"2023-07-05T18:56:17.658512+0000","last_became_active":"2023-07-05T18:56:15.125927+0000","last_became_peered":"2023-07-05T18:56:15.125927+0000","last_unstale":"2023-07-05T18:56:17.658512+0000","last_undegraded":"2023-07-05T18:56:17.658512+0000","last_fullsized":"2023-07-05T18:56:17.658512+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T18:56:14.665171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T18:56:14.665171+0000","last_clean_scrub_stamp":"2023-07-05T18:56:14.665171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-06T21:14:58.040487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-05T18:56:16.104693+0000","last_change":"2023-07-05T18:56:15.118666+0000","last_active":"2023-07-05T18:56:16.104693+0000","last_peered":"2023-07-05T18:56:16.104693+0000","last_clean":"2023-07-05T18:56:16.104693+0000","last_became_active":"2023-07-05T18:56:15.116876+0000","last_became_peered":"2023-07-05T18:56:15.116876+0000","last_unstale":"2023-07-05T18:56:16.104693+0000","last_undegraded":"2023-07-05T18:56:16.104693+0000","last_fullsized":"2023-07-05T18:56:16.104693+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T18:56:14.665171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T18:56:14.665171+0000","last_clean_scrub_stamp":"2023-07-05T18:56:14.665171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T04:34:54.813133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-05T18:56:17.190834+0000","last_change":"2023-07-05T18:56:15.118889+0000","last_active":"2023-07-05T18:56:17.190834+0000","last_peered":"2023-07-05T18:56:17.190834+0000","last_clean":"2023-07-05T18:56:17.190834+0000","last_became_active":"2023-07-05T18:56:15.118609+0000","last_became_peered":"2023-07-05T18:56:15.118609+0000","last_unstale":"2023-07-05T18:56:17.190834+0000","last_undegraded":"2023-07-05T18:56:17.190834+0000","last_fullsized":"2023-07-05T18:56:17.190834+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T18:56:14.665171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T18:56:14.665171+0000","last_clean_scrub_stamp":"2023-07-05T18:56:14.665171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T02:49:05.937629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":8},{"poolid":2,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574854,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27772,"kb_used_data":820,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344068,"statfs":{"total":96636764160,"available":96608325632,"internally_reserved":0,"allocated":839680,"data_stored":671247,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1870000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.629}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.5429999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.5700000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.627}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56200000000000006}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53600000000000003}]}]},{"osd":6,"up_from":13,"seq":55834574856,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27164,"kb_used_data":212,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344676,"statfs":{"total":96636764160,"available":96608948224,"internally_reserved":0,"allocated":217088,"data_stored":79099,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39400000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56200000000000006}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60899999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":3.5499999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48999999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46600000000000003}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57399999999999995}]}]},{"osd":1,"up_from":13,"seq":55834574855,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27744,"kb_used_data":792,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344096,"statfs":{"total":96636764160,"available":96608354304,"internally_reserved":0,"allocated":811008,"data_stored":669467,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38100000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.32000000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42499999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.443}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61899999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46400000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60199999999999998}]}]},{"osd":0,"up_from":13,"seq":55834574855,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27168,"kb_used_data":216,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344672,"statfs":{"total":96636764160,"available":96608944128,"internally_reserved":0,"allocated":221184,"data_stored":79681,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53500000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.4950000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":4.1859999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76800000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.464}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64500000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.82399999999999995}]}]},{"osd":2,"up_from":13,"seq":55834574854,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27160,"kb_used_data":208,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344680,"statfs":{"total":96636764160,"available":96608952320,"internally_reserved":0,"allocated":212992,"data_stored":78138,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.23999999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.314}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.32200000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58799999999999997}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52500000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61199999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57599999999999996}]}]},{"osd":3,"up_from":13,"seq":55834574856,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27168,"kb_used_data":216,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344672,"statfs":{"total":96636764160,"available":96608944128,"internally_reserved":0,"allocated":221184,"data_stored":79189,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":12.015000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.387}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.5069999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83699999999999997}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.93200000000000005}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.484}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.995}]}]},{"osd":4,"up_from":13,"seq":55834574856,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27184,"kb_used_data":232,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344656,"statfs":{"total":96636764160,"available":96608927744,"internally_reserved":0,"allocated":237568,"data_stored":80719,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47799999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.501}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.43099999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61599999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55300000000000005}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54200000000000004}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52700000000000002}]}]},{"osd":5,"up_from":13,"seq":55834574855,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27172,"kb_used_data":220,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344668,"statfs":{"total":96636764160,"available":96608940032,"internally_reserved":0,"allocated":225280,"data_stored":79751,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.629}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64400000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51300000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57799999999999996}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.373}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.49199999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55300000000000005}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1620,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":652,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1780,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-07-05T18:56:24.230 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-07-05T18:56:24.388 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:24.386+0000 7f794347a700 1 Processor -- start 2023-07-05T18:56:24.389 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:24.386+0000 7f794347a700 1 -- start start 2023-07-05T18:56:24.395 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:24.387+0000 7f794347a700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f793c159280 0x7f793c06fe10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:56:24.395 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:24.387+0000 7f794347a700 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f793c0b3f90 con 0x7f793c159d60 2023-07-05T18:56:24.395 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:24.387+0000 7f794347a700 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f793c0b3190 con 0x7f793c070af0 2023-07-05T18:56:24.395 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:24.387+0000 7f794347a700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f793c0cbc00 con 0x7f793c159280 2023-07-05T18:56:24.396 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:24.387+0000 7f7941a17700 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7f793c159d60 0x7f793c162ed0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:57484/0 (socket says 172.21.15.46:57484) 2023-07-05T18:56:24.396 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:24.387+0000 7f7941a17700 1 -- 172.21.15.46:0/3310231098 learned_addr learned my addr 172.21.15.46:0/3310231098 (peer_addr_for_me v1:172.21.15.46:0/0) 2023-07-05T18:56:24.396 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:24.388+0000 7f7941216700 1 --2- 172.21.15.46:0/3310231098 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f793c159280 0x7f793c06fe10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:56:24.396 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:24.388+0000 7f7933fff700 1 -- 172.21.15.46:0/3310231098 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3068333345 0 0) 0x7f793c0b3f90 con 0x7f793c159d60 2023-07-05T18:56:24.396 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:24.388+0000 7f7933fff700 1 -- 172.21.15.46:0/3310231098 --> v1:172.21.15.46:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f79280057c0 con 0x7f793c159d60 2023-07-05T18:56:24.396 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:24.388+0000 7f7933fff700 1 -- 172.21.15.46:0/3310231098 <== mon.1 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4220769751 0 0) 0x7f793c0b3190 con 0x7f793c070af0 2023-07-05T18:56:24.396 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:24.388+0000 7f7933fff700 1 -- 172.21.15.46:0/3310231098 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f793c0b3f90 con 0x7f793c070af0 2023-07-05T18:56:24.397 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:24.388+0000 7f7933fff700 1 -- 172.21.15.46:0/3310231098 <== mon.0 v1:172.21.15.46:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2482832702 0 0) 0x7f79280057c0 con 0x7f793c159d60 2023-07-05T18:56:24.397 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:24.388+0000 7f7933fff700 1 -- 172.21.15.46:0/3310231098 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f793c159280 msgr2=0x7f793c06fe10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-05T18:56:24.397 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:24.388+0000 7f7933fff700 1 --2- 172.21.15.46:0/3310231098 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f793c159280 0x7f793c06fe10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:24.397 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:24.388+0000 7f7933fff700 1 -- 172.21.15.46:0/3310231098 >> v1:172.21.15.73:6789/0 conn(0x7f793c070af0 legacy=0x7f793c159650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:56:24.397 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:24.388+0000 7f7933fff700 1 -- 172.21.15.46:0/3310231098 --> v1:172.21.15.46:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f793c0b3400 con 0x7f793c159d60 2023-07-05T18:56:24.397 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:24.388+0000 7f7933fff700 1 -- 172.21.15.46:0/3310231098 <== mon.0 v1:172.21.15.46:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2195585215 0 0) 0x7f79340019f0 con 0x7f793c159d60 2023-07-05T18:56:24.397 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:24.388+0000 7f7933fff700 1 -- 172.21.15.46:0/3310231098 >> v1:172.21.15.46:6789/0 conn(0x7f793c159d60 legacy=0x7f793c162ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:56:24.397 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:24.388+0000 7f7933fff700 1 --2- 172.21.15.46:0/3310231098 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7928005dd0 0x7f79280061c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:56:24.398 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:24.388+0000 7f7933fff700 1 --2- 172.21.15.46:0/3310231098 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f793c159280 0x7f7928006a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:56:24.398 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:24.388+0000 7f7933fff700 1 --2- 172.21.15.46:0/3310231098 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7928006fa0 0x7f7928007410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:56:24.398 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:24.388+0000 7f7933fff700 1 -- 172.21.15.46:0/3310231098 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f793c0cbc00 con 0x7f7928006fa0 2023-07-05T18:56:24.398 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:24.388+0000 7f7933fff700 1 -- 172.21.15.46:0/3310231098 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f792800dcd0 con 0x7f7928005dd0 2023-07-05T18:56:24.399 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:24.388+0000 7f7933fff700 1 -- 172.21.15.46:0/3310231098 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f792800de90 con 0x7f793c159280 2023-07-05T18:56:24.399 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:24.388+0000 7f7941a17700 1 --2- 172.21.15.46:0/3310231098 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7928006fa0 0x7f7928007410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:56:24.399 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:24.388+0000 7f7941216700 1 --2- 172.21.15.46:0/3310231098 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7928005dd0 0x7f79280061c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:56:24.399 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:24.388+0000 7f7940a15700 1 --2- 172.21.15.46:0/3310231098 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f793c159280 0x7f7928006a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:56:24.399 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:24.388+0000 7f7941a17700 1 -- 172.21.15.46:0/3310231098 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f793c159280 msgr2=0x7f7928006a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-05T18:56:24.399 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:24.388+0000 7f7941a17700 1 --2- 172.21.15.46:0/3310231098 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f793c159280 0x7f7928006a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:24.399 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:24.388+0000 7f7941a17700 1 -- 172.21.15.46:0/3310231098 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7928005dd0 msgr2=0x7f79280061c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-05T18:56:24.400 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:24.388+0000 7f7941a17700 1 --2- 172.21.15.46:0/3310231098 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7928005dd0 0x7f79280061c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:24.400 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:24.388+0000 7f7941a17700 1 -- 172.21.15.46:0/3310231098 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f79280057c0 con 0x7f7928006fa0 2023-07-05T18:56:24.400 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:24.389+0000 7f7941a17700 1 --2- 172.21.15.46:0/3310231098 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7928006fa0 0x7f7928007410 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f793400a6e0 tx=0x7f7928007a90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=80fdbc3ba0ad2b8e server_cookie=0 in_seq=0 out_seq=0 2023-07-05T18:56:24.400 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:24.389+0000 7f7933fff700 1 -- 172.21.15.46:0/3310231098 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79340072d0 con 0x7f7928006fa0 2023-07-05T18:56:24.400 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:24.389+0000 7f7933fff700 1 -- 172.21.15.46:0/3310231098 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7934007430 con 0x7f7928006fa0 2023-07-05T18:56:24.400 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:24.389+0000 7f7933fff700 1 -- 172.21.15.46:0/3310231098 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79340077e0 con 0x7f7928006fa0 2023-07-05T18:56:24.400 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:24.389+0000 7f794347a700 1 -- 172.21.15.46:0/3310231098 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7928006fa0 msgr2=0x7f7928007410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:56:24.401 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:24.389+0000 7f794347a700 1 --2- 172.21.15.46:0/3310231098 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7928006fa0 0x7f7928007410 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f793400a6e0 tx=0x7f7928007a90 comp rx=0 tx=0).stop 2023-07-05T18:56:24.401 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:24.389+0000 7f7941a17700 1 -- 172.21.15.46:0/3310231098 reap_dead start 2023-07-05T18:56:24.401 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:24.389+0000 7f794347a700 1 -- 172.21.15.46:0/3310231098 shutdown_connections 2023-07-05T18:56:24.401 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:24.389+0000 7f794347a700 1 -- 172.21.15.46:0/3310231098 >> 172.21.15.46:0/3310231098 conn(0x7f793c0b0d50 msgr2=0x7f793c0b1150 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-05T18:56:24.402 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:24.389+0000 7f794347a700 1 -- 172.21.15.46:0/3310231098 shutdown_connections 2023-07-05T18:56:24.402 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:24.389+0000 7f794347a700 1 -- 172.21.15.46:0/3310231098 wait complete. 2023-07-05T18:56:24.402 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:24.391+0000 7f794347a700 1 Processor -- start 2023-07-05T18:56:24.402 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:24.391+0000 7f794347a700 1 -- start start 2023-07-05T18:56:24.402 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:24.392+0000 7f794347a700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f793c1388e0 0x7f793c13ba10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:56:24.402 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:24.392+0000 7f794347a700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f793c13f280 0x7f793c14b860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:56:24.402 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:24.392+0000 7f794347a700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f793c15bc30 0x7f793c15c0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:56:24.403 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:24.392+0000 7f794347a700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f793c15c610 con 0x7f793c15bc30 2023-07-05T18:56:24.403 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:24.392+0000 7f794347a700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f793c14d930 con 0x7f793c1388e0 2023-07-05T18:56:24.403 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:24.392+0000 7f794347a700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f793c138cb0 con 0x7f793c13f280 2023-07-05T18:56:24.403 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:24.392+0000 7f7941a17700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f793c15bc30 0x7f793c15c0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:56:24.403 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:24.392+0000 7f7941a17700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f793c15bc30 0x7f793c15c0d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:58224/0 (socket says 172.21.15.46:58224) 2023-07-05T18:56:24.403 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:24.392+0000 7f7941216700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f793c1388e0 0x7f793c13ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:56:24.403 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:24.392+0000 7f7941a17700 1 -- 172.21.15.46:0/21966137 learned_addr learned my addr 172.21.15.46:0/21966137 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-07-05T18:56:24.404 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:24.392+0000 7f7940a15700 1 --2- 172.21.15.46:0/21966137 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f793c13f280 0x7f793c14b860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:56:24.404 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:24.392+0000 7f7941a17700 1 -- 172.21.15.46:0/21966137 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f793c13f280 msgr2=0x7f793c14b860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:56:24.404 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:24.392+0000 7f7941a17700 1 --2- 172.21.15.46:0/21966137 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f793c13f280 0x7f793c14b860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:24.404 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:24.392+0000 7f7941a17700 1 -- 172.21.15.46:0/21966137 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f793c1388e0 msgr2=0x7f793c13ba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:56:24.404 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:24.392+0000 7f7941a17700 1 --2- 172.21.15.46:0/21966137 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f793c1388e0 0x7f793c13ba10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:24.404 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:24.393+0000 7f7941a17700 1 -- 172.21.15.46:0/21966137 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f793c13bf50 con 0x7f793c15bc30 2023-07-05T18:56:24.404 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:24.393+0000 7f7941216700 1 --2- 172.21.15.46:0/21966137 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f793c1388e0 0x7f793c13ba10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-05T18:56:24.404 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:24.393+0000 7f7941a17700 1 --2- 172.21.15.46:0/21966137 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f793c15bc30 0x7f793c15c0d0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f7934002230 tx=0x7f7934001cb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-05T18:56:24.405 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:24.393+0000 7f7931ffb700 1 -- 172.21.15.46:0/21966137 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79340011c0 con 0x7f793c15bc30 2023-07-05T18:56:24.405 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:24.393+0000 7f7931ffb700 1 -- 172.21.15.46:0/21966137 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7934012400 con 0x7f793c15bc30 2023-07-05T18:56:24.405 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:24.393+0000 7f794347a700 1 -- 172.21.15.46:0/21966137 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f793c14bda0 con 0x7f793c15bc30 2023-07-05T18:56:24.405 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:24.393+0000 7f7931ffb700 1 -- 172.21.15.46:0/21966137 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79340127b0 con 0x7f793c15bc30 2023-07-05T18:56:24.405 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:24.393+0000 7f794347a700 1 -- 172.21.15.46:0/21966137 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f793c14de60 con 0x7f793c15bc30 2023-07-05T18:56:24.406 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:24.394+0000 7f794347a700 1 -- 172.21.15.46:0/21966137 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f793c0672e0 con 0x7f793c15bc30 2023-07-05T18:56:24.406 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:24.394+0000 7f7931ffb700 1 -- 172.21.15.46:0/21966137 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f793401a070 con 0x7f793c15bc30 2023-07-05T18:56:24.406 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:24.395+0000 7f7931ffb700 1 --2- 172.21.15.46:0/21966137 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7f792006ace0 0x7f792006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:56:24.407 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:24.395+0000 7f7931ffb700 1 -- 172.21.15.46:0/21966137 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f793408af80 con 0x7f793c15bc30 2023-07-05T18:56:24.407 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:24.395+0000 7f7941216700 1 --2- 172.21.15.46:0/21966137 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7f792006ace0 0x7f792006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:56:24.407 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:24.396+0000 7f7941216700 1 --2- 172.21.15.46:0/21966137 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7f792006ace0 0x7f792006d190 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f792c009650 tx=0x7f792c012040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-05T18:56:24.407 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:24.399+0000 7f7931ffb700 1 -- 172.21.15.46:0/21966137 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f79340562a0 con 0x7f793c15bc30 2023-07-05T18:56:24.595 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:24.593+0000 7f794347a700 1 -- 172.21.15.46:0/21966137 --> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f793c0b3c20 con 0x7f792006ace0 2023-07-05T18:56:24.603 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:24.601+0000 7f7931ffb700 1 -- 172.21.15.46:0/21966137 <== mgr.4099 v2:172.21.15.73:6832/3033361733 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+286791 (secure 0 0 0) 0x7f792c016040 con 0x7f792006ace0 2023-07-05T18:56:24.607 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T18:56:24.610 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:24.604+0000 7f794347a700 1 -- 172.21.15.46:0/21966137 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7f792006ace0 msgr2=0x7f792006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:56:24.610 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:24.604+0000 7f794347a700 1 --2- 172.21.15.46:0/21966137 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7f792006ace0 0x7f792006d190 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f792c009650 tx=0x7f792c012040 comp rx=0 tx=0).stop 2023-07-05T18:56:24.611 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:24.604+0000 7f794347a700 1 -- 172.21.15.46:0/21966137 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f793c15bc30 msgr2=0x7f793c15c0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:56:24.611 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:24.604+0000 7f794347a700 1 --2- 172.21.15.46:0/21966137 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f793c15bc30 0x7f793c15c0d0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f7934002230 tx=0x7f7934001cb0 comp rx=0 tx=0).stop 2023-07-05T18:56:24.611 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:24.604+0000 7f794347a700 1 -- 172.21.15.46:0/21966137 shutdown_connections 2023-07-05T18:56:24.611 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:24.604+0000 7f794347a700 1 --2- 172.21.15.46:0/21966137 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7f792006ace0 0x7f792006d190 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:24.611 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:24.604+0000 7f794347a700 1 --2- 172.21.15.46:0/21966137 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f793c15bc30 0x7f793c15c0d0 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:24.611 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:24.604+0000 7f794347a700 1 --2- 172.21.15.46:0/21966137 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f793c1388e0 0x7f793c13ba10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:24.611 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:24.604+0000 7f794347a700 1 --2- 172.21.15.46:0/21966137 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f793c13f280 0x7f793c14b860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:24.612 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:24.604+0000 7f794347a700 1 -- 172.21.15.46:0/21966137 >> 172.21.15.46:0/21966137 conn(0x7f793c0b0d50 msgr2=0x7f793c06fe10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-05T18:56:24.612 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:24.604+0000 7f794347a700 1 -- 172.21.15.46:0/21966137 shutdown_connections 2023-07-05T18:56:24.612 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:24.604+0000 7f794347a700 1 -- 172.21.15.46:0/21966137 wait complete. 2023-07-05T18:56:24.612 INFO:teuthology.orchestra.run.smithi046.stderr:dumped all 2023-07-05T18:56:24.618 INFO:teuthology.orchestra.run.smithi046.stdout:{"pg_ready":true,"pg_map":{"version":23,"stamp":"2023-07-05T18:56:24.073933+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":218532,"kb_used_data":2916,"kb_used_omap":0,"kb_used_meta":215552,"kb_avail":754756188,"statfs":{"total":773094113280,"available":772870336512,"internally_reserved":0,"allocated":2985984,"data_stored":1817291,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":220725248},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2362,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.972041"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-05T18:56:17.658270+0000","last_change":"2023-07-05T18:56:15.115312+0000","last_active":"2023-07-05T18:56:17.658270+0000","last_peered":"2023-07-05T18:56:17.658270+0000","last_clean":"2023-07-05T18:56:17.658270+0000","last_became_active":"2023-07-05T18:56:15.115039+0000","last_became_peered":"2023-07-05T18:56:15.115039+0000","last_unstale":"2023-07-05T18:56:17.658270+0000","last_undegraded":"2023-07-05T18:56:17.658270+0000","last_fullsized":"2023-07-05T18:56:17.658270+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T18:56:14.665171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T18:56:14.665171+0000","last_clean_scrub_stamp":"2023-07-05T18:56:14.665171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T04:47:53.525224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-05T18:56:16.104997+0000","last_change":"2023-07-05T18:56:15.113285+0000","last_active":"2023-07-05T18:56:16.104997+0000","last_peered":"2023-07-05T18:56:16.104997+0000","last_clean":"2023-07-05T18:56:16.104997+0000","last_became_active":"2023-07-05T18:56:15.113019+0000","last_became_peered":"2023-07-05T18:56:15.113019+0000","last_unstale":"2023-07-05T18:56:16.104997+0000","last_undegraded":"2023-07-05T18:56:16.104997+0000","last_fullsized":"2023-07-05T18:56:16.104997+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T18:56:14.665171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T18:56:14.665171+0000","last_clean_scrub_stamp":"2023-07-05T18:56:14.665171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-06T19:43:28.708822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-05T18:56:17.658939+0000","last_change":"2023-07-05T18:56:15.127147+0000","last_active":"2023-07-05T18:56:17.658939+0000","last_peered":"2023-07-05T18:56:17.658939+0000","last_clean":"2023-07-05T18:56:17.658939+0000","last_became_active":"2023-07-05T18:56:15.126775+0000","last_became_peered":"2023-07-05T18:56:15.126775+0000","last_unstale":"2023-07-05T18:56:17.658939+0000","last_undegraded":"2023-07-05T18:56:17.658939+0000","last_fullsized":"2023-07-05T18:56:17.658939+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T18:56:14.665171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T18:56:14.665171+0000","last_clean_scrub_stamp":"2023-07-05T18:56:14.665171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T04:41:48.823682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-05T18:56:16.105116+0000","last_change":"2023-07-05T18:56:15.119204+0000","last_active":"2023-07-05T18:56:16.105116+0000","last_peered":"2023-07-05T18:56:16.105116+0000","last_clean":"2023-07-05T18:56:16.105116+0000","last_became_active":"2023-07-05T18:56:15.118931+0000","last_became_peered":"2023-07-05T18:56:15.118931+0000","last_unstale":"2023-07-05T18:56:16.105116+0000","last_undegraded":"2023-07-05T18:56:16.105116+0000","last_fullsized":"2023-07-05T18:56:16.105116+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T18:56:14.665171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T18:56:14.665171+0000","last_clean_scrub_stamp":"2023-07-05T18:56:14.665171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T03:19:04.962412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-05T18:56:16.473979+0000","last_change":"2023-07-05T18:56:15.125822+0000","last_active":"2023-07-05T18:56:16.473979+0000","last_peered":"2023-07-05T18:56:16.473979+0000","last_clean":"2023-07-05T18:56:16.473979+0000","last_became_active":"2023-07-05T18:56:15.121836+0000","last_became_peered":"2023-07-05T18:56:15.121836+0000","last_unstale":"2023-07-05T18:56:16.473979+0000","last_undegraded":"2023-07-05T18:56:16.473979+0000","last_fullsized":"2023-07-05T18:56:16.473979+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T18:56:14.665171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T18:56:14.665171+0000","last_clean_scrub_stamp":"2023-07-05T18:56:14.665171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T02:49:05.937629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-05T18:56:17.658488+0000","last_change":"2023-07-05T18:56:15.125381+0000","last_active":"2023-07-05T18:56:17.658488+0000","last_peered":"2023-07-05T18:56:17.658488+0000","last_clean":"2023-07-05T18:56:17.658488+0000","last_became_active":"2023-07-05T18:56:15.124055+0000","last_became_peered":"2023-07-05T18:56:15.124055+0000","last_unstale":"2023-07-05T18:56:17.658488+0000","last_undegraded":"2023-07-05T18:56:17.658488+0000","last_fullsized":"2023-07-05T18:56:17.658488+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T18:56:14.665171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T18:56:14.665171+0000","last_clean_scrub_stamp":"2023-07-05T18:56:14.665171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T02:13:19.229598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-05T18:56:17.158259+0000","last_change":"2023-07-05T18:56:15.116938+0000","last_active":"2023-07-05T18:56:17.158259+0000","last_peered":"2023-07-05T18:56:17.158259+0000","last_clean":"2023-07-05T18:56:17.158259+0000","last_became_active":"2023-07-05T18:56:15.116592+0000","last_became_peered":"2023-07-05T18:56:15.116592+0000","last_unstale":"2023-07-05T18:56:17.158259+0000","last_undegraded":"2023-07-05T18:56:17.158259+0000","last_fullsized":"2023-07-05T18:56:17.158259+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T18:56:14.665171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T18:56:14.665171+0000","last_clean_scrub_stamp":"2023-07-05T18:56:14.665171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T02:30:29.740847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-05T18:56:16.104826+0000","last_change":"2023-07-05T18:56:15.127587+0000","last_active":"2023-07-05T18:56:16.104826+0000","last_peered":"2023-07-05T18:56:16.104826+0000","last_clean":"2023-07-05T18:56:16.104826+0000","last_became_active":"2023-07-05T18:56:15.127359+0000","last_became_peered":"2023-07-05T18:56:15.127359+0000","last_unstale":"2023-07-05T18:56:16.104826+0000","last_undegraded":"2023-07-05T18:56:16.104826+0000","last_fullsized":"2023-07-05T18:56:16.104826+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T18:56:14.665171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T18:56:14.665171+0000","last_clean_scrub_stamp":"2023-07-05T18:56:14.665171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T01:07:17.521433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-05T18:56:16.474116+0000","last_change":"2023-07-05T18:56:15.123724+0000","last_active":"2023-07-05T18:56:16.474116+0000","last_peered":"2023-07-05T18:56:16.474116+0000","last_clean":"2023-07-05T18:56:16.474116+0000","last_became_active":"2023-07-05T18:56:15.121678+0000","last_became_peered":"2023-07-05T18:56:15.121678+0000","last_unstale":"2023-07-05T18:56:16.474116+0000","last_undegraded":"2023-07-05T18:56:16.474116+0000","last_fullsized":"2023-07-05T18:56:16.474116+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T18:56:14.665171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T18:56:14.665171+0000","last_clean_scrub_stamp":"2023-07-05T18:56:14.665171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T02:24:35.873082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-05T18:56:16.105387+0000","last_change":"2023-07-05T18:56:15.121695+0000","last_active":"2023-07-05T18:56:16.105387+0000","last_peered":"2023-07-05T18:56:16.105387+0000","last_clean":"2023-07-05T18:56:16.105387+0000","last_became_active":"2023-07-05T18:56:15.121418+0000","last_became_peered":"2023-07-05T18:56:15.121418+0000","last_unstale":"2023-07-05T18:56:16.105387+0000","last_undegraded":"2023-07-05T18:56:16.105387+0000","last_fullsized":"2023-07-05T18:56:16.105387+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T18:56:14.665171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T18:56:14.665171+0000","last_clean_scrub_stamp":"2023-07-05T18:56:14.665171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-06T21:50:37.526388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-05T18:56:17.658944+0000","last_change":"2023-07-05T18:56:15.127138+0000","last_active":"2023-07-05T18:56:17.658944+0000","last_peered":"2023-07-05T18:56:17.658944+0000","last_clean":"2023-07-05T18:56:17.658944+0000","last_became_active":"2023-07-05T18:56:15.126770+0000","last_became_peered":"2023-07-05T18:56:15.126770+0000","last_unstale":"2023-07-05T18:56:17.658944+0000","last_undegraded":"2023-07-05T18:56:17.658944+0000","last_fullsized":"2023-07-05T18:56:17.658944+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T18:56:14.665171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T18:56:14.665171+0000","last_clean_scrub_stamp":"2023-07-05T18:56:14.665171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-06T23:38:29.351477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-05T18:56:17.658156+0000","last_change":"2023-07-05T18:56:15.127292+0000","last_active":"2023-07-05T18:56:17.658156+0000","last_peered":"2023-07-05T18:56:17.658156+0000","last_clean":"2023-07-05T18:56:17.658156+0000","last_became_active":"2023-07-05T18:56:15.127061+0000","last_became_peered":"2023-07-05T18:56:15.127061+0000","last_unstale":"2023-07-05T18:56:17.658156+0000","last_undegraded":"2023-07-05T18:56:17.658156+0000","last_fullsized":"2023-07-05T18:56:17.658156+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T18:56:14.665171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T18:56:14.665171+0000","last_clean_scrub_stamp":"2023-07-05T18:56:14.665171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-06T21:17:50.248706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-05T18:56:17.658107+0000","last_change":"2023-07-05T18:56:15.114803+0000","last_active":"2023-07-05T18:56:17.658107+0000","last_peered":"2023-07-05T18:56:17.658107+0000","last_clean":"2023-07-05T18:56:17.658107+0000","last_became_active":"2023-07-05T18:56:15.114491+0000","last_became_peered":"2023-07-05T18:56:15.114491+0000","last_unstale":"2023-07-05T18:56:17.658107+0000","last_undegraded":"2023-07-05T18:56:17.658107+0000","last_fullsized":"2023-07-05T18:56:17.658107+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T18:56:14.665171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T18:56:14.665171+0000","last_clean_scrub_stamp":"2023-07-05T18:56:14.665171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T03:29:08.291790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-05T18:56:16.105534+0000","last_change":"2023-07-05T18:56:15.108218+0000","last_active":"2023-07-05T18:56:16.105534+0000","last_peered":"2023-07-05T18:56:16.105534+0000","last_clean":"2023-07-05T18:56:16.105534+0000","last_became_active":"2023-07-05T18:56:15.107769+0000","last_became_peered":"2023-07-05T18:56:15.107769+0000","last_unstale":"2023-07-05T18:56:16.105534+0000","last_undegraded":"2023-07-05T18:56:16.105534+0000","last_fullsized":"2023-07-05T18:56:16.105534+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T18:56:14.665171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T18:56:14.665171+0000","last_clean_scrub_stamp":"2023-07-05T18:56:14.665171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T03:19:04.962412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-05T18:56:17.158599+0000","last_change":"2023-07-05T18:56:15.119803+0000","last_active":"2023-07-05T18:56:17.158599+0000","last_peered":"2023-07-05T18:56:17.158599+0000","last_clean":"2023-07-05T18:56:17.158599+0000","last_became_active":"2023-07-05T18:56:15.119429+0000","last_became_peered":"2023-07-05T18:56:15.119429+0000","last_unstale":"2023-07-05T18:56:17.158599+0000","last_undegraded":"2023-07-05T18:56:17.158599+0000","last_fullsized":"2023-07-05T18:56:17.158599+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T18:56:14.665171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T18:56:14.665171+0000","last_clean_scrub_stamp":"2023-07-05T18:56:14.665171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T03:39:30.527160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-05T18:56:17.658447+0000","last_change":"2023-07-05T18:56:15.128556+0000","last_active":"2023-07-05T18:56:17.658447+0000","last_peered":"2023-07-05T18:56:17.658447+0000","last_clean":"2023-07-05T18:56:17.658447+0000","last_became_active":"2023-07-05T18:56:15.128307+0000","last_became_peered":"2023-07-05T18:56:15.128307+0000","last_unstale":"2023-07-05T18:56:17.658447+0000","last_undegraded":"2023-07-05T18:56:17.658447+0000","last_fullsized":"2023-07-05T18:56:17.658447+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T18:56:14.665171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T18:56:14.665171+0000","last_clean_scrub_stamp":"2023-07-05T18:56:14.665171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-06T22:32:11.493711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-05T18:56:16.474111+0000","last_change":"2023-07-05T18:56:15.121918+0000","last_active":"2023-07-05T18:56:16.474111+0000","last_peered":"2023-07-05T18:56:16.474111+0000","last_clean":"2023-07-05T18:56:16.474111+0000","last_became_active":"2023-07-05T18:56:15.121400+0000","last_became_peered":"2023-07-05T18:56:15.121400+0000","last_unstale":"2023-07-05T18:56:16.474111+0000","last_undegraded":"2023-07-05T18:56:16.474111+0000","last_fullsized":"2023-07-05T18:56:16.474111+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T18:56:14.665171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T18:56:14.665171+0000","last_clean_scrub_stamp":"2023-07-05T18:56:14.665171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-06T21:50:37.526388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-05T18:56:17.659108+0000","last_change":"2023-07-05T18:56:15.127191+0000","last_active":"2023-07-05T18:56:17.659108+0000","last_peered":"2023-07-05T18:56:17.659108+0000","last_clean":"2023-07-05T18:56:17.659108+0000","last_became_active":"2023-07-05T18:56:15.126872+0000","last_became_peered":"2023-07-05T18:56:15.126872+0000","last_unstale":"2023-07-05T18:56:17.659108+0000","last_undegraded":"2023-07-05T18:56:17.659108+0000","last_fullsized":"2023-07-05T18:56:17.659108+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T18:56:14.665171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T18:56:14.665171+0000","last_clean_scrub_stamp":"2023-07-05T18:56:14.665171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T02:22:27.543361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-05T18:56:17.658229+0000","last_change":"2023-07-05T18:56:15.108982+0000","last_active":"2023-07-05T18:56:17.658229+0000","last_peered":"2023-07-05T18:56:17.658229+0000","last_clean":"2023-07-05T18:56:17.658229+0000","last_became_active":"2023-07-05T18:56:15.108461+0000","last_became_peered":"2023-07-05T18:56:15.108461+0000","last_unstale":"2023-07-05T18:56:17.658229+0000","last_undegraded":"2023-07-05T18:56:17.658229+0000","last_fullsized":"2023-07-05T18:56:17.658229+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T18:56:14.665171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T18:56:14.665171+0000","last_clean_scrub_stamp":"2023-07-05T18:56:14.665171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T05:40:41.006597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-05T18:56:17.658840+0000","last_change":"2023-07-05T18:56:15.124274+0000","last_active":"2023-07-05T18:56:17.658840+0000","last_peered":"2023-07-05T18:56:17.658840+0000","last_clean":"2023-07-05T18:56:17.658840+0000","last_became_active":"2023-07-05T18:56:15.123758+0000","last_became_peered":"2023-07-05T18:56:15.123758+0000","last_unstale":"2023-07-05T18:56:17.658840+0000","last_undegraded":"2023-07-05T18:56:17.658840+0000","last_fullsized":"2023-07-05T18:56:17.658840+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T18:56:14.665171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T18:56:14.665171+0000","last_clean_scrub_stamp":"2023-07-05T18:56:14.665171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T03:39:30.527160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-05T18:56:17.158642+0000","last_change":"2023-07-05T18:56:15.123685+0000","last_active":"2023-07-05T18:56:17.158642+0000","last_peered":"2023-07-05T18:56:17.158642+0000","last_clean":"2023-07-05T18:56:17.158642+0000","last_became_active":"2023-07-05T18:56:15.123431+0000","last_became_peered":"2023-07-05T18:56:15.123431+0000","last_unstale":"2023-07-05T18:56:17.158642+0000","last_undegraded":"2023-07-05T18:56:17.158642+0000","last_fullsized":"2023-07-05T18:56:17.158642+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T18:56:14.665171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T18:56:14.665171+0000","last_clean_scrub_stamp":"2023-07-05T18:56:14.665171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T04:41:48.823682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-05T18:56:16.473936+0000","last_change":"2023-07-05T18:56:15.116119+0000","last_active":"2023-07-05T18:56:16.473936+0000","last_peered":"2023-07-05T18:56:16.473936+0000","last_clean":"2023-07-05T18:56:16.473936+0000","last_became_active":"2023-07-05T18:56:15.115869+0000","last_became_peered":"2023-07-05T18:56:15.115869+0000","last_unstale":"2023-07-05T18:56:16.473936+0000","last_undegraded":"2023-07-05T18:56:16.473936+0000","last_fullsized":"2023-07-05T18:56:16.473936+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T18:56:14.665171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T18:56:14.665171+0000","last_clean_scrub_stamp":"2023-07-05T18:56:14.665171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-06T19:43:28.708822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-05T18:56:16.104324+0000","last_change":"2023-07-05T18:56:15.122698+0000","last_active":"2023-07-05T18:56:16.104324+0000","last_peered":"2023-07-05T18:56:16.104324+0000","last_clean":"2023-07-05T18:56:16.104324+0000","last_became_active":"2023-07-05T18:56:15.122391+0000","last_became_peered":"2023-07-05T18:56:15.122391+0000","last_unstale":"2023-07-05T18:56:16.104324+0000","last_undegraded":"2023-07-05T18:56:16.104324+0000","last_fullsized":"2023-07-05T18:56:16.104324+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T18:56:14.665171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T18:56:14.665171+0000","last_clean_scrub_stamp":"2023-07-05T18:56:14.665171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T03:02:00.204080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-05T18:56:17.158207+0000","last_change":"2023-07-05T18:56:15.125120+0000","last_active":"2023-07-05T18:56:17.158207+0000","last_peered":"2023-07-05T18:56:17.158207+0000","last_clean":"2023-07-05T18:56:17.158207+0000","last_became_active":"2023-07-05T18:56:15.124790+0000","last_became_peered":"2023-07-05T18:56:15.124790+0000","last_unstale":"2023-07-05T18:56:17.158207+0000","last_undegraded":"2023-07-05T18:56:17.158207+0000","last_fullsized":"2023-07-05T18:56:17.158207+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T18:56:14.665171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T18:56:14.665171+0000","last_clean_scrub_stamp":"2023-07-05T18:56:14.665171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-06T21:14:58.040487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-05T18:56:17.190914+0000","last_change":"2023-07-05T18:56:15.109580+0000","last_active":"2023-07-05T18:56:17.190914+0000","last_peered":"2023-07-05T18:56:17.190914+0000","last_clean":"2023-07-05T18:56:17.190914+0000","last_became_active":"2023-07-05T18:56:15.109054+0000","last_became_peered":"2023-07-05T18:56:15.109054+0000","last_unstale":"2023-07-05T18:56:17.190914+0000","last_undegraded":"2023-07-05T18:56:17.190914+0000","last_fullsized":"2023-07-05T18:56:17.190914+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T18:56:14.665171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T18:56:14.665171+0000","last_clean_scrub_stamp":"2023-07-05T18:56:14.665171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T04:53:59.163434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-05T18:56:17.191114+0000","last_change":"2023-07-05T18:56:15.103610+0000","last_active":"2023-07-05T18:56:17.191114+0000","last_peered":"2023-07-05T18:56:17.191114+0000","last_clean":"2023-07-05T18:56:17.191114+0000","last_became_active":"2023-07-05T18:56:15.103321+0000","last_became_peered":"2023-07-05T18:56:15.103321+0000","last_unstale":"2023-07-05T18:56:17.191114+0000","last_undegraded":"2023-07-05T18:56:17.191114+0000","last_fullsized":"2023-07-05T18:56:17.191114+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T18:56:14.665171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T18:56:14.665171+0000","last_clean_scrub_stamp":"2023-07-05T18:56:14.665171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T03:02:00.204080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-05T18:56:16.105649+0000","last_change":"2023-07-05T18:56:15.121207+0000","last_active":"2023-07-05T18:56:16.105649+0000","last_peered":"2023-07-05T18:56:16.105649+0000","last_clean":"2023-07-05T18:56:16.105649+0000","last_became_active":"2023-07-05T18:56:15.120697+0000","last_became_peered":"2023-07-05T18:56:15.120697+0000","last_unstale":"2023-07-05T18:56:16.105649+0000","last_undegraded":"2023-07-05T18:56:16.105649+0000","last_fullsized":"2023-07-05T18:56:16.105649+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T18:56:14.665171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T18:56:14.665171+0000","last_clean_scrub_stamp":"2023-07-05T18:56:14.665171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T03:08:48.441898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"20'1","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-05T18:56:17.658707+0000","last_change":"2023-07-05T18:56:14.692934+0000","last_active":"2023-07-05T18:56:17.658707+0000","last_peered":"2023-07-05T18:56:17.658707+0000","last_clean":"2023-07-05T18:56:17.658707+0000","last_became_active":"2023-07-05T18:56:14.692645+0000","last_became_peered":"2023-07-05T18:56:14.692645+0000","last_unstale":"2023-07-05T18:56:17.658707+0000","last_undegraded":"2023-07-05T18:56:17.658707+0000","last_fullsized":"2023-07-05T18:56:17.658707+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T18:56:13.659893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T18:56:13.659893+0000","last_clean_scrub_stamp":"2023-07-05T18:56:13.659893+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T04:34:53.807856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-05T18:56:16.104876+0000","last_change":"2023-07-05T18:56:15.112376+0000","last_active":"2023-07-05T18:56:16.104876+0000","last_peered":"2023-07-05T18:56:16.104876+0000","last_clean":"2023-07-05T18:56:16.104876+0000","last_became_active":"2023-07-05T18:56:15.111904+0000","last_became_peered":"2023-07-05T18:56:15.111904+0000","last_unstale":"2023-07-05T18:56:16.104876+0000","last_undegraded":"2023-07-05T18:56:16.104876+0000","last_fullsized":"2023-07-05T18:56:16.104876+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T18:56:14.665171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T18:56:14.665171+0000","last_clean_scrub_stamp":"2023-07-05T18:56:14.665171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T03:39:30.527160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-05T18:56:17.190892+0000","last_change":"2023-07-05T18:56:14.698190+0000","last_active":"2023-07-05T18:56:17.190892+0000","last_peered":"2023-07-05T18:56:17.190892+0000","last_clean":"2023-07-05T18:56:17.190892+0000","last_became_active":"2023-07-05T18:56:14.697916+0000","last_became_peered":"2023-07-05T18:56:14.697916+0000","last_unstale":"2023-07-05T18:56:17.190892+0000","last_undegraded":"2023-07-05T18:56:17.190892+0000","last_fullsized":"2023-07-05T18:56:17.190892+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T18:56:13.659893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T18:56:13.659893+0000","last_clean_scrub_stamp":"2023-07-05T18:56:13.659893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T05:13:26.630999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-05T18:56:16.474349+0000","last_change":"2023-07-05T18:56:15.121188+0000","last_active":"2023-07-05T18:56:16.474349+0000","last_peered":"2023-07-05T18:56:16.474349+0000","last_clean":"2023-07-05T18:56:16.474349+0000","last_became_active":"2023-07-05T18:56:15.120955+0000","last_became_peered":"2023-07-05T18:56:15.120955+0000","last_unstale":"2023-07-05T18:56:16.474349+0000","last_undegraded":"2023-07-05T18:56:16.474349+0000","last_fullsized":"2023-07-05T18:56:16.474349+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T18:56:14.665171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T18:56:14.665171+0000","last_clean_scrub_stamp":"2023-07-05T18:56:14.665171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-06T21:14:58.040487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-05T18:56:16.104435+0000","last_change":"2023-07-05T18:56:14.689037+0000","last_active":"2023-07-05T18:56:16.104435+0000","last_peered":"2023-07-05T18:56:16.104435+0000","last_clean":"2023-07-05T18:56:16.104435+0000","last_became_active":"2023-07-05T18:56:14.688728+0000","last_became_peered":"2023-07-05T18:56:14.688728+0000","last_unstale":"2023-07-05T18:56:16.104435+0000","last_undegraded":"2023-07-05T18:56:16.104435+0000","last_fullsized":"2023-07-05T18:56:16.104435+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T18:56:13.659893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T18:56:13.659893+0000","last_clean_scrub_stamp":"2023-07-05T18:56:13.659893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-06T22:32:10.488434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-05T18:56:16.105018+0000","last_change":"2023-07-05T18:56:15.115710+0000","last_active":"2023-07-05T18:56:16.105018+0000","last_peered":"2023-07-05T18:56:16.105018+0000","last_clean":"2023-07-05T18:56:16.105018+0000","last_became_active":"2023-07-05T18:56:15.115354+0000","last_became_peered":"2023-07-05T18:56:15.115354+0000","last_unstale":"2023-07-05T18:56:16.105018+0000","last_undegraded":"2023-07-05T18:56:16.105018+0000","last_fullsized":"2023-07-05T18:56:16.105018+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T18:56:14.665171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T18:56:14.665171+0000","last_clean_scrub_stamp":"2023-07-05T18:56:14.665171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T02:24:35.873082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-05T18:56:16.474292+0000","last_change":"2023-07-05T18:56:14.689657+0000","last_active":"2023-07-05T18:56:16.474292+0000","last_peered":"2023-07-05T18:56:16.474292+0000","last_clean":"2023-07-05T18:56:16.474292+0000","last_became_active":"2023-07-05T18:56:14.689065+0000","last_became_peered":"2023-07-05T18:56:14.689065+0000","last_unstale":"2023-07-05T18:56:16.474292+0000","last_undegraded":"2023-07-05T18:56:16.474292+0000","last_fullsized":"2023-07-05T18:56:16.474292+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T18:56:13.659893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T18:56:13.659893+0000","last_clean_scrub_stamp":"2023-07-05T18:56:13.659893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T01:35:59.096513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-05T18:56:16.104489+0000","last_change":"2023-07-05T18:56:15.113602+0000","last_active":"2023-07-05T18:56:16.104489+0000","last_peered":"2023-07-05T18:56:16.104489+0000","last_clean":"2023-07-05T18:56:16.104489+0000","last_became_active":"2023-07-05T18:56:15.113313+0000","last_became_peered":"2023-07-05T18:56:15.113313+0000","last_unstale":"2023-07-05T18:56:16.104489+0000","last_undegraded":"2023-07-05T18:56:16.104489+0000","last_fullsized":"2023-07-05T18:56:16.104489+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T18:56:14.665171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T18:56:14.665171+0000","last_clean_scrub_stamp":"2023-07-05T18:56:14.665171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-06T21:14:58.040487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-05T18:56:16.105135+0000","last_change":"2023-07-05T18:56:14.686543+0000","last_active":"2023-07-05T18:56:16.105135+0000","last_peered":"2023-07-05T18:56:16.105135+0000","last_clean":"2023-07-05T18:56:16.105135+0000","last_became_active":"2023-07-05T18:56:14.686277+0000","last_became_peered":"2023-07-05T18:56:14.686277+0000","last_unstale":"2023-07-05T18:56:16.105135+0000","last_undegraded":"2023-07-05T18:56:16.105135+0000","last_fullsized":"2023-07-05T18:56:16.105135+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T18:56:13.659893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T18:56:13.659893+0000","last_clean_scrub_stamp":"2023-07-05T18:56:13.659893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T05:13:26.630999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-05T18:56:16.104551+0000","last_change":"2023-07-05T18:56:15.117293+0000","last_active":"2023-07-05T18:56:16.104551+0000","last_peered":"2023-07-05T18:56:16.104551+0000","last_clean":"2023-07-05T18:56:16.104551+0000","last_became_active":"2023-07-05T18:56:15.114133+0000","last_became_peered":"2023-07-05T18:56:15.114133+0000","last_unstale":"2023-07-05T18:56:16.104551+0000","last_undegraded":"2023-07-05T18:56:16.104551+0000","last_fullsized":"2023-07-05T18:56:16.104551+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T18:56:14.665171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T18:56:14.665171+0000","last_clean_scrub_stamp":"2023-07-05T18:56:14.665171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T02:13:19.229598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"20'3","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-05T18:56:17.158600+0000","last_change":"2023-07-05T18:56:14.697955+0000","last_active":"2023-07-05T18:56:17.158600+0000","last_peered":"2023-07-05T18:56:17.158600+0000","last_clean":"2023-07-05T18:56:17.158600+0000","last_became_active":"2023-07-05T18:56:14.697729+0000","last_became_peered":"2023-07-05T18:56:14.697729+0000","last_unstale":"2023-07-05T18:56:17.158600+0000","last_undegraded":"2023-07-05T18:56:17.158600+0000","last_fullsized":"2023-07-05T18:56:17.158600+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T18:56:13.659893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T18:56:13.659893+0000","last_clean_scrub_stamp":"2023-07-05T18:56:13.659893+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T00:22:00.885983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-05T18:56:17.190602+0000","last_change":"2023-07-05T18:56:15.119531+0000","last_active":"2023-07-05T18:56:17.190602+0000","last_peered":"2023-07-05T18:56:17.190602+0000","last_clean":"2023-07-05T18:56:17.190602+0000","last_became_active":"2023-07-05T18:56:15.118905+0000","last_became_peered":"2023-07-05T18:56:15.118905+0000","last_unstale":"2023-07-05T18:56:17.190602+0000","last_undegraded":"2023-07-05T18:56:17.190602+0000","last_fullsized":"2023-07-05T18:56:17.190602+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T18:56:14.665171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T18:56:14.665171+0000","last_clean_scrub_stamp":"2023-07-05T18:56:14.665171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T01:07:17.521433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"20'6","reported_seq":19,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-05T18:56:17.659058+0000","last_change":"2023-07-05T18:56:14.686257+0000","last_active":"2023-07-05T18:56:17.659058+0000","last_peered":"2023-07-05T18:56:17.659058+0000","last_clean":"2023-07-05T18:56:17.659058+0000","last_became_active":"2023-07-05T18:56:14.685975+0000","last_became_peered":"2023-07-05T18:56:14.685975+0000","last_unstale":"2023-07-05T18:56:17.659058+0000","last_undegraded":"2023-07-05T18:56:17.659058+0000","last_fullsized":"2023-07-05T18:56:17.659058+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T18:56:13.659893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T18:56:13.659893+0000","last_clean_scrub_stamp":"2023-07-05T18:56:13.659893+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T01:36:07.431270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-05T18:56:17.658806+0000","last_change":"2023-07-05T18:56:15.123521+0000","last_active":"2023-07-05T18:56:17.658806+0000","last_peered":"2023-07-05T18:56:17.658806+0000","last_clean":"2023-07-05T18:56:17.658806+0000","last_became_active":"2023-07-05T18:56:15.123249+0000","last_became_peered":"2023-07-05T18:56:15.123249+0000","last_unstale":"2023-07-05T18:56:17.658806+0000","last_undegraded":"2023-07-05T18:56:17.658806+0000","last_fullsized":"2023-07-05T18:56:17.658806+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T18:56:14.665171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T18:56:14.665171+0000","last_clean_scrub_stamp":"2023-07-05T18:56:14.665171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T01:08:19.218925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.13","version":"20'2","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-05T18:56:17.158513+0000","last_change":"2023-07-05T18:56:14.688172+0000","last_active":"2023-07-05T18:56:17.158513+0000","last_peered":"2023-07-05T18:56:17.158513+0000","last_clean":"2023-07-05T18:56:17.158513+0000","last_became_active":"2023-07-05T18:56:14.687865+0000","last_became_peered":"2023-07-05T18:56:14.687865+0000","last_unstale":"2023-07-05T18:56:17.158513+0000","last_undegraded":"2023-07-05T18:56:17.158513+0000","last_fullsized":"2023-07-05T18:56:17.158513+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T18:56:13.659893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T18:56:13.659893+0000","last_clean_scrub_stamp":"2023-07-05T18:56:13.659893+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T01:08:18.213648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-05T18:56:16.104638+0000","last_change":"2023-07-05T18:56:15.122409+0000","last_active":"2023-07-05T18:56:16.104638+0000","last_peered":"2023-07-05T18:56:16.104638+0000","last_clean":"2023-07-05T18:56:16.104638+0000","last_became_active":"2023-07-05T18:56:15.122152+0000","last_became_peered":"2023-07-05T18:56:15.122152+0000","last_unstale":"2023-07-05T18:56:16.104638+0000","last_undegraded":"2023-07-05T18:56:16.104638+0000","last_fullsized":"2023-07-05T18:56:16.104638+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T18:56:14.665171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T18:56:14.665171+0000","last_clean_scrub_stamp":"2023-07-05T18:56:14.665171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T02:23:52.877499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-05T18:56:16.474220+0000","last_change":"2023-07-05T18:56:14.687246+0000","last_active":"2023-07-05T18:56:16.474220+0000","last_peered":"2023-07-05T18:56:16.474220+0000","last_clean":"2023-07-05T18:56:16.474220+0000","last_became_active":"2023-07-05T18:56:14.686917+0000","last_became_peered":"2023-07-05T18:56:14.686917+0000","last_unstale":"2023-07-05T18:56:16.474220+0000","last_undegraded":"2023-07-05T18:56:16.474220+0000","last_fullsized":"2023-07-05T18:56:16.474220+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T18:56:13.659893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T18:56:13.659893+0000","last_clean_scrub_stamp":"2023-07-05T18:56:13.659893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T03:01:59.198802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-05T18:56:16.105662+0000","last_change":"2023-07-05T18:56:15.120411+0000","last_active":"2023-07-05T18:56:16.105662+0000","last_peered":"2023-07-05T18:56:16.105662+0000","last_clean":"2023-07-05T18:56:16.105662+0000","last_became_active":"2023-07-05T18:56:15.117799+0000","last_became_peered":"2023-07-05T18:56:15.117799+0000","last_unstale":"2023-07-05T18:56:16.105662+0000","last_undegraded":"2023-07-05T18:56:16.105662+0000","last_fullsized":"2023-07-05T18:56:16.105662+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T18:56:14.665171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T18:56:14.665171+0000","last_clean_scrub_stamp":"2023-07-05T18:56:14.665171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-06T22:32:11.493711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-05T18:56:17.158276+0000","last_change":"2023-07-05T18:56:14.689699+0000","last_active":"2023-07-05T18:56:17.158276+0000","last_peered":"2023-07-05T18:56:17.158276+0000","last_clean":"2023-07-05T18:56:17.158276+0000","last_became_active":"2023-07-05T18:56:14.689136+0000","last_became_peered":"2023-07-05T18:56:14.689136+0000","last_unstale":"2023-07-05T18:56:17.158276+0000","last_undegraded":"2023-07-05T18:56:17.158276+0000","last_fullsized":"2023-07-05T18:56:17.158276+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T18:56:13.659893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T18:56:13.659893+0000","last_clean_scrub_stamp":"2023-07-05T18:56:13.659893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T02:13:18.224321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-05T18:56:16.474079+0000","last_change":"2023-07-05T18:56:15.121706+0000","last_active":"2023-07-05T18:56:16.474079+0000","last_peered":"2023-07-05T18:56:16.474079+0000","last_clean":"2023-07-05T18:56:16.474079+0000","last_became_active":"2023-07-05T18:56:15.121455+0000","last_became_peered":"2023-07-05T18:56:15.121455+0000","last_unstale":"2023-07-05T18:56:16.474079+0000","last_undegraded":"2023-07-05T18:56:16.474079+0000","last_fullsized":"2023-07-05T18:56:16.474079+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T18:56:14.665171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T18:56:14.665171+0000","last_clean_scrub_stamp":"2023-07-05T18:56:14.665171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T05:13:27.636276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"20'8","reported_seq":21,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-05T18:56:16.104386+0000","last_change":"2023-07-05T18:56:14.689000+0000","last_active":"2023-07-05T18:56:16.104386+0000","last_peered":"2023-07-05T18:56:16.104386+0000","last_clean":"2023-07-05T18:56:16.104386+0000","last_became_active":"2023-07-05T18:56:14.688670+0000","last_became_peered":"2023-07-05T18:56:14.688670+0000","last_unstale":"2023-07-05T18:56:16.104386+0000","last_undegraded":"2023-07-05T18:56:16.104386+0000","last_fullsized":"2023-07-05T18:56:16.104386+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T18:56:13.659893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T18:56:13.659893+0000","last_clean_scrub_stamp":"2023-07-05T18:56:13.659893+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-06T23:52:21.769984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-05T18:56:16.105133+0000","last_change":"2023-07-05T18:56:15.117236+0000","last_active":"2023-07-05T18:56:16.105133+0000","last_peered":"2023-07-05T18:56:16.105133+0000","last_clean":"2023-07-05T18:56:16.105133+0000","last_became_active":"2023-07-05T18:56:15.116848+0000","last_became_peered":"2023-07-05T18:56:15.116848+0000","last_unstale":"2023-07-05T18:56:16.105133+0000","last_undegraded":"2023-07-05T18:56:16.105133+0000","last_fullsized":"2023-07-05T18:56:16.105133+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T18:56:14.665171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T18:56:14.665171+0000","last_clean_scrub_stamp":"2023-07-05T18:56:14.665171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T04:41:48.823682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"20'1","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-05T18:56:17.158684+0000","last_change":"2023-07-05T18:56:14.688547+0000","last_active":"2023-07-05T18:56:17.158684+0000","last_peered":"2023-07-05T18:56:17.158684+0000","last_clean":"2023-07-05T18:56:17.158684+0000","last_became_active":"2023-07-05T18:56:14.688296+0000","last_became_peered":"2023-07-05T18:56:14.688296+0000","last_unstale":"2023-07-05T18:56:17.158684+0000","last_undegraded":"2023-07-05T18:56:17.158684+0000","last_fullsized":"2023-07-05T18:56:17.158684+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T18:56:13.659893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T18:56:13.659893+0000","last_clean_scrub_stamp":"2023-07-05T18:56:13.659893+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T02:16:58.460543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-05T18:56:16.105182+0000","last_change":"2023-07-05T18:56:15.117356+0000","last_active":"2023-07-05T18:56:16.105182+0000","last_peered":"2023-07-05T18:56:16.105182+0000","last_clean":"2023-07-05T18:56:16.105182+0000","last_became_active":"2023-07-05T18:56:15.117053+0000","last_became_peered":"2023-07-05T18:56:15.117053+0000","last_unstale":"2023-07-05T18:56:16.105182+0000","last_undegraded":"2023-07-05T18:56:16.105182+0000","last_fullsized":"2023-07-05T18:56:16.105182+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T18:56:14.665171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T18:56:14.665171+0000","last_clean_scrub_stamp":"2023-07-05T18:56:14.665171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T04:53:59.163434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"20'2","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-05T18:56:17.158412+0000","last_change":"2023-07-05T18:56:14.688203+0000","last_active":"2023-07-05T18:56:17.158412+0000","last_peered":"2023-07-05T18:56:17.158412+0000","last_clean":"2023-07-05T18:56:17.158412+0000","last_became_active":"2023-07-05T18:56:14.687907+0000","last_became_peered":"2023-07-05T18:56:14.687907+0000","last_unstale":"2023-07-05T18:56:17.158412+0000","last_undegraded":"2023-07-05T18:56:17.158412+0000","last_fullsized":"2023-07-05T18:56:17.158412+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T18:56:13.659893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T18:56:13.659893+0000","last_clean_scrub_stamp":"2023-07-05T18:56:13.659893+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T04:34:53.807856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-05T18:56:17.658461+0000","last_change":"2023-07-05T18:56:15.122876+0000","last_active":"2023-07-05T18:56:17.658461+0000","last_peered":"2023-07-05T18:56:17.658461+0000","last_clean":"2023-07-05T18:56:17.658461+0000","last_became_active":"2023-07-05T18:56:15.122580+0000","last_became_peered":"2023-07-05T18:56:15.122580+0000","last_unstale":"2023-07-05T18:56:17.658461+0000","last_undegraded":"2023-07-05T18:56:17.658461+0000","last_fullsized":"2023-07-05T18:56:17.658461+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T18:56:14.665171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T18:56:14.665171+0000","last_clean_scrub_stamp":"2023-07-05T18:56:14.665171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T02:30:29.740847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.d","version":"20'1","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-05T18:56:17.158635+0000","last_change":"2023-07-05T18:56:14.688520+0000","last_active":"2023-07-05T18:56:17.158635+0000","last_peered":"2023-07-05T18:56:17.158635+0000","last_clean":"2023-07-05T18:56:17.158635+0000","last_became_active":"2023-07-05T18:56:14.688106+0000","last_became_peered":"2023-07-05T18:56:14.688106+0000","last_unstale":"2023-07-05T18:56:17.158635+0000","last_undegraded":"2023-07-05T18:56:17.158635+0000","last_fullsized":"2023-07-05T18:56:17.158635+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T18:56:13.659893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T18:56:13.659893+0000","last_clean_scrub_stamp":"2023-07-05T18:56:13.659893+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-06T23:38:28.346200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-05T18:56:16.104261+0000","last_change":"2023-07-05T18:56:15.112983+0000","last_active":"2023-07-05T18:56:16.104261+0000","last_peered":"2023-07-05T18:56:16.104261+0000","last_clean":"2023-07-05T18:56:16.104261+0000","last_became_active":"2023-07-05T18:56:15.112573+0000","last_became_peered":"2023-07-05T18:56:15.112573+0000","last_unstale":"2023-07-05T18:56:16.104261+0000","last_undegraded":"2023-07-05T18:56:16.104261+0000","last_fullsized":"2023-07-05T18:56:16.104261+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T18:56:14.665171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T18:56:14.665171+0000","last_clean_scrub_stamp":"2023-07-05T18:56:14.665171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-06T19:43:28.708822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-05T18:56:16.105586+0000","last_change":"2023-07-05T18:56:14.683769+0000","last_active":"2023-07-05T18:56:16.105586+0000","last_peered":"2023-07-05T18:56:16.105586+0000","last_clean":"2023-07-05T18:56:16.105586+0000","last_became_active":"2023-07-05T18:56:14.683471+0000","last_became_peered":"2023-07-05T18:56:14.683471+0000","last_unstale":"2023-07-05T18:56:16.105586+0000","last_undegraded":"2023-07-05T18:56:16.105586+0000","last_fullsized":"2023-07-05T18:56:16.105586+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T18:56:13.659893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T18:56:13.659893+0000","last_clean_scrub_stamp":"2023-07-05T18:56:13.659893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T03:01:59.198802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-05T18:56:16.474241+0000","last_change":"2023-07-05T18:56:15.120318+0000","last_active":"2023-07-05T18:56:16.474241+0000","last_peered":"2023-07-05T18:56:16.474241+0000","last_clean":"2023-07-05T18:56:16.474241+0000","last_became_active":"2023-07-05T18:56:15.119781+0000","last_became_peered":"2023-07-05T18:56:15.119781+0000","last_unstale":"2023-07-05T18:56:16.474241+0000","last_undegraded":"2023-07-05T18:56:16.474241+0000","last_fullsized":"2023-07-05T18:56:16.474241+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T18:56:14.665171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T18:56:14.665171+0000","last_clean_scrub_stamp":"2023-07-05T18:56:14.665171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T03:08:48.441898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"20'2","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-05T18:56:16.104648+0000","last_change":"2023-07-05T18:56:14.697766+0000","last_active":"2023-07-05T18:56:16.104648+0000","last_peered":"2023-07-05T18:56:16.104648+0000","last_clean":"2023-07-05T18:56:16.104648+0000","last_became_active":"2023-07-05T18:56:14.697460+0000","last_became_peered":"2023-07-05T18:56:14.697460+0000","last_unstale":"2023-07-05T18:56:16.104648+0000","last_undegraded":"2023-07-05T18:56:16.104648+0000","last_fullsized":"2023-07-05T18:56:16.104648+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T18:56:13.659893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T18:56:13.659893+0000","last_clean_scrub_stamp":"2023-07-05T18:56:13.659893+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T05:47:50.661848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-05T18:56:17.659034+0000","last_change":"2023-07-05T18:56:15.126143+0000","last_active":"2023-07-05T18:56:17.659034+0000","last_peered":"2023-07-05T18:56:17.659034+0000","last_clean":"2023-07-05T18:56:17.659034+0000","last_became_active":"2023-07-05T18:56:15.125704+0000","last_became_peered":"2023-07-05T18:56:15.125704+0000","last_unstale":"2023-07-05T18:56:17.659034+0000","last_undegraded":"2023-07-05T18:56:17.659034+0000","last_fullsized":"2023-07-05T18:56:17.659034+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T18:56:14.665171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T18:56:14.665171+0000","last_clean_scrub_stamp":"2023-07-05T18:56:14.665171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T02:16:59.465821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-05T18:56:16.104166+0000","last_change":"2023-07-05T18:56:14.681768+0000","last_active":"2023-07-05T18:56:16.104166+0000","last_peered":"2023-07-05T18:56:16.104166+0000","last_clean":"2023-07-05T18:56:16.104166+0000","last_became_active":"2023-07-05T18:56:14.681488+0000","last_became_peered":"2023-07-05T18:56:14.681488+0000","last_unstale":"2023-07-05T18:56:16.104166+0000","last_undegraded":"2023-07-05T18:56:16.104166+0000","last_fullsized":"2023-07-05T18:56:16.104166+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T18:56:13.659893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T18:56:13.659893+0000","last_clean_scrub_stamp":"2023-07-05T18:56:13.659893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T01:07:16.516155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-05T18:56:17.659215+0000","last_change":"2023-07-05T18:56:15.131136+0000","last_active":"2023-07-05T18:56:17.659215+0000","last_peered":"2023-07-05T18:56:17.659215+0000","last_clean":"2023-07-05T18:56:17.659215+0000","last_became_active":"2023-07-05T18:56:15.130845+0000","last_became_peered":"2023-07-05T18:56:15.130845+0000","last_unstale":"2023-07-05T18:56:17.659215+0000","last_undegraded":"2023-07-05T18:56:17.659215+0000","last_fullsized":"2023-07-05T18:56:17.659215+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T18:56:14.665171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T18:56:14.665171+0000","last_clean_scrub_stamp":"2023-07-05T18:56:14.665171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-06T20:32:29.656581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-05T18:56:17.658694+0000","last_change":"2023-07-05T18:56:14.694531+0000","last_active":"2023-07-05T18:56:17.658694+0000","last_peered":"2023-07-05T18:56:17.658694+0000","last_clean":"2023-07-05T18:56:17.658694+0000","last_became_active":"2023-07-05T18:56:14.694255+0000","last_became_peered":"2023-07-05T18:56:14.694255+0000","last_unstale":"2023-07-05T18:56:17.658694+0000","last_undegraded":"2023-07-05T18:56:17.658694+0000","last_fullsized":"2023-07-05T18:56:17.658694+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T18:56:13.659893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T18:56:13.659893+0000","last_clean_scrub_stamp":"2023-07-05T18:56:13.659893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T05:47:50.661848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-05T18:56:17.659049+0000","last_change":"2023-07-05T18:56:15.125686+0000","last_active":"2023-07-05T18:56:17.659049+0000","last_peered":"2023-07-05T18:56:17.659049+0000","last_clean":"2023-07-05T18:56:17.659049+0000","last_became_active":"2023-07-05T18:56:15.124278+0000","last_became_peered":"2023-07-05T18:56:15.124278+0000","last_unstale":"2023-07-05T18:56:17.659049+0000","last_undegraded":"2023-07-05T18:56:17.659049+0000","last_fullsized":"2023-07-05T18:56:17.659049+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T18:56:14.665171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T18:56:14.665171+0000","last_clean_scrub_stamp":"2023-07-05T18:56:14.665171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T05:54:49.290188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-05T18:56:16.104272+0000","last_change":"2023-07-05T18:56:14.697776+0000","last_active":"2023-07-05T18:56:16.104272+0000","last_peered":"2023-07-05T18:56:16.104272+0000","last_clean":"2023-07-05T18:56:16.104272+0000","last_became_active":"2023-07-05T18:56:14.697446+0000","last_became_peered":"2023-07-05T18:56:14.697446+0000","last_unstale":"2023-07-05T18:56:16.104272+0000","last_undegraded":"2023-07-05T18:56:16.104272+0000","last_fullsized":"2023-07-05T18:56:16.104272+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T18:56:13.659893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T18:56:13.659893+0000","last_clean_scrub_stamp":"2023-07-05T18:56:13.659893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T03:19:03.957135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-05T18:56:17.191314+0000","last_change":"2023-07-05T18:56:15.119281+0000","last_active":"2023-07-05T18:56:17.191314+0000","last_peered":"2023-07-05T18:56:17.191314+0000","last_clean":"2023-07-05T18:56:17.191314+0000","last_became_active":"2023-07-05T18:56:15.118746+0000","last_became_peered":"2023-07-05T18:56:15.118746+0000","last_unstale":"2023-07-05T18:56:17.191314+0000","last_undegraded":"2023-07-05T18:56:17.191314+0000","last_fullsized":"2023-07-05T18:56:17.191314+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T18:56:14.665171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T18:56:14.665171+0000","last_clean_scrub_stamp":"2023-07-05T18:56:14.665171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-06T22:32:11.493711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"20'2","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-05T18:56:16.104993+0000","last_change":"2023-07-05T18:56:14.688850+0000","last_active":"2023-07-05T18:56:16.104993+0000","last_peered":"2023-07-05T18:56:16.104993+0000","last_clean":"2023-07-05T18:56:16.104993+0000","last_became_active":"2023-07-05T18:56:14.688549+0000","last_became_peered":"2023-07-05T18:56:14.688549+0000","last_unstale":"2023-07-05T18:56:16.104993+0000","last_undegraded":"2023-07-05T18:56:16.104993+0000","last_fullsized":"2023-07-05T18:56:16.104993+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T18:56:13.659893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T18:56:13.659893+0000","last_clean_scrub_stamp":"2023-07-05T18:56:13.659893+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-06T23:38:28.346200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":19,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-05T18:56:17.659116+0000","last_change":"2023-07-05T18:56:09.622184+0000","last_active":"2023-07-05T18:56:17.659116+0000","last_peered":"2023-07-05T18:56:17.659116+0000","last_clean":"2023-07-05T18:56:17.659116+0000","last_became_active":"2023-07-05T18:56:09.621796+0000","last_became_peered":"2023-07-05T18:56:09.621796+0000","last_unstale":"2023-07-05T18:56:17.659116+0000","last_undegraded":"2023-07-05T18:56:17.659116+0000","last_fullsized":"2023-07-05T18:56:17.659116+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T18:56:08.603137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T18:56:08.603137+0000","last_clean_scrub_stamp":"2023-07-05T18:56:08.603137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T00:53:51.106729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-05T18:56:16.104244+0000","last_change":"2023-07-05T18:56:15.117197+0000","last_active":"2023-07-05T18:56:16.104244+0000","last_peered":"2023-07-05T18:56:16.104244+0000","last_clean":"2023-07-05T18:56:16.104244+0000","last_became_active":"2023-07-05T18:56:15.116612+0000","last_became_peered":"2023-07-05T18:56:15.116612+0000","last_unstale":"2023-07-05T18:56:16.104244+0000","last_undegraded":"2023-07-05T18:56:16.104244+0000","last_fullsized":"2023-07-05T18:56:16.104244+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T18:56:14.665171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T18:56:14.665171+0000","last_clean_scrub_stamp":"2023-07-05T18:56:14.665171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T02:24:35.873082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":19,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-05T18:56:16.104703+0000","last_change":"2023-07-05T18:56:09.621596+0000","last_active":"2023-07-05T18:56:16.104703+0000","last_peered":"2023-07-05T18:56:16.104703+0000","last_clean":"2023-07-05T18:56:16.104703+0000","last_became_active":"2023-07-05T18:56:09.621315+0000","last_became_peered":"2023-07-05T18:56:09.621315+0000","last_unstale":"2023-07-05T18:56:16.104703+0000","last_undegraded":"2023-07-05T18:56:16.104703+0000","last_fullsized":"2023-07-05T18:56:16.104703+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T18:56:08.603137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T18:56:08.603137+0000","last_clean_scrub_stamp":"2023-07-05T18:56:08.603137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T01:08:13.156892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"21'1","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-05T18:56:17.235254+0000","last_change":"2023-07-05T18:56:14.693939+0000","last_active":"2023-07-05T18:56:17.235254+0000","last_peered":"2023-07-05T18:56:17.235254+0000","last_clean":"2023-07-05T18:56:17.235254+0000","last_became_active":"2023-07-05T18:56:14.693663+0000","last_became_peered":"2023-07-05T18:56:14.693663+0000","last_unstale":"2023-07-05T18:56:17.235254+0000","last_undegraded":"2023-07-05T18:56:17.235254+0000","last_fullsized":"2023-07-05T18:56:17.235254+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T18:56:13.659893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T18:56:13.659893+0000","last_clean_scrub_stamp":"2023-07-05T18:56:13.659893+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T02:23:51.872222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-05T18:56:17.658492+0000","last_change":"2023-07-05T18:56:15.127817+0000","last_active":"2023-07-05T18:56:17.658492+0000","last_peered":"2023-07-05T18:56:17.658492+0000","last_clean":"2023-07-05T18:56:17.658492+0000","last_became_active":"2023-07-05T18:56:15.127512+0000","last_became_peered":"2023-07-05T18:56:15.127512+0000","last_unstale":"2023-07-05T18:56:17.658492+0000","last_undegraded":"2023-07-05T18:56:17.658492+0000","last_fullsized":"2023-07-05T18:56:17.658492+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T18:56:14.665171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T18:56:14.665171+0000","last_clean_scrub_stamp":"2023-07-05T18:56:14.665171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T01:36:00.101790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":19,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-05T18:56:17.190599+0000","last_change":"2023-07-05T18:56:09.617992+0000","last_active":"2023-07-05T18:56:17.190599+0000","last_peered":"2023-07-05T18:56:17.190599+0000","last_clean":"2023-07-05T18:56:17.190599+0000","last_became_active":"2023-07-05T18:56:09.617720+0000","last_became_peered":"2023-07-05T18:56:09.617720+0000","last_unstale":"2023-07-05T18:56:17.190599+0000","last_undegraded":"2023-07-05T18:56:17.190599+0000","last_fullsized":"2023-07-05T18:56:17.190599+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T18:56:08.603137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T18:56:08.603137+0000","last_clean_scrub_stamp":"2023-07-05T18:56:08.603137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-06T19:43:22.646788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"17'117","reported_seq":169,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-05T18:56:17.158224+0000","last_change":"2023-07-05T18:56:09.621746+0000","last_active":"2023-07-05T18:56:17.158224+0000","last_peered":"2023-07-05T18:56:17.158224+0000","last_clean":"2023-07-05T18:56:17.158224+0000","last_became_active":"2023-07-05T18:56:09.621421+0000","last_became_peered":"2023-07-05T18:56:09.621421+0000","last_unstale":"2023-07-05T18:56:17.158224+0000","last_undegraded":"2023-07-05T18:56:17.158224+0000","last_fullsized":"2023-07-05T18:56:17.158224+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T18:56:08.603137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T18:56:08.603137+0000","last_clean_scrub_stamp":"2023-07-05T18:56:08.603137+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T05:47:45.605092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-05T18:56:16.474394+0000","last_change":"2023-07-05T18:56:14.688968+0000","last_active":"2023-07-05T18:56:16.474394+0000","last_peered":"2023-07-05T18:56:16.474394+0000","last_clean":"2023-07-05T18:56:16.474394+0000","last_became_active":"2023-07-05T18:56:14.688664+0000","last_became_peered":"2023-07-05T18:56:14.688664+0000","last_unstale":"2023-07-05T18:56:16.474394+0000","last_undegraded":"2023-07-05T18:56:16.474394+0000","last_fullsized":"2023-07-05T18:56:16.474394+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T18:56:13.659893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T18:56:13.659893+0000","last_clean_scrub_stamp":"2023-07-05T18:56:13.659893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T02:13:18.224321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-05T18:56:16.474255+0000","last_change":"2023-07-05T18:56:15.121025+0000","last_active":"2023-07-05T18:56:16.474255+0000","last_peered":"2023-07-05T18:56:16.474255+0000","last_clean":"2023-07-05T18:56:16.474255+0000","last_became_active":"2023-07-05T18:56:15.120768+0000","last_became_peered":"2023-07-05T18:56:15.120768+0000","last_unstale":"2023-07-05T18:56:16.474255+0000","last_undegraded":"2023-07-05T18:56:16.474255+0000","last_fullsized":"2023-07-05T18:56:16.474255+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T18:56:14.665171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T18:56:14.665171+0000","last_clean_scrub_stamp":"2023-07-05T18:56:14.665171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-06T22:32:11.493711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":19,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-05T18:56:17.158181+0000","last_change":"2023-07-05T18:56:10.073940+0000","last_active":"2023-07-05T18:56:17.158181+0000","last_peered":"2023-07-05T18:56:17.158181+0000","last_clean":"2023-07-05T18:56:17.158181+0000","last_became_active":"2023-07-05T18:56:10.073617+0000","last_became_peered":"2023-07-05T18:56:10.073617+0000","last_unstale":"2023-07-05T18:56:17.158181+0000","last_undegraded":"2023-07-05T18:56:17.158181+0000","last_fullsized":"2023-07-05T18:56:17.158181+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T18:56:08.603137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T18:56:08.603137+0000","last_clean_scrub_stamp":"2023-07-05T18:56:08.603137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T02:23:46.815465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-05T18:56:17.190477+0000","last_change":"2023-07-05T18:56:14.694860+0000","last_active":"2023-07-05T18:56:17.190477+0000","last_peered":"2023-07-05T18:56:17.190477+0000","last_clean":"2023-07-05T18:56:17.190477+0000","last_became_active":"2023-07-05T18:56:14.694544+0000","last_became_peered":"2023-07-05T18:56:14.694544+0000","last_unstale":"2023-07-05T18:56:17.190477+0000","last_undegraded":"2023-07-05T18:56:17.190477+0000","last_fullsized":"2023-07-05T18:56:17.190477+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T18:56:13.659893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T18:56:13.659893+0000","last_clean_scrub_stamp":"2023-07-05T18:56:13.659893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-06T23:52:21.769984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-05T18:56:17.191246+0000","last_change":"2023-07-05T18:56:15.118635+0000","last_active":"2023-07-05T18:56:17.191246+0000","last_peered":"2023-07-05T18:56:17.191246+0000","last_clean":"2023-07-05T18:56:17.191246+0000","last_became_active":"2023-07-05T18:56:15.115781+0000","last_became_peered":"2023-07-05T18:56:15.115781+0000","last_unstale":"2023-07-05T18:56:17.191246+0000","last_undegraded":"2023-07-05T18:56:17.191246+0000","last_fullsized":"2023-07-05T18:56:17.191246+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T18:56:14.665171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T18:56:14.665171+0000","last_clean_scrub_stamp":"2023-07-05T18:56:14.665171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T03:08:48.441898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":19,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-05T18:56:17.158048+0000","last_change":"2023-07-05T18:56:10.073658+0000","last_active":"2023-07-05T18:56:17.158048+0000","last_peered":"2023-07-05T18:56:17.158048+0000","last_clean":"2023-07-05T18:56:17.158048+0000","last_became_active":"2023-07-05T18:56:10.073336+0000","last_became_peered":"2023-07-05T18:56:10.073336+0000","last_unstale":"2023-07-05T18:56:17.158048+0000","last_undegraded":"2023-07-05T18:56:17.158048+0000","last_fullsized":"2023-07-05T18:56:17.158048+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T18:56:08.603137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T18:56:08.603137+0000","last_clean_scrub_stamp":"2023-07-05T18:56:08.603137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T01:35:54.039757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-05T18:56:16.104468+0000","last_change":"2023-07-05T18:56:14.684990+0000","last_active":"2023-07-05T18:56:16.104468+0000","last_peered":"2023-07-05T18:56:16.104468+0000","last_clean":"2023-07-05T18:56:16.104468+0000","last_became_active":"2023-07-05T18:56:14.684539+0000","last_became_peered":"2023-07-05T18:56:14.684539+0000","last_unstale":"2023-07-05T18:56:16.104468+0000","last_undegraded":"2023-07-05T18:56:16.104468+0000","last_fullsized":"2023-07-05T18:56:16.104468+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T18:56:13.659893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T18:56:13.659893+0000","last_clean_scrub_stamp":"2023-07-05T18:56:13.659893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T01:35:59.096513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-05T18:56:16.104626+0000","last_change":"2023-07-05T18:56:15.128949+0000","last_active":"2023-07-05T18:56:16.104626+0000","last_peered":"2023-07-05T18:56:16.104626+0000","last_clean":"2023-07-05T18:56:16.104626+0000","last_became_active":"2023-07-05T18:56:15.128650+0000","last_became_peered":"2023-07-05T18:56:15.128650+0000","last_unstale":"2023-07-05T18:56:16.104626+0000","last_undegraded":"2023-07-05T18:56:16.104626+0000","last_fullsized":"2023-07-05T18:56:16.104626+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T18:56:14.665171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T18:56:14.665171+0000","last_clean_scrub_stamp":"2023-07-05T18:56:14.665171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T04:53:59.163434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":19,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-05T18:56:16.105025+0000","last_change":"2023-07-05T18:56:10.073693+0000","last_active":"2023-07-05T18:56:16.105025+0000","last_peered":"2023-07-05T18:56:16.105025+0000","last_clean":"2023-07-05T18:56:16.105025+0000","last_became_active":"2023-07-05T18:56:10.073356+0000","last_became_peered":"2023-07-05T18:56:10.073356+0000","last_unstale":"2023-07-05T18:56:16.105025+0000","last_undegraded":"2023-07-05T18:56:16.105025+0000","last_fullsized":"2023-07-05T18:56:16.105025+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T18:56:08.603137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T18:56:08.603137+0000","last_clean_scrub_stamp":"2023-07-05T18:56:08.603137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T02:48:59.875595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-05T18:56:17.659009+0000","last_change":"2023-07-05T18:56:14.694026+0000","last_active":"2023-07-05T18:56:17.659009+0000","last_peered":"2023-07-05T18:56:17.659009+0000","last_clean":"2023-07-05T18:56:17.659009+0000","last_became_active":"2023-07-05T18:56:14.693684+0000","last_became_peered":"2023-07-05T18:56:14.693684+0000","last_unstale":"2023-07-05T18:56:17.659009+0000","last_undegraded":"2023-07-05T18:56:17.659009+0000","last_fullsized":"2023-07-05T18:56:17.659009+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T18:56:13.659893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T18:56:13.659893+0000","last_clean_scrub_stamp":"2023-07-05T18:56:13.659893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-06T23:47:47.938498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-05T18:56:17.191015+0000","last_change":"2023-07-05T18:56:15.109026+0000","last_active":"2023-07-05T18:56:17.191015+0000","last_peered":"2023-07-05T18:56:17.191015+0000","last_clean":"2023-07-05T18:56:17.191015+0000","last_became_active":"2023-07-05T18:56:15.108685+0000","last_became_peered":"2023-07-05T18:56:15.108685+0000","last_unstale":"2023-07-05T18:56:17.191015+0000","last_undegraded":"2023-07-05T18:56:17.191015+0000","last_fullsized":"2023-07-05T18:56:17.191015+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T18:56:14.665171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T18:56:14.665171+0000","last_clean_scrub_stamp":"2023-07-05T18:56:14.665171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-06T21:50:37.526388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":19,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-05T18:56:16.104315+0000","last_change":"2023-07-05T18:56:10.073639+0000","last_active":"2023-07-05T18:56:16.104315+0000","last_peered":"2023-07-05T18:56:16.104315+0000","last_clean":"2023-07-05T18:56:16.104315+0000","last_became_active":"2023-07-05T18:56:10.073339+0000","last_became_peered":"2023-07-05T18:56:10.073339+0000","last_unstale":"2023-07-05T18:56:16.104315+0000","last_undegraded":"2023-07-05T18:56:16.104315+0000","last_fullsized":"2023-07-05T18:56:16.104315+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T18:56:08.603137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T18:56:08.603137+0000","last_clean_scrub_stamp":"2023-07-05T18:56:08.603137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T02:48:59.875595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-05T18:56:17.191009+0000","last_change":"2023-07-05T18:56:14.695868+0000","last_active":"2023-07-05T18:56:17.191009+0000","last_peered":"2023-07-05T18:56:17.191009+0000","last_clean":"2023-07-05T18:56:17.191009+0000","last_became_active":"2023-07-05T18:56:14.695540+0000","last_became_peered":"2023-07-05T18:56:14.695540+0000","last_unstale":"2023-07-05T18:56:17.191009+0000","last_undegraded":"2023-07-05T18:56:17.191009+0000","last_fullsized":"2023-07-05T18:56:17.191009+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T18:56:13.659893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T18:56:13.659893+0000","last_clean_scrub_stamp":"2023-07-05T18:56:13.659893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T02:24:34.867804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-05T18:56:16.474258+0000","last_change":"2023-07-05T18:56:15.120478+0000","last_active":"2023-07-05T18:56:16.474258+0000","last_peered":"2023-07-05T18:56:16.474258+0000","last_clean":"2023-07-05T18:56:16.474258+0000","last_became_active":"2023-07-05T18:56:15.120038+0000","last_became_peered":"2023-07-05T18:56:15.120038+0000","last_unstale":"2023-07-05T18:56:16.474258+0000","last_undegraded":"2023-07-05T18:56:16.474258+0000","last_fullsized":"2023-07-05T18:56:16.474258+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T18:56:14.665171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T18:56:14.665171+0000","last_clean_scrub_stamp":"2023-07-05T18:56:14.665171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T04:53:59.163434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":19,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-05T18:56:16.104808+0000","last_change":"2023-07-05T18:56:09.619299+0000","last_active":"2023-07-05T18:56:16.104808+0000","last_peered":"2023-07-05T18:56:16.104808+0000","last_clean":"2023-07-05T18:56:16.104808+0000","last_became_active":"2023-07-05T18:56:09.618958+0000","last_became_peered":"2023-07-05T18:56:09.618958+0000","last_unstale":"2023-07-05T18:56:16.104808+0000","last_undegraded":"2023-07-05T18:56:16.104808+0000","last_fullsized":"2023-07-05T18:56:16.104808+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T18:56:08.603137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T18:56:08.603137+0000","last_clean_scrub_stamp":"2023-07-05T18:56:08.603137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-06T21:50:31.464355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-05T18:56:16.105755+0000","last_change":"2023-07-05T18:56:14.684753+0000","last_active":"2023-07-05T18:56:16.105755+0000","last_peered":"2023-07-05T18:56:16.105755+0000","last_clean":"2023-07-05T18:56:16.105755+0000","last_became_active":"2023-07-05T18:56:14.684386+0000","last_became_peered":"2023-07-05T18:56:14.684386+0000","last_unstale":"2023-07-05T18:56:16.105755+0000","last_undegraded":"2023-07-05T18:56:16.105755+0000","last_fullsized":"2023-07-05T18:56:16.105755+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T18:56:13.659893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T18:56:13.659893+0000","last_clean_scrub_stamp":"2023-07-05T18:56:13.659893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T01:35:59.096513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-05T18:56:17.191032+0000","last_change":"2023-07-05T18:56:15.109419+0000","last_active":"2023-07-05T18:56:17.191032+0000","last_peered":"2023-07-05T18:56:17.191032+0000","last_clean":"2023-07-05T18:56:17.191032+0000","last_became_active":"2023-07-05T18:56:15.109114+0000","last_became_peered":"2023-07-05T18:56:15.109114+0000","last_unstale":"2023-07-05T18:56:17.191032+0000","last_undegraded":"2023-07-05T18:56:17.191032+0000","last_fullsized":"2023-07-05T18:56:17.191032+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T18:56:14.665171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T18:56:14.665171+0000","last_clean_scrub_stamp":"2023-07-05T18:56:14.665171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T03:19:04.962412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"20'1","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-05T18:56:16.474134+0000","last_change":"2023-07-05T18:56:14.693851+0000","last_active":"2023-07-05T18:56:16.474134+0000","last_peered":"2023-07-05T18:56:16.474134+0000","last_clean":"2023-07-05T18:56:16.474134+0000","last_became_active":"2023-07-05T18:56:14.693542+0000","last_became_peered":"2023-07-05T18:56:14.693542+0000","last_unstale":"2023-07-05T18:56:16.474134+0000","last_undegraded":"2023-07-05T18:56:16.474134+0000","last_fullsized":"2023-07-05T18:56:16.474134+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T18:56:13.659893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T18:56:13.659893+0000","last_clean_scrub_stamp":"2023-07-05T18:56:13.659893+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T03:19:03.957135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-05T18:56:17.658314+0000","last_change":"2023-07-05T18:56:15.103604+0000","last_active":"2023-07-05T18:56:17.658314+0000","last_peered":"2023-07-05T18:56:17.658314+0000","last_clean":"2023-07-05T18:56:17.658314+0000","last_became_active":"2023-07-05T18:56:15.103019+0000","last_became_peered":"2023-07-05T18:56:15.103019+0000","last_unstale":"2023-07-05T18:56:17.658314+0000","last_undegraded":"2023-07-05T18:56:17.658314+0000","last_fullsized":"2023-07-05T18:56:17.658314+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T18:56:14.665171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T18:56:14.665171+0000","last_clean_scrub_stamp":"2023-07-05T18:56:14.665171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T02:43:21.743318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"20'2","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-05T18:56:16.105517+0000","last_change":"2023-07-05T18:56:14.686203+0000","last_active":"2023-07-05T18:56:16.105517+0000","last_peered":"2023-07-05T18:56:16.105517+0000","last_clean":"2023-07-05T18:56:16.105517+0000","last_became_active":"2023-07-05T18:56:14.685948+0000","last_became_peered":"2023-07-05T18:56:14.685948+0000","last_unstale":"2023-07-05T18:56:16.105517+0000","last_undegraded":"2023-07-05T18:56:16.105517+0000","last_fullsized":"2023-07-05T18:56:16.105517+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T18:56:13.659893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T18:56:13.659893+0000","last_clean_scrub_stamp":"2023-07-05T18:56:13.659893+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T02:24:34.867804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-05T18:56:17.658649+0000","last_change":"2023-07-05T18:56:15.126615+0000","last_active":"2023-07-05T18:56:17.658649+0000","last_peered":"2023-07-05T18:56:17.658649+0000","last_clean":"2023-07-05T18:56:17.658649+0000","last_became_active":"2023-07-05T18:56:15.126354+0000","last_became_peered":"2023-07-05T18:56:15.126354+0000","last_unstale":"2023-07-05T18:56:17.658649+0000","last_undegraded":"2023-07-05T18:56:17.658649+0000","last_fullsized":"2023-07-05T18:56:17.658649+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T18:56:14.665171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T18:56:14.665171+0000","last_clean_scrub_stamp":"2023-07-05T18:56:14.665171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T02:23:52.877499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1d","version":"20'2","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-05T18:56:16.105769+0000","last_change":"2023-07-05T18:56:14.684691+0000","last_active":"2023-07-05T18:56:16.105769+0000","last_peered":"2023-07-05T18:56:16.105769+0000","last_clean":"2023-07-05T18:56:16.105769+0000","last_became_active":"2023-07-05T18:56:14.684098+0000","last_became_peered":"2023-07-05T18:56:14.684098+0000","last_unstale":"2023-07-05T18:56:16.105769+0000","last_undegraded":"2023-07-05T18:56:16.105769+0000","last_fullsized":"2023-07-05T18:56:16.105769+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T18:56:13.659893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T18:56:13.659893+0000","last_clean_scrub_stamp":"2023-07-05T18:56:13.659893+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T02:30:28.735569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-05T18:56:17.658893+0000","last_change":"2023-07-05T18:56:15.123781+0000","last_active":"2023-07-05T18:56:17.658893+0000","last_peered":"2023-07-05T18:56:17.658893+0000","last_clean":"2023-07-05T18:56:17.658893+0000","last_became_active":"2023-07-05T18:56:15.123062+0000","last_became_peered":"2023-07-05T18:56:15.123062+0000","last_unstale":"2023-07-05T18:56:17.658893+0000","last_undegraded":"2023-07-05T18:56:17.658893+0000","last_fullsized":"2023-07-05T18:56:17.658893+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T18:56:14.665171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T18:56:14.665171+0000","last_clean_scrub_stamp":"2023-07-05T18:56:14.665171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T00:22:01.891261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1e","version":"20'1","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-05T18:56:16.104884+0000","last_change":"2023-07-05T18:56:14.676047+0000","last_active":"2023-07-05T18:56:16.104884+0000","last_peered":"2023-07-05T18:56:16.104884+0000","last_clean":"2023-07-05T18:56:16.104884+0000","last_became_active":"2023-07-05T18:56:14.675717+0000","last_became_peered":"2023-07-05T18:56:14.675717+0000","last_unstale":"2023-07-05T18:56:16.104884+0000","last_undegraded":"2023-07-05T18:56:16.104884+0000","last_fullsized":"2023-07-05T18:56:16.104884+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T18:56:13.659893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T18:56:13.659893+0000","last_clean_scrub_stamp":"2023-07-05T18:56:13.659893+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T00:22:00.885983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-05T18:56:16.104536+0000","last_change":"2023-07-05T18:56:15.117463+0000","last_active":"2023-07-05T18:56:16.104536+0000","last_peered":"2023-07-05T18:56:16.104536+0000","last_clean":"2023-07-05T18:56:16.104536+0000","last_became_active":"2023-07-05T18:56:15.114489+0000","last_became_peered":"2023-07-05T18:56:15.114489+0000","last_unstale":"2023-07-05T18:56:16.104536+0000","last_undegraded":"2023-07-05T18:56:16.104536+0000","last_fullsized":"2023-07-05T18:56:16.104536+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T18:56:14.665171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T18:56:14.665171+0000","last_clean_scrub_stamp":"2023-07-05T18:56:14.665171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T02:30:29.740847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"20'4","reported_seq":17,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-05T18:56:16.474298+0000","last_change":"2023-07-05T18:56:14.689853+0000","last_active":"2023-07-05T18:56:16.474298+0000","last_peered":"2023-07-05T18:56:16.474298+0000","last_clean":"2023-07-05T18:56:16.474298+0000","last_became_active":"2023-07-05T18:56:14.689381+0000","last_became_peered":"2023-07-05T18:56:14.689381+0000","last_unstale":"2023-07-05T18:56:16.474298+0000","last_undegraded":"2023-07-05T18:56:16.474298+0000","last_fullsized":"2023-07-05T18:56:16.474298+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T18:56:13.659893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T18:56:13.659893+0000","last_clean_scrub_stamp":"2023-07-05T18:56:13.659893+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T02:30:28.735569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-05T18:56:17.658379+0000","last_change":"2023-07-05T18:56:15.123191+0000","last_active":"2023-07-05T18:56:17.658379+0000","last_peered":"2023-07-05T18:56:17.658379+0000","last_clean":"2023-07-05T18:56:17.658379+0000","last_became_active":"2023-07-05T18:56:15.122736+0000","last_became_peered":"2023-07-05T18:56:15.122736+0000","last_unstale":"2023-07-05T18:56:17.658379+0000","last_undegraded":"2023-07-05T18:56:17.658379+0000","last_fullsized":"2023-07-05T18:56:17.658379+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T18:56:14.665171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T18:56:14.665171+0000","last_clean_scrub_stamp":"2023-07-05T18:56:14.665171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T03:08:48.441898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-05T18:56:16.104533+0000","last_change":"2023-07-05T18:56:15.115767+0000","last_active":"2023-07-05T18:56:16.104533+0000","last_peered":"2023-07-05T18:56:16.104533+0000","last_clean":"2023-07-05T18:56:16.104533+0000","last_became_active":"2023-07-05T18:56:15.115052+0000","last_became_peered":"2023-07-05T18:56:15.115052+0000","last_unstale":"2023-07-05T18:56:16.104533+0000","last_undegraded":"2023-07-05T18:56:16.104533+0000","last_fullsized":"2023-07-05T18:56:16.104533+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T18:56:14.665171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T18:56:14.665171+0000","last_clean_scrub_stamp":"2023-07-05T18:56:14.665171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T05:13:27.636276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-05T18:56:16.104384+0000","last_change":"2023-07-05T18:56:15.112332+0000","last_active":"2023-07-05T18:56:16.104384+0000","last_peered":"2023-07-05T18:56:16.104384+0000","last_clean":"2023-07-05T18:56:16.104384+0000","last_became_active":"2023-07-05T18:56:15.112060+0000","last_became_peered":"2023-07-05T18:56:15.112060+0000","last_unstale":"2023-07-05T18:56:16.104384+0000","last_undegraded":"2023-07-05T18:56:16.104384+0000","last_fullsized":"2023-07-05T18:56:16.104384+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T18:56:14.665171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T18:56:14.665171+0000","last_clean_scrub_stamp":"2023-07-05T18:56:14.665171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T03:08:48.441898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-05T18:56:17.658512+0000","last_change":"2023-07-05T18:56:15.126220+0000","last_active":"2023-07-05T18:56:17.658512+0000","last_peered":"2023-07-05T18:56:17.658512+0000","last_clean":"2023-07-05T18:56:17.658512+0000","last_became_active":"2023-07-05T18:56:15.125927+0000","last_became_peered":"2023-07-05T18:56:15.125927+0000","last_unstale":"2023-07-05T18:56:17.658512+0000","last_undegraded":"2023-07-05T18:56:17.658512+0000","last_fullsized":"2023-07-05T18:56:17.658512+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T18:56:14.665171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T18:56:14.665171+0000","last_clean_scrub_stamp":"2023-07-05T18:56:14.665171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-06T21:14:58.040487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-05T18:56:16.104693+0000","last_change":"2023-07-05T18:56:15.118666+0000","last_active":"2023-07-05T18:56:16.104693+0000","last_peered":"2023-07-05T18:56:16.104693+0000","last_clean":"2023-07-05T18:56:16.104693+0000","last_became_active":"2023-07-05T18:56:15.116876+0000","last_became_peered":"2023-07-05T18:56:15.116876+0000","last_unstale":"2023-07-05T18:56:16.104693+0000","last_undegraded":"2023-07-05T18:56:16.104693+0000","last_fullsized":"2023-07-05T18:56:16.104693+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T18:56:14.665171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T18:56:14.665171+0000","last_clean_scrub_stamp":"2023-07-05T18:56:14.665171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T04:34:54.813133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-05T18:56:17.190834+0000","last_change":"2023-07-05T18:56:15.118889+0000","last_active":"2023-07-05T18:56:17.190834+0000","last_peered":"2023-07-05T18:56:17.190834+0000","last_clean":"2023-07-05T18:56:17.190834+0000","last_became_active":"2023-07-05T18:56:15.118609+0000","last_became_peered":"2023-07-05T18:56:15.118609+0000","last_unstale":"2023-07-05T18:56:17.190834+0000","last_undegraded":"2023-07-05T18:56:17.190834+0000","last_fullsized":"2023-07-05T18:56:17.190834+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T18:56:14.665171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T18:56:14.665171+0000","last_clean_scrub_stamp":"2023-07-05T18:56:14.665171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T02:49:05.937629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":8},{"poolid":2,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574854,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27772,"kb_used_data":820,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344068,"statfs":{"total":96636764160,"available":96608325632,"internally_reserved":0,"allocated":839680,"data_stored":671247,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1870000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.629}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.5429999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.5700000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.627}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56200000000000006}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53600000000000003}]}]},{"osd":6,"up_from":13,"seq":55834574856,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27164,"kb_used_data":212,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344676,"statfs":{"total":96636764160,"available":96608948224,"internally_reserved":0,"allocated":217088,"data_stored":79099,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39400000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56200000000000006}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60899999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":3.5499999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48999999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46600000000000003}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57399999999999995}]}]},{"osd":1,"up_from":13,"seq":55834574855,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27744,"kb_used_data":792,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344096,"statfs":{"total":96636764160,"available":96608354304,"internally_reserved":0,"allocated":811008,"data_stored":669467,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38100000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.32000000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42499999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.443}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61899999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46400000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60199999999999998}]}]},{"osd":0,"up_from":13,"seq":55834574855,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27168,"kb_used_data":216,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344672,"statfs":{"total":96636764160,"available":96608944128,"internally_reserved":0,"allocated":221184,"data_stored":79681,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53500000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.4950000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":4.1859999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76800000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.464}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64500000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.82399999999999995}]}]},{"osd":2,"up_from":13,"seq":55834574854,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27160,"kb_used_data":208,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344680,"statfs":{"total":96636764160,"available":96608952320,"internally_reserved":0,"allocated":212992,"data_stored":78138,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.23999999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.314}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.32200000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58799999999999997}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52500000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61199999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57599999999999996}]}]},{"osd":3,"up_from":13,"seq":55834574856,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27168,"kb_used_data":216,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344672,"statfs":{"total":96636764160,"available":96608944128,"internally_reserved":0,"allocated":221184,"data_stored":79189,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":12.015000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.387}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.5069999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83699999999999997}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.93200000000000005}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.484}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.995}]}]},{"osd":4,"up_from":13,"seq":55834574856,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27184,"kb_used_data":232,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344656,"statfs":{"total":96636764160,"available":96608927744,"internally_reserved":0,"allocated":237568,"data_stored":80719,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47799999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.501}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.43099999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61599999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55300000000000005}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54200000000000004}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52700000000000002}]}]},{"osd":5,"up_from":13,"seq":55834574855,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27172,"kb_used_data":220,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344668,"statfs":{"total":96636764160,"available":96608940032,"internally_reserved":0,"allocated":225280,"data_stored":79751,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.629}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64400000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51300000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57799999999999996}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.373}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.49199999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55300000000000005}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1620,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":652,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1780,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-07-05T18:56:24.626 INFO:tasks.ceph.ceph_manager.ceph:clean! 2023-07-05T18:56:24.626 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2023-07-05T18:56:24.626 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2023-07-05T18:56:24.627 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2023-07-05T18:56:24.784 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:24.781+0000 7fcf313a9700 1 Processor -- start 2023-07-05T18:56:24.784 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:24.781+0000 7fcf313a9700 1 -- start start 2023-07-05T18:56:24.784 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:24.781+0000 7fcf313a9700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fcf2c15a4a0 0x7fcf2c0b1fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:56:24.784 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:24.781+0000 7fcf313a9700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fcf2c0ce680 0x7fcf2c0ceb20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:56:24.785 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:24.781+0000 7fcf313a9700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fcf2c0aea30 0x7fcf2c0aee90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:56:24.785 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:24.781+0000 7fcf313a9700 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcf2c0cf060 con 0x7fcf2c0ce680 2023-07-05T18:56:24.785 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:24.781+0000 7fcf313a9700 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcf2c0673b0 con 0x7fcf2c0aea30 2023-07-05T18:56:24.785 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:24.781+0000 7fcf313a9700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcf2c0ad740 con 0x7fcf2c15a4a0 2023-07-05T18:56:24.785 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:24.781+0000 7fcf2a7fc700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fcf2c0ce680 0x7fcf2c0ceb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:56:24.785 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:24.782+0000 7fcf2a7fc700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fcf2c0ce680 0x7fcf2c0ceb20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:58230/0 (socket says 172.21.15.46:58230) 2023-07-05T18:56:24.785 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:24.782+0000 7fcf2a7fc700 1 -- 172.21.15.46:0/212420645 learned_addr learned my addr 172.21.15.46:0/212420645 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-07-05T18:56:24.786 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:24.782+0000 7fcf2b7fe700 1 --2- 172.21.15.46:0/212420645 >> v2:172.21.15.73:3300/0 conn(0x7fcf2c0aea30 0x7fcf2c0aee90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:56:24.786 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:24.782+0000 7fcf2affd700 1 --2- 172.21.15.46:0/212420645 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fcf2c15a4a0 0x7fcf2c0b1fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:56:24.786 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:24.782+0000 7fcf2a7fc700 1 -- 172.21.15.46:0/212420645 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fcf2c15a4a0 msgr2=0x7fcf2c0b1fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-05T18:56:24.786 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:24.782+0000 7fcf2a7fc700 1 --2- 172.21.15.46:0/212420645 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fcf2c15a4a0 0x7fcf2c0b1fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:24.786 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:24.782+0000 7fcf2a7fc700 1 -- 172.21.15.46:0/212420645 >> v2:172.21.15.73:3300/0 conn(0x7fcf2c0aea30 msgr2=0x7fcf2c0aee90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-05T18:56:24.786 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:24.782+0000 7fcf2a7fc700 1 --2- 172.21.15.46:0/212420645 >> v2:172.21.15.73:3300/0 conn(0x7fcf2c0aea30 0x7fcf2c0aee90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:24.786 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:24.782+0000 7fcf2a7fc700 1 -- 172.21.15.46:0/212420645 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf2c0ad990 con 0x7fcf2c0ce680 2023-07-05T18:56:24.787 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:24.782+0000 7fcf2b7fe700 1 --2- 172.21.15.46:0/212420645 >> v2:172.21.15.73:3300/0 conn(0x7fcf2c0aea30 0x7fcf2c0aee90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-05T18:56:24.787 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:24.782+0000 7fcf2a7fc700 1 --2- 172.21.15.46:0/212420645 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fcf2c0ce680 0x7fcf2c0ceb20 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fcf2c09a4f0 tx=0x7fcf14009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8d9b8ef7892256d7 server_cookie=0 in_seq=0 out_seq=0 2023-07-05T18:56:24.787 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:24.782+0000 7fcf29ffb700 1 -- 172.21.15.46:0/212420645 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf1400b860 con 0x7fcf2c0ce680 2023-07-05T18:56:24.787 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:24.782+0000 7fcf29ffb700 1 -- 172.21.15.46:0/212420645 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcf1400b9c0 con 0x7fcf2c0ce680 2023-07-05T18:56:24.787 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:24.782+0000 7fcf29ffb700 1 -- 172.21.15.46:0/212420645 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf1400bd50 con 0x7fcf2c0ce680 2023-07-05T18:56:24.789 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:24.783+0000 7fcf313a9700 1 -- 172.21.15.46:0/212420645 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fcf2c0ce680 msgr2=0x7fcf2c0ceb20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:56:24.789 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:24.783+0000 7fcf313a9700 1 --2- 172.21.15.46:0/212420645 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fcf2c0ce680 0x7fcf2c0ceb20 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fcf2c09a4f0 tx=0x7fcf14009c00 comp rx=0 tx=0).stop 2023-07-05T18:56:24.790 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:24.783+0000 7fcf313a9700 1 -- 172.21.15.46:0/212420645 shutdown_connections 2023-07-05T18:56:24.790 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:24.783+0000 7fcf313a9700 1 --2- 172.21.15.46:0/212420645 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fcf2c15a4a0 0x7fcf2c0b1fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:24.790 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:24.783+0000 7fcf313a9700 1 --2- 172.21.15.46:0/212420645 >> v2:172.21.15.73:3300/0 conn(0x7fcf2c0aea30 0x7fcf2c0aee90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:24.790 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:24.783+0000 7fcf313a9700 1 --2- 172.21.15.46:0/212420645 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fcf2c0ce680 0x7fcf2c0ceb20 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:24.790 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:24.783+0000 7fcf313a9700 1 -- 172.21.15.46:0/212420645 >> 172.21.15.46:0/212420645 conn(0x7fcf2c099de0 msgr2=0x7fcf2c0d0ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-05T18:56:24.790 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:24.783+0000 7fcf313a9700 1 -- 172.21.15.46:0/212420645 shutdown_connections 2023-07-05T18:56:24.790 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:24.783+0000 7fcf313a9700 1 -- 172.21.15.46:0/212420645 wait complete. 2023-07-05T18:56:24.791 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:24.784+0000 7fcf313a9700 1 Processor -- start 2023-07-05T18:56:24.791 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:24.785+0000 7fcf313a9700 1 -- start start 2023-07-05T18:56:24.791 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:24.785+0000 7fcf313a9700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fcf2c0aea30 0x7fcf2c09a850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:56:24.791 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:24.785+0000 7fcf313a9700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fcf2c0ce680 0x7fcf2c09e140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:56:24.791 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:24.785+0000 7fcf313a9700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fcf2c15a4a0 0x7fcf2c0cd3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:56:24.791 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:24.785+0000 7fcf313a9700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf2c09ba40 con 0x7fcf2c0ce680 2023-07-05T18:56:24.791 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:24.785+0000 7fcf313a9700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf2c09ae30 con 0x7fcf2c15a4a0 2023-07-05T18:56:24.792 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:24.785+0000 7fcf313a9700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcf2c09b110 con 0x7fcf2c0aea30 2023-07-05T18:56:24.792 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:24.786+0000 7fcf2a7fc700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fcf2c0ce680 0x7fcf2c09e140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:56:24.792 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:24.786+0000 7fcf2a7fc700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fcf2c0ce680 0x7fcf2c09e140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:58236/0 (socket says 172.21.15.46:58236) 2023-07-05T18:56:24.792 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:24.786+0000 7fcf2a7fc700 1 -- 172.21.15.46:0/178740622 learned_addr learned my addr 172.21.15.46:0/178740622 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-07-05T18:56:24.792 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:24.786+0000 7fcf2affd700 1 --2- 172.21.15.46:0/178740622 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fcf2c0aea30 0x7fcf2c09a850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:56:24.793 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:24.786+0000 7fcf2b7fe700 1 --2- 172.21.15.46:0/178740622 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fcf2c15a4a0 0x7fcf2c0cd3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:56:24.793 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:24.786+0000 7fcf2a7fc700 1 -- 172.21.15.46:0/178740622 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fcf2c0aea30 msgr2=0x7fcf2c09a850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:56:24.793 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:24.786+0000 7fcf2a7fc700 1 --2- 172.21.15.46:0/178740622 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fcf2c0aea30 0x7fcf2c09a850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:24.793 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:24.786+0000 7fcf2a7fc700 1 -- 172.21.15.46:0/178740622 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fcf2c15a4a0 msgr2=0x7fcf2c0cd3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:56:24.793 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:24.786+0000 7fcf2a7fc700 1 --2- 172.21.15.46:0/178740622 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fcf2c15a4a0 0x7fcf2c0cd3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:24.794 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:24.786+0000 7fcf2a7fc700 1 -- 172.21.15.46:0/178740622 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf14009550 con 0x7fcf2c0ce680 2023-07-05T18:56:24.794 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:24.786+0000 7fcf2a7fc700 1 --2- 172.21.15.46:0/178740622 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fcf2c0ce680 0x7fcf2c09e140 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fcf14009130 tx=0x7fcf14004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-05T18:56:24.794 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:24.786+0000 7fcf237fe700 1 -- 172.21.15.46:0/178740622 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf14004450 con 0x7fcf2c0ce680 2023-07-05T18:56:24.794 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:24.786+0000 7fcf237fe700 1 -- 172.21.15.46:0/178740622 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcf1401e070 con 0x7fcf2c0ce680 2023-07-05T18:56:24.794 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:24.786+0000 7fcf237fe700 1 -- 172.21.15.46:0/178740622 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf140038c0 con 0x7fcf2c0ce680 2023-07-05T18:56:24.794 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:24.786+0000 7fcf313a9700 1 -- 172.21.15.46:0/178740622 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcf2c09b3f0 con 0x7fcf2c0ce680 2023-07-05T18:56:24.794 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:24.786+0000 7fcf313a9700 1 -- 172.21.15.46:0/178740622 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcf2c09e680 con 0x7fcf2c0ce680 2023-07-05T18:56:24.794 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:24.787+0000 7fcf313a9700 1 -- 172.21.15.46:0/178740622 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcf2c04e1d0 con 0x7fcf2c0ce680 2023-07-05T18:56:24.795 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:24.788+0000 7fcf237fe700 1 -- 172.21.15.46:0/178740622 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fcf14003a20 con 0x7fcf2c0ce680 2023-07-05T18:56:24.795 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:24.788+0000 7fcf237fe700 1 --2- 172.21.15.46:0/178740622 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7fcf0c06ace0 0x7fcf0c06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:56:24.796 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:24.788+0000 7fcf237fe700 1 -- 172.21.15.46:0/178740622 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fcf14020070 con 0x7fcf2c0ce680 2023-07-05T18:56:24.796 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:24.788+0000 7fcf2affd700 1 --2- 172.21.15.46:0/178740622 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7fcf0c06ace0 0x7fcf0c06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:56:24.796 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:24.789+0000 7fcf2affd700 1 --2- 172.21.15.46:0/178740622 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7fcf0c06ace0 0x7fcf0c06d190 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fcf1c006fd0 tx=0x7fcf1c008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-05T18:56:24.796 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:24.792+0000 7fcf237fe700 1 -- 172.21.15.46:0/178740622 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fcf14055870 con 0x7fcf2c0ce680 2023-07-05T18:56:25.038 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:25.035+0000 7fcf313a9700 1 -- 172.21.15.46:0/178740622 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7fcf2c0c4290 con 0x7fcf2c0ce680 2023-07-05T18:56:25.039 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:25.035+0000 7fcf237fe700 1 -- 172.21.15.46:0/178740622 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+46 (secure 0 0 0) 0x7fcf140045b0 con 0x7fcf2c0ce680 2023-07-05T18:56:25.039 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T18:56:25.040 INFO:teuthology.orchestra.run.smithi046.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2023-07-05T18:56:25.042 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:25.037+0000 7fcf313a9700 1 -- 172.21.15.46:0/178740622 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7fcf0c06ace0 msgr2=0x7fcf0c06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:56:25.042 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:25.037+0000 7fcf313a9700 1 --2- 172.21.15.46:0/178740622 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7fcf0c06ace0 0x7fcf0c06d190 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fcf1c006fd0 tx=0x7fcf1c008040 comp rx=0 tx=0).stop 2023-07-05T18:56:25.043 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:25.037+0000 7fcf313a9700 1 -- 172.21.15.46:0/178740622 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fcf2c0ce680 msgr2=0x7fcf2c09e140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:56:25.043 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:25.037+0000 7fcf313a9700 1 --2- 172.21.15.46:0/178740622 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fcf2c0ce680 0x7fcf2c09e140 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fcf14009130 tx=0x7fcf14004750 comp rx=0 tx=0).stop 2023-07-05T18:56:25.043 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:25.037+0000 7fcf313a9700 1 -- 172.21.15.46:0/178740622 shutdown_connections 2023-07-05T18:56:25.044 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:25.037+0000 7fcf313a9700 1 --2- 172.21.15.46:0/178740622 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7fcf0c06ace0 0x7fcf0c06d190 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:25.044 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:25.037+0000 7fcf313a9700 1 --2- 172.21.15.46:0/178740622 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fcf2c15a4a0 0x7fcf2c0cd3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:25.044 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:25.037+0000 7fcf313a9700 1 --2- 172.21.15.46:0/178740622 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fcf2c0aea30 0x7fcf2c09a850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:25.045 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:25.037+0000 7fcf313a9700 1 --2- 172.21.15.46:0/178740622 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fcf2c0ce680 0x7fcf2c09e140 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:25.045 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:25.037+0000 7fcf313a9700 1 -- 172.21.15.46:0/178740622 >> 172.21.15.46:0/178740622 conn(0x7fcf2c099de0 msgr2=0x7fcf2c1575b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-05T18:56:25.045 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:25.037+0000 7fcf313a9700 1 -- 172.21.15.46:0/178740622 shutdown_connections 2023-07-05T18:56:25.052 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:25.037+0000 7fcf313a9700 1 -- 172.21.15.46:0/178740622 wait complete. 2023-07-05T18:56:25.055 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2023-07-05T18:56:25.056 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-05T18:56:25.181 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:25.179+0000 7f757d4c1700 1 Processor -- start 2023-07-05T18:56:25.181 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:25.179+0000 7f757d4c1700 1 -- start start 2023-07-05T18:56:25.183 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:25.180+0000 7f757d4c1700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f757815c2f0 0x7f75780cd2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:56:25.183 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:25.180+0000 7f757d4c1700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f75780b5ae0 0x7f75780b5ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:56:25.183 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:25.180+0000 7f757d4c1700 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f75780cd8c0 con 0x7f757815c6c0 2023-07-05T18:56:25.183 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:25.180+0000 7f757d4c1700 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f75780d0990 con 0x7f757815c2f0 2023-07-05T18:56:25.183 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:25.180+0000 7f757d4c1700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f75780d0c70 con 0x7f75780b5ae0 2023-07-05T18:56:25.183 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:25.180+0000 7f75767fc700 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7f757815c6c0 0x7f757806c760 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:57514/0 (socket says 172.21.15.46:57514) 2023-07-05T18:56:25.184 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:25.180+0000 7f75767fc700 1 -- 172.21.15.46:0/514586560 learned_addr learned my addr 172.21.15.46:0/514586560 (peer_addr_for_me v1:172.21.15.46:0/0) 2023-07-05T18:56:25.184 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:25.180+0000 7f75777fe700 1 --2- 172.21.15.46:0/514586560 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f75780b5ae0 0x7f75780b5ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:56:25.184 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:25.180+0000 7f7576ffd700 1 --2- 172.21.15.46:0/514586560 >> v2:172.21.15.73:3300/0 conn(0x7f757815c2f0 0x7f75780cd2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:56:25.184 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:25.180+0000 7f7575ffb700 1 -- 172.21.15.46:0/514586560 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4053505969 0 0) 0x7f75780cd8c0 con 0x7f757815c6c0 2023-07-05T18:56:25.184 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:25.180+0000 7f7575ffb700 1 -- 172.21.15.46:0/514586560 --> v1:172.21.15.46:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f75600035b0 con 0x7f757815c6c0 2023-07-05T18:56:25.184 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:25.181+0000 7f75777fe700 1 -- 172.21.15.46:0/514586560 >> v2:172.21.15.73:3300/0 conn(0x7f757815c2f0 msgr2=0x7f75780cd2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-05T18:56:25.184 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:25.181+0000 7f75777fe700 1 --2- 172.21.15.46:0/514586560 >> v2:172.21.15.73:3300/0 conn(0x7f757815c2f0 0x7f75780cd2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:25.184 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:25.181+0000 7f75777fe700 1 -- 172.21.15.46:0/514586560 >> v1:172.21.15.46:6789/0 conn(0x7f757815c6c0 legacy=0x7f757806c760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:56:25.185 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:25.181+0000 7f75777fe700 1 -- 172.21.15.46:0/514586560 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f75780d0f50 con 0x7f75780b5ae0 2023-07-05T18:56:25.185 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:25.181+0000 7f75777fe700 1 --2- 172.21.15.46:0/514586560 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f75780b5ae0 0x7f75780b5ef0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f7570009d90 tx=0x7f757000b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a4fd2fc540a4545f server_cookie=0 in_seq=0 out_seq=0 2023-07-05T18:56:25.185 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:25.181+0000 7f7575ffb700 1 -- 172.21.15.46:0/514586560 <== mon.2 v2:172.21.15.73:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f757000e070 con 0x7f75780b5ae0 2023-07-05T18:56:25.185 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:25.181+0000 7f7575ffb700 1 -- 172.21.15.46:0/514586560 <== mon.2 v2:172.21.15.73:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f757000bb20 con 0x7f75780b5ae0 2023-07-05T18:56:25.185 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:25.181+0000 7f7575ffb700 1 -- 172.21.15.46:0/514586560 <== mon.2 v2:172.21.15.73:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f757000be90 con 0x7f75780b5ae0 2023-07-05T18:56:25.187 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:25.182+0000 7f757d4c1700 1 -- 172.21.15.46:0/514586560 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f75780b5ae0 msgr2=0x7f75780b5ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:56:25.187 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:25.182+0000 7f757d4c1700 1 --2- 172.21.15.46:0/514586560 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f75780b5ae0 0x7f75780b5ef0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f7570009d90 tx=0x7f757000b330 comp rx=0 tx=0).stop 2023-07-05T18:56:25.188 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:25.182+0000 7f757d4c1700 1 -- 172.21.15.46:0/514586560 shutdown_connections 2023-07-05T18:56:25.188 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:25.182+0000 7f757d4c1700 1 --2- 172.21.15.46:0/514586560 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f75780b5ae0 0x7f75780b5ef0 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:25.188 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:25.182+0000 7f757d4c1700 1 --2- 172.21.15.46:0/514586560 >> v2:172.21.15.73:3300/0 conn(0x7f757815c2f0 0x7f75780cd2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:25.188 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:25.182+0000 7f757d4c1700 1 -- 172.21.15.46:0/514586560 >> 172.21.15.46:0/514586560 conn(0x7f757806afa0 msgr2=0x7f75780cf710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-05T18:56:25.188 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:25.182+0000 7f757d4c1700 1 -- 172.21.15.46:0/514586560 shutdown_connections 2023-07-05T18:56:25.188 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:25.182+0000 7f757d4c1700 1 -- 172.21.15.46:0/514586560 wait complete. 2023-07-05T18:56:25.188 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:25.183+0000 7f757d4c1700 1 Processor -- start 2023-07-05T18:56:25.188 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:25.183+0000 7f757d4c1700 1 -- start start 2023-07-05T18:56:25.189 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:25.184+0000 7f757d4c1700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f75780b5ae0 0x7f7578155110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:56:25.189 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:25.184+0000 7f757d4c1700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f757815c2f0 0x7f75781f55f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:56:25.189 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:25.184+0000 7f757d4c1700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f757815c6c0 0x7f75781f2910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:56:25.189 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:25.184+0000 7f757d4c1700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7578155650 con 0x7f757815c2f0 2023-07-05T18:56:25.189 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:25.184+0000 7f757d4c1700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75781f5ed0 con 0x7f75780b5ae0 2023-07-05T18:56:25.189 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:25.184+0000 7f757d4c1700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f75781f61b0 con 0x7f757815c6c0 2023-07-05T18:56:25.189 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:25.184+0000 7f75767fc700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f757815c2f0 0x7f75781f55f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:56:25.190 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:25.185+0000 7f75767fc700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f757815c2f0 0x7f75781f55f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:58250/0 (socket says 172.21.15.46:58250) 2023-07-05T18:56:25.190 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:25.185+0000 7f75767fc700 1 -- 172.21.15.46:0/1381185487 learned_addr learned my addr 172.21.15.46:0/1381185487 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-07-05T18:56:25.190 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:25.185+0000 7f7576ffd700 1 --2- 172.21.15.46:0/1381185487 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f75780b5ae0 0x7f7578155110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:56:25.190 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:25.185+0000 7f75777fe700 1 --2- 172.21.15.46:0/1381185487 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f757815c6c0 0x7f75781f2910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:56:25.190 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:25.185+0000 7f75767fc700 1 -- 172.21.15.46:0/1381185487 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f757815c6c0 msgr2=0x7f75781f2910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:56:25.190 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:25.185+0000 7f75767fc700 1 --2- 172.21.15.46:0/1381185487 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f757815c6c0 0x7f75781f2910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:25.190 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:25.185+0000 7f75767fc700 1 -- 172.21.15.46:0/1381185487 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f75780b5ae0 msgr2=0x7f7578155110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:56:25.190 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:25.185+0000 7f75767fc700 1 --2- 172.21.15.46:0/1381185487 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f75780b5ae0 0x7f7578155110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:25.191 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:25.185+0000 7f75767fc700 1 -- 172.21.15.46:0/1381185487 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7570009a70 con 0x7f757815c2f0 2023-07-05T18:56:25.191 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:25.185+0000 7f7576ffd700 1 --2- 172.21.15.46:0/1381185487 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f75780b5ae0 0x7f7578155110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-05T18:56:25.191 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:25.185+0000 7f75767fc700 1 --2- 172.21.15.46:0/1381185487 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f757815c2f0 0x7f75781f55f0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f756c00c400 tx=0x7f756c00c710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-05T18:56:25.191 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:25.185+0000 7f755f7fe700 1 -- 172.21.15.46:0/1381185487 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f756c005d70 con 0x7f757815c2f0 2023-07-05T18:56:25.191 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:25.185+0000 7f755f7fe700 1 -- 172.21.15.46:0/1381185487 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f756c00ce10 con 0x7f757815c2f0 2023-07-05T18:56:25.191 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:25.185+0000 7f757d4c1700 1 -- 172.21.15.46:0/1381185487 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f75781f6490 con 0x7f757815c2f0 2023-07-05T18:56:25.191 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:25.185+0000 7f755f7fe700 1 -- 172.21.15.46:0/1381185487 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f756c007310 con 0x7f757815c2f0 2023-07-05T18:56:25.192 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:25.185+0000 7f757d4c1700 1 -- 172.21.15.46:0/1381185487 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f75781f23f0 con 0x7f757815c2f0 2023-07-05T18:56:25.192 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:25.186+0000 7f757d4c1700 1 -- 172.21.15.46:0/1381185487 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f757804e1d0 con 0x7f757815c2f0 2023-07-05T18:56:25.192 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:25.187+0000 7f755f7fe700 1 -- 172.21.15.46:0/1381185487 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f756c007470 con 0x7f757815c2f0 2023-07-05T18:56:25.193 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:25.187+0000 7f755f7fe700 1 --2- 172.21.15.46:0/1381185487 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7f756406ace0 0x7f756406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:56:25.193 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:25.187+0000 7f755f7fe700 1 -- 172.21.15.46:0/1381185487 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f756c0887e0 con 0x7f757815c2f0 2023-07-05T18:56:25.193 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:25.187+0000 7f7576ffd700 1 --2- 172.21.15.46:0/1381185487 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7f756406ace0 0x7f756406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:56:25.193 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:25.187+0000 7f7576ffd700 1 --2- 172.21.15.46:0/1381185487 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7f756406ace0 0x7f756406d190 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f7578153e90 tx=0x7f7568009210 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-05T18:56:25.193 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:25.191+0000 7f755f7fe700 1 -- 172.21.15.46:0/1381185487 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f756c053950 con 0x7f757815c2f0 2023-07-05T18:56:25.392 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:25.391+0000 7f757d4c1700 1 -- 172.21.15.46:0/1381185487 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f75780d0130 con 0x7f757815c2f0 2023-07-05T18:56:25.393 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:25.392+0000 7f755f7fe700 1 -- 172.21.15.46:0/1381185487 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) v1 ==== 74+0+18161 (secure 0 0 0) 0x7f756c056f70 con 0x7f757815c2f0 2023-07-05T18:56:25.394 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T18:56:25.394 INFO:teuthology.orchestra.run.smithi046.stdout:{"epoch":21,"fsid":"042652d3-d80c-4ad8-9366-3e94f2a0a512","created":"2023-07-05T18:55:56.455710+0000","modified":"2023-07-05T18:56:16.095672+0000","last_up_change":"2023-07-05T18:56:06.594022+0000","last_in_change":"2023-07-05T18:55:58.879340+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-07-05T18:56:07.729620+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2023-07-05T18:56:08.128122+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-07-05T18:56:12.954625+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-07-05T18:56:14.068396+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"20009183-9a47-4392-8751-883f88d2bfb1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6813","nonce":4151971443},{"type":"v1","addr":"172.21.15.46:6815","nonce":4151971443}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6817","nonce":4151971443},{"type":"v1","addr":"172.21.15.46:6818","nonce":4151971443}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6822","nonce":4151971443},{"type":"v1","addr":"172.21.15.46:6823","nonce":4151971443}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6820","nonce":4151971443},{"type":"v1","addr":"172.21.15.46:6821","nonce":4151971443}]},"public_addr":"172.21.15.46:6815/4151971443","cluster_addr":"172.21.15.46:6818/4151971443","heartbeat_back_addr":"172.21.15.46:6823/4151971443","heartbeat_front_addr":"172.21.15.46:6821/4151971443","state":["exists","up"]},{"osd":1,"uuid":"91b4a7b0-e4e4-4888-a1fe-9edb0d68004c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6808","nonce":502575881},{"type":"v1","addr":"172.21.15.46:6809","nonce":502575881}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6810","nonce":502575881},{"type":"v1","addr":"172.21.15.46:6811","nonce":502575881}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6816","nonce":502575881},{"type":"v1","addr":"172.21.15.46:6819","nonce":502575881}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6812","nonce":502575881},{"type":"v1","addr":"172.21.15.46:6814","nonce":502575881}]},"public_addr":"172.21.15.46:6809/502575881","cluster_addr":"172.21.15.46:6811/502575881","heartbeat_back_addr":"172.21.15.46:6819/502575881","heartbeat_front_addr":"172.21.15.46:6814/502575881","state":["exists","up"]},{"osd":2,"uuid":"669ff744-1331-47c5-8579-0440731c889a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6800","nonce":2115251461},{"type":"v1","addr":"172.21.15.46:6801","nonce":2115251461}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6802","nonce":2115251461},{"type":"v1","addr":"172.21.15.46:6803","nonce":2115251461}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6806","nonce":2115251461},{"type":"v1","addr":"172.21.15.46:6807","nonce":2115251461}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6804","nonce":2115251461},{"type":"v1","addr":"172.21.15.46:6805","nonce":2115251461}]},"public_addr":"172.21.15.46:6801/2115251461","cluster_addr":"172.21.15.46:6803/2115251461","heartbeat_back_addr":"172.21.15.46:6807/2115251461","heartbeat_front_addr":"172.21.15.46:6805/2115251461","state":["exists","up"]},{"osd":3,"uuid":"34e1b86d-ffad-415d-861c-07a5f08068a6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6824","nonce":2981388766},{"type":"v1","addr":"172.21.15.46:6825","nonce":2981388766}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6826","nonce":2981388766},{"type":"v1","addr":"172.21.15.46:6827","nonce":2981388766}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6830","nonce":2981388766},{"type":"v1","addr":"172.21.15.46:6831","nonce":2981388766}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6828","nonce":2981388766},{"type":"v1","addr":"172.21.15.46:6829","nonce":2981388766}]},"public_addr":"172.21.15.46:6825/2981388766","cluster_addr":"172.21.15.46:6827/2981388766","heartbeat_back_addr":"172.21.15.46:6831/2981388766","heartbeat_front_addr":"172.21.15.46:6829/2981388766","state":["exists","up"]},{"osd":4,"uuid":"57ffcb91-c7dc-4a69-ae71-4d9622a14a05","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6800","nonce":2083655348},{"type":"v1","addr":"172.21.15.73:6801","nonce":2083655348}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6802","nonce":2083655348},{"type":"v1","addr":"172.21.15.73:6803","nonce":2083655348}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6806","nonce":2083655348},{"type":"v1","addr":"172.21.15.73:6807","nonce":2083655348}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6804","nonce":2083655348},{"type":"v1","addr":"172.21.15.73:6805","nonce":2083655348}]},"public_addr":"172.21.15.73:6801/2083655348","cluster_addr":"172.21.15.73:6803/2083655348","heartbeat_back_addr":"172.21.15.73:6807/2083655348","heartbeat_front_addr":"172.21.15.73:6805/2083655348","state":["exists","up"]},{"osd":5,"uuid":"665f41c9-ee20-49cf-bf0e-fbe0c03d3aed","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6824","nonce":2803788401},{"type":"v1","addr":"172.21.15.73:6825","nonce":2803788401}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6826","nonce":2803788401},{"type":"v1","addr":"172.21.15.73:6827","nonce":2803788401}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6830","nonce":2803788401},{"type":"v1","addr":"172.21.15.73:6831","nonce":2803788401}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6828","nonce":2803788401},{"type":"v1","addr":"172.21.15.73:6829","nonce":2803788401}]},"public_addr":"172.21.15.73:6825/2803788401","cluster_addr":"172.21.15.73:6827/2803788401","heartbeat_back_addr":"172.21.15.73:6831/2803788401","heartbeat_front_addr":"172.21.15.73:6829/2803788401","state":["exists","up"]},{"osd":6,"uuid":"5790c6cc-bd56-4ce4-9a7c-0f0c3b59215c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6808","nonce":974108383},{"type":"v1","addr":"172.21.15.73:6809","nonce":974108383}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6810","nonce":974108383},{"type":"v1","addr":"172.21.15.73:6811","nonce":974108383}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6815","nonce":974108383},{"type":"v1","addr":"172.21.15.73:6817","nonce":974108383}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6812","nonce":974108383},{"type":"v1","addr":"172.21.15.73:6813","nonce":974108383}]},"public_addr":"172.21.15.73:6809/974108383","cluster_addr":"172.21.15.73:6811/974108383","heartbeat_back_addr":"172.21.15.73:6817/974108383","heartbeat_front_addr":"172.21.15.73:6813/974108383","state":["exists","up"]},{"osd":7,"uuid":"b66f4d2e-147e-4c9b-97dd-cbd59d33802e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6814","nonce":3772673248},{"type":"v1","addr":"172.21.15.73:6816","nonce":3772673248}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6818","nonce":3772673248},{"type":"v1","addr":"172.21.15.73:6819","nonce":3772673248}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6822","nonce":3772673248},{"type":"v1","addr":"172.21.15.73:6823","nonce":3772673248}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6820","nonce":3772673248},{"type":"v1","addr":"172.21.15.73:6821","nonce":3772673248}]},"public_addr":"172.21.15.73:6816/3772673248","cluster_addr":"172.21.15.73:6819/3772673248","heartbeat_back_addr":"172.21.15.73:6823/3772673248","heartbeat_front_addr":"172.21.15.73:6821/3772673248","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-05T18:56:04.115334+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-05T18:56:04.071250+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-05T18:56:04.044387+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-05T18:56:04.085389+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-05T18:56:04.090726+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-05T18:56:04.074529+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-05T18:56:04.058841+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-05T18:56:04.043054+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-05T18:56:25.396 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:25.394+0000 7f757d4c1700 1 -- 172.21.15.46:0/1381185487 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7f756406ace0 msgr2=0x7f756406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:56:25.396 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:25.394+0000 7f757d4c1700 1 --2- 172.21.15.46:0/1381185487 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7f756406ace0 0x7f756406d190 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f7578153e90 tx=0x7f7568009210 comp rx=0 tx=0).stop 2023-07-05T18:56:25.396 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:25.394+0000 7f757d4c1700 1 -- 172.21.15.46:0/1381185487 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f757815c2f0 msgr2=0x7f75781f55f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:56:25.396 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:25.394+0000 7f757d4c1700 1 --2- 172.21.15.46:0/1381185487 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f757815c2f0 0x7f75781f55f0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f756c00c400 tx=0x7f756c00c710 comp rx=0 tx=0).stop 2023-07-05T18:56:25.396 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:25.394+0000 7f757d4c1700 1 -- 172.21.15.46:0/1381185487 shutdown_connections 2023-07-05T18:56:25.397 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:25.394+0000 7f757d4c1700 1 --2- 172.21.15.46:0/1381185487 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7f756406ace0 0x7f756406d190 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:25.397 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:25.394+0000 7f757d4c1700 1 --2- 172.21.15.46:0/1381185487 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f757815c6c0 0x7f75781f2910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:25.397 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:25.394+0000 7f757d4c1700 1 --2- 172.21.15.46:0/1381185487 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f75780b5ae0 0x7f7578155110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:25.397 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:25.394+0000 7f757d4c1700 1 --2- 172.21.15.46:0/1381185487 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f757815c2f0 0x7f75781f55f0 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:25.397 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:25.394+0000 7f757d4c1700 1 -- 172.21.15.46:0/1381185487 >> 172.21.15.46:0/1381185487 conn(0x7f757806afa0 msgr2=0x7f75780cf640 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-05T18:56:25.397 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:25.394+0000 7f757d4c1700 1 -- 172.21.15.46:0/1381185487 shutdown_connections 2023-07-05T18:56:25.397 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:25.394+0000 7f757d4c1700 1 -- 172.21.15.46:0/1381185487 wait complete. 2023-07-05T18:56:25.409 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'rbd', 'create_time': '2023-07-05T18:56:07.729620+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': '.mgr', 'create_time': '2023-07-05T18:56:08.128122+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-07-05T18:56:12.954625+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-07-05T18:56:14.068396+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-07-05T18:56:25.410 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-07-05T18:56:25.538 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:25.536+0000 7f9833d2f700 1 Processor -- start 2023-07-05T18:56:25.538 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:25.536+0000 7f9833d2f700 1 -- start start 2023-07-05T18:56:25.539 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:25.537+0000 7f9833d2f700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f982c0cb110 0x7f982c06b0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:56:25.539 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:25.537+0000 7f9833d2f700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f982c15a890 0x7f982c06bc90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:56:25.539 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:25.537+0000 7f9833d2f700 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f982c15e260 con 0x7f982c15ace0 2023-07-05T18:56:25.539 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:25.537+0000 7f9833d2f700 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f982c15ede0 con 0x7f982c15a890 2023-07-05T18:56:25.539 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:25.537+0000 7f9833d2f700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f982c15e540 con 0x7f982c0cb110 2023-07-05T18:56:25.540 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:25.537+0000 7f98312ca700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f982c15a890 0x7f982c06bc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:56:25.540 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:25.537+0000 7f9831acb700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f982c0cb110 0x7f982c06b0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:56:25.540 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:25.537+0000 7f98322cc700 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7f982c15ace0 0x7f982c06a1e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.46:43448/0 (socket says 172.21.15.46:43448) 2023-07-05T18:56:25.540 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:25.537+0000 7f98322cc700 1 -- 172.21.15.46:0/1640229940 learned_addr learned my addr 172.21.15.46:0/1640229940 (peer_addr_for_me v1:172.21.15.46:0/0) 2023-07-05T18:56:25.541 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:25.537+0000 7f9831acb700 1 -- 172.21.15.46:0/1640229940 >> v2:172.21.15.73:3300/0 conn(0x7f982c15a890 msgr2=0x7f982c06bc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-05T18:56:25.542 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:25.537+0000 7f9831acb700 1 --2- 172.21.15.46:0/1640229940 >> v2:172.21.15.73:3300/0 conn(0x7f982c15a890 0x7f982c06bc90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:25.542 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:25.537+0000 7f9831acb700 1 -- 172.21.15.46:0/1640229940 >> v1:172.21.15.73:6789/0 conn(0x7f982c15ace0 legacy=0x7f982c06a1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:56:25.542 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:25.537+0000 7f9831acb700 1 -- 172.21.15.46:0/1640229940 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f982c15e820 con 0x7f982c0cb110 2023-07-05T18:56:25.542 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:25.537+0000 7f98312ca700 1 --2- 172.21.15.46:0/1640229940 >> v2:172.21.15.73:3300/0 conn(0x7f982c15a890 0x7f982c06bc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-05T18:56:25.543 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:25.538+0000 7f9831acb700 1 --2- 172.21.15.46:0/1640229940 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f982c0cb110 0x7f982c06b0b0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f981c009840 tx=0x7f981c009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=933d0e834e15df16 server_cookie=0 in_seq=0 out_seq=0 2023-07-05T18:56:25.543 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:25.538+0000 7f9830ac9700 1 -- 172.21.15.46:0/1640229940 <== mon.2 v2:172.21.15.73:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f981c011830 con 0x7f982c0cb110 2023-07-05T18:56:25.543 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:25.538+0000 7f9830ac9700 1 -- 172.21.15.46:0/1640229940 <== mon.2 v2:172.21.15.73:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f981c011990 con 0x7f982c0cb110 2023-07-05T18:56:25.543 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:25.538+0000 7f9830ac9700 1 -- 172.21.15.46:0/1640229940 <== mon.2 v2:172.21.15.73:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f981c011d20 con 0x7f982c0cb110 2023-07-05T18:56:25.544 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:25.538+0000 7f9833d2f700 1 -- 172.21.15.46:0/1640229940 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f982c0cb110 msgr2=0x7f982c06b0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:56:25.544 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:25.538+0000 7f9833d2f700 1 --2- 172.21.15.46:0/1640229940 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f982c0cb110 0x7f982c06b0b0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f981c009840 tx=0x7f981c009b50 comp rx=0 tx=0).stop 2023-07-05T18:56:25.544 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:25.538+0000 7f9833d2f700 1 -- 172.21.15.46:0/1640229940 shutdown_connections 2023-07-05T18:56:25.545 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:25.538+0000 7f9833d2f700 1 --2- 172.21.15.46:0/1640229940 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f982c0cb110 0x7f982c06b0b0 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:25.545 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:25.538+0000 7f9833d2f700 1 --2- 172.21.15.46:0/1640229940 >> v2:172.21.15.73:3300/0 conn(0x7f982c15a890 0x7f982c06bc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:25.545 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:25.538+0000 7f9833d2f700 1 -- 172.21.15.46:0/1640229940 >> 172.21.15.46:0/1640229940 conn(0x7f982c0b19a0 msgr2=0x7f982c0cf1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-05T18:56:25.545 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:25.539+0000 7f9833d2f700 1 -- 172.21.15.46:0/1640229940 shutdown_connections 2023-07-05T18:56:25.546 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:25.539+0000 7f9833d2f700 1 -- 172.21.15.46:0/1640229940 wait complete. 2023-07-05T18:56:25.546 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:25.540+0000 7f9833d2f700 1 Processor -- start 2023-07-05T18:56:25.547 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:25.540+0000 7f9833d2f700 1 -- start start 2023-07-05T18:56:25.550 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:25.540+0000 7f9833d2f700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f982c0cb110 0x7f982c0af250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:56:25.550 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:25.540+0000 7f9833d2f700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f982c15a890 0x7f982c1f3df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:56:25.550 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:25.540+0000 7f9833d2f700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f982c15ace0 0x7f982c070f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:56:25.550 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:25.541+0000 7f9833d2f700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f982c1f4330 con 0x7f982c0cb110 2023-07-05T18:56:25.550 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:25.541+0000 7f9833d2f700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f982c0b2050 con 0x7f982c15ace0 2023-07-05T18:56:25.550 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:25.541+0000 7f9833d2f700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f982c0af910 con 0x7f982c15a890 2023-07-05T18:56:25.551 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:25.541+0000 7f9831acb700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f982c0cb110 0x7f982c0af250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:56:25.551 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:25.541+0000 7f9831acb700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f982c0cb110 0x7f982c0af250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:58262/0 (socket says 172.21.15.46:58262) 2023-07-05T18:56:25.551 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:25.541+0000 7f9831acb700 1 -- 172.21.15.46:0/1571070692 learned_addr learned my addr 172.21.15.46:0/1571070692 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-07-05T18:56:25.551 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:25.541+0000 7f98322cc700 1 --2- 172.21.15.46:0/1571070692 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f982c15ace0 0x7f982c070f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:56:25.551 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:25.541+0000 7f98312ca700 1 --2- 172.21.15.46:0/1571070692 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f982c15a890 0x7f982c1f3df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:56:25.551 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:25.541+0000 7f9831acb700 1 -- 172.21.15.46:0/1571070692 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f982c15a890 msgr2=0x7f982c1f3df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:56:25.551 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:25.541+0000 7f9831acb700 1 --2- 172.21.15.46:0/1571070692 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f982c15a890 0x7f982c1f3df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:25.552 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:25.541+0000 7f9831acb700 1 -- 172.21.15.46:0/1571070692 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f982c15ace0 msgr2=0x7f982c070f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:56:25.552 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:25.541+0000 7f9831acb700 1 --2- 172.21.15.46:0/1571070692 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f982c15ace0 0x7f982c070f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:25.552 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:25.541+0000 7f9831acb700 1 -- 172.21.15.46:0/1571070692 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f98280094a0 con 0x7f982c0cb110 2023-07-05T18:56:25.552 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:25.541+0000 7f9831acb700 1 --2- 172.21.15.46:0/1571070692 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f982c0cb110 0x7f982c0af250 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f981c009fd0 tx=0x7f981c004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-05T18:56:25.553 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:25.541+0000 7f98227fc700 1 -- 172.21.15.46:0/1571070692 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f981c0036a0 con 0x7f982c0cb110 2023-07-05T18:56:25.553 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:25.541+0000 7f98227fc700 1 -- 172.21.15.46:0/1571070692 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f981c01e070 con 0x7f982c0cb110 2023-07-05T18:56:25.553 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:25.541+0000 7f9833d2f700 1 -- 172.21.15.46:0/1571070692 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f981c0094a0 con 0x7f982c0cb110 2023-07-05T18:56:25.553 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:25.541+0000 7f98227fc700 1 -- 172.21.15.46:0/1571070692 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f981c003a40 con 0x7f982c0cb110 2023-07-05T18:56:25.553 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:25.541+0000 7f9833d2f700 1 -- 172.21.15.46:0/1571070692 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f982c0afed0 con 0x7f982c0cb110 2023-07-05T18:56:25.553 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:25.542+0000 7f9833d2f700 1 -- 172.21.15.46:0/1571070692 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f982c0672e0 con 0x7f982c0cb110 2023-07-05T18:56:25.553 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:25.543+0000 7f98227fc700 1 -- 172.21.15.46:0/1571070692 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f981c003ba0 con 0x7f982c0cb110 2023-07-05T18:56:25.554 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:25.543+0000 7f98227fc700 1 --2- 172.21.15.46:0/1571070692 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7f981006ace0 0x7f981006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:56:25.554 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:25.543+0000 7f98227fc700 1 -- 172.21.15.46:0/1571070692 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f981c08a3f0 con 0x7f982c0cb110 2023-07-05T18:56:25.554 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:25.543+0000 7f98312ca700 1 --2- 172.21.15.46:0/1571070692 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7f981006ace0 0x7f981006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:56:25.554 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:25.544+0000 7f98312ca700 1 --2- 172.21.15.46:0/1571070692 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7f981006ace0 0x7f981006d190 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f982c0c5fc0 tx=0x7f9828009210 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-05T18:56:25.555 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:25.548+0000 7f98227fc700 1 -- 172.21.15.46:0/1571070692 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f981c055490 con 0x7f982c0cb110 2023-07-05T18:56:25.746 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:25.744+0000 7f9833d2f700 1 -- 172.21.15.46:0/1571070692 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f982c156340 con 0x7f982c0cb110 2023-07-05T18:56:25.747 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:25.745+0000 7f98227fc700 1 -- 172.21.15.46:0/1571070692 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v21) v1 ==== 92+0+10 (secure 0 0 0) 0x7f981c0200a0 con 0x7f982c0cb110 2023-07-05T18:56:25.747 INFO:teuthology.orchestra.run.smithi046.stdout:pg_num: 8 2023-07-05T18:56:25.749 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:25.747+0000 7f9833d2f700 1 -- 172.21.15.46:0/1571070692 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7f981006ace0 msgr2=0x7f981006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:56:25.750 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:25.747+0000 7f9833d2f700 1 --2- 172.21.15.46:0/1571070692 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7f981006ace0 0x7f981006d190 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f982c0c5fc0 tx=0x7f9828009210 comp rx=0 tx=0).stop 2023-07-05T18:56:25.750 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:25.747+0000 7f9833d2f700 1 -- 172.21.15.46:0/1571070692 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f982c0cb110 msgr2=0x7f982c0af250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:56:25.750 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:25.747+0000 7f9833d2f700 1 --2- 172.21.15.46:0/1571070692 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f982c0cb110 0x7f982c0af250 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f981c009fd0 tx=0x7f981c004750 comp rx=0 tx=0).stop 2023-07-05T18:56:25.750 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:25.747+0000 7f9833d2f700 1 -- 172.21.15.46:0/1571070692 shutdown_connections 2023-07-05T18:56:25.750 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:25.747+0000 7f9833d2f700 1 --2- 172.21.15.46:0/1571070692 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7f981006ace0 0x7f981006d190 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:25.750 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:25.747+0000 7f9833d2f700 1 --2- 172.21.15.46:0/1571070692 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f982c15ace0 0x7f982c070f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:25.751 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:25.747+0000 7f9833d2f700 1 --2- 172.21.15.46:0/1571070692 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f982c0cb110 0x7f982c0af250 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:25.751 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:25.747+0000 7f9833d2f700 1 --2- 172.21.15.46:0/1571070692 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f982c15a890 0x7f982c1f3df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:25.751 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:25.747+0000 7f9833d2f700 1 -- 172.21.15.46:0/1571070692 >> 172.21.15.46:0/1571070692 conn(0x7f982c0b19a0 msgr2=0x7f982c0c9fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-05T18:56:25.751 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:25.747+0000 7f9833d2f700 1 -- 172.21.15.46:0/1571070692 shutdown_connections 2023-07-05T18:56:25.751 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:25.747+0000 7f9833d2f700 1 -- 172.21.15.46:0/1571070692 wait complete. 2023-07-05T18:56:25.761 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-07-05T18:56:25.889 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:25.887+0000 7f7298b56700 1 Processor -- start 2023-07-05T18:56:25.890 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:25.887+0000 7f7298b56700 1 -- start start 2023-07-05T18:56:25.891 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:25.888+0000 7f7298b56700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f72940b1870 0x7f72940ca6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:56:25.891 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:25.888+0000 7f7298b56700 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f729415e040 con 0x7f72940b13f0 2023-07-05T18:56:25.891 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:25.888+0000 7f7298b56700 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f729415dbb0 con 0x7f72941594f0 2023-07-05T18:56:25.891 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:25.888+0000 7f7298b56700 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f72940ce200 con 0x7f72940b1870 2023-07-05T18:56:25.891 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:25.888+0000 7f7292d9d700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f72940b1870 0x7f72940ca6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:56:25.892 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:25.889+0000 7f7291d9b700 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7f72940b13f0 0x7f72940c9fc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:57542/0 (socket says 172.21.15.46:57542) 2023-07-05T18:56:25.892 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:25.889+0000 7f7291d9b700 1 -- 172.21.15.46:0/3092510306 learned_addr learned my addr 172.21.15.46:0/3092510306 (peer_addr_for_me v1:172.21.15.46:0/0) 2023-07-05T18:56:25.892 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:25.889+0000 7f7292d9d700 1 -- 172.21.15.46:0/3092510306 >> v1:172.21.15.73:6789/0 conn(0x7f72941594f0 legacy=0x7f72940cd690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-05T18:56:25.892 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:25.889+0000 7f7292d9d700 1 -- 172.21.15.46:0/3092510306 >> v1:172.21.15.46:6789/0 conn(0x7f72940b13f0 legacy=0x7f72940c9fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:56:25.892 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:25.889+0000 7f7292d9d700 1 -- 172.21.15.46:0/3092510306 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f72940cc1c0 con 0x7f72940b1870 2023-07-05T18:56:25.892 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:25.889+0000 7f729159a700 1 -- 172.21.15.46:0/3092510306 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 57129264 0 0) 0x7f729415e040 con 0x7f72940b13f0 2023-07-05T18:56:25.892 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:25.889+0000 7f7292d9d700 1 --2- 172.21.15.46:0/3092510306 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f72940b1870 0x7f72940ca6d0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f728c009d90 tx=0x7f728c00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e8bbd798e5a35e17 server_cookie=0 in_seq=0 out_seq=0 2023-07-05T18:56:25.892 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:25.889+0000 7f729159a700 1 -- 172.21.15.46:0/3092510306 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f728c00e070 con 0x7f72940b1870 2023-07-05T18:56:25.893 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:25.889+0000 7f729159a700 1 -- 172.21.15.46:0/3092510306 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f728c00bb90 con 0x7f72940b1870 2023-07-05T18:56:25.893 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:25.889+0000 7f729159a700 1 -- 172.21.15.46:0/3092510306 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f728c003a20 con 0x7f72940b1870 2023-07-05T18:56:25.895 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:25.890+0000 7f7298b56700 1 -- 172.21.15.46:0/3092510306 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f72940b1870 msgr2=0x7f72940ca6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:56:25.895 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:25.890+0000 7f7298b56700 1 --2- 172.21.15.46:0/3092510306 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f72940b1870 0x7f72940ca6d0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f728c009d90 tx=0x7f728c00b330 comp rx=0 tx=0).stop 2023-07-05T18:56:25.895 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:25.890+0000 7f7298b56700 1 -- 172.21.15.46:0/3092510306 shutdown_connections 2023-07-05T18:56:25.895 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:25.890+0000 7f7298b56700 1 --2- 172.21.15.46:0/3092510306 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f72940b1870 0x7f72940ca6d0 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:25.895 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:25.890+0000 7f7298b56700 1 -- 172.21.15.46:0/3092510306 >> 172.21.15.46:0/3092510306 conn(0x7f729406bba0 msgr2=0x7f72940cc3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-05T18:56:25.896 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:25.890+0000 7f7298b56700 1 -- 172.21.15.46:0/3092510306 shutdown_connections 2023-07-05T18:56:25.896 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:25.890+0000 7f7298b56700 1 -- 172.21.15.46:0/3092510306 wait complete. 2023-07-05T18:56:25.896 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:25.891+0000 7f7298b56700 1 Processor -- start 2023-07-05T18:56:25.896 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:25.891+0000 7f7298b56700 1 -- start start 2023-07-05T18:56:25.896 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:25.892+0000 7f7298b56700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f72940b13f0 0x7f729415cac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:56:25.896 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:25.892+0000 7f7298b56700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f72940b1870 0x7f72941e51d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:56:25.896 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:25.892+0000 7f7298b56700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f72941594f0 0x7f72940c54b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:56:25.897 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:25.892+0000 7f7298b56700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72940b3bc0 con 0x7f72940b13f0 2023-07-05T18:56:25.897 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:25.892+0000 7f7298b56700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72940b3890 con 0x7f72940b1870 2023-07-05T18:56:25.897 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:25.892+0000 7f7298b56700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f729415a450 con 0x7f72941594f0 2023-07-05T18:56:25.897 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:25.892+0000 7f729259c700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f72940b13f0 0x7f729415cac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:56:25.897 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:25.892+0000 7f729259c700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f72940b13f0 0x7f729415cac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:58276/0 (socket says 172.21.15.46:58276) 2023-07-05T18:56:25.897 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:25.892+0000 7f729259c700 1 -- 172.21.15.46:0/2339311782 learned_addr learned my addr 172.21.15.46:0/2339311782 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-07-05T18:56:25.897 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:25.892+0000 7f7291d9b700 1 --2- 172.21.15.46:0/2339311782 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f72940b1870 0x7f72941e51d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:56:25.897 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:25.892+0000 7f729259c700 1 -- 172.21.15.46:0/2339311782 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f72941594f0 msgr2=0x7f72940c54b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:56:25.898 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:25.892+0000 7f7292d9d700 1 --2- 172.21.15.46:0/2339311782 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f72941594f0 0x7f72940c54b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:56:25.898 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:25.892+0000 7f729259c700 1 --2- 172.21.15.46:0/2339311782 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f72941594f0 0x7f72940c54b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:25.898 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:25.892+0000 7f729259c700 1 -- 172.21.15.46:0/2339311782 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f72940b1870 msgr2=0x7f72941e51d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:56:25.899 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:25.892+0000 7f729259c700 1 --2- 172.21.15.46:0/2339311782 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f72940b1870 0x7f72941e51d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:25.899 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:25.892+0000 7f729259c700 1 -- 172.21.15.46:0/2339311782 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f728c009a70 con 0x7f72940b13f0 2023-07-05T18:56:25.899 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:25.892+0000 7f7291d9b700 1 --2- 172.21.15.46:0/2339311782 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f72940b1870 0x7f72941e51d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-05T18:56:25.899 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:25.893+0000 7f729259c700 1 --2- 172.21.15.46:0/2339311782 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f72940b13f0 0x7f729415cac0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f728800b4a0 tx=0x7f728800b860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-05T18:56:25.899 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:25.893+0000 7f7282ffd700 1 -- 172.21.15.46:0/2339311782 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7288011830 con 0x7f72940b13f0 2023-07-05T18:56:25.900 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:25.893+0000 7f7282ffd700 1 -- 172.21.15.46:0/2339311782 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7288011990 con 0x7f72940b13f0 2023-07-05T18:56:25.900 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:25.893+0000 7f7282ffd700 1 -- 172.21.15.46:0/2339311782 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7288011d40 con 0x7f72940b13f0 2023-07-05T18:56:25.900 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:25.893+0000 7f7298b56700 1 -- 172.21.15.46:0/2339311782 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f729415a730 con 0x7f72940b13f0 2023-07-05T18:56:25.900 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:25.893+0000 7f7298b56700 1 -- 172.21.15.46:0/2339311782 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f729415aa10 con 0x7f72940b13f0 2023-07-05T18:56:25.901 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:25.894+0000 7f7298b56700 1 -- 172.21.15.46:0/2339311782 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f729415d820 con 0x7f72940b13f0 2023-07-05T18:56:25.901 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:25.894+0000 7f7282ffd700 1 -- 172.21.15.46:0/2339311782 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f728801a400 con 0x7f72940b13f0 2023-07-05T18:56:25.902 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:25.895+0000 7f7282ffd700 1 --2- 172.21.15.46:0/2339311782 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7f727406ace0 0x7f727406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:56:25.902 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:25.895+0000 7f7282ffd700 1 -- 172.21.15.46:0/2339311782 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f72880894e0 con 0x7f72940b13f0 2023-07-05T18:56:25.902 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:25.895+0000 7f7291d9b700 1 --2- 172.21.15.46:0/2339311782 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7f727406ace0 0x7f727406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:56:25.902 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:25.895+0000 7f7291d9b700 1 --2- 172.21.15.46:0/2339311782 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7f727406ace0 0x7f727406d190 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f7294153120 tx=0x7f7284009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-05T18:56:25.902 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:25.899+0000 7f7282ffd700 1 -- 172.21.15.46:0/2339311782 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f729415d820 con 0x7f72940b13f0 2023-07-05T18:56:26.097 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:26.095+0000 7f7298b56700 1 -- 172.21.15.46:0/2339311782 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f729415d820 con 0x7f72940b13f0 2023-07-05T18:56:26.098 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:26.095+0000 7f7282ffd700 1 -- 172.21.15.46:0/2339311782 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v21) v1 ==== 93+0+10 (secure 0 0 0) 0x7f729415d820 con 0x7f72940b13f0 2023-07-05T18:56:26.098 INFO:teuthology.orchestra.run.smithi046.stdout:pg_num: 1 2023-07-05T18:56:26.100 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:26.097+0000 7f7298b56700 1 -- 172.21.15.46:0/2339311782 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7f727406ace0 msgr2=0x7f727406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:56:26.100 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:26.097+0000 7f7298b56700 1 --2- 172.21.15.46:0/2339311782 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7f727406ace0 0x7f727406d190 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f7294153120 tx=0x7f7284009040 comp rx=0 tx=0).stop 2023-07-05T18:56:26.100 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:26.097+0000 7f7298b56700 1 -- 172.21.15.46:0/2339311782 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f72940b13f0 msgr2=0x7f729415cac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:56:26.101 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:26.097+0000 7f7298b56700 1 --2- 172.21.15.46:0/2339311782 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f72940b13f0 0x7f729415cac0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f728800b4a0 tx=0x7f728800b860 comp rx=0 tx=0).stop 2023-07-05T18:56:26.101 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:26.097+0000 7f7298b56700 1 -- 172.21.15.46:0/2339311782 shutdown_connections 2023-07-05T18:56:26.102 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:26.097+0000 7f7298b56700 1 --2- 172.21.15.46:0/2339311782 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7f727406ace0 0x7f727406d190 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:26.102 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:26.097+0000 7f7298b56700 1 --2- 172.21.15.46:0/2339311782 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f72941594f0 0x7f72940c54b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:26.102 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:26.097+0000 7f7298b56700 1 --2- 172.21.15.46:0/2339311782 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f72940b13f0 0x7f729415cac0 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:26.102 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:26.097+0000 7f7298b56700 1 --2- 172.21.15.46:0/2339311782 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f72940b1870 0x7f72941e51d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:26.102 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:26.097+0000 7f7298b56700 1 -- 172.21.15.46:0/2339311782 >> 172.21.15.46:0/2339311782 conn(0x7f729406bba0 msgr2=0x7f7294153990 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-05T18:56:26.102 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:26.098+0000 7f7298b56700 1 -- 172.21.15.46:0/2339311782 shutdown_connections 2023-07-05T18:56:26.102 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:26.098+0000 7f7298b56700 1 -- 172.21.15.46:0/2339311782 wait complete. 2023-07-05T18:56:26.111 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-07-05T18:56:26.240 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:26.238+0000 7f8f68268700 1 Processor -- start 2023-07-05T18:56:26.240 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:26.238+0000 7f8f68268700 1 -- start start 2023-07-05T18:56:26.242 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:26.239+0000 7f8f68268700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f8f601594f0 0x7f8f600cd690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:56:26.243 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:26.239+0000 7f8f68268700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f8f600b1b00 0x7f8f600c9fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:56:26.243 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:26.239+0000 7f8f68268700 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8f6015e040 con 0x7f8f600cdbd0 2023-07-05T18:56:26.243 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:26.239+0000 7f8f68268700 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8f600ce200 con 0x7f8f600b1b00 2023-07-05T18:56:26.243 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:26.239+0000 7f8f68268700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8f6015dbb0 con 0x7f8f601594f0 2023-07-05T18:56:26.243 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:26.239+0000 7f8f65803700 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7f8f600cdbd0 0x7f8f600b13f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:57558/0 (socket says 172.21.15.46:57558) 2023-07-05T18:56:26.243 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:26.239+0000 7f8f65803700 1 -- 172.21.15.46:0/4092418855 learned_addr learned my addr 172.21.15.46:0/4092418855 (peer_addr_for_me v1:172.21.15.46:0/0) 2023-07-05T18:56:26.243 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:26.239+0000 7f8f66805700 1 --2- 172.21.15.46:0/4092418855 >> v2:172.21.15.73:3300/0 conn(0x7f8f600b1b00 0x7f8f600c9fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:56:26.244 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:26.239+0000 7f8f66004700 1 --2- 172.21.15.46:0/4092418855 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f8f601594f0 0x7f8f600cd690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:56:26.244 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:26.239+0000 7f8f65002700 1 -- 172.21.15.46:0/4092418855 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1427332264 0 0) 0x7f8f6015e040 con 0x7f8f600cdbd0 2023-07-05T18:56:26.244 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:26.239+0000 7f8f65002700 1 -- 172.21.15.46:0/4092418855 --> v1:172.21.15.46:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8f4c0035b0 con 0x7f8f600cdbd0 2023-07-05T18:56:26.245 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:26.240+0000 7f8f66004700 1 -- 172.21.15.46:0/4092418855 >> v2:172.21.15.73:3300/0 conn(0x7f8f600b1b00 msgr2=0x7f8f600c9fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-05T18:56:26.245 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:26.240+0000 7f8f66004700 1 --2- 172.21.15.46:0/4092418855 >> v2:172.21.15.73:3300/0 conn(0x7f8f600b1b00 0x7f8f600c9fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:26.245 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:26.240+0000 7f8f66004700 1 -- 172.21.15.46:0/4092418855 >> v1:172.21.15.46:6789/0 conn(0x7f8f600cdbd0 legacy=0x7f8f600b13f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:56:26.245 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:26.240+0000 7f8f65002700 1 -- 172.21.15.46:0/4092418855 <== mon.0 v1:172.21.15.46:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1801740963 0 0) 0x7f8f4c0035b0 con 0x7f8f600cdbd0 2023-07-05T18:56:26.245 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:26.240+0000 7f8f66004700 1 -- 172.21.15.46:0/4092418855 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8f600cc1c0 con 0x7f8f601594f0 2023-07-05T18:56:26.245 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:26.240+0000 7f8f66805700 1 --2- 172.21.15.46:0/4092418855 >> v2:172.21.15.73:3300/0 conn(0x7f8f600b1b00 0x7f8f600c9fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-05T18:56:26.245 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:26.240+0000 7f8f66004700 1 --2- 172.21.15.46:0/4092418855 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f8f601594f0 0x7f8f600cd690 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f8f5c009840 tx=0x7f8f5c009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5de2df8dbbfbaff3 server_cookie=0 in_seq=0 out_seq=0 2023-07-05T18:56:26.246 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:26.240+0000 7f8f65002700 1 -- 172.21.15.46:0/4092418855 <== mon.2 v2:172.21.15.73:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f50001690 con 0x7f8f601594f0 2023-07-05T18:56:26.246 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:26.240+0000 7f8f65002700 1 -- 172.21.15.46:0/4092418855 <== mon.2 v2:172.21.15.73:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8f5c004030 con 0x7f8f601594f0 2023-07-05T18:56:26.246 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:26.240+0000 7f8f65002700 1 -- 172.21.15.46:0/4092418855 <== mon.2 v2:172.21.15.73:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f5c0043c0 con 0x7f8f601594f0 2023-07-05T18:56:26.246 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:26.241+0000 7f8f68268700 1 -- 172.21.15.46:0/4092418855 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f8f601594f0 msgr2=0x7f8f600cd690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:56:26.246 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:26.241+0000 7f8f68268700 1 --2- 172.21.15.46:0/4092418855 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f8f601594f0 0x7f8f600cd690 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f8f5c009840 tx=0x7f8f5c009b50 comp rx=0 tx=0).stop 2023-07-05T18:56:26.246 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:26.241+0000 7f8f68268700 1 -- 172.21.15.46:0/4092418855 shutdown_connections 2023-07-05T18:56:26.247 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:26.241+0000 7f8f68268700 1 --2- 172.21.15.46:0/4092418855 >> v2:172.21.15.73:3300/0 conn(0x7f8f600b1b00 0x7f8f600c9fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:26.249 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:26.241+0000 7f8f68268700 1 --2- 172.21.15.46:0/4092418855 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f8f601594f0 0x7f8f600cd690 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:26.249 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:26.241+0000 7f8f68268700 1 -- 172.21.15.46:0/4092418855 >> 172.21.15.46:0/4092418855 conn(0x7f8f6006bba0 msgr2=0x7f8f600cc3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-05T18:56:26.249 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:26.241+0000 7f8f68268700 1 -- 172.21.15.46:0/4092418855 shutdown_connections 2023-07-05T18:56:26.249 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:26.241+0000 7f8f68268700 1 -- 172.21.15.46:0/4092418855 wait complete. 2023-07-05T18:56:26.251 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:26.242+0000 7f8f68268700 1 Processor -- start 2023-07-05T18:56:26.253 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:26.242+0000 7f8f68268700 1 -- start start 2023-07-05T18:56:26.253 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:26.243+0000 7f8f68268700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8f600b1b00 0x7f8f60154ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:56:26.253 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:26.243+0000 7f8f68268700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8f600cdbd0 0x7f8f60149eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:56:26.254 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:26.243+0000 7f8f68268700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f8f601594f0 0x7f8f6015b450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:56:26.254 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:26.243+0000 7f8f68268700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f600b3900 con 0x7f8f600b1b00 2023-07-05T18:56:26.254 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:26.243+0000 7f8f68268700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f6014a3f0 con 0x7f8f600cdbd0 2023-07-05T18:56:26.254 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:26.243+0000 7f8f68268700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8f600b2c80 con 0x7f8f601594f0 2023-07-05T18:56:26.254 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:26.243+0000 7f8f66004700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8f600b1b00 0x7f8f60154ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:56:26.254 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:26.243+0000 7f8f66004700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8f600b1b00 0x7f8f60154ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:58290/0 (socket says 172.21.15.46:58290) 2023-07-05T18:56:26.254 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:26.243+0000 7f8f66004700 1 -- 172.21.15.46:0/906324223 learned_addr learned my addr 172.21.15.46:0/906324223 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-07-05T18:56:26.255 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:26.243+0000 7f8f66805700 1 --2- 172.21.15.46:0/906324223 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f8f601594f0 0x7f8f6015b450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:56:26.255 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:26.243+0000 7f8f65803700 1 --2- 172.21.15.46:0/906324223 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8f600cdbd0 0x7f8f60149eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:56:26.255 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:26.243+0000 7f8f66004700 1 -- 172.21.15.46:0/906324223 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f8f601594f0 msgr2=0x7f8f6015b450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:56:26.255 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:26.243+0000 7f8f66004700 1 --2- 172.21.15.46:0/906324223 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f8f601594f0 0x7f8f6015b450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:26.255 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:26.243+0000 7f8f66004700 1 -- 172.21.15.46:0/906324223 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8f600cdbd0 msgr2=0x7f8f60149eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:56:26.255 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:26.243+0000 7f8f66004700 1 --2- 172.21.15.46:0/906324223 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8f600cdbd0 0x7f8f60149eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:26.255 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:26.243+0000 7f8f66004700 1 -- 172.21.15.46:0/906324223 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8f58009a70 con 0x7f8f600b1b00 2023-07-05T18:56:26.256 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:26.243+0000 7f8f66004700 1 --2- 172.21.15.46:0/906324223 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8f600b1b00 0x7f8f60154ff0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f8f5c0090b0 tx=0x7f8f5c004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-05T18:56:26.256 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:26.243+0000 7f8f56ffd700 1 -- 172.21.15.46:0/906324223 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f5c003cf0 con 0x7f8f600b1b00 2023-07-05T18:56:26.256 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:26.244+0000 7f8f56ffd700 1 -- 172.21.15.46:0/906324223 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8f5c01f070 con 0x7f8f600b1b00 2023-07-05T18:56:26.256 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:26.244+0000 7f8f68268700 1 -- 172.21.15.46:0/906324223 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8f5c0094a0 con 0x7f8f600b1b00 2023-07-05T18:56:26.256 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:26.244+0000 7f8f56ffd700 1 -- 172.21.15.46:0/906324223 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f5c011870 con 0x7f8f600b1b00 2023-07-05T18:56:26.256 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:26.244+0000 7f8f68268700 1 -- 172.21.15.46:0/906324223 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8f600b3240 con 0x7f8f600b1b00 2023-07-05T18:56:26.256 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:26.245+0000 7f8f68268700 1 -- 172.21.15.46:0/906324223 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8f600672e0 con 0x7f8f600b1b00 2023-07-05T18:56:26.257 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:26.245+0000 7f8f56ffd700 1 -- 172.21.15.46:0/906324223 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f8f5c0119d0 con 0x7f8f600b1b00 2023-07-05T18:56:26.257 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:26.245+0000 7f8f56ffd700 1 --2- 172.21.15.46:0/906324223 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7f8f4406ace0 0x7f8f4406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:56:26.257 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:26.245+0000 7f8f56ffd700 1 -- 172.21.15.46:0/906324223 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f8f5c021070 con 0x7f8f600b1b00 2023-07-05T18:56:26.258 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:26.246+0000 7f8f65803700 1 --2- 172.21.15.46:0/906324223 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7f8f4406ace0 0x7f8f4406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:56:26.258 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:26.246+0000 7f8f65803700 1 --2- 172.21.15.46:0/906324223 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7f8f4406ace0 0x7f8f4406d190 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f8f6015c5a0 tx=0x7f8f50001250 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-05T18:56:26.258 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:26.250+0000 7f8f56ffd700 1 -- 172.21.15.46:0/906324223 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f8f5c055a60 con 0x7f8f600b1b00 2023-07-05T18:56:26.451 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:26.449+0000 7f8f68268700 1 -- 172.21.15.46:0/906324223 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f8f600c5d70 con 0x7f8f600b1b00 2023-07-05T18:56:26.451 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:26.449+0000 7f8f56ffd700 1 -- 172.21.15.46:0/906324223 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v21) v1 ==== 104+0+11 (secure 0 0 0) 0x7f8f5c059080 con 0x7f8f600b1b00 2023-07-05T18:56:26.452 INFO:teuthology.orchestra.run.smithi046.stdout:pg_num: 32 2023-07-05T18:56:26.454 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:26.451+0000 7f8f68268700 1 -- 172.21.15.46:0/906324223 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7f8f4406ace0 msgr2=0x7f8f4406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:56:26.454 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:26.451+0000 7f8f68268700 1 --2- 172.21.15.46:0/906324223 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7f8f4406ace0 0x7f8f4406d190 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f8f6015c5a0 tx=0x7f8f50001250 comp rx=0 tx=0).stop 2023-07-05T18:56:26.454 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:26.451+0000 7f8f68268700 1 -- 172.21.15.46:0/906324223 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8f600b1b00 msgr2=0x7f8f60154ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:56:26.455 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:26.451+0000 7f8f68268700 1 --2- 172.21.15.46:0/906324223 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8f600b1b00 0x7f8f60154ff0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f8f5c0090b0 tx=0x7f8f5c004750 comp rx=0 tx=0).stop 2023-07-05T18:56:26.455 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:26.451+0000 7f8f68268700 1 -- 172.21.15.46:0/906324223 shutdown_connections 2023-07-05T18:56:26.455 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:26.451+0000 7f8f68268700 1 --2- 172.21.15.46:0/906324223 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7f8f4406ace0 0x7f8f4406d190 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:26.455 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:26.451+0000 7f8f68268700 1 --2- 172.21.15.46:0/906324223 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f8f601594f0 0x7f8f6015b450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:26.455 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:26.451+0000 7f8f68268700 1 --2- 172.21.15.46:0/906324223 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8f600b1b00 0x7f8f60154ff0 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:26.455 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:26.451+0000 7f8f68268700 1 --2- 172.21.15.46:0/906324223 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8f600cdbd0 0x7f8f60149eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:26.456 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:26.451+0000 7f8f68268700 1 -- 172.21.15.46:0/906324223 >> 172.21.15.46:0/906324223 conn(0x7f8f6006bba0 msgr2=0x7f8f600c5590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-05T18:56:26.456 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:26.452+0000 7f8f68268700 1 -- 172.21.15.46:0/906324223 shutdown_connections 2023-07-05T18:56:26.456 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:26.452+0000 7f8f68268700 1 -- 172.21.15.46:0/906324223 wait complete. 2023-07-05T18:56:26.466 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-07-05T18:56:26.594 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:26.592+0000 7fb99ca25700 1 Processor -- start 2023-07-05T18:56:26.595 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:26.593+0000 7fb99ca25700 1 -- start start 2023-07-05T18:56:26.597 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:26.593+0000 7fb99ca25700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fb9980af160 0x7fb9980d0a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:56:26.597 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:26.593+0000 7fb99ca25700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fb9980cf190 0x7fb9980b0f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:56:26.597 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:26.594+0000 7fb99ca25700 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb9980b0ae0 con 0x7fb9980af530 2023-07-05T18:56:26.597 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:26.594+0000 7fb99ca25700 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb9980d15f0 con 0x7fb9980cf190 2023-07-05T18:56:26.597 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:26.594+0000 7fb99ca25700 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb99815ab90 con 0x7fb9980af160 2023-07-05T18:56:26.597 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:26.594+0000 7fb996d9d700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fb9980cf190 0x7fb9980b0f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:56:26.598 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:26.594+0000 7fb996d9d700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fb9980cf190 0x7fb9980b0f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:58302/0 (socket says 172.21.15.46:58302) 2023-07-05T18:56:26.598 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:26.594+0000 7fb996d9d700 1 -- 172.21.15.46:0/3204706521 learned_addr learned my addr 172.21.15.46:0/3204706521 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-07-05T18:56:26.599 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:26.594+0000 7fb99659c700 1 --2- 172.21.15.46:0/3204706521 >> v2:172.21.15.73:3300/0 conn(0x7fb9980af160 0x7fb9980d0a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:56:26.599 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:26.594+0000 7fb996d9d700 1 -- 172.21.15.46:0/3204706521 >> v2:172.21.15.73:3300/0 conn(0x7fb9980af160 msgr2=0x7fb9980d0a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-05T18:56:26.599 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:26.594+0000 7fb996d9d700 1 --2- 172.21.15.46:0/3204706521 >> v2:172.21.15.73:3300/0 conn(0x7fb9980af160 0x7fb9980d0a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:26.599 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:26.594+0000 7fb996d9d700 1 -- 172.21.15.46:0/3204706521 >> v1:172.21.15.73:6789/0 conn(0x7fb9980af530 legacy=0x7fb9980cea80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:56:26.599 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:26.594+0000 7fb996d9d700 1 -- 172.21.15.46:0/3204706521 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb9980d1310 con 0x7fb9980cf190 2023-07-05T18:56:26.599 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:26.594+0000 7fb99659c700 1 --2- 172.21.15.46:0/3204706521 >> v2:172.21.15.73:3300/0 conn(0x7fb9980af160 0x7fb9980d0a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-05T18:56:26.599 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:26.594+0000 7fb996d9d700 1 --2- 172.21.15.46:0/3204706521 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb9980cf190 0x7fb9980b0f70 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fb9980ce670 tx=0x7fb99000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=23759063e8df4eee server_cookie=0 in_seq=0 out_seq=0 2023-07-05T18:56:26.600 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:26.594+0000 7fb99559a700 1 -- 172.21.15.46:0/3204706521 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb99000e070 con 0x7fb9980cf190 2023-07-05T18:56:26.600 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:26.594+0000 7fb99559a700 1 -- 172.21.15.46:0/3204706521 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb99000b980 con 0x7fb9980cf190 2023-07-05T18:56:26.601 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:26.594+0000 7fb99559a700 1 -- 172.21.15.46:0/3204706521 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb99000bd30 con 0x7fb9980cf190 2023-07-05T18:56:26.601 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:26.595+0000 7fb99ca25700 1 -- 172.21.15.46:0/3204706521 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb9980cf190 msgr2=0x7fb9980b0f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:56:26.601 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:26.595+0000 7fb99ca25700 1 --2- 172.21.15.46:0/3204706521 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb9980cf190 0x7fb9980b0f70 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fb9980ce670 tx=0x7fb99000b330 comp rx=0 tx=0).stop 2023-07-05T18:56:26.602 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:26.595+0000 7fb99ca25700 1 -- 172.21.15.46:0/3204706521 shutdown_connections 2023-07-05T18:56:26.602 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:26.595+0000 7fb99ca25700 1 --2- 172.21.15.46:0/3204706521 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb9980cf190 0x7fb9980b0f70 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:26.602 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:26.595+0000 7fb99ca25700 1 --2- 172.21.15.46:0/3204706521 >> v2:172.21.15.73:3300/0 conn(0x7fb9980af160 0x7fb9980d0a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:26.603 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:26.595+0000 7fb99ca25700 1 -- 172.21.15.46:0/3204706521 >> 172.21.15.46:0/3204706521 conn(0x7fb9980664b0 msgr2=0x7fb998099de0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-05T18:56:26.603 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:26.595+0000 7fb99ca25700 1 -- 172.21.15.46:0/3204706521 shutdown_connections 2023-07-05T18:56:26.603 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:26.595+0000 7fb99ca25700 1 -- 172.21.15.46:0/3204706521 wait complete. 2023-07-05T18:56:26.607 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:26.596+0000 7fb99ca25700 1 Processor -- start 2023-07-05T18:56:26.608 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:26.596+0000 7fb99ca25700 1 -- start start 2023-07-05T18:56:26.608 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:26.597+0000 7fb99ca25700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fb9980af160 0x7fb99815b6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:56:26.608 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:26.597+0000 7fb99ca25700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb9980af530 0x7fb9980b61d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:56:26.609 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:26.597+0000 7fb99ca25700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb9980cf190 0x7fb99814da30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:56:26.609 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:26.597+0000 7fb99ca25700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9980c8f10 con 0x7fb9980cf190 2023-07-05T18:56:26.609 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:26.597+0000 7fb99ca25700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb99815cfd0 con 0x7fb9980af530 2023-07-05T18:56:26.609 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:26.597+0000 7fb99ca25700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb9981f3cd0 con 0x7fb9980af160 2023-07-05T18:56:26.610 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:26.597+0000 7fb996d9d700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb9980cf190 0x7fb99814da30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:56:26.610 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:26.597+0000 7fb996d9d700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb9980cf190 0x7fb99814da30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:58308/0 (socket says 172.21.15.46:58308) 2023-07-05T18:56:26.610 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:26.597+0000 7fb996d9d700 1 -- 172.21.15.46:0/2306210724 learned_addr learned my addr 172.21.15.46:0/2306210724 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-07-05T18:56:26.611 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:26.597+0000 7fb995d9b700 1 --2- 172.21.15.46:0/2306210724 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb9980af530 0x7fb9980b61d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:56:26.611 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:26.597+0000 7fb99659c700 1 --2- 172.21.15.46:0/2306210724 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fb9980af160 0x7fb99815b6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:56:26.611 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:26.597+0000 7fb996d9d700 1 -- 172.21.15.46:0/2306210724 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fb9980af160 msgr2=0x7fb99815b6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:56:26.611 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:26.597+0000 7fb996d9d700 1 --2- 172.21.15.46:0/2306210724 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fb9980af160 0x7fb99815b6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:26.611 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:26.598+0000 7fb996d9d700 1 -- 172.21.15.46:0/2306210724 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb9980af530 msgr2=0x7fb9980b61d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:56:26.611 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:26.598+0000 7fb996d9d700 1 --2- 172.21.15.46:0/2306210724 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb9980af530 0x7fb9980b61d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:26.612 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:26.598+0000 7fb996d9d700 1 -- 172.21.15.46:0/2306210724 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb990009b30 con 0x7fb9980cf190 2023-07-05T18:56:26.612 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:26.598+0000 7fb996d9d700 1 --2- 172.21.15.46:0/2306210724 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb9980cf190 0x7fb99814da30 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fb9980ce700 tx=0x7fb990004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-05T18:56:26.612 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:26.598+0000 7fb98effd700 1 -- 172.21.15.46:0/2306210724 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb990004800 con 0x7fb9980cf190 2023-07-05T18:56:26.612 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:26.598+0000 7fb98effd700 1 -- 172.21.15.46:0/2306210724 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb9900092e0 con 0x7fb9980cf190 2023-07-05T18:56:26.612 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:26.598+0000 7fb99ca25700 1 -- 172.21.15.46:0/2306210724 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb9981f3fb0 con 0x7fb9980cf190 2023-07-05T18:56:26.612 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:26.598+0000 7fb98effd700 1 -- 172.21.15.46:0/2306210724 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb99001b670 con 0x7fb9980cf190 2023-07-05T18:56:26.612 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:26.598+0000 7fb99ca25700 1 -- 172.21.15.46:0/2306210724 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb9981f4570 con 0x7fb9980cf190 2023-07-05T18:56:26.613 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:26.599+0000 7fb99ca25700 1 -- 172.21.15.46:0/2306210724 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb9980c90c0 con 0x7fb9980cf190 2023-07-05T18:56:26.613 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:26.599+0000 7fb98effd700 1 -- 172.21.15.46:0/2306210724 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fb99001b7d0 con 0x7fb9980cf190 2023-07-05T18:56:26.613 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:26.600+0000 7fb98effd700 1 --2- 172.21.15.46:0/2306210724 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7fb97806ace0 0x7fb97806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:56:26.613 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:26.600+0000 7fb98effd700 1 -- 172.21.15.46:0/2306210724 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fb99008a2b0 con 0x7fb9980cf190 2023-07-05T18:56:26.613 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:26.600+0000 7fb99659c700 1 --2- 172.21.15.46:0/2306210724 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7fb97806ace0 0x7fb97806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:56:26.615 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:26.600+0000 7fb99659c700 1 --2- 172.21.15.46:0/2306210724 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7fb97806ace0 0x7fb97806d190 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fb9880099d0 tx=0x7fb988008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-05T18:56:26.615 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:26.604+0000 7fb98effd700 1 -- 172.21.15.46:0/2306210724 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fb9980c90c0 con 0x7fb9980cf190 2023-07-05T18:56:26.809 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:26.807+0000 7fb99ca25700 1 -- 172.21.15.46:0/2306210724 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fb9980672e0 con 0x7fb9980cf190 2023-07-05T18:56:26.809 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:26.807+0000 7fb98effd700 1 -- 172.21.15.46:0/2306210724 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v21) v1 ==== 100+0+11 (secure 0 0 0) 0x7fb9900553f0 con 0x7fb9980cf190 2023-07-05T18:56:26.810 INFO:teuthology.orchestra.run.smithi046.stdout:pg_num: 64 2023-07-05T18:56:26.812 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:26.810+0000 7fb99ca25700 1 -- 172.21.15.46:0/2306210724 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7fb97806ace0 msgr2=0x7fb97806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:56:26.812 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:26.810+0000 7fb99ca25700 1 --2- 172.21.15.46:0/2306210724 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7fb97806ace0 0x7fb97806d190 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fb9880099d0 tx=0x7fb988008040 comp rx=0 tx=0).stop 2023-07-05T18:56:26.812 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:26.810+0000 7fb99ca25700 1 -- 172.21.15.46:0/2306210724 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb9980cf190 msgr2=0x7fb99814da30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:56:26.812 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:26.810+0000 7fb99ca25700 1 --2- 172.21.15.46:0/2306210724 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb9980cf190 0x7fb99814da30 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fb9980ce700 tx=0x7fb990004ad0 comp rx=0 tx=0).stop 2023-07-05T18:56:26.812 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:26.810+0000 7fb99ca25700 1 -- 172.21.15.46:0/2306210724 shutdown_connections 2023-07-05T18:56:26.813 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:26.810+0000 7fb99ca25700 1 --2- 172.21.15.46:0/2306210724 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7fb97806ace0 0x7fb97806d190 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:26.813 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:26.810+0000 7fb99ca25700 1 --2- 172.21.15.46:0/2306210724 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb9980cf190 0x7fb99814da30 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:26.813 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:26.810+0000 7fb99ca25700 1 --2- 172.21.15.46:0/2306210724 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fb9980af160 0x7fb99815b6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:26.813 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:26.810+0000 7fb99ca25700 1 --2- 172.21.15.46:0/2306210724 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb9980af530 0x7fb9980b61d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:26.813 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:26.810+0000 7fb99ca25700 1 -- 172.21.15.46:0/2306210724 >> 172.21.15.46:0/2306210724 conn(0x7fb9980664b0 msgr2=0x7fb99806ed00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-05T18:56:26.813 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:26.810+0000 7fb99ca25700 1 -- 172.21.15.46:0/2306210724 shutdown_connections 2023-07-05T18:56:26.814 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:26.810+0000 7fb99ca25700 1 -- 172.21.15.46:0/2306210724 wait complete. 2023-07-05T18:56:26.824 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-05T18:56:26.949 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:26.946+0000 7f680391f700 1 Processor -- start 2023-07-05T18:56:26.955 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:26.947+0000 7f680391f700 1 -- start start 2023-07-05T18:56:26.955 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:26.948+0000 7f680391f700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f67fc06a510 0x7f67fc06ed50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:56:26.955 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:26.948+0000 7f680391f700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f67fc0b33c0 0x7f67fc0cf660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:56:26.956 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:26.948+0000 7f680391f700 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f67fc0b4850 con 0x7f67fc15c500 2023-07-05T18:56:26.956 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:26.948+0000 7f680391f700 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f67fc15c8d0 con 0x7f67fc06a510 2023-07-05T18:56:26.956 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:26.948+0000 7f680391f700 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f67fc0b4b30 con 0x7f67fc0b33c0 2023-07-05T18:56:26.956 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:26.948+0000 7f6800eba700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f67fc06a510 0x7f67fc06ed50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:56:26.956 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:26.948+0000 7f6800eba700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f67fc06a510 0x7f67fc06ed50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:58314/0 (socket says 172.21.15.46:58314) 2023-07-05T18:56:26.956 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:26.948+0000 7f6800eba700 1 -- 172.21.15.46:0/362186506 learned_addr learned my addr 172.21.15.46:0/362186506 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-07-05T18:56:26.956 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:26.948+0000 7f6801ebc700 1 --2- 172.21.15.46:0/362186506 >> v2:172.21.15.73:3300/0 conn(0x7f67fc0b33c0 0x7f67fc0cf660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:56:26.957 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:26.948+0000 7f6800eba700 1 -- 172.21.15.46:0/362186506 >> v2:172.21.15.73:3300/0 conn(0x7f67fc0b33c0 msgr2=0x7f67fc0cf660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-05T18:56:26.957 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:26.948+0000 7f6800eba700 1 --2- 172.21.15.46:0/362186506 >> v2:172.21.15.73:3300/0 conn(0x7f67fc0b33c0 0x7f67fc0cf660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:26.957 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:26.948+0000 7f6800eba700 1 -- 172.21.15.46:0/362186506 >> v1:172.21.15.73:6789/0 conn(0x7f67fc15c500 legacy=0x7f67fc069e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:56:26.957 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:26.948+0000 7f6800eba700 1 -- 172.21.15.46:0/362186506 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f67fc06e270 con 0x7f67fc06a510 2023-07-05T18:56:26.957 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:26.948+0000 7f6800eba700 1 --2- 172.21.15.46:0/362186506 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f67fc06a510 0x7f67fc06ed50 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f67fc070530 tx=0x7f67f0009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e2c9217bfa49dc9b server_cookie=0 in_seq=0 out_seq=0 2023-07-05T18:56:26.957 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:26.948+0000 7f67effff700 1 -- 172.21.15.46:0/362186506 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67f000b870 con 0x7f67fc06a510 2023-07-05T18:56:26.957 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:26.948+0000 7f67effff700 1 -- 172.21.15.46:0/362186506 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f67f000b9d0 con 0x7f67fc06a510 2023-07-05T18:56:26.957 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:26.948+0000 7f67effff700 1 -- 172.21.15.46:0/362186506 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67f000bd60 con 0x7f67fc06a510 2023-07-05T18:56:26.958 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:26.949+0000 7f680391f700 1 -- 172.21.15.46:0/362186506 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f67fc06a510 msgr2=0x7f67fc06ed50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:56:26.958 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:26.949+0000 7f680391f700 1 --2- 172.21.15.46:0/362186506 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f67fc06a510 0x7f67fc06ed50 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f67fc070530 tx=0x7f67f0009bd0 comp rx=0 tx=0).stop 2023-07-05T18:56:26.958 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:26.949+0000 7f680391f700 1 -- 172.21.15.46:0/362186506 shutdown_connections 2023-07-05T18:56:26.958 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:26.949+0000 7f680391f700 1 --2- 172.21.15.46:0/362186506 >> v2:172.21.15.73:3300/0 conn(0x7f67fc0b33c0 0x7f67fc0cf660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:26.958 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:26.949+0000 7f680391f700 1 --2- 172.21.15.46:0/362186506 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f67fc06a510 0x7f67fc06ed50 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:26.958 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:26.949+0000 7f680391f700 1 -- 172.21.15.46:0/362186506 >> 172.21.15.46:0/362186506 conn(0x7f67fc06af10 msgr2=0x7f67fc06b2e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-05T18:56:26.958 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:26.949+0000 7f680391f700 1 -- 172.21.15.46:0/362186506 shutdown_connections 2023-07-05T18:56:26.959 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:26.949+0000 7f680391f700 1 -- 172.21.15.46:0/362186506 wait complete. 2023-07-05T18:56:26.959 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:26.950+0000 7f680391f700 1 Processor -- start 2023-07-05T18:56:26.959 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:26.950+0000 7f680391f700 1 -- start start 2023-07-05T18:56:26.959 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:26.951+0000 7f680391f700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f67fc06a510 0x7f67fc0cb450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:56:26.960 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:26.951+0000 7f680391f700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f67fc0b33c0 0x7f67fc0d0490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:56:26.960 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:26.951+0000 7f680391f700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f67fc15c500 0x7f67fc15f2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:56:26.960 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:26.951+0000 7f680391f700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f67fc0cf4c0 con 0x7f67fc15c500 2023-07-05T18:56:26.960 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:26.951+0000 7f680391f700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f67fc0d0000 con 0x7f67fc06a510 2023-07-05T18:56:26.960 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:26.951+0000 7f680391f700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f67fc1f28e0 con 0x7f67fc0b33c0 2023-07-05T18:56:26.960 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:26.951+0000 7f6801ebc700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f67fc15c500 0x7f67fc15f2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:56:26.960 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:26.951+0000 7f6801ebc700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f67fc15c500 0x7f67fc15f2d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:58322/0 (socket says 172.21.15.46:58322) 2023-07-05T18:56:26.961 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:26.951+0000 7f6801ebc700 1 -- 172.21.15.46:0/4257061695 learned_addr learned my addr 172.21.15.46:0/4257061695 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-07-05T18:56:26.961 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:26.951+0000 7f68016bb700 1 --2- 172.21.15.46:0/4257061695 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f67fc06a510 0x7f67fc0cb450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:56:26.961 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:26.951+0000 7f6800eba700 1 --2- 172.21.15.46:0/4257061695 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f67fc0b33c0 0x7f67fc0d0490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:56:26.961 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:26.951+0000 7f6801ebc700 1 -- 172.21.15.46:0/4257061695 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f67fc0b33c0 msgr2=0x7f67fc0d0490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:56:26.961 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:26.951+0000 7f6801ebc700 1 --2- 172.21.15.46:0/4257061695 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f67fc0b33c0 0x7f67fc0d0490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:26.961 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:26.951+0000 7f6801ebc700 1 -- 172.21.15.46:0/4257061695 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f67fc06a510 msgr2=0x7f67fc0cb450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:56:26.961 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:26.951+0000 7f6801ebc700 1 --2- 172.21.15.46:0/4257061695 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f67fc06a510 0x7f67fc0cb450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:26.961 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:26.951+0000 7f6801ebc700 1 -- 172.21.15.46:0/4257061695 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f67f0009550 con 0x7f67fc15c500 2023-07-05T18:56:26.962 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:26.951+0000 7f68016bb700 1 --2- 172.21.15.46:0/4257061695 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f67fc06a510 0x7f67fc0cb450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-05T18:56:26.962 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:26.952+0000 7f6801ebc700 1 --2- 172.21.15.46:0/4257061695 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f67fc15c500 0x7f67fc15f2d0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f67f4007e70 tx=0x7f67f400e3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-05T18:56:26.962 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:26.952+0000 7f67edffb700 1 -- 172.21.15.46:0/4257061695 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67f400ee50 con 0x7f67fc15c500 2023-07-05T18:56:26.962 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:26.952+0000 7f67edffb700 1 -- 172.21.15.46:0/4257061695 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f67f4014420 con 0x7f67fc15c500 2023-07-05T18:56:26.962 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:26.952+0000 7f680391f700 1 -- 172.21.15.46:0/4257061695 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f67fc15f810 con 0x7f67fc15c500 2023-07-05T18:56:26.962 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:26.952+0000 7f67edffb700 1 -- 172.21.15.46:0/4257061695 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67f40147d0 con 0x7f67fc15c500 2023-07-05T18:56:26.962 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:26.952+0000 7f680391f700 1 -- 172.21.15.46:0/4257061695 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f67fc0cf9b0 con 0x7f67fc15c500 2023-07-05T18:56:26.962 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:26.953+0000 7f680391f700 1 -- 172.21.15.46:0/4257061695 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f67fc0d0170 con 0x7f67fc15c500 2023-07-05T18:56:26.963 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:26.953+0000 7f67edffb700 1 -- 172.21.15.46:0/4257061695 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f67f4014930 con 0x7f67fc15c500 2023-07-05T18:56:26.963 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:26.954+0000 7f67edffb700 1 --2- 172.21.15.46:0/4257061695 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7f67e006ace0 0x7f67e006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:56:26.964 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:26.954+0000 7f67edffb700 1 -- 172.21.15.46:0/4257061695 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f67f4089c40 con 0x7f67fc15c500 2023-07-05T18:56:26.964 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:26.954+0000 7f68016bb700 1 --2- 172.21.15.46:0/4257061695 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7f67e006ace0 0x7f67e006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:56:26.964 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:26.954+0000 7f68016bb700 1 --2- 172.21.15.46:0/4257061695 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7f67e006ace0 0x7f67e006d190 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f67f8000f60 tx=0x7f67f8009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-05T18:56:26.964 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:26.958+0000 7f67edffb700 1 -- 172.21.15.46:0/4257061695 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f67f4054d80 con 0x7f67fc15c500 2023-07-05T18:56:27.201 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:27.200+0000 7f680391f700 1 -- 172.21.15.46:0/4257061695 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f67fc0672e0 con 0x7f67fc15c500 2023-07-05T18:56:27.202 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:27.200+0000 7f67edffb700 1 -- 172.21.15.46:0/4257061695 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4656 (secure 0 0 0) 0x7f67f40583a0 con 0x7f67fc15c500 2023-07-05T18:56:27.202 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T18:56:27.203 INFO:teuthology.orchestra.run.smithi046.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4247,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.73:6837/75231790","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6835","nonce":75231790},{"type":"v1","addr":"172.21.15.73:6837","nonce":75231790}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4284,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.46:6834/378741372","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6832","nonce":378741372},{"type":"v1","addr":"172.21.15.46:6834","nonce":378741372}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4287,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.46:6835/1674703862","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6833","nonce":1674703862},{"type":"v1","addr":"172.21.15.46:6835","nonce":1674703862}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-07-05T18:56:15.093940+0000","modified":"2023-07-05T18:56:18.225033+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4296},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4296":{"gid":4296,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.73:6836/2654190748","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6834","nonce":2654190748},{"type":"v1","addr":"172.21.15.73:6836","nonce":2654190748}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-07-05T18:56:27.204 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:27.202+0000 7f680391f700 1 -- 172.21.15.46:0/4257061695 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7f67e006ace0 msgr2=0x7f67e006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:56:27.205 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:27.202+0000 7f680391f700 1 --2- 172.21.15.46:0/4257061695 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7f67e006ace0 0x7f67e006d190 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f67f8000f60 tx=0x7f67f8009040 comp rx=0 tx=0).stop 2023-07-05T18:56:27.205 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:27.202+0000 7f680391f700 1 -- 172.21.15.46:0/4257061695 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f67fc15c500 msgr2=0x7f67fc15f2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:56:27.205 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:27.202+0000 7f680391f700 1 --2- 172.21.15.46:0/4257061695 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f67fc15c500 0x7f67fc15f2d0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f67f4007e70 tx=0x7f67f400e3c0 comp rx=0 tx=0).stop 2023-07-05T18:56:27.205 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:27.202+0000 7f680391f700 1 -- 172.21.15.46:0/4257061695 shutdown_connections 2023-07-05T18:56:27.205 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:27.202+0000 7f680391f700 1 --2- 172.21.15.46:0/4257061695 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7f67e006ace0 0x7f67e006d190 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:27.205 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:27.202+0000 7f680391f700 1 --2- 172.21.15.46:0/4257061695 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f67fc15c500 0x7f67fc15f2d0 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:27.206 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:27.202+0000 7f680391f700 1 --2- 172.21.15.46:0/4257061695 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f67fc06a510 0x7f67fc0cb450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:27.206 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:27.202+0000 7f680391f700 1 --2- 172.21.15.46:0/4257061695 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f67fc0b33c0 0x7f67fc0d0490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:27.206 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:27.202+0000 7f680391f700 1 -- 172.21.15.46:0/4257061695 >> 172.21.15.46:0/4257061695 conn(0x7f67fc06af10 msgr2=0x7f67fc06c7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-05T18:56:27.206 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:27.203+0000 7f680391f700 1 -- 172.21.15.46:0/4257061695 shutdown_connections 2023-07-05T18:56:27.206 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:27.203+0000 7f680391f700 1 -- 172.21.15.46:0/4257061695 wait complete. 2023-07-05T18:56:27.207 INFO:teuthology.orchestra.run.smithi046.stderr:dumped fsmap epoch 8 2023-07-05T18:56:27.218 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-05T18:56:27.342 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:27.340+0000 7f8e7f2f6700 1 Processor -- start 2023-07-05T18:56:27.343 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:27.341+0000 7f8e7f2f6700 1 -- start start 2023-07-05T18:56:27.344 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:27.341+0000 7f8e7f2f6700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f8e780ce710 0x7f8e780d0ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:56:27.345 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:27.341+0000 7f8e7f2f6700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f8e780d1010 0x7f8e780ae200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:56:27.345 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:27.341+0000 7f8e7f2f6700 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8e780d1470 con 0x7f8e7815a630 2023-07-05T18:56:27.345 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:27.341+0000 7f8e7f2f6700 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8e780ceb80 con 0x7f8e780ce710 2023-07-05T18:56:27.345 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:27.341+0000 7f8e7f2f6700 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8e780ceda0 con 0x7f8e780d1010 2023-07-05T18:56:27.345 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:27.342+0000 7f8e7c891700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f8e780ce710 0x7f8e780d0ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:56:27.345 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:27.342+0000 7f8e7c891700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f8e780ce710 0x7f8e780d0ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:58328/0 (socket says 172.21.15.46:58328) 2023-07-05T18:56:27.346 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:27.342+0000 7f8e7c891700 1 -- 172.21.15.46:0/580652703 learned_addr learned my addr 172.21.15.46:0/580652703 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-07-05T18:56:27.346 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:27.342+0000 7f8e7d893700 1 --2- 172.21.15.46:0/580652703 >> v2:172.21.15.73:3300/0 conn(0x7f8e780d1010 0x7f8e780ae200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:56:27.346 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:27.342+0000 7f8e7c891700 1 -- 172.21.15.46:0/580652703 >> v2:172.21.15.73:3300/0 conn(0x7f8e780d1010 msgr2=0x7f8e780ae200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-05T18:56:27.346 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:27.342+0000 7f8e7c891700 1 --2- 172.21.15.46:0/580652703 >> v2:172.21.15.73:3300/0 conn(0x7f8e780d1010 0x7f8e780ae200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:27.346 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:27.342+0000 7f8e7c891700 1 -- 172.21.15.46:0/580652703 >> v1:172.21.15.73:6789/0 conn(0x7f8e7815a630 legacy=0x7f8e780b1ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:56:27.346 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:27.342+0000 7f8e7c891700 1 -- 172.21.15.46:0/580652703 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8e780cf080 con 0x7f8e780ce710 2023-07-05T18:56:27.346 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:27.342+0000 7f8e7c891700 1 --2- 172.21.15.46:0/580652703 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8e780ce710 0x7f8e780d0ad0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f8e780ce650 tx=0x7f8e6c009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=24942a3c64719229 server_cookie=0 in_seq=0 out_seq=0 2023-07-05T18:56:27.347 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:27.342+0000 7f8e6bfff700 1 -- 172.21.15.46:0/580652703 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e6c00b870 con 0x7f8e780ce710 2023-07-05T18:56:27.347 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:27.342+0000 7f8e6bfff700 1 -- 172.21.15.46:0/580652703 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8e6c00b9d0 con 0x7f8e780ce710 2023-07-05T18:56:27.347 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:27.342+0000 7f8e6bfff700 1 -- 172.21.15.46:0/580652703 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e6c00bd60 con 0x7f8e780ce710 2023-07-05T18:56:27.347 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:27.343+0000 7f8e7f2f6700 1 -- 172.21.15.46:0/580652703 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8e780ce710 msgr2=0x7f8e780d0ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:56:27.347 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:27.343+0000 7f8e7f2f6700 1 --2- 172.21.15.46:0/580652703 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8e780ce710 0x7f8e780d0ad0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f8e780ce650 tx=0x7f8e6c009bd0 comp rx=0 tx=0).stop 2023-07-05T18:56:27.347 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:27.343+0000 7f8e7f2f6700 1 -- 172.21.15.46:0/580652703 shutdown_connections 2023-07-05T18:56:27.347 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:27.343+0000 7f8e7f2f6700 1 --2- 172.21.15.46:0/580652703 >> v2:172.21.15.73:3300/0 conn(0x7f8e780d1010 0x7f8e780ae200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:27.347 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:27.343+0000 7f8e7f2f6700 1 --2- 172.21.15.46:0/580652703 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8e780ce710 0x7f8e780d0ad0 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:27.348 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:27.343+0000 7f8e7f2f6700 1 -- 172.21.15.46:0/580652703 >> 172.21.15.46:0/580652703 conn(0x7f8e78071cf0 msgr2=0x7f8e78099e30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-05T18:56:27.348 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:27.343+0000 7f8e7f2f6700 1 -- 172.21.15.46:0/580652703 shutdown_connections 2023-07-05T18:56:27.348 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:27.343+0000 7f8e7f2f6700 1 -- 172.21.15.46:0/580652703 wait complete. 2023-07-05T18:56:27.350 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:27.344+0000 7f8e7f2f6700 1 Processor -- start 2023-07-05T18:56:27.350 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:27.344+0000 7f8e7f2f6700 1 -- start start 2023-07-05T18:56:27.350 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:27.345+0000 7f8e7f2f6700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f8e780ce710 0x7f8e78150280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:56:27.351 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:27.345+0000 7f8e7f2f6700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8e780d1010 0x7f8e7806c4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:56:27.351 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:27.345+0000 7f8e7f2f6700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8e7815a630 0x7f8e7806af10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:56:27.351 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:27.345+0000 7f8e7f2f6700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e780af270 con 0x7f8e7815a630 2023-07-05T18:56:27.351 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:27.345+0000 7f8e7f2f6700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e781519b0 con 0x7f8e780d1010 2023-07-05T18:56:27.351 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:27.345+0000 7f8e7f2f6700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8e78150da0 con 0x7f8e780ce710 2023-07-05T18:56:27.352 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:27.345+0000 7f8e7d893700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8e7815a630 0x7f8e7806af10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:56:27.352 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:27.345+0000 7f8e7d893700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8e7815a630 0x7f8e7806af10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:58336/0 (socket says 172.21.15.46:58336) 2023-07-05T18:56:27.352 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:27.345+0000 7f8e7d893700 1 -- 172.21.15.46:0/381562140 learned_addr learned my addr 172.21.15.46:0/381562140 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-07-05T18:56:27.352 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:27.345+0000 7f8e7c891700 1 --2- 172.21.15.46:0/381562140 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8e780d1010 0x7f8e7806c4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:56:27.352 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:27.345+0000 7f8e7d092700 1 --2- 172.21.15.46:0/381562140 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f8e780ce710 0x7f8e78150280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:56:27.352 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:27.345+0000 7f8e7d893700 1 -- 172.21.15.46:0/381562140 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f8e780ce710 msgr2=0x7f8e78150280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:56:27.352 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:27.345+0000 7f8e7d893700 1 --2- 172.21.15.46:0/381562140 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f8e780ce710 0x7f8e78150280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:27.353 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:27.345+0000 7f8e7d893700 1 -- 172.21.15.46:0/381562140 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8e780d1010 msgr2=0x7f8e7806c4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:56:27.353 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:27.345+0000 7f8e7d893700 1 --2- 172.21.15.46:0/381562140 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8e780d1010 0x7f8e7806c4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:27.353 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:27.345+0000 7f8e7d893700 1 -- 172.21.15.46:0/381562140 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8e6c009550 con 0x7f8e7815a630 2023-07-05T18:56:27.353 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:27.345+0000 7f8e7c891700 1 --2- 172.21.15.46:0/381562140 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8e780d1010 0x7f8e7806c4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-05T18:56:27.353 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:27.345+0000 7f8e7d893700 1 --2- 172.21.15.46:0/381562140 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8e7815a630 0x7f8e7806af10 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f8e70007e40 tx=0x7f8e7000e3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-05T18:56:27.353 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:27.346+0000 7f8e69ffb700 1 -- 172.21.15.46:0/381562140 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e7000eea0 con 0x7f8e7815a630 2023-07-05T18:56:27.353 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:27.346+0000 7f8e69ffb700 1 -- 172.21.15.46:0/381562140 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8e70014420 con 0x7f8e7815a630 2023-07-05T18:56:27.353 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:27.346+0000 7f8e7f2f6700 1 -- 172.21.15.46:0/381562140 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8e78151080 con 0x7f8e7815a630 2023-07-05T18:56:27.354 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:27.346+0000 7f8e69ffb700 1 -- 172.21.15.46:0/381562140 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e700147b0 con 0x7f8e7815a630 2023-07-05T18:56:27.354 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:27.346+0000 7f8e7f2f6700 1 -- 172.21.15.46:0/381562140 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8e78151640 con 0x7f8e7815a630 2023-07-05T18:56:27.354 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:27.347+0000 7f8e7f2f6700 1 -- 172.21.15.46:0/381562140 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8e78151800 con 0x7f8e7815a630 2023-07-05T18:56:27.354 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:27.347+0000 7f8e69ffb700 1 -- 172.21.15.46:0/381562140 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f8e70014910 con 0x7f8e7815a630 2023-07-05T18:56:27.354 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:27.348+0000 7f8e69ffb700 1 --2- 172.21.15.46:0/381562140 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7f8e5c06ace0 0x7f8e5c06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:56:27.354 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:27.348+0000 7f8e69ffb700 1 -- 172.21.15.46:0/381562140 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f8e70089cc0 con 0x7f8e7815a630 2023-07-05T18:56:27.354 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:27.348+0000 7f8e7d092700 1 --2- 172.21.15.46:0/381562140 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7f8e5c06ace0 0x7f8e5c06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:56:27.355 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:27.348+0000 7f8e7d092700 1 --2- 172.21.15.46:0/381562140 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7f8e5c06ace0 0x7f8e5c06d190 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f8e74000f60 tx=0x7f8e74009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-05T18:56:27.355 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:27.352+0000 7f8e69ffb700 1 -- 172.21.15.46:0/381562140 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f8e70054d70 con 0x7f8e7815a630 2023-07-05T18:56:27.553 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:27.551+0000 7f8e7f2f6700 1 -- 172.21.15.46:0/381562140 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f8e78151b20 con 0x7f8e7815a630 2023-07-05T18:56:27.554 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:27.552+0000 7f8e69ffb700 1 -- 172.21.15.46:0/381562140 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) v1 ==== 74+0+18161 (secure 0 0 0) 0x7f8e78151b20 con 0x7f8e7815a630 2023-07-05T18:56:27.555 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T18:56:27.555 INFO:teuthology.orchestra.run.smithi046.stdout:{"epoch":21,"fsid":"042652d3-d80c-4ad8-9366-3e94f2a0a512","created":"2023-07-05T18:55:56.455710+0000","modified":"2023-07-05T18:56:16.095672+0000","last_up_change":"2023-07-05T18:56:06.594022+0000","last_in_change":"2023-07-05T18:55:58.879340+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-07-05T18:56:07.729620+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2023-07-05T18:56:08.128122+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-07-05T18:56:12.954625+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-07-05T18:56:14.068396+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"20009183-9a47-4392-8751-883f88d2bfb1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6813","nonce":4151971443},{"type":"v1","addr":"172.21.15.46:6815","nonce":4151971443}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6817","nonce":4151971443},{"type":"v1","addr":"172.21.15.46:6818","nonce":4151971443}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6822","nonce":4151971443},{"type":"v1","addr":"172.21.15.46:6823","nonce":4151971443}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6820","nonce":4151971443},{"type":"v1","addr":"172.21.15.46:6821","nonce":4151971443}]},"public_addr":"172.21.15.46:6815/4151971443","cluster_addr":"172.21.15.46:6818/4151971443","heartbeat_back_addr":"172.21.15.46:6823/4151971443","heartbeat_front_addr":"172.21.15.46:6821/4151971443","state":["exists","up"]},{"osd":1,"uuid":"91b4a7b0-e4e4-4888-a1fe-9edb0d68004c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6808","nonce":502575881},{"type":"v1","addr":"172.21.15.46:6809","nonce":502575881}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6810","nonce":502575881},{"type":"v1","addr":"172.21.15.46:6811","nonce":502575881}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6816","nonce":502575881},{"type":"v1","addr":"172.21.15.46:6819","nonce":502575881}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6812","nonce":502575881},{"type":"v1","addr":"172.21.15.46:6814","nonce":502575881}]},"public_addr":"172.21.15.46:6809/502575881","cluster_addr":"172.21.15.46:6811/502575881","heartbeat_back_addr":"172.21.15.46:6819/502575881","heartbeat_front_addr":"172.21.15.46:6814/502575881","state":["exists","up"]},{"osd":2,"uuid":"669ff744-1331-47c5-8579-0440731c889a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6800","nonce":2115251461},{"type":"v1","addr":"172.21.15.46:6801","nonce":2115251461}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6802","nonce":2115251461},{"type":"v1","addr":"172.21.15.46:6803","nonce":2115251461}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6806","nonce":2115251461},{"type":"v1","addr":"172.21.15.46:6807","nonce":2115251461}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6804","nonce":2115251461},{"type":"v1","addr":"172.21.15.46:6805","nonce":2115251461}]},"public_addr":"172.21.15.46:6801/2115251461","cluster_addr":"172.21.15.46:6803/2115251461","heartbeat_back_addr":"172.21.15.46:6807/2115251461","heartbeat_front_addr":"172.21.15.46:6805/2115251461","state":["exists","up"]},{"osd":3,"uuid":"34e1b86d-ffad-415d-861c-07a5f08068a6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6824","nonce":2981388766},{"type":"v1","addr":"172.21.15.46:6825","nonce":2981388766}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6826","nonce":2981388766},{"type":"v1","addr":"172.21.15.46:6827","nonce":2981388766}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6830","nonce":2981388766},{"type":"v1","addr":"172.21.15.46:6831","nonce":2981388766}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6828","nonce":2981388766},{"type":"v1","addr":"172.21.15.46:6829","nonce":2981388766}]},"public_addr":"172.21.15.46:6825/2981388766","cluster_addr":"172.21.15.46:6827/2981388766","heartbeat_back_addr":"172.21.15.46:6831/2981388766","heartbeat_front_addr":"172.21.15.46:6829/2981388766","state":["exists","up"]},{"osd":4,"uuid":"57ffcb91-c7dc-4a69-ae71-4d9622a14a05","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6800","nonce":2083655348},{"type":"v1","addr":"172.21.15.73:6801","nonce":2083655348}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6802","nonce":2083655348},{"type":"v1","addr":"172.21.15.73:6803","nonce":2083655348}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6806","nonce":2083655348},{"type":"v1","addr":"172.21.15.73:6807","nonce":2083655348}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6804","nonce":2083655348},{"type":"v1","addr":"172.21.15.73:6805","nonce":2083655348}]},"public_addr":"172.21.15.73:6801/2083655348","cluster_addr":"172.21.15.73:6803/2083655348","heartbeat_back_addr":"172.21.15.73:6807/2083655348","heartbeat_front_addr":"172.21.15.73:6805/2083655348","state":["exists","up"]},{"osd":5,"uuid":"665f41c9-ee20-49cf-bf0e-fbe0c03d3aed","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6824","nonce":2803788401},{"type":"v1","addr":"172.21.15.73:6825","nonce":2803788401}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6826","nonce":2803788401},{"type":"v1","addr":"172.21.15.73:6827","nonce":2803788401}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6830","nonce":2803788401},{"type":"v1","addr":"172.21.15.73:6831","nonce":2803788401}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6828","nonce":2803788401},{"type":"v1","addr":"172.21.15.73:6829","nonce":2803788401}]},"public_addr":"172.21.15.73:6825/2803788401","cluster_addr":"172.21.15.73:6827/2803788401","heartbeat_back_addr":"172.21.15.73:6831/2803788401","heartbeat_front_addr":"172.21.15.73:6829/2803788401","state":["exists","up"]},{"osd":6,"uuid":"5790c6cc-bd56-4ce4-9a7c-0f0c3b59215c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6808","nonce":974108383},{"type":"v1","addr":"172.21.15.73:6809","nonce":974108383}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6810","nonce":974108383},{"type":"v1","addr":"172.21.15.73:6811","nonce":974108383}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6815","nonce":974108383},{"type":"v1","addr":"172.21.15.73:6817","nonce":974108383}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6812","nonce":974108383},{"type":"v1","addr":"172.21.15.73:6813","nonce":974108383}]},"public_addr":"172.21.15.73:6809/974108383","cluster_addr":"172.21.15.73:6811/974108383","heartbeat_back_addr":"172.21.15.73:6817/974108383","heartbeat_front_addr":"172.21.15.73:6813/974108383","state":["exists","up"]},{"osd":7,"uuid":"b66f4d2e-147e-4c9b-97dd-cbd59d33802e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6814","nonce":3772673248},{"type":"v1","addr":"172.21.15.73:6816","nonce":3772673248}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6818","nonce":3772673248},{"type":"v1","addr":"172.21.15.73:6819","nonce":3772673248}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6822","nonce":3772673248},{"type":"v1","addr":"172.21.15.73:6823","nonce":3772673248}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6820","nonce":3772673248},{"type":"v1","addr":"172.21.15.73:6821","nonce":3772673248}]},"public_addr":"172.21.15.73:6816/3772673248","cluster_addr":"172.21.15.73:6819/3772673248","heartbeat_back_addr":"172.21.15.73:6823/3772673248","heartbeat_front_addr":"172.21.15.73:6821/3772673248","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-05T18:56:04.115334+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-05T18:56:04.071250+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-05T18:56:04.044387+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-05T18:56:04.085389+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-05T18:56:04.090726+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-05T18:56:04.074529+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-05T18:56:04.058841+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-05T18:56:04.043054+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-05T18:56:27.556 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:27.554+0000 7f8e7f2f6700 1 -- 172.21.15.46:0/381562140 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7f8e5c06ace0 msgr2=0x7f8e5c06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:56:27.557 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:27.554+0000 7f8e7f2f6700 1 --2- 172.21.15.46:0/381562140 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7f8e5c06ace0 0x7f8e5c06d190 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f8e74000f60 tx=0x7f8e74009040 comp rx=0 tx=0).stop 2023-07-05T18:56:27.557 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:27.554+0000 7f8e7f2f6700 1 -- 172.21.15.46:0/381562140 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8e7815a630 msgr2=0x7f8e7806af10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:56:27.558 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:27.554+0000 7f8e7f2f6700 1 --2- 172.21.15.46:0/381562140 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8e7815a630 0x7f8e7806af10 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f8e70007e40 tx=0x7f8e7000e3c0 comp rx=0 tx=0).stop 2023-07-05T18:56:27.558 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:27.554+0000 7f8e7f2f6700 1 -- 172.21.15.46:0/381562140 shutdown_connections 2023-07-05T18:56:27.558 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:27.554+0000 7f8e7f2f6700 1 --2- 172.21.15.46:0/381562140 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7f8e5c06ace0 0x7f8e5c06d190 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:27.558 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:27.554+0000 7f8e7f2f6700 1 --2- 172.21.15.46:0/381562140 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8e7815a630 0x7f8e7806af10 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:27.558 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:27.554+0000 7f8e7f2f6700 1 --2- 172.21.15.46:0/381562140 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f8e780ce710 0x7f8e78150280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:27.558 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:27.554+0000 7f8e7f2f6700 1 --2- 172.21.15.46:0/381562140 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8e780d1010 0x7f8e7806c4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:27.558 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:27.554+0000 7f8e7f2f6700 1 -- 172.21.15.46:0/381562140 >> 172.21.15.46:0/381562140 conn(0x7f8e78071cf0 msgr2=0x7f8e781596c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-05T18:56:27.559 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:27.554+0000 7f8e7f2f6700 1 -- 172.21.15.46:0/381562140 shutdown_connections 2023-07-05T18:56:27.559 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:27.554+0000 7f8e7f2f6700 1 -- 172.21.15.46:0/381562140 wait complete. 2023-07-05T18:56:27.569 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'rbd', 'create_time': '2023-07-05T18:56:07.729620+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': '.mgr', 'create_time': '2023-07-05T18:56:08.128122+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-07-05T18:56:12.954625+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-07-05T18:56:14.068396+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-07-05T18:56:27.570 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-07-05T18:56:27.697 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:27.695+0000 7fdcc251e700 1 Processor -- start 2023-07-05T18:56:27.697 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:27.695+0000 7fdcc251e700 1 -- start start 2023-07-05T18:56:27.699 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:27.696+0000 7fdcc251e700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fdcbc069e00 0x7fdcbc06a1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:56:27.699 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:27.696+0000 7fdcc251e700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fdcbc15d740 0x7fdcbc06cd50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:56:27.700 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:27.696+0000 7fdcc251e700 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdcbc06c020 con 0x7fdcbc06d290 2023-07-05T18:56:27.700 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:27.696+0000 7fdcc251e700 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdcbc06dda0 con 0x7fdcbc15d740 2023-07-05T18:56:27.700 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:27.696+0000 7fdcc251e700 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdcbc0cf500 con 0x7fdcbc069e00 2023-07-05T18:56:27.700 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:27.696+0000 7fdcbb7fe700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fdcbc15d740 0x7fdcbc06cd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:56:27.700 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:27.696+0000 7fdcc0abb700 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7fdcbc06d290 0x7fdcbc070690 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:57616/0 (socket says 172.21.15.46:57616) 2023-07-05T18:56:27.700 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:27.696+0000 7fdcc0abb700 1 -- 172.21.15.46:0/2093969097 learned_addr learned my addr 172.21.15.46:0/2093969097 (peer_addr_for_me v1:172.21.15.46:0/0) 2023-07-05T18:56:27.700 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:27.696+0000 7fdcbbfff700 1 --2- 172.21.15.46:0/2093969097 >> v2:172.21.15.73:3300/0 conn(0x7fdcbc069e00 0x7fdcbc06a1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:56:27.701 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:27.696+0000 7fdcbb7fe700 1 -- 172.21.15.46:0/2093969097 >> v2:172.21.15.73:3300/0 conn(0x7fdcbc069e00 msgr2=0x7fdcbc06a1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-05T18:56:27.701 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:27.696+0000 7fdcbb7fe700 1 --2- 172.21.15.46:0/2093969097 >> v2:172.21.15.73:3300/0 conn(0x7fdcbc069e00 0x7fdcbc06a1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:27.701 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:27.696+0000 7fdcbb7fe700 1 -- 172.21.15.46:0/2093969097 >> v1:172.21.15.46:6789/0 conn(0x7fdcbc06d290 legacy=0x7fdcbc070690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:56:27.701 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:27.696+0000 7fdcbb7fe700 1 -- 172.21.15.46:0/2093969097 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdcbc06c8c0 con 0x7fdcbc15d740 2023-07-05T18:56:27.701 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:27.696+0000 7fdcbaffd700 1 -- 172.21.15.46:0/2093969097 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1891757086 0 0) 0x7fdcbc06c020 con 0x7fdcbc06d290 2023-07-05T18:56:27.701 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:27.696+0000 7fdcbb7fe700 1 --2- 172.21.15.46:0/2093969097 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fdcbc15d740 0x7fdcbc06cd50 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fdcbc070340 tx=0x7fdca4009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ea4dbccd82197e60 server_cookie=0 in_seq=0 out_seq=0 2023-07-05T18:56:27.701 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:27.696+0000 7fdcbaffd700 1 -- 172.21.15.46:0/2093969097 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdca4011830 con 0x7fdcbc15d740 2023-07-05T18:56:27.702 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:27.697+0000 7fdcbaffd700 1 -- 172.21.15.46:0/2093969097 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdca4011990 con 0x7fdcbc15d740 2023-07-05T18:56:27.702 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:27.697+0000 7fdcbaffd700 1 -- 172.21.15.46:0/2093969097 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdca4011d20 con 0x7fdcbc15d740 2023-07-05T18:56:27.702 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:27.697+0000 7fdcc251e700 1 -- 172.21.15.46:0/2093969097 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fdcbc15d740 msgr2=0x7fdcbc06cd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:56:27.702 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:27.697+0000 7fdcc251e700 1 --2- 172.21.15.46:0/2093969097 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fdcbc15d740 0x7fdcbc06cd50 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fdcbc070340 tx=0x7fdca4009b50 comp rx=0 tx=0).stop 2023-07-05T18:56:27.702 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:27.697+0000 7fdcc251e700 1 -- 172.21.15.46:0/2093969097 shutdown_connections 2023-07-05T18:56:27.702 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:27.697+0000 7fdcc251e700 1 --2- 172.21.15.46:0/2093969097 >> v2:172.21.15.73:3300/0 conn(0x7fdcbc069e00 0x7fdcbc06a1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:27.702 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:27.697+0000 7fdcc251e700 1 --2- 172.21.15.46:0/2093969097 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fdcbc15d740 0x7fdcbc06cd50 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:27.703 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:27.697+0000 7fdcc251e700 1 -- 172.21.15.46:0/2093969097 >> 172.21.15.46:0/2093969097 conn(0x7fdcbc0b1580 msgr2=0x7fdcbc0b1980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-05T18:56:27.703 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:27.697+0000 7fdcc251e700 1 -- 172.21.15.46:0/2093969097 shutdown_connections 2023-07-05T18:56:27.703 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:27.697+0000 7fdcc251e700 1 -- 172.21.15.46:0/2093969097 wait complete. 2023-07-05T18:56:27.705 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:27.698+0000 7fdcc251e700 1 Processor -- start 2023-07-05T18:56:27.705 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:27.698+0000 7fdcc251e700 1 -- start start 2023-07-05T18:56:27.705 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:27.699+0000 7fdcc251e700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fdcbc069e00 0x7fdcbc155790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:56:27.706 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:27.699+0000 7fdcc251e700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fdcbc06d290 0x7fdcbc15e3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:56:27.706 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:27.699+0000 7fdcc251e700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fdcbc15d740 0x7fdcbc154f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:56:27.706 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:27.699+0000 7fdcc251e700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdcbc159060 con 0x7fdcbc06d290 2023-07-05T18:56:27.706 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:27.699+0000 7fdcc251e700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdcbc158dc0 con 0x7fdcbc15d740 2023-07-05T18:56:27.706 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:27.699+0000 7fdcc251e700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdcbc156fb0 con 0x7fdcbc069e00 2023-07-05T18:56:27.706 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:27.699+0000 7fdcbb7fe700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fdcbc06d290 0x7fdcbc15e3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:56:27.707 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:27.699+0000 7fdcbb7fe700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fdcbc06d290 0x7fdcbc15e3c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:58348/0 (socket says 172.21.15.46:58348) 2023-07-05T18:56:27.707 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:27.699+0000 7fdcbb7fe700 1 -- 172.21.15.46:0/4018044895 learned_addr learned my addr 172.21.15.46:0/4018044895 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-07-05T18:56:27.707 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:27.699+0000 7fdcc0abb700 1 --2- 172.21.15.46:0/4018044895 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fdcbc15d740 0x7fdcbc154f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:56:27.707 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:27.699+0000 7fdcbbfff700 1 --2- 172.21.15.46:0/4018044895 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fdcbc069e00 0x7fdcbc155790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:56:27.707 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:27.700+0000 7fdcbb7fe700 1 -- 172.21.15.46:0/4018044895 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fdcbc069e00 msgr2=0x7fdcbc155790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:56:27.708 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:27.700+0000 7fdcbb7fe700 1 --2- 172.21.15.46:0/4018044895 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fdcbc069e00 0x7fdcbc155790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:27.708 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:27.700+0000 7fdcbb7fe700 1 -- 172.21.15.46:0/4018044895 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fdcbc15d740 msgr2=0x7fdcbc154f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:56:27.708 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:27.700+0000 7fdcbb7fe700 1 --2- 172.21.15.46:0/4018044895 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fdcbc15d740 0x7fdcbc154f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:27.708 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:27.700+0000 7fdcbb7fe700 1 -- 172.21.15.46:0/4018044895 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdca40094a0 con 0x7fdcbc06d290 2023-07-05T18:56:27.708 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:27.700+0000 7fdcbb7fe700 1 --2- 172.21.15.46:0/4018044895 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fdcbc06d290 0x7fdcbc15e3c0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fdca40090b0 tx=0x7fdca4004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-05T18:56:27.708 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:27.700+0000 7fdcb8ff9700 1 -- 172.21.15.46:0/4018044895 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdca4004510 con 0x7fdcbc06d290 2023-07-05T18:56:27.709 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:27.700+0000 7fdcb8ff9700 1 -- 172.21.15.46:0/4018044895 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdca40036a0 con 0x7fdcbc06d290 2023-07-05T18:56:27.709 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:27.700+0000 7fdcb8ff9700 1 -- 172.21.15.46:0/4018044895 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdca4003a10 con 0x7fdcbc06d290 2023-07-05T18:56:27.709 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:27.700+0000 7fdcc251e700 1 -- 172.21.15.46:0/4018044895 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdcbc157290 con 0x7fdcbc06d290 2023-07-05T18:56:27.709 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:27.700+0000 7fdcc251e700 1 -- 172.21.15.46:0/4018044895 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdcbc155f90 con 0x7fdcbc06d290 2023-07-05T18:56:27.709 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:27.701+0000 7fdcc251e700 1 -- 172.21.15.46:0/4018044895 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdcbc1577b0 con 0x7fdcbc06d290 2023-07-05T18:56:27.709 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:27.701+0000 7fdcb8ff9700 1 -- 172.21.15.46:0/4018044895 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fdca4003b70 con 0x7fdcbc06d290 2023-07-05T18:56:27.710 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:27.702+0000 7fdcb8ff9700 1 --2- 172.21.15.46:0/4018044895 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7fdc9c06ad10 0x7fdc9c06d1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:56:27.710 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:27.702+0000 7fdcb8ff9700 1 -- 172.21.15.46:0/4018044895 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fdca408a810 con 0x7fdcbc06d290 2023-07-05T18:56:27.710 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:27.702+0000 7fdcbbfff700 1 --2- 172.21.15.46:0/4018044895 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7fdc9c06ad10 0x7fdc9c06d1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:56:27.710 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:27.703+0000 7fdcbbfff700 1 --2- 172.21.15.46:0/4018044895 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7fdc9c06ad10 0x7fdc9c06d1c0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fdcac006b20 tx=0x7fdcac008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-05T18:56:27.711 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:27.707+0000 7fdcb8ff9700 1 -- 172.21.15.46:0/4018044895 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fdcbc1577b0 con 0x7fdcbc06d290 2023-07-05T18:56:27.904 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:27.902+0000 7fdcc251e700 1 -- 172.21.15.46:0/4018044895 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fdcbc1577b0 con 0x7fdcbc06d290 2023-07-05T18:56:27.904 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:27.902+0000 7fdcb8ff9700 1 -- 172.21.15.46:0/4018044895 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v21) v1 ==== 92+0+10 (secure 0 0 0) 0x7fdcbc1577b0 con 0x7fdcbc06d290 2023-07-05T18:56:27.905 INFO:teuthology.orchestra.run.smithi046.stdout:pg_num: 8 2023-07-05T18:56:27.906 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:27.904+0000 7fdcc251e700 1 -- 172.21.15.46:0/4018044895 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7fdc9c06ad10 msgr2=0x7fdc9c06d1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:56:27.906 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:27.904+0000 7fdcc251e700 1 --2- 172.21.15.46:0/4018044895 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7fdc9c06ad10 0x7fdc9c06d1c0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fdcac006b20 tx=0x7fdcac008040 comp rx=0 tx=0).stop 2023-07-05T18:56:27.906 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:27.904+0000 7fdcc251e700 1 -- 172.21.15.46:0/4018044895 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fdcbc06d290 msgr2=0x7fdcbc15e3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:56:27.907 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:27.904+0000 7fdcc251e700 1 --2- 172.21.15.46:0/4018044895 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fdcbc06d290 0x7fdcbc15e3c0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fdca40090b0 tx=0x7fdca4004750 comp rx=0 tx=0).stop 2023-07-05T18:56:27.907 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:27.904+0000 7fdcc251e700 1 -- 172.21.15.46:0/4018044895 shutdown_connections 2023-07-05T18:56:27.907 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:27.904+0000 7fdcc251e700 1 --2- 172.21.15.46:0/4018044895 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7fdc9c06ad10 0x7fdc9c06d1c0 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:27.907 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:27.904+0000 7fdcc251e700 1 --2- 172.21.15.46:0/4018044895 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fdcbc15d740 0x7fdcbc154f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:27.907 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:27.904+0000 7fdcc251e700 1 --2- 172.21.15.46:0/4018044895 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fdcbc069e00 0x7fdcbc155790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:27.908 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:27.904+0000 7fdcc251e700 1 --2- 172.21.15.46:0/4018044895 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fdcbc06d290 0x7fdcbc15e3c0 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:27.908 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:27.904+0000 7fdcc251e700 1 -- 172.21.15.46:0/4018044895 >> 172.21.15.46:0/4018044895 conn(0x7fdcbc0b1580 msgr2=0x7fdcbc0b1950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-05T18:56:27.908 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:27.904+0000 7fdcc251e700 1 -- 172.21.15.46:0/4018044895 shutdown_connections 2023-07-05T18:56:27.908 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:27.904+0000 7fdcc251e700 1 -- 172.21.15.46:0/4018044895 wait complete. 2023-07-05T18:56:27.919 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-07-05T18:56:28.048 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:28.046+0000 7fa4ae706700 1 Processor -- start 2023-07-05T18:56:28.048 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:28.046+0000 7fa4ae706700 1 -- start start 2023-07-05T18:56:28.056 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:28.047+0000 7fa4ae706700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fa4a815af40 0x7fa4a815e040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:56:28.057 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:28.047+0000 7fa4ae706700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fa4a80cd540 0x7fa4a815b310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:56:28.058 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:28.047+0000 7fa4ae706700 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa4a815e580 con 0x7fa4a80cd9c0 2023-07-05T18:56:28.058 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:28.047+0000 7fa4ae706700 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa4a80cb370 con 0x7fa4a815af40 2023-07-05T18:56:28.058 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:28.047+0000 7fa4ae706700 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa4a815a990 con 0x7fa4a80cd540 2023-07-05T18:56:28.058 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:28.047+0000 7fa4a7fff700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fa4a815af40 0x7fa4a815e040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:56:28.058 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:28.047+0000 7fa4acca3700 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7fa4a80cd9c0 0x7fa4a8069e00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:57630/0 (socket says 172.21.15.46:57630) 2023-07-05T18:56:28.058 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:28.047+0000 7fa4acca3700 1 -- 172.21.15.46:0/3459474011 learned_addr learned my addr 172.21.15.46:0/3459474011 (peer_addr_for_me v1:172.21.15.46:0/0) 2023-07-05T18:56:28.059 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:28.047+0000 7fa4a77fe700 1 --2- 172.21.15.46:0/3459474011 >> v2:172.21.15.73:3300/0 conn(0x7fa4a80cd540 0x7fa4a815b310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:56:28.059 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:28.047+0000 7fa4a6ffd700 1 -- 172.21.15.46:0/3459474011 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2131231024 0 0) 0x7fa4a815e580 con 0x7fa4a80cd9c0 2023-07-05T18:56:28.059 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:28.047+0000 7fa4a6ffd700 1 -- 172.21.15.46:0/3459474011 --> v1:172.21.15.46:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa4900035b0 con 0x7fa4a80cd9c0 2023-07-05T18:56:28.059 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:28.047+0000 7fa4a7fff700 1 -- 172.21.15.46:0/3459474011 >> v2:172.21.15.73:3300/0 conn(0x7fa4a80cd540 msgr2=0x7fa4a815b310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-05T18:56:28.059 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:28.047+0000 7fa4a7fff700 1 --2- 172.21.15.46:0/3459474011 >> v2:172.21.15.73:3300/0 conn(0x7fa4a80cd540 0x7fa4a815b310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:28.059 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:28.047+0000 7fa4a7fff700 1 -- 172.21.15.46:0/3459474011 >> v1:172.21.15.46:6789/0 conn(0x7fa4a80cd9c0 legacy=0x7fa4a8069e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:56:28.059 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:28.047+0000 7fa4a7fff700 1 -- 172.21.15.46:0/3459474011 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa4a815e800 con 0x7fa4a815af40 2023-07-05T18:56:28.059 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:28.047+0000 7fa4a7fff700 1 --2- 172.21.15.46:0/3459474011 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa4a815af40 0x7fa4a815e040 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fa4a8070ec0 tx=0x7fa498009b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4e920c45728073c8 server_cookie=0 in_seq=0 out_seq=0 2023-07-05T18:56:28.060 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:28.047+0000 7fa4a6ffd700 1 -- 172.21.15.46:0/3459474011 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa498011830 con 0x7fa4a815af40 2023-07-05T18:56:28.060 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:28.047+0000 7fa4a6ffd700 1 -- 172.21.15.46:0/3459474011 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa498011990 con 0x7fa4a815af40 2023-07-05T18:56:28.060 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:28.048+0000 7fa4a6ffd700 1 -- 172.21.15.46:0/3459474011 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa498011d20 con 0x7fa4a815af40 2023-07-05T18:56:28.060 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:28.048+0000 7fa4ae706700 1 -- 172.21.15.46:0/3459474011 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa4a815af40 msgr2=0x7fa4a815e040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:56:28.060 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:28.048+0000 7fa4ae706700 1 --2- 172.21.15.46:0/3459474011 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa4a815af40 0x7fa4a815e040 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fa4a8070ec0 tx=0x7fa498009b20 comp rx=0 tx=0).stop 2023-07-05T18:56:28.061 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:28.048+0000 7fa4ae706700 1 -- 172.21.15.46:0/3459474011 shutdown_connections 2023-07-05T18:56:28.061 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:28.048+0000 7fa4ae706700 1 --2- 172.21.15.46:0/3459474011 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa4a815af40 0x7fa4a815e040 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:28.061 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:28.048+0000 7fa4ae706700 1 --2- 172.21.15.46:0/3459474011 >> v2:172.21.15.73:3300/0 conn(0x7fa4a80cd540 0x7fa4a815b310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:28.061 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:28.048+0000 7fa4ae706700 1 -- 172.21.15.46:0/3459474011 >> 172.21.15.46:0/3459474011 conn(0x7fa4a806bba0 msgr2=0x7fa4a80cc3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-05T18:56:28.061 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:28.048+0000 7fa4ae706700 1 -- 172.21.15.46:0/3459474011 shutdown_connections 2023-07-05T18:56:28.062 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:28.048+0000 7fa4ae706700 1 -- 172.21.15.46:0/3459474011 wait complete. 2023-07-05T18:56:28.062 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:28.049+0000 7fa4ae706700 1 Processor -- start 2023-07-05T18:56:28.062 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:28.049+0000 7fa4ae706700 1 -- start start 2023-07-05T18:56:28.062 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:28.050+0000 7fa4ae706700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fa4a80cd540 0x7fa4a80aea20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:56:28.062 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:28.050+0000 7fa4ae706700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa4a80cd9c0 0x7fa4a80adb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:56:28.062 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:28.050+0000 7fa4ae706700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa4a815af40 0x7fa4a80c6a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:56:28.063 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:28.050+0000 7fa4ae706700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4a80af040 con 0x7fa4a80cd9c0 2023-07-05T18:56:28.063 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:28.050+0000 7fa4ae706700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4a80ae0d0 con 0x7fa4a815af40 2023-07-05T18:56:28.063 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:28.050+0000 7fa4ae706700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa4a80c6f80 con 0x7fa4a80cd540 2023-07-05T18:56:28.063 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:28.050+0000 7fa4a77fe700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa4a80cd9c0 0x7fa4a80adb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:56:28.063 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:28.050+0000 7fa4a77fe700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa4a80cd9c0 0x7fa4a80adb90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:58364/0 (socket says 172.21.15.46:58364) 2023-07-05T18:56:28.063 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:28.050+0000 7fa4a77fe700 1 -- 172.21.15.46:0/3617602929 learned_addr learned my addr 172.21.15.46:0/3617602929 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-07-05T18:56:28.063 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:28.050+0000 7fa4acca3700 1 --2- 172.21.15.46:0/3617602929 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa4a815af40 0x7fa4a80c6a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:56:28.064 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:28.050+0000 7fa4a7fff700 1 --2- 172.21.15.46:0/3617602929 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fa4a80cd540 0x7fa4a80aea20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:56:28.064 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:28.051+0000 7fa4a77fe700 1 -- 172.21.15.46:0/3617602929 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fa4a80cd540 msgr2=0x7fa4a80aea20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:56:28.064 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:28.051+0000 7fa4a77fe700 1 --2- 172.21.15.46:0/3617602929 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fa4a80cd540 0x7fa4a80aea20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:28.064 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:28.051+0000 7fa4a77fe700 1 -- 172.21.15.46:0/3617602929 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa4a815af40 msgr2=0x7fa4a80c6a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:56:28.064 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:28.051+0000 7fa4a77fe700 1 --2- 172.21.15.46:0/3617602929 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa4a815af40 0x7fa4a80c6a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:28.064 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:28.051+0000 7fa4a77fe700 1 -- 172.21.15.46:0/3617602929 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa4980094a0 con 0x7fa4a80cd9c0 2023-07-05T18:56:28.064 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:28.051+0000 7fa4a77fe700 1 --2- 172.21.15.46:0/3617602929 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa4a80cd9c0 0x7fa4a80adb90 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fa49c00e9b0 tx=0x7fa49c00ecc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-05T18:56:28.065 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:28.051+0000 7fa4a4ff9700 1 -- 172.21.15.46:0/3617602929 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa49c009710 con 0x7fa4a80cd9c0 2023-07-05T18:56:28.065 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:28.051+0000 7fa4a4ff9700 1 -- 172.21.15.46:0/3617602929 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa49c00ee50 con 0x7fa4a80cd9c0 2023-07-05T18:56:28.065 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:28.051+0000 7fa4ae706700 1 -- 172.21.15.46:0/3617602929 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa4a80c73f0 con 0x7fa4a80cd9c0 2023-07-05T18:56:28.065 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:28.051+0000 7fa4a4ff9700 1 -- 172.21.15.46:0/3617602929 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa49c00ca50 con 0x7fa4a80cd9c0 2023-07-05T18:56:28.065 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:28.051+0000 7fa4ae706700 1 -- 172.21.15.46:0/3617602929 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa4a80c79b0 con 0x7fa4a80cd9c0 2023-07-05T18:56:28.065 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:28.052+0000 7fa4ae706700 1 -- 172.21.15.46:0/3617602929 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa4a80672e0 con 0x7fa4a80cd9c0 2023-07-05T18:56:28.065 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:28.053+0000 7fa4a4ff9700 1 -- 172.21.15.46:0/3617602929 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fa49c00cbb0 con 0x7fa4a80cd9c0 2023-07-05T18:56:28.066 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:28.053+0000 7fa4a4ff9700 1 --2- 172.21.15.46:0/3617602929 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7fa49406ace0 0x7fa49406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:56:28.066 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:28.053+0000 7fa4a4ff9700 1 -- 172.21.15.46:0/3617602929 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fa49c089410 con 0x7fa4a80cd9c0 2023-07-05T18:56:28.066 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:28.053+0000 7fa4a7fff700 1 --2- 172.21.15.46:0/3617602929 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7fa49406ace0 0x7fa49406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:56:28.066 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:28.054+0000 7fa4a7fff700 1 --2- 172.21.15.46:0/3617602929 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7fa49406ace0 0x7fa49406d190 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fa4980090b0 tx=0x7fa49801c040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-05T18:56:28.066 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:28.057+0000 7fa4a4ff9700 1 -- 172.21.15.46:0/3617602929 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fa49c057fe0 con 0x7fa4a80cd9c0 2023-07-05T18:56:28.257 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:28.255+0000 7fa4ae706700 1 -- 172.21.15.46:0/3617602929 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fa4a80af180 con 0x7fa4a80cd9c0 2023-07-05T18:56:28.257 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:28.255+0000 7fa4a4ff9700 1 -- 172.21.15.46:0/3617602929 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v21) v1 ==== 93+0+10 (secure 0 0 0) 0x7fa49c00ce60 con 0x7fa4a80cd9c0 2023-07-05T18:56:28.257 INFO:teuthology.orchestra.run.smithi046.stdout:pg_num: 1 2023-07-05T18:56:28.259 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:28.257+0000 7fa4ae706700 1 -- 172.21.15.46:0/3617602929 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7fa49406ace0 msgr2=0x7fa49406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:56:28.260 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:28.257+0000 7fa4ae706700 1 --2- 172.21.15.46:0/3617602929 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7fa49406ace0 0x7fa49406d190 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fa4980090b0 tx=0x7fa49801c040 comp rx=0 tx=0).stop 2023-07-05T18:56:28.260 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:28.257+0000 7fa4ae706700 1 -- 172.21.15.46:0/3617602929 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa4a80cd9c0 msgr2=0x7fa4a80adb90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:56:28.260 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:28.257+0000 7fa4ae706700 1 --2- 172.21.15.46:0/3617602929 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa4a80cd9c0 0x7fa4a80adb90 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fa49c00e9b0 tx=0x7fa49c00ecc0 comp rx=0 tx=0).stop 2023-07-05T18:56:28.260 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:28.257+0000 7fa4ae706700 1 -- 172.21.15.46:0/3617602929 shutdown_connections 2023-07-05T18:56:28.260 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:28.257+0000 7fa4ae706700 1 --2- 172.21.15.46:0/3617602929 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7fa49406ace0 0x7fa49406d190 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:28.261 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:28.257+0000 7fa4ae706700 1 --2- 172.21.15.46:0/3617602929 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa4a815af40 0x7fa4a80c6a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:28.261 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:28.257+0000 7fa4ae706700 1 --2- 172.21.15.46:0/3617602929 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fa4a80cd540 0x7fa4a80aea20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:28.261 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:28.257+0000 7fa4ae706700 1 --2- 172.21.15.46:0/3617602929 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa4a80cd9c0 0x7fa4a80adb90 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:28.261 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:28.257+0000 7fa4ae706700 1 -- 172.21.15.46:0/3617602929 >> 172.21.15.46:0/3617602929 conn(0x7fa4a806bba0 msgr2=0x7fa4a80cf870 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-05T18:56:28.261 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:28.257+0000 7fa4ae706700 1 -- 172.21.15.46:0/3617602929 shutdown_connections 2023-07-05T18:56:28.261 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:28.257+0000 7fa4ae706700 1 -- 172.21.15.46:0/3617602929 wait complete. 2023-07-05T18:56:28.277 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-07-05T18:56:28.404 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:28.402+0000 7f9ace02f700 1 Processor -- start 2023-07-05T18:56:28.407 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:28.402+0000 7f9ace02f700 1 -- start start 2023-07-05T18:56:28.407 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:28.403+0000 7f9ace02f700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f9ac81594f0 0x7f9ac80cd690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:56:28.408 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:28.403+0000 7f9ace02f700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f9ac80cdbd0 0x7f9ac80b13f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:56:28.409 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:28.403+0000 7f9ace02f700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f9ac80b1930 0x7f9ac8070620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:56:28.409 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:28.403+0000 7f9ace02f700 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9ac80ce200 con 0x7f9ac80cdbd0 2023-07-05T18:56:28.409 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:28.403+0000 7f9ace02f700 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9ac815e040 con 0x7f9ac80b1930 2023-07-05T18:56:28.409 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:28.403+0000 7f9ace02f700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9ac815dbb0 con 0x7f9ac81594f0 2023-07-05T18:56:28.410 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:28.403+0000 7f9ac6ffd700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f9ac80cdbd0 0x7f9ac80b13f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:56:28.410 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:28.403+0000 7f9ac6ffd700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f9ac80cdbd0 0x7f9ac80b13f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:58368/0 (socket says 172.21.15.46:58368) 2023-07-05T18:56:28.410 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:28.403+0000 7f9ac6ffd700 1 -- 172.21.15.46:0/4118917246 learned_addr learned my addr 172.21.15.46:0/4118917246 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-07-05T18:56:28.410 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:28.404+0000 7f9ac7fff700 1 --2- 172.21.15.46:0/4118917246 >> v2:172.21.15.73:3300/0 conn(0x7f9ac80b1930 0x7f9ac8070620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:56:28.410 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:28.404+0000 7f9ac77fe700 1 --2- 172.21.15.46:0/4118917246 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f9ac81594f0 0x7f9ac80cd690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:56:28.410 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:28.404+0000 7f9ac6ffd700 1 -- 172.21.15.46:0/4118917246 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f9ac81594f0 msgr2=0x7f9ac80cd690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-05T18:56:28.410 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:28.404+0000 7f9ac6ffd700 1 --2- 172.21.15.46:0/4118917246 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f9ac81594f0 0x7f9ac80cd690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:28.411 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:28.404+0000 7f9ac6ffd700 1 -- 172.21.15.46:0/4118917246 >> v2:172.21.15.73:3300/0 conn(0x7f9ac80b1930 msgr2=0x7f9ac8070620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-05T18:56:28.411 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:28.404+0000 7f9ac6ffd700 1 --2- 172.21.15.46:0/4118917246 >> v2:172.21.15.73:3300/0 conn(0x7f9ac80b1930 0x7f9ac8070620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:28.411 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:28.404+0000 7f9ac6ffd700 1 -- 172.21.15.46:0/4118917246 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ac80b1d20 con 0x7f9ac80cdbd0 2023-07-05T18:56:28.411 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:28.404+0000 7f9ac6ffd700 1 --2- 172.21.15.46:0/4118917246 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9ac80cdbd0 0x7f9ac80b13f0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f9ac8066a40 tx=0x7f9ab0009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5c26784652ac3d00 server_cookie=0 in_seq=0 out_seq=0 2023-07-05T18:56:28.411 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:28.404+0000 7f9ac67fc700 1 -- 172.21.15.46:0/4118917246 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ab000b870 con 0x7f9ac80cdbd0 2023-07-05T18:56:28.411 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:28.404+0000 7f9ac67fc700 1 -- 172.21.15.46:0/4118917246 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9ab000b9d0 con 0x7f9ac80cdbd0 2023-07-05T18:56:28.412 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:28.404+0000 7f9ac67fc700 1 -- 172.21.15.46:0/4118917246 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ab000bd60 con 0x7f9ac80cdbd0 2023-07-05T18:56:28.412 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:28.405+0000 7f9ace02f700 1 -- 172.21.15.46:0/4118917246 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9ac80cdbd0 msgr2=0x7f9ac80b13f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:56:28.413 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:28.405+0000 7f9ace02f700 1 --2- 172.21.15.46:0/4118917246 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9ac80cdbd0 0x7f9ac80b13f0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f9ac8066a40 tx=0x7f9ab0009bd0 comp rx=0 tx=0).stop 2023-07-05T18:56:28.417 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:28.405+0000 7f9ace02f700 1 -- 172.21.15.46:0/4118917246 shutdown_connections 2023-07-05T18:56:28.418 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:28.405+0000 7f9ace02f700 1 --2- 172.21.15.46:0/4118917246 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f9ac81594f0 0x7f9ac80cd690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:28.418 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:28.405+0000 7f9ace02f700 1 --2- 172.21.15.46:0/4118917246 >> v2:172.21.15.73:3300/0 conn(0x7f9ac80b1930 0x7f9ac8070620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:28.418 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:28.405+0000 7f9ace02f700 1 --2- 172.21.15.46:0/4118917246 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9ac80cdbd0 0x7f9ac80b13f0 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:28.418 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:28.405+0000 7f9ace02f700 1 -- 172.21.15.46:0/4118917246 >> 172.21.15.46:0/4118917246 conn(0x7f9ac806bba0 msgr2=0x7f9ac80cc3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-05T18:56:28.418 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:28.405+0000 7f9ace02f700 1 -- 172.21.15.46:0/4118917246 shutdown_connections 2023-07-05T18:56:28.418 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:28.405+0000 7f9ace02f700 1 -- 172.21.15.46:0/4118917246 wait complete. 2023-07-05T18:56:28.421 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:28.406+0000 7f9ace02f700 1 Processor -- start 2023-07-05T18:56:28.421 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:28.407+0000 7f9ace02f700 1 -- start start 2023-07-05T18:56:28.422 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:28.407+0000 7f9ace02f700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9ac80b1930 0x7f9ac81efda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:56:28.422 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:28.407+0000 7f9ace02f700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9ac80cdbd0 0x7f9ac8157c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:56:28.422 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:28.407+0000 7f9ace02f700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f9ac81594f0 0x7f9ac8158160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:56:28.422 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:28.407+0000 7f9ace02f700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ac8157710 con 0x7f9ac80cdbd0 2023-07-05T18:56:28.422 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:28.407+0000 7f9ace02f700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ac8158da0 con 0x7f9ac80b1930 2023-07-05T18:56:28.422 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:28.407+0000 7f9ace02f700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9ac81f02e0 con 0x7f9ac81594f0 2023-07-05T18:56:28.423 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:28.408+0000 7f9ac6ffd700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9ac80cdbd0 0x7f9ac8157c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:56:28.423 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:28.408+0000 7f9ac6ffd700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9ac80cdbd0 0x7f9ac8157c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:58376/0 (socket says 172.21.15.46:58376) 2023-07-05T18:56:28.423 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:28.408+0000 7f9ac6ffd700 1 -- 172.21.15.46:0/1580736189 learned_addr learned my addr 172.21.15.46:0/1580736189 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-07-05T18:56:28.423 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:28.408+0000 7f9ac77fe700 1 --2- 172.21.15.46:0/1580736189 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9ac80b1930 0x7f9ac81efda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:56:28.423 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:28.408+0000 7f9ac7fff700 1 --2- 172.21.15.46:0/1580736189 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f9ac81594f0 0x7f9ac8158160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:56:28.423 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:28.408+0000 7f9ac6ffd700 1 -- 172.21.15.46:0/1580736189 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f9ac81594f0 msgr2=0x7f9ac8158160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:56:28.423 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:28.408+0000 7f9ac6ffd700 1 --2- 172.21.15.46:0/1580736189 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f9ac81594f0 0x7f9ac8158160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:28.424 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:28.408+0000 7f9ac6ffd700 1 -- 172.21.15.46:0/1580736189 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9ac80b1930 msgr2=0x7f9ac81efda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:56:28.424 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:28.408+0000 7f9ac6ffd700 1 --2- 172.21.15.46:0/1580736189 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9ac80b1930 0x7f9ac81efda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:28.424 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:28.408+0000 7f9ac6ffd700 1 -- 172.21.15.46:0/1580736189 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ab0009550 con 0x7f9ac80cdbd0 2023-07-05T18:56:28.424 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:28.408+0000 7f9ac6ffd700 1 --2- 172.21.15.46:0/1580736189 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9ac80cdbd0 0x7f9ac8157c20 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f9ab0000c00 tx=0x7f9ab0004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-05T18:56:28.424 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:28.408+0000 7f9abffff700 1 -- 172.21.15.46:0/1580736189 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ab0004480 con 0x7f9ac80cdbd0 2023-07-05T18:56:28.424 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:28.408+0000 7f9abffff700 1 -- 172.21.15.46:0/1580736189 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9ab00045e0 con 0x7f9ac80cdbd0 2023-07-05T18:56:28.424 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:28.408+0000 7f9ace02f700 1 -- 172.21.15.46:0/1580736189 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9ac81587e0 con 0x7f9ac80cdbd0 2023-07-05T18:56:28.425 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:28.408+0000 7f9abffff700 1 -- 172.21.15.46:0/1580736189 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ab00038e0 con 0x7f9ac80cdbd0 2023-07-05T18:56:28.425 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:28.408+0000 7f9ace02f700 1 -- 172.21.15.46:0/1580736189 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9ac80b3990 con 0x7f9ac80cdbd0 2023-07-05T18:56:28.425 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:28.409+0000 7f9ace02f700 1 -- 172.21.15.46:0/1580736189 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9ac80b37f0 con 0x7f9ac80cdbd0 2023-07-05T18:56:28.425 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:28.410+0000 7f9abffff700 1 -- 172.21.15.46:0/1580736189 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f9ab0021070 con 0x7f9ac80cdbd0 2023-07-05T18:56:28.425 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:28.410+0000 7f9abffff700 1 --2- 172.21.15.46:0/1580736189 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7f9aa806ace0 0x7f9aa806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:56:28.425 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:28.410+0000 7f9abffff700 1 -- 172.21.15.46:0/1580736189 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f9ab008aa20 con 0x7f9ac80cdbd0 2023-07-05T18:56:28.425 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:28.410+0000 7f9ac77fe700 1 --2- 172.21.15.46:0/1580736189 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7f9aa806ace0 0x7f9aa806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:56:28.426 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:28.411+0000 7f9ac77fe700 1 --2- 172.21.15.46:0/1580736189 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7f9aa806ace0 0x7f9aa806d190 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f9ab800ab60 tx=0x7f9ab8008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-05T18:56:28.426 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:28.414+0000 7f9abffff700 1 -- 172.21.15.46:0/1580736189 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f9ac80b37f0 con 0x7f9ac80cdbd0 2023-07-05T18:56:28.621 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:28.618+0000 7f9ace02f700 1 -- 172.21.15.46:0/1580736189 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f9ac80b37f0 con 0x7f9ac80cdbd0 2023-07-05T18:56:28.621 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:28.619+0000 7f9abffff700 1 -- 172.21.15.46:0/1580736189 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v21) v1 ==== 104+0+11 (secure 0 0 0) 0x7f9ac80b37f0 con 0x7f9ac80cdbd0 2023-07-05T18:56:28.622 INFO:teuthology.orchestra.run.smithi046.stdout:pg_num: 32 2023-07-05T18:56:28.624 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:28.621+0000 7f9ace02f700 1 -- 172.21.15.46:0/1580736189 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7f9aa806ace0 msgr2=0x7f9aa806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:56:28.624 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:28.621+0000 7f9ace02f700 1 --2- 172.21.15.46:0/1580736189 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7f9aa806ace0 0x7f9aa806d190 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f9ab800ab60 tx=0x7f9ab8008040 comp rx=0 tx=0).stop 2023-07-05T18:56:28.624 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:28.621+0000 7f9ace02f700 1 -- 172.21.15.46:0/1580736189 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9ac80cdbd0 msgr2=0x7f9ac8157c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:56:28.624 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:28.621+0000 7f9ace02f700 1 --2- 172.21.15.46:0/1580736189 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9ac80cdbd0 0x7f9ac8157c20 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f9ab0000c00 tx=0x7f9ab0004750 comp rx=0 tx=0).stop 2023-07-05T18:56:28.625 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:28.621+0000 7f9ace02f700 1 -- 172.21.15.46:0/1580736189 shutdown_connections 2023-07-05T18:56:28.625 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:28.621+0000 7f9ace02f700 1 --2- 172.21.15.46:0/1580736189 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7f9aa806ace0 0x7f9aa806d190 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:28.625 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:28.621+0000 7f9ace02f700 1 --2- 172.21.15.46:0/1580736189 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f9ac81594f0 0x7f9ac8158160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:28.625 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:28.621+0000 7f9ace02f700 1 --2- 172.21.15.46:0/1580736189 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9ac80b1930 0x7f9ac81efda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:28.625 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:28.621+0000 7f9ace02f700 1 --2- 172.21.15.46:0/1580736189 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9ac80cdbd0 0x7f9ac8157c20 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:28.625 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:28.621+0000 7f9ace02f700 1 -- 172.21.15.46:0/1580736189 >> 172.21.15.46:0/1580736189 conn(0x7f9ac806bba0 msgr2=0x7f9ac806c1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-05T18:56:28.625 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:28.621+0000 7f9ace02f700 1 -- 172.21.15.46:0/1580736189 shutdown_connections 2023-07-05T18:56:28.625 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:28.621+0000 7f9ace02f700 1 -- 172.21.15.46:0/1580736189 wait complete. 2023-07-05T18:56:28.635 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-07-05T18:56:28.764 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:28.760+0000 7ff8c8625700 1 Processor -- start 2023-07-05T18:56:28.764 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:28.760+0000 7ff8c8625700 1 -- start start 2023-07-05T18:56:28.764 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:28.761+0000 7ff8c8625700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7ff8c015af40 0x7ff8c015e040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:56:28.764 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:28.761+0000 7ff8c8625700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7ff8c00cd9c0 0x7ff8c0069e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:56:28.765 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:28.761+0000 7ff8c8625700 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff8c015ba20 con 0x7ff8c00cd540 2023-07-05T18:56:28.765 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:28.761+0000 7ff8c8625700 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff8c00cb370 con 0x7ff8c00cd9c0 2023-07-05T18:56:28.765 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:28.761+0000 7ff8c8625700 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff8c015a990 con 0x7ff8c015af40 2023-07-05T18:56:28.765 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:28.762+0000 7ff8c6bc2700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7ff8c00cd9c0 0x7ff8c0069e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:56:28.765 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:28.762+0000 7ff8c5bc0700 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7ff8c00cd540 0x7ff8c015b310 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:57654/0 (socket says 172.21.15.46:57654) 2023-07-05T18:56:28.765 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:28.762+0000 7ff8c5bc0700 1 -- 172.21.15.46:0/542385380 learned_addr learned my addr 172.21.15.46:0/542385380 (peer_addr_for_me v1:172.21.15.46:0/0) 2023-07-05T18:56:28.766 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:28.762+0000 7ff8c63c1700 1 --2- 172.21.15.46:0/542385380 >> v2:172.21.15.73:3300/0 conn(0x7ff8c015af40 0x7ff8c015e040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:56:28.766 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:28.762+0000 7ff8c6bc2700 1 -- 172.21.15.46:0/542385380 >> v2:172.21.15.73:3300/0 conn(0x7ff8c015af40 msgr2=0x7ff8c015e040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-05T18:56:28.766 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:28.762+0000 7ff8c6bc2700 1 --2- 172.21.15.46:0/542385380 >> v2:172.21.15.73:3300/0 conn(0x7ff8c015af40 0x7ff8c015e040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:28.766 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:28.762+0000 7ff8c6bc2700 1 -- 172.21.15.46:0/542385380 >> v1:172.21.15.46:6789/0 conn(0x7ff8c00cd540 legacy=0x7ff8c015b310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:56:28.766 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:28.762+0000 7ff8c53bf700 1 -- 172.21.15.46:0/542385380 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1227812524 0 0) 0x7ff8c015ba20 con 0x7ff8c00cd540 2023-07-05T18:56:28.766 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:28.762+0000 7ff8c6bc2700 1 -- 172.21.15.46:0/542385380 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff8c015e580 con 0x7ff8c00cd9c0 2023-07-05T18:56:28.766 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:28.762+0000 7ff8c6bc2700 1 --2- 172.21.15.46:0/542385380 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff8c00cd9c0 0x7ff8c0069e00 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7ff8c00725c0 tx=0x7ff8b800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=373fb6121296932c server_cookie=0 in_seq=0 out_seq=0 2023-07-05T18:56:28.767 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:28.762+0000 7ff8c53bf700 1 -- 172.21.15.46:0/542385380 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8b800bca0 con 0x7ff8c00cd9c0 2023-07-05T18:56:28.767 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:28.762+0000 7ff8c53bf700 1 -- 172.21.15.46:0/542385380 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff8b800be00 con 0x7ff8c00cd9c0 2023-07-05T18:56:28.767 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:28.762+0000 7ff8c53bf700 1 -- 172.21.15.46:0/542385380 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8b8003c60 con 0x7ff8c00cd9c0 2023-07-05T18:56:28.769 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:28.763+0000 7ff8c8625700 1 -- 172.21.15.46:0/542385380 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff8c00cd9c0 msgr2=0x7ff8c0069e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:56:28.769 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:28.763+0000 7ff8c8625700 1 --2- 172.21.15.46:0/542385380 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff8c00cd9c0 0x7ff8c0069e00 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7ff8c00725c0 tx=0x7ff8b800b330 comp rx=0 tx=0).stop 2023-07-05T18:56:28.770 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:28.763+0000 7ff8c8625700 1 -- 172.21.15.46:0/542385380 shutdown_connections 2023-07-05T18:56:28.770 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:28.763+0000 7ff8c8625700 1 --2- 172.21.15.46:0/542385380 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff8c00cd9c0 0x7ff8c0069e00 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:28.770 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:28.763+0000 7ff8c8625700 1 --2- 172.21.15.46:0/542385380 >> v2:172.21.15.73:3300/0 conn(0x7ff8c015af40 0x7ff8c015e040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:28.770 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:28.763+0000 7ff8c8625700 1 -- 172.21.15.46:0/542385380 >> 172.21.15.46:0/542385380 conn(0x7ff8c006bba0 msgr2=0x7ff8c00cc3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-05T18:56:28.770 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:28.763+0000 7ff8c8625700 1 -- 172.21.15.46:0/542385380 shutdown_connections 2023-07-05T18:56:28.770 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:28.763+0000 7ff8c8625700 1 -- 172.21.15.46:0/542385380 wait complete. 2023-07-05T18:56:28.770 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:28.764+0000 7ff8c8625700 1 Processor -- start 2023-07-05T18:56:28.771 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:28.764+0000 7ff8c8625700 1 -- start start 2023-07-05T18:56:28.771 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:28.765+0000 7ff8c8625700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7ff8c00cd540 0x7ff8c01ee630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:56:28.771 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:28.765+0000 7ff8c8625700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff8c00cd9c0 0x7ff8c014fd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:56:28.771 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:28.765+0000 7ff8c8625700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff8c015af40 0x7ff8c01f10d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:56:28.771 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:28.765+0000 7ff8c8625700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8c01f1c40 con 0x7ff8c00cd9c0 2023-07-05T18:56:28.771 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:28.765+0000 7ff8c8625700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8c01f1f20 con 0x7ff8c015af40 2023-07-05T18:56:28.771 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:28.765+0000 7ff8c8625700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff8c01ede30 con 0x7ff8c00cd540 2023-07-05T18:56:28.772 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:28.765+0000 7ff8c5bc0700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff8c00cd9c0 0x7ff8c014fd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:56:28.772 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:28.765+0000 7ff8c5bc0700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff8c00cd9c0 0x7ff8c014fd80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:58390/0 (socket says 172.21.15.46:58390) 2023-07-05T18:56:28.772 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:28.765+0000 7ff8c5bc0700 1 -- 172.21.15.46:0/4257563256 learned_addr learned my addr 172.21.15.46:0/4257563256 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-07-05T18:56:28.772 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:28.765+0000 7ff8c6bc2700 1 --2- 172.21.15.46:0/4257563256 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff8c015af40 0x7ff8c01f10d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:56:28.772 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:28.765+0000 7ff8c5bc0700 1 -- 172.21.15.46:0/4257563256 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7ff8c00cd540 msgr2=0x7ff8c01ee630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:56:28.772 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:28.765+0000 7ff8c5bc0700 1 --2- 172.21.15.46:0/4257563256 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7ff8c00cd540 0x7ff8c01ee630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:28.772 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:28.765+0000 7ff8c5bc0700 1 -- 172.21.15.46:0/4257563256 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff8c015af40 msgr2=0x7ff8c01f10d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:56:28.773 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:28.765+0000 7ff8c5bc0700 1 --2- 172.21.15.46:0/4257563256 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff8c015af40 0x7ff8c01f10d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:28.773 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:28.765+0000 7ff8c5bc0700 1 -- 172.21.15.46:0/4257563256 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff8b8009a70 con 0x7ff8c00cd9c0 2023-07-05T18:56:28.773 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:28.765+0000 7ff8c5bc0700 1 --2- 172.21.15.46:0/4257563256 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff8c00cd9c0 0x7ff8c014fd80 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7ff8b00011e0 tx=0x7ff8b000cae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-05T18:56:28.773 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:28.765+0000 7ff8b6ffd700 1 -- 172.21.15.46:0/4257563256 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8b0004c80 con 0x7ff8c00cd9c0 2023-07-05T18:56:28.773 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:28.765+0000 7ff8b6ffd700 1 -- 172.21.15.46:0/4257563256 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff8b0004e00 con 0x7ff8c00cd9c0 2023-07-05T18:56:28.773 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:28.765+0000 7ff8b6ffd700 1 -- 172.21.15.46:0/4257563256 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8b0007310 con 0x7ff8c00cd9c0 2023-07-05T18:56:28.773 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:28.765+0000 7ff8c8625700 1 -- 172.21.15.46:0/4257563256 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff8c01ee110 con 0x7ff8c00cd9c0 2023-07-05T18:56:28.773 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:28.765+0000 7ff8c8625700 1 -- 172.21.15.46:0/4257563256 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff8c01edab0 con 0x7ff8c00cd9c0 2023-07-05T18:56:28.774 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:28.766+0000 7ff8c8625700 1 -- 172.21.15.46:0/4257563256 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff8c01ee350 con 0x7ff8c00cd9c0 2023-07-05T18:56:28.774 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:28.767+0000 7ff8b6ffd700 1 -- 172.21.15.46:0/4257563256 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7ff8b0007470 con 0x7ff8c00cd9c0 2023-07-05T18:56:28.774 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:28.767+0000 7ff8b6ffd700 1 --2- 172.21.15.46:0/4257563256 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7ff8a406ace0 0x7ff8a406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:56:28.774 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:28.767+0000 7ff8b6ffd700 1 -- 172.21.15.46:0/4257563256 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6062+0+0 (secure 0 0 0) 0x7ff8b0089270 con 0x7ff8c00cd9c0 2023-07-05T18:56:28.774 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:28.767+0000 7ff8c63c1700 1 --2- 172.21.15.46:0/4257563256 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7ff8a406ace0 0x7ff8a406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:56:28.774 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:28.768+0000 7ff8c63c1700 1 --2- 172.21.15.46:0/4257563256 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7ff8a406ace0 0x7ff8a406d190 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7ff8bc006b20 tx=0x7ff8bc006ab0 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-05T18:56:28.775 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:28.772+0000 7ff8b6ffd700 1 -- 172.21.15.46:0/4257563256 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7ff8c01ee350 con 0x7ff8c00cd9c0 2023-07-05T18:56:28.972 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:28.966+0000 7ff8c8625700 1 -- 172.21.15.46:0/4257563256 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7ff8c01ee350 con 0x7ff8c00cd9c0 2023-07-05T18:56:28.972 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:28.967+0000 7ff8b6ffd700 1 -- 172.21.15.46:0/4257563256 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v21) v1 ==== 100+0+11 (secure 0 0 0) 0x7ff8c01ee350 con 0x7ff8c00cd9c0 2023-07-05T18:56:28.973 INFO:teuthology.orchestra.run.smithi046.stdout:pg_num: 64 2023-07-05T18:56:28.973 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:28.969+0000 7ff8c8625700 1 -- 172.21.15.46:0/4257563256 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7ff8a406ace0 msgr2=0x7ff8a406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:56:28.974 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:28.969+0000 7ff8c8625700 1 --2- 172.21.15.46:0/4257563256 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7ff8a406ace0 0x7ff8a406d190 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7ff8bc006b20 tx=0x7ff8bc006ab0 comp rx=0 tx=0).stop 2023-07-05T18:56:28.974 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:28.969+0000 7ff8c8625700 1 -- 172.21.15.46:0/4257563256 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff8c00cd9c0 msgr2=0x7ff8c014fd80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:56:28.974 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:28.969+0000 7ff8c8625700 1 --2- 172.21.15.46:0/4257563256 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff8c00cd9c0 0x7ff8c014fd80 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7ff8b00011e0 tx=0x7ff8b000cae0 comp rx=0 tx=0).stop 2023-07-05T18:56:28.974 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:28.969+0000 7ff8c8625700 1 -- 172.21.15.46:0/4257563256 shutdown_connections 2023-07-05T18:56:28.974 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:28.969+0000 7ff8c8625700 1 --2- 172.21.15.46:0/4257563256 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7ff8a406ace0 0x7ff8a406d190 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:28.974 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:28.969+0000 7ff8c8625700 1 --2- 172.21.15.46:0/4257563256 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff8c015af40 0x7ff8c01f10d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:28.974 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:28.969+0000 7ff8c8625700 1 --2- 172.21.15.46:0/4257563256 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7ff8c00cd540 0x7ff8c01ee630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:28.975 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:28.969+0000 7ff8c8625700 1 --2- 172.21.15.46:0/4257563256 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff8c00cd9c0 0x7ff8c014fd80 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:28.975 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:28.969+0000 7ff8c8625700 1 -- 172.21.15.46:0/4257563256 >> 172.21.15.46:0/4257563256 conn(0x7ff8c006bba0 msgr2=0x7ff8c0159d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-05T18:56:28.975 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:28.969+0000 7ff8c8625700 1 -- 172.21.15.46:0/4257563256 shutdown_connections 2023-07-05T18:56:28.975 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:28.969+0000 7ff8c8625700 1 -- 172.21.15.46:0/4257563256 wait complete. 2023-07-05T18:56:28.984 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-05T18:56:29.110 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:29.108+0000 7f8c01448700 1 Processor -- start 2023-07-05T18:56:29.110 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:29.108+0000 7f8c01448700 1 -- start start 2023-07-05T18:56:29.111 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:29.109+0000 7f8c01448700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f8bfc15c6c0 0x7f8bfc0cd2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:56:29.111 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:29.109+0000 7f8c01448700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f8bfc0b5ae0 0x7f8bfc0b5f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:56:29.111 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:29.109+0000 7f8c01448700 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8bfc0cd8c0 con 0x7f8bfc15c2f0 2023-07-05T18:56:29.112 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:29.109+0000 7f8c01448700 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8bfc0d0990 con 0x7f8bfc0b5ae0 2023-07-05T18:56:29.112 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:29.109+0000 7f8c01448700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8bfc0d0c70 con 0x7f8bfc15c6c0 2023-07-05T18:56:29.112 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:29.109+0000 7f8bfb7fe700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f8bfc0b5ae0 0x7f8bfc0b5f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:56:29.112 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:29.109+0000 7f8bfaffd700 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7f8bfc15c2f0 0x7f8bfc06c760 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:57668/0 (socket says 172.21.15.46:57668) 2023-07-05T18:56:29.112 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:29.109+0000 7f8bfaffd700 1 -- 172.21.15.46:0/2458914070 learned_addr learned my addr 172.21.15.46:0/2458914070 (peer_addr_for_me v1:172.21.15.46:0/0) 2023-07-05T18:56:29.112 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:29.109+0000 7f8bfa7fc700 1 --2- 172.21.15.46:0/2458914070 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f8bfc15c6c0 0x7f8bfc0cd2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:56:29.113 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:29.109+0000 7f8bfb7fe700 1 -- 172.21.15.46:0/2458914070 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f8bfc15c6c0 msgr2=0x7f8bfc0cd2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-05T18:56:29.113 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:29.109+0000 7f8bfb7fe700 1 --2- 172.21.15.46:0/2458914070 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f8bfc15c6c0 0x7f8bfc0cd2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:29.113 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:29.109+0000 7f8bfb7fe700 1 -- 172.21.15.46:0/2458914070 >> v1:172.21.15.46:6789/0 conn(0x7f8bfc15c2f0 legacy=0x7f8bfc06c760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:56:29.113 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:29.109+0000 7f8bfb7fe700 1 -- 172.21.15.46:0/2458914070 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8bfc0d0f50 con 0x7f8bfc0b5ae0 2023-07-05T18:56:29.113 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:29.109+0000 7f8bf9ffb700 1 -- 172.21.15.46:0/2458914070 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 418766181 0 0) 0x7f8bfc0cd8c0 con 0x7f8bfc15c2f0 2023-07-05T18:56:29.113 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:29.109+0000 7f8bfb7fe700 1 --2- 172.21.15.46:0/2458914070 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8bfc0b5ae0 0x7f8bfc0b5f00 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f8bf4009d90 tx=0x7f8bf400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=be9be53edf6251eb server_cookie=0 in_seq=0 out_seq=0 2023-07-05T18:56:29.113 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:29.109+0000 7f8bf9ffb700 1 -- 172.21.15.46:0/2458914070 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8bf400e070 con 0x7f8bfc0b5ae0 2023-07-05T18:56:29.113 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:29.109+0000 7f8bf9ffb700 1 -- 172.21.15.46:0/2458914070 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8bf400bb20 con 0x7f8bfc0b5ae0 2023-07-05T18:56:29.114 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:29.109+0000 7f8bf9ffb700 1 -- 172.21.15.46:0/2458914070 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8bf4012430 con 0x7f8bfc0b5ae0 2023-07-05T18:56:29.116 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:29.110+0000 7f8c01448700 1 -- 172.21.15.46:0/2458914070 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8bfc0b5ae0 msgr2=0x7f8bfc0b5f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:56:29.116 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:29.110+0000 7f8c01448700 1 --2- 172.21.15.46:0/2458914070 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8bfc0b5ae0 0x7f8bfc0b5f00 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f8bf4009d90 tx=0x7f8bf400b330 comp rx=0 tx=0).stop 2023-07-05T18:56:29.117 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:29.110+0000 7f8c01448700 1 -- 172.21.15.46:0/2458914070 shutdown_connections 2023-07-05T18:56:29.117 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:29.110+0000 7f8c01448700 1 --2- 172.21.15.46:0/2458914070 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8bfc0b5ae0 0x7f8bfc0b5f00 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:29.117 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:29.110+0000 7f8c01448700 1 --2- 172.21.15.46:0/2458914070 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f8bfc15c6c0 0x7f8bfc0cd2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:29.117 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:29.110+0000 7f8c01448700 1 -- 172.21.15.46:0/2458914070 >> 172.21.15.46:0/2458914070 conn(0x7f8bfc06afa0 msgr2=0x7f8bfc0cf710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-05T18:56:29.117 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:29.110+0000 7f8c01448700 1 -- 172.21.15.46:0/2458914070 shutdown_connections 2023-07-05T18:56:29.117 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:29.110+0000 7f8c01448700 1 -- 172.21.15.46:0/2458914070 wait complete. 2023-07-05T18:56:29.117 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:29.111+0000 7f8c01448700 1 Processor -- start 2023-07-05T18:56:29.118 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:29.111+0000 7f8c01448700 1 -- start start 2023-07-05T18:56:29.118 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:29.112+0000 7f8c01448700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f8bfc0b5ae0 0x7f8bfc0b3dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:56:29.118 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:29.112+0000 7f8c01448700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8bfc15c2f0 0x7f8bfc0c9420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:56:29.119 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:29.112+0000 7f8c01448700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8bfc15c6c0 0x7f8bfc0cbf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:56:29.119 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:29.112+0000 7f8c01448700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8bfc0b4310 con 0x7f8bfc15c6c0 2023-07-05T18:56:29.119 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:29.112+0000 7f8c01448700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8bfc156d80 con 0x7f8bfc15c2f0 2023-07-05T18:56:29.119 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:29.112+0000 7f8c01448700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8bfc157060 con 0x7f8bfc0b5ae0 2023-07-05T18:56:29.119 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:29.112+0000 7f8bfb7fe700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8bfc15c6c0 0x7f8bfc0cbf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:56:29.119 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:29.112+0000 7f8bfb7fe700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8bfc15c6c0 0x7f8bfc0cbf30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:58406/0 (socket says 172.21.15.46:58406) 2023-07-05T18:56:29.120 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:29.112+0000 7f8bfb7fe700 1 -- 172.21.15.46:0/1815556821 learned_addr learned my addr 172.21.15.46:0/1815556821 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-07-05T18:56:29.120 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:29.112+0000 7f8bfa7fc700 1 --2- 172.21.15.46:0/1815556821 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8bfc15c2f0 0x7f8bfc0c9420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:56:29.120 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:29.112+0000 7f8bfaffd700 1 --2- 172.21.15.46:0/1815556821 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f8bfc0b5ae0 0x7f8bfc0b3dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:56:29.120 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:29.112+0000 7f8bfb7fe700 1 -- 172.21.15.46:0/1815556821 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f8bfc0b5ae0 msgr2=0x7f8bfc0b3dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:56:29.120 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:29.112+0000 7f8bfb7fe700 1 --2- 172.21.15.46:0/1815556821 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f8bfc0b5ae0 0x7f8bfc0b3dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:29.120 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:29.112+0000 7f8bfb7fe700 1 -- 172.21.15.46:0/1815556821 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8bfc15c2f0 msgr2=0x7f8bfc0c9420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:56:29.121 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:29.112+0000 7f8bfb7fe700 1 --2- 172.21.15.46:0/1815556821 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8bfc15c2f0 0x7f8bfc0c9420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:29.121 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:29.112+0000 7f8bfb7fe700 1 -- 172.21.15.46:0/1815556821 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8bf4009a70 con 0x7f8bfc15c6c0 2023-07-05T18:56:29.121 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:29.112+0000 7f8bfa7fc700 1 --2- 172.21.15.46:0/1815556821 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8bfc15c2f0 0x7f8bfc0c9420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-05T18:56:29.121 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:29.113+0000 7f8bfb7fe700 1 --2- 172.21.15.46:0/1815556821 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8bfc15c6c0 0x7f8bfc0cbf30 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f8bfc06d010 tx=0x7f8bf4004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-05T18:56:29.121 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:29.113+0000 7f8be37fe700 1 -- 172.21.15.46:0/1815556821 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8bf4012430 con 0x7f8bfc15c6c0 2023-07-05T18:56:29.121 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:29.113+0000 7f8be37fe700 1 -- 172.21.15.46:0/1815556821 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8bf4020070 con 0x7f8bfc15c6c0 2023-07-05T18:56:29.121 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:29.113+0000 7f8c01448700 1 -- 172.21.15.46:0/1815556821 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8bfc157340 con 0x7f8bfc15c6c0 2023-07-05T18:56:29.121 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:29.113+0000 7f8be37fe700 1 -- 172.21.15.46:0/1815556821 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8bf4004280 con 0x7f8bfc15c6c0 2023-07-05T18:56:29.122 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:29.113+0000 7f8c01448700 1 -- 172.21.15.46:0/1815556821 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8bfc156910 con 0x7f8bfc15c6c0 2023-07-05T18:56:29.122 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:29.114+0000 7f8c01448700 1 -- 172.21.15.46:0/1815556821 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8bfc0c7040 con 0x7f8bfc15c6c0 2023-07-05T18:56:29.122 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:29.114+0000 7f8be37fe700 1 -- 172.21.15.46:0/1815556821 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f8bf40043e0 con 0x7f8bfc15c6c0 2023-07-05T18:56:29.123 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:29.115+0000 7f8be37fe700 1 --2- 172.21.15.46:0/1815556821 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7f8be806ace0 0x7f8be806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:56:29.123 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:29.115+0000 7f8be37fe700 1 -- 172.21.15.46:0/1815556821 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f8bf4022070 con 0x7f8bfc15c6c0 2023-07-05T18:56:29.123 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:29.115+0000 7f8bfaffd700 1 --2- 172.21.15.46:0/1815556821 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7f8be806ace0 0x7f8be806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:56:29.123 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:29.115+0000 7f8bfaffd700 1 --2- 172.21.15.46:0/1815556821 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7f8be806ace0 0x7f8be806d190 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f8bec000f60 tx=0x7f8bec007be0 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-05T18:56:29.123 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:29.119+0000 7f8be37fe700 1 -- 172.21.15.46:0/1815556821 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f8bf40bd310 con 0x7f8bfc15c6c0 2023-07-05T18:56:29.366 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:29.364+0000 7f8c01448700 1 -- 172.21.15.46:0/1815556821 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f8bfc0d1190 con 0x7f8bfc15c6c0 2023-07-05T18:56:29.367 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:29.365+0000 7f8be37fe700 1 -- 172.21.15.46:0/1815556821 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4656 (secure 0 0 0) 0x7f8bf40562a0 con 0x7f8bfc15c6c0 2023-07-05T18:56:29.367 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T18:56:29.367 INFO:teuthology.orchestra.run.smithi046.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4247,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.73:6837/75231790","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6835","nonce":75231790},{"type":"v1","addr":"172.21.15.73:6837","nonce":75231790}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4284,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.46:6834/378741372","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6832","nonce":378741372},{"type":"v1","addr":"172.21.15.46:6834","nonce":378741372}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4287,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.46:6835/1674703862","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6833","nonce":1674703862},{"type":"v1","addr":"172.21.15.46:6835","nonce":1674703862}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-07-05T18:56:15.093940+0000","modified":"2023-07-05T18:56:18.225033+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4296},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4296":{"gid":4296,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.73:6836/2654190748","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6834","nonce":2654190748},{"type":"v1","addr":"172.21.15.73:6836","nonce":2654190748}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-07-05T18:56:29.370 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:29.367+0000 7f8c01448700 1 -- 172.21.15.46:0/1815556821 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7f8be806ace0 msgr2=0x7f8be806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:56:29.370 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:29.367+0000 7f8c01448700 1 --2- 172.21.15.46:0/1815556821 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7f8be806ace0 0x7f8be806d190 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f8bec000f60 tx=0x7f8bec007be0 comp rx=0 tx=0).stop 2023-07-05T18:56:29.370 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:29.367+0000 7f8c01448700 1 -- 172.21.15.46:0/1815556821 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8bfc15c6c0 msgr2=0x7f8bfc0cbf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:56:29.370 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:29.367+0000 7f8c01448700 1 --2- 172.21.15.46:0/1815556821 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8bfc15c6c0 0x7f8bfc0cbf30 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f8bfc06d010 tx=0x7f8bf4004ad0 comp rx=0 tx=0).stop 2023-07-05T18:56:29.370 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:29.367+0000 7f8c01448700 1 -- 172.21.15.46:0/1815556821 shutdown_connections 2023-07-05T18:56:29.371 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:29.367+0000 7f8c01448700 1 --2- 172.21.15.46:0/1815556821 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7f8be806ace0 0x7f8be806d190 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:29.371 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:29.367+0000 7f8c01448700 1 --2- 172.21.15.46:0/1815556821 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8bfc15c6c0 0x7f8bfc0cbf30 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:29.371 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:29.367+0000 7f8c01448700 1 --2- 172.21.15.46:0/1815556821 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f8bfc0b5ae0 0x7f8bfc0b3dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:29.371 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:29.367+0000 7f8c01448700 1 --2- 172.21.15.46:0/1815556821 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8bfc15c2f0 0x7f8bfc0c9420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:29.371 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:29.367+0000 7f8c01448700 1 -- 172.21.15.46:0/1815556821 >> 172.21.15.46:0/1815556821 conn(0x7f8bfc06afa0 msgr2=0x7f8bfc15e410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-05T18:56:29.371 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:29.367+0000 7f8c01448700 1 -- 172.21.15.46:0/1815556821 shutdown_connections 2023-07-05T18:56:29.371 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:29.367+0000 7f8c01448700 1 -- 172.21.15.46:0/1815556821 wait complete. 2023-07-05T18:56:29.371 INFO:teuthology.orchestra.run.smithi046.stderr:dumped fsmap epoch 8 2023-07-05T18:56:29.381 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-05T18:56:29.514 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:29.504+0000 7f09e960a700 1 Processor -- start 2023-07-05T18:56:29.515 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:29.505+0000 7f09e960a700 1 -- start start 2023-07-05T18:56:29.515 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:29.505+0000 7f09e960a700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f09e40cd2e0 0x7f09e40d1450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:56:29.515 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:29.505+0000 7f09e960a700 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f09e40cd8c0 con 0x7f09e415c2f0 2023-07-05T18:56:29.515 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:29.505+0000 7f09e960a700 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f09e40d0990 con 0x7f09e415c6c0 2023-07-05T18:56:29.516 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:29.505+0000 7f09e960a700 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f09e40d0c70 con 0x7f09e40cd2e0 2023-07-05T18:56:29.516 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:29.505+0000 7f09e2ffd700 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7f09e415c2f0 0x7f09e406c760 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:57682/0 (socket says 172.21.15.46:57682) 2023-07-05T18:56:29.516 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:29.505+0000 7f09e2ffd700 1 -- 172.21.15.46:0/3972182272 learned_addr learned my addr 172.21.15.46:0/3972182272 (peer_addr_for_me v1:172.21.15.46:0/0) 2023-07-05T18:56:29.516 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:29.506+0000 7f09e37fe700 1 --2- 172.21.15.46:0/3972182272 >> v2:172.21.15.73:3300/0 conn(0x7f09e40cd2e0 0x7f09e40d1450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:56:29.517 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:29.506+0000 7f09e1ffb700 1 -- 172.21.15.46:0/3972182272 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1280372563 0 0) 0x7f09e40cd8c0 con 0x7f09e415c2f0 2023-07-05T18:56:29.517 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:29.506+0000 7f09e1ffb700 1 -- 172.21.15.46:0/3972182272 --> v1:172.21.15.46:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f09d00035b0 con 0x7f09e415c2f0 2023-07-05T18:56:29.517 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:29.506+0000 7f09e1ffb700 1 -- 172.21.15.46:0/3972182272 <== mon.0 v1:172.21.15.46:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2578887234 0 0) 0x7f09d00035b0 con 0x7f09e415c2f0 2023-07-05T18:56:29.517 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:29.506+0000 7f09e1ffb700 1 -- 172.21.15.46:0/3972182272 >> v2:172.21.15.73:3300/0 conn(0x7f09e40cd2e0 msgr2=0x7f09e40d1450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-05T18:56:29.517 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:29.506+0000 7f09e1ffb700 1 --2- 172.21.15.46:0/3972182272 >> v2:172.21.15.73:3300/0 conn(0x7f09e40cd2e0 0x7f09e40d1450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:29.517 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:29.506+0000 7f09e1ffb700 1 -- 172.21.15.46:0/3972182272 >> v1:172.21.15.73:6789/0 conn(0x7f09e415c6c0 legacy=0x7f09e40b5ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:56:29.517 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:29.506+0000 7f09e1ffb700 1 -- 172.21.15.46:0/3972182272 --> v1:172.21.15.46:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f09e40d0f50 con 0x7f09e415c2f0 2023-07-05T18:56:29.517 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:29.506+0000 7f09e1ffb700 1 -- 172.21.15.46:0/3972182272 <== mon.0 v1:172.21.15.46:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2195585215 0 0) 0x7f09d4001670 con 0x7f09e415c2f0 2023-07-05T18:56:29.518 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:29.506+0000 7f09e1ffb700 1 -- 172.21.15.46:0/3972182272 >> v1:172.21.15.46:6789/0 conn(0x7f09e415c2f0 legacy=0x7f09e406c760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:56:29.518 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:29.506+0000 7f09e1ffb700 1 --2- 172.21.15.46:0/3972182272 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f09d0003a00 0x7f09d0003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:56:29.518 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:29.506+0000 7f09e1ffb700 1 --2- 172.21.15.46:0/3972182272 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f09d00043f0 0x7f09d00048b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:56:29.518 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:29.506+0000 7f09e1ffb700 1 --2- 172.21.15.46:0/3972182272 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f09d0005150 0x7f09d000ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:56:29.518 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:29.506+0000 7f09e1ffb700 1 -- 172.21.15.46:0/3972182272 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09e40d0c70 con 0x7f09d0005150 2023-07-05T18:56:29.519 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:29.506+0000 7f09e1ffb700 1 -- 172.21.15.46:0/3972182272 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09d000c080 con 0x7f09d0003a00 2023-07-05T18:56:29.519 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:29.506+0000 7f09e1ffb700 1 -- 172.21.15.46:0/3972182272 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f09d000c240 con 0x7f09d00043f0 2023-07-05T18:56:29.519 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:29.506+0000 7f09e2ffd700 1 --2- 172.21.15.46:0/3972182272 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f09d0003a00 0x7f09d0003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:56:29.519 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:29.506+0000 7f09e37fe700 1 --2- 172.21.15.46:0/3972182272 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f09d0005150 0x7f09d000ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:56:29.519 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:29.506+0000 7f09e27fc700 1 --2- 172.21.15.46:0/3972182272 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f09d00043f0 0x7f09d00048b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:56:29.519 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:29.506+0000 7f09e37fe700 1 -- 172.21.15.46:0/3972182272 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f09d00043f0 msgr2=0x7f09d00048b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-05T18:56:29.520 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:29.506+0000 7f09e37fe700 1 --2- 172.21.15.46:0/3972182272 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f09d00043f0 0x7f09d00048b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:29.520 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:29.506+0000 7f09e37fe700 1 -- 172.21.15.46:0/3972182272 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f09d0003a00 msgr2=0x7f09d0003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-05T18:56:29.520 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:29.506+0000 7f09e37fe700 1 --2- 172.21.15.46:0/3972182272 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f09d0003a00 0x7f09d0003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:29.520 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:29.506+0000 7f09e37fe700 1 -- 172.21.15.46:0/3972182272 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f09d00035b0 con 0x7f09d0005150 2023-07-05T18:56:29.520 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:29.507+0000 7f09e37fe700 1 -- 172.21.15.46:0/3972182272 reap_dead start 2023-07-05T18:56:29.521 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:29.507+0000 7f09e37fe700 1 --2- 172.21.15.46:0/3972182272 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f09d0005150 0x7f09d000ba10 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f09dc009fc0 tx=0x7f09d0005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f4d0bbad14639443 server_cookie=0 in_seq=0 out_seq=0 2023-07-05T18:56:29.521 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:29.507+0000 7f09e1ffb700 1 -- 172.21.15.46:0/3972182272 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09dc003a20 con 0x7f09d0005150 2023-07-05T18:56:29.521 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:29.507+0000 7f09e1ffb700 1 -- 172.21.15.46:0/3972182272 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f09dc00f040 con 0x7f09d0005150 2023-07-05T18:56:29.521 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:29.507+0000 7f09e1ffb700 1 -- 172.21.15.46:0/3972182272 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09dc003de0 con 0x7f09d0005150 2023-07-05T18:56:29.522 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:29.507+0000 7f09e960a700 1 -- 172.21.15.46:0/3972182272 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f09d0005150 msgr2=0x7f09d000ba10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:56:29.522 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:29.507+0000 7f09e960a700 1 --2- 172.21.15.46:0/3972182272 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f09d0005150 0x7f09d000ba10 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f09dc009fc0 tx=0x7f09d0005880 comp rx=0 tx=0).stop 2023-07-05T18:56:29.522 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:29.507+0000 7f09e960a700 1 -- 172.21.15.46:0/3972182272 shutdown_connections 2023-07-05T18:56:29.523 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:29.507+0000 7f09e960a700 1 --2- 172.21.15.46:0/3972182272 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f09d0005150 0x7f09d000ba10 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:29.523 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:29.507+0000 7f09e960a700 1 -- 172.21.15.46:0/3972182272 >> 172.21.15.46:0/3972182272 conn(0x7f09e406afa0 msgr2=0x7f09e40cf710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-05T18:56:29.523 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:29.507+0000 7f09e960a700 1 -- 172.21.15.46:0/3972182272 shutdown_connections 2023-07-05T18:56:29.523 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:29.507+0000 7f09e960a700 1 -- 172.21.15.46:0/3972182272 wait complete. 2023-07-05T18:56:29.524 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:29.509+0000 7f09e960a700 1 Processor -- start 2023-07-05T18:56:29.524 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:29.509+0000 7f09e960a700 1 -- start start 2023-07-05T18:56:29.524 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:29.509+0000 7f09e960a700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f09d0005150 0x7f09e4150170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:56:29.525 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:29.509+0000 7f09e960a700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f09e40c9d60 0x7f09e40ca6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:56:29.525 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:29.510+0000 7f09e960a700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f09e40cac20 0x7f09e41f55e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:56:29.525 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:29.510+0000 7f09e960a700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09e40cb090 con 0x7f09d0005150 2023-07-05T18:56:29.525 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:29.510+0000 7f09e960a700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09e415dd30 con 0x7f09e40cac20 2023-07-05T18:56:29.526 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:29.510+0000 7f09e960a700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f09e415e2f0 con 0x7f09e40c9d60 2023-07-05T18:56:29.526 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:29.510+0000 7f09e2ffd700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f09d0005150 0x7f09e4150170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:56:29.526 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:29.510+0000 7f09e2ffd700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f09d0005150 0x7f09e4150170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:58422/0 (socket says 172.21.15.46:58422) 2023-07-05T18:56:29.526 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:29.510+0000 7f09e2ffd700 1 -- 172.21.15.46:0/1483039596 learned_addr learned my addr 172.21.15.46:0/1483039596 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-07-05T18:56:29.527 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:29.510+0000 7f09e27fc700 1 --2- 172.21.15.46:0/1483039596 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f09e40c9d60 0x7f09e40ca6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:56:29.527 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:29.510+0000 7f09e37fe700 1 --2- 172.21.15.46:0/1483039596 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f09e40cac20 0x7f09e41f55e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:56:29.527 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:29.510+0000 7f09e2ffd700 1 -- 172.21.15.46:0/1483039596 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f09e40c9d60 msgr2=0x7f09e40ca6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:56:29.527 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:29.510+0000 7f09e2ffd700 1 --2- 172.21.15.46:0/1483039596 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f09e40c9d60 0x7f09e40ca6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:29.527 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:29.510+0000 7f09e2ffd700 1 -- 172.21.15.46:0/1483039596 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f09e40cac20 msgr2=0x7f09e41f55e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:56:29.527 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:29.510+0000 7f09e2ffd700 1 --2- 172.21.15.46:0/1483039596 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f09e40cac20 0x7f09e41f55e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:29.527 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:29.510+0000 7f09e2ffd700 1 -- 172.21.15.46:0/1483039596 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f09e41506b0 con 0x7f09d0005150 2023-07-05T18:56:29.528 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:29.510+0000 7f09e37fe700 1 --2- 172.21.15.46:0/1483039596 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f09e40cac20 0x7f09e41f55e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-05T18:56:29.528 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:29.510+0000 7f09e2ffd700 1 --2- 172.21.15.46:0/1483039596 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f09d0005150 0x7f09e4150170 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f09d40072f0 tx=0x7f09d4007600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-05T18:56:29.528 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:29.510+0000 7f09db7fe700 1 -- 172.21.15.46:0/1483039596 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09d4017070 con 0x7f09d0005150 2023-07-05T18:56:29.528 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:29.510+0000 7f09db7fe700 1 -- 172.21.15.46:0/1483039596 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f09d4011580 con 0x7f09d0005150 2023-07-05T18:56:29.528 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:29.510+0000 7f09e960a700 1 -- 172.21.15.46:0/1483039596 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f09e40c84c0 con 0x7f09d0005150 2023-07-05T18:56:29.528 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:29.510+0000 7f09db7fe700 1 -- 172.21.15.46:0/1483039596 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09d4011710 con 0x7f09d0005150 2023-07-05T18:56:29.529 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:29.510+0000 7f09e960a700 1 -- 172.21.15.46:0/1483039596 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f09e40c8a80 con 0x7f09d0005150 2023-07-05T18:56:29.529 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:29.511+0000 7f09e960a700 1 -- 172.21.15.46:0/1483039596 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f09e40c8c40 con 0x7f09d0005150 2023-07-05T18:56:29.529 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:29.512+0000 7f09db7fe700 1 -- 172.21.15.46:0/1483039596 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f09d4011870 con 0x7f09d0005150 2023-07-05T18:56:29.529 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:29.512+0000 7f09db7fe700 1 --2- 172.21.15.46:0/1483039596 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7f09c406ace0 0x7f09c406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:56:29.530 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:29.512+0000 7f09db7fe700 1 -- 172.21.15.46:0/1483039596 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f09d4088d60 con 0x7f09d0005150 2023-07-05T18:56:29.530 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:29.512+0000 7f09e27fc700 1 --2- 172.21.15.46:0/1483039596 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7f09c406ace0 0x7f09c406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:56:29.530 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:29.513+0000 7f09e27fc700 1 --2- 172.21.15.46:0/1483039596 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7f09c406ace0 0x7f09c406d190 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f09e415f9f0 tx=0x7f09cc009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-05T18:56:29.531 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:29.517+0000 7f09db7fe700 1 -- 172.21.15.46:0/1483039596 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f09d4053e10 con 0x7f09d0005150 2023-07-05T18:56:29.714 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:29.713+0000 7f09e960a700 1 -- 172.21.15.46:0/1483039596 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f09e404e1d0 con 0x7f09d0005150 2023-07-05T18:56:29.716 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:29.714+0000 7f09db7fe700 1 -- 172.21.15.46:0/1483039596 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) v1 ==== 74+0+18161 (secure 0 0 0) 0x7f09d4057430 con 0x7f09d0005150 2023-07-05T18:56:29.716 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T18:56:29.716 INFO:teuthology.orchestra.run.smithi046.stdout:{"epoch":21,"fsid":"042652d3-d80c-4ad8-9366-3e94f2a0a512","created":"2023-07-05T18:55:56.455710+0000","modified":"2023-07-05T18:56:16.095672+0000","last_up_change":"2023-07-05T18:56:06.594022+0000","last_in_change":"2023-07-05T18:55:58.879340+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-07-05T18:56:07.729620+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2023-07-05T18:56:08.128122+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-07-05T18:56:12.954625+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-07-05T18:56:14.068396+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"20009183-9a47-4392-8751-883f88d2bfb1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6813","nonce":4151971443},{"type":"v1","addr":"172.21.15.46:6815","nonce":4151971443}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6817","nonce":4151971443},{"type":"v1","addr":"172.21.15.46:6818","nonce":4151971443}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6822","nonce":4151971443},{"type":"v1","addr":"172.21.15.46:6823","nonce":4151971443}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6820","nonce":4151971443},{"type":"v1","addr":"172.21.15.46:6821","nonce":4151971443}]},"public_addr":"172.21.15.46:6815/4151971443","cluster_addr":"172.21.15.46:6818/4151971443","heartbeat_back_addr":"172.21.15.46:6823/4151971443","heartbeat_front_addr":"172.21.15.46:6821/4151971443","state":["exists","up"]},{"osd":1,"uuid":"91b4a7b0-e4e4-4888-a1fe-9edb0d68004c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6808","nonce":502575881},{"type":"v1","addr":"172.21.15.46:6809","nonce":502575881}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6810","nonce":502575881},{"type":"v1","addr":"172.21.15.46:6811","nonce":502575881}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6816","nonce":502575881},{"type":"v1","addr":"172.21.15.46:6819","nonce":502575881}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6812","nonce":502575881},{"type":"v1","addr":"172.21.15.46:6814","nonce":502575881}]},"public_addr":"172.21.15.46:6809/502575881","cluster_addr":"172.21.15.46:6811/502575881","heartbeat_back_addr":"172.21.15.46:6819/502575881","heartbeat_front_addr":"172.21.15.46:6814/502575881","state":["exists","up"]},{"osd":2,"uuid":"669ff744-1331-47c5-8579-0440731c889a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6800","nonce":2115251461},{"type":"v1","addr":"172.21.15.46:6801","nonce":2115251461}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6802","nonce":2115251461},{"type":"v1","addr":"172.21.15.46:6803","nonce":2115251461}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6806","nonce":2115251461},{"type":"v1","addr":"172.21.15.46:6807","nonce":2115251461}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6804","nonce":2115251461},{"type":"v1","addr":"172.21.15.46:6805","nonce":2115251461}]},"public_addr":"172.21.15.46:6801/2115251461","cluster_addr":"172.21.15.46:6803/2115251461","heartbeat_back_addr":"172.21.15.46:6807/2115251461","heartbeat_front_addr":"172.21.15.46:6805/2115251461","state":["exists","up"]},{"osd":3,"uuid":"34e1b86d-ffad-415d-861c-07a5f08068a6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6824","nonce":2981388766},{"type":"v1","addr":"172.21.15.46:6825","nonce":2981388766}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6826","nonce":2981388766},{"type":"v1","addr":"172.21.15.46:6827","nonce":2981388766}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6830","nonce":2981388766},{"type":"v1","addr":"172.21.15.46:6831","nonce":2981388766}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6828","nonce":2981388766},{"type":"v1","addr":"172.21.15.46:6829","nonce":2981388766}]},"public_addr":"172.21.15.46:6825/2981388766","cluster_addr":"172.21.15.46:6827/2981388766","heartbeat_back_addr":"172.21.15.46:6831/2981388766","heartbeat_front_addr":"172.21.15.46:6829/2981388766","state":["exists","up"]},{"osd":4,"uuid":"57ffcb91-c7dc-4a69-ae71-4d9622a14a05","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6800","nonce":2083655348},{"type":"v1","addr":"172.21.15.73:6801","nonce":2083655348}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6802","nonce":2083655348},{"type":"v1","addr":"172.21.15.73:6803","nonce":2083655348}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6806","nonce":2083655348},{"type":"v1","addr":"172.21.15.73:6807","nonce":2083655348}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6804","nonce":2083655348},{"type":"v1","addr":"172.21.15.73:6805","nonce":2083655348}]},"public_addr":"172.21.15.73:6801/2083655348","cluster_addr":"172.21.15.73:6803/2083655348","heartbeat_back_addr":"172.21.15.73:6807/2083655348","heartbeat_front_addr":"172.21.15.73:6805/2083655348","state":["exists","up"]},{"osd":5,"uuid":"665f41c9-ee20-49cf-bf0e-fbe0c03d3aed","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6824","nonce":2803788401},{"type":"v1","addr":"172.21.15.73:6825","nonce":2803788401}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6826","nonce":2803788401},{"type":"v1","addr":"172.21.15.73:6827","nonce":2803788401}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6830","nonce":2803788401},{"type":"v1","addr":"172.21.15.73:6831","nonce":2803788401}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6828","nonce":2803788401},{"type":"v1","addr":"172.21.15.73:6829","nonce":2803788401}]},"public_addr":"172.21.15.73:6825/2803788401","cluster_addr":"172.21.15.73:6827/2803788401","heartbeat_back_addr":"172.21.15.73:6831/2803788401","heartbeat_front_addr":"172.21.15.73:6829/2803788401","state":["exists","up"]},{"osd":6,"uuid":"5790c6cc-bd56-4ce4-9a7c-0f0c3b59215c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6808","nonce":974108383},{"type":"v1","addr":"172.21.15.73:6809","nonce":974108383}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6810","nonce":974108383},{"type":"v1","addr":"172.21.15.73:6811","nonce":974108383}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6815","nonce":974108383},{"type":"v1","addr":"172.21.15.73:6817","nonce":974108383}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6812","nonce":974108383},{"type":"v1","addr":"172.21.15.73:6813","nonce":974108383}]},"public_addr":"172.21.15.73:6809/974108383","cluster_addr":"172.21.15.73:6811/974108383","heartbeat_back_addr":"172.21.15.73:6817/974108383","heartbeat_front_addr":"172.21.15.73:6813/974108383","state":["exists","up"]},{"osd":7,"uuid":"b66f4d2e-147e-4c9b-97dd-cbd59d33802e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6814","nonce":3772673248},{"type":"v1","addr":"172.21.15.73:6816","nonce":3772673248}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6818","nonce":3772673248},{"type":"v1","addr":"172.21.15.73:6819","nonce":3772673248}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6822","nonce":3772673248},{"type":"v1","addr":"172.21.15.73:6823","nonce":3772673248}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6820","nonce":3772673248},{"type":"v1","addr":"172.21.15.73:6821","nonce":3772673248}]},"public_addr":"172.21.15.73:6816/3772673248","cluster_addr":"172.21.15.73:6819/3772673248","heartbeat_back_addr":"172.21.15.73:6823/3772673248","heartbeat_front_addr":"172.21.15.73:6821/3772673248","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-05T18:56:04.115334+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-05T18:56:04.071250+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-05T18:56:04.044387+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-05T18:56:04.085389+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-05T18:56:04.090726+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-05T18:56:04.074529+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-05T18:56:04.058841+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-05T18:56:04.043054+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-05T18:56:29.718 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:29.716+0000 7f09e960a700 1 -- 172.21.15.46:0/1483039596 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7f09c406ace0 msgr2=0x7f09c406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:56:29.719 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:29.716+0000 7f09e960a700 1 --2- 172.21.15.46:0/1483039596 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7f09c406ace0 0x7f09c406d190 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f09e415f9f0 tx=0x7f09cc009040 comp rx=0 tx=0).stop 2023-07-05T18:56:29.719 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:29.716+0000 7f09e960a700 1 -- 172.21.15.46:0/1483039596 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f09d0005150 msgr2=0x7f09e4150170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:56:29.719 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:29.716+0000 7f09e960a700 1 --2- 172.21.15.46:0/1483039596 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f09d0005150 0x7f09e4150170 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f09d40072f0 tx=0x7f09d4007600 comp rx=0 tx=0).stop 2023-07-05T18:56:29.719 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:29.716+0000 7f09e960a700 1 -- 172.21.15.46:0/1483039596 shutdown_connections 2023-07-05T18:56:29.719 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:29.716+0000 7f09e960a700 1 --2- 172.21.15.46:0/1483039596 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7f09c406ace0 0x7f09c406d190 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:29.719 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:29.716+0000 7f09e960a700 1 --2- 172.21.15.46:0/1483039596 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f09e40cac20 0x7f09e41f55e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:29.719 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:29.716+0000 7f09e960a700 1 --2- 172.21.15.46:0/1483039596 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f09d0005150 0x7f09e4150170 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:29.720 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:29.716+0000 7f09e960a700 1 --2- 172.21.15.46:0/1483039596 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f09e40c9d60 0x7f09e40ca6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:29.720 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:29.716+0000 7f09e960a700 1 -- 172.21.15.46:0/1483039596 >> 172.21.15.46:0/1483039596 conn(0x7f09e406afa0 msgr2=0x7f09e40b83e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-05T18:56:29.720 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:29.716+0000 7f09e960a700 1 -- 172.21.15.46:0/1483039596 shutdown_connections 2023-07-05T18:56:29.720 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:29.716+0000 7f09e960a700 1 -- 172.21.15.46:0/1483039596 wait complete. 2023-07-05T18:56:29.731 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-05T18:56:29.856 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:29.854+0000 7fa22e311700 1 Processor -- start 2023-07-05T18:56:29.859 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:29.854+0000 7fa22e311700 1 -- start start 2023-07-05T18:56:29.859 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:29.855+0000 7fa22e311700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fa22815c460 0x7fa2280ac4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:56:29.859 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:29.855+0000 7fa22e311700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fa2280b1f70 0x7fa2280aca30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:56:29.859 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:29.855+0000 7fa22e311700 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa2280b3730 con 0x7fa22815c830 2023-07-05T18:56:29.860 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:29.855+0000 7fa22e311700 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa2280b3fb0 con 0x7fa2280b1f70 2023-07-05T18:56:29.860 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:29.855+0000 7fa22e311700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa2280cc9a0 con 0x7fa22815c460 2023-07-05T18:56:29.860 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:29.855+0000 7fa22c8ae700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fa2280b1f70 0x7fa2280aca30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:56:29.860 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:29.855+0000 7fa22c8ae700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fa2280b1f70 0x7fa2280aca30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:58434/0 (socket says 172.21.15.46:58434) 2023-07-05T18:56:29.860 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:29.855+0000 7fa22c8ae700 1 -- 172.21.15.46:0/23895993 learned_addr learned my addr 172.21.15.46:0/23895993 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-07-05T18:56:29.860 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:29.855+0000 7fa227fff700 1 --2- 172.21.15.46:0/23895993 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fa22815c460 0x7fa2280ac4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:56:29.863 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:29.856+0000 7fa22c8ae700 1 -- 172.21.15.46:0/23895993 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fa22815c460 msgr2=0x7fa2280ac4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-05T18:56:29.863 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:29.856+0000 7fa22c8ae700 1 --2- 172.21.15.46:0/23895993 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fa22815c460 0x7fa2280ac4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:29.863 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:29.856+0000 7fa22c8ae700 1 -- 172.21.15.46:0/23895993 >> v1:172.21.15.73:6789/0 conn(0x7fa22815c830 legacy=0x7fa2280cee10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-05T18:56:29.863 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:29.856+0000 7fa22c8ae700 1 -- 172.21.15.46:0/23895993 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa2280cc6c0 con 0x7fa2280b1f70 2023-07-05T18:56:29.864 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:29.856+0000 7fa22c8ae700 1 --2- 172.21.15.46:0/23895993 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa2280b1f70 0x7fa2280aca30 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fa220009e50 tx=0x7fa22000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5724a5f0f183aaa6 server_cookie=0 in_seq=0 out_seq=0 2023-07-05T18:56:29.864 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:29.856+0000 7fa226ffd700 1 -- 172.21.15.46:0/23895993 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa22000e070 con 0x7fa2280b1f70 2023-07-05T18:56:29.864 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:29.856+0000 7fa226ffd700 1 -- 172.21.15.46:0/23895993 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa220003a20 con 0x7fa2280b1f70 2023-07-05T18:56:29.864 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:29.856+0000 7fa226ffd700 1 -- 172.21.15.46:0/23895993 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa220003dd0 con 0x7fa2280b1f70 2023-07-05T18:56:29.864 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:29.856+0000 7fa22e311700 1 -- 172.21.15.46:0/23895993 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa2280b1f70 msgr2=0x7fa2280aca30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:56:29.864 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:29.856+0000 7fa22e311700 1 --2- 172.21.15.46:0/23895993 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa2280b1f70 0x7fa2280aca30 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fa220009e50 tx=0x7fa22000b330 comp rx=0 tx=0).stop 2023-07-05T18:56:29.865 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:29.856+0000 7fa22e311700 1 -- 172.21.15.46:0/23895993 shutdown_connections 2023-07-05T18:56:29.865 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:29.856+0000 7fa22e311700 1 --2- 172.21.15.46:0/23895993 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fa22815c460 0x7fa2280ac4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:29.865 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:29.856+0000 7fa22e311700 1 --2- 172.21.15.46:0/23895993 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa2280b1f70 0x7fa2280aca30 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:29.877 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:29.856+0000 7fa22e311700 1 -- 172.21.15.46:0/23895993 >> 172.21.15.46:0/23895993 conn(0x7fa2280b4420 msgr2=0x7fa2280b47f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-05T18:56:29.878 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:29.856+0000 7fa22e311700 1 -- 172.21.15.46:0/23895993 shutdown_connections 2023-07-05T18:56:29.878 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:29.856+0000 7fa22e311700 1 -- 172.21.15.46:0/23895993 wait complete. 2023-07-05T18:56:29.881 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:29.858+0000 7fa22e311700 1 Processor -- start 2023-07-05T18:56:29.881 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:29.858+0000 7fa22e311700 1 -- start start 2023-07-05T18:56:29.881 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:29.858+0000 7fa22e311700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa2280b1f70 0x7fa2280cccd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:56:29.881 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:29.858+0000 7fa22e311700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fa22815c460 0x7fa2281f1ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:56:29.881 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:29.858+0000 7fa22e311700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa2280cd550 0x7fa2280cf1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:56:29.882 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:29.859+0000 7fa22e311700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2280c4ea0 con 0x7fa2280b1f70 2023-07-05T18:56:29.882 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:29.859+0000 7fa22e311700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2280cd210 con 0x7fa2280cd550 2023-07-05T18:56:29.882 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:29.859+0000 7fa22e311700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa22815ae10 con 0x7fa22815c460 2023-07-05T18:56:29.882 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:29.859+0000 7fa227fff700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa2280b1f70 0x7fa2280cccd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:56:29.882 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:29.859+0000 7fa227fff700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa2280b1f70 0x7fa2280cccd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:58436/0 (socket says 172.21.15.46:58436) 2023-07-05T18:56:29.884 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:29.859+0000 7fa227fff700 1 -- 172.21.15.46:0/2101795118 learned_addr learned my addr 172.21.15.46:0/2101795118 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-07-05T18:56:29.885 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:29.859+0000 7fa22c8ae700 1 --2- 172.21.15.46:0/2101795118 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa2280cd550 0x7fa2280cf1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:56:29.885 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:29.859+0000 7fa2277fe700 1 --2- 172.21.15.46:0/2101795118 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fa22815c460 0x7fa2281f1ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:56:29.885 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:29.859+0000 7fa227fff700 1 -- 172.21.15.46:0/2101795118 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fa22815c460 msgr2=0x7fa2281f1ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:56:29.885 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:29.859+0000 7fa227fff700 1 --2- 172.21.15.46:0/2101795118 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fa22815c460 0x7fa2281f1ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:29.885 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:29.859+0000 7fa227fff700 1 -- 172.21.15.46:0/2101795118 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa2280cd550 msgr2=0x7fa2280cf1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:56:29.885 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:29.859+0000 7fa227fff700 1 --2- 172.21.15.46:0/2101795118 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa2280cd550 0x7fa2280cf1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:29.885 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:29.859+0000 7fa227fff700 1 -- 172.21.15.46:0/2101795118 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa220009b30 con 0x7fa2280b1f70 2023-07-05T18:56:29.886 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:29.859+0000 7fa2277fe700 1 --2- 172.21.15.46:0/2101795118 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fa22815c460 0x7fa2281f1ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-05T18:56:29.886 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:29.859+0000 7fa22c8ae700 1 --2- 172.21.15.46:0/2101795118 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa2280cd550 0x7fa2280cf1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-05T18:56:29.886 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:29.859+0000 7fa227fff700 1 --2- 172.21.15.46:0/2101795118 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa2280b1f70 0x7fa2280cccd0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fa21800e730 tx=0x7fa21800eaf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-05T18:56:29.886 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:29.859+0000 7fa224ff9700 1 -- 172.21.15.46:0/2101795118 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa218013610 con 0x7fa2280b1f70 2023-07-05T18:56:29.886 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:29.859+0000 7fa224ff9700 1 -- 172.21.15.46:0/2101795118 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa218013770 con 0x7fa2280b1f70 2023-07-05T18:56:29.886 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:29.859+0000 7fa22e311700 1 -- 172.21.15.46:0/2101795118 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa2280cd9c0 con 0x7fa2280b1f70 2023-07-05T18:56:29.890 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:29.859+0000 7fa224ff9700 1 -- 172.21.15.46:0/2101795118 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa218013b20 con 0x7fa2280b1f70 2023-07-05T18:56:29.890 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:29.859+0000 7fa22e311700 1 -- 172.21.15.46:0/2101795118 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa2280c4ac0 con 0x7fa2280b1f70 2023-07-05T18:56:29.891 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:29.860+0000 7fa22e311700 1 -- 172.21.15.46:0/2101795118 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa2280c5110 con 0x7fa2280b1f70 2023-07-05T18:56:29.891 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:29.861+0000 7fa224ff9700 1 -- 172.21.15.46:0/2101795118 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fa218013c80 con 0x7fa2280b1f70 2023-07-05T18:56:29.891 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:29.861+0000 7fa224ff9700 1 --2- 172.21.15.46:0/2101795118 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7fa21406ace0 0x7fa21406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:56:29.891 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:29.861+0000 7fa224ff9700 1 -- 172.21.15.46:0/2101795118 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fa218088e60 con 0x7fa2280b1f70 2023-07-05T18:56:29.891 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:29.861+0000 7fa2277fe700 1 --2- 172.21.15.46:0/2101795118 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7fa21406ace0 0x7fa21406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:56:29.891 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:29.862+0000 7fa2277fe700 1 --2- 172.21.15.46:0/2101795118 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7fa21406ace0 0x7fa21406d190 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fa21c006fd0 tx=0x7fa21c008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-05T18:56:29.891 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:29.865+0000 7fa224ff9700 1 -- 172.21.15.46:0/2101795118 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fa2180579a0 con 0x7fa2280b1f70 2023-07-05T18:56:30.112 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:30.110+0000 7fa22e311700 1 -- 172.21.15.46:0/2101795118 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fa2280672e0 con 0x7fa2280b1f70 2023-07-05T18:56:30.112 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:30.110+0000 7fa224ff9700 1 -- 172.21.15.46:0/2101795118 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4656 (secure 0 0 0) 0x7fa218057530 con 0x7fa2280b1f70 2023-07-05T18:56:30.113 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T18:56:30.113 INFO:teuthology.orchestra.run.smithi046.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4247,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.73:6837/75231790","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6835","nonce":75231790},{"type":"v1","addr":"172.21.15.73:6837","nonce":75231790}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4284,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.46:6834/378741372","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6832","nonce":378741372},{"type":"v1","addr":"172.21.15.46:6834","nonce":378741372}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4287,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.46:6835/1674703862","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6833","nonce":1674703862},{"type":"v1","addr":"172.21.15.46:6835","nonce":1674703862}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-07-05T18:56:15.093940+0000","modified":"2023-07-05T18:56:18.225033+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4296},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4296":{"gid":4296,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.73:6836/2654190748","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6834","nonce":2654190748},{"type":"v1","addr":"172.21.15.73:6836","nonce":2654190748}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-07-05T18:56:30.115 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:30.112+0000 7fa22e311700 1 -- 172.21.15.46:0/2101795118 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7fa21406ace0 msgr2=0x7fa21406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:56:30.115 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:30.112+0000 7fa22e311700 1 --2- 172.21.15.46:0/2101795118 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7fa21406ace0 0x7fa21406d190 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fa21c006fd0 tx=0x7fa21c008040 comp rx=0 tx=0).stop 2023-07-05T18:56:30.115 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:30.112+0000 7fa22e311700 1 -- 172.21.15.46:0/2101795118 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa2280b1f70 msgr2=0x7fa2280cccd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:56:30.115 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:30.112+0000 7fa22e311700 1 --2- 172.21.15.46:0/2101795118 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa2280b1f70 0x7fa2280cccd0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fa21800e730 tx=0x7fa21800eaf0 comp rx=0 tx=0).stop 2023-07-05T18:56:30.116 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:30.112+0000 7fa22e311700 1 -- 172.21.15.46:0/2101795118 shutdown_connections 2023-07-05T18:56:30.116 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:30.112+0000 7fa22e311700 1 --2- 172.21.15.46:0/2101795118 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7fa21406ace0 0x7fa21406d190 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:30.116 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:30.112+0000 7fa22e311700 1 --2- 172.21.15.46:0/2101795118 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa2280cd550 0x7fa2280cf1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:30.116 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:30.112+0000 7fa22e311700 1 --2- 172.21.15.46:0/2101795118 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa2280b1f70 0x7fa2280cccd0 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:30.116 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:30.112+0000 7fa22e311700 1 --2- 172.21.15.46:0/2101795118 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fa22815c460 0x7fa2281f1ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:30.116 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:30.112+0000 7fa22e311700 1 -- 172.21.15.46:0/2101795118 >> 172.21.15.46:0/2101795118 conn(0x7fa2280b4420 msgr2=0x7fa2280cb9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-05T18:56:30.117 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:30.113+0000 7fa22e311700 1 -- 172.21.15.46:0/2101795118 shutdown_connections 2023-07-05T18:56:30.117 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:30.113+0000 7fa22e311700 1 -- 172.21.15.46:0/2101795118 wait complete. 2023-07-05T18:56:30.117 INFO:teuthology.orchestra.run.smithi046.stderr:dumped fsmap epoch 8 2023-07-05T18:56:30.529 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 8, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-07-05T18:56:15.093940+0000', 'modified': '2023-07-05T18:56:18.225033+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4296}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4296': {'gid': 4296, 'name': 'b', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.73:6836/2654190748', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.73:6834', 'nonce': 2654190748}, {'type': 'v1', 'addr': '172.21.15.73:6836', 'nonce': 2654190748}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [4], 'metadata_pool': 3, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2023-07-05T18:56:30.530 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-07-05T18:56:30.530 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.b status 2023-07-05T18:56:30.664 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:30.662+0000 7fe8e555b700 1 Processor -- start 2023-07-05T18:56:30.665 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:30.662+0000 7fe8e555b700 1 -- start start 2023-07-05T18:56:30.666 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:30.663+0000 7fe8e555b700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fe8e00cede0 0x7fe8e00b1ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:56:30.666 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:30.663+0000 7fe8e555b700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fe8e00aeac0 0x7fe8e00aef20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:56:30.666 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:30.664+0000 7fe8e555b700 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe8e00ada20 con 0x7fe8e015a610 2023-07-05T18:56:30.667 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:30.664+0000 7fe8e555b700 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe8e00b2410 con 0x7fe8e00cede0 2023-07-05T18:56:30.667 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:30.664+0000 7fe8e555b700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe8e00add00 con 0x7fe8e00aeac0 2023-07-05T18:56:30.667 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:30.664+0000 7fe8de7fc700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fe8e00cede0 0x7fe8e00b1ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:56:30.667 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:30.664+0000 7fe8deffd700 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7fe8e015a610 0x7fe8e00ce6d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:57716/0 (socket says 172.21.15.46:57716) 2023-07-05T18:56:30.667 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:30.664+0000 7fe8deffd700 1 -- 172.21.15.46:0/658389976 learned_addr learned my addr 172.21.15.46:0/658389976 (peer_addr_for_me v1:172.21.15.46:0/0) 2023-07-05T18:56:30.667 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:30.664+0000 7fe8df7fe700 1 --2- 172.21.15.46:0/658389976 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fe8e00aeac0 0x7fe8e00aef20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:56:30.667 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:30.664+0000 7fe8de7fc700 1 -- 172.21.15.46:0/658389976 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fe8e00aeac0 msgr2=0x7fe8e00aef20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-05T18:56:30.668 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:30.664+0000 7fe8de7fc700 1 --2- 172.21.15.46:0/658389976 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fe8e00aeac0 0x7fe8e00aef20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:30.668 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:30.664+0000 7fe8de7fc700 1 -- 172.21.15.46:0/658389976 >> v1:172.21.15.46:6789/0 conn(0x7fe8e015a610 legacy=0x7fe8e00ce6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:56:30.668 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:30.664+0000 7fe8de7fc700 1 -- 172.21.15.46:0/658389976 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe8e00adfe0 con 0x7fe8e00cede0 2023-07-05T18:56:30.668 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:30.664+0000 7fe8de7fc700 1 --2- 172.21.15.46:0/658389976 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe8e00cede0 0x7fe8e00b1ed0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fe8d0009840 tx=0x7fe8d0009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9b01b426adb072d1 server_cookie=0 in_seq=0 out_seq=0 2023-07-05T18:56:30.668 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:30.664+0000 7fe8ddffb700 1 -- 172.21.15.46:0/658389976 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8d0004230 con 0x7fe8e00cede0 2023-07-05T18:56:30.668 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:30.664+0000 7fe8ddffb700 1 -- 172.21.15.46:0/658389976 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe8d0004390 con 0x7fe8e00cede0 2023-07-05T18:56:30.668 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:30.664+0000 7fe8ddffb700 1 -- 172.21.15.46:0/658389976 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8d00036a0 con 0x7fe8e00cede0 2023-07-05T18:56:30.670 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:30.665+0000 7fe8e555b700 1 -- 172.21.15.46:0/658389976 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe8e00cede0 msgr2=0x7fe8e00b1ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:56:30.671 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:30.665+0000 7fe8e555b700 1 --2- 172.21.15.46:0/658389976 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe8e00cede0 0x7fe8e00b1ed0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fe8d0009840 tx=0x7fe8d0009b50 comp rx=0 tx=0).stop 2023-07-05T18:56:30.671 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:30.665+0000 7fe8e555b700 1 -- 172.21.15.46:0/658389976 shutdown_connections 2023-07-05T18:56:30.671 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:30.665+0000 7fe8e555b700 1 --2- 172.21.15.46:0/658389976 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fe8e00aeac0 0x7fe8e00aef20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:30.671 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:30.665+0000 7fe8e555b700 1 --2- 172.21.15.46:0/658389976 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe8e00cede0 0x7fe8e00b1ed0 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:30.671 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:30.665+0000 7fe8e555b700 1 -- 172.21.15.46:0/658389976 >> 172.21.15.46:0/658389976 conn(0x7fe8e0099e00 msgr2=0x7fe8e00d0b00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-05T18:56:30.671 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:30.665+0000 7fe8e555b700 1 -- 172.21.15.46:0/658389976 shutdown_connections 2023-07-05T18:56:30.671 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:30.665+0000 7fe8e555b700 1 -- 172.21.15.46:0/658389976 wait complete. 2023-07-05T18:56:30.672 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:30.666+0000 7fe8e555b700 1 Processor -- start 2023-07-05T18:56:30.672 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:30.666+0000 7fe8e555b700 1 -- start start 2023-07-05T18:56:30.672 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:30.667+0000 7fe8e555b700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fe8e00aeac0 0x7fe8e0152360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:56:30.672 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:30.667+0000 7fe8e555b700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe8e00cede0 0x7fe8e01e3f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:56:30.672 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:30.667+0000 7fe8e555b700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe8e015a610 0x7fe8e01e44c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:56:30.672 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:30.667+0000 7fe8e555b700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8e01e4a00 con 0x7fe8e015a610 2023-07-05T18:56:30.672 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:30.667+0000 7fe8e555b700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8e01e2650 con 0x7fe8e00cede0 2023-07-05T18:56:30.673 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:30.667+0000 7fe8e555b700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe8e01e2930 con 0x7fe8e00aeac0 2023-07-05T18:56:30.673 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:30.667+0000 7fe8df7fe700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe8e015a610 0x7fe8e01e44c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:56:30.673 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:30.667+0000 7fe8df7fe700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe8e015a610 0x7fe8e01e44c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:58454/0 (socket says 172.21.15.46:58454) 2023-07-05T18:56:30.673 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:30.667+0000 7fe8df7fe700 1 -- 172.21.15.46:0/2555193881 learned_addr learned my addr 172.21.15.46:0/2555193881 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-07-05T18:56:30.673 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:30.667+0000 7fe8deffd700 1 --2- 172.21.15.46:0/2555193881 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fe8e00aeac0 0x7fe8e0152360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:56:30.673 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:30.667+0000 7fe8de7fc700 1 --2- 172.21.15.46:0/2555193881 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe8e00cede0 0x7fe8e01e3f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:56:30.673 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:30.668+0000 7fe8df7fe700 1 -- 172.21.15.46:0/2555193881 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fe8e00aeac0 msgr2=0x7fe8e0152360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:56:30.673 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:30.668+0000 7fe8df7fe700 1 --2- 172.21.15.46:0/2555193881 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fe8e00aeac0 0x7fe8e0152360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:30.674 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:30.668+0000 7fe8df7fe700 1 -- 172.21.15.46:0/2555193881 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe8e00cede0 msgr2=0x7fe8e01e3f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:56:30.674 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:30.668+0000 7fe8df7fe700 1 --2- 172.21.15.46:0/2555193881 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe8e00cede0 0x7fe8e01e3f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:30.674 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:30.668+0000 7fe8df7fe700 1 -- 172.21.15.46:0/2555193881 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe8d00094a0 con 0x7fe8e015a610 2023-07-05T18:56:30.674 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:30.668+0000 7fe8df7fe700 1 --2- 172.21.15.46:0/2555193881 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe8e015a610 0x7fe8e01e44c0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fe8d800cc30 tx=0x7fe8d800cf40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-05T18:56:30.674 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:30.668+0000 7fe8c77fe700 1 -- 172.21.15.46:0/2555193881 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8d800aa50 con 0x7fe8e015a610 2023-07-05T18:56:30.674 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:30.668+0000 7fe8c77fe700 1 -- 172.21.15.46:0/2555193881 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe8d800abb0 con 0x7fe8e015a610 2023-07-05T18:56:30.674 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:30.668+0000 7fe8e555b700 1 -- 172.21.15.46:0/2555193881 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe8e00c8710 con 0x7fe8e015a610 2023-07-05T18:56:30.674 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:30.668+0000 7fe8c77fe700 1 -- 172.21.15.46:0/2555193881 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8d8003a20 con 0x7fe8e015a610 2023-07-05T18:56:30.675 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:30.668+0000 7fe8e555b700 1 -- 172.21.15.46:0/2555193881 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe8e00c8cd0 con 0x7fe8e015a610 2023-07-05T18:56:30.677 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:30.672+0000 7fe8f16e0b80 1 Processor -- start 2023-07-05T18:56:30.677 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:30.672+0000 7fe8f16e0b80 1 -- start start 2023-07-05T18:56:30.677 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:30.672+0000 7fe8c77fe700 1 -- 172.21.15.46:0/2555193881 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fe8d800f3f0 con 0x7fe8e015a610 2023-07-05T18:56:30.677 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:30.672+0000 7fe8f16e0b80 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x55a8dde93f50 0x55a8dde94320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:56:30.677 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:30.673+0000 7fe8f16e0b80 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55a8ddebbd80 0x55a8ddeba820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:56:30.678 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:30.673+0000 7fe8f16e0b80 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55a8dde91740 0x55a8ddebe440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:56:30.678 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:30.673+0000 7fe8f16e0b80 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a8ddd98c60 con 0x55a8dde91740 2023-07-05T18:56:30.678 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:30.673+0000 7fe8f16e0b80 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a8dddeb9f0 con 0x55a8ddebbd80 2023-07-05T18:56:30.678 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:30.673+0000 7fe8f16e0b80 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x55a8ddde4e80 con 0x55a8dde93f50 2023-07-05T18:56:30.678 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:30.673+0000 7fe8de7fc700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55a8dde91740 0x55a8ddebe440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:56:30.678 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:30.673+0000 7fe8de7fc700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55a8dde91740 0x55a8ddebe440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:58460/0 (socket says 172.21.15.46:58460) 2023-07-05T18:56:30.678 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:30.673+0000 7fe8de7fc700 1 -- 172.21.15.46:0/2921767088 learned_addr learned my addr 172.21.15.46:0/2921767088 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-07-05T18:56:30.678 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:30.673+0000 7fe8de7fc700 1 --2- 172.21.15.46:0/2921767088 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x55a8dde93f50 0x55a8dde94320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:56:30.679 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:30.673+0000 7fe8deffd700 1 --2- 172.21.15.46:0/2921767088 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55a8ddebbd80 0x55a8ddeba820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:56:30.679 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:30.673+0000 7fe8c77fe700 1 --2- 172.21.15.46:0/2555193881 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7fe8cc06ace0 0x7fe8cc06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:56:30.679 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:30.673+0000 7fe8de7fc700 1 -- 172.21.15.46:0/2921767088 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x55a8dde93f50 msgr2=0x55a8dde94320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-05T18:56:30.679 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:30.673+0000 7fe8de7fc700 1 --2- 172.21.15.46:0/2921767088 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x55a8dde93f50 0x55a8dde94320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:30.679 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:30.673+0000 7fe8de7fc700 1 -- 172.21.15.46:0/2921767088 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55a8ddebbd80 msgr2=0x55a8ddeba820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-05T18:56:30.679 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:30.673+0000 7fe8de7fc700 1 --2- 172.21.15.46:0/2921767088 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55a8ddebbd80 0x55a8ddeba820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:30.679 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:30.673+0000 7fe8de7fc700 1 -- 172.21.15.46:0/2921767088 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55a8ddc665e0 con 0x55a8dde91740 2023-07-05T18:56:30.680 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:30.673+0000 7fe8c77fe700 1 -- 172.21.15.46:0/2555193881 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fe8d80895d0 con 0x7fe8e015a610 2023-07-05T18:56:30.680 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:30.673+0000 7fe8de7fc700 1 --2- 172.21.15.46:0/2921767088 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55a8dde91740 0x55a8ddebe440 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7fe8d00090b0 tx=0x7fe8d0013040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fdeb4a554d1113cf server_cookie=0 in_seq=0 out_seq=0 2023-07-05T18:56:30.680 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:30.673+0000 7fe8df7fe700 1 --2- 172.21.15.46:0/2555193881 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7fe8cc06ace0 0x7fe8cc06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:56:30.680 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:30.673+0000 7fe8c4ff9700 1 -- 172.21.15.46:0/2921767088 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8d0003950 con 0x55a8dde91740 2023-07-05T18:56:30.680 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:30.673+0000 7fe8c4ff9700 1 -- 172.21.15.46:0/2921767088 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe8d0003ad0 con 0x55a8dde91740 2023-07-05T18:56:30.680 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:30.673+0000 7fe8c4ff9700 1 -- 172.21.15.46:0/2921767088 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8d0003e80 con 0x55a8dde91740 2023-07-05T18:56:30.680 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:30.674+0000 7fe8df7fe700 1 --2- 172.21.15.46:0/2555193881 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7fe8cc06ace0 0x7fe8cc06d190 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fe8d80547a0 tx=0x7fe8d800a6c0 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-05T18:56:30.680 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:30.674+0000 7fe8f16e0b80 1 -- 172.21.15.46:0/2921767088 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55a8dde91740 msgr2=0x55a8ddebe440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:56:30.681 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:30.674+0000 7fe8f16e0b80 1 --2- 172.21.15.46:0/2921767088 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55a8dde91740 0x55a8ddebe440 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7fe8d00090b0 tx=0x7fe8d0013040 comp rx=0 tx=0).stop 2023-07-05T18:56:30.681 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:30.674+0000 7fe8f16e0b80 1 -- 172.21.15.46:0/2921767088 shutdown_connections 2023-07-05T18:56:30.681 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:30.674+0000 7fe8f16e0b80 1 --2- 172.21.15.46:0/2921767088 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55a8dde91740 0x55a8ddebe440 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:30.681 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:30.674+0000 7fe8f16e0b80 1 --2- 172.21.15.46:0/2921767088 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x55a8dde93f50 0x55a8dde94320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:30.681 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:30.674+0000 7fe8f16e0b80 1 --2- 172.21.15.46:0/2921767088 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55a8ddebbd80 0x55a8ddeba820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:30.681 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:30.674+0000 7fe8f16e0b80 1 -- 172.21.15.46:0/2921767088 >> 172.21.15.46:0/2921767088 conn(0x55a8dde88fc0 msgr2=0x55a8dded91a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-05T18:56:30.681 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:30.674+0000 7fe8f16e0b80 1 -- 172.21.15.46:0/2921767088 shutdown_connections 2023-07-05T18:56:30.682 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:30.674+0000 7fe8f16e0b80 1 -- 172.21.15.46:0/2921767088 wait complete. 2023-07-05T18:56:30.682 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:30.675+0000 7fe8f16e0b80 1 -- start start 2023-07-05T18:56:30.682 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:30.675+0000 7fe8f16e0b80 1 Processor -- start 2023-07-05T18:56:30.685 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:30.676+0000 7fe8f16e0b80 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55a8dde91740 0x55a8ddeb4e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:56:30.685 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:30.676+0000 7fe8f16e0b80 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x55a8dde93f50 0x55a8dded4540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:56:30.685 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:30.676+0000 7fe8f16e0b80 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55a8ddebbd80 0x55a8ddedb6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:56:30.685 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:30.676+0000 7fe8f16e0b80 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a8ddd84a70 con 0x55a8dde91740 2023-07-05T18:56:30.685 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:30.676+0000 7fe8f16e0b80 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a8ddd84770 con 0x55a8ddebbd80 2023-07-05T18:56:30.685 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:30.676+0000 7fe8f16e0b80 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x55a8ddc688d0 con 0x55a8dde93f50 2023-07-05T18:56:30.686 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:30.676+0000 7fe8f16e0b80 10 client.0 _ll_register_callbacks cb 0x55a8ddd8a210 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-05T18:56:30.686 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:30.676+0000 7fe8de7fc700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55a8dde91740 0x55a8ddeb4e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:56:30.686 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:30.676+0000 7fe8de7fc700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55a8dde91740 0x55a8ddeb4e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:58464/0 (socket says 172.21.15.46:58464) 2023-07-05T18:56:30.686 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:30.676+0000 7fe8de7fc700 1 -- 172.21.15.46:0/228036259 learned_addr learned my addr 172.21.15.46:0/228036259 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-07-05T18:56:30.686 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:30.676+0000 7fe8deffd700 1 --2- 172.21.15.46:0/228036259 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x55a8dde93f50 0x55a8dded4540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:56:30.686 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:30.676+0000 7fe8de7fc700 1 --2- 172.21.15.46:0/228036259 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55a8ddebbd80 0x55a8ddedb6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:56:30.686 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:30.676+0000 7fe8de7fc700 1 -- 172.21.15.46:0/228036259 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x55a8dde93f50 msgr2=0x55a8dded4540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-05T18:56:30.686 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:30.676+0000 7fe8de7fc700 1 --2- 172.21.15.46:0/228036259 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x55a8dde93f50 0x55a8dded4540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:30.687 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:30.676+0000 7fe8de7fc700 1 -- 172.21.15.46:0/228036259 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55a8ddebbd80 msgr2=0x55a8ddedb6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-05T18:56:30.687 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:30.676+0000 7fe8de7fc700 1 --2- 172.21.15.46:0/228036259 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55a8ddebbd80 0x55a8ddedb6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:30.687 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:30.676+0000 7fe8de7fc700 1 -- 172.21.15.46:0/228036259 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe8d0025040 con 0x55a8dde91740 2023-07-05T18:56:30.687 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:30.676+0000 7fe8de7fc700 1 --2- 172.21.15.46:0/228036259 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55a8dde91740 0x55a8ddeb4e40 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fe8d0009840 tx=0x7fe8d0009210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=66dea6622b81f017 server_cookie=0 in_seq=0 out_seq=0 2023-07-05T18:56:30.687 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:30.676+0000 7fe8bdffb700 10 client.0 ms_handle_connect on v2:172.21.15.46:3300/0 2023-07-05T18:56:30.687 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:30.676+0000 7fe8bdffb700 1 -- 172.21.15.46:0/228036259 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8d0033070 con 0x55a8dde91740 2023-07-05T18:56:30.687 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:30.676+0000 7fe8bdffb700 1 -- 172.21.15.46:0/228036259 <== mon.0 v2:172.21.15.46:3300/0 2 ==== osd_map(21..21 src has 1..21) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fe8d0000e40 con 0x55a8dde91740 2023-07-05T18:56:30.687 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:30.676+0000 7fe8f16e0b80 1 -- 172.21.15.46:0/228036259 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55a8dde86780 con 0x55a8dde91740 2023-07-05T18:56:30.688 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:30.676+0000 7fe8bdffb700 1 -- 172.21.15.46:0/228036259 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_get_version_reply(handle=1 version=8) v2 ==== 24+0+0 (secure 0 0 0) 0x7fe8d0011630 con 0x55a8dde91740 2023-07-05T18:56:30.688 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:30.677+0000 7fe8f16e0b80 10 client.4683 fetch_fsmap learned FSMap version 8 2023-07-05T18:56:30.688 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:30.677+0000 7fe8f16e0b80 1 -- 172.21.15.46:0/228036259 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,fsmap=8,monmap=2+}) v3 -- 0x55a8ddc12d90 con 0x55a8dde91740 2023-07-05T18:56:30.688 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:30.677+0000 7fe8bdffb700 1 -- 172.21.15.46:0/228036259 <== mon.0 v2:172.21.15.46:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55a8dde86780 con 0x55a8dde91740 2023-07-05T18:56:30.688 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:30.677+0000 7fe8bdffb700 1 -- 172.21.15.46:0/228036259 <== mon.0 v2:172.21.15.46:3300/0 5 ==== fsmap(e 8) v1 ==== 3114+0+0 (secure 0 0 0) 0x7fe8d0018070 con 0x55a8dde91740 2023-07-05T18:56:30.688 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:30.677+0000 7fe8f16e0b80 10 client.4683 fetch_fsmap finished waiting for FSMap version 8 2023-07-05T18:56:30.688 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:30.677+0000 7fe8f16e0b80 10 client.4683 resolve_mds: resolved name 'b' to daemon mds.b 2023-07-05T18:56:30.689 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:30.677+0000 7fe8f16e0b80 20 client.4683 populate_metadata read hostname 'smithi046' 2023-07-05T18:56:30.689 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:30.677+0000 7fe8f16e0b80 1 --2- 172.21.15.46:0/228036259 >> [v2:172.21.15.73:6834/2654190748,v1:172.21.15.73:6836/2654190748] conn(0x55a8ddeda810 0x55a8ddedabe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:56:30.689 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:30.677+0000 7fe8f16e0b80 4 client.4683 mds_command: new command op to 4296 tid=0[{"prefix": "get_command_descriptions"}] 2023-07-05T18:56:30.689 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:30.677+0000 7fe8f16e0b80 1 -- 172.21.15.46:0/228036259 --> [v2:172.21.15.73:6834/2654190748,v1:172.21.15.73:6836/2654190748] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55a8ddddde60 con 0x55a8ddeda810 2023-07-05T18:56:30.689 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:30.677+0000 7fe8deffd700 1 --2- 172.21.15.46:0/228036259 >> [v2:172.21.15.73:6834/2654190748,v1:172.21.15.73:6836/2654190748] conn(0x55a8ddeda810 0x55a8ddedabe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:56:30.689 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:30.677+0000 7fe8bdffb700 10 client.4683 ms_handle_connect on v2:172.21.15.73:6834/2654190748 2023-07-05T18:56:30.689 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:30.677+0000 7fe8deffd700 1 --2- 172.21.15.46:0/228036259 >> [v2:172.21.15.73:6834/2654190748,v1:172.21.15.73:6836/2654190748] conn(0x55a8ddeda810 0x55a8ddedabe0 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=cfedbf30c392bcf0 server_cookie=7d8973d4200301f1 in_seq=0 out_seq=0 2023-07-05T18:56:30.689 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:30.678+0000 7fe8bdffb700 1 -- 172.21.15.46:0/228036259 <== mds.0 v2:172.21.15.73:6834/2654190748 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18291 (crc 0 0 0) 0x55a8ddddde60 con 0x55a8ddeda810 2023-07-05T18:56:30.690 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:30.678+0000 7fe8bdffb700 10 client.4683 handle_command_reply: tid=0 2023-07-05T18:56:30.690 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:30.678+0000 7fe8f16e0b80 1 client.4683 shutdown 2023-07-05T18:56:30.690 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:30.678+0000 7fe8f16e0b80 1 -- 172.21.15.46:0/228036259 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55a8dde91740 msgr2=0x55a8ddeb4e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:56:30.690 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:30.678+0000 7fe8f16e0b80 1 --2- 172.21.15.46:0/228036259 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55a8dde91740 0x55a8ddeb4e40 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fe8d0009840 tx=0x7fe8d0009210 comp rx=0 tx=0).stop 2023-07-05T18:56:30.690 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:30.678+0000 7fe8f16e0b80 1 -- 172.21.15.46:0/228036259 shutdown_connections 2023-07-05T18:56:30.690 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:30.678+0000 7fe8f16e0b80 1 --2- 172.21.15.46:0/228036259 >> [v2:172.21.15.73:6834/2654190748,v1:172.21.15.73:6836/2654190748] conn(0x55a8ddeda810 0x55a8ddedabe0 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:30.690 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:30.678+0000 7fe8f16e0b80 1 --2- 172.21.15.46:0/228036259 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55a8ddebbd80 0x55a8ddedb6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:30.690 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:30.678+0000 7fe8f16e0b80 1 --2- 172.21.15.46:0/228036259 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55a8dde91740 0x55a8ddeb4e40 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:30.691 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:30.678+0000 7fe8bdffb700 0 client.4683 ms_handle_reset on v2:172.21.15.73:6834/2654190748 2023-07-05T18:56:30.691 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:30.678+0000 7fe8f16e0b80 1 --2- 172.21.15.46:0/228036259 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x55a8dde93f50 0x55a8dded4540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:30.691 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:30.678+0000 7fe8f16e0b80 1 -- 172.21.15.46:0/228036259 >> 172.21.15.46:0/228036259 conn(0x55a8dde88fc0 msgr2=0x55a8dde8cf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-05T18:56:30.691 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:30.679+0000 7fe8f16e0b80 1 -- 172.21.15.46:0/228036259 shutdown_connections 2023-07-05T18:56:30.691 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:30.679+0000 7fe8f16e0b80 1 -- 172.21.15.46:0/228036259 wait complete. 2023-07-05T18:56:30.691 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:30.679+0000 7fe8f16e0b80 20 client.4683 trim_cache size 0 max 16384 2023-07-05T18:56:30.699 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:30.697+0000 7fe8f16e0b80 1 Processor -- start 2023-07-05T18:56:30.699 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:30.697+0000 7fe8f16e0b80 1 -- start start 2023-07-05T18:56:30.700 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:30.698+0000 7fe8f16e0b80 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55a8dde91740 0x55a8dded3b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:56:30.701 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:30.698+0000 7fe8f16e0b80 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55a8dde93f50 0x55a8dde8d2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:56:30.701 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:30.698+0000 7fe8f16e0b80 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x55a8ddebbd80 0x55a8ddeb60e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:56:30.701 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:30.698+0000 7fe8f16e0b80 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a8dded32e0 con 0x55a8dde91740 2023-07-05T18:56:30.701 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:30.698+0000 7fe8f16e0b80 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a8dde88e30 con 0x55a8dde93f50 2023-07-05T18:56:30.701 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:30.698+0000 7fe8f16e0b80 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x55a8dde92e40 con 0x55a8ddebbd80 2023-07-05T18:56:30.701 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:30.698+0000 7fe8de7fc700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55a8dde91740 0x55a8dded3b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:56:30.701 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:30.698+0000 7fe8de7fc700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55a8dde91740 0x55a8dded3b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:58472/0 (socket says 172.21.15.46:58472) 2023-07-05T18:56:30.702 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:30.698+0000 7fe8de7fc700 1 -- 172.21.15.46:0/2573200221 learned_addr learned my addr 172.21.15.46:0/2573200221 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-07-05T18:56:30.702 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:30.698+0000 7fe8deffd700 1 --2- 172.21.15.46:0/2573200221 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55a8dde93f50 0x55a8dde8d2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:56:30.702 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:30.698+0000 7fe8de7fc700 1 --2- 172.21.15.46:0/2573200221 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x55a8ddebbd80 0x55a8ddeb60e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:56:30.702 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:30.698+0000 7fe8de7fc700 1 -- 172.21.15.46:0/2573200221 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x55a8ddebbd80 msgr2=0x55a8ddeb60e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-05T18:56:30.702 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:30.698+0000 7fe8de7fc700 1 --2- 172.21.15.46:0/2573200221 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x55a8ddebbd80 0x55a8ddeb60e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:30.702 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:30.698+0000 7fe8de7fc700 1 -- 172.21.15.46:0/2573200221 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55a8dde93f50 msgr2=0x55a8dde8d2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-05T18:56:30.702 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:30.698+0000 7fe8de7fc700 1 --2- 172.21.15.46:0/2573200221 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55a8dde93f50 0x55a8dde8d2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:30.702 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:30.698+0000 7fe8de7fc700 1 -- 172.21.15.46:0/2573200221 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55a8ddbfbc10 con 0x55a8dde91740 2023-07-05T18:56:30.703 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:30.698+0000 7fe8deffd700 1 --2- 172.21.15.46:0/2573200221 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55a8dde93f50 0x55a8dde8d2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-05T18:56:30.703 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:30.698+0000 7fe8de7fc700 1 --2- 172.21.15.46:0/2573200221 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55a8dde91740 0x55a8dded3b60 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fe8d0000c00 tx=0x7fe8d002b000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c57eca59f835e716 server_cookie=0 in_seq=0 out_seq=0 2023-07-05T18:56:30.703 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:30.699+0000 7fe8c57fa700 1 -- 172.21.15.46:0/2573200221 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8d0033040 con 0x55a8dde91740 2023-07-05T18:56:30.703 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:30.699+0000 7fe8c57fa700 1 -- 172.21.15.46:0/2573200221 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe8d00045c0 con 0x55a8dde91740 2023-07-05T18:56:30.703 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:30.699+0000 7fe8c57fa700 1 -- 172.21.15.46:0/2573200221 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8d0011870 con 0x55a8dde91740 2023-07-05T18:56:30.706 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:30.699+0000 7fe8f16e0b80 1 -- 172.21.15.46:0/2573200221 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55a8dde91740 msgr2=0x55a8dded3b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:56:30.707 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:30.699+0000 7fe8f16e0b80 1 --2- 172.21.15.46:0/2573200221 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55a8dde91740 0x55a8dded3b60 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fe8d0000c00 tx=0x7fe8d002b000 comp rx=0 tx=0).stop 2023-07-05T18:56:30.707 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:30.699+0000 7fe8f16e0b80 1 -- 172.21.15.46:0/2573200221 shutdown_connections 2023-07-05T18:56:30.707 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:30.699+0000 7fe8f16e0b80 1 --2- 172.21.15.46:0/2573200221 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x55a8ddebbd80 0x55a8ddeb60e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:30.707 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:30.699+0000 7fe8f16e0b80 1 --2- 172.21.15.46:0/2573200221 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55a8dde91740 0x55a8dded3b60 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:30.707 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:30.699+0000 7fe8f16e0b80 1 --2- 172.21.15.46:0/2573200221 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55a8dde93f50 0x55a8dde8d2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:30.707 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:30.699+0000 7fe8f16e0b80 1 -- 172.21.15.46:0/2573200221 >> 172.21.15.46:0/2573200221 conn(0x55a8dde88fc0 msgr2=0x55a8ddefafb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-05T18:56:30.707 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:30.699+0000 7fe8f16e0b80 1 -- 172.21.15.46:0/2573200221 shutdown_connections 2023-07-05T18:56:30.708 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:30.699+0000 7fe8f16e0b80 1 -- 172.21.15.46:0/2573200221 wait complete. 2023-07-05T18:56:30.708 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:30.700+0000 7fe8f16e0b80 1 -- start start 2023-07-05T18:56:30.708 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:30.700+0000 7fe8f16e0b80 1 Processor -- start 2023-07-05T18:56:30.708 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:30.701+0000 7fe8f16e0b80 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55a8dde91740 0x55a8dde91b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:56:30.708 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:30.701+0000 7fe8f16e0b80 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x55a8dde93f50 0x55a8ddeb3c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:56:30.708 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:30.701+0000 7fe8f16e0b80 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55a8ddebbd80 0x55a8ddebffd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:56:30.708 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:30.701+0000 7fe8f16e0b80 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a8ddeb5d00 con 0x55a8ddebbd80 2023-07-05T18:56:30.709 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:30.701+0000 7fe8f16e0b80 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a8ddec09c0 con 0x55a8dde91740 2023-07-05T18:56:30.709 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:30.701+0000 7fe8f16e0b80 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x55a8ddeb5210 con 0x55a8dde93f50 2023-07-05T18:56:30.709 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:30.701+0000 7fe8f16e0b80 10 client.0 _ll_register_callbacks cb 0x55a8ddd8a210 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-05T18:56:30.709 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:30.701+0000 7fe8de7fc700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55a8ddebbd80 0x55a8ddebffd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:56:30.709 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:30.701+0000 7fe8de7fc700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55a8ddebbd80 0x55a8ddebffd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:58482/0 (socket says 172.21.15.46:58482) 2023-07-05T18:56:30.709 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:30.701+0000 7fe8de7fc700 1 -- 172.21.15.46:0/1084441639 learned_addr learned my addr 172.21.15.46:0/1084441639 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-07-05T18:56:30.709 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:30.701+0000 7fe8de7fc700 1 --2- 172.21.15.46:0/1084441639 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55a8dde91740 0x55a8dde91b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:56:30.709 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:30.701+0000 7fe8deffd700 1 --2- 172.21.15.46:0/1084441639 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x55a8dde93f50 0x55a8ddeb3c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:56:30.710 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:30.701+0000 7fe8de7fc700 1 -- 172.21.15.46:0/1084441639 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x55a8dde93f50 msgr2=0x55a8ddeb3c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-05T18:56:30.710 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:30.701+0000 7fe8de7fc700 1 --2- 172.21.15.46:0/1084441639 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x55a8dde93f50 0x55a8ddeb3c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:30.710 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:30.701+0000 7fe8de7fc700 1 -- 172.21.15.46:0/1084441639 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55a8dde91740 msgr2=0x55a8dde91b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-05T18:56:30.710 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:30.701+0000 7fe8de7fc700 1 --2- 172.21.15.46:0/1084441639 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55a8dde91740 0x55a8dde91b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:30.710 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:30.701+0000 7fe8de7fc700 1 -- 172.21.15.46:0/1084441639 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55a8ddc12d90 con 0x55a8ddebbd80 2023-07-05T18:56:30.710 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:30.701+0000 7fe8de7fc700 1 --2- 172.21.15.46:0/1084441639 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55a8ddebbd80 0x55a8ddebffd0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fe8d000a010 tx=0x7fe8d002e040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bfabcf7052d359d1 server_cookie=0 in_seq=0 out_seq=0 2023-07-05T18:56:30.710 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:30.701+0000 7fe8bdffb700 10 client.0 ms_handle_connect on v2:172.21.15.46:3300/0 2023-07-05T18:56:30.711 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:30.701+0000 7fe8bdffb700 1 -- 172.21.15.46:0/1084441639 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8d0033070 con 0x55a8ddebbd80 2023-07-05T18:56:30.711 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:30.701+0000 7fe8bdffb700 1 -- 172.21.15.46:0/1084441639 <== mon.0 v2:172.21.15.46:3300/0 2 ==== osd_map(21..21 src has 1..21) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fe8d0000e40 con 0x55a8ddebbd80 2023-07-05T18:56:30.711 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:30.701+0000 7fe8f16e0b80 1 -- 172.21.15.46:0/1084441639 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fe8d0003ad0 con 0x55a8ddebbd80 2023-07-05T18:56:30.711 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:30.701+0000 7fe8bdffb700 1 -- 172.21.15.46:0/1084441639 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_get_version_reply(handle=1 version=8) v2 ==== 24+0+0 (secure 0 0 0) 0x7fe8d0005a20 con 0x55a8ddebbd80 2023-07-05T18:56:30.711 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:30.701+0000 7fe8f16e0b80 10 client.4689 fetch_fsmap learned FSMap version 8 2023-07-05T18:56:30.711 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:30.701+0000 7fe8f16e0b80 1 -- 172.21.15.46:0/1084441639 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,fsmap=8,monmap=2+}) v3 -- 0x55a8ddc39200 con 0x55a8ddebbd80 2023-07-05T18:56:30.711 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:30.702+0000 7fe8bdffb700 1 -- 172.21.15.46:0/1084441639 <== mon.0 v2:172.21.15.46:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe8d0003ad0 con 0x55a8ddebbd80 2023-07-05T18:56:30.711 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:30.702+0000 7fe8bdffb700 1 -- 172.21.15.46:0/1084441639 <== mon.0 v2:172.21.15.46:3300/0 5 ==== fsmap(e 8) v1 ==== 3114+0+0 (secure 0 0 0) 0x7fe8d0018070 con 0x55a8ddebbd80 2023-07-05T18:56:30.712 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:30.702+0000 7fe8f16e0b80 10 client.4689 fetch_fsmap finished waiting for FSMap version 8 2023-07-05T18:56:30.712 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:30.702+0000 7fe8f16e0b80 10 client.4689 resolve_mds: resolved name 'b' to daemon mds.b 2023-07-05T18:56:30.712 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:30.702+0000 7fe8f16e0b80 20 client.4689 populate_metadata read hostname 'smithi046' 2023-07-05T18:56:30.712 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:30.702+0000 7fe8f16e0b80 1 --2- 172.21.15.46:0/1084441639 >> [v2:172.21.15.73:6834/2654190748,v1:172.21.15.73:6836/2654190748] conn(0x55a8ddec0510 0x55a8ddeb60e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:56:30.712 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:30.702+0000 7fe8f16e0b80 4 client.4689 mds_command: new command op to 4296 tid=0[{"prefix": "status"}] 2023-07-05T18:56:30.712 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:30.702+0000 7fe8f16e0b80 1 -- 172.21.15.46:0/1084441639 --> [v2:172.21.15.73:6834/2654190748,v1:172.21.15.73:6836/2654190748] -- command(tid 0: {"prefix": "status"}) v1 -- 0x55a8ddda0000 con 0x55a8ddec0510 2023-07-05T18:56:30.712 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:30.702+0000 7fe8deffd700 1 --2- 172.21.15.46:0/1084441639 >> [v2:172.21.15.73:6834/2654190748,v1:172.21.15.73:6836/2654190748] conn(0x55a8ddec0510 0x55a8ddeb60e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:56:30.712 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:30.702+0000 7fe8bdffb700 10 client.4689 ms_handle_connect on v2:172.21.15.73:6834/2654190748 2023-07-05T18:56:30.713 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:30.702+0000 7fe8deffd700 1 --2- 172.21.15.46:0/1084441639 >> [v2:172.21.15.73:6834/2654190748,v1:172.21.15.73:6836/2654190748] conn(0x55a8ddec0510 0x55a8ddeb60e0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f75c8287578ce189 server_cookie=d0e3e0237d945b85 in_seq=0 out_seq=0 2023-07-05T18:56:30.713 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:30.702+0000 7fe8bdffb700 1 -- 172.21.15.46:0/1084441639 <== mds.0 v2:172.21.15.73:6834/2654190748 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+324 (crc 0 0 0) 0x55a8ddda0000 con 0x55a8ddec0510 2023-07-05T18:56:30.713 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:30.702+0000 7fe8bdffb700 10 client.4689 handle_command_reply: tid=0 2023-07-05T18:56:30.713 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:30.702+0000 7fe8f16e0b80 1 client.4689 shutdown 2023-07-05T18:56:30.713 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:30.703+0000 7fe8f16e0b80 1 -- 172.21.15.46:0/1084441639 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55a8ddebbd80 msgr2=0x55a8ddebffd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:56:30.713 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:30.703+0000 7fe8f16e0b80 1 --2- 172.21.15.46:0/1084441639 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55a8ddebbd80 0x55a8ddebffd0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fe8d000a010 tx=0x7fe8d002e040 comp rx=0 tx=0).stop 2023-07-05T18:56:30.713 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:30.703+0000 7fe8f16e0b80 1 -- 172.21.15.46:0/1084441639 shutdown_connections 2023-07-05T18:56:30.714 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:30.703+0000 7fe8f16e0b80 1 --2- 172.21.15.46:0/1084441639 >> [v2:172.21.15.73:6834/2654190748,v1:172.21.15.73:6836/2654190748] conn(0x55a8ddec0510 0x55a8ddeb60e0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:30.714 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:30.703+0000 7fe8f16e0b80 1 --2- 172.21.15.46:0/1084441639 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55a8ddebbd80 0x55a8ddebffd0 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:30.714 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:30.703+0000 7fe8f16e0b80 1 --2- 172.21.15.46:0/1084441639 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55a8dde91740 0x55a8dde91b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:30.714 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:30.703+0000 7fe8bdffb700 0 client.4689 ms_handle_reset on v2:172.21.15.73:6834/2654190748 2023-07-05T18:56:30.714 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:30.703+0000 7fe8f16e0b80 1 --2- 172.21.15.46:0/1084441639 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x55a8dde93f50 0x55a8ddeb3c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:30.714 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:30.703+0000 7fe8f16e0b80 1 -- 172.21.15.46:0/1084441639 >> 172.21.15.46:0/1084441639 conn(0x55a8dde88fc0 msgr2=0x55a8ddedc350 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-05T18:56:30.714 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:30.703+0000 7fe8f16e0b80 1 -- 172.21.15.46:0/1084441639 shutdown_connections 2023-07-05T18:56:30.714 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:30.703+0000 7fe8f16e0b80 1 -- 172.21.15.46:0/1084441639 wait complete. 2023-07-05T18:56:30.715 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:30.703+0000 7fe8f16e0b80 20 client.4689 trim_cache size 0 max 16384 2023-07-05T18:56:30.715 INFO:teuthology.orchestra.run.smithi046.stdout:{ 2023-07-05T18:56:30.715 INFO:teuthology.orchestra.run.smithi046.stdout: "cluster_fsid": "042652d3-d80c-4ad8-9366-3e94f2a0a512", 2023-07-05T18:56:30.715 INFO:teuthology.orchestra.run.smithi046.stdout: "whoami": 0, 2023-07-05T18:56:30.715 INFO:teuthology.orchestra.run.smithi046.stdout: "id": 4296, 2023-07-05T18:56:30.715 INFO:teuthology.orchestra.run.smithi046.stdout: "want_state": "up:active", 2023-07-05T18:56:30.716 INFO:teuthology.orchestra.run.smithi046.stdout: "state": "up:active", 2023-07-05T18:56:30.716 INFO:teuthology.orchestra.run.smithi046.stdout: "fs_name": "cephfs", 2023-07-05T18:56:30.716 INFO:teuthology.orchestra.run.smithi046.stdout: "rank_uptime": 15.607956131, 2023-07-05T18:56:30.716 INFO:teuthology.orchestra.run.smithi046.stdout: "mdsmap_epoch": 8, 2023-07-05T18:56:30.716 INFO:teuthology.orchestra.run.smithi046.stdout: "osdmap_epoch": 21, 2023-07-05T18:56:30.716 INFO:teuthology.orchestra.run.smithi046.stdout: "osdmap_epoch_barrier": 21, 2023-07-05T18:56:30.716 INFO:teuthology.orchestra.run.smithi046.stdout: "uptime": 20.955578274000001 2023-07-05T18:56:30.717 INFO:teuthology.orchestra.run.smithi046.stdout:} 2023-07-05T18:56:30.718 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:30.703+0000 7fe8e555b700 1 -- 172.21.15.46:0/2555193881 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7fe8cc06ace0 msgr2=0x7fe8cc06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:56:30.718 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:30.703+0000 7fe8e555b700 1 --2- 172.21.15.46:0/2555193881 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7fe8cc06ace0 0x7fe8cc06d190 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fe8d80547a0 tx=0x7fe8d800a6c0 comp rx=0 tx=0).stop 2023-07-05T18:56:30.718 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:30.703+0000 7fe8e555b700 1 -- 172.21.15.46:0/2555193881 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe8e015a610 msgr2=0x7fe8e01e44c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:56:30.718 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:30.703+0000 7fe8e555b700 1 --2- 172.21.15.46:0/2555193881 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe8e015a610 0x7fe8e01e44c0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fe8d800cc30 tx=0x7fe8d800cf40 comp rx=0 tx=0).stop 2023-07-05T18:56:30.718 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:30.703+0000 7fe8e555b700 1 -- 172.21.15.46:0/2555193881 shutdown_connections 2023-07-05T18:56:30.718 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:30.703+0000 7fe8e555b700 1 --2- 172.21.15.46:0/2555193881 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7fe8cc06ace0 0x7fe8cc06d190 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:30.719 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:30.703+0000 7fe8e555b700 1 --2- 172.21.15.46:0/2555193881 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe8e015a610 0x7fe8e01e44c0 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:30.719 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:30.703+0000 7fe8e555b700 1 --2- 172.21.15.46:0/2555193881 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fe8e00aeac0 0x7fe8e0152360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:30.719 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:30.703+0000 7fe8e555b700 1 --2- 172.21.15.46:0/2555193881 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe8e00cede0 0x7fe8e01e3f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:30.719 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:30.703+0000 7fe8e555b700 1 -- 172.21.15.46:0/2555193881 >> 172.21.15.46:0/2555193881 conn(0x7fe8e0099e00 msgr2=0x7fe8e006e6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-05T18:56:30.719 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:30.703+0000 7fe8e555b700 1 -- 172.21.15.46:0/2555193881 shutdown_connections 2023-07-05T18:56:30.719 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:30.703+0000 7fe8e555b700 1 -- 172.21.15.46:0/2555193881 wait complete. 2023-07-05T18:56:30.720 INFO:teuthology.run_tasks:Running task kclient... 2023-07-05T18:56:30.750 INFO:tasks.kclient:Mounting kernel clients... 2023-07-05T18:56:30.750 INFO:tasks.kclient:config is {'client.0': {}, 'client.2': {}, 'client.1': {}, 'client.3': {}} 2023-07-05T18:56:30.751 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-05T18:56:30.751 DEBUG:teuthology.orchestra.run.smithi046:> ip netns list 2023-07-05T18:56:30.769 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-05T18:56:30.769 DEBUG:teuthology.orchestra.run.smithi046:> sudo ip link delete ceph-brx 2023-07-05T18:56:30.839 INFO:teuthology.orchestra.run.smithi046.stderr:Cannot find device "ceph-brx" 2023-07-05T18:56:30.840 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-07-05T18:56:30.840 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-05T18:56:30.841 DEBUG:teuthology.orchestra.run.smithi046:> ip netns list 2023-07-05T18:56:30.898 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-05T18:56:30.898 DEBUG:teuthology.orchestra.run.smithi046:> sudo ip link delete ceph-brx 2023-07-05T18:56:30.966 INFO:teuthology.orchestra.run.smithi046.stderr:Cannot find device "ceph-brx" 2023-07-05T18:56:30.967 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-07-05T18:56:30.968 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-05T18:56:30.969 DEBUG:teuthology.orchestra.run.smithi073:> ip netns list 2023-07-05T18:56:30.990 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-05T18:56:30.990 DEBUG:teuthology.orchestra.run.smithi073:> sudo ip link delete ceph-brx 2023-07-05T18:56:31.064 INFO:teuthology.orchestra.run.smithi073.stderr:Cannot find device "ceph-brx" 2023-07-05T18:56:31.065 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-07-05T18:56:31.065 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-05T18:56:31.066 DEBUG:teuthology.orchestra.run.smithi073:> ip netns list 2023-07-05T18:56:31.125 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-05T18:56:31.125 DEBUG:teuthology.orchestra.run.smithi073:> sudo ip link delete ceph-brx 2023-07-05T18:56:31.196 INFO:teuthology.orchestra.run.smithi073.stderr:Cannot find device "ceph-brx" 2023-07-05T18:56:31.197 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-07-05T18:56:31.198 INFO:tasks.kclient:client.0 config is {'syntax': 'v1'} 2023-07-05T18:56:31.199 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2023-07-05T18:56:31.199 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-07-05T18:56:31.200 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-07-05T18:56:31.328 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:31.326+0000 7f7078d3a700 1 Processor -- start 2023-07-05T18:56:31.328 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:31.326+0000 7f7078d3a700 1 -- start start 2023-07-05T18:56:31.331 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:31.327+0000 7f7078d3a700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f707406f5b0 0x7f707406f980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:56:31.331 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:31.327+0000 7f7078d3a700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f70740cc840 0x7f70740cd650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:56:31.331 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:31.327+0000 7f7078d3a700 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f70740c9400 con 0x7f707415cdd0 2023-07-05T18:56:31.331 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:31.327+0000 7f7078d3a700 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f70740cb160 con 0x7f70740cc840 2023-07-05T18:56:31.332 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:31.327+0000 7f7078d3a700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f707406fec0 con 0x7f707406f5b0 2023-07-05T18:56:31.332 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:31.327+0000 7f7072d9d700 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7f707415cdd0 0x7f707415d250 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:57762/0 (socket says 172.21.15.46:57762) 2023-07-05T18:56:31.332 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:31.327+0000 7f7072d9d700 1 -- 172.21.15.46:0/3721678165 learned_addr learned my addr 172.21.15.46:0/3721678165 (peer_addr_for_me v1:172.21.15.46:0/0) 2023-07-05T18:56:31.332 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:31.327+0000 7f7071d9b700 1 --2- 172.21.15.46:0/3721678165 >> v2:172.21.15.73:3300/0 conn(0x7f70740cc840 0x7f70740cd650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:56:31.333 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:31.327+0000 7f707259c700 1 --2- 172.21.15.46:0/3721678165 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f707406f5b0 0x7f707406f980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:56:31.333 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:31.327+0000 7f707159a700 1 -- 172.21.15.46:0/3721678165 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1071387487 0 0) 0x7f70740c9400 con 0x7f707415cdd0 2023-07-05T18:56:31.333 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:31.327+0000 7f707159a700 1 -- 172.21.15.46:0/3721678165 --> v1:172.21.15.46:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f705c0035b0 con 0x7f707415cdd0 2023-07-05T18:56:31.333 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:31.328+0000 7f707159a700 1 -- 172.21.15.46:0/3721678165 <== mon.0 v1:172.21.15.46:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1741122375 0 0) 0x7f705c0035b0 con 0x7f707415cdd0 2023-07-05T18:56:31.334 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:31.328+0000 7f707159a700 1 -- 172.21.15.46:0/3721678165 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f707406f5b0 msgr2=0x7f707406f980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-05T18:56:31.334 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:31.328+0000 7f707159a700 1 --2- 172.21.15.46:0/3721678165 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f707406f5b0 0x7f707406f980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:31.334 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:31.328+0000 7f707159a700 1 -- 172.21.15.46:0/3721678165 >> v2:172.21.15.73:3300/0 conn(0x7f70740cc840 msgr2=0x7f70740cd650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-05T18:56:31.334 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:31.328+0000 7f707159a700 1 --2- 172.21.15.46:0/3721678165 >> v2:172.21.15.73:3300/0 conn(0x7f70740cc840 0x7f70740cd650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:31.334 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:31.328+0000 7f707159a700 1 -- 172.21.15.46:0/3721678165 --> v1:172.21.15.46:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f70741596a0 con 0x7f707415cdd0 2023-07-05T18:56:31.334 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:31.328+0000 7f707159a700 1 -- 172.21.15.46:0/3721678165 <== mon.0 v1:172.21.15.46:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2195585215 0 0) 0x7f706c0019f0 con 0x7f707415cdd0 2023-07-05T18:56:31.334 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:31.328+0000 7f707259c700 1 --2- 172.21.15.46:0/3721678165 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f707406f5b0 0x7f707406f980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-05T18:56:31.335 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:31.328+0000 7f7071d9b700 1 --2- 172.21.15.46:0/3721678165 >> v2:172.21.15.73:3300/0 conn(0x7f70740cc840 0x7f70740cd650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-05T18:56:31.335 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:31.328+0000 7f707159a700 1 -- 172.21.15.46:0/3721678165 >> v1:172.21.15.46:6789/0 conn(0x7f707415cdd0 legacy=0x7f707415d250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:56:31.335 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:31.328+0000 7f707159a700 1 --2- 172.21.15.46:0/3721678165 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f705c003a00 0x7f705c003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:56:31.335 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:31.328+0000 7f707159a700 1 --2- 172.21.15.46:0/3721678165 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f705c004430 0x7f705c0048f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:56:31.335 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:31.328+0000 7f707159a700 1 --2- 172.21.15.46:0/3721678165 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f707406f5b0 0x7f705c004f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:56:31.335 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:31.328+0000 7f707159a700 1 -- 172.21.15.46:0/3721678165 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70740cb160 con 0x7f705c004430 2023-07-05T18:56:31.335 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:31.328+0000 7f707159a700 1 -- 172.21.15.46:0/3721678165 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f707406fec0 con 0x7f705c003a00 2023-07-05T18:56:31.335 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:31.328+0000 7f707159a700 1 -- 172.21.15.46:0/3721678165 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f705c00ba10 con 0x7f707406f5b0 2023-07-05T18:56:31.336 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:31.328+0000 7f7071d9b700 1 --2- 172.21.15.46:0/3721678165 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f705c004430 0x7f705c0048f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:56:31.336 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:31.328+0000 7f707259c700 1 --2- 172.21.15.46:0/3721678165 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f705c003a00 0x7f705c003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:56:31.336 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:31.328+0000 7f7072d9d700 1 --2- 172.21.15.46:0/3721678165 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f707406f5b0 0x7f705c004f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:56:31.336 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:31.328+0000 7f7071d9b700 1 -- 172.21.15.46:0/3721678165 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f707406f5b0 msgr2=0x7f705c004f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-05T18:56:31.336 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:31.328+0000 7f7071d9b700 1 --2- 172.21.15.46:0/3721678165 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f707406f5b0 0x7f705c004f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:31.336 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:31.328+0000 7f7071d9b700 1 -- 172.21.15.46:0/3721678165 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f705c003a00 msgr2=0x7f705c003e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-05T18:56:31.336 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:31.328+0000 7f7071d9b700 1 --2- 172.21.15.46:0/3721678165 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f705c003a00 0x7f705c003e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:31.337 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:31.328+0000 7f7071d9b700 1 -- 172.21.15.46:0/3721678165 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f70680094a0 con 0x7f705c004430 2023-07-05T18:56:31.337 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:31.328+0000 7f7071d9b700 1 --2- 172.21.15.46:0/3721678165 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f705c004430 0x7f705c0048f0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f7064009d00 tx=0x7f705c005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bc7e1c6084fc63ee server_cookie=0 in_seq=0 out_seq=0 2023-07-05T18:56:31.337 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:31.328+0000 7f707159a700 1 -- 172.21.15.46:0/3721678165 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7064009e50 con 0x7f705c004430 2023-07-05T18:56:31.337 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:31.328+0000 7f707159a700 1 -- 172.21.15.46:0/3721678165 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f706400e9a0 con 0x7f705c004430 2023-07-05T18:56:31.337 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:31.329+0000 7f707159a700 1 -- 172.21.15.46:0/3721678165 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f706400ed50 con 0x7f705c004430 2023-07-05T18:56:31.337 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:31.329+0000 7f7078d3a700 1 -- 172.21.15.46:0/3721678165 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f705c004430 msgr2=0x7f705c0048f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:56:31.337 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:31.329+0000 7f7078d3a700 1 --2- 172.21.15.46:0/3721678165 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f705c004430 0x7f705c0048f0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f7064009d00 tx=0x7f705c005880 comp rx=0 tx=0).stop 2023-07-05T18:56:31.337 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:31.329+0000 7f7072d9d700 1 -- 172.21.15.46:0/3721678165 reap_dead start 2023-07-05T18:56:31.338 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:31.329+0000 7f7078d3a700 1 -- 172.21.15.46:0/3721678165 shutdown_connections 2023-07-05T18:56:31.338 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:31.329+0000 7f7078d3a700 1 -- 172.21.15.46:0/3721678165 >> 172.21.15.46:0/3721678165 conn(0x7f70740b0fc0 msgr2=0x7f70740ce860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-05T18:56:31.338 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:31.329+0000 7f7078d3a700 1 -- 172.21.15.46:0/3721678165 shutdown_connections 2023-07-05T18:56:31.338 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:31.329+0000 7f7078d3a700 1 -- 172.21.15.46:0/3721678165 wait complete. 2023-07-05T18:56:31.341 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:31.330+0000 7f7078d3a700 1 Processor -- start 2023-07-05T18:56:31.341 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:31.331+0000 7f7078d3a700 1 -- start start 2023-07-05T18:56:31.341 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:31.331+0000 7f7078d3a700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f705c004430 0x7f7074153900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:56:31.341 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:31.331+0000 7f7078d3a700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7074159830 0x7f70740c85c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:56:31.341 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:31.331+0000 7f7078d3a700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f70740b36a0 0x7f70740b3b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:56:31.341 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:31.331+0000 7f7078d3a700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70740b4080 con 0x7f7074159830 2023-07-05T18:56:31.342 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:31.331+0000 7f7078d3a700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7074153e40 con 0x7f705c004430 2023-07-05T18:56:31.342 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:31.331+0000 7f7078d3a700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7074159ca0 con 0x7f70740b36a0 2023-07-05T18:56:31.342 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:31.331+0000 7f7071d9b700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7074159830 0x7f70740c85c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:56:31.342 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:31.331+0000 7f7071d9b700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7074159830 0x7f70740c85c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:58500/0 (socket says 172.21.15.46:58500) 2023-07-05T18:56:31.343 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:31.331+0000 7f7071d9b700 1 -- 172.21.15.46:0/1382553589 learned_addr learned my addr 172.21.15.46:0/1382553589 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-07-05T18:56:31.343 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:31.331+0000 7f707259c700 1 --2- 172.21.15.46:0/1382553589 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f705c004430 0x7f7074153900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:56:31.343 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:31.331+0000 7f7072d9d700 1 --2- 172.21.15.46:0/1382553589 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f70740b36a0 0x7f70740b3b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:56:31.343 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:31.332+0000 7f7071d9b700 1 -- 172.21.15.46:0/1382553589 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f70740b36a0 msgr2=0x7f70740b3b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:56:31.343 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:31.332+0000 7f7071d9b700 1 --2- 172.21.15.46:0/1382553589 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f70740b36a0 0x7f70740b3b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:31.344 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:31.332+0000 7f7071d9b700 1 -- 172.21.15.46:0/1382553589 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f705c004430 msgr2=0x7f7074153900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:56:31.344 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:31.332+0000 7f7071d9b700 1 --2- 172.21.15.46:0/1382553589 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f705c004430 0x7f7074153900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:31.344 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:31.332+0000 7f7071d9b700 1 -- 172.21.15.46:0/1382553589 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7074159f80 con 0x7f7074159830 2023-07-05T18:56:31.344 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:31.332+0000 7f7071d9b700 1 --2- 172.21.15.46:0/1382553589 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7074159830 0x7f70740c85c0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f7064000c00 tx=0x7f70640047c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-05T18:56:31.345 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:31.332+0000 7f7062ffd700 1 -- 172.21.15.46:0/1382553589 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7064021070 con 0x7f7074159830 2023-07-05T18:56:31.345 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:31.332+0000 7f7062ffd700 1 -- 172.21.15.46:0/1382553589 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7064009e50 con 0x7f7074159830 2023-07-05T18:56:31.345 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:31.332+0000 7f7062ffd700 1 -- 172.21.15.46:0/1382553589 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7064006e60 con 0x7f7074159830 2023-07-05T18:56:31.345 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:31.332+0000 7f7078d3a700 1 -- 172.21.15.46:0/1382553589 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f707415a260 con 0x7f7074159830 2023-07-05T18:56:31.345 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:31.332+0000 7f7078d3a700 1 -- 172.21.15.46:0/1382553589 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f70740c8b00 con 0x7f7074159830 2023-07-05T18:56:31.345 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:31.333+0000 7f7078d3a700 1 -- 172.21.15.46:0/1382553589 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f707415aaa0 con 0x7f7074159830 2023-07-05T18:56:31.345 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:31.333+0000 7f7062ffd700 1 -- 172.21.15.46:0/1382553589 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f7064025070 con 0x7f7074159830 2023-07-05T18:56:31.346 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:31.334+0000 7f7062ffd700 1 --2- 172.21.15.46:0/1382553589 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7f705406ace0 0x7f705406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:56:31.346 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:31.334+0000 7f7062ffd700 1 -- 172.21.15.46:0/1382553589 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f706408a750 con 0x7f7074159830 2023-07-05T18:56:31.346 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:31.334+0000 7f707259c700 1 --2- 172.21.15.46:0/1382553589 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7f705406ace0 0x7f705406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:56:31.346 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:31.334+0000 7f707259c700 1 --2- 172.21.15.46:0/1382553589 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7f705406ace0 0x7f705406d190 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f7068009470 tx=0x7f7068009210 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-05T18:56:31.346 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:31.338+0000 7f7062ffd700 1 -- 172.21.15.46:0/1382553589 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f707415aaa0 con 0x7f7074159830 2023-07-05T18:56:31.588 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:31.586+0000 7f7078d3a700 1 -- 172.21.15.46:0/1382553589 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f707415aaa0 con 0x7f7074159830 2023-07-05T18:56:31.589 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:31.586+0000 7f7062ffd700 1 -- 172.21.15.46:0/1382553589 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v8) v1 ==== 53+0+73 (secure 0 0 0) 0x7f707415aaa0 con 0x7f7074159830 2023-07-05T18:56:31.589 INFO:teuthology.orchestra.run.smithi046.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-07-05T18:56:31.596 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:31.588+0000 7f7078d3a700 1 -- 172.21.15.46:0/1382553589 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7f705406ace0 msgr2=0x7f705406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:56:31.596 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:31.588+0000 7f7078d3a700 1 --2- 172.21.15.46:0/1382553589 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7f705406ace0 0x7f705406d190 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f7068009470 tx=0x7f7068009210 comp rx=0 tx=0).stop 2023-07-05T18:56:31.597 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:31.588+0000 7f7078d3a700 1 -- 172.21.15.46:0/1382553589 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7074159830 msgr2=0x7f70740c85c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:56:31.597 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:31.588+0000 7f7078d3a700 1 --2- 172.21.15.46:0/1382553589 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7074159830 0x7f70740c85c0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f7064000c00 tx=0x7f70640047c0 comp rx=0 tx=0).stop 2023-07-05T18:56:31.597 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:31.588+0000 7f7078d3a700 1 -- 172.21.15.46:0/1382553589 shutdown_connections 2023-07-05T18:56:31.597 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:31.588+0000 7f7078d3a700 1 --2- 172.21.15.46:0/1382553589 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7f705406ace0 0x7f705406d190 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:31.597 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:31.588+0000 7f7078d3a700 1 --2- 172.21.15.46:0/1382553589 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f70740b36a0 0x7f70740b3b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:31.597 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:31.588+0000 7f7078d3a700 1 --2- 172.21.15.46:0/1382553589 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f705c004430 0x7f7074153900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:31.597 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:31.588+0000 7f7078d3a700 1 --2- 172.21.15.46:0/1382553589 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7074159830 0x7f70740c85c0 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:31.598 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:31.588+0000 7f7078d3a700 1 -- 172.21.15.46:0/1382553589 >> 172.21.15.46:0/1382553589 conn(0x7f70740b0fc0 msgr2=0x7f70740cd690 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-05T18:56:31.598 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:31.589+0000 7f7078d3a700 1 -- 172.21.15.46:0/1382553589 shutdown_connections 2023-07-05T18:56:31.598 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:31.589+0000 7f7078d3a700 1 -- 172.21.15.46:0/1382553589 wait complete. 2023-07-05T18:56:31.603 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-07-05T18:56:31.603 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-07-05T18:56:31.607 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi046.front.sepia.ceph.com 2023-07-05T18:56:31.607 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-07-05T18:56:31.607 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-07-05T18:56:31.608 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-07-05T18:56:31.608 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-07-05T18:56:31.608 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-07-05T18:56:31.608 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.0' 2023-07-05T18:56:31.609 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-05T18:56:31.609 DEBUG:teuthology.orchestra.run.smithi046:> ip addr 2023-07-05T18:56:31.627 INFO:teuthology.orchestra.run.smithi046.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-07-05T18:56:31.627 INFO:teuthology.orchestra.run.smithi046.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-07-05T18:56:31.627 INFO:teuthology.orchestra.run.smithi046.stdout: inet 127.0.0.1/8 scope host lo 2023-07-05T18:56:31.627 INFO:teuthology.orchestra.run.smithi046.stdout: valid_lft forever preferred_lft forever 2023-07-05T18:56:31.628 INFO:teuthology.orchestra.run.smithi046.stdout: inet6 ::1/128 scope host 2023-07-05T18:56:31.628 INFO:teuthology.orchestra.run.smithi046.stdout: valid_lft forever preferred_lft forever 2023-07-05T18:56:31.628 INFO:teuthology.orchestra.run.smithi046.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-07-05T18:56:31.628 INFO:teuthology.orchestra.run.smithi046.stdout: link/ether 0c:c4:7a:6b:f6:10 brd ff:ff:ff:ff:ff:ff 2023-07-05T18:56:31.628 INFO:teuthology.orchestra.run.smithi046.stdout:3: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2023-07-05T18:56:31.628 INFO:teuthology.orchestra.run.smithi046.stdout: link/ether 0c:c4:7a:bd:15:f8 brd ff:ff:ff:ff:ff:ff 2023-07-05T18:56:31.629 INFO:teuthology.orchestra.run.smithi046.stdout: inet 172.21.15.46/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2023-07-05T18:56:31.629 INFO:teuthology.orchestra.run.smithi046.stdout: valid_lft 42426sec preferred_lft 42426sec 2023-07-05T18:56:31.629 INFO:teuthology.orchestra.run.smithi046.stdout: inet6 fe80::ec4:7aff:febd:15f8/64 scope link 2023-07-05T18:56:31.629 INFO:teuthology.orchestra.run.smithi046.stdout: valid_lft forever preferred_lft forever 2023-07-05T18:56:31.629 INFO:teuthology.orchestra.run.smithi046.stdout:4: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-07-05T18:56:31.629 INFO:teuthology.orchestra.run.smithi046.stdout: link/ether 0c:c4:7a:6b:f6:11 brd ff:ff:ff:ff:ff:ff 2023-07-05T18:56:31.629 INFO:teuthology.orchestra.run.smithi046.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-07-05T18:56:31.629 INFO:teuthology.orchestra.run.smithi046.stdout: link/ether 0c:c4:7a:bd:15:f9 brd ff:ff:ff:ff:ff:ff 2023-07-05T18:56:31.630 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2023-07-05T18:56:31.630 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-05T18:56:31.631 DEBUG:teuthology.orchestra.run.smithi046:> (cd / && exec bash -c ' 2023-07-05T18:56:31.631 DEBUG:teuthology.orchestra.run.smithi046:> set -e 2023-07-05T18:56:31.631 DEBUG:teuthology.orchestra.run.smithi046:> sudo ip link add name ceph-brx type bridge 2023-07-05T18:56:31.631 DEBUG:teuthology.orchestra.run.smithi046:> sudo ip addr flush dev ceph-brx 2023-07-05T18:56:31.632 DEBUG:teuthology.orchestra.run.smithi046:> sudo ip link set ceph-brx up 2023-07-05T18:56:31.632 DEBUG:teuthology.orchestra.run.smithi046:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2023-07-05T18:56:31.632 DEBUG:teuthology.orchestra.run.smithi046:> ') 2023-07-05T18:56:31.793 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-05T18:56:31.794 DEBUG:teuthology.orchestra.run.smithi046:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-07-05T18:56:31.824 INFO:teuthology.orchestra.run.smithi046.stdout:1 2023-07-05T18:56:31.825 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-05T18:56:31.826 DEBUG:teuthology.orchestra.run.smithi046:> route 2023-07-05T18:56:31.903 INFO:teuthology.orchestra.run.smithi046.stdout:Kernel IP routing table 2023-07-05T18:56:31.903 INFO:teuthology.orchestra.run.smithi046.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-07-05T18:56:31.903 INFO:teuthology.orchestra.run.smithi046.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2023-07-05T18:56:31.904 INFO:teuthology.orchestra.run.smithi046.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2023-07-05T18:56:31.904 INFO:teuthology.orchestra.run.smithi046.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-07-05T18:56:31.904 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-05T18:56:31.905 DEBUG:teuthology.orchestra.run.smithi046:> (cd / && exec bash -c ' 2023-07-05T18:56:31.905 DEBUG:teuthology.orchestra.run.smithi046:> set -e 2023-07-05T18:56:31.905 DEBUG:teuthology.orchestra.run.smithi046:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2023-07-05T18:56:31.905 DEBUG:teuthology.orchestra.run.smithi046:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2023-07-05T18:56:31.906 DEBUG:teuthology.orchestra.run.smithi046:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2023-07-05T18:56:31.906 DEBUG:teuthology.orchestra.run.smithi046:> ') 2023-07-05T18:56:32.157 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-05T18:56:32.158 DEBUG:teuthology.orchestra.run.smithi046:> ip netns list 2023-07-05T18:56:32.177 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-05T18:56:32.178 DEBUG:teuthology.orchestra.run.smithi046:> ip netns list-id 2023-07-05T18:56:32.239 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-05T18:56:32.240 DEBUG:teuthology.orchestra.run.smithi046:> (cd / && exec bash -c ' 2023-07-05T18:56:32.240 DEBUG:teuthology.orchestra.run.smithi046:> set -e 2023-07-05T18:56:32.240 DEBUG:teuthology.orchestra.run.smithi046:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.0 2023-07-05T18:56:32.241 DEBUG:teuthology.orchestra.run.smithi046:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.0 0 2023-07-05T18:56:32.241 DEBUG:teuthology.orchestra.run.smithi046:> ') 2023-07-05T18:56:32.334 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' with 192.168.0.1/16 2023-07-05T18:56:32.335 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-05T18:56:32.335 DEBUG:teuthology.orchestra.run.smithi046:> (cd / && exec bash -c ' 2023-07-05T18:56:32.335 DEBUG:teuthology.orchestra.run.smithi046:> set -e 2023-07-05T18:56:32.336 DEBUG:teuthology.orchestra.run.smithi046:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.0 type veth peer name brx.0 2023-07-05T18:56:32.336 DEBUG:teuthology.orchestra.run.smithi046:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2023-07-05T18:56:32.336 DEBUG:teuthology.orchestra.run.smithi046:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set veth0 up 2023-07-05T18:56:32.337 DEBUG:teuthology.orchestra.run.smithi046:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set lo up 2023-07-05T18:56:32.337 DEBUG:teuthology.orchestra.run.smithi046:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip route add default via 192.168.255.254 2023-07-05T18:56:32.337 DEBUG:teuthology.orchestra.run.smithi046:> ') 2023-07-05T18:56:32.546 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-05T18:56:32.547 DEBUG:teuthology.orchestra.run.smithi046:> (cd / && exec bash -c ' 2023-07-05T18:56:32.547 DEBUG:teuthology.orchestra.run.smithi046:> set -e 2023-07-05T18:56:32.547 DEBUG:teuthology.orchestra.run.smithi046:> sudo ip link set brx.0 up 2023-07-05T18:56:32.547 DEBUG:teuthology.orchestra.run.smithi046:> sudo ip link set dev brx.0 master ceph-brx 2023-07-05T18:56:32.548 DEBUG:teuthology.orchestra.run.smithi046:> ') 2023-07-05T18:56:32.663 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-07-05T18:56:32.663 DEBUG:teuthology.orchestra.run.smithi046:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-07-05T18:56:32.685 INFO:teuthology.orchestra.run.smithi046.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-07-05T18:56:32.686 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-07-05T18:56:32.686 DEBUG:teuthology.orchestra.run.smithi046:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-07-05T18:56:32.744 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2023-07-05T18:56:32.745 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-05T18:56:32.745 DEBUG:teuthology.orchestra.run.smithi046:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-07-05T18:56:32.837 INFO:teuthology.orchestra.run.smithi046.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-07-05T18:56:32.837 INFO:teuthology.orchestra.run.smithi046.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2023-07-05T18:56:32.837 INFO:teuthology.orchestra.run.smithi046.stdout:invalid new device string format 2023-07-05T18:56:32.944 INFO:teuthology.orchestra.run.smithi046.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-07-05T18:56:32.944 INFO:teuthology.orchestra.run.smithi046.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2023-07-05T18:56:32.944 INFO:teuthology.orchestra.run.smithi046.stdout:invalid new device string format 2023-07-05T18:56:32.944 INFO:teuthology.orchestra.run.smithi046.stdout:mount.ceph: resolved to: "172.21.15.46:3300,172.21.15.73:3300,172.21.15.73:3301" 2023-07-05T18:56:32.944 INFO:teuthology.orchestra.run.smithi046.stdout:mount.ceph: switching to using v1 address with old syntax 2023-07-05T18:56:33.017 INFO:teuthology.orchestra.run.smithi046.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-07-05T18:56:33.018 INFO:teuthology.orchestra.run.smithi046.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2023-07-05T18:56:33.018 INFO:teuthology.orchestra.run.smithi046.stdout:invalid new device string format 2023-07-05T18:56:33.018 INFO:teuthology.orchestra.run.smithi046.stdout:mount.ceph: resolved to: "172.21.15.46:3300,172.21.15.73:3300,172.21.15.73:3301" 2023-07-05T18:56:33.018 INFO:teuthology.orchestra.run.smithi046.stdout:mount.ceph: switching to using v1 address with old syntax 2023-07-05T18:56:33.018 INFO:teuthology.orchestra.run.smithi046.stdout:mount.ceph: resolved to: "172.21.15.46:6789,172.21.15.73:6789,172.21.15.73:6790" 2023-07-05T18:56:33.019 INFO:teuthology.orchestra.run.smithi046.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.46:6789,172.21.15.73:6789,172.21.15.73:6790:/ 2023-07-05T18:56:33.019 INFO:teuthology.orchestra.run.smithi046.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,key=0,fsid=042652d3-d80c-4ad8-9366-3e94f2a0a512" will pass to kernel 2023-07-05T18:56:33.020 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-07-05T18:56:33.020 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-05T18:56:33.022 DEBUG:teuthology.orchestra.run.smithi046:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-07-05T18:56:33.053 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-05T18:56:33.054 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-07-05T18:56:33.144 INFO:teuthology.orchestra.run.smithi046.stdout:client4514 2023-07-05T18:56:33.145 DEBUG:teuthology.orchestra.run.smithi046:> set -ex 2023-07-05T18:56:33.145 DEBUG:teuthology.orchestra.run.smithi046:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-05T18:56:33.163 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-05T18:56:33.163 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-07-05T18:56:33.251 INFO:teuthology.orchestra.run.smithi046.stdout:client4514 2023-07-05T18:56:33.252 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-05T18:56:33.252 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-07-05T18:56:33.304 INFO:teuthology.orchestra.run.smithi046.stdout:client4514 2023-07-05T18:56:33.305 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-05T18:56:33.305 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'sudo dd if=/sys/kernel/debug/ceph/042652d3-d80c-4ad8-9366-3e94f2a0a512.client4514/status') 2023-07-05T18:56:33.358 INFO:teuthology.orchestra.run.smithi046.stdout:instance: client.4514 (3)172.21.15.46:0/1773822373 2023-07-05T18:56:33.359 INFO:teuthology.orchestra.run.smithi046.stdout:blocklisted: false 2023-07-05T18:56:33.360 INFO:teuthology.orchestra.run.smithi046.stderr:0+1 records in 2023-07-05T18:56:33.360 INFO:teuthology.orchestra.run.smithi046.stderr:0+1 records out 2023-07-05T18:56:33.360 INFO:teuthology.orchestra.run.smithi046.stderr:70 bytes copied, 2.5064e-05 s, 2.8 MB/s 2023-07-05T18:56:33.360 INFO:tasks.kclient:client.2 config is {'syntax': 'v1'} 2023-07-05T18:56:33.361 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2023-07-05T18:56:33.361 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.2 2023-07-05T18:56:33.361 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-07-05T18:56:33.487 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:33.485+0000 7f97de7e5700 1 Processor -- start 2023-07-05T18:56:33.487 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:33.485+0000 7f97de7e5700 1 -- start start 2023-07-05T18:56:33.488 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:33.486+0000 7f97de7e5700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f97d815d190 0x7f97d80b3530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:56:33.489 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:33.486+0000 7f97de7e5700 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f97d80b30a0 con 0x7f97d80aef40 2023-07-05T18:56:33.489 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:33.486+0000 7f97de7e5700 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f97d806ca80 con 0x7f97d806a510 2023-07-05T18:56:33.489 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:33.486+0000 7f97de7e5700 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f97d815d940 con 0x7f97d815d190 2023-07-05T18:56:33.489 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:33.486+0000 7f97d7fff700 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7f97d80aef40 0x7f97d8069e00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:57786/0 (socket says 172.21.15.46:57786) 2023-07-05T18:56:33.489 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:33.486+0000 7f97d7fff700 1 -- 172.21.15.46:0/2553077155 learned_addr learned my addr 172.21.15.46:0/2553077155 (peer_addr_for_me v1:172.21.15.46:0/0) 2023-07-05T18:56:33.489 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:33.486+0000 7f97dcd82700 1 --2- 172.21.15.46:0/2553077155 >> v2:172.21.15.73:3300/0 conn(0x7f97d815d190 0x7f97d80b3530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:56:33.489 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:33.486+0000 7f97d6ffd700 1 -- 172.21.15.46:0/2553077155 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1950662402 0 0) 0x7f97d80b30a0 con 0x7f97d80aef40 2023-07-05T18:56:33.490 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:33.486+0000 7f97d6ffd700 1 -- 172.21.15.46:0/2553077155 --> v1:172.21.15.46:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f97c40035b0 con 0x7f97d80aef40 2023-07-05T18:56:33.490 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:33.486+0000 7f97d6ffd700 1 -- 172.21.15.46:0/2553077155 <== mon.0 v1:172.21.15.46:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4091185023 0 0) 0x7f97c40035b0 con 0x7f97d80aef40 2023-07-05T18:56:33.490 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:33.486+0000 7f97dcd82700 1 -- 172.21.15.46:0/2553077155 >> v1:172.21.15.73:6789/0 conn(0x7f97d806a510 legacy=0x7f97d815ca80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:56:33.490 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:33.486+0000 7f97dcd82700 1 -- 172.21.15.46:0/2553077155 >> v1:172.21.15.46:6789/0 conn(0x7f97d80aef40 legacy=0x7f97d8069e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:56:33.490 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:33.487+0000 7f97dcd82700 1 -- 172.21.15.46:0/2553077155 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f97d815d660 con 0x7f97d815d190 2023-07-05T18:56:33.491 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:33.487+0000 7f97dcd82700 1 --2- 172.21.15.46:0/2553077155 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f97d815d190 0x7f97d80b3530 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f97d0009d90 tx=0x7f97d000b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6035b858ccde3e03 server_cookie=0 in_seq=0 out_seq=0 2023-07-05T18:56:33.491 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:33.487+0000 7f97d6ffd700 1 -- 172.21.15.46:0/2553077155 <== mon.1 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97d000e070 con 0x7f97d815d190 2023-07-05T18:56:33.491 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:33.487+0000 7f97d6ffd700 1 -- 172.21.15.46:0/2553077155 <== mon.1 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f97d0003a20 con 0x7f97d815d190 2023-07-05T18:56:33.491 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:33.487+0000 7f97d6ffd700 1 -- 172.21.15.46:0/2553077155 <== mon.1 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97c8001670 con 0x7f97d815d190 2023-07-05T18:56:33.493 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:33.487+0000 7f97de7e5700 1 -- 172.21.15.46:0/2553077155 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f97d815d190 msgr2=0x7f97d80b3530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:56:33.493 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:33.487+0000 7f97de7e5700 1 --2- 172.21.15.46:0/2553077155 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f97d815d190 0x7f97d80b3530 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f97d0009d90 tx=0x7f97d000b330 comp rx=0 tx=0).stop 2023-07-05T18:56:33.493 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:33.487+0000 7f97de7e5700 1 -- 172.21.15.46:0/2553077155 shutdown_connections 2023-07-05T18:56:33.493 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:33.487+0000 7f97de7e5700 1 --2- 172.21.15.46:0/2553077155 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f97d815d190 0x7f97d80b3530 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:33.494 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:33.487+0000 7f97de7e5700 1 -- 172.21.15.46:0/2553077155 >> 172.21.15.46:0/2553077155 conn(0x7f97d806af10 msgr2=0x7f97d806b2e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-05T18:56:33.494 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:33.487+0000 7f97de7e5700 1 -- 172.21.15.46:0/2553077155 shutdown_connections 2023-07-05T18:56:33.494 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:33.488+0000 7f97de7e5700 1 -- 172.21.15.46:0/2553077155 wait complete. 2023-07-05T18:56:33.495 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:33.489+0000 7f97de7e5700 1 Processor -- start 2023-07-05T18:56:33.495 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:33.489+0000 7f97de7e5700 1 -- start start 2023-07-05T18:56:33.495 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:33.490+0000 7f97de7e5700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f97d806a510 0x7f97d81e59c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:56:33.495 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:33.490+0000 7f97de7e5700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f97d80aef40 0x7f97d81e8510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:56:33.495 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:33.490+0000 7f97de7e5700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f97d815d190 0x7f97d80b1840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:56:33.495 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:33.490+0000 7f97de7e5700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97d81535b0 con 0x7f97d80aef40 2023-07-05T18:56:33.495 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:33.490+0000 7f97de7e5700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97d81e7750 con 0x7f97d806a510 2023-07-05T18:56:33.495 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:33.490+0000 7f97de7e5700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f97d81e7a30 con 0x7f97d815d190 2023-07-05T18:56:33.496 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:33.490+0000 7f97d77fe700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f97d80aef40 0x7f97d81e8510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:56:33.496 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:33.490+0000 7f97d77fe700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f97d80aef40 0x7f97d81e8510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:58520/0 (socket says 172.21.15.46:58520) 2023-07-05T18:56:33.496 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:33.490+0000 7f97d77fe700 1 -- 172.21.15.46:0/2814769598 learned_addr learned my addr 172.21.15.46:0/2814769598 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-07-05T18:56:33.496 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:33.490+0000 7f97dcd82700 1 --2- 172.21.15.46:0/2814769598 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f97d815d190 0x7f97d80b1840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:56:33.496 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:33.490+0000 7f97d7fff700 1 --2- 172.21.15.46:0/2814769598 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f97d806a510 0x7f97d81e59c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:56:33.496 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:33.490+0000 7f97d77fe700 1 -- 172.21.15.46:0/2814769598 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f97d815d190 msgr2=0x7f97d80b1840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:56:33.496 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:33.490+0000 7f97d77fe700 1 --2- 172.21.15.46:0/2814769598 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f97d815d190 0x7f97d80b1840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:33.497 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:33.490+0000 7f97d77fe700 1 -- 172.21.15.46:0/2814769598 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f97d806a510 msgr2=0x7f97d81e59c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:56:33.497 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:33.490+0000 7f97d77fe700 1 --2- 172.21.15.46:0/2814769598 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f97d806a510 0x7f97d81e59c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:33.497 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:33.490+0000 7f97d77fe700 1 -- 172.21.15.46:0/2814769598 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f97d0009a70 con 0x7f97d80aef40 2023-07-05T18:56:33.497 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:33.490+0000 7f97d7fff700 1 --2- 172.21.15.46:0/2814769598 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f97d806a510 0x7f97d81e59c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-05T18:56:33.497 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:33.490+0000 7f97d77fe700 1 --2- 172.21.15.46:0/2814769598 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f97d80aef40 0x7f97d81e8510 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f97c000c3c0 tx=0x7f97c000c6d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-05T18:56:33.497 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:33.490+0000 7f97d4ff9700 1 -- 172.21.15.46:0/2814769598 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97c00052d0 con 0x7f97d80aef40 2023-07-05T18:56:33.497 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:33.491+0000 7f97d4ff9700 1 -- 172.21.15.46:0/2814769598 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f97c0005430 con 0x7f97d80aef40 2023-07-05T18:56:33.497 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:33.491+0000 7f97de7e5700 1 -- 172.21.15.46:0/2814769598 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f97d81e7d10 con 0x7f97d80aef40 2023-07-05T18:56:33.498 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:33.491+0000 7f97d4ff9700 1 -- 172.21.15.46:0/2814769598 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97c0006aa0 con 0x7f97d80aef40 2023-07-05T18:56:33.498 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:33.491+0000 7f97de7e5700 1 -- 172.21.15.46:0/2814769598 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f97d81e7370 con 0x7f97d80aef40 2023-07-05T18:56:33.499 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:33.492+0000 7f97de7e5700 1 -- 172.21.15.46:0/2814769598 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f97d81e8230 con 0x7f97d80aef40 2023-07-05T18:56:33.499 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:33.492+0000 7f97d4ff9700 1 -- 172.21.15.46:0/2814769598 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f97c0003680 con 0x7f97d80aef40 2023-07-05T18:56:33.499 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:33.492+0000 7f97d4ff9700 1 --2- 172.21.15.46:0/2814769598 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7f97b806ace0 0x7f97b806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:56:33.499 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:33.492+0000 7f97d4ff9700 1 -- 172.21.15.46:0/2814769598 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f97c0088690 con 0x7f97d80aef40 2023-07-05T18:56:33.499 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:33.492+0000 7f97d7fff700 1 --2- 172.21.15.46:0/2814769598 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7f97b806ace0 0x7f97b806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:56:33.499 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:33.493+0000 7f97d7fff700 1 --2- 172.21.15.46:0/2814769598 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7f97b806ace0 0x7f97b806d190 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f97c8001860 tx=0x7f97c80015f0 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-05T18:56:33.500 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:33.497+0000 7f97d4ff9700 1 -- 172.21.15.46:0/2814769598 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f97d81e8230 con 0x7f97d80aef40 2023-07-05T18:56:33.753 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:33.746+0000 7f97de7e5700 1 -- 172.21.15.46:0/2814769598 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f97d81e8230 con 0x7f97d80aef40 2023-07-05T18:56:33.753 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:33.747+0000 7f97d4ff9700 1 -- 172.21.15.46:0/2814769598 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v8) v1 ==== 53+0+73 (secure 0 0 0) 0x7f97d81e8230 con 0x7f97d80aef40 2023-07-05T18:56:33.754 INFO:teuthology.orchestra.run.smithi046.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-07-05T18:56:33.755 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:33.749+0000 7f97de7e5700 1 -- 172.21.15.46:0/2814769598 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7f97b806ace0 msgr2=0x7f97b806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:56:33.755 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:33.749+0000 7f97de7e5700 1 --2- 172.21.15.46:0/2814769598 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7f97b806ace0 0x7f97b806d190 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f97c8001860 tx=0x7f97c80015f0 comp rx=0 tx=0).stop 2023-07-05T18:56:33.756 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:33.749+0000 7f97de7e5700 1 -- 172.21.15.46:0/2814769598 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f97d80aef40 msgr2=0x7f97d81e8510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:56:33.759 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:33.749+0000 7f97de7e5700 1 --2- 172.21.15.46:0/2814769598 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f97d80aef40 0x7f97d81e8510 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f97c000c3c0 tx=0x7f97c000c6d0 comp rx=0 tx=0).stop 2023-07-05T18:56:33.759 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:33.749+0000 7f97de7e5700 1 -- 172.21.15.46:0/2814769598 shutdown_connections 2023-07-05T18:56:33.760 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:33.749+0000 7f97de7e5700 1 --2- 172.21.15.46:0/2814769598 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7f97b806ace0 0x7f97b806d190 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:33.760 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:33.749+0000 7f97de7e5700 1 --2- 172.21.15.46:0/2814769598 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f97d815d190 0x7f97d80b1840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:33.760 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:33.749+0000 7f97de7e5700 1 --2- 172.21.15.46:0/2814769598 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f97d806a510 0x7f97d81e59c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:33.761 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:33.749+0000 7f97de7e5700 1 --2- 172.21.15.46:0/2814769598 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f97d80aef40 0x7f97d81e8510 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:33.761 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:33.749+0000 7f97de7e5700 1 -- 172.21.15.46:0/2814769598 >> 172.21.15.46:0/2814769598 conn(0x7f97d806af10 msgr2=0x7f97d80b3530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-05T18:56:33.762 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:33.749+0000 7f97de7e5700 1 -- 172.21.15.46:0/2814769598 shutdown_connections 2023-07-05T18:56:33.762 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:33.749+0000 7f97de7e5700 1 -- 172.21.15.46:0/2814769598 wait complete. 2023-07-05T18:56:33.763 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-07-05T18:56:33.763 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-07-05T18:56:33.764 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi046.front.sepia.ceph.com 2023-07-05T18:56:33.764 INFO:tasks.cephfs.mount:self.client.name = client.2 2023-07-05T18:56:33.764 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.2 2023-07-05T18:56:33.764 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-07-05T18:56:33.764 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-07-05T18:56:33.765 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-07-05T18:56:33.765 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.2' 2023-07-05T18:56:33.765 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-05T18:56:33.765 DEBUG:teuthology.orchestra.run.smithi046:> ip addr 2023-07-05T18:56:33.785 INFO:teuthology.orchestra.run.smithi046.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-07-05T18:56:33.785 INFO:teuthology.orchestra.run.smithi046.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-07-05T18:56:33.785 INFO:teuthology.orchestra.run.smithi046.stdout: inet 127.0.0.1/8 scope host lo 2023-07-05T18:56:33.785 INFO:teuthology.orchestra.run.smithi046.stdout: valid_lft forever preferred_lft forever 2023-07-05T18:56:33.786 INFO:teuthology.orchestra.run.smithi046.stdout: inet6 ::1/128 scope host 2023-07-05T18:56:33.786 INFO:teuthology.orchestra.run.smithi046.stdout: valid_lft forever preferred_lft forever 2023-07-05T18:56:33.786 INFO:teuthology.orchestra.run.smithi046.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-07-05T18:56:33.786 INFO:teuthology.orchestra.run.smithi046.stdout: link/ether 0c:c4:7a:6b:f6:10 brd ff:ff:ff:ff:ff:ff 2023-07-05T18:56:33.786 INFO:teuthology.orchestra.run.smithi046.stdout:3: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2023-07-05T18:56:33.787 INFO:teuthology.orchestra.run.smithi046.stdout: link/ether 0c:c4:7a:bd:15:f8 brd ff:ff:ff:ff:ff:ff 2023-07-05T18:56:33.787 INFO:teuthology.orchestra.run.smithi046.stdout: inet 172.21.15.46/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2023-07-05T18:56:33.787 INFO:teuthology.orchestra.run.smithi046.stdout: valid_lft 42424sec preferred_lft 42424sec 2023-07-05T18:56:33.787 INFO:teuthology.orchestra.run.smithi046.stdout: inet6 fe80::ec4:7aff:febd:15f8/64 scope link 2023-07-05T18:56:33.787 INFO:teuthology.orchestra.run.smithi046.stdout: valid_lft forever preferred_lft forever 2023-07-05T18:56:33.787 INFO:teuthology.orchestra.run.smithi046.stdout:4: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-07-05T18:56:33.787 INFO:teuthology.orchestra.run.smithi046.stdout: link/ether 0c:c4:7a:6b:f6:11 brd ff:ff:ff:ff:ff:ff 2023-07-05T18:56:33.787 INFO:teuthology.orchestra.run.smithi046.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-07-05T18:56:33.788 INFO:teuthology.orchestra.run.smithi046.stdout: link/ether 0c:c4:7a:bd:15:f9 brd ff:ff:ff:ff:ff:ff 2023-07-05T18:56:33.788 INFO:teuthology.orchestra.run.smithi046.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-07-05T18:56:33.788 INFO:teuthology.orchestra.run.smithi046.stdout: link/ether 22:01:f2:63:4d:4e brd ff:ff:ff:ff:ff:ff 2023-07-05T18:56:33.789 INFO:teuthology.orchestra.run.smithi046.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-07-05T18:56:33.790 INFO:teuthology.orchestra.run.smithi046.stdout: valid_lft forever preferred_lft forever 2023-07-05T18:56:33.790 INFO:teuthology.orchestra.run.smithi046.stdout: inet6 fe80::208b:beff:fe32:f830/64 scope link 2023-07-05T18:56:33.790 INFO:teuthology.orchestra.run.smithi046.stdout: valid_lft forever preferred_lft forever 2023-07-05T18:56:33.790 INFO:teuthology.orchestra.run.smithi046.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-07-05T18:56:33.791 INFO:teuthology.orchestra.run.smithi046.stdout: link/ether 22:01:f2:63:4d:4e brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-07-05T18:56:33.791 INFO:teuthology.orchestra.run.smithi046.stdout: inet6 fe80::2001:f2ff:fe63:4d4e/64 scope link tentative 2023-07-05T18:56:33.791 INFO:teuthology.orchestra.run.smithi046.stdout: valid_lft forever preferred_lft forever 2023-07-05T18:56:33.792 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-05T18:56:33.793 DEBUG:teuthology.orchestra.run.smithi046:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-07-05T18:56:33.851 INFO:teuthology.orchestra.run.smithi046.stdout:1 2023-07-05T18:56:33.853 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-05T18:56:33.853 DEBUG:teuthology.orchestra.run.smithi046:> route 2023-07-05T18:56:33.913 INFO:teuthology.orchestra.run.smithi046.stdout:Kernel IP routing table 2023-07-05T18:56:33.913 INFO:teuthology.orchestra.run.smithi046.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-07-05T18:56:33.913 INFO:teuthology.orchestra.run.smithi046.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2023-07-05T18:56:33.914 INFO:teuthology.orchestra.run.smithi046.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2023-07-05T18:56:33.914 INFO:teuthology.orchestra.run.smithi046.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-07-05T18:56:33.914 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-05T18:56:33.915 DEBUG:teuthology.orchestra.run.smithi046:> (cd / && exec bash -c ' 2023-07-05T18:56:33.915 DEBUG:teuthology.orchestra.run.smithi046:> set -e 2023-07-05T18:56:33.916 DEBUG:teuthology.orchestra.run.smithi046:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2023-07-05T18:56:33.917 DEBUG:teuthology.orchestra.run.smithi046:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2023-07-05T18:56:33.917 DEBUG:teuthology.orchestra.run.smithi046:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2023-07-05T18:56:33.918 DEBUG:teuthology.orchestra.run.smithi046:> ') 2023-07-05T18:56:34.019 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-05T18:56:34.020 DEBUG:teuthology.orchestra.run.smithi046:> ip netns list 2023-07-05T18:56:34.037 INFO:teuthology.orchestra.run.smithi046.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-07-05T18:56:34.038 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-05T18:56:34.038 DEBUG:teuthology.orchestra.run.smithi046:> ip netns list-id 2023-07-05T18:56:34.096 INFO:teuthology.orchestra.run.smithi046.stdout:nsid 0 (iproute2 netns name: ceph-ns--home-ubuntu-cephtest-mnt.0) 2023-07-05T18:56:34.096 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-05T18:56:34.097 DEBUG:teuthology.orchestra.run.smithi046:> (cd / && exec bash -c ' 2023-07-05T18:56:34.097 DEBUG:teuthology.orchestra.run.smithi046:> set -e 2023-07-05T18:56:34.097 DEBUG:teuthology.orchestra.run.smithi046:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.2 2023-07-05T18:56:34.097 DEBUG:teuthology.orchestra.run.smithi046:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.2 1 2023-07-05T18:56:34.097 DEBUG:teuthology.orchestra.run.smithi046:> ') 2023-07-05T18:56:34.191 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-05T18:56:34.192 DEBUG:teuthology.orchestra.run.smithi046:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr 2023-07-05T18:56:34.238 INFO:teuthology.orchestra.run.smithi046.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-07-05T18:56:34.239 INFO:teuthology.orchestra.run.smithi046.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-07-05T18:56:34.239 INFO:teuthology.orchestra.run.smithi046.stdout: inet 127.0.0.1/8 scope host lo 2023-07-05T18:56:34.239 INFO:teuthology.orchestra.run.smithi046.stdout: valid_lft forever preferred_lft forever 2023-07-05T18:56:34.240 INFO:teuthology.orchestra.run.smithi046.stdout: inet6 ::1/128 scope host 2023-07-05T18:56:34.241 INFO:teuthology.orchestra.run.smithi046.stdout: valid_lft forever preferred_lft forever 2023-07-05T18:56:34.241 INFO:teuthology.orchestra.run.smithi046.stdout:2: veth0@if7: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-07-05T18:56:34.242 INFO:teuthology.orchestra.run.smithi046.stdout: link/ether 3a:5f:ab:c7:01:fe brd ff:ff:ff:ff:ff:ff link-netnsid 0 2023-07-05T18:56:34.242 INFO:teuthology.orchestra.run.smithi046.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2023-07-05T18:56:34.242 INFO:teuthology.orchestra.run.smithi046.stdout: valid_lft forever preferred_lft forever 2023-07-05T18:56:34.244 INFO:teuthology.orchestra.run.smithi046.stdout: inet6 fe80::385f:abff:fec7:1fe/64 scope link tentative 2023-07-05T18:56:34.245 INFO:teuthology.orchestra.run.smithi046.stdout: valid_lft forever preferred_lft forever 2023-07-05T18:56:34.254 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-05T18:56:34.255 DEBUG:teuthology.orchestra.run.smithi046:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr 2023-07-05T18:56:34.303 INFO:teuthology.orchestra.run.smithi046.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-07-05T18:56:34.304 INFO:teuthology.orchestra.run.smithi046.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-07-05T18:56:34.304 INFO:teuthology.orchestra.run.smithi046.stdout: inet 127.0.0.1/8 scope host lo 2023-07-05T18:56:34.304 INFO:teuthology.orchestra.run.smithi046.stdout: valid_lft forever preferred_lft forever 2023-07-05T18:56:34.304 INFO:teuthology.orchestra.run.smithi046.stdout: inet6 ::1/128 scope host 2023-07-05T18:56:34.304 INFO:teuthology.orchestra.run.smithi046.stdout: valid_lft forever preferred_lft forever 2023-07-05T18:56:34.305 INFO:teuthology.orchestra.run.smithi046.stdout:2: veth0@if7: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-07-05T18:56:34.305 INFO:teuthology.orchestra.run.smithi046.stdout: link/ether 3a:5f:ab:c7:01:fe brd ff:ff:ff:ff:ff:ff link-netnsid 0 2023-07-05T18:56:34.305 INFO:teuthology.orchestra.run.smithi046.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2023-07-05T18:56:34.305 INFO:teuthology.orchestra.run.smithi046.stdout: valid_lft forever preferred_lft forever 2023-07-05T18:56:34.305 INFO:teuthology.orchestra.run.smithi046.stdout: inet6 fe80::385f:abff:fec7:1fe/64 scope link tentative 2023-07-05T18:56:34.305 INFO:teuthology.orchestra.run.smithi046.stdout: valid_lft forever preferred_lft forever 2023-07-05T18:56:34.317 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.2' with 192.168.0.2/16 2023-07-05T18:56:34.317 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-05T18:56:34.318 DEBUG:teuthology.orchestra.run.smithi046:> (cd / && exec bash -c ' 2023-07-05T18:56:34.318 DEBUG:teuthology.orchestra.run.smithi046:> set -e 2023-07-05T18:56:34.319 DEBUG:teuthology.orchestra.run.smithi046:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.2 type veth peer name brx.1 2023-07-05T18:56:34.319 DEBUG:teuthology.orchestra.run.smithi046:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip addr add 192.168.0.2/16 brd 192.168.255.255 dev veth0 2023-07-05T18:56:34.319 DEBUG:teuthology.orchestra.run.smithi046:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip link set veth0 up 2023-07-05T18:56:34.319 DEBUG:teuthology.orchestra.run.smithi046:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip link set lo up 2023-07-05T18:56:34.320 DEBUG:teuthology.orchestra.run.smithi046:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip route add default via 192.168.255.254 2023-07-05T18:56:34.320 DEBUG:teuthology.orchestra.run.smithi046:> ') 2023-07-05T18:56:34.535 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-05T18:56:34.535 DEBUG:teuthology.orchestra.run.smithi046:> (cd / && exec bash -c ' 2023-07-05T18:56:34.536 DEBUG:teuthology.orchestra.run.smithi046:> set -e 2023-07-05T18:56:34.536 DEBUG:teuthology.orchestra.run.smithi046:> sudo ip link set brx.1 up 2023-07-05T18:56:34.536 DEBUG:teuthology.orchestra.run.smithi046:> sudo ip link set dev brx.1 master ceph-brx 2023-07-05T18:56:34.536 DEBUG:teuthology.orchestra.run.smithi046:> ') 2023-07-05T18:56:34.661 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-07-05T18:56:34.662 DEBUG:teuthology.orchestra.run.smithi046:> mkdir -p -v /home/ubuntu/cephtest/mnt.2 2023-07-05T18:56:34.679 INFO:teuthology.orchestra.run.smithi046.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.2' 2023-07-05T18:56:34.680 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-07-05T18:56:34.680 DEBUG:teuthology.orchestra.run.smithi046:> chmod 0000 /home/ubuntu/cephtest/mnt.2 2023-07-05T18:56:34.737 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2023-07-05T18:56:34.738 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-05T18:56:34.739 DEBUG:teuthology.orchestra.run.smithi046:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.2 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=2,mds_namespace=cephfs 2023-07-05T18:56:34.825 INFO:teuthology.orchestra.run.smithi046.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=2,mds_namespace=cephfs 2023-07-05T18:56:34.825 INFO:teuthology.orchestra.run.smithi046.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=2,mds_namespace=cephfs". 2023-07-05T18:56:34.826 INFO:teuthology.orchestra.run.smithi046.stdout:invalid new device string format 2023-07-05T18:56:34.834 INFO:teuthology.orchestra.run.smithi046.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=2,mds_namespace=cephfs 2023-07-05T18:56:34.834 INFO:teuthology.orchestra.run.smithi046.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=2,mds_namespace=cephfs". 2023-07-05T18:56:34.834 INFO:teuthology.orchestra.run.smithi046.stdout:invalid new device string format 2023-07-05T18:56:34.834 INFO:teuthology.orchestra.run.smithi046.stdout:mount.ceph: resolved to: "172.21.15.46:3300,172.21.15.73:3300,172.21.15.73:3301" 2023-07-05T18:56:34.835 INFO:teuthology.orchestra.run.smithi046.stdout:mount.ceph: switching to using v1 address with old syntax 2023-07-05T18:56:34.907 INFO:teuthology.orchestra.run.smithi046.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=2,mds_namespace=cephfs 2023-07-05T18:56:34.907 INFO:teuthology.orchestra.run.smithi046.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=2,mds_namespace=cephfs". 2023-07-05T18:56:34.907 INFO:teuthology.orchestra.run.smithi046.stdout:invalid new device string format 2023-07-05T18:56:34.907 INFO:teuthology.orchestra.run.smithi046.stdout:mount.ceph: resolved to: "172.21.15.46:3300,172.21.15.73:3300,172.21.15.73:3301" 2023-07-05T18:56:34.908 INFO:teuthology.orchestra.run.smithi046.stdout:mount.ceph: switching to using v1 address with old syntax 2023-07-05T18:56:34.908 INFO:teuthology.orchestra.run.smithi046.stdout:mount.ceph: resolved to: "172.21.15.46:6789,172.21.15.73:6789,172.21.15.73:6790" 2023-07-05T18:56:34.908 INFO:teuthology.orchestra.run.smithi046.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.46:6789,172.21.15.73:6789,172.21.15.73:6790:/ 2023-07-05T18:56:34.908 INFO:teuthology.orchestra.run.smithi046.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=2,mds_namespace=cephfs,key=2,fsid=042652d3-d80c-4ad8-9366-3e94f2a0a512" will pass to kernel 2023-07-05T18:56:34.910 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-07-05T18:56:34.910 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-05T18:56:34.910 DEBUG:teuthology.orchestra.run.smithi046:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.2 2023-07-05T18:56:34.937 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-05T18:56:34.937 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.2 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-07-05T18:56:35.010 INFO:teuthology.orchestra.run.smithi046.stdout:client4642 2023-07-05T18:56:35.011 DEBUG:teuthology.orchestra.run.smithi046:> set -ex 2023-07-05T18:56:35.012 DEBUG:teuthology.orchestra.run.smithi046:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-05T18:56:35.069 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-05T18:56:35.069 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.2 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-07-05T18:56:35.141 INFO:teuthology.orchestra.run.smithi046.stdout:client4642 2023-07-05T18:56:35.142 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-05T18:56:35.142 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.2 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-07-05T18:56:35.215 INFO:teuthology.orchestra.run.smithi046.stdout:client4642 2023-07-05T18:56:35.216 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-05T18:56:35.216 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.2 && exec bash -c 'sudo dd if=/sys/kernel/debug/ceph/042652d3-d80c-4ad8-9366-3e94f2a0a512.client4642/status') 2023-07-05T18:56:35.299 INFO:teuthology.orchestra.run.smithi046.stdout:instance: client.4642 (3)172.21.15.46:0/8919851 2023-07-05T18:56:35.299 INFO:teuthology.orchestra.run.smithi046.stdout:blocklisted: false 2023-07-05T18:56:35.300 INFO:teuthology.orchestra.run.smithi046.stderr:0+1 records in 2023-07-05T18:56:35.301 INFO:teuthology.orchestra.run.smithi046.stderr:0+1 records out 2023-07-05T18:56:35.301 INFO:teuthology.orchestra.run.smithi046.stderr:67 bytes copied, 2.4949e-05 s, 2.7 MB/s 2023-07-05T18:56:35.301 INFO:tasks.kclient:client.1 config is {'syntax': 'v1'} 2023-07-05T18:56:35.301 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2023-07-05T18:56:35.302 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2023-07-05T18:56:35.302 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-07-05T18:56:35.468 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:35.463+0000 7f78bd87b700 1 Processor -- start 2023-07-05T18:56:35.469 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:35.464+0000 7f78bd87b700 1 -- start start 2023-07-05T18:56:35.469 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:35.464+0000 7f78bd87b700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f78b80b1ed0 0x7f78b80af1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:56:35.470 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:35.464+0000 7f78bd87b700 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f78b80ada20 con 0x7f78b80cede0 2023-07-05T18:56:35.470 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:35.464+0000 7f78bd87b700 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f78b80add00 con 0x7f78b815a610 2023-07-05T18:56:35.470 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:35.464+0000 7f78bd87b700 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f78b80adfe0 con 0x7f78b80b1ed0 2023-07-05T18:56:35.471 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:35.464+0000 7f78b77fe700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f78b80b1ed0 0x7f78b80af1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:56:35.471 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:35.464+0000 7f78b67fc700 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7f78b80cede0 0x7f78b80aeac0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:57814/0 (socket says 172.21.15.46:57814) 2023-07-05T18:56:35.471 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:35.464+0000 7f78b67fc700 1 -- 172.21.15.46:0/2755870621 learned_addr learned my addr 172.21.15.46:0/2755870621 (peer_addr_for_me v1:172.21.15.46:0/0) 2023-07-05T18:56:35.471 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:35.465+0000 7f78b77fe700 1 -- 172.21.15.46:0/2755870621 >> v1:172.21.15.73:6789/0 conn(0x7f78b815a610 legacy=0x7f78b80ce6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:56:35.471 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:35.465+0000 7f78b77fe700 1 -- 172.21.15.46:0/2755870621 >> v1:172.21.15.46:6789/0 conn(0x7f78b80cede0 legacy=0x7f78b80aeac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:56:35.471 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:35.465+0000 7f78b5ffb700 1 -- 172.21.15.46:0/2755870621 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4173006372 0 0) 0x7f78b80ada20 con 0x7f78b80cede0 2023-07-05T18:56:35.471 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:35.465+0000 7f78b77fe700 1 -- 172.21.15.46:0/2755870621 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f78b80ae2c0 con 0x7f78b80b1ed0 2023-07-05T18:56:35.472 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:35.465+0000 7f78b77fe700 1 --2- 172.21.15.46:0/2755870621 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f78b80b1ed0 0x7f78b80af1d0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f78b0009d90 tx=0x7f78b000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ba63775b46d71f54 server_cookie=0 in_seq=0 out_seq=0 2023-07-05T18:56:35.472 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:35.465+0000 7f78b5ffb700 1 -- 172.21.15.46:0/2755870621 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78b000e070 con 0x7f78b80b1ed0 2023-07-05T18:56:35.473 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:35.465+0000 7f78b5ffb700 1 -- 172.21.15.46:0/2755870621 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f78b000bbd0 con 0x7f78b80b1ed0 2023-07-05T18:56:35.473 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:35.465+0000 7f78b5ffb700 1 -- 172.21.15.46:0/2755870621 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78b0012430 con 0x7f78b80b1ed0 2023-07-05T18:56:35.473 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:35.466+0000 7f78bd87b700 1 -- 172.21.15.46:0/2755870621 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f78b80b1ed0 msgr2=0x7f78b80af1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:56:35.474 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:35.466+0000 7f78bd87b700 1 --2- 172.21.15.46:0/2755870621 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f78b80b1ed0 0x7f78b80af1d0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f78b0009d90 tx=0x7f78b000b330 comp rx=0 tx=0).stop 2023-07-05T18:56:35.474 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:35.466+0000 7f78bd87b700 1 -- 172.21.15.46:0/2755870621 shutdown_connections 2023-07-05T18:56:35.474 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:35.466+0000 7f78bd87b700 1 --2- 172.21.15.46:0/2755870621 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f78b80b1ed0 0x7f78b80af1d0 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:35.474 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:35.466+0000 7f78bd87b700 1 -- 172.21.15.46:0/2755870621 >> 172.21.15.46:0/2755870621 conn(0x7f78b8099e00 msgr2=0x7f78b80d0b00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-05T18:56:35.475 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:35.466+0000 7f78bd87b700 1 -- 172.21.15.46:0/2755870621 shutdown_connections 2023-07-05T18:56:35.475 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:35.466+0000 7f78bd87b700 1 -- 172.21.15.46:0/2755870621 wait complete. 2023-07-05T18:56:35.478 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:35.467+0000 7f78bd87b700 1 Processor -- start 2023-07-05T18:56:35.478 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:35.467+0000 7f78bd87b700 1 -- start start 2023-07-05T18:56:35.479 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:35.468+0000 7f78bd87b700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f78b80b1ed0 0x7f78b80c6260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:56:35.479 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:35.468+0000 7f78bd87b700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f78b80cede0 0x7f78b80c9440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:56:35.479 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:35.468+0000 7f78bd87b700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f78b815a610 0x7f78b8157950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:56:35.479 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:35.468+0000 7f78bd87b700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78b80c7c70 con 0x7f78b80cede0 2023-07-05T18:56:35.479 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:35.468+0000 7f78bd87b700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78b80c7f10 con 0x7f78b80b1ed0 2023-07-05T18:56:35.479 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:35.468+0000 7f78bd87b700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f78b80c81f0 con 0x7f78b815a610 2023-07-05T18:56:35.479 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:35.468+0000 7f78b67fc700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f78b80cede0 0x7f78b80c9440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:56:35.480 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:35.468+0000 7f78b67fc700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f78b80cede0 0x7f78b80c9440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:58548/0 (socket says 172.21.15.46:58548) 2023-07-05T18:56:35.480 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:35.468+0000 7f78b67fc700 1 -- 172.21.15.46:0/4192914766 learned_addr learned my addr 172.21.15.46:0/4192914766 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-07-05T18:56:35.480 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:35.468+0000 7f78b6ffd700 1 --2- 172.21.15.46:0/4192914766 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f78b80b1ed0 0x7f78b80c6260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:56:35.480 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:35.468+0000 7f78b77fe700 1 --2- 172.21.15.46:0/4192914766 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f78b815a610 0x7f78b8157950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:56:35.480 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:35.468+0000 7f78b67fc700 1 -- 172.21.15.46:0/4192914766 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f78b815a610 msgr2=0x7f78b8157950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:56:35.480 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:35.468+0000 7f78b67fc700 1 --2- 172.21.15.46:0/4192914766 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f78b815a610 0x7f78b8157950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:35.480 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:35.468+0000 7f78b67fc700 1 -- 172.21.15.46:0/4192914766 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f78b80b1ed0 msgr2=0x7f78b80c6260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:56:35.481 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:35.468+0000 7f78b67fc700 1 --2- 172.21.15.46:0/4192914766 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f78b80b1ed0 0x7f78b80c6260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:35.481 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:35.468+0000 7f78b67fc700 1 -- 172.21.15.46:0/4192914766 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f78b0009a70 con 0x7f78b80cede0 2023-07-05T18:56:35.481 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:35.469+0000 7f78b67fc700 1 --2- 172.21.15.46:0/4192914766 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f78b80cede0 0x7f78b80c9440 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f78a0001eb0 tx=0x7f78a000c800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-05T18:56:35.481 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:35.469+0000 7f78affff700 1 -- 172.21.15.46:0/4192914766 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78a0004c80 con 0x7f78b80cede0 2023-07-05T18:56:35.481 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:35.469+0000 7f78affff700 1 -- 172.21.15.46:0/4192914766 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f78a0004de0 con 0x7f78b80cede0 2023-07-05T18:56:35.481 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:35.469+0000 7f78bd87b700 1 -- 172.21.15.46:0/4192914766 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f78b80c84d0 con 0x7f78b80cede0 2023-07-05T18:56:35.482 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:35.469+0000 7f78affff700 1 -- 172.21.15.46:0/4192914766 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78a0007310 con 0x7f78b80cede0 2023-07-05T18:56:35.482 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:35.469+0000 7f78bd87b700 1 -- 172.21.15.46:0/4192914766 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f78b80ca650 con 0x7f78b80cede0 2023-07-05T18:56:35.482 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:35.470+0000 7f78bd87b700 1 -- 172.21.15.46:0/4192914766 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f78b8070c60 con 0x7f78b80cede0 2023-07-05T18:56:35.482 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:35.470+0000 7f78affff700 1 -- 172.21.15.46:0/4192914766 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f78a0007470 con 0x7f78b80cede0 2023-07-05T18:56:35.482 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:35.471+0000 7f78affff700 1 --2- 172.21.15.46:0/4192914766 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7f789806ace0 0x7f789806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:56:35.482 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:35.471+0000 7f78affff700 1 -- 172.21.15.46:0/4192914766 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f78a0089170 con 0x7f78b80cede0 2023-07-05T18:56:35.482 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:35.471+0000 7f78b6ffd700 1 --2- 172.21.15.46:0/4192914766 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7f789806ace0 0x7f789806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:56:35.483 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:35.471+0000 7f78b6ffd700 1 --2- 172.21.15.46:0/4192914766 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7f789806ace0 0x7f789806d190 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f78a8000fb0 tx=0x7f78a8009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-05T18:56:35.483 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:35.475+0000 7f78affff700 1 -- 172.21.15.46:0/4192914766 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f78a0054110 con 0x7f78b80cede0 2023-07-05T18:56:35.723 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:35.721+0000 7f78bd87b700 1 -- 172.21.15.46:0/4192914766 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f78b806f620 con 0x7f78b80cede0 2023-07-05T18:56:35.723 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:35.721+0000 7f78affff700 1 -- 172.21.15.46:0/4192914766 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v8) v1 ==== 53+0+73 (secure 0 0 0) 0x7f78a0057730 con 0x7f78b80cede0 2023-07-05T18:56:35.724 INFO:teuthology.orchestra.run.smithi046.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-07-05T18:56:35.725 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:35.723+0000 7f78bd87b700 1 -- 172.21.15.46:0/4192914766 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7f789806ace0 msgr2=0x7f789806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:56:35.726 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:35.723+0000 7f78bd87b700 1 --2- 172.21.15.46:0/4192914766 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7f789806ace0 0x7f789806d190 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f78a8000fb0 tx=0x7f78a8009040 comp rx=0 tx=0).stop 2023-07-05T18:56:35.726 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:35.723+0000 7f78bd87b700 1 -- 172.21.15.46:0/4192914766 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f78b80cede0 msgr2=0x7f78b80c9440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:56:35.726 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:35.723+0000 7f78bd87b700 1 --2- 172.21.15.46:0/4192914766 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f78b80cede0 0x7f78b80c9440 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f78a0001eb0 tx=0x7f78a000c800 comp rx=0 tx=0).stop 2023-07-05T18:56:35.726 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:35.723+0000 7f78bd87b700 1 -- 172.21.15.46:0/4192914766 shutdown_connections 2023-07-05T18:56:35.726 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:35.723+0000 7f78bd87b700 1 --2- 172.21.15.46:0/4192914766 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7f789806ace0 0x7f789806d190 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:35.726 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:35.723+0000 7f78bd87b700 1 --2- 172.21.15.46:0/4192914766 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f78b815a610 0x7f78b8157950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:35.726 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:35.723+0000 7f78bd87b700 1 --2- 172.21.15.46:0/4192914766 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f78b80b1ed0 0x7f78b80c6260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:35.727 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:35.723+0000 7f78bd87b700 1 --2- 172.21.15.46:0/4192914766 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f78b80cede0 0x7f78b80c9440 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:35.727 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:35.723+0000 7f78bd87b700 1 -- 172.21.15.46:0/4192914766 >> 172.21.15.46:0/4192914766 conn(0x7f78b8099e00 msgr2=0x7f78b80b0050 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-05T18:56:35.727 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:35.723+0000 7f78bd87b700 1 -- 172.21.15.46:0/4192914766 shutdown_connections 2023-07-05T18:56:35.727 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:35.723+0000 7f78bd87b700 1 -- 172.21.15.46:0/4192914766 wait complete. 2023-07-05T18:56:35.738 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-07-05T18:56:35.738 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-07-05T18:56:35.738 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi073.front.sepia.ceph.com 2023-07-05T18:56:35.738 INFO:tasks.cephfs.mount:self.client.name = client.1 2023-07-05T18:56:35.739 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2023-07-05T18:56:35.739 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-07-05T18:56:35.739 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-07-05T18:56:35.739 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-07-05T18:56:35.739 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.1' 2023-07-05T18:56:35.740 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-05T18:56:35.740 DEBUG:teuthology.orchestra.run.smithi073:> ip addr 2023-07-05T18:56:35.762 INFO:teuthology.orchestra.run.smithi073.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-07-05T18:56:35.762 INFO:teuthology.orchestra.run.smithi073.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-07-05T18:56:35.763 INFO:teuthology.orchestra.run.smithi073.stdout: inet 127.0.0.1/8 scope host lo 2023-07-05T18:56:35.763 INFO:teuthology.orchestra.run.smithi073.stdout: valid_lft forever preferred_lft forever 2023-07-05T18:56:35.763 INFO:teuthology.orchestra.run.smithi073.stdout: inet6 ::1/128 scope host 2023-07-05T18:56:35.764 INFO:teuthology.orchestra.run.smithi073.stdout: valid_lft forever preferred_lft forever 2023-07-05T18:56:35.764 INFO:teuthology.orchestra.run.smithi073.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-07-05T18:56:35.764 INFO:teuthology.orchestra.run.smithi073.stdout: link/ether 0c:c4:7a:d8:d9:ea brd ff:ff:ff:ff:ff:ff 2023-07-05T18:56:35.765 INFO:teuthology.orchestra.run.smithi073.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-07-05T18:56:35.765 INFO:teuthology.orchestra.run.smithi073.stdout: link/ether 0c:c4:7a:d8:d9:eb brd ff:ff:ff:ff:ff:ff 2023-07-05T18:56:35.765 INFO:teuthology.orchestra.run.smithi073.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-07-05T18:56:35.765 INFO:teuthology.orchestra.run.smithi073.stdout: link/ether 0c:c4:7a:8f:ce:7c brd ff:ff:ff:ff:ff:ff 2023-07-05T18:56:35.765 INFO:teuthology.orchestra.run.smithi073.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-07-05T18:56:35.766 INFO:teuthology.orchestra.run.smithi073.stdout: link/ether 0c:c4:7a:8f:ce:7d brd ff:ff:ff:ff:ff:ff 2023-07-05T18:56:35.766 INFO:teuthology.orchestra.run.smithi073.stdout: inet 172.21.15.73/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-07-05T18:56:35.766 INFO:teuthology.orchestra.run.smithi073.stdout: valid_lft 42279sec preferred_lft 42279sec 2023-07-05T18:56:35.766 INFO:teuthology.orchestra.run.smithi073.stdout: inet6 fe80::eecd:33ec:670a:202/64 scope link noprefixroute 2023-07-05T18:56:35.766 INFO:teuthology.orchestra.run.smithi073.stdout: valid_lft forever preferred_lft forever 2023-07-05T18:56:35.768 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2023-07-05T18:56:35.768 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-05T18:56:35.769 DEBUG:teuthology.orchestra.run.smithi073:> (cd / && exec bash -c ' 2023-07-05T18:56:35.770 DEBUG:teuthology.orchestra.run.smithi073:> set -e 2023-07-05T18:56:35.771 DEBUG:teuthology.orchestra.run.smithi073:> sudo ip link add name ceph-brx type bridge 2023-07-05T18:56:35.771 DEBUG:teuthology.orchestra.run.smithi073:> sudo ip addr flush dev ceph-brx 2023-07-05T18:56:35.772 DEBUG:teuthology.orchestra.run.smithi073:> sudo ip link set ceph-brx up 2023-07-05T18:56:35.772 DEBUG:teuthology.orchestra.run.smithi073:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2023-07-05T18:56:35.773 DEBUG:teuthology.orchestra.run.smithi073:> ') 2023-07-05T18:56:36.063 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-05T18:56:36.064 DEBUG:teuthology.orchestra.run.smithi073:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-07-05T18:56:36.094 INFO:teuthology.orchestra.run.smithi073.stdout:1 2023-07-05T18:56:36.097 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-05T18:56:36.097 DEBUG:teuthology.orchestra.run.smithi073:> route 2023-07-05T18:56:36.168 INFO:teuthology.orchestra.run.smithi073.stdout:Kernel IP routing table 2023-07-05T18:56:36.169 INFO:teuthology.orchestra.run.smithi073.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-07-05T18:56:36.169 INFO:teuthology.orchestra.run.smithi073.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-07-05T18:56:36.169 INFO:teuthology.orchestra.run.smithi073.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-07-05T18:56:36.169 INFO:teuthology.orchestra.run.smithi073.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-07-05T18:56:36.169 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-05T18:56:36.170 DEBUG:teuthology.orchestra.run.smithi073:> (cd / && exec bash -c ' 2023-07-05T18:56:36.170 DEBUG:teuthology.orchestra.run.smithi073:> set -e 2023-07-05T18:56:36.170 DEBUG:teuthology.orchestra.run.smithi073:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-07-05T18:56:36.171 DEBUG:teuthology.orchestra.run.smithi073:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-07-05T18:56:36.171 DEBUG:teuthology.orchestra.run.smithi073:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-07-05T18:56:36.171 DEBUG:teuthology.orchestra.run.smithi073:> ') 2023-07-05T18:56:36.464 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-05T18:56:36.465 DEBUG:teuthology.orchestra.run.smithi073:> ip netns list 2023-07-05T18:56:36.486 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-05T18:56:36.486 DEBUG:teuthology.orchestra.run.smithi073:> ip netns list-id 2023-07-05T18:56:36.543 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-05T18:56:36.544 DEBUG:teuthology.orchestra.run.smithi073:> (cd / && exec bash -c ' 2023-07-05T18:56:36.545 DEBUG:teuthology.orchestra.run.smithi073:> set -e 2023-07-05T18:56:36.545 DEBUG:teuthology.orchestra.run.smithi073:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.1 2023-07-05T18:56:36.545 DEBUG:teuthology.orchestra.run.smithi073:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.1 0 2023-07-05T18:56:36.546 DEBUG:teuthology.orchestra.run.smithi073:> ') 2023-07-05T18:56:36.638 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.1' with 192.168.0.1/16 2023-07-05T18:56:36.639 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-05T18:56:36.641 DEBUG:teuthology.orchestra.run.smithi073:> (cd / && exec bash -c ' 2023-07-05T18:56:36.642 DEBUG:teuthology.orchestra.run.smithi073:> set -e 2023-07-05T18:56:36.642 DEBUG:teuthology.orchestra.run.smithi073:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.1 type veth peer name brx.0 2023-07-05T18:56:36.643 DEBUG:teuthology.orchestra.run.smithi073:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2023-07-05T18:56:36.644 DEBUG:teuthology.orchestra.run.smithi073:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set veth0 up 2023-07-05T18:56:36.644 DEBUG:teuthology.orchestra.run.smithi073:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set lo up 2023-07-05T18:56:36.645 DEBUG:teuthology.orchestra.run.smithi073:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip route add default via 192.168.255.254 2023-07-05T18:56:36.645 DEBUG:teuthology.orchestra.run.smithi073:> ') 2023-07-05T18:56:36.851 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-05T18:56:36.852 DEBUG:teuthology.orchestra.run.smithi073:> (cd / && exec bash -c ' 2023-07-05T18:56:36.852 DEBUG:teuthology.orchestra.run.smithi073:> set -e 2023-07-05T18:56:36.859 DEBUG:teuthology.orchestra.run.smithi073:> sudo ip link set brx.0 up 2023-07-05T18:56:36.860 DEBUG:teuthology.orchestra.run.smithi073:> sudo ip link set dev brx.0 master ceph-brx 2023-07-05T18:56:36.860 DEBUG:teuthology.orchestra.run.smithi073:> ') 2023-07-05T18:56:36.963 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-07-05T18:56:36.963 DEBUG:teuthology.orchestra.run.smithi073:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2023-07-05T18:56:36.983 INFO:teuthology.orchestra.run.smithi073.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2023-07-05T18:56:36.984 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-07-05T18:56:36.984 DEBUG:teuthology.orchestra.run.smithi073:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2023-07-05T18:56:37.040 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2023-07-05T18:56:37.042 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-05T18:56:37.043 DEBUG:teuthology.orchestra.run.smithi073:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.1 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2023-07-05T18:56:37.163 INFO:teuthology.orchestra.run.smithi073.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2023-07-05T18:56:37.164 INFO:teuthology.orchestra.run.smithi073.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2023-07-05T18:56:37.164 INFO:teuthology.orchestra.run.smithi073.stdout:invalid new device string format 2023-07-05T18:56:37.276 INFO:teuthology.orchestra.run.smithi073.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2023-07-05T18:56:37.276 INFO:teuthology.orchestra.run.smithi073.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2023-07-05T18:56:37.276 INFO:teuthology.orchestra.run.smithi073.stdout:invalid new device string format 2023-07-05T18:56:37.276 INFO:teuthology.orchestra.run.smithi073.stdout:mount.ceph: resolved to: "172.21.15.46:3300,172.21.15.73:3300,172.21.15.73:3301" 2023-07-05T18:56:37.276 INFO:teuthology.orchestra.run.smithi073.stdout:mount.ceph: switching to using v1 address with old syntax 2023-07-05T18:56:37.350 INFO:teuthology.orchestra.run.smithi073.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2023-07-05T18:56:37.350 INFO:teuthology.orchestra.run.smithi073.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2023-07-05T18:56:37.351 INFO:teuthology.orchestra.run.smithi073.stdout:invalid new device string format 2023-07-05T18:56:37.351 INFO:teuthology.orchestra.run.smithi073.stdout:mount.ceph: resolved to: "172.21.15.46:3300,172.21.15.73:3300,172.21.15.73:3301" 2023-07-05T18:56:37.351 INFO:teuthology.orchestra.run.smithi073.stdout:mount.ceph: switching to using v1 address with old syntax 2023-07-05T18:56:37.351 INFO:teuthology.orchestra.run.smithi073.stdout:mount.ceph: resolved to: "172.21.15.46:6789,172.21.15.73:6789,172.21.15.73:6790" 2023-07-05T18:56:37.351 INFO:teuthology.orchestra.run.smithi073.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.46:6789,172.21.15.73:6789,172.21.15.73:6790:/ 2023-07-05T18:56:37.352 INFO:teuthology.orchestra.run.smithi073.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs,key=1,fsid=042652d3-d80c-4ad8-9366-3e94f2a0a512" will pass to kernel 2023-07-05T18:56:37.353 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-07-05T18:56:37.354 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-05T18:56:37.355 DEBUG:teuthology.orchestra.run.smithi073:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2023-07-05T18:56:37.385 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-05T18:56:37.386 DEBUG:teuthology.orchestra.run.smithi073:> (cd /home/ubuntu/cephtest/mnt.1 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-07-05T18:56:37.458 INFO:teuthology.orchestra.run.smithi073.stdout:client4713 2023-07-05T18:56:37.459 DEBUG:teuthology.orchestra.run.smithi073:> set -ex 2023-07-05T18:56:37.459 DEBUG:teuthology.orchestra.run.smithi073:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-05T18:56:37.519 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-05T18:56:37.520 DEBUG:teuthology.orchestra.run.smithi073:> (cd /home/ubuntu/cephtest/mnt.1 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-07-05T18:56:37.592 INFO:teuthology.orchestra.run.smithi073.stdout:client4713 2023-07-05T18:56:37.593 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-05T18:56:37.595 DEBUG:teuthology.orchestra.run.smithi073:> (cd /home/ubuntu/cephtest/mnt.1 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-07-05T18:56:37.664 INFO:teuthology.orchestra.run.smithi073.stdout:client4713 2023-07-05T18:56:37.664 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-05T18:56:37.665 DEBUG:teuthology.orchestra.run.smithi073:> (cd /home/ubuntu/cephtest/mnt.1 && exec bash -c 'sudo dd if=/sys/kernel/debug/ceph/042652d3-d80c-4ad8-9366-3e94f2a0a512.client4713/status') 2023-07-05T18:56:37.744 INFO:teuthology.orchestra.run.smithi073.stdout:instance: client.4713 (3)172.21.15.73:0/1337250529 2023-07-05T18:56:37.745 INFO:teuthology.orchestra.run.smithi073.stdout:blocklisted: false 2023-07-05T18:56:37.745 INFO:teuthology.orchestra.run.smithi073.stderr:0+1 records in 2023-07-05T18:56:37.746 INFO:teuthology.orchestra.run.smithi073.stderr:0+1 records out 2023-07-05T18:56:37.746 INFO:teuthology.orchestra.run.smithi073.stderr:70 bytes copied, 3.5789e-05 s, 2.0 MB/s 2023-07-05T18:56:37.746 INFO:tasks.kclient:client.3 config is {'syntax': 'v1'} 2023-07-05T18:56:37.747 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2023-07-05T18:56:37.747 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.3 2023-07-05T18:56:37.748 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-07-05T18:56:37.887 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:37.885+0000 7f508435d700 1 Processor -- start 2023-07-05T18:56:37.888 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:37.885+0000 7f508435d700 1 -- start start 2023-07-05T18:56:37.889 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:37.886+0000 7f508435d700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f507c071440 0x7f507c070730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:56:37.890 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:37.886+0000 7f508435d700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f507c071810 0x7f507c0b55b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:56:37.890 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:37.886+0000 7f508435d700 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f507c15de90 con 0x7f507c0b17b0 2023-07-05T18:56:37.891 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:37.886+0000 7f508435d700 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f507c06de40 con 0x7f507c071440 2023-07-05T18:56:37.891 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:37.886+0000 7f508435d700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f507c15e0e0 con 0x7f507c071810 2023-07-05T18:56:37.891 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:37.886+0000 7f50820f9700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f507c071440 0x7f507c070730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:56:37.891 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:37.886+0000 7f50820f9700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f507c071440 0x7f507c070730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:58554/0 (socket says 172.21.15.46:58554) 2023-07-05T18:56:37.891 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:37.886+0000 7f50820f9700 1 -- 172.21.15.46:0/4019482281 learned_addr learned my addr 172.21.15.46:0/4019482281 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-07-05T18:56:37.891 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:37.886+0000 7f50818f8700 1 --2- 172.21.15.46:0/4019482281 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f507c071810 0x7f507c0b55b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:56:37.892 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:37.887+0000 7f50820f9700 1 -- 172.21.15.46:0/4019482281 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f507c071810 msgr2=0x7f507c0b55b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-05T18:56:37.892 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:37.887+0000 7f50820f9700 1 --2- 172.21.15.46:0/4019482281 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f507c071810 0x7f507c0b55b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:37.892 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:37.887+0000 7f50820f9700 1 -- 172.21.15.46:0/4019482281 >> v1:172.21.15.73:6789/0 conn(0x7f507c0b17b0 legacy=0x7f507c15abf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:56:37.892 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:37.887+0000 7f50820f9700 1 -- 172.21.15.46:0/4019482281 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f507c15e3c0 con 0x7f507c071440 2023-07-05T18:56:37.893 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:37.887+0000 7f50820f9700 1 --2- 172.21.15.46:0/4019482281 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f507c071440 0x7f507c070730 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f506c0098f0 tx=0x7f506c009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8d1f3ec3c8288b4f server_cookie=0 in_seq=0 out_seq=0 2023-07-05T18:56:37.893 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:37.887+0000 7f50810f7700 1 -- 172.21.15.46:0/4019482281 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f506c00b8a0 con 0x7f507c071440 2023-07-05T18:56:37.893 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:37.887+0000 7f50810f7700 1 -- 172.21.15.46:0/4019482281 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f506c00ba00 con 0x7f507c071440 2023-07-05T18:56:37.893 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:37.887+0000 7f50810f7700 1 -- 172.21.15.46:0/4019482281 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f506c00bd90 con 0x7f507c071440 2023-07-05T18:56:37.893 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:37.887+0000 7f508435d700 1 -- 172.21.15.46:0/4019482281 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f507c071440 msgr2=0x7f507c070730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:56:37.893 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:37.888+0000 7f508435d700 1 --2- 172.21.15.46:0/4019482281 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f507c071440 0x7f507c070730 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f506c0098f0 tx=0x7f506c009c00 comp rx=0 tx=0).stop 2023-07-05T18:56:37.893 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:37.888+0000 7f508435d700 1 -- 172.21.15.46:0/4019482281 shutdown_connections 2023-07-05T18:56:37.894 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:37.888+0000 7f508435d700 1 --2- 172.21.15.46:0/4019482281 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f507c071440 0x7f507c070730 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:37.894 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:37.888+0000 7f508435d700 1 --2- 172.21.15.46:0/4019482281 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f507c071810 0x7f507c0b55b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:37.894 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:37.888+0000 7f508435d700 1 -- 172.21.15.46:0/4019482281 >> 172.21.15.46:0/4019482281 conn(0x7f507c06af10 msgr2=0x7f507c06b2e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-05T18:56:37.894 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:37.888+0000 7f508435d700 1 -- 172.21.15.46:0/4019482281 shutdown_connections 2023-07-05T18:56:37.894 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:37.888+0000 7f508435d700 1 -- 172.21.15.46:0/4019482281 wait complete. 2023-07-05T18:56:37.896 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:37.889+0000 7f508435d700 1 Processor -- start 2023-07-05T18:56:37.896 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:37.889+0000 7f508435d700 1 -- start start 2023-07-05T18:56:37.897 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:37.890+0000 7f508435d700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f507c071440 0x7f507c1f54f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:56:37.897 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:37.890+0000 7f508435d700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f507c071810 0x7f507c14fc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:56:37.897 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:37.890+0000 7f508435d700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f507c0b17b0 0x7f507c0aebe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:56:37.898 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:37.890+0000 7f508435d700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f507c0cda40 con 0x7f507c0b17b0 2023-07-05T18:56:37.898 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:37.890+0000 7f508435d700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f507c1f63b0 con 0x7f507c071440 2023-07-05T18:56:37.899 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:37.890+0000 7f508435d700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f507c1f5b10 con 0x7f507c071810 2023-07-05T18:56:37.899 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:37.890+0000 7f50828fa700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f507c0b17b0 0x7f507c0aebe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:56:37.899 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:37.890+0000 7f50828fa700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f507c0b17b0 0x7f507c0aebe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:58564/0 (socket says 172.21.15.46:58564) 2023-07-05T18:56:37.899 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:37.890+0000 7f50828fa700 1 -- 172.21.15.46:0/3560854845 learned_addr learned my addr 172.21.15.46:0/3560854845 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-07-05T18:56:37.899 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:37.890+0000 7f50820f9700 1 --2- 172.21.15.46:0/3560854845 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f507c071440 0x7f507c1f54f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:56:37.899 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:37.890+0000 7f50818f8700 1 --2- 172.21.15.46:0/3560854845 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f507c071810 0x7f507c14fc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:56:37.899 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:37.890+0000 7f50828fa700 1 -- 172.21.15.46:0/3560854845 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f507c071810 msgr2=0x7f507c14fc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:56:37.900 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:37.890+0000 7f50828fa700 1 --2- 172.21.15.46:0/3560854845 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f507c071810 0x7f507c14fc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:37.900 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:37.890+0000 7f50828fa700 1 -- 172.21.15.46:0/3560854845 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f507c071440 msgr2=0x7f507c1f54f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:56:37.900 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:37.890+0000 7f50828fa700 1 --2- 172.21.15.46:0/3560854845 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f507c071440 0x7f507c1f54f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:37.900 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:37.890+0000 7f50828fa700 1 -- 172.21.15.46:0/3560854845 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f506c009550 con 0x7f507c0b17b0 2023-07-05T18:56:37.900 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:37.890+0000 7f50828fa700 1 --2- 172.21.15.46:0/3560854845 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f507c0b17b0 0x7f507c0aebe0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f507400cb50 tx=0x7f507400cf10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-05T18:56:37.900 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:37.890+0000 7f5072ffd700 1 -- 172.21.15.46:0/3560854845 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5074003c00 con 0x7f507c0b17b0 2023-07-05T18:56:37.900 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:37.890+0000 7f5072ffd700 1 -- 172.21.15.46:0/3560854845 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5074003d60 con 0x7f507c0b17b0 2023-07-05T18:56:37.901 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:37.890+0000 7f508435d700 1 -- 172.21.15.46:0/3560854845 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f507c1f5df0 con 0x7f507c0b17b0 2023-07-05T18:56:37.901 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:37.891+0000 7f5072ffd700 1 -- 172.21.15.46:0/3560854845 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f507400ab70 con 0x7f507c0b17b0 2023-07-05T18:56:37.901 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:37.891+0000 7f508435d700 1 -- 172.21.15.46:0/3560854845 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f507c150180 con 0x7f507c0b17b0 2023-07-05T18:56:37.901 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:37.891+0000 7f508435d700 1 -- 172.21.15.46:0/3560854845 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f507c0cdb80 con 0x7f507c0b17b0 2023-07-05T18:56:37.901 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:37.892+0000 7f5072ffd700 1 -- 172.21.15.46:0/3560854845 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f507400acd0 con 0x7f507c0b17b0 2023-07-05T18:56:37.901 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:37.892+0000 7f5072ffd700 1 --2- 172.21.15.46:0/3560854845 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7f506006ace0 0x7f506006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:56:37.901 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:37.892+0000 7f5072ffd700 1 -- 172.21.15.46:0/3560854845 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f5074089450 con 0x7f507c0b17b0 2023-07-05T18:56:37.901 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:37.893+0000 7f50820f9700 1 --2- 172.21.15.46:0/3560854845 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7f506006ace0 0x7f506006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:56:37.902 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:37.893+0000 7f50820f9700 1 --2- 172.21.15.46:0/3560854845 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7f506006ace0 0x7f506006d190 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f506c009c40 tx=0x7f506c008030 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-05T18:56:37.902 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:37.897+0000 7f5072ffd700 1 -- 172.21.15.46:0/3560854845 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f507c0cdb80 con 0x7f507c0b17b0 2023-07-05T18:56:38.143 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:38.139+0000 7f508435d700 1 -- 172.21.15.46:0/3560854845 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f507c0cdb80 con 0x7f507c0b17b0 2023-07-05T18:56:38.143 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:38.140+0000 7f5072ffd700 1 -- 172.21.15.46:0/3560854845 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v8) v1 ==== 53+0+73 (secure 0 0 0) 0x7f507c0cdb80 con 0x7f507c0b17b0 2023-07-05T18:56:38.144 INFO:teuthology.orchestra.run.smithi046.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-07-05T18:56:38.145 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:38.142+0000 7f508435d700 1 -- 172.21.15.46:0/3560854845 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7f506006ace0 msgr2=0x7f506006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:56:38.145 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:38.142+0000 7f508435d700 1 --2- 172.21.15.46:0/3560854845 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7f506006ace0 0x7f506006d190 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f506c009c40 tx=0x7f506c008030 comp rx=0 tx=0).stop 2023-07-05T18:56:38.145 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:38.142+0000 7f508435d700 1 -- 172.21.15.46:0/3560854845 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f507c0b17b0 msgr2=0x7f507c0aebe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:56:38.145 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:38.142+0000 7f508435d700 1 --2- 172.21.15.46:0/3560854845 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f507c0b17b0 0x7f507c0aebe0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f507400cb50 tx=0x7f507400cf10 comp rx=0 tx=0).stop 2023-07-05T18:56:38.145 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:38.142+0000 7f508435d700 1 -- 172.21.15.46:0/3560854845 shutdown_connections 2023-07-05T18:56:38.145 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:38.142+0000 7f508435d700 1 --2- 172.21.15.46:0/3560854845 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7f506006ace0 0x7f506006d190 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:38.146 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:38.142+0000 7f508435d700 1 --2- 172.21.15.46:0/3560854845 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f507c0b17b0 0x7f507c0aebe0 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:38.146 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:38.142+0000 7f508435d700 1 --2- 172.21.15.46:0/3560854845 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f507c071440 0x7f507c1f54f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:38.146 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:38.142+0000 7f508435d700 1 --2- 172.21.15.46:0/3560854845 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f507c071810 0x7f507c14fc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:38.146 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:38.142+0000 7f508435d700 1 -- 172.21.15.46:0/3560854845 >> 172.21.15.46:0/3560854845 conn(0x7f507c06af10 msgr2=0x7f507c070630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-05T18:56:38.146 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:38.142+0000 7f508435d700 1 -- 172.21.15.46:0/3560854845 shutdown_connections 2023-07-05T18:56:38.146 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:38.142+0000 7f508435d700 1 -- 172.21.15.46:0/3560854845 wait complete. 2023-07-05T18:56:38.156 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-07-05T18:56:38.156 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-07-05T18:56:38.156 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi073.front.sepia.ceph.com 2023-07-05T18:56:38.157 INFO:tasks.cephfs.mount:self.client.name = client.3 2023-07-05T18:56:38.157 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.3 2023-07-05T18:56:38.157 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-07-05T18:56:38.157 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-07-05T18:56:38.157 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-07-05T18:56:38.158 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.3' 2023-07-05T18:56:38.158 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-05T18:56:38.158 DEBUG:teuthology.orchestra.run.smithi073:> ip addr 2023-07-05T18:56:38.177 INFO:teuthology.orchestra.run.smithi073.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-07-05T18:56:38.177 INFO:teuthology.orchestra.run.smithi073.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-07-05T18:56:38.177 INFO:teuthology.orchestra.run.smithi073.stdout: inet 127.0.0.1/8 scope host lo 2023-07-05T18:56:38.177 INFO:teuthology.orchestra.run.smithi073.stdout: valid_lft forever preferred_lft forever 2023-07-05T18:56:38.178 INFO:teuthology.orchestra.run.smithi073.stdout: inet6 ::1/128 scope host 2023-07-05T18:56:38.178 INFO:teuthology.orchestra.run.smithi073.stdout: valid_lft forever preferred_lft forever 2023-07-05T18:56:38.178 INFO:teuthology.orchestra.run.smithi073.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-07-05T18:56:38.178 INFO:teuthology.orchestra.run.smithi073.stdout: link/ether 0c:c4:7a:d8:d9:ea brd ff:ff:ff:ff:ff:ff 2023-07-05T18:56:38.178 INFO:teuthology.orchestra.run.smithi073.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-07-05T18:56:38.178 INFO:teuthology.orchestra.run.smithi073.stdout: link/ether 0c:c4:7a:d8:d9:eb brd ff:ff:ff:ff:ff:ff 2023-07-05T18:56:38.178 INFO:teuthology.orchestra.run.smithi073.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-07-05T18:56:38.179 INFO:teuthology.orchestra.run.smithi073.stdout: link/ether 0c:c4:7a:8f:ce:7c brd ff:ff:ff:ff:ff:ff 2023-07-05T18:56:38.179 INFO:teuthology.orchestra.run.smithi073.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-07-05T18:56:38.179 INFO:teuthology.orchestra.run.smithi073.stdout: link/ether 0c:c4:7a:8f:ce:7d brd ff:ff:ff:ff:ff:ff 2023-07-05T18:56:38.179 INFO:teuthology.orchestra.run.smithi073.stdout: inet 172.21.15.73/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-07-05T18:56:38.179 INFO:teuthology.orchestra.run.smithi073.stdout: valid_lft 42277sec preferred_lft 42277sec 2023-07-05T18:56:38.179 INFO:teuthology.orchestra.run.smithi073.stdout: inet6 fe80::eecd:33ec:670a:202/64 scope link noprefixroute 2023-07-05T18:56:38.179 INFO:teuthology.orchestra.run.smithi073.stdout: valid_lft forever preferred_lft forever 2023-07-05T18:56:38.180 INFO:teuthology.orchestra.run.smithi073.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-07-05T18:56:38.180 INFO:teuthology.orchestra.run.smithi073.stdout: link/ether be:9d:f7:80:08:c0 brd ff:ff:ff:ff:ff:ff 2023-07-05T18:56:38.180 INFO:teuthology.orchestra.run.smithi073.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-07-05T18:56:38.180 INFO:teuthology.orchestra.run.smithi073.stdout: valid_lft forever preferred_lft forever 2023-07-05T18:56:38.180 INFO:teuthology.orchestra.run.smithi073.stdout: inet6 fe80::403e:7bff:fe68:907c/64 scope link 2023-07-05T18:56:38.180 INFO:teuthology.orchestra.run.smithi073.stdout: valid_lft forever preferred_lft forever 2023-07-05T18:56:38.180 INFO:teuthology.orchestra.run.smithi073.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-07-05T18:56:38.181 INFO:teuthology.orchestra.run.smithi073.stdout: link/ether be:9d:f7:80:08:c0 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2023-07-05T18:56:38.181 INFO:teuthology.orchestra.run.smithi073.stdout: inet6 fe80::bc9d:f7ff:fe80:8c0/64 scope link tentative 2023-07-05T18:56:38.181 INFO:teuthology.orchestra.run.smithi073.stdout: valid_lft forever preferred_lft forever 2023-07-05T18:56:38.181 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-05T18:56:38.182 DEBUG:teuthology.orchestra.run.smithi073:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-07-05T18:56:38.244 INFO:teuthology.orchestra.run.smithi073.stdout:1 2023-07-05T18:56:38.245 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-05T18:56:38.245 DEBUG:teuthology.orchestra.run.smithi073:> route 2023-07-05T18:56:38.306 INFO:teuthology.orchestra.run.smithi073.stdout:Kernel IP routing table 2023-07-05T18:56:38.306 INFO:teuthology.orchestra.run.smithi073.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-07-05T18:56:38.306 INFO:teuthology.orchestra.run.smithi073.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-07-05T18:56:38.306 INFO:teuthology.orchestra.run.smithi073.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-07-05T18:56:38.306 INFO:teuthology.orchestra.run.smithi073.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-07-05T18:56:38.307 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-05T18:56:38.307 DEBUG:teuthology.orchestra.run.smithi073:> (cd / && exec bash -c ' 2023-07-05T18:56:38.307 DEBUG:teuthology.orchestra.run.smithi073:> set -e 2023-07-05T18:56:38.307 DEBUG:teuthology.orchestra.run.smithi073:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-07-05T18:56:38.308 DEBUG:teuthology.orchestra.run.smithi073:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-07-05T18:56:38.308 DEBUG:teuthology.orchestra.run.smithi073:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-07-05T18:56:38.308 DEBUG:teuthology.orchestra.run.smithi073:> ') 2023-07-05T18:56:38.410 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-05T18:56:38.411 DEBUG:teuthology.orchestra.run.smithi073:> ip netns list 2023-07-05T18:56:38.427 INFO:teuthology.orchestra.run.smithi073.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2023-07-05T18:56:38.428 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-05T18:56:38.428 DEBUG:teuthology.orchestra.run.smithi073:> ip netns list-id 2023-07-05T18:56:38.484 INFO:teuthology.orchestra.run.smithi073.stdout:nsid 0 (iproute2 netns name: ceph-ns--home-ubuntu-cephtest-mnt.1) 2023-07-05T18:56:38.485 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-05T18:56:38.485 DEBUG:teuthology.orchestra.run.smithi073:> (cd / && exec bash -c ' 2023-07-05T18:56:38.485 DEBUG:teuthology.orchestra.run.smithi073:> set -e 2023-07-05T18:56:38.485 DEBUG:teuthology.orchestra.run.smithi073:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.3 2023-07-05T18:56:38.486 DEBUG:teuthology.orchestra.run.smithi073:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.3 1 2023-07-05T18:56:38.486 DEBUG:teuthology.orchestra.run.smithi073:> ') 2023-07-05T18:56:38.580 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-05T18:56:38.581 DEBUG:teuthology.orchestra.run.smithi073:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr 2023-07-05T18:56:38.616 INFO:teuthology.orchestra.run.smithi073.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-07-05T18:56:38.617 INFO:teuthology.orchestra.run.smithi073.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-07-05T18:56:38.617 INFO:teuthology.orchestra.run.smithi073.stdout: inet 127.0.0.1/8 scope host lo 2023-07-05T18:56:38.617 INFO:teuthology.orchestra.run.smithi073.stdout: valid_lft forever preferred_lft forever 2023-07-05T18:56:38.617 INFO:teuthology.orchestra.run.smithi073.stdout: inet6 ::1/128 scope host 2023-07-05T18:56:38.617 INFO:teuthology.orchestra.run.smithi073.stdout: valid_lft forever preferred_lft forever 2023-07-05T18:56:38.617 INFO:teuthology.orchestra.run.smithi073.stdout:2: veth0@if7: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-07-05T18:56:38.617 INFO:teuthology.orchestra.run.smithi073.stdout: link/ether 76:63:48:de:dc:91 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2023-07-05T18:56:38.618 INFO:teuthology.orchestra.run.smithi073.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2023-07-05T18:56:38.618 INFO:teuthology.orchestra.run.smithi073.stdout: valid_lft forever preferred_lft forever 2023-07-05T18:56:38.618 INFO:teuthology.orchestra.run.smithi073.stdout: inet6 fe80::7463:48ff:fede:dc91/64 scope link tentative 2023-07-05T18:56:38.618 INFO:teuthology.orchestra.run.smithi073.stdout: valid_lft forever preferred_lft forever 2023-07-05T18:56:38.627 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-05T18:56:38.628 DEBUG:teuthology.orchestra.run.smithi073:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr 2023-07-05T18:56:38.707 INFO:teuthology.orchestra.run.smithi073.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-07-05T18:56:38.708 INFO:teuthology.orchestra.run.smithi073.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-07-05T18:56:38.708 INFO:teuthology.orchestra.run.smithi073.stdout: inet 127.0.0.1/8 scope host lo 2023-07-05T18:56:38.708 INFO:teuthology.orchestra.run.smithi073.stdout: valid_lft forever preferred_lft forever 2023-07-05T18:56:38.708 INFO:teuthology.orchestra.run.smithi073.stdout: inet6 ::1/128 scope host 2023-07-05T18:56:38.708 INFO:teuthology.orchestra.run.smithi073.stdout: valid_lft forever preferred_lft forever 2023-07-05T18:56:38.708 INFO:teuthology.orchestra.run.smithi073.stdout:2: veth0@if7: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-07-05T18:56:38.708 INFO:teuthology.orchestra.run.smithi073.stdout: link/ether 76:63:48:de:dc:91 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2023-07-05T18:56:38.709 INFO:teuthology.orchestra.run.smithi073.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2023-07-05T18:56:38.709 INFO:teuthology.orchestra.run.smithi073.stdout: valid_lft forever preferred_lft forever 2023-07-05T18:56:38.709 INFO:teuthology.orchestra.run.smithi073.stdout: inet6 fe80::7463:48ff:fede:dc91/64 scope link tentative 2023-07-05T18:56:38.709 INFO:teuthology.orchestra.run.smithi073.stdout: valid_lft forever preferred_lft forever 2023-07-05T18:56:38.723 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.3' with 192.168.0.2/16 2023-07-05T18:56:38.724 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-05T18:56:38.724 DEBUG:teuthology.orchestra.run.smithi073:> (cd / && exec bash -c ' 2023-07-05T18:56:38.724 DEBUG:teuthology.orchestra.run.smithi073:> set -e 2023-07-05T18:56:38.725 DEBUG:teuthology.orchestra.run.smithi073:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.3 type veth peer name brx.1 2023-07-05T18:56:38.725 DEBUG:teuthology.orchestra.run.smithi073:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip addr add 192.168.0.2/16 brd 192.168.255.255 dev veth0 2023-07-05T18:56:38.725 DEBUG:teuthology.orchestra.run.smithi073:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip link set veth0 up 2023-07-05T18:56:38.725 DEBUG:teuthology.orchestra.run.smithi073:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip link set lo up 2023-07-05T18:56:38.726 DEBUG:teuthology.orchestra.run.smithi073:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip route add default via 192.168.255.254 2023-07-05T18:56:38.726 DEBUG:teuthology.orchestra.run.smithi073:> ') 2023-07-05T18:56:38.956 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-05T18:56:38.956 DEBUG:teuthology.orchestra.run.smithi073:> (cd / && exec bash -c ' 2023-07-05T18:56:38.957 DEBUG:teuthology.orchestra.run.smithi073:> set -e 2023-07-05T18:56:38.957 DEBUG:teuthology.orchestra.run.smithi073:> sudo ip link set brx.1 up 2023-07-05T18:56:38.957 DEBUG:teuthology.orchestra.run.smithi073:> sudo ip link set dev brx.1 master ceph-brx 2023-07-05T18:56:38.957 DEBUG:teuthology.orchestra.run.smithi073:> ') 2023-07-05T18:56:39.072 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-07-05T18:56:39.073 DEBUG:teuthology.orchestra.run.smithi073:> mkdir -p -v /home/ubuntu/cephtest/mnt.3 2023-07-05T18:56:39.092 INFO:teuthology.orchestra.run.smithi073.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.3' 2023-07-05T18:56:39.092 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-07-05T18:56:39.093 DEBUG:teuthology.orchestra.run.smithi073:> chmod 0000 /home/ubuntu/cephtest/mnt.3 2023-07-05T18:56:39.148 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2023-07-05T18:56:39.149 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-05T18:56:39.149 DEBUG:teuthology.orchestra.run.smithi073:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.3 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=3,mds_namespace=cephfs 2023-07-05T18:56:39.233 INFO:teuthology.orchestra.run.smithi073.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=3,mds_namespace=cephfs 2023-07-05T18:56:39.234 INFO:teuthology.orchestra.run.smithi073.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=3,mds_namespace=cephfs". 2023-07-05T18:56:39.234 INFO:teuthology.orchestra.run.smithi073.stdout:invalid new device string format 2023-07-05T18:56:39.242 INFO:teuthology.orchestra.run.smithi073.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=3,mds_namespace=cephfs 2023-07-05T18:56:39.242 INFO:teuthology.orchestra.run.smithi073.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=3,mds_namespace=cephfs". 2023-07-05T18:56:39.242 INFO:teuthology.orchestra.run.smithi073.stdout:invalid new device string format 2023-07-05T18:56:39.242 INFO:teuthology.orchestra.run.smithi073.stdout:mount.ceph: resolved to: "172.21.15.46:3300,172.21.15.73:3300,172.21.15.73:3301" 2023-07-05T18:56:39.243 INFO:teuthology.orchestra.run.smithi073.stdout:mount.ceph: switching to using v1 address with old syntax 2023-07-05T18:56:39.273 INFO:teuthology.orchestra.run.smithi073.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=3,mds_namespace=cephfs 2023-07-05T18:56:39.273 INFO:teuthology.orchestra.run.smithi073.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=3,mds_namespace=cephfs". 2023-07-05T18:56:39.274 INFO:teuthology.orchestra.run.smithi073.stdout:invalid new device string format 2023-07-05T18:56:39.274 INFO:teuthology.orchestra.run.smithi073.stdout:mount.ceph: resolved to: "172.21.15.46:3300,172.21.15.73:3300,172.21.15.73:3301" 2023-07-05T18:56:39.274 INFO:teuthology.orchestra.run.smithi073.stdout:mount.ceph: switching to using v1 address with old syntax 2023-07-05T18:56:39.274 INFO:teuthology.orchestra.run.smithi073.stdout:mount.ceph: resolved to: "172.21.15.46:6789,172.21.15.73:6789,172.21.15.73:6790" 2023-07-05T18:56:39.274 INFO:teuthology.orchestra.run.smithi073.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.46:6789,172.21.15.73:6789,172.21.15.73:6790:/ 2023-07-05T18:56:39.274 INFO:teuthology.orchestra.run.smithi073.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=3,mds_namespace=cephfs,key=3,fsid=042652d3-d80c-4ad8-9366-3e94f2a0a512" will pass to kernel 2023-07-05T18:56:39.276 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-07-05T18:56:39.276 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-05T18:56:39.277 DEBUG:teuthology.orchestra.run.smithi073:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.3 2023-07-05T18:56:39.311 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-05T18:56:39.311 DEBUG:teuthology.orchestra.run.smithi073:> (cd /home/ubuntu/cephtest/mnt.3 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-07-05T18:56:39.383 INFO:teuthology.orchestra.run.smithi073.stdout:client4657 2023-07-05T18:56:39.384 DEBUG:teuthology.orchestra.run.smithi073:> set -ex 2023-07-05T18:56:39.384 DEBUG:teuthology.orchestra.run.smithi073:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-05T18:56:39.441 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-05T18:56:39.441 DEBUG:teuthology.orchestra.run.smithi073:> (cd /home/ubuntu/cephtest/mnt.3 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-07-05T18:56:39.515 INFO:teuthology.orchestra.run.smithi073.stdout:client4657 2023-07-05T18:56:39.516 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-05T18:56:39.516 DEBUG:teuthology.orchestra.run.smithi073:> (cd /home/ubuntu/cephtest/mnt.3 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-07-05T18:56:39.587 INFO:teuthology.orchestra.run.smithi073.stdout:client4657 2023-07-05T18:56:39.588 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-05T18:56:39.588 DEBUG:teuthology.orchestra.run.smithi073:> (cd /home/ubuntu/cephtest/mnt.3 && exec bash -c 'sudo dd if=/sys/kernel/debug/ceph/042652d3-d80c-4ad8-9366-3e94f2a0a512.client4657/status') 2023-07-05T18:56:39.670 INFO:teuthology.orchestra.run.smithi073.stdout:instance: client.4657 (3)192.168.0.2:0/247486987 2023-07-05T18:56:39.671 INFO:teuthology.orchestra.run.smithi073.stdout:blocklisted: false 2023-07-05T18:56:39.672 INFO:teuthology.orchestra.run.smithi073.stderr:0+1 records in 2023-07-05T18:56:39.672 INFO:teuthology.orchestra.run.smithi073.stderr:0+1 records out 2023-07-05T18:56:39.673 INFO:teuthology.orchestra.run.smithi073.stderr:68 bytes copied, 2.3097e-05 s, 2.9 MB/s 2023-07-05T18:56:39.673 INFO:teuthology.run_tasks:Running task cephfs_test_runner... 2023-07-05T18:56:39.697 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-05T18:56:39.837 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:39.835+0000 7f928cbb9700 1 Processor -- start 2023-07-05T18:56:39.838 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:39.835+0000 7f928cbb9700 1 -- start start 2023-07-05T18:56:39.839 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:39.836+0000 7f928cbb9700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f92880aef40 0x7f92880b3530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:56:39.840 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:39.836+0000 7f928cbb9700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f9288069e00 0x7f928806a250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:56:39.840 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:39.836+0000 7f928cbb9700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f928815ca80 0x7f928815cf00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:56:39.840 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:39.836+0000 7f928cbb9700 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f928815d440 con 0x7f928815ca80 2023-07-05T18:56:39.841 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:39.836+0000 7f928cbb9700 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f928806a790 con 0x7f9288069e00 2023-07-05T18:56:39.841 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:39.836+0000 7f928cbb9700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f92880b30a0 con 0x7f92880aef40 2023-07-05T18:56:39.841 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:39.836+0000 7f9286d9d700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f928815ca80 0x7f928815cf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:56:39.841 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:39.836+0000 7f9286d9d700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f928815ca80 0x7f928815cf00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:58578/0 (socket says 172.21.15.46:58578) 2023-07-05T18:56:39.841 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:39.836+0000 7f9286d9d700 1 -- 172.21.15.46:0/3245356939 learned_addr learned my addr 172.21.15.46:0/3245356939 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-07-05T18:56:39.841 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:39.836+0000 7f928659c700 1 --2- 172.21.15.46:0/3245356939 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f92880aef40 0x7f92880b3530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:56:39.842 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:39.836+0000 7f9285d9b700 1 --2- 172.21.15.46:0/3245356939 >> v2:172.21.15.73:3300/0 conn(0x7f9288069e00 0x7f928806a250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:56:39.842 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:39.837+0000 7f9286d9d700 1 -- 172.21.15.46:0/3245356939 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f92880aef40 msgr2=0x7f92880b3530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-05T18:56:39.842 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:39.837+0000 7f9286d9d700 1 --2- 172.21.15.46:0/3245356939 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f92880aef40 0x7f92880b3530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:39.842 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:39.837+0000 7f9286d9d700 1 -- 172.21.15.46:0/3245356939 >> v2:172.21.15.73:3300/0 conn(0x7f9288069e00 msgr2=0x7f928806a250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-05T18:56:39.842 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:39.837+0000 7f9286d9d700 1 --2- 172.21.15.46:0/3245356939 >> v2:172.21.15.73:3300/0 conn(0x7f9288069e00 0x7f928806a250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:39.842 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:39.837+0000 7f9286d9d700 1 -- 172.21.15.46:0/3245356939 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f928806ca80 con 0x7f928815ca80 2023-07-05T18:56:39.842 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:39.837+0000 7f9286d9d700 1 --2- 172.21.15.46:0/3245356939 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f928815ca80 0x7f928815cf00 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f92880d0a70 tx=0x7f928000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b4912a757ab32cdf server_cookie=0 in_seq=0 out_seq=0 2023-07-05T18:56:39.843 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:39.837+0000 7f928559a700 1 -- 172.21.15.46:0/3245356939 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f928000e070 con 0x7f928815ca80 2023-07-05T18:56:39.843 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:39.837+0000 7f928559a700 1 -- 172.21.15.46:0/3245356939 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f928000b910 con 0x7f928815ca80 2023-07-05T18:56:39.843 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:39.837+0000 7f928559a700 1 -- 172.21.15.46:0/3245356939 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f928000bcc0 con 0x7f928815ca80 2023-07-05T18:56:39.843 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:39.838+0000 7f928cbb9700 1 -- 172.21.15.46:0/3245356939 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f928815ca80 msgr2=0x7f928815cf00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:56:39.843 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:39.838+0000 7f928cbb9700 1 --2- 172.21.15.46:0/3245356939 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f928815ca80 0x7f928815cf00 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f92880d0a70 tx=0x7f928000b330 comp rx=0 tx=0).stop 2023-07-05T18:56:39.843 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:39.838+0000 7f928cbb9700 1 -- 172.21.15.46:0/3245356939 shutdown_connections 2023-07-05T18:56:39.844 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:39.838+0000 7f928cbb9700 1 --2- 172.21.15.46:0/3245356939 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f92880aef40 0x7f92880b3530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:39.844 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:39.838+0000 7f928cbb9700 1 --2- 172.21.15.46:0/3245356939 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f928815ca80 0x7f928815cf00 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:39.845 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:39.838+0000 7f928cbb9700 1 --2- 172.21.15.46:0/3245356939 >> v2:172.21.15.73:3300/0 conn(0x7f9288069e00 0x7f928806a250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:39.845 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:39.838+0000 7f928cbb9700 1 -- 172.21.15.46:0/3245356939 >> 172.21.15.46:0/3245356939 conn(0x7f928806af10 msgr2=0x7f928806b2e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-05T18:56:39.845 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:39.838+0000 7f928cbb9700 1 -- 172.21.15.46:0/3245356939 shutdown_connections 2023-07-05T18:56:39.845 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:39.838+0000 7f928cbb9700 1 -- 172.21.15.46:0/3245356939 wait complete. 2023-07-05T18:56:39.847 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:39.839+0000 7f928cbb9700 1 Processor -- start 2023-07-05T18:56:39.847 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:39.840+0000 7f928cbb9700 1 -- start start 2023-07-05T18:56:39.847 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:39.840+0000 7f928cbb9700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f9288069e00 0x7f9288153900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:56:39.848 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:39.841+0000 7f928cbb9700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f92880aef40 0x7f92881f2090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:56:39.848 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:39.841+0000 7f928cbb9700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f928815ca80 0x7f92880b10b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:56:39.848 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:39.841+0000 7f928cbb9700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9288153e40 con 0x7f928815ca80 2023-07-05T18:56:39.848 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:39.841+0000 7f928cbb9700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9288150f40 con 0x7f92880aef40 2023-07-05T18:56:39.848 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:39.841+0000 7f928cbb9700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f928814eec0 con 0x7f9288069e00 2023-07-05T18:56:39.848 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:39.841+0000 7f9286d9d700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f928815ca80 0x7f92880b10b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:56:39.848 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:39.841+0000 7f9286d9d700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f928815ca80 0x7f92880b10b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:58584/0 (socket says 172.21.15.46:58584) 2023-07-05T18:56:39.849 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:39.841+0000 7f9286d9d700 1 -- 172.21.15.46:0/4192977471 learned_addr learned my addr 172.21.15.46:0/4192977471 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-07-05T18:56:39.849 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:39.841+0000 7f928659c700 1 --2- 172.21.15.46:0/4192977471 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f9288069e00 0x7f9288153900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:56:39.849 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:39.841+0000 7f9285d9b700 1 --2- 172.21.15.46:0/4192977471 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f92880aef40 0x7f92881f2090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:56:39.849 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:39.841+0000 7f9286d9d700 1 -- 172.21.15.46:0/4192977471 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f9288069e00 msgr2=0x7f9288153900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:56:39.849 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:39.841+0000 7f9286d9d700 1 --2- 172.21.15.46:0/4192977471 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f9288069e00 0x7f9288153900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:39.849 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:39.841+0000 7f9286d9d700 1 -- 172.21.15.46:0/4192977471 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f92880aef40 msgr2=0x7f92881f2090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:56:39.849 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:39.841+0000 7f9286d9d700 1 --2- 172.21.15.46:0/4192977471 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f92880aef40 0x7f92881f2090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:39.849 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:39.841+0000 7f9286d9d700 1 -- 172.21.15.46:0/4192977471 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9280009b30 con 0x7f928815ca80 2023-07-05T18:56:39.850 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:39.841+0000 7f9286d9d700 1 --2- 172.21.15.46:0/4192977471 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f928815ca80 0x7f92880b10b0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f92880d0aa0 tx=0x7f9280004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-05T18:56:39.850 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:39.841+0000 7f9276ffd700 1 -- 172.21.15.46:0/4192977471 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f928000ce80 con 0x7f928815ca80 2023-07-05T18:56:39.850 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:39.841+0000 7f9276ffd700 1 -- 172.21.15.46:0/4192977471 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9280004250 con 0x7f928815ca80 2023-07-05T18:56:39.850 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:39.841+0000 7f9276ffd700 1 -- 172.21.15.46:0/4192977471 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9280004600 con 0x7f928815ca80 2023-07-05T18:56:39.850 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:39.841+0000 7f928cbb9700 1 -- 172.21.15.46:0/4192977471 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f928814f1a0 con 0x7f928815ca80 2023-07-05T18:56:39.850 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:39.841+0000 7f928cbb9700 1 -- 172.21.15.46:0/4192977471 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f928814f760 con 0x7f928815ca80 2023-07-05T18:56:39.851 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:39.842+0000 7f928cbb9700 1 -- 172.21.15.46:0/4192977471 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f92880672e0 con 0x7f928815ca80 2023-07-05T18:56:39.851 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:39.843+0000 7f9276ffd700 1 -- 172.21.15.46:0/4192977471 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f9280004760 con 0x7f928815ca80 2023-07-05T18:56:39.851 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:39.843+0000 7f9276ffd700 1 --2- 172.21.15.46:0/4192977471 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7f926806ace0 0x7f926806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:56:39.851 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:39.843+0000 7f9276ffd700 1 -- 172.21.15.46:0/4192977471 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f928008a8c0 con 0x7f928815ca80 2023-07-05T18:56:39.851 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:39.843+0000 7f928659c700 1 --2- 172.21.15.46:0/4192977471 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7f926806ace0 0x7f926806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:56:39.851 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:39.844+0000 7f928659c700 1 --2- 172.21.15.46:0/4192977471 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7f926806ace0 0x7f926806d190 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f927c009b70 tx=0x7f927c008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-05T18:56:39.852 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:39.848+0000 7f9276ffd700 1 -- 172.21.15.46:0/4192977471 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f9280055980 con 0x7f928815ca80 2023-07-05T18:56:40.050 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:40.048+0000 7f928cbb9700 1 -- 172.21.15.46:0/4192977471 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f928806ef70 con 0x7f928815ca80 2023-07-05T18:56:40.052 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:40.050+0000 7f9276ffd700 1 -- 172.21.15.46:0/4192977471 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) v1 ==== 74+0+18161 (secure 0 0 0) 0x7f9280058fa0 con 0x7f928815ca80 2023-07-05T18:56:40.052 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T18:56:40.053 INFO:teuthology.orchestra.run.smithi046.stdout:{"epoch":21,"fsid":"042652d3-d80c-4ad8-9366-3e94f2a0a512","created":"2023-07-05T18:55:56.455710+0000","modified":"2023-07-05T18:56:16.095672+0000","last_up_change":"2023-07-05T18:56:06.594022+0000","last_in_change":"2023-07-05T18:55:58.879340+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-07-05T18:56:07.729620+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2023-07-05T18:56:08.128122+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-07-05T18:56:12.954625+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-07-05T18:56:14.068396+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"20009183-9a47-4392-8751-883f88d2bfb1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6813","nonce":4151971443},{"type":"v1","addr":"172.21.15.46:6815","nonce":4151971443}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6817","nonce":4151971443},{"type":"v1","addr":"172.21.15.46:6818","nonce":4151971443}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6822","nonce":4151971443},{"type":"v1","addr":"172.21.15.46:6823","nonce":4151971443}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6820","nonce":4151971443},{"type":"v1","addr":"172.21.15.46:6821","nonce":4151971443}]},"public_addr":"172.21.15.46:6815/4151971443","cluster_addr":"172.21.15.46:6818/4151971443","heartbeat_back_addr":"172.21.15.46:6823/4151971443","heartbeat_front_addr":"172.21.15.46:6821/4151971443","state":["exists","up"]},{"osd":1,"uuid":"91b4a7b0-e4e4-4888-a1fe-9edb0d68004c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6808","nonce":502575881},{"type":"v1","addr":"172.21.15.46:6809","nonce":502575881}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6810","nonce":502575881},{"type":"v1","addr":"172.21.15.46:6811","nonce":502575881}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6816","nonce":502575881},{"type":"v1","addr":"172.21.15.46:6819","nonce":502575881}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6812","nonce":502575881},{"type":"v1","addr":"172.21.15.46:6814","nonce":502575881}]},"public_addr":"172.21.15.46:6809/502575881","cluster_addr":"172.21.15.46:6811/502575881","heartbeat_back_addr":"172.21.15.46:6819/502575881","heartbeat_front_addr":"172.21.15.46:6814/502575881","state":["exists","up"]},{"osd":2,"uuid":"669ff744-1331-47c5-8579-0440731c889a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6800","nonce":2115251461},{"type":"v1","addr":"172.21.15.46:6801","nonce":2115251461}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6802","nonce":2115251461},{"type":"v1","addr":"172.21.15.46:6803","nonce":2115251461}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6806","nonce":2115251461},{"type":"v1","addr":"172.21.15.46:6807","nonce":2115251461}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6804","nonce":2115251461},{"type":"v1","addr":"172.21.15.46:6805","nonce":2115251461}]},"public_addr":"172.21.15.46:6801/2115251461","cluster_addr":"172.21.15.46:6803/2115251461","heartbeat_back_addr":"172.21.15.46:6807/2115251461","heartbeat_front_addr":"172.21.15.46:6805/2115251461","state":["exists","up"]},{"osd":3,"uuid":"34e1b86d-ffad-415d-861c-07a5f08068a6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6824","nonce":2981388766},{"type":"v1","addr":"172.21.15.46:6825","nonce":2981388766}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6826","nonce":2981388766},{"type":"v1","addr":"172.21.15.46:6827","nonce":2981388766}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6830","nonce":2981388766},{"type":"v1","addr":"172.21.15.46:6831","nonce":2981388766}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6828","nonce":2981388766},{"type":"v1","addr":"172.21.15.46:6829","nonce":2981388766}]},"public_addr":"172.21.15.46:6825/2981388766","cluster_addr":"172.21.15.46:6827/2981388766","heartbeat_back_addr":"172.21.15.46:6831/2981388766","heartbeat_front_addr":"172.21.15.46:6829/2981388766","state":["exists","up"]},{"osd":4,"uuid":"57ffcb91-c7dc-4a69-ae71-4d9622a14a05","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6800","nonce":2083655348},{"type":"v1","addr":"172.21.15.73:6801","nonce":2083655348}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6802","nonce":2083655348},{"type":"v1","addr":"172.21.15.73:6803","nonce":2083655348}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6806","nonce":2083655348},{"type":"v1","addr":"172.21.15.73:6807","nonce":2083655348}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6804","nonce":2083655348},{"type":"v1","addr":"172.21.15.73:6805","nonce":2083655348}]},"public_addr":"172.21.15.73:6801/2083655348","cluster_addr":"172.21.15.73:6803/2083655348","heartbeat_back_addr":"172.21.15.73:6807/2083655348","heartbeat_front_addr":"172.21.15.73:6805/2083655348","state":["exists","up"]},{"osd":5,"uuid":"665f41c9-ee20-49cf-bf0e-fbe0c03d3aed","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6824","nonce":2803788401},{"type":"v1","addr":"172.21.15.73:6825","nonce":2803788401}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6826","nonce":2803788401},{"type":"v1","addr":"172.21.15.73:6827","nonce":2803788401}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6830","nonce":2803788401},{"type":"v1","addr":"172.21.15.73:6831","nonce":2803788401}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6828","nonce":2803788401},{"type":"v1","addr":"172.21.15.73:6829","nonce":2803788401}]},"public_addr":"172.21.15.73:6825/2803788401","cluster_addr":"172.21.15.73:6827/2803788401","heartbeat_back_addr":"172.21.15.73:6831/2803788401","heartbeat_front_addr":"172.21.15.73:6829/2803788401","state":["exists","up"]},{"osd":6,"uuid":"5790c6cc-bd56-4ce4-9a7c-0f0c3b59215c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6808","nonce":974108383},{"type":"v1","addr":"172.21.15.73:6809","nonce":974108383}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6810","nonce":974108383},{"type":"v1","addr":"172.21.15.73:6811","nonce":974108383}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6815","nonce":974108383},{"type":"v1","addr":"172.21.15.73:6817","nonce":974108383}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6812","nonce":974108383},{"type":"v1","addr":"172.21.15.73:6813","nonce":974108383}]},"public_addr":"172.21.15.73:6809/974108383","cluster_addr":"172.21.15.73:6811/974108383","heartbeat_back_addr":"172.21.15.73:6817/974108383","heartbeat_front_addr":"172.21.15.73:6813/974108383","state":["exists","up"]},{"osd":7,"uuid":"b66f4d2e-147e-4c9b-97dd-cbd59d33802e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6814","nonce":3772673248},{"type":"v1","addr":"172.21.15.73:6816","nonce":3772673248}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6818","nonce":3772673248},{"type":"v1","addr":"172.21.15.73:6819","nonce":3772673248}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6822","nonce":3772673248},{"type":"v1","addr":"172.21.15.73:6823","nonce":3772673248}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6820","nonce":3772673248},{"type":"v1","addr":"172.21.15.73:6821","nonce":3772673248}]},"public_addr":"172.21.15.73:6816/3772673248","cluster_addr":"172.21.15.73:6819/3772673248","heartbeat_back_addr":"172.21.15.73:6823/3772673248","heartbeat_front_addr":"172.21.15.73:6821/3772673248","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-05T18:56:04.115334+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-05T18:56:04.071250+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-05T18:56:04.044387+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-05T18:56:04.085389+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-05T18:56:04.090726+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-05T18:56:04.074529+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-05T18:56:04.058841+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-05T18:56:04.043054+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-05T18:56:40.054 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:40.052+0000 7f928cbb9700 1 -- 172.21.15.46:0/4192977471 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7f926806ace0 msgr2=0x7f926806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:56:40.054 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:40.052+0000 7f928cbb9700 1 --2- 172.21.15.46:0/4192977471 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7f926806ace0 0x7f926806d190 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f927c009b70 tx=0x7f927c008040 comp rx=0 tx=0).stop 2023-07-05T18:56:40.054 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:40.052+0000 7f928cbb9700 1 -- 172.21.15.46:0/4192977471 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f928815ca80 msgr2=0x7f92880b10b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:56:40.054 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:40.052+0000 7f928cbb9700 1 --2- 172.21.15.46:0/4192977471 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f928815ca80 0x7f92880b10b0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f92880d0aa0 tx=0x7f9280004ad0 comp rx=0 tx=0).stop 2023-07-05T18:56:40.054 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:40.052+0000 7f928cbb9700 1 -- 172.21.15.46:0/4192977471 shutdown_connections 2023-07-05T18:56:40.055 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:40.052+0000 7f928cbb9700 1 --2- 172.21.15.46:0/4192977471 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7f926806ace0 0x7f926806d190 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:40.055 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:40.052+0000 7f928cbb9700 1 --2- 172.21.15.46:0/4192977471 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f928815ca80 0x7f92880b10b0 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:40.055 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:40.052+0000 7f928cbb9700 1 --2- 172.21.15.46:0/4192977471 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f9288069e00 0x7f9288153900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:40.055 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:40.052+0000 7f928cbb9700 1 --2- 172.21.15.46:0/4192977471 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f92880aef40 0x7f92881f2090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:40.055 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:40.052+0000 7f928cbb9700 1 -- 172.21.15.46:0/4192977471 >> 172.21.15.46:0/4192977471 conn(0x7f928806af10 msgr2=0x7f92880b3430 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-05T18:56:40.055 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:40.052+0000 7f928cbb9700 1 -- 172.21.15.46:0/4192977471 shutdown_connections 2023-07-05T18:56:40.056 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:40.052+0000 7f928cbb9700 1 -- 172.21.15.46:0/4192977471 wait complete. 2023-07-05T18:56:40.066 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'rbd', 'create_time': '2023-07-05T18:56:07.729620+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': '.mgr', 'create_time': '2023-07-05T18:56:08.128122+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-07-05T18:56:12.954625+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-07-05T18:56:14.068396+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-07-05T18:56:40.068 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-07-05T18:56:40.197 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:40.194+0000 7fdf9e4f2700 1 Processor -- start 2023-07-05T18:56:40.198 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:40.194+0000 7fdf9e4f2700 1 -- start start 2023-07-05T18:56:40.198 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:40.195+0000 7fdf9e4f2700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fdf9815c860 0x7fdf98160ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:56:40.198 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:40.195+0000 7fdf9e4f2700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fdf980715c0 0x7fdf98069e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:56:40.199 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:40.195+0000 7fdf9e4f2700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fdf9806a340 0x7fdf980b13f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:56:40.199 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:40.195+0000 7fdf9e4f2700 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdf980ce640 con 0x7fdf980715c0 2023-07-05T18:56:40.199 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:40.195+0000 7fdf9e4f2700 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdf9806a780 con 0x7fdf9806a340 2023-07-05T18:56:40.199 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:40.195+0000 7fdf9e4f2700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdf981611e0 con 0x7fdf9815c860 2023-07-05T18:56:40.200 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:40.195+0000 7fdf977fe700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fdf980715c0 0x7fdf98069e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:56:40.200 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:40.195+0000 7fdf977fe700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fdf980715c0 0x7fdf98069e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:58588/0 (socket says 172.21.15.46:58588) 2023-07-05T18:56:40.200 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:40.195+0000 7fdf977fe700 1 -- 172.21.15.46:0/2672677878 learned_addr learned my addr 172.21.15.46:0/2672677878 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-07-05T18:56:40.201 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:40.195+0000 7fdf97fff700 1 --2- 172.21.15.46:0/2672677878 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fdf9815c860 0x7fdf98160ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:56:40.201 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:40.195+0000 7fdf9ca8f700 1 --2- 172.21.15.46:0/2672677878 >> v2:172.21.15.73:3300/0 conn(0x7fdf9806a340 0x7fdf980b13f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:56:40.206 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:40.196+0000 7fdf977fe700 1 -- 172.21.15.46:0/2672677878 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fdf9815c860 msgr2=0x7fdf98160ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-05T18:56:40.208 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:40.196+0000 7fdf977fe700 1 --2- 172.21.15.46:0/2672677878 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fdf9815c860 0x7fdf98160ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:40.209 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:40.196+0000 7fdf977fe700 1 -- 172.21.15.46:0/2672677878 >> v2:172.21.15.73:3300/0 conn(0x7fdf9806a340 msgr2=0x7fdf980b13f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-05T18:56:40.209 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:40.196+0000 7fdf977fe700 1 --2- 172.21.15.46:0/2672677878 >> v2:172.21.15.73:3300/0 conn(0x7fdf9806a340 0x7fdf980b13f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:40.209 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:40.196+0000 7fdf977fe700 1 -- 172.21.15.46:0/2672677878 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdf980ce870 con 0x7fdf980715c0 2023-07-05T18:56:40.209 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:40.196+0000 7fdf977fe700 1 --2- 172.21.15.46:0/2672677878 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fdf980715c0 0x7fdf98069e00 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fdf980cd5d0 tx=0x7fdf80009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fbcbec3ba2d8d1c3 server_cookie=0 in_seq=0 out_seq=0 2023-07-05T18:56:40.209 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:40.196+0000 7fdf96ffd700 1 -- 172.21.15.46:0/2672677878 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf80011830 con 0x7fdf980715c0 2023-07-05T18:56:40.209 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:40.196+0000 7fdf96ffd700 1 -- 172.21.15.46:0/2672677878 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdf80011990 con 0x7fdf980715c0 2023-07-05T18:56:40.209 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:40.196+0000 7fdf96ffd700 1 -- 172.21.15.46:0/2672677878 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf80011d20 con 0x7fdf980715c0 2023-07-05T18:56:40.209 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:40.196+0000 7fdf9e4f2700 1 -- 172.21.15.46:0/2672677878 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fdf980715c0 msgr2=0x7fdf98069e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:56:40.210 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:40.196+0000 7fdf9e4f2700 1 --2- 172.21.15.46:0/2672677878 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fdf980715c0 0x7fdf98069e00 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fdf980cd5d0 tx=0x7fdf80009bd0 comp rx=0 tx=0).stop 2023-07-05T18:56:40.210 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:40.197+0000 7fdf9e4f2700 1 -- 172.21.15.46:0/2672677878 shutdown_connections 2023-07-05T18:56:40.210 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:40.197+0000 7fdf9e4f2700 1 --2- 172.21.15.46:0/2672677878 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fdf9815c860 0x7fdf98160ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:40.210 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:40.197+0000 7fdf9e4f2700 1 --2- 172.21.15.46:0/2672677878 >> v2:172.21.15.73:3300/0 conn(0x7fdf9806a340 0x7fdf980b13f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:40.210 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:40.197+0000 7fdf9e4f2700 1 --2- 172.21.15.46:0/2672677878 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fdf980715c0 0x7fdf98069e00 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:40.210 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:40.197+0000 7fdf9e4f2700 1 -- 172.21.15.46:0/2672677878 >> 172.21.15.46:0/2672677878 conn(0x7fdf9806bba0 msgr2=0x7fdf980cc3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-05T18:56:40.210 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:40.197+0000 7fdf9e4f2700 1 -- 172.21.15.46:0/2672677878 shutdown_connections 2023-07-05T18:56:40.211 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:40.197+0000 7fdf9e4f2700 1 -- 172.21.15.46:0/2672677878 wait complete. 2023-07-05T18:56:40.211 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:40.198+0000 7fdf9e4f2700 1 Processor -- start 2023-07-05T18:56:40.211 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:40.198+0000 7fdf9e4f2700 1 -- start start 2023-07-05T18:56:40.211 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:40.199+0000 7fdf9e4f2700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fdf9806a340 0x7fdf9814f590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:56:40.211 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:40.199+0000 7fdf9e4f2700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fdf980715c0 0x7fdf980b1030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:56:40.211 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:40.199+0000 7fdf9e4f2700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fdf9815c860 0x7fdf980b1570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:56:40.211 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:40.199+0000 7fdf9e4f2700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf980c4400 con 0x7fdf9815c860 2023-07-05T18:56:40.211 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:40.199+0000 7fdf9e4f2700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf980aeac0 con 0x7fdf980715c0 2023-07-05T18:56:40.212 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:40.199+0000 7fdf9e4f2700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdf980aed60 con 0x7fdf9806a340 2023-07-05T18:56:40.212 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:40.199+0000 7fdf9ca8f700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fdf9815c860 0x7fdf980b1570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:56:40.212 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:40.199+0000 7fdf9ca8f700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fdf9815c860 0x7fdf980b1570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:58598/0 (socket says 172.21.15.46:58598) 2023-07-05T18:56:40.212 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:40.199+0000 7fdf9ca8f700 1 -- 172.21.15.46:0/3331290880 learned_addr learned my addr 172.21.15.46:0/3331290880 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-07-05T18:56:40.212 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:40.199+0000 7fdf97fff700 1 --2- 172.21.15.46:0/3331290880 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fdf9806a340 0x7fdf9814f590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:56:40.212 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:40.199+0000 7fdf977fe700 1 --2- 172.21.15.46:0/3331290880 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fdf980715c0 0x7fdf980b1030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:56:40.212 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:40.199+0000 7fdf9ca8f700 1 -- 172.21.15.46:0/3331290880 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fdf9806a340 msgr2=0x7fdf9814f590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:56:40.213 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:40.199+0000 7fdf9ca8f700 1 --2- 172.21.15.46:0/3331290880 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fdf9806a340 0x7fdf9814f590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:40.213 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:40.199+0000 7fdf9ca8f700 1 -- 172.21.15.46:0/3331290880 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fdf980715c0 msgr2=0x7fdf980b1030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:56:40.213 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:40.199+0000 7fdf9ca8f700 1 --2- 172.21.15.46:0/3331290880 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fdf980715c0 0x7fdf980b1030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:40.213 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:40.199+0000 7fdf9ca8f700 1 -- 172.21.15.46:0/3331290880 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdf80009550 con 0x7fdf9815c860 2023-07-05T18:56:40.213 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:40.199+0000 7fdf9ca8f700 1 --2- 172.21.15.46:0/3331290880 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fdf9815c860 0x7fdf980b1570 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fdf9000efc0 tx=0x7fdf9000c0c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-05T18:56:40.213 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:40.199+0000 7fdf94ff9700 1 -- 172.21.15.46:0/3331290880 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf9000cad0 con 0x7fdf9815c860 2023-07-05T18:56:40.213 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:40.200+0000 7fdf94ff9700 1 -- 172.21.15.46:0/3331290880 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdf9000f040 con 0x7fdf9815c860 2023-07-05T18:56:40.214 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:40.200+0000 7fdf9e4f2700 1 -- 172.21.15.46:0/3331290880 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdf9814fe70 con 0x7fdf9815c860 2023-07-05T18:56:40.214 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:40.200+0000 7fdf94ff9700 1 -- 172.21.15.46:0/3331290880 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf9000ce70 con 0x7fdf9815c860 2023-07-05T18:56:40.214 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:40.200+0000 7fdf9e4f2700 1 -- 172.21.15.46:0/3331290880 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdf98150430 con 0x7fdf9815c860 2023-07-05T18:56:40.214 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:40.201+0000 7fdf9e4f2700 1 -- 172.21.15.46:0/3331290880 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdf98067e40 con 0x7fdf9815c860 2023-07-05T18:56:40.214 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:40.201+0000 7fdf94ff9700 1 -- 172.21.15.46:0/3331290880 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fdf90014480 con 0x7fdf9815c860 2023-07-05T18:56:40.214 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:40.201+0000 7fdf94ff9700 1 --2- 172.21.15.46:0/3331290880 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7fdf7806ace0 0x7fdf7806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:56:40.214 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:40.201+0000 7fdf94ff9700 1 -- 172.21.15.46:0/3331290880 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fdf90089cb0 con 0x7fdf9815c860 2023-07-05T18:56:40.214 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:40.202+0000 7fdf97fff700 1 --2- 172.21.15.46:0/3331290880 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7fdf7806ace0 0x7fdf7806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:56:40.215 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:40.202+0000 7fdf97fff700 1 --2- 172.21.15.46:0/3331290880 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7fdf7806ace0 0x7fdf7806d190 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fdf98151080 tx=0x7fdf88009210 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-05T18:56:40.215 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:40.206+0000 7fdf94ff9700 1 -- 172.21.15.46:0/3331290880 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fdf90054d70 con 0x7fdf9815c860 2023-07-05T18:56:40.409 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:40.404+0000 7fdf9e4f2700 1 -- 172.21.15.46:0/3331290880 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fdf980672e0 con 0x7fdf9815c860 2023-07-05T18:56:40.409 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:40.404+0000 7fdf94ff9700 1 -- 172.21.15.46:0/3331290880 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v21) v1 ==== 92+0+10 (secure 0 0 0) 0x7fdf90018020 con 0x7fdf9815c860 2023-07-05T18:56:40.410 INFO:teuthology.orchestra.run.smithi046.stdout:pg_num: 8 2023-07-05T18:56:40.412 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:40.406+0000 7fdf9e4f2700 1 -- 172.21.15.46:0/3331290880 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7fdf7806ace0 msgr2=0x7fdf7806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:56:40.412 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:40.406+0000 7fdf9e4f2700 1 --2- 172.21.15.46:0/3331290880 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7fdf7806ace0 0x7fdf7806d190 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fdf98151080 tx=0x7fdf88009210 comp rx=0 tx=0).stop 2023-07-05T18:56:40.412 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:40.406+0000 7fdf9e4f2700 1 -- 172.21.15.46:0/3331290880 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fdf9815c860 msgr2=0x7fdf980b1570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:56:40.412 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:40.406+0000 7fdf9e4f2700 1 --2- 172.21.15.46:0/3331290880 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fdf9815c860 0x7fdf980b1570 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fdf9000efc0 tx=0x7fdf9000c0c0 comp rx=0 tx=0).stop 2023-07-05T18:56:40.413 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:40.406+0000 7fdf9e4f2700 1 -- 172.21.15.46:0/3331290880 shutdown_connections 2023-07-05T18:56:40.413 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:40.406+0000 7fdf9e4f2700 1 --2- 172.21.15.46:0/3331290880 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7fdf7806ace0 0x7fdf7806d190 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:40.413 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:40.406+0000 7fdf9e4f2700 1 --2- 172.21.15.46:0/3331290880 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fdf9815c860 0x7fdf980b1570 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:40.413 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:40.406+0000 7fdf9e4f2700 1 --2- 172.21.15.46:0/3331290880 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fdf9806a340 0x7fdf9814f590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:40.413 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:40.406+0000 7fdf9e4f2700 1 --2- 172.21.15.46:0/3331290880 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fdf980715c0 0x7fdf980b1030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:40.413 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:40.406+0000 7fdf9e4f2700 1 -- 172.21.15.46:0/3331290880 >> 172.21.15.46:0/3331290880 conn(0x7fdf9806bba0 msgr2=0x7fdf9815b100 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-05T18:56:40.413 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:40.407+0000 7fdf9e4f2700 1 -- 172.21.15.46:0/3331290880 shutdown_connections 2023-07-05T18:56:40.414 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:40.407+0000 7fdf9e4f2700 1 -- 172.21.15.46:0/3331290880 wait complete. 2023-07-05T18:56:40.421 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-07-05T18:56:40.552 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:40.550+0000 7fa51d0e0700 1 Processor -- start 2023-07-05T18:56:40.553 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:40.550+0000 7fa51d0e0700 1 -- start start 2023-07-05T18:56:40.554 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:40.551+0000 7fa51d0e0700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fa5181594f0 0x7fa5180cd690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:56:40.555 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:40.551+0000 7fa51d0e0700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fa5180b1b00 0x7fa5180c9fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:56:40.555 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:40.551+0000 7fa51d0e0700 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa51815e040 con 0x7fa5180cdbd0 2023-07-05T18:56:40.555 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:40.551+0000 7fa51d0e0700 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa5180ce200 con 0x7fa5181594f0 2023-07-05T18:56:40.556 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:40.551+0000 7fa51d0e0700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa51815dbb0 con 0x7fa5180b1b00 2023-07-05T18:56:40.556 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:40.551+0000 7fa51659c700 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7fa5180cdbd0 0x7fa5180b13f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:57874/0 (socket says 172.21.15.46:57874) 2023-07-05T18:56:40.556 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:40.551+0000 7fa51659c700 1 -- 172.21.15.46:0/3360499497 learned_addr learned my addr 172.21.15.46:0/3360499497 (peer_addr_for_me v1:172.21.15.46:0/0) 2023-07-05T18:56:40.556 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:40.551+0000 7fa51759e700 1 --2- 172.21.15.46:0/3360499497 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fa5180b1b00 0x7fa5180c9fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:56:40.556 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:40.551+0000 7fa516d9d700 1 --2- 172.21.15.46:0/3360499497 >> v2:172.21.15.73:3300/0 conn(0x7fa5181594f0 0x7fa5180cd690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:56:40.556 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:40.551+0000 7fa515d9b700 1 -- 172.21.15.46:0/3360499497 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1183314445 0 0) 0x7fa51815e040 con 0x7fa5180cdbd0 2023-07-05T18:56:40.556 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:40.552+0000 7fa515d9b700 1 -- 172.21.15.46:0/3360499497 --> v1:172.21.15.46:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa5000057c0 con 0x7fa5180cdbd0 2023-07-05T18:56:40.557 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:40.552+0000 7fa51759e700 1 -- 172.21.15.46:0/3360499497 >> v2:172.21.15.73:3300/0 conn(0x7fa5181594f0 msgr2=0x7fa5180cd690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-05T18:56:40.557 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:40.552+0000 7fa51759e700 1 --2- 172.21.15.46:0/3360499497 >> v2:172.21.15.73:3300/0 conn(0x7fa5181594f0 0x7fa5180cd690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:40.557 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:40.552+0000 7fa51759e700 1 -- 172.21.15.46:0/3360499497 >> v1:172.21.15.46:6789/0 conn(0x7fa5180cdbd0 legacy=0x7fa5180b13f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:56:40.557 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:40.552+0000 7fa51759e700 1 -- 172.21.15.46:0/3360499497 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa5180cc1c0 con 0x7fa5180b1b00 2023-07-05T18:56:40.557 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:40.552+0000 7fa51759e700 1 --2- 172.21.15.46:0/3360499497 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fa5180b1b00 0x7fa5180c9fc0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fa510009d90 tx=0x7fa51000b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=bb79d09586f8eeb server_cookie=0 in_seq=0 out_seq=0 2023-07-05T18:56:40.557 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:40.552+0000 7fa515d9b700 1 -- 172.21.15.46:0/3360499497 <== mon.2 v2:172.21.15.73:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa51000e070 con 0x7fa5180b1b00 2023-07-05T18:56:40.557 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:40.552+0000 7fa515d9b700 1 -- 172.21.15.46:0/3360499497 <== mon.2 v2:172.21.15.73:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa51000bb20 con 0x7fa5180b1b00 2023-07-05T18:56:40.558 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:40.552+0000 7fa515d9b700 1 -- 172.21.15.46:0/3360499497 <== mon.2 v2:172.21.15.73:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa510012430 con 0x7fa5180b1b00 2023-07-05T18:56:40.558 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:40.552+0000 7fa51d0e0700 1 -- 172.21.15.46:0/3360499497 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fa5180b1b00 msgr2=0x7fa5180c9fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:56:40.558 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:40.553+0000 7fa51d0e0700 1 --2- 172.21.15.46:0/3360499497 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fa5180b1b00 0x7fa5180c9fc0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fa510009d90 tx=0x7fa51000b330 comp rx=0 tx=0).stop 2023-07-05T18:56:40.558 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:40.553+0000 7fa51d0e0700 1 -- 172.21.15.46:0/3360499497 shutdown_connections 2023-07-05T18:56:40.558 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:40.553+0000 7fa51d0e0700 1 --2- 172.21.15.46:0/3360499497 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fa5180b1b00 0x7fa5180c9fc0 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:40.558 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:40.553+0000 7fa51d0e0700 1 --2- 172.21.15.46:0/3360499497 >> v2:172.21.15.73:3300/0 conn(0x7fa5181594f0 0x7fa5180cd690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:40.558 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:40.553+0000 7fa51d0e0700 1 -- 172.21.15.46:0/3360499497 >> 172.21.15.46:0/3360499497 conn(0x7fa51806bba0 msgr2=0x7fa5180cc3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-05T18:56:40.559 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:40.553+0000 7fa51d0e0700 1 -- 172.21.15.46:0/3360499497 shutdown_connections 2023-07-05T18:56:40.559 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:40.553+0000 7fa51d0e0700 1 -- 172.21.15.46:0/3360499497 wait complete. 2023-07-05T18:56:40.561 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:40.554+0000 7fa51d0e0700 1 Processor -- start 2023-07-05T18:56:40.561 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:40.554+0000 7fa51d0e0700 1 -- start start 2023-07-05T18:56:40.561 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:40.555+0000 7fa51d0e0700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa5180b1b00 0x7fa5180b3640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:56:40.561 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:40.555+0000 7fa51d0e0700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa5180cdbd0 0x7fa51815bb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:56:40.561 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:40.555+0000 7fa51d0e0700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fa5181594f0 0x7fa5180c55e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:56:40.562 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:40.555+0000 7fa51d0e0700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5180b0640 con 0x7fa5180b1b00 2023-07-05T18:56:40.562 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:40.555+0000 7fa51d0e0700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa518151d70 con 0x7fa5180cdbd0 2023-07-05T18:56:40.562 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:40.555+0000 7fa51d0e0700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa518152050 con 0x7fa5181594f0 2023-07-05T18:56:40.562 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:40.555+0000 7fa516d9d700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa5180b1b00 0x7fa5180b3640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:56:40.562 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:40.555+0000 7fa516d9d700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa5180b1b00 0x7fa5180b3640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:58608/0 (socket says 172.21.15.46:58608) 2023-07-05T18:56:40.562 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:40.555+0000 7fa516d9d700 1 -- 172.21.15.46:0/3936020269 learned_addr learned my addr 172.21.15.46:0/3936020269 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-07-05T18:56:40.563 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:40.555+0000 7fa51759e700 1 --2- 172.21.15.46:0/3936020269 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fa5181594f0 0x7fa5180c55e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:56:40.563 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:40.555+0000 7fa51659c700 1 --2- 172.21.15.46:0/3936020269 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa5180cdbd0 0x7fa51815bb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:56:40.563 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:40.555+0000 7fa516d9d700 1 -- 172.21.15.46:0/3936020269 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fa5181594f0 msgr2=0x7fa5180c55e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:56:40.563 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:40.555+0000 7fa516d9d700 1 --2- 172.21.15.46:0/3936020269 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fa5181594f0 0x7fa5180c55e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:40.563 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:40.555+0000 7fa516d9d700 1 -- 172.21.15.46:0/3936020269 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa5180cdbd0 msgr2=0x7fa51815bb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:56:40.563 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:40.555+0000 7fa516d9d700 1 --2- 172.21.15.46:0/3936020269 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa5180cdbd0 0x7fa51815bb40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:40.563 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:40.555+0000 7fa516d9d700 1 -- 172.21.15.46:0/3936020269 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa510009a70 con 0x7fa5180b1b00 2023-07-05T18:56:40.563 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:40.556+0000 7fa516d9d700 1 --2- 172.21.15.46:0/3936020269 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa5180b1b00 0x7fa5180b3640 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fa50c00e870 tx=0x7fa50c00eb80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-05T18:56:40.564 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:40.556+0000 7fa4ff7fe700 1 -- 172.21.15.46:0/3936020269 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa50c009590 con 0x7fa5180b1b00 2023-07-05T18:56:40.564 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:40.556+0000 7fa4ff7fe700 1 -- 172.21.15.46:0/3936020269 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa50c013680 con 0x7fa5180b1b00 2023-07-05T18:56:40.564 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:40.556+0000 7fa4ff7fe700 1 -- 172.21.15.46:0/3936020269 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa50c0139f0 con 0x7fa5180b1b00 2023-07-05T18:56:40.564 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:40.556+0000 7fa51d0e0700 1 -- 172.21.15.46:0/3936020269 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa518152330 con 0x7fa5180b1b00 2023-07-05T18:56:40.564 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:40.556+0000 7fa51d0e0700 1 -- 172.21.15.46:0/3936020269 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa51815c080 con 0x7fa5180b1b00 2023-07-05T18:56:40.564 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:40.557+0000 7fa51d0e0700 1 -- 172.21.15.46:0/3936020269 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa5180b0920 con 0x7fa5180b1b00 2023-07-05T18:56:40.564 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:40.557+0000 7fa4ff7fe700 1 -- 172.21.15.46:0/3936020269 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fa50c013b50 con 0x7fa5180b1b00 2023-07-05T18:56:40.565 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:40.558+0000 7fa4ff7fe700 1 --2- 172.21.15.46:0/3936020269 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7fa50406ace0 0x7fa50406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:56:40.565 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:40.558+0000 7fa4ff7fe700 1 -- 172.21.15.46:0/3936020269 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fa50c089280 con 0x7fa5180b1b00 2023-07-05T18:56:40.565 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:40.558+0000 7fa51659c700 1 --2- 172.21.15.46:0/3936020269 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7fa50406ace0 0x7fa50406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:56:40.565 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:40.558+0000 7fa51659c700 1 --2- 172.21.15.46:0/3936020269 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7fa50406ace0 0x7fa50406d190 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fa518071060 tx=0x7fa508007dc0 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-05T18:56:40.566 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:40.562+0000 7fa4ff7fe700 1 -- 172.21.15.46:0/3936020269 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fa50c057dc0 con 0x7fa5180b1b00 2023-07-05T18:56:40.759 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:40.757+0000 7fa51d0e0700 1 -- 172.21.15.46:0/3936020269 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fa51815c2a0 con 0x7fa5180b1b00 2023-07-05T18:56:40.760 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:40.758+0000 7fa4ff7fe700 1 -- 172.21.15.46:0/3936020269 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v21) v1 ==== 93+0+10 (secure 0 0 0) 0x7fa50c057950 con 0x7fa5180b1b00 2023-07-05T18:56:40.760 INFO:teuthology.orchestra.run.smithi046.stdout:pg_num: 1 2023-07-05T18:56:40.762 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:40.760+0000 7fa51d0e0700 1 -- 172.21.15.46:0/3936020269 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7fa50406ace0 msgr2=0x7fa50406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:56:40.762 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:40.760+0000 7fa51d0e0700 1 --2- 172.21.15.46:0/3936020269 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7fa50406ace0 0x7fa50406d190 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fa518071060 tx=0x7fa508007dc0 comp rx=0 tx=0).stop 2023-07-05T18:56:40.762 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:40.760+0000 7fa51d0e0700 1 -- 172.21.15.46:0/3936020269 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa5180b1b00 msgr2=0x7fa5180b3640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:56:40.762 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:40.760+0000 7fa51d0e0700 1 --2- 172.21.15.46:0/3936020269 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa5180b1b00 0x7fa5180b3640 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fa50c00e870 tx=0x7fa50c00eb80 comp rx=0 tx=0).stop 2023-07-05T18:56:40.762 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:40.760+0000 7fa51d0e0700 1 -- 172.21.15.46:0/3936020269 shutdown_connections 2023-07-05T18:56:40.763 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:40.760+0000 7fa51d0e0700 1 --2- 172.21.15.46:0/3936020269 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7fa50406ace0 0x7fa50406d190 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:40.763 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:40.760+0000 7fa51d0e0700 1 --2- 172.21.15.46:0/3936020269 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fa5181594f0 0x7fa5180c55e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:40.763 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:40.760+0000 7fa51d0e0700 1 --2- 172.21.15.46:0/3936020269 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa5180b1b00 0x7fa5180b3640 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:40.763 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:40.760+0000 7fa51d0e0700 1 --2- 172.21.15.46:0/3936020269 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa5180cdbd0 0x7fa51815bb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:40.763 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:40.760+0000 7fa51d0e0700 1 -- 172.21.15.46:0/3936020269 >> 172.21.15.46:0/3936020269 conn(0x7fa51806bba0 msgr2=0x7fa51815cb00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-05T18:56:40.763 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:40.760+0000 7fa51d0e0700 1 -- 172.21.15.46:0/3936020269 shutdown_connections 2023-07-05T18:56:40.763 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:40.760+0000 7fa51d0e0700 1 -- 172.21.15.46:0/3936020269 wait complete. 2023-07-05T18:56:40.775 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-07-05T18:56:40.904 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:40.902+0000 7fa06cb72700 1 Processor -- start 2023-07-05T18:56:40.904 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:40.902+0000 7fa06cb72700 1 -- start start 2023-07-05T18:56:40.905 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:40.903+0000 7fa06cb72700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fa06815c860 0x7fa068160ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:56:40.906 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:40.903+0000 7fa06cb72700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fa06806a510 0x7fa06806c1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:56:40.906 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:40.903+0000 7fa06cb72700 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa0680ce640 con 0x7fa0680715c0 2023-07-05T18:56:40.906 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:40.903+0000 7fa06cb72700 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa0681611e0 con 0x7fa06806a510 2023-07-05T18:56:40.906 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:40.903+0000 7fa06cb72700 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa0680ce870 con 0x7fa06815c860 2023-07-05T18:56:40.906 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:40.903+0000 7fa066d9d700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fa06806a510 0x7fa06806c1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:56:40.906 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:40.903+0000 7fa066d9d700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fa06806a510 0x7fa06806c1f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:58620/0 (socket says 172.21.15.46:58620) 2023-07-05T18:56:40.907 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:40.903+0000 7fa066d9d700 1 -- 172.21.15.46:0/477205159 learned_addr learned my addr 172.21.15.46:0/477205159 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-07-05T18:56:40.907 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:40.903+0000 7fa066d9d700 1 -- 172.21.15.46:0/477205159 >> v2:172.21.15.73:3300/0 conn(0x7fa06815c860 msgr2=0x7fa068160ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-05T18:56:40.907 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:40.903+0000 7fa066d9d700 1 --2- 172.21.15.46:0/477205159 >> v2:172.21.15.73:3300/0 conn(0x7fa06815c860 0x7fa068160ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:40.907 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:40.903+0000 7fa066d9d700 1 -- 172.21.15.46:0/477205159 >> v1:172.21.15.73:6789/0 conn(0x7fa0680715c0 legacy=0x7fa068069e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-05T18:56:40.907 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:40.903+0000 7fa066d9d700 1 -- 172.21.15.46:0/477205159 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa0680ceb50 con 0x7fa06806a510 2023-07-05T18:56:40.907 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:40.903+0000 7fa066d9d700 1 --2- 172.21.15.46:0/477205159 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa06806a510 0x7fa06806c1f0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fa068066b90 tx=0x7fa06000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=433a2bf4b3501dbb server_cookie=0 in_seq=0 out_seq=0 2023-07-05T18:56:40.907 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:40.904+0000 7fa06559a700 1 -- 172.21.15.46:0/477205159 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa06000e070 con 0x7fa06806a510 2023-07-05T18:56:40.908 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:40.904+0000 7fa06559a700 1 -- 172.21.15.46:0/477205159 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa060003a20 con 0x7fa06806a510 2023-07-05T18:56:40.908 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:40.904+0000 7fa06559a700 1 -- 172.21.15.46:0/477205159 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa060003dd0 con 0x7fa06806a510 2023-07-05T18:56:40.910 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:40.904+0000 7fa06cb72700 1 -- 172.21.15.46:0/477205159 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa06806a510 msgr2=0x7fa06806c1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:56:40.910 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:40.904+0000 7fa06cb72700 1 --2- 172.21.15.46:0/477205159 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa06806a510 0x7fa06806c1f0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fa068066b90 tx=0x7fa06000b330 comp rx=0 tx=0).stop 2023-07-05T18:56:40.911 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:40.904+0000 7fa06cb72700 1 -- 172.21.15.46:0/477205159 shutdown_connections 2023-07-05T18:56:40.911 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:40.904+0000 7fa06cb72700 1 --2- 172.21.15.46:0/477205159 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa06806a510 0x7fa06806c1f0 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:40.911 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:40.904+0000 7fa06cb72700 1 --2- 172.21.15.46:0/477205159 >> v2:172.21.15.73:3300/0 conn(0x7fa06815c860 0x7fa068160ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:40.911 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:40.904+0000 7fa06cb72700 1 -- 172.21.15.46:0/477205159 >> 172.21.15.46:0/477205159 conn(0x7fa06806bba0 msgr2=0x7fa0680cc3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-05T18:56:40.912 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:40.904+0000 7fa06cb72700 1 -- 172.21.15.46:0/477205159 shutdown_connections 2023-07-05T18:56:40.912 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:40.904+0000 7fa06cb72700 1 -- 172.21.15.46:0/477205159 wait complete. 2023-07-05T18:56:40.912 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:40.906+0000 7fa06cb72700 1 Processor -- start 2023-07-05T18:56:40.912 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:40.906+0000 7fa06cb72700 1 -- start start 2023-07-05T18:56:40.912 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:40.906+0000 7fa06cb72700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fa06806a510 0x7fa068153b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:56:40.912 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:40.906+0000 7fa06cb72700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa0680715c0 0x7fa0681e8090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:56:40.912 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:40.906+0000 7fa06cb72700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa06815c860 0x7fa0681e6910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:56:40.913 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:40.906+0000 7fa06cb72700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0681e8a20 con 0x7fa06815c860 2023-07-05T18:56:40.913 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:40.906+0000 7fa06cb72700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0681e6480 con 0x7fa0680715c0 2023-07-05T18:56:40.913 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:40.906+0000 7fa06cb72700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa0681e6150 con 0x7fa06806a510 2023-07-05T18:56:40.913 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:40.906+0000 7fa066d9d700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa06815c860 0x7fa0681e6910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:56:40.913 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:40.906+0000 7fa06659c700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fa06806a510 0x7fa068153b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:56:40.914 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:40.906+0000 7fa066d9d700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa06815c860 0x7fa0681e6910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:58626/0 (socket says 172.21.15.46:58626) 2023-07-05T18:56:40.914 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:40.907+0000 7fa066d9d700 1 -- 172.21.15.46:0/2975757641 learned_addr learned my addr 172.21.15.46:0/2975757641 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-07-05T18:56:40.914 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:40.907+0000 7fa065d9b700 1 --2- 172.21.15.46:0/2975757641 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa0680715c0 0x7fa0681e8090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:56:40.914 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:40.907+0000 7fa066d9d700 1 -- 172.21.15.46:0/2975757641 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fa06806a510 msgr2=0x7fa068153b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:56:40.914 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:40.907+0000 7fa066d9d700 1 --2- 172.21.15.46:0/2975757641 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fa06806a510 0x7fa068153b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:40.914 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:40.907+0000 7fa066d9d700 1 -- 172.21.15.46:0/2975757641 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa0680715c0 msgr2=0x7fa0681e8090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:56:40.915 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:40.907+0000 7fa066d9d700 1 --2- 172.21.15.46:0/2975757641 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa0680715c0 0x7fa0681e8090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:40.915 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:40.907+0000 7fa066d9d700 1 -- 172.21.15.46:0/2975757641 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa060009b30 con 0x7fa06815c860 2023-07-05T18:56:40.915 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:40.907+0000 7fa066d9d700 1 --2- 172.21.15.46:0/2975757641 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa06815c860 0x7fa0681e6910 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fa060015040 tx=0x7fa060004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-05T18:56:40.915 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:40.907+0000 7fa056ffd700 1 -- 172.21.15.46:0/2975757641 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0600094d0 con 0x7fa06815c860 2023-07-05T18:56:40.915 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:40.907+0000 7fa056ffd700 1 -- 172.21.15.46:0/2975757641 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa060004240 con 0x7fa06815c860 2023-07-05T18:56:40.915 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:40.907+0000 7fa06cb72700 1 -- 172.21.15.46:0/2975757641 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa0681e8c70 con 0x7fa06815c860 2023-07-05T18:56:40.915 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:40.907+0000 7fa056ffd700 1 -- 172.21.15.46:0/2975757641 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0600045f0 con 0x7fa06815c860 2023-07-05T18:56:40.916 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:40.907+0000 7fa06cb72700 1 -- 172.21.15.46:0/2975757641 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa0681e8f50 con 0x7fa06815c860 2023-07-05T18:56:40.916 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:40.908+0000 7fa06cb72700 1 -- 172.21.15.46:0/2975757641 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa0680672e0 con 0x7fa06815c860 2023-07-05T18:56:40.917 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:40.909+0000 7fa056ffd700 1 -- 172.21.15.46:0/2975757641 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fa060019070 con 0x7fa06815c860 2023-07-05T18:56:40.917 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:40.909+0000 7fa056ffd700 1 --2- 172.21.15.46:0/2975757641 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7fa04806ace0 0x7fa04806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:56:40.917 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:40.909+0000 7fa056ffd700 1 -- 172.21.15.46:0/2975757641 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fa06008a330 con 0x7fa06815c860 2023-07-05T18:56:40.917 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:40.909+0000 7fa06659c700 1 --2- 172.21.15.46:0/2975757641 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7fa04806ace0 0x7fa04806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:56:40.917 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:40.910+0000 7fa06659c700 1 --2- 172.21.15.46:0/2975757641 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7fa04806ace0 0x7fa04806d190 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fa0680b2310 tx=0x7fa05c009110 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-05T18:56:40.917 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:40.914+0000 7fa056ffd700 1 -- 172.21.15.46:0/2975757641 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fa060058e80 con 0x7fa06815c860 2023-07-05T18:56:41.111 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:41.109+0000 7fa06cb72700 1 -- 172.21.15.46:0/2975757641 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fa0680b58f0 con 0x7fa06815c860 2023-07-05T18:56:41.112 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:41.110+0000 7fa056ffd700 1 -- 172.21.15.46:0/2975757641 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v21) v1 ==== 104+0+11 (secure 0 0 0) 0x7fa060007310 con 0x7fa06815c860 2023-07-05T18:56:41.112 INFO:teuthology.orchestra.run.smithi046.stdout:pg_num: 32 2023-07-05T18:56:41.114 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:41.112+0000 7fa06cb72700 1 -- 172.21.15.46:0/2975757641 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7fa04806ace0 msgr2=0x7fa04806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:56:41.114 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:41.112+0000 7fa06cb72700 1 --2- 172.21.15.46:0/2975757641 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7fa04806ace0 0x7fa04806d190 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fa0680b2310 tx=0x7fa05c009110 comp rx=0 tx=0).stop 2023-07-05T18:56:41.114 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:41.112+0000 7fa06cb72700 1 -- 172.21.15.46:0/2975757641 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa06815c860 msgr2=0x7fa0681e6910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:56:41.115 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:41.112+0000 7fa06cb72700 1 --2- 172.21.15.46:0/2975757641 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa06815c860 0x7fa0681e6910 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fa060015040 tx=0x7fa060004ad0 comp rx=0 tx=0).stop 2023-07-05T18:56:41.115 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:41.112+0000 7fa06cb72700 1 -- 172.21.15.46:0/2975757641 shutdown_connections 2023-07-05T18:56:41.115 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:41.112+0000 7fa06cb72700 1 --2- 172.21.15.46:0/2975757641 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7fa04806ace0 0x7fa04806d190 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:41.115 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:41.112+0000 7fa06cb72700 1 --2- 172.21.15.46:0/2975757641 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa06815c860 0x7fa0681e6910 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:41.115 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:41.112+0000 7fa06cb72700 1 --2- 172.21.15.46:0/2975757641 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fa06806a510 0x7fa068153b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:41.115 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:41.112+0000 7fa06cb72700 1 --2- 172.21.15.46:0/2975757641 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa0680715c0 0x7fa0681e8090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:41.116 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:41.112+0000 7fa06cb72700 1 -- 172.21.15.46:0/2975757641 >> 172.21.15.46:0/2975757641 conn(0x7fa06806bba0 msgr2=0x7fa06815b060 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-05T18:56:41.116 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:41.112+0000 7fa06cb72700 1 -- 172.21.15.46:0/2975757641 shutdown_connections 2023-07-05T18:56:41.116 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:41.112+0000 7fa06cb72700 1 -- 172.21.15.46:0/2975757641 wait complete. 2023-07-05T18:56:41.126 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-07-05T18:56:41.256 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:41.254+0000 7fb96056a700 1 Processor -- start 2023-07-05T18:56:41.256 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:41.254+0000 7fb96056a700 1 -- start start 2023-07-05T18:56:41.258 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:41.255+0000 7fb96056a700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fb9580af160 0x7fb9580d0a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:56:41.259 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:41.255+0000 7fb96056a700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fb9580cf190 0x7fb9580b0f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:56:41.259 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:41.255+0000 7fb96056a700 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb9580b0ae0 con 0x7fb9580af530 2023-07-05T18:56:41.259 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:41.255+0000 7fb96056a700 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb9580d15f0 con 0x7fb9580cf190 2023-07-05T18:56:41.259 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:41.255+0000 7fb96056a700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb95815ab90 con 0x7fb9580af160 2023-07-05T18:56:41.259 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:41.255+0000 7fb95db05700 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7fb9580af530 0x7fb9580cea80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:57904/0 (socket says 172.21.15.46:57904) 2023-07-05T18:56:41.260 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:41.255+0000 7fb95db05700 1 -- 172.21.15.46:0/2651052561 learned_addr learned my addr 172.21.15.46:0/2651052561 (peer_addr_for_me v1:172.21.15.46:0/0) 2023-07-05T18:56:41.260 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:41.255+0000 7fb95e306700 1 --2- 172.21.15.46:0/2651052561 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fb9580af160 0x7fb9580d0a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:56:41.260 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:41.255+0000 7fb95eb07700 1 --2- 172.21.15.46:0/2651052561 >> v2:172.21.15.73:3300/0 conn(0x7fb9580cf190 0x7fb9580b0f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:56:41.260 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:41.255+0000 7fb95d304700 1 -- 172.21.15.46:0/2651052561 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2351771977 0 0) 0x7fb9580b0ae0 con 0x7fb9580af530 2023-07-05T18:56:41.261 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:41.255+0000 7fb95d304700 1 -- 172.21.15.46:0/2651052561 --> v1:172.21.15.46:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb9440035b0 con 0x7fb9580af530 2023-07-05T18:56:41.261 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:41.256+0000 7fb95e306700 1 -- 172.21.15.46:0/2651052561 >> v2:172.21.15.73:3300/0 conn(0x7fb9580cf190 msgr2=0x7fb9580b0f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-05T18:56:41.261 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:41.256+0000 7fb95e306700 1 --2- 172.21.15.46:0/2651052561 >> v2:172.21.15.73:3300/0 conn(0x7fb9580cf190 0x7fb9580b0f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:41.261 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:41.256+0000 7fb95e306700 1 -- 172.21.15.46:0/2651052561 >> v1:172.21.15.46:6789/0 conn(0x7fb9580af530 legacy=0x7fb9580cea80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:56:41.262 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:41.256+0000 7fb95e306700 1 -- 172.21.15.46:0/2651052561 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb9580d1310 con 0x7fb9580af160 2023-07-05T18:56:41.262 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:41.256+0000 7fb95eb07700 1 --2- 172.21.15.46:0/2651052561 >> v2:172.21.15.73:3300/0 conn(0x7fb9580cf190 0x7fb9580b0f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-05T18:56:41.262 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:41.256+0000 7fb95e306700 1 --2- 172.21.15.46:0/2651052561 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fb9580af160 0x7fb9580d0a00 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fb948009840 tx=0x7fb948009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b799dc18ce1d33bf server_cookie=0 in_seq=0 out_seq=0 2023-07-05T18:56:41.263 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:41.256+0000 7fb95d304700 1 -- 172.21.15.46:0/2651052561 <== mon.2 v2:172.21.15.73:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb948011830 con 0x7fb9580af160 2023-07-05T18:56:41.263 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:41.256+0000 7fb95d304700 1 -- 172.21.15.46:0/2651052561 <== mon.2 v2:172.21.15.73:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb948011990 con 0x7fb9580af160 2023-07-05T18:56:41.263 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:41.256+0000 7fb95d304700 1 -- 172.21.15.46:0/2651052561 <== mon.2 v2:172.21.15.73:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb948011d20 con 0x7fb9580af160 2023-07-05T18:56:41.263 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:41.256+0000 7fb96056a700 1 -- 172.21.15.46:0/2651052561 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fb9580af160 msgr2=0x7fb9580d0a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:56:41.263 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:41.256+0000 7fb96056a700 1 --2- 172.21.15.46:0/2651052561 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fb9580af160 0x7fb9580d0a00 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fb948009840 tx=0x7fb948009b50 comp rx=0 tx=0).stop 2023-07-05T18:56:41.267 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:41.257+0000 7fb96056a700 1 -- 172.21.15.46:0/2651052561 shutdown_connections 2023-07-05T18:56:41.267 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:41.257+0000 7fb96056a700 1 --2- 172.21.15.46:0/2651052561 >> v2:172.21.15.73:3300/0 conn(0x7fb9580cf190 0x7fb9580b0f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:41.267 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:41.257+0000 7fb96056a700 1 --2- 172.21.15.46:0/2651052561 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fb9580af160 0x7fb9580d0a00 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:41.267 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:41.257+0000 7fb96056a700 1 -- 172.21.15.46:0/2651052561 >> 172.21.15.46:0/2651052561 conn(0x7fb9580664b0 msgr2=0x7fb958099de0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-05T18:56:41.268 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:41.257+0000 7fb96056a700 1 -- 172.21.15.46:0/2651052561 shutdown_connections 2023-07-05T18:56:41.268 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:41.257+0000 7fb96056a700 1 -- 172.21.15.46:0/2651052561 wait complete. 2023-07-05T18:56:41.270 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:41.258+0000 7fb96056a700 1 Processor -- start 2023-07-05T18:56:41.270 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:41.258+0000 7fb96056a700 1 -- start start 2023-07-05T18:56:41.270 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:41.259+0000 7fb96056a700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb9580af160 0x7fb9581e3d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:56:41.271 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:41.259+0000 7fb96056a700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fb9580af530 0x7fb95814ef70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:56:41.271 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:41.259+0000 7fb96056a700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb9580cf190 0x7fb958157390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:56:41.271 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:41.259+0000 7fb96056a700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9581e4840 con 0x7fb9580cf190 2023-07-05T18:56:41.271 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:41.259+0000 7fb96056a700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9581e42c0 con 0x7fb9580af160 2023-07-05T18:56:41.271 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:41.259+0000 7fb96056a700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb9580c9850 con 0x7fb9580af530 2023-07-05T18:56:41.271 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:41.259+0000 7fb95eb07700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb9580cf190 0x7fb958157390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:56:41.271 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:41.259+0000 7fb95eb07700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb9580cf190 0x7fb958157390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:58640/0 (socket says 172.21.15.46:58640) 2023-07-05T18:56:41.272 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:41.259+0000 7fb95eb07700 1 -- 172.21.15.46:0/1774314144 learned_addr learned my addr 172.21.15.46:0/1774314144 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-07-05T18:56:41.272 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:41.259+0000 7fb95db05700 1 --2- 172.21.15.46:0/1774314144 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fb9580af530 0x7fb95814ef70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:56:41.272 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:41.259+0000 7fb95e306700 1 --2- 172.21.15.46:0/1774314144 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb9580af160 0x7fb9581e3d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:56:41.272 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:41.259+0000 7fb95eb07700 1 -- 172.21.15.46:0/1774314144 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fb9580af530 msgr2=0x7fb95814ef70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:56:41.272 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:41.259+0000 7fb95eb07700 1 --2- 172.21.15.46:0/1774314144 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fb9580af530 0x7fb95814ef70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:41.272 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:41.259+0000 7fb95eb07700 1 -- 172.21.15.46:0/1774314144 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb9580af160 msgr2=0x7fb9581e3d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:56:41.272 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:41.259+0000 7fb95eb07700 1 --2- 172.21.15.46:0/1774314144 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb9580af160 0x7fb9581e3d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:41.273 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:41.259+0000 7fb95eb07700 1 -- 172.21.15.46:0/1774314144 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb950009a70 con 0x7fb9580cf190 2023-07-05T18:56:41.273 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:41.259+0000 7fb95eb07700 1 --2- 172.21.15.46:0/1774314144 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb9580cf190 0x7fb958157390 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fb950009eb0 tx=0x7fb950009f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-05T18:56:41.273 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:41.259+0000 7fb94effd700 1 -- 172.21.15.46:0/1774314144 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb950009d50 con 0x7fb9580cf190 2023-07-05T18:56:41.273 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:41.259+0000 7fb94effd700 1 -- 172.21.15.46:0/1774314144 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb95000f040 con 0x7fb9580cf190 2023-07-05T18:56:41.273 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:41.260+0000 7fb96056a700 1 -- 172.21.15.46:0/1774314144 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb9480094a0 con 0x7fb9580cf190 2023-07-05T18:56:41.273 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:41.260+0000 7fb94effd700 1 -- 172.21.15.46:0/1774314144 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb950014480 con 0x7fb9580cf190 2023-07-05T18:56:41.273 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:41.260+0000 7fb96056a700 1 -- 172.21.15.46:0/1774314144 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb9580c9e10 con 0x7fb9580cf190 2023-07-05T18:56:41.273 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:41.260+0000 7fb96056a700 1 -- 172.21.15.46:0/1774314144 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb9580d0080 con 0x7fb9580cf190 2023-07-05T18:56:41.274 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:41.261+0000 7fb94effd700 1 -- 172.21.15.46:0/1774314144 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fb9500145e0 con 0x7fb9580cf190 2023-07-05T18:56:41.274 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:41.261+0000 7fb94effd700 1 --2- 172.21.15.46:0/1774314144 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7fb93c06ace0 0x7fb93c06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:56:41.274 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:41.261+0000 7fb94effd700 1 -- 172.21.15.46:0/1774314144 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fb95008a2f0 con 0x7fb9580cf190 2023-07-05T18:56:41.274 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:41.262+0000 7fb95e306700 1 --2- 172.21.15.46:0/1774314144 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7fb93c06ace0 0x7fb93c06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:56:41.274 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:41.262+0000 7fb95e306700 1 --2- 172.21.15.46:0/1774314144 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7fb93c06ace0 0x7fb93c06d190 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fb948009fd0 tx=0x7fb94801c040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-05T18:56:41.274 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:41.266+0000 7fb94effd700 1 -- 172.21.15.46:0/1774314144 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fb950058d90 con 0x7fb9580cf190 2023-07-05T18:56:41.470 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:41.468+0000 7fb96056a700 1 -- 172.21.15.46:0/1774314144 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fb9580672e0 con 0x7fb9580cf190 2023-07-05T18:56:41.470 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:41.468+0000 7fb94effd700 1 -- 172.21.15.46:0/1774314144 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v21) v1 ==== 100+0+11 (secure 0 0 0) 0x7fb950058920 con 0x7fb9580cf190 2023-07-05T18:56:41.470 INFO:teuthology.orchestra.run.smithi046.stdout:pg_num: 64 2023-07-05T18:56:41.472 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:41.470+0000 7fb96056a700 1 -- 172.21.15.46:0/1774314144 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7fb93c06ace0 msgr2=0x7fb93c06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:56:41.472 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:41.470+0000 7fb96056a700 1 --2- 172.21.15.46:0/1774314144 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7fb93c06ace0 0x7fb93c06d190 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fb948009fd0 tx=0x7fb94801c040 comp rx=0 tx=0).stop 2023-07-05T18:56:41.473 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:41.470+0000 7fb96056a700 1 -- 172.21.15.46:0/1774314144 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb9580cf190 msgr2=0x7fb958157390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:56:41.473 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:41.470+0000 7fb96056a700 1 --2- 172.21.15.46:0/1774314144 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb9580cf190 0x7fb958157390 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fb950009eb0 tx=0x7fb950009f90 comp rx=0 tx=0).stop 2023-07-05T18:56:41.473 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:41.470+0000 7fb96056a700 1 -- 172.21.15.46:0/1774314144 shutdown_connections 2023-07-05T18:56:41.473 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:41.470+0000 7fb96056a700 1 --2- 172.21.15.46:0/1774314144 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7fb93c06ace0 0x7fb93c06d190 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:41.473 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:41.470+0000 7fb96056a700 1 --2- 172.21.15.46:0/1774314144 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb9580cf190 0x7fb958157390 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:41.473 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:41.470+0000 7fb96056a700 1 --2- 172.21.15.46:0/1774314144 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb9580af160 0x7fb9581e3d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:41.473 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:41.470+0000 7fb96056a700 1 --2- 172.21.15.46:0/1774314144 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fb9580af530 0x7fb95814ef70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:41.474 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:41.470+0000 7fb96056a700 1 -- 172.21.15.46:0/1774314144 >> 172.21.15.46:0/1774314144 conn(0x7fb9580664b0 msgr2=0x7fb95815a020 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-05T18:56:41.474 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:41.470+0000 7fb96056a700 1 -- 172.21.15.46:0/1774314144 shutdown_connections 2023-07-05T18:56:41.474 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:41.470+0000 7fb96056a700 1 -- 172.21.15.46:0/1774314144 wait complete. 2023-07-05T18:56:41.485 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-05T18:56:41.610 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:41.607+0000 7f703479c700 1 Processor -- start 2023-07-05T18:56:41.610 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:41.607+0000 7f703479c700 1 -- start start 2023-07-05T18:56:41.612 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:41.608+0000 7f703479c700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f702c15a610 0x7f702c0b1ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:56:41.612 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:41.608+0000 7f703479c700 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f702c0b0df0 con 0x7f702c0ce6d0 2023-07-05T18:56:41.612 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:41.608+0000 7f703479c700 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f702c0ada20 con 0x7f702c0afad0 2023-07-05T18:56:41.612 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:41.608+0000 7f703479c700 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f702c0b2410 con 0x7f702c15a610 2023-07-05T18:56:41.612 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:41.609+0000 7f7032538700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f702c15a610 0x7f702c0b1ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:56:41.612 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:41.609+0000 7f7031d37700 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7f702c0ce6d0 0x7f702c0affd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:57916/0 (socket says 172.21.15.46:57916) 2023-07-05T18:56:41.613 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:41.609+0000 7f7031d37700 1 -- 172.21.15.46:0/2335536485 learned_addr learned my addr 172.21.15.46:0/2335536485 (peer_addr_for_me v1:172.21.15.46:0/0) 2023-07-05T18:56:41.613 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:41.609+0000 7f7032538700 1 -- 172.21.15.46:0/2335536485 >> v1:172.21.15.73:6789/0 conn(0x7f702c0afad0 legacy=0x7f702c0b06e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:56:41.613 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:41.609+0000 7f7032538700 1 -- 172.21.15.46:0/2335536485 >> v1:172.21.15.46:6789/0 conn(0x7f702c0ce6d0 legacy=0x7f702c0affd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:56:41.613 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:41.609+0000 7f7032538700 1 -- 172.21.15.46:0/2335536485 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f702c0add00 con 0x7f702c15a610 2023-07-05T18:56:41.613 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:41.609+0000 7f7032538700 1 --2- 172.21.15.46:0/2335536485 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f702c15a610 0x7f702c0b1ed0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f7028009820 tx=0x7f7028009b30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=74f7a7a50a61a4eb server_cookie=0 in_seq=0 out_seq=0 2023-07-05T18:56:41.613 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:41.609+0000 7f7031536700 1 -- 172.21.15.46:0/2335536485 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7028005e30 con 0x7f702c15a610 2023-07-05T18:56:41.613 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:41.609+0000 7f7031536700 1 -- 172.21.15.46:0/2335536485 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7028006030 con 0x7f702c15a610 2023-07-05T18:56:41.614 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:41.609+0000 7f7031536700 1 -- 172.21.15.46:0/2335536485 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70280063e0 con 0x7f702c15a610 2023-07-05T18:56:41.614 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:41.610+0000 7f703479c700 1 -- 172.21.15.46:0/2335536485 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f702c15a610 msgr2=0x7f702c0b1ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:56:41.614 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:41.610+0000 7f703479c700 1 --2- 172.21.15.46:0/2335536485 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f702c15a610 0x7f702c0b1ed0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f7028009820 tx=0x7f7028009b30 comp rx=0 tx=0).stop 2023-07-05T18:56:41.614 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:41.610+0000 7f703479c700 1 -- 172.21.15.46:0/2335536485 shutdown_connections 2023-07-05T18:56:41.614 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:41.610+0000 7f703479c700 1 --2- 172.21.15.46:0/2335536485 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f702c15a610 0x7f702c0b1ed0 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:41.614 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:41.610+0000 7f703479c700 1 -- 172.21.15.46:0/2335536485 >> 172.21.15.46:0/2335536485 conn(0x7f702c099e00 msgr2=0x7f702c0d0b00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-05T18:56:41.614 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:41.610+0000 7f703479c700 1 -- 172.21.15.46:0/2335536485 shutdown_connections 2023-07-05T18:56:41.614 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:41.610+0000 7f703479c700 1 -- 172.21.15.46:0/2335536485 wait complete. 2023-07-05T18:56:41.616 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:41.611+0000 7f703479c700 1 Processor -- start 2023-07-05T18:56:41.617 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:41.611+0000 7f703479c700 1 -- start start 2023-07-05T18:56:41.617 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:41.612+0000 7f703479c700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f702c0afad0 0x7f702c150d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:56:41.617 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:41.612+0000 7f703479c700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f702c0ce6d0 0x7f702c0ca2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:56:41.617 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:41.612+0000 7f703479c700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f702c15a610 0x7f702c0ca820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:56:41.617 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:41.612+0000 7f703479c700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f702c0b6690 con 0x7f702c0ce6d0 2023-07-05T18:56:41.617 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:41.612+0000 7f703479c700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f702c0b5ae0 con 0x7f702c0afad0 2023-07-05T18:56:41.617 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:41.612+0000 7f703479c700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f702c0b4660 con 0x7f702c15a610 2023-07-05T18:56:41.618 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:41.612+0000 7f7031d37700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f702c0ce6d0 0x7f702c0ca2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:56:41.618 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:41.612+0000 7f7031d37700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f702c0ce6d0 0x7f702c0ca2e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:58652/0 (socket says 172.21.15.46:58652) 2023-07-05T18:56:41.618 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:41.612+0000 7f7031d37700 1 -- 172.21.15.46:0/2007944125 learned_addr learned my addr 172.21.15.46:0/2007944125 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-07-05T18:56:41.618 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:41.612+0000 7f7032d39700 1 --2- 172.21.15.46:0/2007944125 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f702c15a610 0x7f702c0ca820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:56:41.618 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:41.612+0000 7f7032538700 1 --2- 172.21.15.46:0/2007944125 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f702c0afad0 0x7f702c150d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:56:41.618 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:41.612+0000 7f7031d37700 1 -- 172.21.15.46:0/2007944125 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f702c15a610 msgr2=0x7f702c0ca820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:56:41.618 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:41.612+0000 7f7031d37700 1 --2- 172.21.15.46:0/2007944125 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f702c15a610 0x7f702c0ca820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:41.619 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:41.612+0000 7f7031d37700 1 -- 172.21.15.46:0/2007944125 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f702c0afad0 msgr2=0x7f702c150d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:56:41.619 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:41.612+0000 7f7031d37700 1 --2- 172.21.15.46:0/2007944125 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f702c0afad0 0x7f702c150d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:41.619 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:41.612+0000 7f7031d37700 1 -- 172.21.15.46:0/2007944125 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7028009430 con 0x7f702c0ce6d0 2023-07-05T18:56:41.619 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:41.613+0000 7f7031d37700 1 --2- 172.21.15.46:0/2007944125 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f702c0ce6d0 0x7f702c0ca2e0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f702000c4b0 tx=0x7f702000c7c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-05T18:56:41.620 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:41.613+0000 7f701effd700 1 -- 172.21.15.46:0/2007944125 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7020005d70 con 0x7f702c0ce6d0 2023-07-05T18:56:41.620 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:41.613+0000 7f701effd700 1 -- 172.21.15.46:0/2007944125 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f702000ce80 con 0x7f702c0ce6d0 2023-07-05T18:56:41.620 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:41.613+0000 7f703479c700 1 -- 172.21.15.46:0/2007944125 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f702c0b5d60 con 0x7f702c0ce6d0 2023-07-05T18:56:41.620 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:41.613+0000 7f701effd700 1 -- 172.21.15.46:0/2007944125 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70200072d0 con 0x7f702c0ce6d0 2023-07-05T18:56:41.620 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:41.613+0000 7f703479c700 1 -- 172.21.15.46:0/2007944125 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f702c0b6320 con 0x7f702c0ce6d0 2023-07-05T18:56:41.620 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:41.614+0000 7f703479c700 1 -- 172.21.15.46:0/2007944125 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f702c0b6840 con 0x7f702c0ce6d0 2023-07-05T18:56:41.620 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:41.614+0000 7f701effd700 1 -- 172.21.15.46:0/2007944125 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f7020007430 con 0x7f702c0ce6d0 2023-07-05T18:56:41.621 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:41.615+0000 7f701effd700 1 --2- 172.21.15.46:0/2007944125 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7f701006ace0 0x7f701006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:56:41.621 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:41.615+0000 7f701effd700 1 -- 172.21.15.46:0/2007944125 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f7020088720 con 0x7f702c0ce6d0 2023-07-05T18:56:41.621 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:41.615+0000 7f7032538700 1 --2- 172.21.15.46:0/2007944125 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7f701006ace0 0x7f701006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:56:41.621 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:41.616+0000 7f7032538700 1 --2- 172.21.15.46:0/2007944125 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7f701006ace0 0x7f701006d190 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f7028013040 tx=0x7f7028008070 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-05T18:56:41.622 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:41.620+0000 7f701effd700 1 -- 172.21.15.46:0/2007944125 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f702c0b6840 con 0x7f702c0ce6d0 2023-07-05T18:56:41.819 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:41.817+0000 7f703479c700 1 -- 172.21.15.46:0/2007944125 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f702c0b6840 con 0x7f702c0ce6d0 2023-07-05T18:56:41.820 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:41.818+0000 7f701effd700 1 -- 172.21.15.46:0/2007944125 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) v1 ==== 74+0+18161 (secure 0 0 0) 0x7f702c0b6840 con 0x7f702c0ce6d0 2023-07-05T18:56:41.821 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T18:56:41.821 INFO:teuthology.orchestra.run.smithi046.stdout:{"epoch":21,"fsid":"042652d3-d80c-4ad8-9366-3e94f2a0a512","created":"2023-07-05T18:55:56.455710+0000","modified":"2023-07-05T18:56:16.095672+0000","last_up_change":"2023-07-05T18:56:06.594022+0000","last_in_change":"2023-07-05T18:55:58.879340+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-07-05T18:56:07.729620+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2023-07-05T18:56:08.128122+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-07-05T18:56:12.954625+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-07-05T18:56:14.068396+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"20009183-9a47-4392-8751-883f88d2bfb1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6813","nonce":4151971443},{"type":"v1","addr":"172.21.15.46:6815","nonce":4151971443}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6817","nonce":4151971443},{"type":"v1","addr":"172.21.15.46:6818","nonce":4151971443}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6822","nonce":4151971443},{"type":"v1","addr":"172.21.15.46:6823","nonce":4151971443}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6820","nonce":4151971443},{"type":"v1","addr":"172.21.15.46:6821","nonce":4151971443}]},"public_addr":"172.21.15.46:6815/4151971443","cluster_addr":"172.21.15.46:6818/4151971443","heartbeat_back_addr":"172.21.15.46:6823/4151971443","heartbeat_front_addr":"172.21.15.46:6821/4151971443","state":["exists","up"]},{"osd":1,"uuid":"91b4a7b0-e4e4-4888-a1fe-9edb0d68004c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6808","nonce":502575881},{"type":"v1","addr":"172.21.15.46:6809","nonce":502575881}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6810","nonce":502575881},{"type":"v1","addr":"172.21.15.46:6811","nonce":502575881}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6816","nonce":502575881},{"type":"v1","addr":"172.21.15.46:6819","nonce":502575881}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6812","nonce":502575881},{"type":"v1","addr":"172.21.15.46:6814","nonce":502575881}]},"public_addr":"172.21.15.46:6809/502575881","cluster_addr":"172.21.15.46:6811/502575881","heartbeat_back_addr":"172.21.15.46:6819/502575881","heartbeat_front_addr":"172.21.15.46:6814/502575881","state":["exists","up"]},{"osd":2,"uuid":"669ff744-1331-47c5-8579-0440731c889a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6800","nonce":2115251461},{"type":"v1","addr":"172.21.15.46:6801","nonce":2115251461}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6802","nonce":2115251461},{"type":"v1","addr":"172.21.15.46:6803","nonce":2115251461}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6806","nonce":2115251461},{"type":"v1","addr":"172.21.15.46:6807","nonce":2115251461}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6804","nonce":2115251461},{"type":"v1","addr":"172.21.15.46:6805","nonce":2115251461}]},"public_addr":"172.21.15.46:6801/2115251461","cluster_addr":"172.21.15.46:6803/2115251461","heartbeat_back_addr":"172.21.15.46:6807/2115251461","heartbeat_front_addr":"172.21.15.46:6805/2115251461","state":["exists","up"]},{"osd":3,"uuid":"34e1b86d-ffad-415d-861c-07a5f08068a6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6824","nonce":2981388766},{"type":"v1","addr":"172.21.15.46:6825","nonce":2981388766}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6826","nonce":2981388766},{"type":"v1","addr":"172.21.15.46:6827","nonce":2981388766}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6830","nonce":2981388766},{"type":"v1","addr":"172.21.15.46:6831","nonce":2981388766}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6828","nonce":2981388766},{"type":"v1","addr":"172.21.15.46:6829","nonce":2981388766}]},"public_addr":"172.21.15.46:6825/2981388766","cluster_addr":"172.21.15.46:6827/2981388766","heartbeat_back_addr":"172.21.15.46:6831/2981388766","heartbeat_front_addr":"172.21.15.46:6829/2981388766","state":["exists","up"]},{"osd":4,"uuid":"57ffcb91-c7dc-4a69-ae71-4d9622a14a05","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6800","nonce":2083655348},{"type":"v1","addr":"172.21.15.73:6801","nonce":2083655348}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6802","nonce":2083655348},{"type":"v1","addr":"172.21.15.73:6803","nonce":2083655348}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6806","nonce":2083655348},{"type":"v1","addr":"172.21.15.73:6807","nonce":2083655348}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6804","nonce":2083655348},{"type":"v1","addr":"172.21.15.73:6805","nonce":2083655348}]},"public_addr":"172.21.15.73:6801/2083655348","cluster_addr":"172.21.15.73:6803/2083655348","heartbeat_back_addr":"172.21.15.73:6807/2083655348","heartbeat_front_addr":"172.21.15.73:6805/2083655348","state":["exists","up"]},{"osd":5,"uuid":"665f41c9-ee20-49cf-bf0e-fbe0c03d3aed","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6824","nonce":2803788401},{"type":"v1","addr":"172.21.15.73:6825","nonce":2803788401}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6826","nonce":2803788401},{"type":"v1","addr":"172.21.15.73:6827","nonce":2803788401}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6830","nonce":2803788401},{"type":"v1","addr":"172.21.15.73:6831","nonce":2803788401}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6828","nonce":2803788401},{"type":"v1","addr":"172.21.15.73:6829","nonce":2803788401}]},"public_addr":"172.21.15.73:6825/2803788401","cluster_addr":"172.21.15.73:6827/2803788401","heartbeat_back_addr":"172.21.15.73:6831/2803788401","heartbeat_front_addr":"172.21.15.73:6829/2803788401","state":["exists","up"]},{"osd":6,"uuid":"5790c6cc-bd56-4ce4-9a7c-0f0c3b59215c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6808","nonce":974108383},{"type":"v1","addr":"172.21.15.73:6809","nonce":974108383}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6810","nonce":974108383},{"type":"v1","addr":"172.21.15.73:6811","nonce":974108383}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6815","nonce":974108383},{"type":"v1","addr":"172.21.15.73:6817","nonce":974108383}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6812","nonce":974108383},{"type":"v1","addr":"172.21.15.73:6813","nonce":974108383}]},"public_addr":"172.21.15.73:6809/974108383","cluster_addr":"172.21.15.73:6811/974108383","heartbeat_back_addr":"172.21.15.73:6817/974108383","heartbeat_front_addr":"172.21.15.73:6813/974108383","state":["exists","up"]},{"osd":7,"uuid":"b66f4d2e-147e-4c9b-97dd-cbd59d33802e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6814","nonce":3772673248},{"type":"v1","addr":"172.21.15.73:6816","nonce":3772673248}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6818","nonce":3772673248},{"type":"v1","addr":"172.21.15.73:6819","nonce":3772673248}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6822","nonce":3772673248},{"type":"v1","addr":"172.21.15.73:6823","nonce":3772673248}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6820","nonce":3772673248},{"type":"v1","addr":"172.21.15.73:6821","nonce":3772673248}]},"public_addr":"172.21.15.73:6816/3772673248","cluster_addr":"172.21.15.73:6819/3772673248","heartbeat_back_addr":"172.21.15.73:6823/3772673248","heartbeat_front_addr":"172.21.15.73:6821/3772673248","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-05T18:56:04.115334+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-05T18:56:04.071250+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-05T18:56:04.044387+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-05T18:56:04.085389+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-05T18:56:04.090726+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-05T18:56:04.074529+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-05T18:56:04.058841+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-05T18:56:04.043054+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-05T18:56:41.822 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:41.820+0000 7f703479c700 1 -- 172.21.15.46:0/2007944125 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7f701006ace0 msgr2=0x7f701006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:56:41.822 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:41.820+0000 7f703479c700 1 --2- 172.21.15.46:0/2007944125 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7f701006ace0 0x7f701006d190 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f7028013040 tx=0x7f7028008070 comp rx=0 tx=0).stop 2023-07-05T18:56:41.823 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:41.820+0000 7f703479c700 1 -- 172.21.15.46:0/2007944125 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f702c0ce6d0 msgr2=0x7f702c0ca2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:56:41.823 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:41.820+0000 7f703479c700 1 --2- 172.21.15.46:0/2007944125 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f702c0ce6d0 0x7f702c0ca2e0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f702000c4b0 tx=0x7f702000c7c0 comp rx=0 tx=0).stop 2023-07-05T18:56:41.823 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:41.820+0000 7f703479c700 1 -- 172.21.15.46:0/2007944125 shutdown_connections 2023-07-05T18:56:41.823 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:41.820+0000 7f703479c700 1 --2- 172.21.15.46:0/2007944125 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7f701006ace0 0x7f701006d190 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:41.823 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:41.820+0000 7f703479c700 1 --2- 172.21.15.46:0/2007944125 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f702c15a610 0x7f702c0ca820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:41.823 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:41.820+0000 7f703479c700 1 --2- 172.21.15.46:0/2007944125 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f702c0afad0 0x7f702c150d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:41.823 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:41.820+0000 7f703479c700 1 --2- 172.21.15.46:0/2007944125 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f702c0ce6d0 0x7f702c0ca2e0 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:41.824 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:41.820+0000 7f703479c700 1 -- 172.21.15.46:0/2007944125 >> 172.21.15.46:0/2007944125 conn(0x7f702c099e00 msgr2=0x7f702c159710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-05T18:56:41.824 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:41.820+0000 7f703479c700 1 -- 172.21.15.46:0/2007944125 shutdown_connections 2023-07-05T18:56:41.824 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:41.820+0000 7f703479c700 1 -- 172.21.15.46:0/2007944125 wait complete. 2023-07-05T18:56:41.835 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'rbd', 'create_time': '2023-07-05T18:56:07.729620+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': '.mgr', 'create_time': '2023-07-05T18:56:08.128122+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-07-05T18:56:12.954625+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-07-05T18:56:14.068396+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-07-05T18:56:41.836 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-07-05T18:56:41.965 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:41.962+0000 7f598c8f6700 1 Processor -- start 2023-07-05T18:56:41.965 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:41.963+0000 7f598c8f6700 1 -- start start 2023-07-05T18:56:41.966 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:41.963+0000 7f598c8f6700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f59880b13f0 0x7f59880b1870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:56:41.966 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:41.963+0000 7f598c8f6700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f59880c9fc0 0x7f59880ca3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:56:41.967 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:41.963+0000 7f598c8f6700 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f598815e040 con 0x7f59881594f0 2023-07-05T18:56:41.967 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:41.964+0000 7f598c8f6700 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f59880ce200 con 0x7f59880c9fc0 2023-07-05T18:56:41.967 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:41.964+0000 7f598c8f6700 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f59880b1db0 con 0x7f59880b13f0 2023-07-05T18:56:41.967 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:41.964+0000 7f5986d9d700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f59880c9fc0 0x7f59880ca3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:56:41.967 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:41.964+0000 7f598659c700 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7f59881594f0 0x7f59880cd690 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:57930/0 (socket says 172.21.15.46:57930) 2023-07-05T18:56:41.967 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:41.964+0000 7f598659c700 1 -- 172.21.15.46:0/2168771594 learned_addr learned my addr 172.21.15.46:0/2168771594 (peer_addr_for_me v1:172.21.15.46:0/0) 2023-07-05T18:56:41.967 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:41.964+0000 7f5985d9b700 1 --2- 172.21.15.46:0/2168771594 >> v2:172.21.15.73:3300/0 conn(0x7f59880b13f0 0x7f59880b1870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:56:41.968 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:41.964+0000 7f5986d9d700 1 -- 172.21.15.46:0/2168771594 >> v2:172.21.15.73:3300/0 conn(0x7f59880b13f0 msgr2=0x7f59880b1870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-05T18:56:41.968 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:41.964+0000 7f5986d9d700 1 --2- 172.21.15.46:0/2168771594 >> v2:172.21.15.73:3300/0 conn(0x7f59880b13f0 0x7f59880b1870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:41.968 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:41.964+0000 7f5986d9d700 1 -- 172.21.15.46:0/2168771594 >> v1:172.21.15.46:6789/0 conn(0x7f59881594f0 legacy=0x7f59880cd690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:56:41.968 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:41.964+0000 7f5986d9d700 1 -- 172.21.15.46:0/2168771594 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f598815dbb0 con 0x7f59880c9fc0 2023-07-05T18:56:41.968 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:41.964+0000 7f598559a700 1 -- 172.21.15.46:0/2168771594 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4131757892 0 0) 0x7f598815e040 con 0x7f59881594f0 2023-07-05T18:56:41.968 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:41.964+0000 7f5986d9d700 1 --2- 172.21.15.46:0/2168771594 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f59880c9fc0 0x7f59880ca3f0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f5988066a40 tx=0x7f598000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7f80478a7fb25890 server_cookie=0 in_seq=0 out_seq=0 2023-07-05T18:56:41.968 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:41.964+0000 7f598559a700 1 -- 172.21.15.46:0/2168771594 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f598000e070 con 0x7f59880c9fc0 2023-07-05T18:56:41.968 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:41.964+0000 7f598559a700 1 -- 172.21.15.46:0/2168771594 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f598000bb20 con 0x7f59880c9fc0 2023-07-05T18:56:41.969 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:41.964+0000 7f598559a700 1 -- 172.21.15.46:0/2168771594 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5980012430 con 0x7f59880c9fc0 2023-07-05T18:56:41.969 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:41.965+0000 7f598c8f6700 1 -- 172.21.15.46:0/2168771594 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f59880c9fc0 msgr2=0x7f59880ca3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:56:41.971 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:41.965+0000 7f598c8f6700 1 --2- 172.21.15.46:0/2168771594 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f59880c9fc0 0x7f59880ca3f0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f5988066a40 tx=0x7f598000b330 comp rx=0 tx=0).stop 2023-07-05T18:56:41.971 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:41.965+0000 7f598c8f6700 1 -- 172.21.15.46:0/2168771594 shutdown_connections 2023-07-05T18:56:41.971 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:41.965+0000 7f598c8f6700 1 --2- 172.21.15.46:0/2168771594 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f59880c9fc0 0x7f59880ca3f0 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:41.971 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:41.965+0000 7f598c8f6700 1 --2- 172.21.15.46:0/2168771594 >> v2:172.21.15.73:3300/0 conn(0x7f59880b13f0 0x7f59880b1870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:41.972 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:41.965+0000 7f598c8f6700 1 -- 172.21.15.46:0/2168771594 >> 172.21.15.46:0/2168771594 conn(0x7f598806bba0 msgr2=0x7f59880cc3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-05T18:56:41.972 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:41.965+0000 7f598c8f6700 1 -- 172.21.15.46:0/2168771594 shutdown_connections 2023-07-05T18:56:41.972 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:41.965+0000 7f598c8f6700 1 -- 172.21.15.46:0/2168771594 wait complete. 2023-07-05T18:56:41.972 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:41.966+0000 7f598c8f6700 1 Processor -- start 2023-07-05T18:56:41.972 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:41.967+0000 7f598c8f6700 1 -- start start 2023-07-05T18:56:41.972 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:41.967+0000 7f598c8f6700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f59880b13f0 0x7f59880c93e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:56:41.973 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:41.967+0000 7f598c8f6700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f59880c9fc0 0x7f59880ac870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:56:41.973 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:41.967+0000 7f598c8f6700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f59881594f0 0x7f59880b3020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:56:41.973 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:41.967+0000 7f598c8f6700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59880add80 con 0x7f59880b13f0 2023-07-05T18:56:41.973 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:41.967+0000 7f598c8f6700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59880c9920 con 0x7f59880c9fc0 2023-07-05T18:56:41.973 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:41.967+0000 7f598c8f6700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f59880ad170 con 0x7f59881594f0 2023-07-05T18:56:41.973 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:41.967+0000 7f598659c700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f59880b13f0 0x7f59880c93e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:56:41.973 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:41.967+0000 7f598659c700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f59880b13f0 0x7f59880c93e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:58664/0 (socket says 172.21.15.46:58664) 2023-07-05T18:56:41.973 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:41.967+0000 7f598659c700 1 -- 172.21.15.46:0/3736937768 learned_addr learned my addr 172.21.15.46:0/3736937768 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-07-05T18:56:41.974 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:41.967+0000 7f5985d9b700 1 --2- 172.21.15.46:0/3736937768 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f59880c9fc0 0x7f59880ac870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:56:41.974 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:41.968+0000 7f5986d9d700 1 --2- 172.21.15.46:0/3736937768 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f59881594f0 0x7f59880b3020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:56:41.974 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:41.968+0000 7f598659c700 1 -- 172.21.15.46:0/3736937768 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f59881594f0 msgr2=0x7f59880b3020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:56:41.974 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:41.968+0000 7f598659c700 1 --2- 172.21.15.46:0/3736937768 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f59881594f0 0x7f59880b3020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:41.974 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:41.968+0000 7f598659c700 1 -- 172.21.15.46:0/3736937768 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f59880c9fc0 msgr2=0x7f59880ac870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:56:41.974 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:41.968+0000 7f598659c700 1 --2- 172.21.15.46:0/3736937768 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f59880c9fc0 0x7f59880ac870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:41.974 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:41.968+0000 7f598659c700 1 -- 172.21.15.46:0/3736937768 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5980009a70 con 0x7f59880b13f0 2023-07-05T18:56:41.975 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:41.968+0000 7f5986d9d700 1 --2- 172.21.15.46:0/3736937768 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f59881594f0 0x7f59880b3020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-05T18:56:41.975 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:41.968+0000 7f598659c700 1 --2- 172.21.15.46:0/3736937768 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f59880b13f0 0x7f59880c93e0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f597c00c550 tx=0x7f597c00c860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-05T18:56:41.975 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:41.968+0000 7f5976ffd700 1 -- 172.21.15.46:0/3736937768 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f597c004c80 con 0x7f59880b13f0 2023-07-05T18:56:41.975 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:41.968+0000 7f5976ffd700 1 -- 172.21.15.46:0/3736937768 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f597c004e00 con 0x7f59880b13f0 2023-07-05T18:56:41.975 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:41.968+0000 7f598c8f6700 1 -- 172.21.15.46:0/3736937768 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f59880ad450 con 0x7f59880b13f0 2023-07-05T18:56:41.975 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:41.968+0000 7f5976ffd700 1 -- 172.21.15.46:0/3736937768 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f597c007310 con 0x7f59880b13f0 2023-07-05T18:56:41.975 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:41.968+0000 7f598c8f6700 1 -- 172.21.15.46:0/3736937768 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f59880ada10 con 0x7f59880b13f0 2023-07-05T18:56:41.975 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:41.969+0000 7f598c8f6700 1 -- 172.21.15.46:0/3736937768 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5988067e40 con 0x7f59880b13f0 2023-07-05T18:56:41.976 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:41.969+0000 7f5976ffd700 1 -- 172.21.15.46:0/3736937768 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f597c007470 con 0x7f59880b13f0 2023-07-05T18:56:41.976 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:41.970+0000 7f5976ffd700 1 --2- 172.21.15.46:0/3736937768 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7f596806ace0 0x7f596806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:56:41.976 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:41.970+0000 7f5976ffd700 1 -- 172.21.15.46:0/3736937768 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f597c089100 con 0x7f59880b13f0 2023-07-05T18:56:41.977 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:41.970+0000 7f5985d9b700 1 --2- 172.21.15.46:0/3736937768 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7f596806ace0 0x7f596806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:56:41.977 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:41.970+0000 7f5985d9b700 1 --2- 172.21.15.46:0/3736937768 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7f596806ace0 0x7f596806d190 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f59881f5840 tx=0x7f5978009210 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-05T18:56:41.977 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:41.974+0000 7f5976ffd700 1 -- 172.21.15.46:0/3736937768 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f597c0541b0 con 0x7f59880b13f0 2023-07-05T18:56:42.172 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:42.169+0000 7f598c8f6700 1 -- 172.21.15.46:0/3736937768 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f59880672e0 con 0x7f59880b13f0 2023-07-05T18:56:42.173 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:42.170+0000 7f5976ffd700 1 -- 172.21.15.46:0/3736937768 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v21) v1 ==== 92+0+10 (secure 0 0 0) 0x7f597c0577d0 con 0x7f59880b13f0 2023-07-05T18:56:42.173 INFO:teuthology.orchestra.run.smithi046.stdout:pg_num: 8 2023-07-05T18:56:42.174 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:42.172+0000 7f598c8f6700 1 -- 172.21.15.46:0/3736937768 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7f596806ace0 msgr2=0x7f596806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:56:42.174 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:42.172+0000 7f598c8f6700 1 --2- 172.21.15.46:0/3736937768 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7f596806ace0 0x7f596806d190 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f59881f5840 tx=0x7f5978009210 comp rx=0 tx=0).stop 2023-07-05T18:56:42.174 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:42.172+0000 7f598c8f6700 1 -- 172.21.15.46:0/3736937768 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f59880b13f0 msgr2=0x7f59880c93e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:56:42.175 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:42.172+0000 7f598c8f6700 1 --2- 172.21.15.46:0/3736937768 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f59880b13f0 0x7f59880c93e0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f597c00c550 tx=0x7f597c00c860 comp rx=0 tx=0).stop 2023-07-05T18:56:42.175 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:42.172+0000 7f598c8f6700 1 -- 172.21.15.46:0/3736937768 shutdown_connections 2023-07-05T18:56:42.175 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:42.172+0000 7f598c8f6700 1 --2- 172.21.15.46:0/3736937768 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7f596806ace0 0x7f596806d190 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:42.175 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:42.172+0000 7f598c8f6700 1 --2- 172.21.15.46:0/3736937768 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f59881594f0 0x7f59880b3020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:42.175 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:42.172+0000 7f598c8f6700 1 --2- 172.21.15.46:0/3736937768 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f59880b13f0 0x7f59880c93e0 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:42.175 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:42.172+0000 7f598c8f6700 1 --2- 172.21.15.46:0/3736937768 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f59880c9fc0 0x7f59880ac870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:42.175 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:42.172+0000 7f598c8f6700 1 -- 172.21.15.46:0/3736937768 >> 172.21.15.46:0/3736937768 conn(0x7f598806bba0 msgr2=0x7f5988152880 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-05T18:56:42.176 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:42.172+0000 7f598c8f6700 1 -- 172.21.15.46:0/3736937768 shutdown_connections 2023-07-05T18:56:42.176 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:42.172+0000 7f598c8f6700 1 -- 172.21.15.46:0/3736937768 wait complete. 2023-07-05T18:56:42.186 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-07-05T18:56:42.315 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:42.312+0000 7f63c937d700 1 Processor -- start 2023-07-05T18:56:42.315 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:42.312+0000 7f63c937d700 1 -- start start 2023-07-05T18:56:42.317 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:42.313+0000 7f63c937d700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f63c415c860 0x7f63c4160ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:56:42.317 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:42.313+0000 7f63c937d700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f63c40715c0 0x7f63c4069e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:56:42.317 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:42.313+0000 7f63c937d700 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f63c40ce640 con 0x7f63c406a340 2023-07-05T18:56:42.317 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:42.313+0000 7f63c937d700 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f63c406a780 con 0x7f63c40715c0 2023-07-05T18:56:42.318 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:42.313+0000 7f63c937d700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f63c41611e0 con 0x7f63c415c860 2023-07-05T18:56:42.318 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:42.313+0000 7f63c37fe700 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7f63c406a340 0x7f63c40b13f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:57946/0 (socket says 172.21.15.46:57946) 2023-07-05T18:56:42.318 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:42.313+0000 7f63c37fe700 1 -- 172.21.15.46:0/2856560044 learned_addr learned my addr 172.21.15.46:0/2856560044 (peer_addr_for_me v1:172.21.15.46:0/0) 2023-07-05T18:56:42.318 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:42.313+0000 7f63c2ffd700 1 --2- 172.21.15.46:0/2856560044 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f63c415c860 0x7f63c4160ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:56:42.318 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:42.313+0000 7f63c27fc700 1 --2- 172.21.15.46:0/2856560044 >> v2:172.21.15.73:3300/0 conn(0x7f63c40715c0 0x7f63c4069e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:56:42.318 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:42.314+0000 7f63c1ffb700 1 -- 172.21.15.46:0/2856560044 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2478783801 0 0) 0x7f63c40ce640 con 0x7f63c406a340 2023-07-05T18:56:42.318 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:42.314+0000 7f63c1ffb700 1 -- 172.21.15.46:0/2856560044 --> v1:172.21.15.46:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f63ac0035b0 con 0x7f63c406a340 2023-07-05T18:56:42.319 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:42.314+0000 7f63c2ffd700 1 -- 172.21.15.46:0/2856560044 >> v2:172.21.15.73:3300/0 conn(0x7f63c40715c0 msgr2=0x7f63c4069e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-05T18:56:42.319 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:42.314+0000 7f63c2ffd700 1 --2- 172.21.15.46:0/2856560044 >> v2:172.21.15.73:3300/0 conn(0x7f63c40715c0 0x7f63c4069e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:42.319 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:42.314+0000 7f63c2ffd700 1 -- 172.21.15.46:0/2856560044 >> v1:172.21.15.46:6789/0 conn(0x7f63c406a340 legacy=0x7f63c40b13f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:56:42.319 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:42.314+0000 7f63c2ffd700 1 -- 172.21.15.46:0/2856560044 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f63c40ce870 con 0x7f63c415c860 2023-07-05T18:56:42.319 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:42.314+0000 7f63c27fc700 1 --2- 172.21.15.46:0/2856560044 >> v2:172.21.15.73:3300/0 conn(0x7f63c40715c0 0x7f63c4069e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-05T18:56:42.319 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:42.314+0000 7f63c2ffd700 1 --2- 172.21.15.46:0/2856560044 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f63c415c860 0x7f63c4160ca0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f63b8009840 tx=0x7f63b8009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d27d2b80e574feb0 server_cookie=0 in_seq=0 out_seq=0 2023-07-05T18:56:42.319 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:42.314+0000 7f63c1ffb700 1 -- 172.21.15.46:0/2856560044 <== mon.2 v2:172.21.15.73:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63b8011830 con 0x7f63c415c860 2023-07-05T18:56:42.319 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:42.314+0000 7f63c1ffb700 1 -- 172.21.15.46:0/2856560044 <== mon.2 v2:172.21.15.73:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f63b8011990 con 0x7f63c415c860 2023-07-05T18:56:42.320 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:42.314+0000 7f63c1ffb700 1 -- 172.21.15.46:0/2856560044 <== mon.2 v2:172.21.15.73:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63b8011d20 con 0x7f63c415c860 2023-07-05T18:56:42.320 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:42.315+0000 7f63c937d700 1 -- 172.21.15.46:0/2856560044 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f63c415c860 msgr2=0x7f63c4160ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:56:42.320 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:42.315+0000 7f63c937d700 1 --2- 172.21.15.46:0/2856560044 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f63c415c860 0x7f63c4160ca0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f63b8009840 tx=0x7f63b8009b50 comp rx=0 tx=0).stop 2023-07-05T18:56:42.320 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:42.315+0000 7f63c937d700 1 -- 172.21.15.46:0/2856560044 shutdown_connections 2023-07-05T18:56:42.320 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:42.315+0000 7f63c937d700 1 --2- 172.21.15.46:0/2856560044 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f63c415c860 0x7f63c4160ca0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:42.320 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:42.315+0000 7f63c937d700 1 --2- 172.21.15.46:0/2856560044 >> v2:172.21.15.73:3300/0 conn(0x7f63c40715c0 0x7f63c4069e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:42.320 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:42.315+0000 7f63c937d700 1 -- 172.21.15.46:0/2856560044 >> 172.21.15.46:0/2856560044 conn(0x7f63c406bba0 msgr2=0x7f63c40cc3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-05T18:56:42.320 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:42.315+0000 7f63c937d700 1 -- 172.21.15.46:0/2856560044 shutdown_connections 2023-07-05T18:56:42.321 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:42.315+0000 7f63c937d700 1 -- 172.21.15.46:0/2856560044 wait complete. 2023-07-05T18:56:42.322 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:42.316+0000 7f63c937d700 1 Processor -- start 2023-07-05T18:56:42.323 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:42.316+0000 7f63c937d700 1 -- start start 2023-07-05T18:56:42.323 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:42.317+0000 7f63c937d700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f63c406a340 0x7f63c415f030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:56:42.323 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:42.317+0000 7f63c937d700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f63c40715c0 0x7f63c415afa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:56:42.323 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:42.317+0000 7f63c937d700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f63c415c860 0x7f63c415ccc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:56:42.323 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:42.317+0000 7f63c937d700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f63c415b4e0 con 0x7f63c406a340 2023-07-05T18:56:42.323 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:42.317+0000 7f63c937d700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f63c415e540 con 0x7f63c415c860 2023-07-05T18:56:42.323 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:42.317+0000 7f63c937d700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f63c415d200 con 0x7f63c40715c0 2023-07-05T18:56:42.324 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:42.317+0000 7f63c2ffd700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f63c406a340 0x7f63c415f030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:56:42.324 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:42.317+0000 7f63c2ffd700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f63c406a340 0x7f63c415f030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:58676/0 (socket says 172.21.15.46:58676) 2023-07-05T18:56:42.324 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:42.317+0000 7f63c2ffd700 1 -- 172.21.15.46:0/845371991 learned_addr learned my addr 172.21.15.46:0/845371991 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-07-05T18:56:42.325 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:42.317+0000 7f63c37fe700 1 --2- 172.21.15.46:0/845371991 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f63c415c860 0x7f63c415ccc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:56:42.325 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:42.317+0000 7f63c27fc700 1 --2- 172.21.15.46:0/845371991 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f63c40715c0 0x7f63c415afa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:56:42.325 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:42.317+0000 7f63c2ffd700 1 -- 172.21.15.46:0/845371991 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f63c40715c0 msgr2=0x7f63c415afa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:56:42.325 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:42.317+0000 7f63c2ffd700 1 --2- 172.21.15.46:0/845371991 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f63c40715c0 0x7f63c415afa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:42.326 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:42.317+0000 7f63c2ffd700 1 -- 172.21.15.46:0/845371991 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f63c415c860 msgr2=0x7f63c415ccc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:56:42.326 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:42.317+0000 7f63c2ffd700 1 --2- 172.21.15.46:0/845371991 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f63c415c860 0x7f63c415ccc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:42.326 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:42.318+0000 7f63c2ffd700 1 -- 172.21.15.46:0/845371991 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f63b40094a0 con 0x7f63c406a340 2023-07-05T18:56:42.326 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:42.318+0000 7f63c37fe700 1 --2- 172.21.15.46:0/845371991 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f63c415c860 0x7f63c415ccc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-05T18:56:42.326 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:42.318+0000 7f63c2ffd700 1 --2- 172.21.15.46:0/845371991 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f63c406a340 0x7f63c415f030 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f63b8014040 tx=0x7f63b8004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-05T18:56:42.327 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:42.318+0000 7f63ab7fe700 1 -- 172.21.15.46:0/845371991 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63b80038a0 con 0x7f63c406a340 2023-07-05T18:56:42.327 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:42.318+0000 7f63ab7fe700 1 -- 172.21.15.46:0/845371991 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f63b801f070 con 0x7f63c406a340 2023-07-05T18:56:42.327 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:42.318+0000 7f63c937d700 1 -- 172.21.15.46:0/845371991 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f63b80094a0 con 0x7f63c406a340 2023-07-05T18:56:42.327 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:42.318+0000 7f63ab7fe700 1 -- 172.21.15.46:0/845371991 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63b8003c00 con 0x7f63c406a340 2023-07-05T18:56:42.327 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:42.318+0000 7f63c937d700 1 -- 172.21.15.46:0/845371991 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f63c415d780 con 0x7f63c406a340 2023-07-05T18:56:42.327 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:42.319+0000 7f63c937d700 1 -- 172.21.15.46:0/845371991 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f63c40672e0 con 0x7f63c406a340 2023-07-05T18:56:42.327 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:42.319+0000 7f63ab7fe700 1 -- 172.21.15.46:0/845371991 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f63b801a430 con 0x7f63c406a340 2023-07-05T18:56:42.327 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:42.320+0000 7f63ab7fe700 1 --2- 172.21.15.46:0/845371991 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7f63b006ace0 0x7f63b006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:56:42.328 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:42.320+0000 7f63ab7fe700 1 -- 172.21.15.46:0/845371991 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f63b8021070 con 0x7f63c406a340 2023-07-05T18:56:42.328 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:42.320+0000 7f63c27fc700 1 --2- 172.21.15.46:0/845371991 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7f63b006ace0 0x7f63b006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:56:42.328 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:42.321+0000 7f63c27fc700 1 --2- 172.21.15.46:0/845371991 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7f63b006ace0 0x7f63b006d190 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f63c40b0cf0 tx=0x7f63b4008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-05T18:56:42.328 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:42.324+0000 7f63ab7fe700 1 -- 172.21.15.46:0/845371991 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f63b8055dc0 con 0x7f63c406a340 2023-07-05T18:56:42.525 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:42.523+0000 7f63c937d700 1 -- 172.21.15.46:0/845371991 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f63c40b4540 con 0x7f63c406a340 2023-07-05T18:56:42.526 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:42.524+0000 7f63ab7fe700 1 -- 172.21.15.46:0/845371991 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v21) v1 ==== 93+0+10 (secure 0 0 0) 0x7f63b80150a0 con 0x7f63c406a340 2023-07-05T18:56:42.526 INFO:teuthology.orchestra.run.smithi046.stdout:pg_num: 1 2023-07-05T18:56:42.528 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:42.526+0000 7f63c937d700 1 -- 172.21.15.46:0/845371991 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7f63b006ace0 msgr2=0x7f63b006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:56:42.528 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:42.526+0000 7f63c937d700 1 --2- 172.21.15.46:0/845371991 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7f63b006ace0 0x7f63b006d190 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f63c40b0cf0 tx=0x7f63b4008040 comp rx=0 tx=0).stop 2023-07-05T18:56:42.528 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:42.526+0000 7f63c937d700 1 -- 172.21.15.46:0/845371991 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f63c406a340 msgr2=0x7f63c415f030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:56:42.528 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:42.526+0000 7f63c937d700 1 --2- 172.21.15.46:0/845371991 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f63c406a340 0x7f63c415f030 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f63b8014040 tx=0x7f63b8004750 comp rx=0 tx=0).stop 2023-07-05T18:56:42.528 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:42.526+0000 7f63c937d700 1 -- 172.21.15.46:0/845371991 shutdown_connections 2023-07-05T18:56:42.529 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:42.526+0000 7f63c937d700 1 --2- 172.21.15.46:0/845371991 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7f63b006ace0 0x7f63b006d190 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:42.529 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:42.526+0000 7f63c937d700 1 --2- 172.21.15.46:0/845371991 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f63c415c860 0x7f63c415ccc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:42.529 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:42.526+0000 7f63c937d700 1 --2- 172.21.15.46:0/845371991 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f63c406a340 0x7f63c415f030 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:42.529 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:42.526+0000 7f63c937d700 1 --2- 172.21.15.46:0/845371991 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f63c40715c0 0x7f63c415afa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:42.529 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:42.526+0000 7f63c937d700 1 -- 172.21.15.46:0/845371991 >> 172.21.15.46:0/845371991 conn(0x7f63c406bba0 msgr2=0x7f63c40ae040 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-05T18:56:42.529 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:42.526+0000 7f63c937d700 1 -- 172.21.15.46:0/845371991 shutdown_connections 2023-07-05T18:56:42.529 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:42.526+0000 7f63c937d700 1 -- 172.21.15.46:0/845371991 wait complete. 2023-07-05T18:56:42.541 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-07-05T18:56:42.669 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:42.667+0000 7f362afed700 1 Processor -- start 2023-07-05T18:56:42.670 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:42.667+0000 7f362afed700 1 -- start start 2023-07-05T18:56:42.672 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:42.668+0000 7f362afed700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f36240acbb0 0x7f362409cc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:56:42.673 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:42.668+0000 7f362afed700 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f362415d4b0 con 0x7f36240b36a0 2023-07-05T18:56:42.673 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:42.668+0000 7f362afed700 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f362415c8a0 con 0x7f36240cc150 2023-07-05T18:56:42.673 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:42.668+0000 7f362afed700 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f36240ad030 con 0x7f36240acbb0 2023-07-05T18:56:42.673 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:42.668+0000 7f3628d89700 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7f36240b36a0 0x7f36240cba40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:57956/0 (socket says 172.21.15.46:57956) 2023-07-05T18:56:42.673 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:42.668+0000 7f3628d89700 1 -- 172.21.15.46:0/1987639203 learned_addr learned my addr 172.21.15.46:0/1987639203 (peer_addr_for_me v1:172.21.15.46:0/0) 2023-07-05T18:56:42.673 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:42.668+0000 7f362958a700 1 --2- 172.21.15.46:0/1987639203 >> v2:172.21.15.73:3300/0 conn(0x7f36240acbb0 0x7f362409cc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:56:42.676 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:42.668+0000 7f36237fe700 1 -- 172.21.15.46:0/1987639203 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1029656749 0 0) 0x7f362415d4b0 con 0x7f36240b36a0 2023-07-05T18:56:42.677 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:42.668+0000 7f36237fe700 1 -- 172.21.15.46:0/1987639203 --> v1:172.21.15.46:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f36140035b0 con 0x7f36240b36a0 2023-07-05T18:56:42.677 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:42.669+0000 7f36237fe700 1 -- 172.21.15.46:0/1987639203 <== mon.1 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1736301981 0 0) 0x7f362415c8a0 con 0x7f36240cc150 2023-07-05T18:56:42.677 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:42.669+0000 7f36237fe700 1 -- 172.21.15.46:0/1987639203 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f362415d4b0 con 0x7f36240cc150 2023-07-05T18:56:42.677 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:42.669+0000 7f36237fe700 1 -- 172.21.15.46:0/1987639203 <== mon.0 v1:172.21.15.46:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3513250402 0 0) 0x7f36140035b0 con 0x7f36240b36a0 2023-07-05T18:56:42.677 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:42.669+0000 7f36237fe700 1 -- 172.21.15.46:0/1987639203 >> v2:172.21.15.73:3300/0 conn(0x7f36240acbb0 msgr2=0x7f362409cc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-05T18:56:42.677 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:42.669+0000 7f36237fe700 1 --2- 172.21.15.46:0/1987639203 >> v2:172.21.15.73:3300/0 conn(0x7f36240acbb0 0x7f362409cc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:42.677 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:42.669+0000 7f36237fe700 1 -- 172.21.15.46:0/1987639203 >> v1:172.21.15.73:6789/0 conn(0x7f36240cc150 legacy=0x7f3624069fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:56:42.678 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:42.669+0000 7f36237fe700 1 -- 172.21.15.46:0/1987639203 --> v1:172.21.15.46:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f362415cb80 con 0x7f36240b36a0 2023-07-05T18:56:42.678 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:42.669+0000 7f36237fe700 1 -- 172.21.15.46:0/1987639203 <== mon.0 v1:172.21.15.46:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2195585215 0 0) 0x7f3618001670 con 0x7f36240b36a0 2023-07-05T18:56:42.678 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:42.669+0000 7f36237fe700 1 -- 172.21.15.46:0/1987639203 >> v1:172.21.15.46:6789/0 conn(0x7f36240b36a0 legacy=0x7f36240cba40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:56:42.678 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:42.669+0000 7f36237fe700 1 --2- 172.21.15.46:0/1987639203 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3614003b90 0x7f3614003f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:56:42.678 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:42.669+0000 7f36237fe700 1 --2- 172.21.15.46:0/1987639203 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3614004850 0x7f3614004cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:56:42.678 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:42.669+0000 7f36237fe700 1 --2- 172.21.15.46:0/1987639203 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f3614005200 0x7f361400cb20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:56:42.679 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:42.669+0000 7f36237fe700 1 -- 172.21.15.46:0/1987639203 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36240ad030 con 0x7f3614004850 2023-07-05T18:56:42.679 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:42.669+0000 7f36237fe700 1 -- 172.21.15.46:0/1987639203 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f361400d170 con 0x7f3614003b90 2023-07-05T18:56:42.679 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:42.669+0000 7f36237fe700 1 -- 172.21.15.46:0/1987639203 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3614005a60 con 0x7f3614005200 2023-07-05T18:56:42.679 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:42.669+0000 7f3623fff700 1 --2- 172.21.15.46:0/1987639203 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3614004850 0x7f3614004cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:56:42.679 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:42.669+0000 7f3628d89700 1 --2- 172.21.15.46:0/1987639203 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3614003b90 0x7f3614003f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:56:42.679 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:42.669+0000 7f362958a700 1 --2- 172.21.15.46:0/1987639203 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f3614005200 0x7f361400cb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:56:42.679 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:42.669+0000 7f3623fff700 1 -- 172.21.15.46:0/1987639203 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f3614005200 msgr2=0x7f361400cb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-05T18:56:42.680 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:42.669+0000 7f3623fff700 1 --2- 172.21.15.46:0/1987639203 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f3614005200 0x7f361400cb20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:42.680 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:42.669+0000 7f3623fff700 1 -- 172.21.15.46:0/1987639203 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3614003b90 msgr2=0x7f3614003f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-05T18:56:42.680 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:42.669+0000 7f3623fff700 1 --2- 172.21.15.46:0/1987639203 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3614003b90 0x7f3614003f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:42.680 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:42.669+0000 7f3623fff700 1 -- 172.21.15.46:0/1987639203 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f36140035b0 con 0x7f3614004850 2023-07-05T18:56:42.680 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:42.669+0000 7f362958a700 1 -- 172.21.15.46:0/1987639203 reap_dead start 2023-07-05T18:56:42.680 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:42.669+0000 7f3623fff700 1 --2- 172.21.15.46:0/1987639203 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3614004850 0x7f3614004cc0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f36240cc540 tx=0x7f3614005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=850d76fcd9c9ee82 server_cookie=0 in_seq=0 out_seq=0 2023-07-05T18:56:42.680 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:42.669+0000 7f36237fe700 1 -- 172.21.15.46:0/1987639203 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3610001430 con 0x7f3614004850 2023-07-05T18:56:42.681 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:42.669+0000 7f36237fe700 1 -- 172.21.15.46:0/1987639203 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f36100052d0 con 0x7f3614004850 2023-07-05T18:56:42.681 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:42.669+0000 7f36237fe700 1 -- 172.21.15.46:0/1987639203 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3610001d40 con 0x7f3614004850 2023-07-05T18:56:42.681 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:42.670+0000 7f362afed700 1 -- 172.21.15.46:0/1987639203 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3614004850 msgr2=0x7f3614004cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:56:42.682 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:42.670+0000 7f362afed700 1 --2- 172.21.15.46:0/1987639203 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3614004850 0x7f3614004cc0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f36240cc540 tx=0x7f3614005880 comp rx=0 tx=0).stop 2023-07-05T18:56:42.682 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:42.670+0000 7f362afed700 1 -- 172.21.15.46:0/1987639203 shutdown_connections 2023-07-05T18:56:42.682 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:42.670+0000 7f362afed700 1 --2- 172.21.15.46:0/1987639203 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3614004850 0x7f3614004cc0 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:42.683 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:42.670+0000 7f362afed700 1 -- 172.21.15.46:0/1987639203 >> 172.21.15.46:0/1987639203 conn(0x7f36240b44c0 msgr2=0x7f36240b4890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-05T18:56:42.683 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:42.670+0000 7f362afed700 1 -- 172.21.15.46:0/1987639203 shutdown_connections 2023-07-05T18:56:42.683 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:42.670+0000 7f362afed700 1 -- 172.21.15.46:0/1987639203 wait complete. 2023-07-05T18:56:42.685 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:42.671+0000 7f362afed700 1 Processor -- start 2023-07-05T18:56:42.686 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:42.671+0000 7f362afed700 1 -- start start 2023-07-05T18:56:42.686 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:42.672+0000 7f362afed700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3614004850 0x7f36240c6290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:56:42.686 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:42.672+0000 7f362afed700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f3624159f40 0x7f362415a3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:56:42.686 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:42.672+0000 7f362afed700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f36241f5a10 0x7f36241f5e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:56:42.686 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:42.672+0000 7f362afed700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36241f63c0 con 0x7f36241f5a10 2023-07-05T18:56:42.686 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:42.672+0000 7f362afed700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f362415ace0 con 0x7f3614004850 2023-07-05T18:56:42.687 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:42.672+0000 7f362afed700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f362415aa00 con 0x7f3624159f40 2023-07-05T18:56:42.687 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:42.672+0000 7f362958a700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f36241f5a10 0x7f36241f5e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:56:42.687 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:42.672+0000 7f362958a700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f36241f5a10 0x7f36241f5e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:58700/0 (socket says 172.21.15.46:58700) 2023-07-05T18:56:42.687 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:42.672+0000 7f362958a700 1 -- 172.21.15.46:0/1887817254 learned_addr learned my addr 172.21.15.46:0/1887817254 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-07-05T18:56:42.687 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:42.672+0000 7f3628d89700 1 --2- 172.21.15.46:0/1887817254 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3614004850 0x7f36240c6290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:56:42.687 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:42.672+0000 7f3623fff700 1 --2- 172.21.15.46:0/1887817254 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f3624159f40 0x7f362415a3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:56:42.687 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:42.673+0000 7f362958a700 1 -- 172.21.15.46:0/1887817254 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f3624159f40 msgr2=0x7f362415a3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:56:42.687 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:42.673+0000 7f362958a700 1 --2- 172.21.15.46:0/1887817254 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f3624159f40 0x7f362415a3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:42.688 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:42.673+0000 7f362958a700 1 -- 172.21.15.46:0/1887817254 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3614004850 msgr2=0x7f36240c6290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:56:42.688 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:42.673+0000 7f362958a700 1 --2- 172.21.15.46:0/1887817254 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3614004850 0x7f36240c6290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:42.688 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:42.673+0000 7f362958a700 1 -- 172.21.15.46:0/1887817254 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f36240b03c0 con 0x7f36241f5a10 2023-07-05T18:56:42.688 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:42.673+0000 7f3623fff700 1 --2- 172.21.15.46:0/1887817254 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f3624159f40 0x7f362415a3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-05T18:56:42.688 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:42.673+0000 7f362958a700 1 --2- 172.21.15.46:0/1887817254 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f36241f5a10 0x7f36241f5e80 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f36240cc740 tx=0x7f361c011f80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-05T18:56:42.688 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:42.673+0000 7f36217fa700 1 -- 172.21.15.46:0/1887817254 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f361c00e040 con 0x7f36241f5a10 2023-07-05T18:56:42.688 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:42.673+0000 7f36217fa700 1 -- 172.21.15.46:0/1887817254 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f361c00f040 con 0x7f36241f5a10 2023-07-05T18:56:42.689 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:42.673+0000 7f362afed700 1 -- 172.21.15.46:0/1887817254 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f36240b06a0 con 0x7f36241f5a10 2023-07-05T18:56:42.689 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:42.673+0000 7f36217fa700 1 -- 172.21.15.46:0/1887817254 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f361c00f880 con 0x7f36241f5a10 2023-07-05T18:56:42.689 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:42.673+0000 7f362afed700 1 -- 172.21.15.46:0/1887817254 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f36241576b0 con 0x7f36241f5a10 2023-07-05T18:56:42.689 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:42.674+0000 7f362afed700 1 -- 172.21.15.46:0/1887817254 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f36240b0220 con 0x7f36241f5a10 2023-07-05T18:56:42.689 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:42.674+0000 7f36217fa700 1 -- 172.21.15.46:0/1887817254 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f361c00f9e0 con 0x7f36241f5a10 2023-07-05T18:56:42.689 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:42.675+0000 7f36217fa700 1 --2- 172.21.15.46:0/1887817254 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7f360806ace0 0x7f360806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:56:42.689 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:42.675+0000 7f36217fa700 1 -- 172.21.15.46:0/1887817254 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f361c0898a0 con 0x7f36241f5a10 2023-07-05T18:56:42.690 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:42.675+0000 7f3628d89700 1 --2- 172.21.15.46:0/1887817254 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7f360806ace0 0x7f360806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:56:42.690 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:42.676+0000 7f3628d89700 1 --2- 172.21.15.46:0/1887817254 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7f360806ace0 0x7f360806d190 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f3618001eb0 tx=0x7f3618001e00 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-05T18:56:42.690 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:42.679+0000 7f36217fa700 1 -- 172.21.15.46:0/1887817254 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f36240b0220 con 0x7f36241f5a10 2023-07-05T18:56:42.880 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:42.878+0000 7f362afed700 1 -- 172.21.15.46:0/1887817254 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f36240b0bc0 con 0x7f36241f5a10 2023-07-05T18:56:42.881 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:42.879+0000 7f36217fa700 1 -- 172.21.15.46:0/1887817254 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v21) v1 ==== 104+0+11 (secure 0 0 0) 0x7f36240b0bc0 con 0x7f36241f5a10 2023-07-05T18:56:42.881 INFO:teuthology.orchestra.run.smithi046.stdout:pg_num: 32 2023-07-05T18:56:42.884 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:42.881+0000 7f362afed700 1 -- 172.21.15.46:0/1887817254 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7f360806ace0 msgr2=0x7f360806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:56:42.884 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:42.881+0000 7f362afed700 1 --2- 172.21.15.46:0/1887817254 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7f360806ace0 0x7f360806d190 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f3618001eb0 tx=0x7f3618001e00 comp rx=0 tx=0).stop 2023-07-05T18:56:42.884 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:42.881+0000 7f362afed700 1 -- 172.21.15.46:0/1887817254 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f36241f5a10 msgr2=0x7f36241f5e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:56:42.885 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:42.881+0000 7f362afed700 1 --2- 172.21.15.46:0/1887817254 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f36241f5a10 0x7f36241f5e80 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f36240cc740 tx=0x7f361c011f80 comp rx=0 tx=0).stop 2023-07-05T18:56:42.885 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:42.881+0000 7f362afed700 1 -- 172.21.15.46:0/1887817254 shutdown_connections 2023-07-05T18:56:42.885 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:42.881+0000 7f362afed700 1 --2- 172.21.15.46:0/1887817254 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7f360806ace0 0x7f360806d190 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:42.885 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:42.881+0000 7f362afed700 1 --2- 172.21.15.46:0/1887817254 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f36241f5a10 0x7f36241f5e80 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:42.885 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:42.881+0000 7f362afed700 1 --2- 172.21.15.46:0/1887817254 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3614004850 0x7f36240c6290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:42.885 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:42.881+0000 7f362afed700 1 --2- 172.21.15.46:0/1887817254 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f3624159f40 0x7f362415a3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:42.886 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:42.881+0000 7f362afed700 1 -- 172.21.15.46:0/1887817254 >> 172.21.15.46:0/1887817254 conn(0x7f36240b44c0 msgr2=0x7f36240b1ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-05T18:56:42.886 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:42.881+0000 7f362afed700 1 -- 172.21.15.46:0/1887817254 shutdown_connections 2023-07-05T18:56:42.886 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:42.881+0000 7f362afed700 1 -- 172.21.15.46:0/1887817254 wait complete. 2023-07-05T18:56:42.895 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-07-05T18:56:43.023 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:43.021+0000 7f831fd45700 1 Processor -- start 2023-07-05T18:56:43.024 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:43.022+0000 7f831fd45700 1 -- start start 2023-07-05T18:56:43.025 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:43.022+0000 7f831fd45700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f83180b1870 0x7f83180ca6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:56:43.025 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:43.022+0000 7f831fd45700 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f831815e040 con 0x7f83180b13f0 2023-07-05T18:56:43.026 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:43.022+0000 7f831fd45700 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f831815dbb0 con 0x7f83181594f0 2023-07-05T18:56:43.026 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:43.022+0000 7f831fd45700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f83180ce200 con 0x7f83180b1870 2023-07-05T18:56:43.026 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:43.022+0000 7f831d2e0700 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7f83180b13f0 0x7f83180c9fc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:57978/0 (socket says 172.21.15.46:57978) 2023-07-05T18:56:43.026 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:43.022+0000 7f831d2e0700 1 -- 172.21.15.46:0/248889135 learned_addr learned my addr 172.21.15.46:0/248889135 (peer_addr_for_me v1:172.21.15.46:0/0) 2023-07-05T18:56:43.026 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:43.023+0000 7f831e2e2700 1 --2- 172.21.15.46:0/248889135 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f83180b1870 0x7f83180ca6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:56:43.027 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:43.023+0000 7f831cadf700 1 -- 172.21.15.46:0/248889135 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2796964608 0 0) 0x7f831815e040 con 0x7f83180b13f0 2023-07-05T18:56:43.027 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:43.023+0000 7f831cadf700 1 -- 172.21.15.46:0/248889135 --> v1:172.21.15.46:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f83040035b0 con 0x7f83180b13f0 2023-07-05T18:56:43.027 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:43.023+0000 7f831cadf700 1 -- 172.21.15.46:0/248889135 <== mon.1 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 682195110 0 0) 0x7f831815dbb0 con 0x7f83181594f0 2023-07-05T18:56:43.027 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:43.023+0000 7f831cadf700 1 -- 172.21.15.46:0/248889135 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f831815e040 con 0x7f83181594f0 2023-07-05T18:56:43.027 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:43.023+0000 7f831cadf700 1 -- 172.21.15.46:0/248889135 <== mon.0 v1:172.21.15.46:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 76642813 0 0) 0x7f83040035b0 con 0x7f83180b13f0 2023-07-05T18:56:43.027 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:43.023+0000 7f831e2e2700 1 -- 172.21.15.46:0/248889135 >> v1:172.21.15.73:6789/0 conn(0x7f83181594f0 legacy=0x7f83180cd690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:56:43.028 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:43.023+0000 7f831e2e2700 1 -- 172.21.15.46:0/248889135 >> v1:172.21.15.46:6789/0 conn(0x7f83180b13f0 legacy=0x7f83180c9fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:56:43.028 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:43.023+0000 7f831e2e2700 1 -- 172.21.15.46:0/248889135 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f83180cc1c0 con 0x7f83180b1870 2023-07-05T18:56:43.028 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:43.023+0000 7f831e2e2700 1 --2- 172.21.15.46:0/248889135 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f83180b1870 0x7f83180ca6d0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f8310009dc0 tx=0x7f831000b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8d20bf000d36924e server_cookie=0 in_seq=0 out_seq=0 2023-07-05T18:56:43.028 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:43.023+0000 7f831cadf700 1 -- 172.21.15.46:0/248889135 <== mon.2 v2:172.21.15.73:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f831000e070 con 0x7f83180b1870 2023-07-05T18:56:43.029 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:43.024+0000 7f831cadf700 1 -- 172.21.15.46:0/248889135 <== mon.2 v2:172.21.15.73:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8310003a20 con 0x7f83180b1870 2023-07-05T18:56:43.029 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:43.024+0000 7f831cadf700 1 -- 172.21.15.46:0/248889135 <== mon.2 v2:172.21.15.73:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83140015f0 con 0x7f83180b1870 2023-07-05T18:56:43.031 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:43.024+0000 7f831fd45700 1 -- 172.21.15.46:0/248889135 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f83180b1870 msgr2=0x7f83180ca6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:56:43.032 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:43.024+0000 7f831fd45700 1 --2- 172.21.15.46:0/248889135 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f83180b1870 0x7f83180ca6d0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f8310009dc0 tx=0x7f831000b330 comp rx=0 tx=0).stop 2023-07-05T18:56:43.032 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:43.024+0000 7f831fd45700 1 -- 172.21.15.46:0/248889135 shutdown_connections 2023-07-05T18:56:43.032 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:43.024+0000 7f831fd45700 1 --2- 172.21.15.46:0/248889135 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f83180b1870 0x7f83180ca6d0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:43.032 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:43.024+0000 7f831fd45700 1 -- 172.21.15.46:0/248889135 >> 172.21.15.46:0/248889135 conn(0x7f831806bba0 msgr2=0x7f83180cc3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-05T18:56:43.032 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:43.024+0000 7f831fd45700 1 -- 172.21.15.46:0/248889135 shutdown_connections 2023-07-05T18:56:43.032 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:43.024+0000 7f831fd45700 1 -- 172.21.15.46:0/248889135 wait complete. 2023-07-05T18:56:43.032 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:43.025+0000 7f831fd45700 1 Processor -- start 2023-07-05T18:56:43.033 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:43.025+0000 7f831fd45700 1 -- start start 2023-07-05T18:56:43.033 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:43.026+0000 7f831fd45700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f83180b13f0 0x7f831806cbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:56:43.033 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:43.026+0000 7f831fd45700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f83180b1870 0x7f83180b4e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:56:43.033 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:43.026+0000 7f831fd45700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f83181594f0 0x7f83180c5aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:56:43.033 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:43.026+0000 7f831fd45700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83180c5610 con 0x7f83181594f0 2023-07-05T18:56:43.033 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:43.026+0000 7f831fd45700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83180c4a00 con 0x7f83180b1870 2023-07-05T18:56:43.033 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:43.026+0000 7f831fd45700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f83180c4ce0 con 0x7f83180b13f0 2023-07-05T18:56:43.033 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:43.026+0000 7f831e2e2700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f83181594f0 0x7f83180c5aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:56:43.034 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:43.026+0000 7f831e2e2700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f83181594f0 0x7f83180c5aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:58714/0 (socket says 172.21.15.46:58714) 2023-07-05T18:56:43.034 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:43.026+0000 7f831e2e2700 1 -- 172.21.15.46:0/519841856 learned_addr learned my addr 172.21.15.46:0/519841856 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-07-05T18:56:43.034 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:43.026+0000 7f831dae1700 1 --2- 172.21.15.46:0/519841856 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f83180b13f0 0x7f831806cbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:56:43.034 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:43.027+0000 7f831d2e0700 1 --2- 172.21.15.46:0/519841856 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f83180b1870 0x7f83180b4e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:56:43.034 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:43.027+0000 7f831e2e2700 1 -- 172.21.15.46:0/519841856 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f83180b13f0 msgr2=0x7f831806cbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:56:43.034 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:43.027+0000 7f831e2e2700 1 --2- 172.21.15.46:0/519841856 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f83180b13f0 0x7f831806cbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:43.034 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:43.027+0000 7f831e2e2700 1 -- 172.21.15.46:0/519841856 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f83180b1870 msgr2=0x7f83180b4e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:56:43.034 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:43.027+0000 7f831e2e2700 1 --2- 172.21.15.46:0/519841856 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f83180b1870 0x7f83180b4e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:43.035 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:43.027+0000 7f831e2e2700 1 -- 172.21.15.46:0/519841856 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8310009a70 con 0x7f83181594f0 2023-07-05T18:56:43.035 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:43.027+0000 7f831e2e2700 1 --2- 172.21.15.46:0/519841856 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f83181594f0 0x7f83180c5aa0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f8310009d90 tx=0x7f8310004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-05T18:56:43.035 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:43.027+0000 7f830e7fc700 1 -- 172.21.15.46:0/519841856 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8310004540 con 0x7f83181594f0 2023-07-05T18:56:43.035 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:43.027+0000 7f830e7fc700 1 -- 172.21.15.46:0/519841856 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f83100046a0 con 0x7f83181594f0 2023-07-05T18:56:43.035 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:43.027+0000 7f831fd45700 1 -- 172.21.15.46:0/519841856 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f83180c4fc0 con 0x7f83181594f0 2023-07-05T18:56:43.036 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:43.027+0000 7f830e7fc700 1 -- 172.21.15.46:0/519841856 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f831001d470 con 0x7f83181594f0 2023-07-05T18:56:43.036 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:43.027+0000 7f831fd45700 1 -- 172.21.15.46:0/519841856 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f83180c4660 con 0x7f83181594f0 2023-07-05T18:56:43.036 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:43.028+0000 7f831fd45700 1 -- 172.21.15.46:0/519841856 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f83180c5780 con 0x7f83181594f0 2023-07-05T18:56:43.036 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:43.028+0000 7f830e7fc700 1 -- 172.21.15.46:0/519841856 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f831001d5d0 con 0x7f83181594f0 2023-07-05T18:56:43.036 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:43.029+0000 7f830e7fc700 1 --2- 172.21.15.46:0/519841856 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7f82fc06ace0 0x7f82fc06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:56:43.036 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:43.029+0000 7f830e7fc700 1 -- 172.21.15.46:0/519841856 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f831008b230 con 0x7f83181594f0 2023-07-05T18:56:43.036 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:43.029+0000 7f831dae1700 1 --2- 172.21.15.46:0/519841856 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7f82fc06ace0 0x7f82fc06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:56:43.037 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:43.030+0000 7f831dae1700 1 --2- 172.21.15.46:0/519841856 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7f82fc06ace0 0x7f82fc06d190 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f8308000f60 tx=0x7f8308009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-05T18:56:43.037 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:43.033+0000 7f830e7fc700 1 -- 172.21.15.46:0/519841856 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f8310059d80 con 0x7f83181594f0 2023-07-05T18:56:43.232 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:43.231+0000 7f831fd45700 1 -- 172.21.15.46:0/519841856 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f83180672e0 con 0x7f83181594f0 2023-07-05T18:56:43.233 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:43.231+0000 7f830e7fc700 1 -- 172.21.15.46:0/519841856 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v21) v1 ==== 100+0+11 (secure 0 0 0) 0x7f8310059910 con 0x7f83181594f0 2023-07-05T18:56:43.233 INFO:teuthology.orchestra.run.smithi046.stdout:pg_num: 64 2023-07-05T18:56:43.235 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:43.233+0000 7f831fd45700 1 -- 172.21.15.46:0/519841856 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7f82fc06ace0 msgr2=0x7f82fc06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:56:43.235 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:43.233+0000 7f831fd45700 1 --2- 172.21.15.46:0/519841856 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7f82fc06ace0 0x7f82fc06d190 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f8308000f60 tx=0x7f8308009040 comp rx=0 tx=0).stop 2023-07-05T18:56:43.235 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:43.233+0000 7f831fd45700 1 -- 172.21.15.46:0/519841856 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f83181594f0 msgr2=0x7f83180c5aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:56:43.236 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:43.233+0000 7f831fd45700 1 --2- 172.21.15.46:0/519841856 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f83181594f0 0x7f83180c5aa0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f8310009d90 tx=0x7f8310004ad0 comp rx=0 tx=0).stop 2023-07-05T18:56:43.236 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:43.233+0000 7f831fd45700 1 -- 172.21.15.46:0/519841856 shutdown_connections 2023-07-05T18:56:43.236 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:43.233+0000 7f831fd45700 1 --2- 172.21.15.46:0/519841856 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7f82fc06ace0 0x7f82fc06d190 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:43.236 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:43.233+0000 7f831fd45700 1 --2- 172.21.15.46:0/519841856 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f83181594f0 0x7f83180c5aa0 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:43.236 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:43.233+0000 7f831fd45700 1 --2- 172.21.15.46:0/519841856 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f83180b13f0 0x7f831806cbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:43.236 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:43.233+0000 7f831fd45700 1 --2- 172.21.15.46:0/519841856 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f83180b1870 0x7f83180b4e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:43.236 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:43.233+0000 7f831fd45700 1 -- 172.21.15.46:0/519841856 >> 172.21.15.46:0/519841856 conn(0x7f831806bba0 msgr2=0x7f83180cd520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-05T18:56:43.237 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:43.233+0000 7f831fd45700 1 -- 172.21.15.46:0/519841856 shutdown_connections 2023-07-05T18:56:43.237 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:43.233+0000 7f831fd45700 1 -- 172.21.15.46:0/519841856 wait complete. 2023-07-05T18:56:43.247 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-05T18:56:43.373 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:43.371+0000 7f68dcb54700 1 Processor -- start 2023-07-05T18:56:43.374 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:43.371+0000 7f68dcb54700 1 -- start start 2023-07-05T18:56:43.384 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:43.372+0000 7f68dcb54700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f68d8142480 0x7f68d80b41d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:56:43.384 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:43.372+0000 7f68dcb54700 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f68d806c8d0 con 0x7f68d813f4c0 2023-07-05T18:56:43.385 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:43.372+0000 7f68dcb54700 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f68d806cbb0 con 0x7f68d80b4710 2023-07-05T18:56:43.385 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:43.372+0000 7f68dcb54700 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f68d806ce90 con 0x7f68d8142480 2023-07-05T18:56:43.385 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:43.372+0000 7f68d659c700 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7f68d813f4c0 0x7f68d815d6a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:57990/0 (socket says 172.21.15.46:57990) 2023-07-05T18:56:43.385 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:43.372+0000 7f68d659c700 1 -- 172.21.15.46:0/3231007016 learned_addr learned my addr 172.21.15.46:0/3231007016 (peer_addr_for_me v1:172.21.15.46:0/0) 2023-07-05T18:56:43.387 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:43.373+0000 7f68d5d9b700 1 --2- 172.21.15.46:0/3231007016 >> v2:172.21.15.73:3300/0 conn(0x7f68d8142480 0x7f68d80b41d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:56:43.387 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:43.373+0000 7f68d559a700 1 -- 172.21.15.46:0/3231007016 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2306044881 0 0) 0x7f68d806c8d0 con 0x7f68d813f4c0 2023-07-05T18:56:43.387 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:43.373+0000 7f68d559a700 1 -- 172.21.15.46:0/3231007016 --> v1:172.21.15.46:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f68c00035b0 con 0x7f68d813f4c0 2023-07-05T18:56:43.387 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:43.373+0000 7f68d559a700 1 -- 172.21.15.46:0/3231007016 <== mon.0 v1:172.21.15.46:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2176954897 0 0) 0x7f68c00035b0 con 0x7f68d813f4c0 2023-07-05T18:56:43.387 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:43.373+0000 7f68d559a700 1 -- 172.21.15.46:0/3231007016 >> v2:172.21.15.73:3300/0 conn(0x7f68d8142480 msgr2=0x7f68d80b41d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-05T18:56:43.387 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:43.373+0000 7f68d559a700 1 --2- 172.21.15.46:0/3231007016 >> v2:172.21.15.73:3300/0 conn(0x7f68d8142480 0x7f68d80b41d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:43.388 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:43.373+0000 7f68d559a700 1 -- 172.21.15.46:0/3231007016 >> v1:172.21.15.73:6789/0 conn(0x7f68d80b4710 legacy=0x7f68d806d140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:56:43.388 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:43.373+0000 7f68d559a700 1 -- 172.21.15.46:0/3231007016 --> v1:172.21.15.46:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f68d80b39d0 con 0x7f68d813f4c0 2023-07-05T18:56:43.388 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:43.373+0000 7f68d559a700 1 -- 172.21.15.46:0/3231007016 <== mon.0 v1:172.21.15.46:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2195585215 0 0) 0x7f68cc001670 con 0x7f68d813f4c0 2023-07-05T18:56:43.388 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:43.373+0000 7f68d559a700 1 -- 172.21.15.46:0/3231007016 >> v1:172.21.15.46:6789/0 conn(0x7f68d813f4c0 legacy=0x7f68d815d6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:56:43.388 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:43.373+0000 7f68d559a700 1 --2- 172.21.15.46:0/3231007016 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f68c0003a00 0x7f68c0003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:56:43.388 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:43.373+0000 7f68d559a700 1 --2- 172.21.15.46:0/3231007016 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f68c0004850 0x7f68c0004cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:56:43.389 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:43.373+0000 7f68d559a700 1 --2- 172.21.15.46:0/3231007016 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f68c0005200 0x7f68c000ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:56:43.389 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:43.373+0000 7f68d559a700 1 -- 172.21.15.46:0/3231007016 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68d806ce90 con 0x7f68c0005200 2023-07-05T18:56:43.389 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:43.373+0000 7f68d559a700 1 -- 172.21.15.46:0/3231007016 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68c000c080 con 0x7f68c0003a00 2023-07-05T18:56:43.389 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:43.373+0000 7f68d559a700 1 -- 172.21.15.46:0/3231007016 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f68c000c240 con 0x7f68c0004850 2023-07-05T18:56:43.389 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:43.373+0000 7f68d6d9d700 1 --2- 172.21.15.46:0/3231007016 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f68c0005200 0x7f68c000ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:56:43.390 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:43.373+0000 7f68d5d9b700 1 --2- 172.21.15.46:0/3231007016 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f68c0004850 0x7f68c0004cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:56:43.390 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:43.373+0000 7f68d659c700 1 --2- 172.21.15.46:0/3231007016 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f68c0003a00 0x7f68c0003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:56:43.390 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:43.373+0000 7f68d6d9d700 1 -- 172.21.15.46:0/3231007016 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f68c0004850 msgr2=0x7f68c0004cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-05T18:56:43.390 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:43.373+0000 7f68d6d9d700 1 --2- 172.21.15.46:0/3231007016 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f68c0004850 0x7f68c0004cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:43.390 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:43.373+0000 7f68d6d9d700 1 -- 172.21.15.46:0/3231007016 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f68c0003a00 msgr2=0x7f68c0003e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-05T18:56:43.391 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:43.373+0000 7f68d6d9d700 1 --2- 172.21.15.46:0/3231007016 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f68c0003a00 0x7f68c0003e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:43.391 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:43.373+0000 7f68d6d9d700 1 -- 172.21.15.46:0/3231007016 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f68c00035b0 con 0x7f68c0005200 2023-07-05T18:56:43.391 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:43.373+0000 7f68d6d9d700 1 -- 172.21.15.46:0/3231007016 reap_dead start 2023-07-05T18:56:43.391 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:43.374+0000 7f68d6d9d700 1 --2- 172.21.15.46:0/3231007016 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f68c0005200 0x7f68c000ba10 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f68d000c160 tx=0x7f68c0005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8c4674d79a2a6839 server_cookie=0 in_seq=0 out_seq=0 2023-07-05T18:56:43.391 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:43.374+0000 7f68d559a700 1 -- 172.21.15.46:0/3231007016 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68d0001db0 con 0x7f68c0005200 2023-07-05T18:56:43.391 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:43.374+0000 7f68d559a700 1 -- 172.21.15.46:0/3231007016 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f68d000ccc0 con 0x7f68c0005200 2023-07-05T18:56:43.391 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:43.374+0000 7f68d559a700 1 -- 172.21.15.46:0/3231007016 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68d0003c40 con 0x7f68c0005200 2023-07-05T18:56:43.391 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:43.374+0000 7f68dcb54700 1 -- 172.21.15.46:0/3231007016 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f68c0005200 msgr2=0x7f68c000ba10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:56:43.392 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:43.374+0000 7f68dcb54700 1 --2- 172.21.15.46:0/3231007016 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f68c0005200 0x7f68c000ba10 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f68d000c160 tx=0x7f68c0005880 comp rx=0 tx=0).stop 2023-07-05T18:56:43.392 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:43.374+0000 7f68dcb54700 1 -- 172.21.15.46:0/3231007016 shutdown_connections 2023-07-05T18:56:43.392 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:43.374+0000 7f68dcb54700 1 --2- 172.21.15.46:0/3231007016 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f68c0005200 0x7f68c000ba10 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:43.392 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:43.374+0000 7f68dcb54700 1 -- 172.21.15.46:0/3231007016 >> 172.21.15.46:0/3231007016 conn(0x7f68d806af10 msgr2=0x7f68d806b2e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-05T18:56:43.393 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:43.374+0000 7f68dcb54700 1 -- 172.21.15.46:0/3231007016 shutdown_connections 2023-07-05T18:56:43.393 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:43.374+0000 7f68dcb54700 1 -- 172.21.15.46:0/3231007016 wait complete. 2023-07-05T18:56:43.393 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:43.376+0000 7f68dcb54700 1 Processor -- start 2023-07-05T18:56:43.393 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:43.376+0000 7f68dcb54700 1 -- start start 2023-07-05T18:56:43.393 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:43.376+0000 7f68dcb54700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f68c0005200 0x7f68d8156990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:56:43.393 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:43.376+0000 7f68dcb54700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f68d815d360 0x7f68d8069e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:56:43.393 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:43.376+0000 7f68dcb54700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f68d813bd20 0x7f68d806a340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:56:43.394 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:43.377+0000 7f68dcb54700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68d8141e10 con 0x7f68d813bd20 2023-07-05T18:56:43.394 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:43.377+0000 7f68dcb54700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68d806e830 con 0x7f68c0005200 2023-07-05T18:56:43.394 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:43.377+0000 7f68dcb54700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f68d80ac990 con 0x7f68d815d360 2023-07-05T18:56:43.394 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:43.377+0000 7f68d6d9d700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f68d813bd20 0x7f68d806a340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:56:43.394 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:43.377+0000 7f68d6d9d700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f68d813bd20 0x7f68d806a340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:58734/0 (socket says 172.21.15.46:58734) 2023-07-05T18:56:43.394 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:43.377+0000 7f68d6d9d700 1 -- 172.21.15.46:0/2109146509 learned_addr learned my addr 172.21.15.46:0/2109146509 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-07-05T18:56:43.394 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:43.377+0000 7f68d5d9b700 1 --2- 172.21.15.46:0/2109146509 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f68d815d360 0x7f68d8069e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:56:43.394 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:43.377+0000 7f68d659c700 1 --2- 172.21.15.46:0/2109146509 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f68c0005200 0x7f68d8156990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:56:43.395 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:43.377+0000 7f68d6d9d700 1 -- 172.21.15.46:0/2109146509 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f68d815d360 msgr2=0x7f68d8069e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:56:43.395 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:43.377+0000 7f68d6d9d700 1 --2- 172.21.15.46:0/2109146509 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f68d815d360 0x7f68d8069e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:43.395 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:43.377+0000 7f68d6d9d700 1 -- 172.21.15.46:0/2109146509 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f68c0005200 msgr2=0x7f68d8156990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:56:43.395 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:43.377+0000 7f68d6d9d700 1 --2- 172.21.15.46:0/2109146509 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f68c0005200 0x7f68d8156990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:43.395 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:43.377+0000 7f68d6d9d700 1 -- 172.21.15.46:0/2109146509 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f68d80acc70 con 0x7f68d813bd20 2023-07-05T18:56:43.395 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:43.377+0000 7f68d6d9d700 1 --2- 172.21.15.46:0/2109146509 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f68d813bd20 0x7f68d806a340 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f68d0005040 tx=0x7f68d00014a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-05T18:56:43.395 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:43.377+0000 7f68c6ffd700 1 -- 172.21.15.46:0/2109146509 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68d0005070 con 0x7f68d813bd20 2023-07-05T18:56:43.395 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:43.377+0000 7f68c6ffd700 1 -- 172.21.15.46:0/2109146509 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f68d00051d0 con 0x7f68d813bd20 2023-07-05T18:56:43.396 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:43.377+0000 7f68dcb54700 1 -- 172.21.15.46:0/2109146509 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f68d8139d60 con 0x7f68d813bd20 2023-07-05T18:56:43.396 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:43.377+0000 7f68c6ffd700 1 -- 172.21.15.46:0/2109146509 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68d0005540 con 0x7f68d813bd20 2023-07-05T18:56:43.397 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:43.377+0000 7f68dcb54700 1 -- 172.21.15.46:0/2109146509 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f68d8156ed0 con 0x7f68d813bd20 2023-07-05T18:56:43.397 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:43.378+0000 7f68dcb54700 1 -- 172.21.15.46:0/2109146509 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f68d80ace90 con 0x7f68d813bd20 2023-07-05T18:56:43.397 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:43.379+0000 7f68c6ffd700 1 -- 172.21.15.46:0/2109146509 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f68d00056a0 con 0x7f68d813bd20 2023-07-05T18:56:43.397 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:43.379+0000 7f68c6ffd700 1 --2- 172.21.15.46:0/2109146509 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7f68b806ace0 0x7f68b806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:56:43.397 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:43.380+0000 7f68d659c700 1 --2- 172.21.15.46:0/2109146509 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7f68b806ace0 0x7f68b806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:56:43.397 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:43.380+0000 7f68c6ffd700 1 -- 172.21.15.46:0/2109146509 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f68d008a7c0 con 0x7f68d813bd20 2023-07-05T18:56:43.397 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:43.380+0000 7f68d659c700 1 --2- 172.21.15.46:0/2109146509 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7f68b806ace0 0x7f68b806d190 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f68cc000c00 tx=0x7f68cc001b20 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-05T18:56:43.398 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:43.384+0000 7f68c6ffd700 1 -- 172.21.15.46:0/2109146509 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f68d00559c0 con 0x7f68d813bd20 2023-07-05T18:56:43.584 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:43.582+0000 7f68dcb54700 1 -- 172.21.15.46:0/2109146509 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f68d8139f50 con 0x7f68d813bd20 2023-07-05T18:56:43.585 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:43.584+0000 7f68c6ffd700 1 -- 172.21.15.46:0/2109146509 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) v1 ==== 74+0+18161 (secure 0 0 0) 0x7f68d0058fe0 con 0x7f68d813bd20 2023-07-05T18:56:43.586 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T18:56:43.587 INFO:teuthology.orchestra.run.smithi046.stdout:{"epoch":21,"fsid":"042652d3-d80c-4ad8-9366-3e94f2a0a512","created":"2023-07-05T18:55:56.455710+0000","modified":"2023-07-05T18:56:16.095672+0000","last_up_change":"2023-07-05T18:56:06.594022+0000","last_in_change":"2023-07-05T18:55:58.879340+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-07-05T18:56:07.729620+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2023-07-05T18:56:08.128122+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-07-05T18:56:12.954625+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-07-05T18:56:14.068396+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"20009183-9a47-4392-8751-883f88d2bfb1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6813","nonce":4151971443},{"type":"v1","addr":"172.21.15.46:6815","nonce":4151971443}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6817","nonce":4151971443},{"type":"v1","addr":"172.21.15.46:6818","nonce":4151971443}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6822","nonce":4151971443},{"type":"v1","addr":"172.21.15.46:6823","nonce":4151971443}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6820","nonce":4151971443},{"type":"v1","addr":"172.21.15.46:6821","nonce":4151971443}]},"public_addr":"172.21.15.46:6815/4151971443","cluster_addr":"172.21.15.46:6818/4151971443","heartbeat_back_addr":"172.21.15.46:6823/4151971443","heartbeat_front_addr":"172.21.15.46:6821/4151971443","state":["exists","up"]},{"osd":1,"uuid":"91b4a7b0-e4e4-4888-a1fe-9edb0d68004c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6808","nonce":502575881},{"type":"v1","addr":"172.21.15.46:6809","nonce":502575881}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6810","nonce":502575881},{"type":"v1","addr":"172.21.15.46:6811","nonce":502575881}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6816","nonce":502575881},{"type":"v1","addr":"172.21.15.46:6819","nonce":502575881}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6812","nonce":502575881},{"type":"v1","addr":"172.21.15.46:6814","nonce":502575881}]},"public_addr":"172.21.15.46:6809/502575881","cluster_addr":"172.21.15.46:6811/502575881","heartbeat_back_addr":"172.21.15.46:6819/502575881","heartbeat_front_addr":"172.21.15.46:6814/502575881","state":["exists","up"]},{"osd":2,"uuid":"669ff744-1331-47c5-8579-0440731c889a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6800","nonce":2115251461},{"type":"v1","addr":"172.21.15.46:6801","nonce":2115251461}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6802","nonce":2115251461},{"type":"v1","addr":"172.21.15.46:6803","nonce":2115251461}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6806","nonce":2115251461},{"type":"v1","addr":"172.21.15.46:6807","nonce":2115251461}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6804","nonce":2115251461},{"type":"v1","addr":"172.21.15.46:6805","nonce":2115251461}]},"public_addr":"172.21.15.46:6801/2115251461","cluster_addr":"172.21.15.46:6803/2115251461","heartbeat_back_addr":"172.21.15.46:6807/2115251461","heartbeat_front_addr":"172.21.15.46:6805/2115251461","state":["exists","up"]},{"osd":3,"uuid":"34e1b86d-ffad-415d-861c-07a5f08068a6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6824","nonce":2981388766},{"type":"v1","addr":"172.21.15.46:6825","nonce":2981388766}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6826","nonce":2981388766},{"type":"v1","addr":"172.21.15.46:6827","nonce":2981388766}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6830","nonce":2981388766},{"type":"v1","addr":"172.21.15.46:6831","nonce":2981388766}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6828","nonce":2981388766},{"type":"v1","addr":"172.21.15.46:6829","nonce":2981388766}]},"public_addr":"172.21.15.46:6825/2981388766","cluster_addr":"172.21.15.46:6827/2981388766","heartbeat_back_addr":"172.21.15.46:6831/2981388766","heartbeat_front_addr":"172.21.15.46:6829/2981388766","state":["exists","up"]},{"osd":4,"uuid":"57ffcb91-c7dc-4a69-ae71-4d9622a14a05","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6800","nonce":2083655348},{"type":"v1","addr":"172.21.15.73:6801","nonce":2083655348}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6802","nonce":2083655348},{"type":"v1","addr":"172.21.15.73:6803","nonce":2083655348}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6806","nonce":2083655348},{"type":"v1","addr":"172.21.15.73:6807","nonce":2083655348}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6804","nonce":2083655348},{"type":"v1","addr":"172.21.15.73:6805","nonce":2083655348}]},"public_addr":"172.21.15.73:6801/2083655348","cluster_addr":"172.21.15.73:6803/2083655348","heartbeat_back_addr":"172.21.15.73:6807/2083655348","heartbeat_front_addr":"172.21.15.73:6805/2083655348","state":["exists","up"]},{"osd":5,"uuid":"665f41c9-ee20-49cf-bf0e-fbe0c03d3aed","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6824","nonce":2803788401},{"type":"v1","addr":"172.21.15.73:6825","nonce":2803788401}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6826","nonce":2803788401},{"type":"v1","addr":"172.21.15.73:6827","nonce":2803788401}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6830","nonce":2803788401},{"type":"v1","addr":"172.21.15.73:6831","nonce":2803788401}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6828","nonce":2803788401},{"type":"v1","addr":"172.21.15.73:6829","nonce":2803788401}]},"public_addr":"172.21.15.73:6825/2803788401","cluster_addr":"172.21.15.73:6827/2803788401","heartbeat_back_addr":"172.21.15.73:6831/2803788401","heartbeat_front_addr":"172.21.15.73:6829/2803788401","state":["exists","up"]},{"osd":6,"uuid":"5790c6cc-bd56-4ce4-9a7c-0f0c3b59215c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6808","nonce":974108383},{"type":"v1","addr":"172.21.15.73:6809","nonce":974108383}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6810","nonce":974108383},{"type":"v1","addr":"172.21.15.73:6811","nonce":974108383}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6815","nonce":974108383},{"type":"v1","addr":"172.21.15.73:6817","nonce":974108383}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6812","nonce":974108383},{"type":"v1","addr":"172.21.15.73:6813","nonce":974108383}]},"public_addr":"172.21.15.73:6809/974108383","cluster_addr":"172.21.15.73:6811/974108383","heartbeat_back_addr":"172.21.15.73:6817/974108383","heartbeat_front_addr":"172.21.15.73:6813/974108383","state":["exists","up"]},{"osd":7,"uuid":"b66f4d2e-147e-4c9b-97dd-cbd59d33802e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6814","nonce":3772673248},{"type":"v1","addr":"172.21.15.73:6816","nonce":3772673248}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6818","nonce":3772673248},{"type":"v1","addr":"172.21.15.73:6819","nonce":3772673248}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6822","nonce":3772673248},{"type":"v1","addr":"172.21.15.73:6823","nonce":3772673248}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6820","nonce":3772673248},{"type":"v1","addr":"172.21.15.73:6821","nonce":3772673248}]},"public_addr":"172.21.15.73:6816/3772673248","cluster_addr":"172.21.15.73:6819/3772673248","heartbeat_back_addr":"172.21.15.73:6823/3772673248","heartbeat_front_addr":"172.21.15.73:6821/3772673248","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-05T18:56:04.115334+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-05T18:56:04.071250+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-05T18:56:04.044387+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-05T18:56:04.085389+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-05T18:56:04.090726+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-05T18:56:04.074529+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-05T18:56:04.058841+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-05T18:56:04.043054+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-05T18:56:43.588 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:43.586+0000 7f68dcb54700 1 -- 172.21.15.46:0/2109146509 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7f68b806ace0 msgr2=0x7f68b806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:56:43.589 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:43.586+0000 7f68dcb54700 1 --2- 172.21.15.46:0/2109146509 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7f68b806ace0 0x7f68b806d190 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f68cc000c00 tx=0x7f68cc001b20 comp rx=0 tx=0).stop 2023-07-05T18:56:43.589 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:43.586+0000 7f68dcb54700 1 -- 172.21.15.46:0/2109146509 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f68d813bd20 msgr2=0x7f68d806a340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:56:43.589 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:43.586+0000 7f68dcb54700 1 --2- 172.21.15.46:0/2109146509 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f68d813bd20 0x7f68d806a340 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f68d0005040 tx=0x7f68d00014a0 comp rx=0 tx=0).stop 2023-07-05T18:56:43.590 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:43.586+0000 7f68dcb54700 1 -- 172.21.15.46:0/2109146509 shutdown_connections 2023-07-05T18:56:43.590 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:43.586+0000 7f68dcb54700 1 --2- 172.21.15.46:0/2109146509 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7f68b806ace0 0x7f68b806d190 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:43.591 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:43.586+0000 7f68dcb54700 1 --2- 172.21.15.46:0/2109146509 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f68d813bd20 0x7f68d806a340 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:43.591 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:43.586+0000 7f68dcb54700 1 --2- 172.21.15.46:0/2109146509 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f68c0005200 0x7f68d8156990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:43.591 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:43.586+0000 7f68dcb54700 1 --2- 172.21.15.46:0/2109146509 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f68d815d360 0x7f68d8069e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:43.591 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:43.586+0000 7f68dcb54700 1 -- 172.21.15.46:0/2109146509 >> 172.21.15.46:0/2109146509 conn(0x7f68d806af10 msgr2=0x7f68d80b1690 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-05T18:56:43.592 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:43.586+0000 7f68dcb54700 1 -- 172.21.15.46:0/2109146509 shutdown_connections 2023-07-05T18:56:43.592 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:43.586+0000 7f68dcb54700 1 -- 172.21.15.46:0/2109146509 wait complete. 2023-07-05T18:56:43.601 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'rbd', 'create_time': '2023-07-05T18:56:07.729620+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': '.mgr', 'create_time': '2023-07-05T18:56:08.128122+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-07-05T18:56:12.954625+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-07-05T18:56:14.068396+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-07-05T18:56:43.604 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-07-05T18:56:43.732 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:43.730+0000 7f05f6785700 1 Processor -- start 2023-07-05T18:56:43.733 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:43.730+0000 7f05f6785700 1 -- start start 2023-07-05T18:56:43.734 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:43.731+0000 7f05f6785700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f05f00c5590 0x7f05f0069e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:56:43.734 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:43.731+0000 7f05f6785700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f05f006a340 0x7f05f0166040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:56:43.734 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:43.731+0000 7f05f6785700 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f05f006b060 con 0x7f05f006bc70 2023-07-05T18:56:43.734 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:43.731+0000 7f05f6785700 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f05f00c4160 con 0x7f05f00c5590 2023-07-05T18:56:43.735 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:43.731+0000 7f05f6785700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f05f006a7c0 con 0x7f05f006a340 2023-07-05T18:56:43.735 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:43.731+0000 7f05ef7fe700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f05f00c5590 0x7f05f0069e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:56:43.735 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:43.731+0000 7f05effff700 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7f05f006bc70 0x7f05f006c040 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:58010/0 (socket says 172.21.15.46:58010) 2023-07-05T18:56:43.735 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:43.731+0000 7f05effff700 1 -- 172.21.15.46:0/1421078553 learned_addr learned my addr 172.21.15.46:0/1421078553 (peer_addr_for_me v1:172.21.15.46:0/0) 2023-07-05T18:56:43.735 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:43.732+0000 7f05f4d22700 1 --2- 172.21.15.46:0/1421078553 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f05f006a340 0x7f05f0166040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:56:43.735 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:43.732+0000 7f05ef7fe700 1 -- 172.21.15.46:0/1421078553 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f05f006a340 msgr2=0x7f05f0166040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-05T18:56:43.735 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:43.732+0000 7f05ef7fe700 1 --2- 172.21.15.46:0/1421078553 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f05f006a340 0x7f05f0166040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:43.735 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:43.732+0000 7f05ef7fe700 1 -- 172.21.15.46:0/1421078553 >> v1:172.21.15.46:6789/0 conn(0x7f05f006bc70 legacy=0x7f05f006c040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:56:43.736 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:43.732+0000 7f05ef7fe700 1 -- 172.21.15.46:0/1421078553 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f05f006aaa0 con 0x7f05f00c5590 2023-07-05T18:56:43.736 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:43.732+0000 7f05f4d22700 1 --2- 172.21.15.46:0/1421078553 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f05f006a340 0x7f05f0166040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-05T18:56:43.736 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:43.732+0000 7f05ef7fe700 1 --2- 172.21.15.46:0/1421078553 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f05f00c5590 0x7f05f0069e00 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f05e0009840 tx=0x7f05e0009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4251756a5aa27943 server_cookie=0 in_seq=0 out_seq=0 2023-07-05T18:56:43.736 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:43.732+0000 7f05eeffd700 1 -- 172.21.15.46:0/1421078553 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05e0011830 con 0x7f05f00c5590 2023-07-05T18:56:43.736 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:43.732+0000 7f05eeffd700 1 -- 172.21.15.46:0/1421078553 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f05e0011990 con 0x7f05f00c5590 2023-07-05T18:56:43.736 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:43.732+0000 7f05eeffd700 1 -- 172.21.15.46:0/1421078553 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05e0011d20 con 0x7f05f00c5590 2023-07-05T18:56:43.739 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:43.733+0000 7f05f6785700 1 -- 172.21.15.46:0/1421078553 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f05f00c5590 msgr2=0x7f05f0069e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:56:43.739 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:43.733+0000 7f05f6785700 1 --2- 172.21.15.46:0/1421078553 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f05f00c5590 0x7f05f0069e00 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f05e0009840 tx=0x7f05e0009b50 comp rx=0 tx=0).stop 2023-07-05T18:56:43.739 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:43.733+0000 7f05f6785700 1 -- 172.21.15.46:0/1421078553 shutdown_connections 2023-07-05T18:56:43.739 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:43.733+0000 7f05f6785700 1 --2- 172.21.15.46:0/1421078553 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f05f006a340 0x7f05f0166040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:43.739 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:43.733+0000 7f05f6785700 1 --2- 172.21.15.46:0/1421078553 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f05f00c5590 0x7f05f0069e00 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:43.739 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:43.733+0000 7f05f6785700 1 -- 172.21.15.46:0/1421078553 >> 172.21.15.46:0/1421078553 conn(0x7f05f00b19d0 msgr2=0x7f05f00cf120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-05T18:56:43.740 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:43.733+0000 7f05f6785700 1 -- 172.21.15.46:0/1421078553 shutdown_connections 2023-07-05T18:56:43.740 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:43.733+0000 7f05f6785700 1 -- 172.21.15.46:0/1421078553 wait complete. 2023-07-05T18:56:43.740 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:43.734+0000 7f05f6785700 1 Processor -- start 2023-07-05T18:56:43.740 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:43.734+0000 7f05f6785700 1 -- start start 2023-07-05T18:56:43.740 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:43.735+0000 7f05f6785700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f05f006bc70 0x7f05f015c9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:56:43.740 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:43.735+0000 7f05f6785700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f05f00c5590 0x7f05f015b1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:56:43.740 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:43.735+0000 7f05f6785700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f05f015b950 0x7f05f013a710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:56:43.740 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:43.735+0000 7f05f6785700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05f015b700 con 0x7f05f00c5590 2023-07-05T18:56:43.741 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:43.735+0000 7f05f6785700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05f013aff0 con 0x7f05f006bc70 2023-07-05T18:56:43.741 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:43.735+0000 7f05f6785700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f05f013b2d0 con 0x7f05f015b950 2023-07-05T18:56:43.741 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:43.735+0000 7f05ef7fe700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f05f00c5590 0x7f05f015b1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:56:43.741 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:43.735+0000 7f05ef7fe700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f05f00c5590 0x7f05f015b1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:58746/0 (socket says 172.21.15.46:58746) 2023-07-05T18:56:43.741 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:43.735+0000 7f05ef7fe700 1 -- 172.21.15.46:0/2991028029 learned_addr learned my addr 172.21.15.46:0/2991028029 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-07-05T18:56:43.742 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:43.735+0000 7f05f4d22700 1 --2- 172.21.15.46:0/2991028029 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f05f015b950 0x7f05f013a710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:56:43.742 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:43.735+0000 7f05effff700 1 --2- 172.21.15.46:0/2991028029 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f05f006bc70 0x7f05f015c9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:56:43.742 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:43.735+0000 7f05ef7fe700 1 -- 172.21.15.46:0/2991028029 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f05f015b950 msgr2=0x7f05f013a710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:56:43.742 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:43.735+0000 7f05ef7fe700 1 --2- 172.21.15.46:0/2991028029 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f05f015b950 0x7f05f013a710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:43.742 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:43.735+0000 7f05ef7fe700 1 -- 172.21.15.46:0/2991028029 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f05f006bc70 msgr2=0x7f05f015c9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:56:43.743 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:43.735+0000 7f05ef7fe700 1 --2- 172.21.15.46:0/2991028029 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f05f006bc70 0x7f05f015c9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:43.743 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:43.735+0000 7f05ef7fe700 1 -- 172.21.15.46:0/2991028029 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f05e00094a0 con 0x7f05f00c5590 2023-07-05T18:56:43.743 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:43.735+0000 7f05effff700 1 --2- 172.21.15.46:0/2991028029 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f05f006bc70 0x7f05f015c9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-05T18:56:43.743 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:43.735+0000 7f05ef7fe700 1 --2- 172.21.15.46:0/2991028029 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f05f00c5590 0x7f05f015b1c0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f05e00090b0 tx=0x7f05e0004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-05T18:56:43.743 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:43.736+0000 7f05ecff9700 1 -- 172.21.15.46:0/2991028029 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05e00038a0 con 0x7f05f00c5590 2023-07-05T18:56:43.743 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:43.736+0000 7f05ecff9700 1 -- 172.21.15.46:0/2991028029 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f05e0003a20 con 0x7f05f00c5590 2023-07-05T18:56:43.743 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:43.736+0000 7f05f6785700 1 -- 172.21.15.46:0/2991028029 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f05f013b5b0 con 0x7f05f00c5590 2023-07-05T18:56:43.743 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:43.736+0000 7f05ecff9700 1 -- 172.21.15.46:0/2991028029 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05e0003dd0 con 0x7f05f00c5590 2023-07-05T18:56:43.744 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:43.736+0000 7f05f6785700 1 -- 172.21.15.46:0/2991028029 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f05f013ac50 con 0x7f05f00c5590 2023-07-05T18:56:43.744 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:43.737+0000 7f05f6785700 1 -- 172.21.15.46:0/2991028029 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f05f00b3460 con 0x7f05f00c5590 2023-07-05T18:56:43.744 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:43.737+0000 7f05ecff9700 1 -- 172.21.15.46:0/2991028029 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f05e001a420 con 0x7f05f00c5590 2023-07-05T18:56:43.745 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:43.737+0000 7f05ecff9700 1 --2- 172.21.15.46:0/2991028029 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7f05dc06ace0 0x7f05dc06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:56:43.745 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:43.738+0000 7f05ecff9700 1 -- 172.21.15.46:0/2991028029 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f05e008a9c0 con 0x7f05f00c5590 2023-07-05T18:56:43.745 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:43.738+0000 7f05effff700 1 --2- 172.21.15.46:0/2991028029 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7f05dc06ace0 0x7f05dc06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:56:43.745 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:43.738+0000 7f05effff700 1 --2- 172.21.15.46:0/2991028029 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7f05dc06ace0 0x7f05dc06d190 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f05e4005910 tx=0x7f05e4009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-05T18:56:43.745 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:43.742+0000 7f05ecff9700 1 -- 172.21.15.46:0/2991028029 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f05f00b3460 con 0x7f05f00c5590 2023-07-05T18:56:43.945 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:43.943+0000 7f05f6785700 1 -- 172.21.15.46:0/2991028029 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f05f00b3460 con 0x7f05f00c5590 2023-07-05T18:56:43.945 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:43.943+0000 7f05ecff9700 1 -- 172.21.15.46:0/2991028029 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v21) v1 ==== 92+0+10 (secure 0 0 0) 0x7f05f00b3460 con 0x7f05f00c5590 2023-07-05T18:56:43.946 INFO:teuthology.orchestra.run.smithi046.stdout:pg_num: 8 2023-07-05T18:56:43.951 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:43.945+0000 7f05f6785700 1 -- 172.21.15.46:0/2991028029 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7f05dc06ace0 msgr2=0x7f05dc06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:56:43.951 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:43.945+0000 7f05f6785700 1 --2- 172.21.15.46:0/2991028029 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7f05dc06ace0 0x7f05dc06d190 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f05e4005910 tx=0x7f05e4009040 comp rx=0 tx=0).stop 2023-07-05T18:56:43.952 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:43.945+0000 7f05f6785700 1 -- 172.21.15.46:0/2991028029 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f05f00c5590 msgr2=0x7f05f015b1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:56:43.952 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:43.945+0000 7f05f6785700 1 --2- 172.21.15.46:0/2991028029 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f05f00c5590 0x7f05f015b1c0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f05e00090b0 tx=0x7f05e0004750 comp rx=0 tx=0).stop 2023-07-05T18:56:43.952 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:43.945+0000 7f05f6785700 1 -- 172.21.15.46:0/2991028029 shutdown_connections 2023-07-05T18:56:43.952 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:43.945+0000 7f05f6785700 1 --2- 172.21.15.46:0/2991028029 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7f05dc06ace0 0x7f05dc06d190 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:43.953 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:43.945+0000 7f05f6785700 1 --2- 172.21.15.46:0/2991028029 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f05f015b950 0x7f05f013a710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:43.953 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:43.945+0000 7f05f6785700 1 --2- 172.21.15.46:0/2991028029 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f05f006bc70 0x7f05f015c9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:43.953 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:43.945+0000 7f05f6785700 1 --2- 172.21.15.46:0/2991028029 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f05f00c5590 0x7f05f015b1c0 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:43.953 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:43.945+0000 7f05f6785700 1 -- 172.21.15.46:0/2991028029 >> 172.21.15.46:0/2991028029 conn(0x7f05f00b19d0 msgr2=0x7f05f00ce600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-05T18:56:43.953 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:43.945+0000 7f05f6785700 1 -- 172.21.15.46:0/2991028029 shutdown_connections 2023-07-05T18:56:43.953 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:43.945+0000 7f05f6785700 1 -- 172.21.15.46:0/2991028029 wait complete. 2023-07-05T18:56:43.960 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-07-05T18:56:44.089 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:44.087+0000 7f9f60e5d700 1 Processor -- start 2023-07-05T18:56:44.089 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:44.087+0000 7f9f60e5d700 1 -- start start 2023-07-05T18:56:44.095 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:44.088+0000 7f9f60e5d700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f9f5c1592f0 0x7f9f5c06c530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:56:44.095 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:44.088+0000 7f9f60e5d700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f9f5c06ca70 0x7f9f5c0cd5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:56:44.096 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:44.088+0000 7f9f60e5d700 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9f5c0ca470 con 0x7f9f5c0cdb20 2023-07-05T18:56:44.096 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:44.088+0000 7f9f60e5d700 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9f5c0cdf10 con 0x7f9f5c1592f0 2023-07-05T18:56:44.096 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:44.088+0000 7f9f60e5d700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9f5c06cf10 con 0x7f9f5c06ca70 2023-07-05T18:56:44.097 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:44.088+0000 7f9f5a59c700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f9f5c1592f0 0x7f9f5c06c530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:56:44.097 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:44.088+0000 7f9f5ad9d700 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7f9f5c0cdb20 0x7f9f5c15cf00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:58028/0 (socket says 172.21.15.46:58028) 2023-07-05T18:56:44.097 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:44.088+0000 7f9f5ad9d700 1 -- 172.21.15.46:0/924735148 learned_addr learned my addr 172.21.15.46:0/924735148 (peer_addr_for_me v1:172.21.15.46:0/0) 2023-07-05T18:56:44.097 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:44.088+0000 7f9f59d9b700 1 --2- 172.21.15.46:0/924735148 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f9f5c06ca70 0x7f9f5c0cd5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:56:44.097 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:44.088+0000 7f9f5a59c700 1 -- 172.21.15.46:0/924735148 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f9f5c06ca70 msgr2=0x7f9f5c0cd5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-05T18:56:44.097 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:44.088+0000 7f9f5a59c700 1 --2- 172.21.15.46:0/924735148 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f9f5c06ca70 0x7f9f5c0cd5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:44.097 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:44.088+0000 7f9f5a59c700 1 -- 172.21.15.46:0/924735148 >> v1:172.21.15.46:6789/0 conn(0x7f9f5c0cdb20 legacy=0x7f9f5c15cf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:56:44.098 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:44.088+0000 7f9f5a59c700 1 -- 172.21.15.46:0/924735148 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9f5c06d1f0 con 0x7f9f5c1592f0 2023-07-05T18:56:44.098 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:44.088+0000 7f9f59d9b700 1 --2- 172.21.15.46:0/924735148 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f9f5c06ca70 0x7f9f5c0cd5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-05T18:56:44.098 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:44.088+0000 7f9f5a59c700 1 --2- 172.21.15.46:0/924735148 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9f5c1592f0 0x7f9f5c06c530 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f9f4c009840 tx=0x7f9f4c009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fc62db1b0ab5fbd3 server_cookie=0 in_seq=0 out_seq=0 2023-07-05T18:56:44.098 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:44.089+0000 7f9f5959a700 1 -- 172.21.15.46:0/924735148 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f4c011830 con 0x7f9f5c1592f0 2023-07-05T18:56:44.098 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:44.089+0000 7f9f5959a700 1 -- 172.21.15.46:0/924735148 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9f4c011990 con 0x7f9f5c1592f0 2023-07-05T18:56:44.098 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:44.089+0000 7f9f5959a700 1 -- 172.21.15.46:0/924735148 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f4c011d20 con 0x7f9f5c1592f0 2023-07-05T18:56:44.099 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:44.089+0000 7f9f60e5d700 1 -- 172.21.15.46:0/924735148 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9f5c1592f0 msgr2=0x7f9f5c06c530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:56:44.099 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:44.089+0000 7f9f60e5d700 1 --2- 172.21.15.46:0/924735148 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9f5c1592f0 0x7f9f5c06c530 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f9f4c009840 tx=0x7f9f4c009b50 comp rx=0 tx=0).stop 2023-07-05T18:56:44.099 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:44.089+0000 7f9f60e5d700 1 -- 172.21.15.46:0/924735148 shutdown_connections 2023-07-05T18:56:44.102 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:44.089+0000 7f9f60e5d700 1 --2- 172.21.15.46:0/924735148 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9f5c1592f0 0x7f9f5c06c530 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:44.103 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:44.089+0000 7f9f60e5d700 1 --2- 172.21.15.46:0/924735148 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f9f5c06ca70 0x7f9f5c0cd5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:44.103 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:44.089+0000 7f9f60e5d700 1 -- 172.21.15.46:0/924735148 >> 172.21.15.46:0/924735148 conn(0x7f9f5c0b1580 msgr2=0x7f9f5c0b1980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-05T18:56:44.103 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:44.089+0000 7f9f60e5d700 1 -- 172.21.15.46:0/924735148 shutdown_connections 2023-07-05T18:56:44.103 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:44.089+0000 7f9f60e5d700 1 -- 172.21.15.46:0/924735148 wait complete. 2023-07-05T18:56:44.104 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:44.091+0000 7f9f60e5d700 1 Processor -- start 2023-07-05T18:56:44.104 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:44.091+0000 7f9f60e5d700 1 -- start start 2023-07-05T18:56:44.104 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:44.091+0000 7f9f60e5d700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9f5c06ca70 0x7f9f5c146e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:56:44.105 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:44.091+0000 7f9f60e5d700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f9f5c0cdb20 0x7f9f5c1f25a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:56:44.105 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:44.091+0000 7f9f60e5d700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9f5c1592f0 0x7f9f5c1f2ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:56:44.106 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:44.091+0000 7f9f60e5d700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f5c1559d0 con 0x7f9f5c06ca70 2023-07-05T18:56:44.106 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:44.091+0000 7f9f60e5d700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f5c147340 con 0x7f9f5c1592f0 2023-07-05T18:56:44.106 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:44.091+0000 7f9f60e5d700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9f5c0c5e40 con 0x7f9f5c0cdb20 2023-07-05T18:56:44.107 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:44.092+0000 7f9f5a59c700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9f5c06ca70 0x7f9f5c146e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:56:44.107 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:44.092+0000 7f9f5a59c700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9f5c06ca70 0x7f9f5c146e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:58758/0 (socket says 172.21.15.46:58758) 2023-07-05T18:56:44.107 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:44.092+0000 7f9f5a59c700 1 -- 172.21.15.46:0/4018236608 learned_addr learned my addr 172.21.15.46:0/4018236608 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-07-05T18:56:44.107 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:44.092+0000 7f9f59d9b700 1 --2- 172.21.15.46:0/4018236608 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f9f5c0cdb20 0x7f9f5c1f25a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:56:44.108 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:44.092+0000 7f9f5a59c700 1 -- 172.21.15.46:0/4018236608 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f9f5c0cdb20 msgr2=0x7f9f5c1f25a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:56:44.108 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:44.092+0000 7f9f5a59c700 1 --2- 172.21.15.46:0/4018236608 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f9f5c0cdb20 0x7f9f5c1f25a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:44.108 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:44.092+0000 7f9f5a59c700 1 -- 172.21.15.46:0/4018236608 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9f5c1592f0 msgr2=0x7f9f5c1f2ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:56:44.109 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:44.092+0000 7f9f5ad9d700 1 --2- 172.21.15.46:0/4018236608 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9f5c1592f0 0x7f9f5c1f2ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:56:44.109 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:44.092+0000 7f9f5a59c700 1 --2- 172.21.15.46:0/4018236608 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9f5c1592f0 0x7f9f5c1f2ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:44.109 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:44.092+0000 7f9f5a59c700 1 -- 172.21.15.46:0/4018236608 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9f4c0094a0 con 0x7f9f5c06ca70 2023-07-05T18:56:44.110 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:44.092+0000 7f9f59d9b700 1 --2- 172.21.15.46:0/4018236608 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f9f5c0cdb20 0x7f9f5c1f25a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-05T18:56:44.110 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:44.092+0000 7f9f5ad9d700 1 --2- 172.21.15.46:0/4018236608 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9f5c1592f0 0x7f9f5c1f2ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-05T18:56:44.110 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:44.092+0000 7f9f5a59c700 1 --2- 172.21.15.46:0/4018236608 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9f5c06ca70 0x7f9f5c146e00 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f9f4c000c00 tx=0x7f9f4c004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-05T18:56:44.110 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:44.092+0000 7f9f4affd700 1 -- 172.21.15.46:0/4018236608 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f4c0036a0 con 0x7f9f5c06ca70 2023-07-05T18:56:44.111 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:44.092+0000 7f9f4affd700 1 -- 172.21.15.46:0/4018236608 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9f4c01e070 con 0x7f9f5c06ca70 2023-07-05T18:56:44.111 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:44.092+0000 7f9f60e5d700 1 -- 172.21.15.46:0/4018236608 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9f5c155c20 con 0x7f9f5c06ca70 2023-07-05T18:56:44.112 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:44.092+0000 7f9f4affd700 1 -- 172.21.15.46:0/4018236608 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f4c003a60 con 0x7f9f5c06ca70 2023-07-05T18:56:44.112 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:44.092+0000 7f9f60e5d700 1 -- 172.21.15.46:0/4018236608 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9f5c1561e0 con 0x7f9f5c06ca70 2023-07-05T18:56:44.113 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:44.093+0000 7f9f60e5d700 1 -- 172.21.15.46:0/4018236608 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9f5c0cd090 con 0x7f9f5c06ca70 2023-07-05T18:56:44.113 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:44.094+0000 7f9f4affd700 1 -- 172.21.15.46:0/4018236608 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f9f4c003bc0 con 0x7f9f5c06ca70 2023-07-05T18:56:44.115 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:44.094+0000 7f9f4affd700 1 --2- 172.21.15.46:0/4018236608 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7f9f3c06ace0 0x7f9f3c06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:56:44.115 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:44.094+0000 7f9f4affd700 1 -- 172.21.15.46:0/4018236608 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f9f4c08a4f0 con 0x7f9f5c06ca70 2023-07-05T18:56:44.115 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:44.094+0000 7f9f59d9b700 1 --2- 172.21.15.46:0/4018236608 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7f9f3c06ace0 0x7f9f3c06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:56:44.116 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:44.095+0000 7f9f59d9b700 1 --2- 172.21.15.46:0/4018236608 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7f9f3c06ace0 0x7f9f3c06d190 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f9f5c0cb730 tx=0x7f9f50008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-05T18:56:44.116 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:44.099+0000 7f9f4affd700 1 -- 172.21.15.46:0/4018236608 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f9f4c055630 con 0x7f9f5c06ca70 2023-07-05T18:56:44.299 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:44.297+0000 7f9f60e5d700 1 -- 172.21.15.46:0/4018236608 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f9f5c0cb480 con 0x7f9f5c06ca70 2023-07-05T18:56:44.300 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:44.297+0000 7f9f4affd700 1 -- 172.21.15.46:0/4018236608 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v21) v1 ==== 93+0+10 (secure 0 0 0) 0x7f9f4c058c50 con 0x7f9f5c06ca70 2023-07-05T18:56:44.300 INFO:teuthology.orchestra.run.smithi046.stdout:pg_num: 1 2023-07-05T18:56:44.302 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:44.299+0000 7f9f60e5d700 1 -- 172.21.15.46:0/4018236608 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7f9f3c06ace0 msgr2=0x7f9f3c06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:56:44.303 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:44.299+0000 7f9f60e5d700 1 --2- 172.21.15.46:0/4018236608 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7f9f3c06ace0 0x7f9f3c06d190 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f9f5c0cb730 tx=0x7f9f50008040 comp rx=0 tx=0).stop 2023-07-05T18:56:44.303 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:44.299+0000 7f9f60e5d700 1 -- 172.21.15.46:0/4018236608 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9f5c06ca70 msgr2=0x7f9f5c146e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:56:44.303 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:44.299+0000 7f9f60e5d700 1 --2- 172.21.15.46:0/4018236608 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9f5c06ca70 0x7f9f5c146e00 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f9f4c000c00 tx=0x7f9f4c004750 comp rx=0 tx=0).stop 2023-07-05T18:56:44.304 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:44.300+0000 7f9f60e5d700 1 -- 172.21.15.46:0/4018236608 shutdown_connections 2023-07-05T18:56:44.304 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:44.300+0000 7f9f60e5d700 1 --2- 172.21.15.46:0/4018236608 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7f9f3c06ace0 0x7f9f3c06d190 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:44.305 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:44.300+0000 7f9f60e5d700 1 --2- 172.21.15.46:0/4018236608 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9f5c1592f0 0x7f9f5c1f2ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:44.305 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:44.300+0000 7f9f60e5d700 1 --2- 172.21.15.46:0/4018236608 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9f5c06ca70 0x7f9f5c146e00 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:44.307 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:44.300+0000 7f9f60e5d700 1 --2- 172.21.15.46:0/4018236608 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f9f5c0cdb20 0x7f9f5c1f25a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:44.307 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:44.300+0000 7f9f60e5d700 1 -- 172.21.15.46:0/4018236608 >> 172.21.15.46:0/4018236608 conn(0x7f9f5c0b1580 msgr2=0x7f9f5c06d650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-05T18:56:44.307 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:44.300+0000 7f9f60e5d700 1 -- 172.21.15.46:0/4018236608 shutdown_connections 2023-07-05T18:56:44.307 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:44.300+0000 7f9f60e5d700 1 -- 172.21.15.46:0/4018236608 wait complete. 2023-07-05T18:56:44.315 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-07-05T18:56:44.445 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:44.442+0000 7f3d89884700 1 Processor -- start 2023-07-05T18:56:44.445 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:44.443+0000 7f3d89884700 1 -- start start 2023-07-05T18:56:44.447 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:44.443+0000 7f3d89884700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f3d8415c6c0 0x7f3d840cd2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:56:44.447 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:44.443+0000 7f3d89884700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f3d840b5ae0 0x7f3d840b5ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:56:44.447 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:44.443+0000 7f3d89884700 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3d840cd8c0 con 0x7f3d8415c2f0 2023-07-05T18:56:44.447 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:44.443+0000 7f3d89884700 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3d840d0990 con 0x7f3d8415c6c0 2023-07-05T18:56:44.447 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:44.443+0000 7f3d89884700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3d840d0c70 con 0x7f3d840b5ae0 2023-07-05T18:56:44.447 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:44.444+0000 7f3d827fc700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f3d8415c6c0 0x7f3d840cd2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:56:44.448 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:44.444+0000 7f3d837fe700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f3d840b5ae0 0x7f3d840b5ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:56:44.448 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:44.444+0000 7f3d837fe700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f3d840b5ae0 0x7f3d840b5ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3301/0 says I am v2:172.21.15.46:42456/0 (socket says 172.21.15.46:42456) 2023-07-05T18:56:44.448 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:44.444+0000 7f3d837fe700 1 -- 172.21.15.46:0/2816390195 learned_addr learned my addr 172.21.15.46:0/2816390195 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-07-05T18:56:44.448 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:44.444+0000 7f3d82ffd700 1 --1- 172.21.15.46:0/2816390195 >> v1:172.21.15.73:6789/0 conn(0x7f3d8415c2f0 0x7f3d8406c760 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.46:43954/0 (socket says 172.21.15.46:43954) 2023-07-05T18:56:44.448 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:44.444+0000 7f3d837fe700 1 -- 172.21.15.46:0/2816390195 >> v2:172.21.15.73:3300/0 conn(0x7f3d8415c6c0 msgr2=0x7f3d840cd2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-05T18:56:44.448 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:44.444+0000 7f3d837fe700 1 --2- 172.21.15.46:0/2816390195 >> v2:172.21.15.73:3300/0 conn(0x7f3d8415c6c0 0x7f3d840cd2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:44.448 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:44.444+0000 7f3d837fe700 1 -- 172.21.15.46:0/2816390195 >> v1:172.21.15.73:6789/0 conn(0x7f3d8415c2f0 legacy=0x7f3d8406c760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:56:44.449 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:44.444+0000 7f3d837fe700 1 -- 172.21.15.46:0/2816390195 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3d840d0f50 con 0x7f3d840b5ae0 2023-07-05T18:56:44.450 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:44.444+0000 7f3d827fc700 1 --2- 172.21.15.46:0/2816390195 >> v2:172.21.15.73:3300/0 conn(0x7f3d8415c6c0 0x7f3d840cd2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-05T18:56:44.450 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:44.444+0000 7f3d837fe700 1 --2- 172.21.15.46:0/2816390195 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f3d840b5ae0 0x7f3d840b5ef0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f3d7c009e50 tx=0x7f3d7c00b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2177d1887cdc1096 server_cookie=0 in_seq=0 out_seq=0 2023-07-05T18:56:44.450 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:44.444+0000 7f3d81ffb700 1 -- 172.21.15.46:0/2816390195 <== mon.2 v2:172.21.15.73:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d7c00e070 con 0x7f3d840b5ae0 2023-07-05T18:56:44.451 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:44.445+0000 7f3d81ffb700 1 -- 172.21.15.46:0/2816390195 <== mon.2 v2:172.21.15.73:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3d7c00b910 con 0x7f3d840b5ae0 2023-07-05T18:56:44.451 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:44.445+0000 7f3d81ffb700 1 -- 172.21.15.46:0/2816390195 <== mon.2 v2:172.21.15.73:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d7c00bcc0 con 0x7f3d840b5ae0 2023-07-05T18:56:44.451 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:44.445+0000 7f3d89884700 1 -- 172.21.15.46:0/2816390195 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f3d840b5ae0 msgr2=0x7f3d840b5ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:56:44.451 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:44.445+0000 7f3d89884700 1 --2- 172.21.15.46:0/2816390195 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f3d840b5ae0 0x7f3d840b5ef0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f3d7c009e50 tx=0x7f3d7c00b330 comp rx=0 tx=0).stop 2023-07-05T18:56:44.451 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:44.445+0000 7f3d89884700 1 -- 172.21.15.46:0/2816390195 shutdown_connections 2023-07-05T18:56:44.451 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:44.445+0000 7f3d89884700 1 --2- 172.21.15.46:0/2816390195 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f3d840b5ae0 0x7f3d840b5ef0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:44.451 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:44.445+0000 7f3d89884700 1 --2- 172.21.15.46:0/2816390195 >> v2:172.21.15.73:3300/0 conn(0x7f3d8415c6c0 0x7f3d840cd2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:44.452 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:44.445+0000 7f3d89884700 1 -- 172.21.15.46:0/2816390195 >> 172.21.15.46:0/2816390195 conn(0x7f3d8406afa0 msgr2=0x7f3d840cf710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-05T18:56:44.452 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:44.445+0000 7f3d89884700 1 -- 172.21.15.46:0/2816390195 shutdown_connections 2023-07-05T18:56:44.452 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:44.445+0000 7f3d89884700 1 -- 172.21.15.46:0/2816390195 wait complete. 2023-07-05T18:56:44.455 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:44.446+0000 7f3d89884700 1 Processor -- start 2023-07-05T18:56:44.456 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:44.447+0000 7f3d89884700 1 -- start start 2023-07-05T18:56:44.456 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:44.447+0000 7f3d89884700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3d840b5ae0 0x7f3d841f1610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:56:44.456 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:44.447+0000 7f3d89884700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f3d8415c2f0 0x7f3d840c67c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:56:44.457 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:44.447+0000 7f3d89884700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3d8415c6c0 0x7f3d8415e420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:56:44.457 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:44.447+0000 7f3d89884700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d840c7f00 con 0x7f3d840b5ae0 2023-07-05T18:56:44.457 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:44.447+0000 7f3d89884700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d840c7280 con 0x7f3d8415c6c0 2023-07-05T18:56:44.457 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:44.447+0000 7f3d89884700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3d840c7560 con 0x7f3d8415c2f0 2023-07-05T18:56:44.457 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:44.447+0000 7f3d82ffd700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3d840b5ae0 0x7f3d841f1610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:56:44.457 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:44.447+0000 7f3d82ffd700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3d840b5ae0 0x7f3d841f1610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:58772/0 (socket says 172.21.15.46:58772) 2023-07-05T18:56:44.457 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:44.447+0000 7f3d82ffd700 1 -- 172.21.15.46:0/3024191518 learned_addr learned my addr 172.21.15.46:0/3024191518 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-07-05T18:56:44.458 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:44.447+0000 7f3d837fe700 1 --2- 172.21.15.46:0/3024191518 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3d8415c6c0 0x7f3d8415e420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:56:44.458 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:44.447+0000 7f3d827fc700 1 --2- 172.21.15.46:0/3024191518 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f3d8415c2f0 0x7f3d840c67c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:56:44.458 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:44.448+0000 7f3d82ffd700 1 -- 172.21.15.46:0/3024191518 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f3d8415c2f0 msgr2=0x7f3d840c67c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:56:44.458 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:44.448+0000 7f3d82ffd700 1 --2- 172.21.15.46:0/3024191518 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f3d8415c2f0 0x7f3d840c67c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:44.458 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:44.448+0000 7f3d82ffd700 1 -- 172.21.15.46:0/3024191518 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3d8415c6c0 msgr2=0x7f3d8415e420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:56:44.458 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:44.448+0000 7f3d82ffd700 1 --2- 172.21.15.46:0/3024191518 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3d8415c6c0 0x7f3d8415e420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:44.458 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:44.448+0000 7f3d82ffd700 1 -- 172.21.15.46:0/3024191518 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3d740094a0 con 0x7f3d840b5ae0 2023-07-05T18:56:44.458 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:44.448+0000 7f3d837fe700 1 --2- 172.21.15.46:0/3024191518 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3d8415c6c0 0x7f3d8415e420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-05T18:56:44.459 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:44.448+0000 7f3d82ffd700 1 --2- 172.21.15.46:0/3024191518 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3d840b5ae0 0x7f3d841f1610 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f3d7800c520 tx=0x7f3d7800c830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-05T18:56:44.459 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:44.448+0000 7f3d6bfff700 1 -- 172.21.15.46:0/3024191518 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d78005cb0 con 0x7f3d840b5ae0 2023-07-05T18:56:44.459 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:44.448+0000 7f3d6bfff700 1 -- 172.21.15.46:0/3024191518 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3d78005e10 con 0x7f3d840b5ae0 2023-07-05T18:56:44.459 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:44.448+0000 7f3d89884700 1 -- 172.21.15.46:0/3024191518 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3d7c009b30 con 0x7f3d840b5ae0 2023-07-05T18:56:44.459 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:44.448+0000 7f3d6bfff700 1 -- 172.21.15.46:0/3024191518 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d780072d0 con 0x7f3d840b5ae0 2023-07-05T18:56:44.459 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:44.448+0000 7f3d89884700 1 -- 172.21.15.46:0/3024191518 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3d840c7b20 con 0x7f3d840b5ae0 2023-07-05T18:56:44.459 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:44.449+0000 7f3d89884700 1 -- 172.21.15.46:0/3024191518 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3d840c8040 con 0x7f3d840b5ae0 2023-07-05T18:56:44.460 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:44.450+0000 7f3d6bfff700 1 -- 172.21.15.46:0/3024191518 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f3d78007430 con 0x7f3d840b5ae0 2023-07-05T18:56:44.460 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:44.450+0000 7f3d6bfff700 1 --2- 172.21.15.46:0/3024191518 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7f3d7006ace0 0x7f3d7006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:56:44.460 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:44.450+0000 7f3d6bfff700 1 -- 172.21.15.46:0/3024191518 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f3d78088680 con 0x7f3d840b5ae0 2023-07-05T18:56:44.460 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:44.450+0000 7f3d827fc700 1 --2- 172.21.15.46:0/3024191518 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7f3d7006ace0 0x7f3d7006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:56:44.460 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:44.451+0000 7f3d827fc700 1 --2- 172.21.15.46:0/3024191518 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7f3d7006ace0 0x7f3d7006d190 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f3d8415cb00 tx=0x7f3d74009210 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-05T18:56:44.461 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:44.454+0000 7f3d6bfff700 1 -- 172.21.15.46:0/3024191518 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f3d78053870 con 0x7f3d840b5ae0 2023-07-05T18:56:44.654 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:44.652+0000 7f3d89884700 1 -- 172.21.15.46:0/3024191518 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f3d8404e1d0 con 0x7f3d840b5ae0 2023-07-05T18:56:44.654 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:44.652+0000 7f3d6bfff700 1 -- 172.21.15.46:0/3024191518 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v21) v1 ==== 104+0+11 (secure 0 0 0) 0x7f3d78056e90 con 0x7f3d840b5ae0 2023-07-05T18:56:44.654 INFO:teuthology.orchestra.run.smithi046.stdout:pg_num: 32 2023-07-05T18:56:44.656 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:44.654+0000 7f3d89884700 1 -- 172.21.15.46:0/3024191518 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7f3d7006ace0 msgr2=0x7f3d7006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:56:44.657 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:44.654+0000 7f3d89884700 1 --2- 172.21.15.46:0/3024191518 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7f3d7006ace0 0x7f3d7006d190 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f3d8415cb00 tx=0x7f3d74009210 comp rx=0 tx=0).stop 2023-07-05T18:56:44.657 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:44.654+0000 7f3d89884700 1 -- 172.21.15.46:0/3024191518 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3d840b5ae0 msgr2=0x7f3d841f1610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:56:44.657 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:44.654+0000 7f3d89884700 1 --2- 172.21.15.46:0/3024191518 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3d840b5ae0 0x7f3d841f1610 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f3d7800c520 tx=0x7f3d7800c830 comp rx=0 tx=0).stop 2023-07-05T18:56:44.657 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:44.654+0000 7f3d89884700 1 -- 172.21.15.46:0/3024191518 shutdown_connections 2023-07-05T18:56:44.657 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:44.654+0000 7f3d89884700 1 --2- 172.21.15.46:0/3024191518 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7f3d7006ace0 0x7f3d7006d190 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:44.657 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:44.654+0000 7f3d89884700 1 --2- 172.21.15.46:0/3024191518 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3d8415c6c0 0x7f3d8415e420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:44.657 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:44.654+0000 7f3d89884700 1 --2- 172.21.15.46:0/3024191518 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3d840b5ae0 0x7f3d841f1610 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:44.658 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:44.654+0000 7f3d89884700 1 --2- 172.21.15.46:0/3024191518 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f3d8415c2f0 0x7f3d840c67c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:44.658 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:44.654+0000 7f3d89884700 1 -- 172.21.15.46:0/3024191518 >> 172.21.15.46:0/3024191518 conn(0x7f3d8406afa0 msgr2=0x7f3d84159ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-05T18:56:44.658 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:44.654+0000 7f3d89884700 1 -- 172.21.15.46:0/3024191518 shutdown_connections 2023-07-05T18:56:44.658 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:44.654+0000 7f3d89884700 1 -- 172.21.15.46:0/3024191518 wait complete. 2023-07-05T18:56:44.670 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-07-05T18:56:44.800 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:44.796+0000 7ff666aeb700 1 Processor -- start 2023-07-05T18:56:44.800 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:44.796+0000 7ff666aeb700 1 -- start start 2023-07-05T18:56:44.800 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:44.797+0000 7ff666aeb700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7ff66015c860 0x7ff660160ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:56:44.801 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:44.797+0000 7ff666aeb700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7ff66006a510 0x7ff66006c1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:56:44.801 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:44.797+0000 7ff666aeb700 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff6600ce640 con 0x7ff6600715c0 2023-07-05T18:56:44.801 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:44.797+0000 7ff666aeb700 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff6601611e0 con 0x7ff66015c860 2023-07-05T18:56:44.802 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:44.797+0000 7ff666aeb700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff6600ce870 con 0x7ff66006a510 2023-07-05T18:56:44.802 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:44.797+0000 7ff664887700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7ff66015c860 0x7ff660160ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:56:44.802 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:44.797+0000 7ff665088700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7ff66006a510 0x7ff66006c1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:56:44.803 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:44.797+0000 7ff664887700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7ff66015c860 0x7ff660160ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.46:58264/0 (socket says 172.21.15.46:58264) 2023-07-05T18:56:44.803 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:44.797+0000 7ff665088700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7ff66006a510 0x7ff66006c1f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3301/0 says I am v2:172.21.15.46:42470/0 (socket says 172.21.15.46:42470) 2023-07-05T18:56:44.803 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:44.797+0000 7ff664887700 1 -- 172.21.15.46:0/2241940161 learned_addr learned my addr 172.21.15.46:0/2241940161 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-07-05T18:56:44.803 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:44.797+0000 7ff65ffff700 1 --1- 172.21.15.46:0/2241940161 >> v1:172.21.15.73:6789/0 conn(0x7ff6600715c0 0x7ff660069e00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.46:43968/0 (socket says 172.21.15.46:43968) 2023-07-05T18:56:44.803 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:44.798+0000 7ff664887700 1 -- 172.21.15.46:0/2241940161 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7ff66006a510 msgr2=0x7ff66006c1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-05T18:56:44.803 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:44.798+0000 7ff664887700 1 --2- 172.21.15.46:0/2241940161 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7ff66006a510 0x7ff66006c1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:44.803 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:44.798+0000 7ff664887700 1 -- 172.21.15.46:0/2241940161 >> v1:172.21.15.73:6789/0 conn(0x7ff6600715c0 legacy=0x7ff660069e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:56:44.804 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:44.798+0000 7ff664887700 1 -- 172.21.15.46:0/2241940161 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff6600ceb50 con 0x7ff66015c860 2023-07-05T18:56:44.804 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:44.798+0000 7ff65f7fe700 1 -- 172.21.15.46:0/2241940161 <== mon.1 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2993154512 0 0) 0x7ff6600ce640 con 0x7ff6600715c0 2023-07-05T18:56:44.804 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:44.798+0000 7ff664887700 1 --2- 172.21.15.46:0/2241940161 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff66015c860 0x7ff660160ca0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7ff6540098f0 tx=0x7ff654009c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=58e00e8ad836b6f1 server_cookie=0 in_seq=0 out_seq=0 2023-07-05T18:56:44.804 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:44.798+0000 7ff65f7fe700 1 -- 172.21.15.46:0/2241940161 <== mon.1 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff654011830 con 0x7ff66015c860 2023-07-05T18:56:44.804 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:44.798+0000 7ff65f7fe700 1 -- 172.21.15.46:0/2241940161 <== mon.1 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff654011990 con 0x7ff66015c860 2023-07-05T18:56:44.805 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:44.798+0000 7ff65f7fe700 1 -- 172.21.15.46:0/2241940161 <== mon.1 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff654011d20 con 0x7ff66015c860 2023-07-05T18:56:44.810 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:44.798+0000 7ff666aeb700 1 -- 172.21.15.46:0/2241940161 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff66015c860 msgr2=0x7ff660160ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:56:44.810 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:44.798+0000 7ff666aeb700 1 --2- 172.21.15.46:0/2241940161 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff66015c860 0x7ff660160ca0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7ff6540098f0 tx=0x7ff654009c00 comp rx=0 tx=0).stop 2023-07-05T18:56:44.810 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:44.799+0000 7ff666aeb700 1 -- 172.21.15.46:0/2241940161 shutdown_connections 2023-07-05T18:56:44.811 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:44.799+0000 7ff666aeb700 1 --2- 172.21.15.46:0/2241940161 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7ff66006a510 0x7ff66006c1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:44.811 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:44.799+0000 7ff666aeb700 1 --2- 172.21.15.46:0/2241940161 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff66015c860 0x7ff660160ca0 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:44.811 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:44.799+0000 7ff666aeb700 1 -- 172.21.15.46:0/2241940161 >> 172.21.15.46:0/2241940161 conn(0x7ff66006bba0 msgr2=0x7ff6600cc3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-05T18:56:44.812 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:44.799+0000 7ff666aeb700 1 -- 172.21.15.46:0/2241940161 shutdown_connections 2023-07-05T18:56:44.812 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:44.799+0000 7ff666aeb700 1 -- 172.21.15.46:0/2241940161 wait complete. 2023-07-05T18:56:44.812 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:44.800+0000 7ff666aeb700 1 Processor -- start 2023-07-05T18:56:44.813 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:44.800+0000 7ff666aeb700 1 -- start start 2023-07-05T18:56:44.813 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:44.801+0000 7ff666aeb700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7ff66006a510 0x7ff660149e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:56:44.813 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:44.801+0000 7ff666aeb700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff6600715c0 0x7ff66015ccc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:56:44.814 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:44.801+0000 7ff666aeb700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff66015c860 0x7ff6600ad8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:56:44.814 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:44.801+0000 7ff666aeb700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff66014a380 con 0x7ff6600715c0 2023-07-05T18:56:44.814 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:44.801+0000 7ff666aeb700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6600c6db0 con 0x7ff66015c860 2023-07-05T18:56:44.814 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:44.801+0000 7ff666aeb700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff66015d6a0 con 0x7ff66006a510 2023-07-05T18:56:44.815 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:44.801+0000 7ff65ffff700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff6600715c0 0x7ff66015ccc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:56:44.815 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:44.801+0000 7ff664887700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7ff66006a510 0x7ff660149e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:56:44.815 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:44.802+0000 7ff664887700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7ff66006a510 0x7ff660149e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3301/0 says I am v2:172.21.15.46:42472/0 (socket says 172.21.15.46:42472) 2023-07-05T18:56:44.815 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:44.802+0000 7ff664887700 1 -- 172.21.15.46:0/2444558903 learned_addr learned my addr 172.21.15.46:0/2444558903 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-07-05T18:56:44.816 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:44.802+0000 7ff65ffff700 1 --2- 172.21.15.46:0/2444558903 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff6600715c0 0x7ff66015ccc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:58788/0 (socket says 172.21.15.46:58788) 2023-07-05T18:56:44.816 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:44.802+0000 7ff665088700 1 --2- 172.21.15.46:0/2444558903 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff66015c860 0x7ff6600ad8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:56:44.816 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:44.802+0000 7ff65ffff700 1 -- 172.21.15.46:0/2444558903 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7ff66006a510 msgr2=0x7ff660149e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:56:44.817 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:44.802+0000 7ff65ffff700 1 --2- 172.21.15.46:0/2444558903 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7ff66006a510 0x7ff660149e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:44.817 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:44.802+0000 7ff65ffff700 1 -- 172.21.15.46:0/2444558903 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff66015c860 msgr2=0x7ff6600ad8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:56:44.817 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:44.802+0000 7ff65ffff700 1 --2- 172.21.15.46:0/2444558903 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff66015c860 0x7ff6600ad8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:44.817 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:44.802+0000 7ff65ffff700 1 -- 172.21.15.46:0/2444558903 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff654009550 con 0x7ff6600715c0 2023-07-05T18:56:44.817 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:44.802+0000 7ff65ffff700 1 --2- 172.21.15.46:0/2444558903 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff6600715c0 0x7ff66015ccc0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7ff64c00c4b0 tx=0x7ff64c00c7c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-05T18:56:44.818 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:44.802+0000 7ff65d7fa700 1 -- 172.21.15.46:0/2444558903 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff64c004c80 con 0x7ff6600715c0 2023-07-05T18:56:44.818 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:44.802+0000 7ff666aeb700 1 -- 172.21.15.46:0/2444558903 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff66015d980 con 0x7ff6600715c0 2023-07-05T18:56:44.818 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:44.802+0000 7ff65d7fa700 1 -- 172.21.15.46:0/2444558903 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff64c004e00 con 0x7ff6600715c0 2023-07-05T18:56:44.819 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:44.802+0000 7ff65d7fa700 1 -- 172.21.15.46:0/2444558903 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff64c007310 con 0x7ff6600715c0 2023-07-05T18:56:44.819 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:44.802+0000 7ff666aeb700 1 -- 172.21.15.46:0/2444558903 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff6600c6a40 con 0x7ff6600715c0 2023-07-05T18:56:44.819 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:44.803+0000 7ff666aeb700 1 -- 172.21.15.46:0/2444558903 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff6600672e0 con 0x7ff6600715c0 2023-07-05T18:56:44.820 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:44.804+0000 7ff65d7fa700 1 -- 172.21.15.46:0/2444558903 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7ff64c007470 con 0x7ff6600715c0 2023-07-05T18:56:44.820 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:44.804+0000 7ff65d7fa700 1 --2- 172.21.15.46:0/2444558903 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7ff64406ace0 0x7ff64406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:56:44.820 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:44.804+0000 7ff65d7fa700 1 -- 172.21.15.46:0/2444558903 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6062+0+0 (secure 0 0 0) 0x7ff64c089110 con 0x7ff6600715c0 2023-07-05T18:56:44.820 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:44.804+0000 7ff664887700 1 --2- 172.21.15.46:0/2444558903 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7ff64406ace0 0x7ff64406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:56:44.821 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:44.805+0000 7ff664887700 1 --2- 172.21.15.46:0/2444558903 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7ff64406ace0 0x7ff64406d190 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7ff66015e660 tx=0x7ff654008030 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-05T18:56:44.822 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:44.808+0000 7ff65d7fa700 1 -- 172.21.15.46:0/2444558903 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7ff64c054200 con 0x7ff6600715c0 2023-07-05T18:56:45.005 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:45.003+0000 7ff666aeb700 1 -- 172.21.15.46:0/2444558903 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7ff6600b58f0 con 0x7ff6600715c0 2023-07-05T18:56:45.006 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:45.004+0000 7ff65d7fa700 1 -- 172.21.15.46:0/2444558903 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v21) v1 ==== 100+0+11 (secure 0 0 0) 0x7ff64c057820 con 0x7ff6600715c0 2023-07-05T18:56:45.006 INFO:teuthology.orchestra.run.smithi046.stdout:pg_num: 64 2023-07-05T18:56:45.008 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:45.006+0000 7ff666aeb700 1 -- 172.21.15.46:0/2444558903 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7ff64406ace0 msgr2=0x7ff64406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:56:45.009 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:45.006+0000 7ff666aeb700 1 --2- 172.21.15.46:0/2444558903 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7ff64406ace0 0x7ff64406d190 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7ff66015e660 tx=0x7ff654008030 comp rx=0 tx=0).stop 2023-07-05T18:56:45.009 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:45.006+0000 7ff666aeb700 1 -- 172.21.15.46:0/2444558903 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff6600715c0 msgr2=0x7ff66015ccc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:56:45.009 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:45.006+0000 7ff666aeb700 1 --2- 172.21.15.46:0/2444558903 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff6600715c0 0x7ff66015ccc0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7ff64c00c4b0 tx=0x7ff64c00c7c0 comp rx=0 tx=0).stop 2023-07-05T18:56:45.009 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:45.006+0000 7ff666aeb700 1 -- 172.21.15.46:0/2444558903 shutdown_connections 2023-07-05T18:56:45.009 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:45.006+0000 7ff666aeb700 1 --2- 172.21.15.46:0/2444558903 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7ff64406ace0 0x7ff64406d190 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:45.009 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:45.006+0000 7ff666aeb700 1 --2- 172.21.15.46:0/2444558903 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff66015c860 0x7ff6600ad8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:45.010 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:45.006+0000 7ff666aeb700 1 --2- 172.21.15.46:0/2444558903 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7ff66006a510 0x7ff660149e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:45.010 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:45.006+0000 7ff666aeb700 1 --2- 172.21.15.46:0/2444558903 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff6600715c0 0x7ff66015ccc0 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:45.010 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:45.006+0000 7ff666aeb700 1 -- 172.21.15.46:0/2444558903 >> 172.21.15.46:0/2444558903 conn(0x7ff66006bba0 msgr2=0x7ff6600cc3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-05T18:56:45.010 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:45.006+0000 7ff666aeb700 1 -- 172.21.15.46:0/2444558903 shutdown_connections 2023-07-05T18:56:45.010 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:45.006+0000 7ff666aeb700 1 -- 172.21.15.46:0/2444558903 wait complete. 2023-07-05T18:56:45.020 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-05T18:56:45.145 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:45.144+0000 7f4c3a910700 1 Processor -- start 2023-07-05T18:56:45.146 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:45.144+0000 7f4c3a910700 1 -- start start 2023-07-05T18:56:45.147 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:45.144+0000 7f4c3a910700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f4c3406d140 0x7f4c3406d5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:56:45.147 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:45.144+0000 7f4c3a910700 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4c3406c8d0 con 0x7f4c3413f4c0 2023-07-05T18:56:45.147 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:45.144+0000 7f4c3a910700 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4c3406cbb0 con 0x7f4c34142480 2023-07-05T18:56:45.148 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:45.144+0000 7f4c3a910700 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4c3406ce90 con 0x7f4c3406d140 2023-07-05T18:56:45.148 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:45.145+0000 7f4c38ead700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f4c3406d140 0x7f4c3406d5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:56:45.148 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:45.145+0000 7f4c33fff700 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7f4c3413f4c0 0x7f4c3415d6a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:58066/0 (socket says 172.21.15.46:58066) 2023-07-05T18:56:45.148 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:45.145+0000 7f4c33fff700 1 -- 172.21.15.46:0/4116589346 learned_addr learned my addr 172.21.15.46:0/4116589346 (peer_addr_for_me v1:172.21.15.46:0/0) 2023-07-05T18:56:45.148 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:45.145+0000 7f4c38ead700 1 -- 172.21.15.46:0/4116589346 >> v1:172.21.15.73:6789/0 conn(0x7f4c34142480 legacy=0x7f4c340b41d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:56:45.148 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:45.145+0000 7f4c38ead700 1 -- 172.21.15.46:0/4116589346 >> v1:172.21.15.46:6789/0 conn(0x7f4c3413f4c0 legacy=0x7f4c3415d6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:56:45.148 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:45.145+0000 7f4c38ead700 1 -- 172.21.15.46:0/4116589346 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4c340b39d0 con 0x7f4c3406d140 2023-07-05T18:56:45.149 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:45.145+0000 7f4c32ffd700 1 -- 172.21.15.46:0/4116589346 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2065282084 0 0) 0x7f4c3406c8d0 con 0x7f4c3413f4c0 2023-07-05T18:56:45.149 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:45.145+0000 7f4c38ead700 1 --2- 172.21.15.46:0/4116589346 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4c3406d140 0x7f4c3406d5c0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f4c2c009d90 tx=0x7f4c2c00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9f11c98915480cf5 server_cookie=0 in_seq=0 out_seq=0 2023-07-05T18:56:45.149 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:45.145+0000 7f4c32ffd700 1 -- 172.21.15.46:0/4116589346 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c2c00e070 con 0x7f4c3406d140 2023-07-05T18:56:45.149 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:45.145+0000 7f4c32ffd700 1 -- 172.21.15.46:0/4116589346 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4c2c00bbd0 con 0x7f4c3406d140 2023-07-05T18:56:45.149 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:45.145+0000 7f4c32ffd700 1 -- 172.21.15.46:0/4116589346 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c2c012430 con 0x7f4c3406d140 2023-07-05T18:56:45.151 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:45.146+0000 7f4c3a910700 1 -- 172.21.15.46:0/4116589346 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4c3406d140 msgr2=0x7f4c3406d5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:56:45.151 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:45.146+0000 7f4c3a910700 1 --2- 172.21.15.46:0/4116589346 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4c3406d140 0x7f4c3406d5c0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f4c2c009d90 tx=0x7f4c2c00b330 comp rx=0 tx=0).stop 2023-07-05T18:56:45.151 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:45.146+0000 7f4c3a910700 1 -- 172.21.15.46:0/4116589346 shutdown_connections 2023-07-05T18:56:45.152 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:45.146+0000 7f4c3a910700 1 --2- 172.21.15.46:0/4116589346 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4c3406d140 0x7f4c3406d5c0 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:45.152 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:45.146+0000 7f4c3a910700 1 -- 172.21.15.46:0/4116589346 >> 172.21.15.46:0/4116589346 conn(0x7f4c3406af10 msgr2=0x7f4c3406b2e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-05T18:56:45.152 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:45.146+0000 7f4c3a910700 1 -- 172.21.15.46:0/4116589346 shutdown_connections 2023-07-05T18:56:45.153 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:45.146+0000 7f4c3a910700 1 -- 172.21.15.46:0/4116589346 wait complete. 2023-07-05T18:56:45.153 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:45.147+0000 7f4c3a910700 1 Processor -- start 2023-07-05T18:56:45.153 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:45.147+0000 7f4c3a910700 1 -- start start 2023-07-05T18:56:45.153 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:45.148+0000 7f4c3a910700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4c3406d140 0x7f4c3413e440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:56:45.153 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:45.148+0000 7f4c3a910700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f4c3413f4c0 0x7f4c3413cd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:56:45.153 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:45.148+0000 7f4c3a910700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4c34142480 0x7f4c34140d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:56:45.153 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:45.148+0000 7f4c3a910700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c3413ed70 con 0x7f4c34142480 2023-07-05T18:56:45.153 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:45.148+0000 7f4c3a910700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c3415b490 con 0x7f4c3406d140 2023-07-05T18:56:45.154 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:45.148+0000 7f4c3a910700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4c3415a600 con 0x7f4c3413f4c0 2023-07-05T18:56:45.154 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:45.148+0000 7f4c38ead700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4c34142480 0x7f4c34140d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:56:45.154 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:45.148+0000 7f4c38ead700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4c34142480 0x7f4c34140d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:58804/0 (socket says 172.21.15.46:58804) 2023-07-05T18:56:45.154 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:45.148+0000 7f4c38ead700 1 -- 172.21.15.46:0/2376297675 learned_addr learned my addr 172.21.15.46:0/2376297675 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-07-05T18:56:45.154 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:45.148+0000 7f4c337fe700 1 --2- 172.21.15.46:0/2376297675 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f4c3413f4c0 0x7f4c3413cd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:56:45.155 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:45.148+0000 7f4c33fff700 1 --2- 172.21.15.46:0/2376297675 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4c3406d140 0x7f4c3413e440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:56:45.155 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:45.148+0000 7f4c38ead700 1 -- 172.21.15.46:0/2376297675 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f4c3413f4c0 msgr2=0x7f4c3413cd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:56:45.155 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:45.148+0000 7f4c38ead700 1 --2- 172.21.15.46:0/2376297675 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f4c3413f4c0 0x7f4c3413cd00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:45.155 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:45.148+0000 7f4c38ead700 1 -- 172.21.15.46:0/2376297675 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4c3406d140 msgr2=0x7f4c3413e440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:56:45.155 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:45.148+0000 7f4c38ead700 1 --2- 172.21.15.46:0/2376297675 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4c3406d140 0x7f4c3413e440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:45.155 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:45.148+0000 7f4c38ead700 1 -- 172.21.15.46:0/2376297675 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4c2c009a70 con 0x7f4c34142480 2023-07-05T18:56:45.156 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:45.148+0000 7f4c337fe700 1 --2- 172.21.15.46:0/2376297675 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f4c3413f4c0 0x7f4c3413cd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-05T18:56:45.156 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:45.148+0000 7f4c33fff700 1 --2- 172.21.15.46:0/2376297675 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4c3406d140 0x7f4c3413e440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-05T18:56:45.157 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:45.149+0000 7f4c38ead700 1 --2- 172.21.15.46:0/2376297675 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4c34142480 0x7f4c34140d30 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f4c340717e0 tx=0x7f4c2c004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-05T18:56:45.157 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:45.149+0000 7f4c30ff9700 1 -- 172.21.15.46:0/2376297675 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c2c01b810 con 0x7f4c34142480 2023-07-05T18:56:45.157 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:45.149+0000 7f4c30ff9700 1 -- 172.21.15.46:0/2376297675 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4c2c020070 con 0x7f4c34142480 2023-07-05T18:56:45.158 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:45.149+0000 7f4c3a910700 1 -- 172.21.15.46:0/2376297675 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4c3415a880 con 0x7f4c34142480 2023-07-05T18:56:45.158 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:45.149+0000 7f4c30ff9700 1 -- 172.21.15.46:0/2376297675 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c2c01bbb0 con 0x7f4c34142480 2023-07-05T18:56:45.158 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:45.149+0000 7f4c3a910700 1 -- 172.21.15.46:0/2376297675 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4c3415ae40 con 0x7f4c34142480 2023-07-05T18:56:45.159 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:45.150+0000 7f4c3a910700 1 -- 172.21.15.46:0/2376297675 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4c3415b640 con 0x7f4c34142480 2023-07-05T18:56:45.159 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:45.150+0000 7f4c30ff9700 1 -- 172.21.15.46:0/2376297675 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f4c2c01bd10 con 0x7f4c34142480 2023-07-05T18:56:45.159 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:45.150+0000 7f4c30ff9700 1 --2- 172.21.15.46:0/2376297675 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7f4c2006ace0 0x7f4c2006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:56:45.160 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:45.151+0000 7f4c30ff9700 1 -- 172.21.15.46:0/2376297675 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f4c2c022070 con 0x7f4c34142480 2023-07-05T18:56:45.160 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:45.151+0000 7f4c33fff700 1 --2- 172.21.15.46:0/2376297675 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7f4c2006ace0 0x7f4c2006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:56:45.160 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:45.151+0000 7f4c33fff700 1 --2- 172.21.15.46:0/2376297675 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7f4c2006ace0 0x7f4c2006d190 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f4c24000f60 tx=0x7f4c24009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-05T18:56:45.160 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:45.155+0000 7f4c30ff9700 1 -- 172.21.15.46:0/2376297675 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f4c3415b640 con 0x7f4c34142480 2023-07-05T18:56:45.354 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:45.352+0000 7f4c3a910700 1 -- 172.21.15.46:0/2376297675 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f4c3415b640 con 0x7f4c34142480 2023-07-05T18:56:45.355 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:45.353+0000 7f4c30ff9700 1 -- 172.21.15.46:0/2376297675 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) v1 ==== 74+0+18161 (secure 0 0 0) 0x7f4c3415b640 con 0x7f4c34142480 2023-07-05T18:56:45.355 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T18:56:45.356 INFO:teuthology.orchestra.run.smithi046.stdout:{"epoch":21,"fsid":"042652d3-d80c-4ad8-9366-3e94f2a0a512","created":"2023-07-05T18:55:56.455710+0000","modified":"2023-07-05T18:56:16.095672+0000","last_up_change":"2023-07-05T18:56:06.594022+0000","last_in_change":"2023-07-05T18:55:58.879340+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-07-05T18:56:07.729620+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2023-07-05T18:56:08.128122+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-07-05T18:56:12.954625+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-07-05T18:56:14.068396+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"20009183-9a47-4392-8751-883f88d2bfb1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6813","nonce":4151971443},{"type":"v1","addr":"172.21.15.46:6815","nonce":4151971443}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6817","nonce":4151971443},{"type":"v1","addr":"172.21.15.46:6818","nonce":4151971443}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6822","nonce":4151971443},{"type":"v1","addr":"172.21.15.46:6823","nonce":4151971443}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6820","nonce":4151971443},{"type":"v1","addr":"172.21.15.46:6821","nonce":4151971443}]},"public_addr":"172.21.15.46:6815/4151971443","cluster_addr":"172.21.15.46:6818/4151971443","heartbeat_back_addr":"172.21.15.46:6823/4151971443","heartbeat_front_addr":"172.21.15.46:6821/4151971443","state":["exists","up"]},{"osd":1,"uuid":"91b4a7b0-e4e4-4888-a1fe-9edb0d68004c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6808","nonce":502575881},{"type":"v1","addr":"172.21.15.46:6809","nonce":502575881}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6810","nonce":502575881},{"type":"v1","addr":"172.21.15.46:6811","nonce":502575881}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6816","nonce":502575881},{"type":"v1","addr":"172.21.15.46:6819","nonce":502575881}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6812","nonce":502575881},{"type":"v1","addr":"172.21.15.46:6814","nonce":502575881}]},"public_addr":"172.21.15.46:6809/502575881","cluster_addr":"172.21.15.46:6811/502575881","heartbeat_back_addr":"172.21.15.46:6819/502575881","heartbeat_front_addr":"172.21.15.46:6814/502575881","state":["exists","up"]},{"osd":2,"uuid":"669ff744-1331-47c5-8579-0440731c889a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6800","nonce":2115251461},{"type":"v1","addr":"172.21.15.46:6801","nonce":2115251461}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6802","nonce":2115251461},{"type":"v1","addr":"172.21.15.46:6803","nonce":2115251461}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6806","nonce":2115251461},{"type":"v1","addr":"172.21.15.46:6807","nonce":2115251461}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6804","nonce":2115251461},{"type":"v1","addr":"172.21.15.46:6805","nonce":2115251461}]},"public_addr":"172.21.15.46:6801/2115251461","cluster_addr":"172.21.15.46:6803/2115251461","heartbeat_back_addr":"172.21.15.46:6807/2115251461","heartbeat_front_addr":"172.21.15.46:6805/2115251461","state":["exists","up"]},{"osd":3,"uuid":"34e1b86d-ffad-415d-861c-07a5f08068a6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6824","nonce":2981388766},{"type":"v1","addr":"172.21.15.46:6825","nonce":2981388766}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6826","nonce":2981388766},{"type":"v1","addr":"172.21.15.46:6827","nonce":2981388766}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6830","nonce":2981388766},{"type":"v1","addr":"172.21.15.46:6831","nonce":2981388766}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6828","nonce":2981388766},{"type":"v1","addr":"172.21.15.46:6829","nonce":2981388766}]},"public_addr":"172.21.15.46:6825/2981388766","cluster_addr":"172.21.15.46:6827/2981388766","heartbeat_back_addr":"172.21.15.46:6831/2981388766","heartbeat_front_addr":"172.21.15.46:6829/2981388766","state":["exists","up"]},{"osd":4,"uuid":"57ffcb91-c7dc-4a69-ae71-4d9622a14a05","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6800","nonce":2083655348},{"type":"v1","addr":"172.21.15.73:6801","nonce":2083655348}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6802","nonce":2083655348},{"type":"v1","addr":"172.21.15.73:6803","nonce":2083655348}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6806","nonce":2083655348},{"type":"v1","addr":"172.21.15.73:6807","nonce":2083655348}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6804","nonce":2083655348},{"type":"v1","addr":"172.21.15.73:6805","nonce":2083655348}]},"public_addr":"172.21.15.73:6801/2083655348","cluster_addr":"172.21.15.73:6803/2083655348","heartbeat_back_addr":"172.21.15.73:6807/2083655348","heartbeat_front_addr":"172.21.15.73:6805/2083655348","state":["exists","up"]},{"osd":5,"uuid":"665f41c9-ee20-49cf-bf0e-fbe0c03d3aed","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6824","nonce":2803788401},{"type":"v1","addr":"172.21.15.73:6825","nonce":2803788401}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6826","nonce":2803788401},{"type":"v1","addr":"172.21.15.73:6827","nonce":2803788401}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6830","nonce":2803788401},{"type":"v1","addr":"172.21.15.73:6831","nonce":2803788401}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6828","nonce":2803788401},{"type":"v1","addr":"172.21.15.73:6829","nonce":2803788401}]},"public_addr":"172.21.15.73:6825/2803788401","cluster_addr":"172.21.15.73:6827/2803788401","heartbeat_back_addr":"172.21.15.73:6831/2803788401","heartbeat_front_addr":"172.21.15.73:6829/2803788401","state":["exists","up"]},{"osd":6,"uuid":"5790c6cc-bd56-4ce4-9a7c-0f0c3b59215c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6808","nonce":974108383},{"type":"v1","addr":"172.21.15.73:6809","nonce":974108383}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6810","nonce":974108383},{"type":"v1","addr":"172.21.15.73:6811","nonce":974108383}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6815","nonce":974108383},{"type":"v1","addr":"172.21.15.73:6817","nonce":974108383}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6812","nonce":974108383},{"type":"v1","addr":"172.21.15.73:6813","nonce":974108383}]},"public_addr":"172.21.15.73:6809/974108383","cluster_addr":"172.21.15.73:6811/974108383","heartbeat_back_addr":"172.21.15.73:6817/974108383","heartbeat_front_addr":"172.21.15.73:6813/974108383","state":["exists","up"]},{"osd":7,"uuid":"b66f4d2e-147e-4c9b-97dd-cbd59d33802e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6814","nonce":3772673248},{"type":"v1","addr":"172.21.15.73:6816","nonce":3772673248}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6818","nonce":3772673248},{"type":"v1","addr":"172.21.15.73:6819","nonce":3772673248}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6822","nonce":3772673248},{"type":"v1","addr":"172.21.15.73:6823","nonce":3772673248}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6820","nonce":3772673248},{"type":"v1","addr":"172.21.15.73:6821","nonce":3772673248}]},"public_addr":"172.21.15.73:6816/3772673248","cluster_addr":"172.21.15.73:6819/3772673248","heartbeat_back_addr":"172.21.15.73:6823/3772673248","heartbeat_front_addr":"172.21.15.73:6821/3772673248","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-05T18:56:04.115334+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-05T18:56:04.071250+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-05T18:56:04.044387+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-05T18:56:04.085389+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-05T18:56:04.090726+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-05T18:56:04.074529+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-05T18:56:04.058841+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-05T18:56:04.043054+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-05T18:56:45.357 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:45.355+0000 7f4c3a910700 1 -- 172.21.15.46:0/2376297675 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7f4c2006ace0 msgr2=0x7f4c2006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:56:45.358 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:45.355+0000 7f4c3a910700 1 --2- 172.21.15.46:0/2376297675 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7f4c2006ace0 0x7f4c2006d190 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f4c24000f60 tx=0x7f4c24009040 comp rx=0 tx=0).stop 2023-07-05T18:56:45.358 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:45.355+0000 7f4c3a910700 1 -- 172.21.15.46:0/2376297675 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4c34142480 msgr2=0x7f4c34140d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:56:45.358 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:45.355+0000 7f4c3a910700 1 --2- 172.21.15.46:0/2376297675 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4c34142480 0x7f4c34140d30 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f4c340717e0 tx=0x7f4c2c004ad0 comp rx=0 tx=0).stop 2023-07-05T18:56:45.359 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:45.355+0000 7f4c3a910700 1 -- 172.21.15.46:0/2376297675 shutdown_connections 2023-07-05T18:56:45.359 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:45.355+0000 7f4c3a910700 1 --2- 172.21.15.46:0/2376297675 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7f4c2006ace0 0x7f4c2006d190 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:45.359 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:45.355+0000 7f4c3a910700 1 --2- 172.21.15.46:0/2376297675 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4c34142480 0x7f4c34140d30 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:45.359 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:45.355+0000 7f4c3a910700 1 --2- 172.21.15.46:0/2376297675 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4c3406d140 0x7f4c3413e440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:45.360 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:45.355+0000 7f4c3a910700 1 --2- 172.21.15.46:0/2376297675 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f4c3413f4c0 0x7f4c3413cd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:45.360 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:45.355+0000 7f4c3a910700 1 -- 172.21.15.46:0/2376297675 >> 172.21.15.46:0/2376297675 conn(0x7f4c3406af10 msgr2=0x7f4c341646e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-05T18:56:45.360 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:45.355+0000 7f4c3a910700 1 -- 172.21.15.46:0/2376297675 shutdown_connections 2023-07-05T18:56:45.363 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:45.355+0000 7f4c3a910700 1 -- 172.21.15.46:0/2376297675 wait complete. 2023-07-05T18:56:45.370 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'rbd', 'create_time': '2023-07-05T18:56:07.729620+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': '.mgr', 'create_time': '2023-07-05T18:56:08.128122+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-07-05T18:56:12.954625+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-07-05T18:56:14.068396+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-07-05T18:56:45.371 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-07-05T18:56:45.500 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:45.498+0000 7f3440fa6700 1 Processor -- start 2023-07-05T18:56:45.501 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:45.498+0000 7f3440fa6700 1 -- start start 2023-07-05T18:56:45.503 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:45.499+0000 7f3440fa6700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f343c15c860 0x7f343c160ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:56:45.504 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:45.499+0000 7f3440fa6700 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f343c0ce640 con 0x7f343c0715c0 2023-07-05T18:56:45.504 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:45.499+0000 7f3440fa6700 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f343c1611e0 con 0x7f343c06a510 2023-07-05T18:56:45.504 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:45.499+0000 7f3440fa6700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f343c0ce870 con 0x7f343c15c860 2023-07-05T18:56:45.504 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:45.499+0000 7f3439d9b700 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7f343c0715c0 0x7f343c069e00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:58080/0 (socket says 172.21.15.46:58080) 2023-07-05T18:56:45.504 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:45.499+0000 7f3439d9b700 1 -- 172.21.15.46:0/960684983 learned_addr learned my addr 172.21.15.46:0/960684983 (peer_addr_for_me v1:172.21.15.46:0/0) 2023-07-05T18:56:45.505 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:45.499+0000 7f343a59c700 1 --2- 172.21.15.46:0/960684983 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f343c15c860 0x7f343c160ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:56:45.505 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:45.499+0000 7f343959a700 1 -- 172.21.15.46:0/960684983 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3593396997 0 0) 0x7f343c0ce640 con 0x7f343c0715c0 2023-07-05T18:56:45.505 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:45.499+0000 7f343959a700 1 -- 172.21.15.46:0/960684983 --> v1:172.21.15.46:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f34240035b0 con 0x7f343c0715c0 2023-07-05T18:56:45.505 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:45.500+0000 7f343959a700 1 -- 172.21.15.46:0/960684983 <== mon.1 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3857212478 0 0) 0x7f343c1611e0 con 0x7f343c06a510 2023-07-05T18:56:45.505 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:45.500+0000 7f343959a700 1 -- 172.21.15.46:0/960684983 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f343c0ce640 con 0x7f343c06a510 2023-07-05T18:56:45.505 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:45.500+0000 7f343959a700 1 -- 172.21.15.46:0/960684983 <== mon.0 v1:172.21.15.46:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2970383810 0 0) 0x7f34240035b0 con 0x7f343c0715c0 2023-07-05T18:56:45.505 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:45.500+0000 7f343959a700 1 -- 172.21.15.46:0/960684983 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f343c15c860 msgr2=0x7f343c160ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-05T18:56:45.506 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:45.500+0000 7f343959a700 1 --2- 172.21.15.46:0/960684983 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f343c15c860 0x7f343c160ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:45.506 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:45.500+0000 7f343959a700 1 -- 172.21.15.46:0/960684983 >> v1:172.21.15.73:6789/0 conn(0x7f343c06a510 legacy=0x7f343c06c1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:56:45.506 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:45.500+0000 7f343959a700 1 -- 172.21.15.46:0/960684983 --> v1:172.21.15.46:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f343c0ceb50 con 0x7f343c0715c0 2023-07-05T18:56:45.506 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:45.500+0000 7f343959a700 1 -- 172.21.15.46:0/960684983 <== mon.0 v1:172.21.15.46:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2195585215 0 0) 0x7f342c001670 con 0x7f343c0715c0 2023-07-05T18:56:45.506 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:45.500+0000 7f343a59c700 1 --2- 172.21.15.46:0/960684983 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f343c15c860 0x7f343c160ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-05T18:56:45.506 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:45.500+0000 7f343959a700 1 -- 172.21.15.46:0/960684983 >> v1:172.21.15.46:6789/0 conn(0x7f343c0715c0 legacy=0x7f343c069e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:56:45.506 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:45.500+0000 7f343959a700 1 --2- 172.21.15.46:0/960684983 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3424003bc0 0x7f3424003fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:56:45.506 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:45.500+0000 7f343959a700 1 --2- 172.21.15.46:0/960684983 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f343c15c860 0x7f3424004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:56:45.507 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:45.500+0000 7f343959a700 1 --2- 172.21.15.46:0/960684983 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3424004d90 0x7f3424005200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:56:45.507 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:45.500+0000 7f343959a700 1 -- 172.21.15.46:0/960684983 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f343c0ce870 con 0x7f3424003bc0 2023-07-05T18:56:45.507 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:45.500+0000 7f343959a700 1 -- 172.21.15.46:0/960684983 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f342400bac0 con 0x7f3424004d90 2023-07-05T18:56:45.507 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:45.500+0000 7f343959a700 1 -- 172.21.15.46:0/960684983 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f342400bc00 con 0x7f343c15c860 2023-07-05T18:56:45.507 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:45.500+0000 7f343a59c700 1 --2- 172.21.15.46:0/960684983 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3424003bc0 0x7f3424003fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:56:45.507 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:45.500+0000 7f343ad9d700 1 --2- 172.21.15.46:0/960684983 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3424004d90 0x7f3424005200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:56:45.507 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:45.500+0000 7f3439d9b700 1 --2- 172.21.15.46:0/960684983 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f343c15c860 0x7f3424004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:56:45.508 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:45.500+0000 7f343a59c700 1 -- 172.21.15.46:0/960684983 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f343c15c860 msgr2=0x7f3424004850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-05T18:56:45.508 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:45.500+0000 7f343a59c700 1 --2- 172.21.15.46:0/960684983 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f343c15c860 0x7f3424004850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:45.508 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:45.500+0000 7f343a59c700 1 -- 172.21.15.46:0/960684983 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3424004d90 msgr2=0x7f3424005200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-05T18:56:45.508 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:45.500+0000 7f343a59c700 1 --2- 172.21.15.46:0/960684983 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3424004d90 0x7f3424005200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:45.508 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:45.500+0000 7f343a59c700 1 -- 172.21.15.46:0/960684983 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f34300094a0 con 0x7f3424003bc0 2023-07-05T18:56:45.508 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:45.500+0000 7f3439d9b700 1 --2- 172.21.15.46:0/960684983 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f343c15c860 0x7f3424004850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-05T18:56:45.508 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:45.500+0000 7f343ad9d700 1 --2- 172.21.15.46:0/960684983 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3424004d90 0x7f3424005200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-05T18:56:45.509 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:45.500+0000 7f343a59c700 1 --2- 172.21.15.46:0/960684983 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3424003bc0 0x7f3424003fb0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f3430009d30 tx=0x7f3424005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bb6abdb64bf207b0 server_cookie=0 in_seq=0 out_seq=0 2023-07-05T18:56:45.509 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:45.500+0000 7f343959a700 1 -- 172.21.15.46:0/960684983 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3430009e80 con 0x7f3424003bc0 2023-07-05T18:56:45.509 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:45.500+0000 7f343959a700 1 -- 172.21.15.46:0/960684983 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f343000e9a0 con 0x7f3424003bc0 2023-07-05T18:56:45.509 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:45.500+0000 7f343959a700 1 -- 172.21.15.46:0/960684983 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f343000ed10 con 0x7f3424003bc0 2023-07-05T18:56:45.509 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:45.501+0000 7f3440fa6700 1 -- 172.21.15.46:0/960684983 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3424003bc0 msgr2=0x7f3424003fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:56:45.510 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:45.501+0000 7f3440fa6700 1 --2- 172.21.15.46:0/960684983 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3424003bc0 0x7f3424003fb0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f3430009d30 tx=0x7f3424005880 comp rx=0 tx=0).stop 2023-07-05T18:56:45.510 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:45.501+0000 7f343ad9d700 1 -- 172.21.15.46:0/960684983 reap_dead start 2023-07-05T18:56:45.510 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:45.501+0000 7f3440fa6700 1 -- 172.21.15.46:0/960684983 shutdown_connections 2023-07-05T18:56:45.510 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:45.501+0000 7f3440fa6700 1 -- 172.21.15.46:0/960684983 >> 172.21.15.46:0/960684983 conn(0x7f343c06bba0 msgr2=0x7f343c0cc3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-05T18:56:45.510 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:45.501+0000 7f3440fa6700 1 -- 172.21.15.46:0/960684983 shutdown_connections 2023-07-05T18:56:45.510 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:45.501+0000 7f3440fa6700 1 -- 172.21.15.46:0/960684983 wait complete. 2023-07-05T18:56:45.513 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:45.502+0000 7f3440fa6700 1 Processor -- start 2023-07-05T18:56:45.513 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:45.503+0000 7f3440fa6700 1 -- start start 2023-07-05T18:56:45.513 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:45.503+0000 7f3440fa6700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f3424003bc0 0x7f343c06cf60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:56:45.513 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:45.503+0000 7f3440fa6700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f343c158170 0x7f343c152310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:56:45.513 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:45.503+0000 7f3440fa6700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f343c0b0c30 0x7f343c0b10b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:56:45.513 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:45.503+0000 7f3440fa6700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f343c0b15f0 con 0x7f343c0b0c30 2023-07-05T18:56:45.513 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:45.503+0000 7f3440fa6700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f343c15dcd0 con 0x7f343c158170 2023-07-05T18:56:45.514 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:45.503+0000 7f3440fa6700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f343c158650 con 0x7f3424003bc0 2023-07-05T18:56:45.514 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:45.503+0000 7f343ad9d700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f343c0b0c30 0x7f343c0b10b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:56:45.514 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:45.503+0000 7f343ad9d700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f343c0b0c30 0x7f343c0b10b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:58822/0 (socket says 172.21.15.46:58822) 2023-07-05T18:56:45.515 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:45.503+0000 7f343ad9d700 1 -- 172.21.15.46:0/3380167376 learned_addr learned my addr 172.21.15.46:0/3380167376 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-07-05T18:56:45.515 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:45.503+0000 7f343a59c700 1 --2- 172.21.15.46:0/3380167376 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f3424003bc0 0x7f343c06cf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:56:45.515 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:45.503+0000 7f3439d9b700 1 --2- 172.21.15.46:0/3380167376 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f343c158170 0x7f343c152310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:56:45.515 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:45.504+0000 7f343ad9d700 1 -- 172.21.15.46:0/3380167376 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f3424003bc0 msgr2=0x7f343c06cf60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:56:45.515 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:45.504+0000 7f343ad9d700 1 --2- 172.21.15.46:0/3380167376 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f3424003bc0 0x7f343c06cf60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:45.516 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:45.504+0000 7f343ad9d700 1 -- 172.21.15.46:0/3380167376 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f343c158170 msgr2=0x7f343c152310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:56:45.516 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:45.504+0000 7f343ad9d700 1 --2- 172.21.15.46:0/3380167376 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f343c158170 0x7f343c152310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:45.516 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:45.504+0000 7f343ad9d700 1 -- 172.21.15.46:0/3380167376 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f343c158930 con 0x7f343c0b0c30 2023-07-05T18:56:45.516 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:45.504+0000 7f343ad9d700 1 --2- 172.21.15.46:0/3380167376 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f343c0b0c30 0x7f343c0b10b0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f3434001a50 tx=0x7f343400ee90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-05T18:56:45.516 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:45.504+0000 7f342affd700 1 -- 172.21.15.46:0/3380167376 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3434003c10 con 0x7f343c0b0c30 2023-07-05T18:56:45.516 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:45.504+0000 7f342affd700 1 -- 172.21.15.46:0/3380167376 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3434003d90 con 0x7f343c0b0c30 2023-07-05T18:56:45.516 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:45.504+0000 7f342affd700 1 -- 172.21.15.46:0/3380167376 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3434005310 con 0x7f343c0b0c30 2023-07-05T18:56:45.516 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:45.504+0000 7f3440fa6700 1 -- 172.21.15.46:0/3380167376 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f343c15df90 con 0x7f343c0b0c30 2023-07-05T18:56:45.517 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:45.504+0000 7f3440fa6700 1 -- 172.21.15.46:0/3380167376 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f343c159840 con 0x7f343c0b0c30 2023-07-05T18:56:45.517 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:45.505+0000 7f3440fa6700 1 -- 172.21.15.46:0/3380167376 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f343c15e4b0 con 0x7f343c0b0c30 2023-07-05T18:56:45.517 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:45.506+0000 7f342affd700 1 -- 172.21.15.46:0/3380167376 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f3434005470 con 0x7f343c0b0c30 2023-07-05T18:56:45.517 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:45.506+0000 7f342affd700 1 --2- 172.21.15.46:0/3380167376 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7f341c06ace0 0x7f341c06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:56:45.517 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:45.506+0000 7f342affd700 1 -- 172.21.15.46:0/3380167376 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f3434089410 con 0x7f343c0b0c30 2023-07-05T18:56:45.517 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:45.506+0000 7f343a59c700 1 --2- 172.21.15.46:0/3380167376 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7f341c06ace0 0x7f341c06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:56:45.517 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:45.507+0000 7f343a59c700 1 --2- 172.21.15.46:0/3380167376 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7f341c06ace0 0x7f341c06d190 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f3430000c00 tx=0x7f343001f040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-05T18:56:45.518 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:45.510+0000 7f342affd700 1 -- 172.21.15.46:0/3380167376 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f343c15e4b0 con 0x7f343c0b0c30 2023-07-05T18:56:45.709 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:45.707+0000 7f3440fa6700 1 -- 172.21.15.46:0/3380167376 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f343c15e4b0 con 0x7f343c0b0c30 2023-07-05T18:56:45.710 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:45.707+0000 7f342affd700 1 -- 172.21.15.46:0/3380167376 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v21) v1 ==== 92+0+10 (secure 0 0 0) 0x7f343c15e4b0 con 0x7f343c0b0c30 2023-07-05T18:56:45.711 INFO:teuthology.orchestra.run.smithi046.stdout:pg_num: 8 2023-07-05T18:56:45.712 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:45.709+0000 7f3440fa6700 1 -- 172.21.15.46:0/3380167376 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7f341c06ace0 msgr2=0x7f341c06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:56:45.713 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:45.709+0000 7f3440fa6700 1 --2- 172.21.15.46:0/3380167376 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7f341c06ace0 0x7f341c06d190 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f3430000c00 tx=0x7f343001f040 comp rx=0 tx=0).stop 2023-07-05T18:56:45.713 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:45.709+0000 7f3440fa6700 1 -- 172.21.15.46:0/3380167376 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f343c0b0c30 msgr2=0x7f343c0b10b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:56:45.713 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:45.709+0000 7f3440fa6700 1 --2- 172.21.15.46:0/3380167376 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f343c0b0c30 0x7f343c0b10b0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f3434001a50 tx=0x7f343400ee90 comp rx=0 tx=0).stop 2023-07-05T18:56:45.714 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:45.710+0000 7f3440fa6700 1 -- 172.21.15.46:0/3380167376 shutdown_connections 2023-07-05T18:56:45.714 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:45.710+0000 7f3440fa6700 1 --2- 172.21.15.46:0/3380167376 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7f341c06ace0 0x7f341c06d190 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:45.714 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:45.710+0000 7f3440fa6700 1 --2- 172.21.15.46:0/3380167376 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f343c0b0c30 0x7f343c0b10b0 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:45.714 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:45.710+0000 7f3440fa6700 1 --2- 172.21.15.46:0/3380167376 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f3424003bc0 0x7f343c06cf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:45.714 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:45.710+0000 7f3440fa6700 1 --2- 172.21.15.46:0/3380167376 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f343c158170 0x7f343c152310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:45.715 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:45.710+0000 7f3440fa6700 1 -- 172.21.15.46:0/3380167376 >> 172.21.15.46:0/3380167376 conn(0x7f343c06bba0 msgr2=0x7f343c0b32c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-05T18:56:45.715 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:45.710+0000 7f3440fa6700 1 -- 172.21.15.46:0/3380167376 shutdown_connections 2023-07-05T18:56:45.715 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:45.710+0000 7f3440fa6700 1 -- 172.21.15.46:0/3380167376 wait complete. 2023-07-05T18:56:45.724 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-07-05T18:56:45.852 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:45.850+0000 7f8444fa8700 1 Processor -- start 2023-07-05T18:56:45.853 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:45.850+0000 7f8444fa8700 1 -- start start 2023-07-05T18:56:45.855 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:45.851+0000 7f8444fa8700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f84400af530 0x7f84400cea80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:56:45.855 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:45.851+0000 7f8444fa8700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f844015ee20 0x7f84400cefc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:56:45.855 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:45.851+0000 7f8444fa8700 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f84400b0ae0 con 0x7f84400af160 2023-07-05T18:56:45.855 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:45.851+0000 7f8444fa8700 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f84400d15f0 con 0x7f84400af530 2023-07-05T18:56:45.856 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:45.851+0000 7f8444fa8700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f84400d1110 con 0x7f844015ee20 2023-07-05T18:56:45.856 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:45.851+0000 7f843e59c700 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7f84400af160 0x7f84400d0a00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:58100/0 (socket says 172.21.15.46:58100) 2023-07-05T18:56:45.856 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:45.852+0000 7f843e59c700 1 -- 172.21.15.46:0/48032255 learned_addr learned my addr 172.21.15.46:0/48032255 (peer_addr_for_me v1:172.21.15.46:0/0) 2023-07-05T18:56:45.856 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:45.852+0000 7f843ed9d700 1 --2- 172.21.15.46:0/48032255 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f844015ee20 0x7f84400cefc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:56:45.856 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:45.852+0000 7f843dd9b700 1 --2- 172.21.15.46:0/48032255 >> v2:172.21.15.73:3300/0 conn(0x7f84400af530 0x7f84400cea80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:56:45.857 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:45.852+0000 7f843d59a700 1 -- 172.21.15.46:0/48032255 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 711784702 0 0) 0x7f84400b0ae0 con 0x7f84400af160 2023-07-05T18:56:45.857 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:45.852+0000 7f843d59a700 1 -- 172.21.15.46:0/48032255 --> v1:172.21.15.46:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f84280035b0 con 0x7f84400af160 2023-07-05T18:56:45.857 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:45.852+0000 7f843d59a700 1 -- 172.21.15.46:0/48032255 <== mon.0 v1:172.21.15.46:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4293139030 0 0) 0x7f84280035b0 con 0x7f84400af160 2023-07-05T18:56:45.857 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:45.852+0000 7f843ed9d700 1 -- 172.21.15.46:0/48032255 >> v2:172.21.15.73:3300/0 conn(0x7f84400af530 msgr2=0x7f84400cea80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-05T18:56:45.857 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:45.852+0000 7f843ed9d700 1 --2- 172.21.15.46:0/48032255 >> v2:172.21.15.73:3300/0 conn(0x7f84400af530 0x7f84400cea80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:45.858 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:45.852+0000 7f843ed9d700 1 -- 172.21.15.46:0/48032255 >> v1:172.21.15.46:6789/0 conn(0x7f84400af160 legacy=0x7f84400d0a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:56:45.858 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:45.852+0000 7f843ed9d700 1 -- 172.21.15.46:0/48032255 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f84400b1f80 con 0x7f844015ee20 2023-07-05T18:56:45.858 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:45.852+0000 7f843ed9d700 1 --2- 172.21.15.46:0/48032255 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f844015ee20 0x7f84400cefc0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f8438009d90 tx=0x7f843800b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1d9532d46623ceec server_cookie=0 in_seq=0 out_seq=0 2023-07-05T18:56:45.859 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:45.852+0000 7f843d59a700 1 -- 172.21.15.46:0/48032255 <== mon.2 v2:172.21.15.73:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f843800e070 con 0x7f844015ee20 2023-07-05T18:56:45.859 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:45.852+0000 7f843d59a700 1 -- 172.21.15.46:0/48032255 <== mon.2 v2:172.21.15.73:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8438003a20 con 0x7f844015ee20 2023-07-05T18:56:45.859 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:45.852+0000 7f843d59a700 1 -- 172.21.15.46:0/48032255 <== mon.2 v2:172.21.15.73:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8434001670 con 0x7f844015ee20 2023-07-05T18:56:45.860 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:45.853+0000 7f8444fa8700 1 -- 172.21.15.46:0/48032255 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f844015ee20 msgr2=0x7f84400cefc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:56:45.860 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:45.853+0000 7f8444fa8700 1 --2- 172.21.15.46:0/48032255 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f844015ee20 0x7f84400cefc0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f8438009d90 tx=0x7f843800b330 comp rx=0 tx=0).stop 2023-07-05T18:56:45.860 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:45.853+0000 7f8444fa8700 1 -- 172.21.15.46:0/48032255 shutdown_connections 2023-07-05T18:56:45.860 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:45.853+0000 7f8444fa8700 1 --2- 172.21.15.46:0/48032255 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f844015ee20 0x7f84400cefc0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:45.861 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:45.853+0000 7f8444fa8700 1 --2- 172.21.15.46:0/48032255 >> v2:172.21.15.73:3300/0 conn(0x7f84400af530 0x7f84400cea80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:45.861 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:45.853+0000 7f8444fa8700 1 -- 172.21.15.46:0/48032255 >> 172.21.15.46:0/48032255 conn(0x7f84400664b0 msgr2=0x7f8440099de0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-05T18:56:45.861 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:45.853+0000 7f8444fa8700 1 -- 172.21.15.46:0/48032255 shutdown_connections 2023-07-05T18:56:45.861 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:45.853+0000 7f8444fa8700 1 -- 172.21.15.46:0/48032255 wait complete. 2023-07-05T18:56:45.864 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:45.854+0000 7f8444fa8700 1 Processor -- start 2023-07-05T18:56:45.864 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:45.854+0000 7f8444fa8700 1 -- start start 2023-07-05T18:56:45.864 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:45.855+0000 7f8444fa8700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f84400af160 0x7f84400b6330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:56:45.865 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:45.855+0000 7f8444fa8700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f84400af530 0x7f84400cd8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:56:45.865 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:45.855+0000 7f8444fa8700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f844015ee20 0x7f84400cddf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:56:45.866 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:45.855+0000 7f8444fa8700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84401555b0 con 0x7f844015ee20 2023-07-05T18:56:45.866 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:45.855+0000 7f8444fa8700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84400ca140 con 0x7f84400af530 2023-07-05T18:56:45.866 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:45.855+0000 7f8444fa8700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f84400c9b80 con 0x7f84400af160 2023-07-05T18:56:45.866 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:45.855+0000 7f843ed9d700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f844015ee20 0x7f84400cddf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:56:45.866 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:45.855+0000 7f843ed9d700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f844015ee20 0x7f84400cddf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:58838/0 (socket says 172.21.15.46:58838) 2023-07-05T18:56:45.866 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:45.855+0000 7f843ed9d700 1 -- 172.21.15.46:0/1776258529 learned_addr learned my addr 172.21.15.46:0/1776258529 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-07-05T18:56:45.866 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:45.856+0000 7f843e59c700 1 --2- 172.21.15.46:0/1776258529 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f84400af160 0x7f84400b6330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:56:45.866 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:45.856+0000 7f843dd9b700 1 --2- 172.21.15.46:0/1776258529 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f84400af530 0x7f84400cd8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:56:45.867 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:45.856+0000 7f843ed9d700 1 -- 172.21.15.46:0/1776258529 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f84400af160 msgr2=0x7f84400b6330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:56:45.867 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:45.856+0000 7f843ed9d700 1 --2- 172.21.15.46:0/1776258529 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f84400af160 0x7f84400b6330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:45.867 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:45.856+0000 7f843ed9d700 1 -- 172.21.15.46:0/1776258529 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f84400af530 msgr2=0x7f84400cd8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:56:45.868 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:45.856+0000 7f843ed9d700 1 --2- 172.21.15.46:0/1776258529 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f84400af530 0x7f84400cd8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:45.868 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:45.856+0000 7f843ed9d700 1 -- 172.21.15.46:0/1776258529 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8438009a70 con 0x7f844015ee20 2023-07-05T18:56:45.868 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:45.856+0000 7f843ed9d700 1 --2- 172.21.15.46:0/1776258529 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f844015ee20 0x7f84400cddf0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f8440072540 tx=0x7f8438004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-05T18:56:45.868 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:45.856+0000 7f842effd700 1 -- 172.21.15.46:0/1776258529 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84380045f0 con 0x7f844015ee20 2023-07-05T18:56:45.869 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:45.856+0000 7f8444fa8700 1 -- 172.21.15.46:0/1776258529 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f84400c9e60 con 0x7f844015ee20 2023-07-05T18:56:45.869 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:45.856+0000 7f842effd700 1 -- 172.21.15.46:0/1776258529 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8438004750 con 0x7f844015ee20 2023-07-05T18:56:45.869 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:45.856+0000 7f842effd700 1 -- 172.21.15.46:0/1776258529 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8438009450 con 0x7f844015ee20 2023-07-05T18:56:45.869 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:45.856+0000 7f8444fa8700 1 -- 172.21.15.46:0/1776258529 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8440155a40 con 0x7f844015ee20 2023-07-05T18:56:45.869 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:45.857+0000 7f8444fa8700 1 -- 172.21.15.46:0/1776258529 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8440155760 con 0x7f844015ee20 2023-07-05T18:56:45.869 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:45.857+0000 7f842effd700 1 -- 172.21.15.46:0/1776258529 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f8438012430 con 0x7f844015ee20 2023-07-05T18:56:45.870 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:45.858+0000 7f842effd700 1 --2- 172.21.15.46:0/1776258529 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7f842006ace0 0x7f842006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:56:45.870 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:45.858+0000 7f842effd700 1 -- 172.21.15.46:0/1776258529 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f843808adb0 con 0x7f844015ee20 2023-07-05T18:56:45.870 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:45.858+0000 7f843e59c700 1 --2- 172.21.15.46:0/1776258529 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7f842006ace0 0x7f842006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:56:45.870 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:45.859+0000 7f843e59c700 1 --2- 172.21.15.46:0/1776258529 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7f842006ace0 0x7f842006d190 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f8434001eb0 tx=0x7f8434001ce0 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-05T18:56:45.871 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:45.862+0000 7f842effd700 1 -- 172.21.15.46:0/1776258529 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f8440155760 con 0x7f844015ee20 2023-07-05T18:56:46.062 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:46.060+0000 7f8444fa8700 1 -- 172.21.15.46:0/1776258529 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f84400672e0 con 0x7f844015ee20 2023-07-05T18:56:46.062 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:46.060+0000 7f842effd700 1 -- 172.21.15.46:0/1776258529 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v21) v1 ==== 93+0+10 (secure 0 0 0) 0x7f8438059900 con 0x7f844015ee20 2023-07-05T18:56:46.063 INFO:teuthology.orchestra.run.smithi046.stdout:pg_num: 1 2023-07-05T18:56:46.064 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:46.062+0000 7f8444fa8700 1 -- 172.21.15.46:0/1776258529 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7f842006ace0 msgr2=0x7f842006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:56:46.065 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:46.062+0000 7f8444fa8700 1 --2- 172.21.15.46:0/1776258529 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7f842006ace0 0x7f842006d190 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f8434001eb0 tx=0x7f8434001ce0 comp rx=0 tx=0).stop 2023-07-05T18:56:46.065 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:46.062+0000 7f8444fa8700 1 -- 172.21.15.46:0/1776258529 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f844015ee20 msgr2=0x7f84400cddf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:56:46.065 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:46.062+0000 7f8444fa8700 1 --2- 172.21.15.46:0/1776258529 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f844015ee20 0x7f84400cddf0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f8440072540 tx=0x7f8438004ad0 comp rx=0 tx=0).stop 2023-07-05T18:56:46.065 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:46.062+0000 7f8444fa8700 1 -- 172.21.15.46:0/1776258529 shutdown_connections 2023-07-05T18:56:46.065 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:46.062+0000 7f8444fa8700 1 --2- 172.21.15.46:0/1776258529 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7f842006ace0 0x7f842006d190 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:46.066 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:46.062+0000 7f8444fa8700 1 --2- 172.21.15.46:0/1776258529 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f844015ee20 0x7f84400cddf0 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:46.066 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:46.062+0000 7f8444fa8700 1 --2- 172.21.15.46:0/1776258529 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f84400af160 0x7f84400b6330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:46.066 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:46.062+0000 7f8444fa8700 1 --2- 172.21.15.46:0/1776258529 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f84400af530 0x7f84400cd8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:46.066 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:46.062+0000 7f8444fa8700 1 -- 172.21.15.46:0/1776258529 >> 172.21.15.46:0/1776258529 conn(0x7f84400664b0 msgr2=0x7f84400b2600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-05T18:56:46.066 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:46.062+0000 7f8444fa8700 1 -- 172.21.15.46:0/1776258529 shutdown_connections 2023-07-05T18:56:46.066 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:46.062+0000 7f8444fa8700 1 -- 172.21.15.46:0/1776258529 wait complete. 2023-07-05T18:56:46.077 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-07-05T18:56:46.206 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:46.204+0000 7ff7c1b3a700 1 Processor -- start 2023-07-05T18:56:46.206 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:46.204+0000 7ff7c1b3a700 1 -- start start 2023-07-05T18:56:46.207 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:46.205+0000 7ff7c1b3a700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7ff7bc0cb110 0x7ff7bc06b0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:56:46.207 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:46.205+0000 7ff7c1b3a700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7ff7bc15a890 0x7ff7bc06bc90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:56:46.208 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:46.205+0000 7ff7c1b3a700 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff7bc15e260 con 0x7ff7bc15ad10 2023-07-05T18:56:46.208 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:46.205+0000 7ff7c1b3a700 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff7bc15ede0 con 0x7ff7bc0cb110 2023-07-05T18:56:46.208 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:46.205+0000 7ff7c1b3a700 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff7bc15e540 con 0x7ff7bc15a890 2023-07-05T18:56:46.208 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:46.205+0000 7ff7bb7fe700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7ff7bc0cb110 0x7ff7bc06b0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:56:46.208 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:46.205+0000 7ff7bb7fe700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7ff7bc0cb110 0x7ff7bc06b0b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:58842/0 (socket says 172.21.15.46:58842) 2023-07-05T18:56:46.208 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:46.205+0000 7ff7bb7fe700 1 -- 172.21.15.46:0/954492276 learned_addr learned my addr 172.21.15.46:0/954492276 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-07-05T18:56:46.208 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:46.205+0000 7ff7baffd700 1 --2- 172.21.15.46:0/954492276 >> v2:172.21.15.73:3300/0 conn(0x7ff7bc15a890 0x7ff7bc06bc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:56:46.209 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:46.205+0000 7ff7bb7fe700 1 -- 172.21.15.46:0/954492276 >> v2:172.21.15.73:3300/0 conn(0x7ff7bc15a890 msgr2=0x7ff7bc06bc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-05T18:56:46.209 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:46.205+0000 7ff7bb7fe700 1 --2- 172.21.15.46:0/954492276 >> v2:172.21.15.73:3300/0 conn(0x7ff7bc15a890 0x7ff7bc06bc90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:46.209 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:46.205+0000 7ff7bb7fe700 1 -- 172.21.15.46:0/954492276 >> v1:172.21.15.73:6789/0 conn(0x7ff7bc15ad10 legacy=0x7ff7bc06a1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-05T18:56:46.209 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:46.205+0000 7ff7bb7fe700 1 -- 172.21.15.46:0/954492276 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff7bc15e820 con 0x7ff7bc0cb110 2023-07-05T18:56:46.209 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:46.205+0000 7ff7bb7fe700 1 --2- 172.21.15.46:0/954492276 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff7bc0cb110 0x7ff7bc06b0b0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7ff7bc066370 tx=0x7ff7ac009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5f80546d464dd8b6 server_cookie=0 in_seq=0 out_seq=0 2023-07-05T18:56:46.209 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:46.205+0000 7ff7ba7fc700 1 -- 172.21.15.46:0/954492276 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7ac004230 con 0x7ff7bc0cb110 2023-07-05T18:56:46.209 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:46.205+0000 7ff7ba7fc700 1 -- 172.21.15.46:0/954492276 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff7ac004390 con 0x7ff7bc0cb110 2023-07-05T18:56:46.210 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:46.205+0000 7ff7ba7fc700 1 -- 172.21.15.46:0/954492276 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7ac0036a0 con 0x7ff7bc0cb110 2023-07-05T18:56:46.213 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:46.206+0000 7ff7c1b3a700 1 -- 172.21.15.46:0/954492276 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff7bc0cb110 msgr2=0x7ff7bc06b0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:56:46.213 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:46.206+0000 7ff7c1b3a700 1 --2- 172.21.15.46:0/954492276 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff7bc0cb110 0x7ff7bc06b0b0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7ff7bc066370 tx=0x7ff7ac009bd0 comp rx=0 tx=0).stop 2023-07-05T18:56:46.213 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:46.206+0000 7ff7c1b3a700 1 -- 172.21.15.46:0/954492276 shutdown_connections 2023-07-05T18:56:46.213 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:46.206+0000 7ff7c1b3a700 1 --2- 172.21.15.46:0/954492276 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff7bc0cb110 0x7ff7bc06b0b0 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:46.214 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:46.206+0000 7ff7c1b3a700 1 --2- 172.21.15.46:0/954492276 >> v2:172.21.15.73:3300/0 conn(0x7ff7bc15a890 0x7ff7bc06bc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:46.214 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:46.206+0000 7ff7c1b3a700 1 -- 172.21.15.46:0/954492276 >> 172.21.15.46:0/954492276 conn(0x7ff7bc0b19a0 msgr2=0x7ff7bc0cf1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-05T18:56:46.214 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:46.206+0000 7ff7c1b3a700 1 -- 172.21.15.46:0/954492276 shutdown_connections 2023-07-05T18:56:46.214 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:46.206+0000 7ff7c1b3a700 1 -- 172.21.15.46:0/954492276 wait complete. 2023-07-05T18:56:46.214 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:46.208+0000 7ff7c1b3a700 1 Processor -- start 2023-07-05T18:56:46.215 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:46.208+0000 7ff7c1b3a700 1 -- start start 2023-07-05T18:56:46.215 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:46.209+0000 7ff7c1b3a700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff7bc0cb110 0x7ff7bc14c300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:56:46.215 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:46.209+0000 7ff7c1b3a700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff7bc15a890 0x7ff7bc1550a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:56:46.215 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:46.209+0000 7ff7c1b3a700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7ff7bc15ad10 0x7ff7bc15d5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:56:46.215 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:46.209+0000 7ff7c1b3a700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7bc1555e0 con 0x7ff7bc15a890 2023-07-05T18:56:46.215 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:46.209+0000 7ff7c1b3a700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7bc154c10 con 0x7ff7bc0cb110 2023-07-05T18:56:46.215 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:46.209+0000 7ff7c1b3a700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff7bc154000 con 0x7ff7bc15ad10 2023-07-05T18:56:46.216 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:46.209+0000 7ff7baffd700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff7bc15a890 0x7ff7bc1550a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:56:46.216 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:46.209+0000 7ff7baffd700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff7bc15a890 0x7ff7bc1550a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:58850/0 (socket says 172.21.15.46:58850) 2023-07-05T18:56:46.216 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:46.209+0000 7ff7baffd700 1 -- 172.21.15.46:0/3066589555 learned_addr learned my addr 172.21.15.46:0/3066589555 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-07-05T18:56:46.216 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:46.209+0000 7ff7bb7fe700 1 --2- 172.21.15.46:0/3066589555 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff7bc0cb110 0x7ff7bc14c300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:56:46.217 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:46.209+0000 7ff7bbfff700 1 --2- 172.21.15.46:0/3066589555 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7ff7bc15ad10 0x7ff7bc15d5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:56:46.217 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:46.209+0000 7ff7baffd700 1 -- 172.21.15.46:0/3066589555 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7ff7bc15ad10 msgr2=0x7ff7bc15d5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:56:46.217 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:46.209+0000 7ff7baffd700 1 --2- 172.21.15.46:0/3066589555 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7ff7bc15ad10 0x7ff7bc15d5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:46.217 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:46.209+0000 7ff7baffd700 1 -- 172.21.15.46:0/3066589555 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff7bc0cb110 msgr2=0x7ff7bc14c300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:56:46.217 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:46.209+0000 7ff7baffd700 1 --2- 172.21.15.46:0/3066589555 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff7bc0cb110 0x7ff7bc14c300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:46.217 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:46.209+0000 7ff7baffd700 1 -- 172.21.15.46:0/3066589555 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff7ac009550 con 0x7ff7bc15a890 2023-07-05T18:56:46.217 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:46.209+0000 7ff7bbfff700 1 --2- 172.21.15.46:0/3066589555 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7ff7bc15ad10 0x7ff7bc15d5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-05T18:56:46.217 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:46.209+0000 7ff7baffd700 1 --2- 172.21.15.46:0/3066589555 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff7bc15a890 0x7ff7bc1550a0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7ff7b000e810 tx=0x7ff7b000eb20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-05T18:56:46.218 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:46.209+0000 7ff7a3fff700 1 -- 172.21.15.46:0/3066589555 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7b0013610 con 0x7ff7bc15a890 2023-07-05T18:56:46.218 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:46.210+0000 7ff7a3fff700 1 -- 172.21.15.46:0/3066589555 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff7b0013770 con 0x7ff7bc15a890 2023-07-05T18:56:46.218 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:46.210+0000 7ff7c1b3a700 1 -- 172.21.15.46:0/3066589555 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff7bc1542e0 con 0x7ff7bc15a890 2023-07-05T18:56:46.218 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:46.210+0000 7ff7a3fff700 1 -- 172.21.15.46:0/3066589555 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7b0013b20 con 0x7ff7bc15a890 2023-07-05T18:56:46.218 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:46.210+0000 7ff7c1b3a700 1 -- 172.21.15.46:0/3066589555 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff7bc1548a0 con 0x7ff7bc15a890 2023-07-05T18:56:46.218 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:46.211+0000 7ff7c1b3a700 1 -- 172.21.15.46:0/3066589555 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff7bc154d80 con 0x7ff7bc15a890 2023-07-05T18:56:46.218 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:46.211+0000 7ff7a3fff700 1 -- 172.21.15.46:0/3066589555 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7ff7b0013c80 con 0x7ff7bc15a890 2023-07-05T18:56:46.219 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:46.211+0000 7ff7a3fff700 1 --2- 172.21.15.46:0/3066589555 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7ff7a806ace0 0x7ff7a806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:56:46.219 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:46.212+0000 7ff7a3fff700 1 -- 172.21.15.46:0/3066589555 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6062+0+0 (secure 0 0 0) 0x7ff7b0089170 con 0x7ff7bc15a890 2023-07-05T18:56:46.219 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:46.212+0000 7ff7bb7fe700 1 --2- 172.21.15.46:0/3066589555 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7ff7a806ace0 0x7ff7a806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:56:46.220 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:46.212+0000 7ff7bb7fe700 1 --2- 172.21.15.46:0/3066589555 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7ff7a806ace0 0x7ff7a806d190 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7ff7ac009130 tx=0x7ff7ac008030 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-05T18:56:46.220 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:46.216+0000 7ff7a3fff700 1 -- 172.21.15.46:0/3066589555 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7ff7b0054190 con 0x7ff7bc15a890 2023-07-05T18:56:46.415 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:46.413+0000 7ff7c1b3a700 1 -- 172.21.15.46:0/3066589555 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7ff7bc0672e0 con 0x7ff7bc15a890 2023-07-05T18:56:46.416 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:46.414+0000 7ff7a3fff700 1 -- 172.21.15.46:0/3066589555 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v21) v1 ==== 104+0+11 (secure 0 0 0) 0x7ff7b00577b0 con 0x7ff7bc15a890 2023-07-05T18:56:46.416 INFO:teuthology.orchestra.run.smithi046.stdout:pg_num: 32 2023-07-05T18:56:46.418 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:46.416+0000 7ff7c1b3a700 1 -- 172.21.15.46:0/3066589555 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7ff7a806ace0 msgr2=0x7ff7a806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:56:46.418 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:46.416+0000 7ff7c1b3a700 1 --2- 172.21.15.46:0/3066589555 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7ff7a806ace0 0x7ff7a806d190 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7ff7ac009130 tx=0x7ff7ac008030 comp rx=0 tx=0).stop 2023-07-05T18:56:46.418 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:46.416+0000 7ff7c1b3a700 1 -- 172.21.15.46:0/3066589555 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff7bc15a890 msgr2=0x7ff7bc1550a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:56:46.418 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:46.416+0000 7ff7c1b3a700 1 --2- 172.21.15.46:0/3066589555 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff7bc15a890 0x7ff7bc1550a0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7ff7b000e810 tx=0x7ff7b000eb20 comp rx=0 tx=0).stop 2023-07-05T18:56:46.419 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:46.416+0000 7ff7c1b3a700 1 -- 172.21.15.46:0/3066589555 shutdown_connections 2023-07-05T18:56:46.419 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:46.416+0000 7ff7c1b3a700 1 --2- 172.21.15.46:0/3066589555 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7ff7a806ace0 0x7ff7a806d190 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:46.419 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:46.416+0000 7ff7c1b3a700 1 --2- 172.21.15.46:0/3066589555 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7ff7bc15ad10 0x7ff7bc15d5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:46.419 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:46.416+0000 7ff7c1b3a700 1 --2- 172.21.15.46:0/3066589555 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff7bc0cb110 0x7ff7bc14c300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:46.419 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:46.416+0000 7ff7c1b3a700 1 --2- 172.21.15.46:0/3066589555 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff7bc15a890 0x7ff7bc1550a0 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:46.419 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:46.416+0000 7ff7c1b3a700 1 -- 172.21.15.46:0/3066589555 >> 172.21.15.46:0/3066589555 conn(0x7ff7bc0b19a0 msgr2=0x7ff7bc0c9970 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-05T18:56:46.419 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:46.416+0000 7ff7c1b3a700 1 -- 172.21.15.46:0/3066589555 shutdown_connections 2023-07-05T18:56:46.419 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:46.416+0000 7ff7c1b3a700 1 -- 172.21.15.46:0/3066589555 wait complete. 2023-07-05T18:56:46.430 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-07-05T18:56:46.560 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:46.558+0000 7f717495b700 1 Processor -- start 2023-07-05T18:56:46.561 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:46.558+0000 7f717495b700 1 -- start start 2023-07-05T18:56:46.562 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:46.559+0000 7f717495b700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f71700b13f0 0x7f71700b1870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:56:46.562 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:46.559+0000 7f717495b700 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f717015e040 con 0x7f71700c9fc0 2023-07-05T18:56:46.563 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:46.559+0000 7f717495b700 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f717015dbb0 con 0x7f71701594f0 2023-07-05T18:56:46.563 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:46.559+0000 7f717495b700 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f71700ce200 con 0x7f71700b13f0 2023-07-05T18:56:46.563 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:46.559+0000 7f716ed9d700 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7f71700c9fc0 0x7f71700ca3f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:58132/0 (socket says 172.21.15.46:58132) 2023-07-05T18:56:46.564 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:46.559+0000 7f716ed9d700 1 -- 172.21.15.46:0/1942767141 learned_addr learned my addr 172.21.15.46:0/1942767141 (peer_addr_for_me v1:172.21.15.46:0/0) 2023-07-05T18:56:46.564 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:46.560+0000 7f716dd9b700 1 --2- 172.21.15.46:0/1942767141 >> v2:172.21.15.73:3300/0 conn(0x7f71700b13f0 0x7f71700b1870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:56:46.564 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:46.560+0000 7f716d59a700 1 -- 172.21.15.46:0/1942767141 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2070693893 0 0) 0x7f717015e040 con 0x7f71700c9fc0 2023-07-05T18:56:46.565 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:46.560+0000 7f716d59a700 1 -- 172.21.15.46:0/1942767141 --> v1:172.21.15.46:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f71580035b0 con 0x7f71700c9fc0 2023-07-05T18:56:46.565 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:46.560+0000 7f716d59a700 1 -- 172.21.15.46:0/1942767141 <== mon.1 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 300188896 0 0) 0x7f717015dbb0 con 0x7f71701594f0 2023-07-05T18:56:46.565 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:46.560+0000 7f716d59a700 1 -- 172.21.15.46:0/1942767141 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f717015e040 con 0x7f71701594f0 2023-07-05T18:56:46.565 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:46.560+0000 7f716dd9b700 1 -- 172.21.15.46:0/1942767141 >> v1:172.21.15.73:6789/0 conn(0x7f71701594f0 legacy=0x7f71700cd690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:56:46.565 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:46.560+0000 7f716dd9b700 1 -- 172.21.15.46:0/1942767141 >> v1:172.21.15.46:6789/0 conn(0x7f71700c9fc0 legacy=0x7f71700ca3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:56:46.565 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:46.560+0000 7f716d59a700 1 -- 172.21.15.46:0/1942767141 <== mon.0 v1:172.21.15.46:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2971000443 0 0) 0x7f71580035b0 con 0x7f71700c9fc0 2023-07-05T18:56:46.565 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:46.560+0000 7f716dd9b700 1 -- 172.21.15.46:0/1942767141 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f71700cc1c0 con 0x7f71700b13f0 2023-07-05T18:56:46.566 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:46.560+0000 7f716dd9b700 1 --2- 172.21.15.46:0/1942767141 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f71700b13f0 0x7f71700b1870 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f7160009840 tx=0x7f7160009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=38fe6127254009ae server_cookie=0 in_seq=0 out_seq=0 2023-07-05T18:56:46.566 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:46.560+0000 7f716d59a700 1 -- 172.21.15.46:0/1942767141 <== mon.1 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71680019f0 con 0x7f71700b13f0 2023-07-05T18:56:46.566 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:46.560+0000 7f716d59a700 1 -- 172.21.15.46:0/1942767141 <== mon.1 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7160004030 con 0x7f71700b13f0 2023-07-05T18:56:46.566 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:46.560+0000 7f716d59a700 1 -- 172.21.15.46:0/1942767141 <== mon.1 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71600043c0 con 0x7f71700b13f0 2023-07-05T18:56:46.569 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:46.561+0000 7f717495b700 1 -- 172.21.15.46:0/1942767141 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f71700b13f0 msgr2=0x7f71700b1870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:56:46.569 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:46.561+0000 7f717495b700 1 --2- 172.21.15.46:0/1942767141 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f71700b13f0 0x7f71700b1870 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f7160009840 tx=0x7f7160009b50 comp rx=0 tx=0).stop 2023-07-05T18:56:46.569 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:46.561+0000 7f717495b700 1 -- 172.21.15.46:0/1942767141 shutdown_connections 2023-07-05T18:56:46.569 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:46.561+0000 7f717495b700 1 --2- 172.21.15.46:0/1942767141 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f71700b13f0 0x7f71700b1870 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:46.570 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:46.561+0000 7f717495b700 1 -- 172.21.15.46:0/1942767141 >> 172.21.15.46:0/1942767141 conn(0x7f717006bba0 msgr2=0x7f71700cc3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-05T18:56:46.570 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:46.561+0000 7f717495b700 1 -- 172.21.15.46:0/1942767141 shutdown_connections 2023-07-05T18:56:46.570 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:46.561+0000 7f717495b700 1 -- 172.21.15.46:0/1942767141 wait complete. 2023-07-05T18:56:46.570 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:46.562+0000 7f717495b700 1 Processor -- start 2023-07-05T18:56:46.571 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:46.562+0000 7f717495b700 1 -- start start 2023-07-05T18:56:46.571 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:46.563+0000 7f717495b700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f71700b13f0 0x7f7170155d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:56:46.571 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:46.563+0000 7f717495b700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f71700c9fc0 0x7f7170156280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:56:46.571 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:46.563+0000 7f717495b700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f71701594f0 0x7f71701f0690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:56:46.571 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:46.563+0000 7f717495b700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71701f1c90 con 0x7f71700c9fc0 2023-07-05T18:56:46.571 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:46.563+0000 7f717495b700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71701551c0 con 0x7f71700b13f0 2023-07-05T18:56:46.571 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:46.563+0000 7f717495b700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f71701f18f0 con 0x7f71701594f0 2023-07-05T18:56:46.571 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:46.563+0000 7f716dd9b700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f71700c9fc0 0x7f7170156280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:56:46.572 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:46.563+0000 7f716dd9b700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f71700c9fc0 0x7f7170156280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:58864/0 (socket says 172.21.15.46:58864) 2023-07-05T18:56:46.572 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:46.563+0000 7f716dd9b700 1 -- 172.21.15.46:0/401508386 learned_addr learned my addr 172.21.15.46:0/401508386 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-07-05T18:56:46.572 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:46.563+0000 7f716e59c700 1 --2- 172.21.15.46:0/401508386 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f71700b13f0 0x7f7170155d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:56:46.572 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:46.563+0000 7f716ed9d700 1 --2- 172.21.15.46:0/401508386 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f71701594f0 0x7f71701f0690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:56:46.572 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:46.564+0000 7f716dd9b700 1 -- 172.21.15.46:0/401508386 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f71701594f0 msgr2=0x7f71701f0690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:56:46.572 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:46.564+0000 7f716dd9b700 1 --2- 172.21.15.46:0/401508386 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f71701594f0 0x7f71701f0690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:46.572 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:46.564+0000 7f716dd9b700 1 -- 172.21.15.46:0/401508386 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f71700b13f0 msgr2=0x7f7170155d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:56:46.573 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:46.564+0000 7f716dd9b700 1 --2- 172.21.15.46:0/401508386 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f71700b13f0 0x7f7170155d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:46.573 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:46.564+0000 7f716dd9b700 1 -- 172.21.15.46:0/401508386 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f71600094a0 con 0x7f71700c9fc0 2023-07-05T18:56:46.573 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:46.564+0000 7f716e59c700 1 --2- 172.21.15.46:0/401508386 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f71700b13f0 0x7f7170155d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-05T18:56:46.573 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:46.564+0000 7f716dd9b700 1 --2- 172.21.15.46:0/401508386 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f71700c9fc0 0x7f7170156280 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f7160009b90 tx=0x7f7160004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-05T18:56:46.573 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:46.564+0000 7f715effd700 1 -- 172.21.15.46:0/401508386 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7160011830 con 0x7f71700c9fc0 2023-07-05T18:56:46.573 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:46.564+0000 7f715effd700 1 -- 172.21.15.46:0/401508386 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f716001f070 con 0x7f71700c9fc0 2023-07-05T18:56:46.573 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:46.564+0000 7f715effd700 1 -- 172.21.15.46:0/401508386 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7160011bf0 con 0x7f71700c9fc0 2023-07-05T18:56:46.573 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:46.564+0000 7f717495b700 1 -- 172.21.15.46:0/401508386 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7170156bc0 con 0x7f71700c9fc0 2023-07-05T18:56:46.574 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:46.564+0000 7f717495b700 1 -- 172.21.15.46:0/401508386 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7170157180 con 0x7f71700c9fc0 2023-07-05T18:56:46.574 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:46.565+0000 7f717495b700 1 -- 172.21.15.46:0/401508386 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7170067e40 con 0x7f71700c9fc0 2023-07-05T18:56:46.574 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:46.565+0000 7f715effd700 1 -- 172.21.15.46:0/401508386 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f7160011d50 con 0x7f71700c9fc0 2023-07-05T18:56:46.574 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:46.566+0000 7f715effd700 1 --2- 172.21.15.46:0/401508386 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7f715006ace0 0x7f715006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:56:46.574 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:46.566+0000 7f715effd700 1 -- 172.21.15.46:0/401508386 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f7160021070 con 0x7f71700c9fc0 2023-07-05T18:56:46.574 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:46.566+0000 7f716e59c700 1 --2- 172.21.15.46:0/401508386 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7f715006ace0 0x7f715006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:56:46.574 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:46.567+0000 7f716e59c700 1 --2- 172.21.15.46:0/401508386 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7f715006ace0 0x7f715006d190 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f71640011e0 tx=0x7f7164009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-05T18:56:46.575 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:46.570+0000 7f715effd700 1 -- 172.21.15.46:0/401508386 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f7160055ec0 con 0x7f71700c9fc0 2023-07-05T18:56:46.783 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:46.780+0000 7f717495b700 1 -- 172.21.15.46:0/401508386 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f71701f1dd0 con 0x7f71700c9fc0 2023-07-05T18:56:46.783 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:46.781+0000 7f715effd700 1 -- 172.21.15.46:0/401508386 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v21) v1 ==== 100+0+11 (secure 0 0 0) 0x7f71701f1dd0 con 0x7f71700c9fc0 2023-07-05T18:56:46.783 INFO:teuthology.orchestra.run.smithi046.stdout:pg_num: 64 2023-07-05T18:56:46.785 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:46.783+0000 7f717495b700 1 -- 172.21.15.46:0/401508386 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7f715006ace0 msgr2=0x7f715006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:56:46.786 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:46.783+0000 7f717495b700 1 --2- 172.21.15.46:0/401508386 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7f715006ace0 0x7f715006d190 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f71640011e0 tx=0x7f7164009040 comp rx=0 tx=0).stop 2023-07-05T18:56:46.786 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:46.783+0000 7f717495b700 1 -- 172.21.15.46:0/401508386 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f71700c9fc0 msgr2=0x7f7170156280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:56:46.786 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:46.783+0000 7f717495b700 1 --2- 172.21.15.46:0/401508386 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f71700c9fc0 0x7f7170156280 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f7160009b90 tx=0x7f7160004750 comp rx=0 tx=0).stop 2023-07-05T18:56:46.786 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:46.783+0000 7f717495b700 1 -- 172.21.15.46:0/401508386 shutdown_connections 2023-07-05T18:56:46.787 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:46.783+0000 7f717495b700 1 --2- 172.21.15.46:0/401508386 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7f715006ace0 0x7f715006d190 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:46.787 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:46.783+0000 7f717495b700 1 --2- 172.21.15.46:0/401508386 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f71701594f0 0x7f71701f0690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:46.787 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:46.783+0000 7f717495b700 1 --2- 172.21.15.46:0/401508386 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f71700b13f0 0x7f7170155d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:46.788 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:46.783+0000 7f717495b700 1 --2- 172.21.15.46:0/401508386 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f71700c9fc0 0x7f7170156280 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:46.788 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:46.783+0000 7f717495b700 1 -- 172.21.15.46:0/401508386 >> 172.21.15.46:0/401508386 conn(0x7f717006bba0 msgr2=0x7f71700cab90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-05T18:56:46.788 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:46.783+0000 7f717495b700 1 -- 172.21.15.46:0/401508386 shutdown_connections 2023-07-05T18:56:46.789 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:46.783+0000 7f717495b700 1 -- 172.21.15.46:0/401508386 wait complete. 2023-07-05T18:56:46.810 INFO:tasks.cephfs_test_runner:Starting test: test_generic (tasks.cephfs.tests_from_xfstests_dev.TestXFSTestsDev) 2023-07-05T18:56:46.811 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.tests_from_xfstests_dev.TestXFSTestsDev.test_generic' 2023-07-05T18:56:46.940 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:46.938+0000 7f273743d700 1 Processor -- start 2023-07-05T18:56:46.941 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:46.938+0000 7f273743d700 1 -- start start 2023-07-05T18:56:46.942 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:46.939+0000 7f273743d700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f27300b1d50 0x7f27300b54c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:56:46.943 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:46.939+0000 7f273743d700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f273015d710 0x7f273006c7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:56:46.943 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:46.939+0000 7f273743d700 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f273015a1e0 con 0x7f2730159180 2023-07-05T18:56:46.943 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:46.939+0000 7f273743d700 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f273015a670 con 0x7f27300b1d50 2023-07-05T18:56:46.943 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:46.939+0000 7f273743d700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f27300b5aa0 con 0x7f273015d710 2023-07-05T18:56:46.943 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:46.939+0000 7f27349d8700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f27300b1d50 0x7f27300b54c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:56:46.943 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:46.939+0000 7f27349d8700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f27300b1d50 0x7f27300b54c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:58872/0 (socket says 172.21.15.46:58872) 2023-07-05T18:56:46.943 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:46.939+0000 7f27349d8700 1 -- 172.21.15.46:0/1468966375 learned_addr learned my addr 172.21.15.46:0/1468966375 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-07-05T18:56:46.944 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:46.939+0000 7f27359da700 1 --2- 172.21.15.46:0/1468966375 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f273015d710 0x7f273006c7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:56:46.944 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:46.940+0000 7f27349d8700 1 -- 172.21.15.46:0/1468966375 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f273015d710 msgr2=0x7f273006c7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-05T18:56:46.944 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:46.940+0000 7f27349d8700 1 --2- 172.21.15.46:0/1468966375 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f273015d710 0x7f273006c7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:46.944 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:46.940+0000 7f27349d8700 1 -- 172.21.15.46:0/1468966375 >> v1:172.21.15.73:6789/0 conn(0x7f2730159180 legacy=0x7f27300b1640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:56:46.944 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:46.940+0000 7f27349d8700 1 -- 172.21.15.46:0/1468966375 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f27301598b0 con 0x7f27300b1d50 2023-07-05T18:56:46.944 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:46.940+0000 7f27349d8700 1 --2- 172.21.15.46:0/1468966375 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f27300b1d50 0x7f27300b54c0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f272c00bb90 tx=0x7f272c00bea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=53c2188e08ad1f8f server_cookie=0 in_seq=0 out_seq=0 2023-07-05T18:56:46.944 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:46.940+0000 7f2727fff700 1 -- 172.21.15.46:0/1468966375 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f272c00dd30 con 0x7f27300b1d50 2023-07-05T18:56:46.945 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:46.940+0000 7f2727fff700 1 -- 172.21.15.46:0/1468966375 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f272c00de90 con 0x7f27300b1d50 2023-07-05T18:56:46.945 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:46.940+0000 7f2727fff700 1 -- 172.21.15.46:0/1468966375 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f272c010690 con 0x7f27300b1d50 2023-07-05T18:56:46.945 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:46.940+0000 7f273743d700 1 -- 172.21.15.46:0/1468966375 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f27300b1d50 msgr2=0x7f27300b54c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:56:46.945 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:46.940+0000 7f273743d700 1 --2- 172.21.15.46:0/1468966375 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f27300b1d50 0x7f27300b54c0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f272c00bb90 tx=0x7f272c00bea0 comp rx=0 tx=0).stop 2023-07-05T18:56:46.945 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:46.941+0000 7f273743d700 1 -- 172.21.15.46:0/1468966375 shutdown_connections 2023-07-05T18:56:46.945 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:46.941+0000 7f273743d700 1 --2- 172.21.15.46:0/1468966375 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f273015d710 0x7f273006c7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:46.945 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:46.941+0000 7f273743d700 1 --2- 172.21.15.46:0/1468966375 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f27300b1d50 0x7f27300b54c0 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:46.946 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:46.941+0000 7f273743d700 1 -- 172.21.15.46:0/1468966375 >> 172.21.15.46:0/1468966375 conn(0x7f27300cf9a0 msgr2=0x7f27300cfda0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-05T18:56:46.946 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:46.941+0000 7f273743d700 1 -- 172.21.15.46:0/1468966375 shutdown_connections 2023-07-05T18:56:46.946 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:46.941+0000 7f273743d700 1 -- 172.21.15.46:0/1468966375 wait complete. 2023-07-05T18:56:46.948 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:46.942+0000 7f273743d700 1 Processor -- start 2023-07-05T18:56:46.948 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:46.942+0000 7f273743d700 1 -- start start 2023-07-05T18:56:46.948 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:46.943+0000 7f273743d700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f27300b1d50 0x7f273014e590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:56:46.948 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:46.943+0000 7f273743d700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f2730159180 0x7f2730156c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:56:46.949 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:46.943+0000 7f273743d700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f273015d710 0x7f273006c7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:56:46.949 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:46.943+0000 7f273743d700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f273015af50 con 0x7f273015d710 2023-07-05T18:56:46.949 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:46.943+0000 7f273743d700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f273014ead0 con 0x7f27300b1d50 2023-07-05T18:56:46.949 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:46.943+0000 7f273743d700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2730157490 con 0x7f2730159180 2023-07-05T18:56:46.949 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:46.943+0000 7f27359da700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f273015d710 0x7f273006c7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:56:46.949 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:46.943+0000 7f27359da700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f273015d710 0x7f273006c7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:58880/0 (socket says 172.21.15.46:58880) 2023-07-05T18:56:46.950 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:46.943+0000 7f27359da700 1 -- 172.21.15.46:0/1688583043 learned_addr learned my addr 172.21.15.46:0/1688583043 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-07-05T18:56:46.950 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:46.943+0000 7f27349d8700 1 --2- 172.21.15.46:0/1688583043 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f2730159180 0x7f2730156c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:56:46.950 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:46.943+0000 7f27351d9700 1 --2- 172.21.15.46:0/1688583043 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f27300b1d50 0x7f273014e590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:56:46.950 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:46.943+0000 7f27359da700 1 -- 172.21.15.46:0/1688583043 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f2730159180 msgr2=0x7f2730156c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:56:46.951 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:46.943+0000 7f27359da700 1 --2- 172.21.15.46:0/1688583043 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f2730159180 0x7f2730156c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:46.951 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:46.943+0000 7f27359da700 1 -- 172.21.15.46:0/1688583043 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f27300b1d50 msgr2=0x7f273014e590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:56:46.951 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:46.943+0000 7f27359da700 1 --2- 172.21.15.46:0/1688583043 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f27300b1d50 0x7f273014e590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:46.951 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:46.943+0000 7f27359da700 1 -- 172.21.15.46:0/1688583043 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f272c00b7f0 con 0x7f273015d710 2023-07-05T18:56:46.951 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:46.943+0000 7f27359da700 1 --2- 172.21.15.46:0/1688583043 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f273015d710 0x7f273006c7a0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f272800efc0 tx=0x7f272800c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-05T18:56:46.951 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:46.944+0000 7f2725ffb700 1 -- 172.21.15.46:0/1688583043 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2728009ea0 con 0x7f273015d710 2023-07-05T18:56:46.951 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:46.944+0000 7f2725ffb700 1 -- 172.21.15.46:0/1688583043 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f272800f040 con 0x7f273015d710 2023-07-05T18:56:46.952 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:46.944+0000 7f273743d700 1 -- 172.21.15.46:0/1688583043 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2730157770 con 0x7f273015d710 2023-07-05T18:56:46.952 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:46.944+0000 7f2725ffb700 1 -- 172.21.15.46:0/1688583043 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f272800ced0 con 0x7f273015d710 2023-07-05T18:56:46.952 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:46.944+0000 7f273743d700 1 -- 172.21.15.46:0/1688583043 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f273015abe0 con 0x7f273015d710 2023-07-05T18:56:46.952 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:46.945+0000 7f273743d700 1 -- 172.21.15.46:0/1688583043 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f273015b0c0 con 0x7f273015d710 2023-07-05T18:56:46.952 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:46.945+0000 7f2725ffb700 1 -- 172.21.15.46:0/1688583043 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f2728014480 con 0x7f273015d710 2023-07-05T18:56:46.952 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:46.946+0000 7f2725ffb700 1 --2- 172.21.15.46:0/1688583043 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7f271406ace0 0x7f271406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:56:46.952 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:46.946+0000 7f2725ffb700 1 -- 172.21.15.46:0/1688583043 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f2728089c80 con 0x7f273015d710 2023-07-05T18:56:46.953 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:46.946+0000 7f27351d9700 1 --2- 172.21.15.46:0/1688583043 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7f271406ace0 0x7f271406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:56:46.953 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:46.946+0000 7f27351d9700 1 --2- 172.21.15.46:0/1688583043 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7f271406ace0 0x7f271406d190 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f2720000fb0 tx=0x7f2720009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-05T18:56:46.953 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:46.950+0000 7f2725ffb700 1 -- 172.21.15.46:0/1688583043 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f2728054d30 con 0x7f273015d710 2023-07-05T18:56:47.241 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:47.239+0000 7f273743d700 1 -- 172.21.15.46:0/1688583043 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.tests_from_xfstests_dev.TestXFSTestsDev.test_generic"]} v 0) v1 -- 0x7f27300672e0 con 0x7f273015d710 2023-07-05T18:56:47.329 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:47.327+0000 7f2725ffb700 1 -- 172.21.15.46:0/1688583043 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.tests_from_xfstests_dev.TestXFSTestsDev.test_generic"]}]=0 v51) v1 ==== 147+0+0 (secure 0 0 0) 0x7f2728058350 con 0x7f273015d710 2023-07-05T18:56:47.331 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:47.329+0000 7f273743d700 1 -- 172.21.15.46:0/1688583043 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7f271406ace0 msgr2=0x7f271406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:56:47.332 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:47.329+0000 7f273743d700 1 --2- 172.21.15.46:0/1688583043 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7f271406ace0 0x7f271406d190 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f2720000fb0 tx=0x7f2720009040 comp rx=0 tx=0).stop 2023-07-05T18:56:47.332 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:47.329+0000 7f273743d700 1 -- 172.21.15.46:0/1688583043 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f273015d710 msgr2=0x7f273006c7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:56:47.333 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:47.329+0000 7f273743d700 1 --2- 172.21.15.46:0/1688583043 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f273015d710 0x7f273006c7a0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f272800efc0 tx=0x7f272800c3a0 comp rx=0 tx=0).stop 2023-07-05T18:56:47.333 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:47.329+0000 7f273743d700 1 -- 172.21.15.46:0/1688583043 shutdown_connections 2023-07-05T18:56:47.334 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:47.329+0000 7f273743d700 1 --2- 172.21.15.46:0/1688583043 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7f271406ace0 0x7f271406d190 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:47.334 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:47.329+0000 7f273743d700 1 --2- 172.21.15.46:0/1688583043 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f273015d710 0x7f273006c7a0 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:47.334 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:47.329+0000 7f273743d700 1 --2- 172.21.15.46:0/1688583043 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f27300b1d50 0x7f273014e590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:47.335 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:47.329+0000 7f273743d700 1 --2- 172.21.15.46:0/1688583043 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f2730159180 0x7f2730156c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:47.335 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:47.329+0000 7f273743d700 1 -- 172.21.15.46:0/1688583043 >> 172.21.15.46:0/1688583043 conn(0x7f27300cf9a0 msgr2=0x7f27300cbb90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-05T18:56:47.335 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:47.329+0000 7f273743d700 1 -- 172.21.15.46:0/1688583043 shutdown_connections 2023-07-05T18:56:47.335 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:47.329+0000 7f273743d700 1 -- 172.21.15.46:0/1688583043 wait complete. 2023-07-05T18:56:47.346 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-05T18:56:47.473 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:47.469+0000 7f7cda943700 1 Processor -- start 2023-07-05T18:56:47.473 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:47.469+0000 7f7cda943700 1 -- start start 2023-07-05T18:56:47.473 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:47.470+0000 7f7cda943700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f7cd4142480 0x7f7cd40b41d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:56:47.473 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:47.470+0000 7f7cda943700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f7cd40b4710 0x7f7cd406d140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:56:47.473 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:47.470+0000 7f7cda943700 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7cd406c8d0 con 0x7f7cd413f4c0 2023-07-05T18:56:47.473 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:47.470+0000 7f7cda943700 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7cd406ce90 con 0x7f7cd4142480 2023-07-05T18:56:47.474 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:47.470+0000 7f7cda943700 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7cd406cbb0 con 0x7f7cd40b4710 2023-07-05T18:56:47.474 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:47.470+0000 7f7cd37fe700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f7cd4142480 0x7f7cd40b41d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:56:47.474 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:47.470+0000 7f7cd37fe700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f7cd4142480 0x7f7cd40b41d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:58886/0 (socket says 172.21.15.46:58886) 2023-07-05T18:56:47.474 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:47.470+0000 7f7cd37fe700 1 -- 172.21.15.46:0/1752976650 learned_addr learned my addr 172.21.15.46:0/1752976650 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-07-05T18:56:47.474 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:47.470+0000 7f7cd8ee0700 1 --2- 172.21.15.46:0/1752976650 >> v2:172.21.15.73:3300/0 conn(0x7f7cd40b4710 0x7f7cd406d140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:56:47.474 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:47.471+0000 7f7cd37fe700 1 -- 172.21.15.46:0/1752976650 >> v2:172.21.15.73:3300/0 conn(0x7f7cd40b4710 msgr2=0x7f7cd406d140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-05T18:56:47.474 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:47.471+0000 7f7cd37fe700 1 --2- 172.21.15.46:0/1752976650 >> v2:172.21.15.73:3300/0 conn(0x7f7cd40b4710 0x7f7cd406d140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:47.475 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:47.471+0000 7f7cd37fe700 1 -- 172.21.15.46:0/1752976650 >> v1:172.21.15.73:6789/0 conn(0x7f7cd413f4c0 legacy=0x7f7cd415d6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:56:47.475 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:47.471+0000 7f7cd37fe700 1 -- 172.21.15.46:0/1752976650 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7cd40b39d0 con 0x7f7cd4142480 2023-07-05T18:56:47.475 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:47.471+0000 7f7cd37fe700 1 --2- 172.21.15.46:0/1752976650 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7cd4142480 0x7f7cd40b41d0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f7cd41428f0 tx=0x7f7cbc009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=41580f9df37365a6 server_cookie=0 in_seq=0 out_seq=0 2023-07-05T18:56:47.475 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:47.471+0000 7f7cd2ffd700 1 -- 172.21.15.46:0/1752976650 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7cbc011830 con 0x7f7cd4142480 2023-07-05T18:56:47.475 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:47.471+0000 7f7cd2ffd700 1 -- 172.21.15.46:0/1752976650 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7cbc011990 con 0x7f7cd4142480 2023-07-05T18:56:47.475 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:47.471+0000 7f7cd2ffd700 1 -- 172.21.15.46:0/1752976650 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7cbc011d20 con 0x7f7cd4142480 2023-07-05T18:56:47.477 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:47.471+0000 7f7cda943700 1 -- 172.21.15.46:0/1752976650 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7cd4142480 msgr2=0x7f7cd40b41d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:56:47.477 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:47.471+0000 7f7cda943700 1 --2- 172.21.15.46:0/1752976650 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7cd4142480 0x7f7cd40b41d0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f7cd41428f0 tx=0x7f7cbc009bd0 comp rx=0 tx=0).stop 2023-07-05T18:56:47.478 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:47.471+0000 7f7cda943700 1 -- 172.21.15.46:0/1752976650 shutdown_connections 2023-07-05T18:56:47.478 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:47.471+0000 7f7cda943700 1 --2- 172.21.15.46:0/1752976650 >> v2:172.21.15.73:3300/0 conn(0x7f7cd40b4710 0x7f7cd406d140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:47.478 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:47.471+0000 7f7cda943700 1 --2- 172.21.15.46:0/1752976650 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7cd4142480 0x7f7cd40b41d0 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:47.478 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:47.471+0000 7f7cda943700 1 -- 172.21.15.46:0/1752976650 >> 172.21.15.46:0/1752976650 conn(0x7f7cd406af10 msgr2=0x7f7cd406b2e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-05T18:56:47.479 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:47.471+0000 7f7cda943700 1 -- 172.21.15.46:0/1752976650 shutdown_connections 2023-07-05T18:56:47.479 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:47.472+0000 7f7cda943700 1 -- 172.21.15.46:0/1752976650 wait complete. 2023-07-05T18:56:47.479 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:47.473+0000 7f7cda943700 1 Processor -- start 2023-07-05T18:56:47.479 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:47.473+0000 7f7cda943700 1 -- start start 2023-07-05T18:56:47.479 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:47.474+0000 7f7cda943700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7cd40b4710 0x7f7cd4134310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:56:47.479 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:47.474+0000 7f7cda943700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7cd413f4c0 0x7f7cd413bff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:56:47.479 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:47.474+0000 7f7cda943700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f7cd4142480 0x7f7cd415a130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:56:47.480 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:47.474+0000 7f7cda943700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7cd40aec60 con 0x7f7cd413f4c0 2023-07-05T18:56:47.480 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:47.474+0000 7f7cda943700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7cd40acd30 con 0x7f7cd40b4710 2023-07-05T18:56:47.480 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:47.474+0000 7f7cda943700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7cd4134850 con 0x7f7cd4142480 2023-07-05T18:56:47.480 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:47.474+0000 7f7cd37fe700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7cd413f4c0 0x7f7cd413bff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:56:47.480 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:47.474+0000 7f7cd37fe700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7cd413f4c0 0x7f7cd413bff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:58892/0 (socket says 172.21.15.46:58892) 2023-07-05T18:56:47.480 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:47.474+0000 7f7cd37fe700 1 -- 172.21.15.46:0/4106867810 learned_addr learned my addr 172.21.15.46:0/4106867810 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-07-05T18:56:47.480 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:47.474+0000 7f7cd3fff700 1 --2- 172.21.15.46:0/4106867810 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7cd40b4710 0x7f7cd4134310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:56:47.480 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:47.474+0000 7f7cd8ee0700 1 --2- 172.21.15.46:0/4106867810 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f7cd4142480 0x7f7cd415a130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:56:47.481 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:47.474+0000 7f7cd37fe700 1 -- 172.21.15.46:0/4106867810 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f7cd4142480 msgr2=0x7f7cd415a130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:56:47.481 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:47.474+0000 7f7cd37fe700 1 --2- 172.21.15.46:0/4106867810 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f7cd4142480 0x7f7cd415a130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:47.481 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:47.474+0000 7f7cd37fe700 1 -- 172.21.15.46:0/4106867810 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7cd40b4710 msgr2=0x7f7cd4134310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:56:47.481 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:47.474+0000 7f7cd37fe700 1 --2- 172.21.15.46:0/4106867810 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7cd40b4710 0x7f7cd4134310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:47.482 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:47.474+0000 7f7cd37fe700 1 -- 172.21.15.46:0/4106867810 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7cbc009550 con 0x7f7cd413f4c0 2023-07-05T18:56:47.482 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:47.474+0000 7f7cd37fe700 1 --2- 172.21.15.46:0/4106867810 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7cd413f4c0 0x7f7cd413bff0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f7cbc009c10 tx=0x7f7cbc004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-05T18:56:47.482 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:47.474+0000 7f7cd0ff9700 1 -- 172.21.15.46:0/4106867810 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7cbc0036a0 con 0x7f7cd413f4c0 2023-07-05T18:56:47.482 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:47.474+0000 7f7cd0ff9700 1 -- 172.21.15.46:0/4106867810 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7cbc01e070 con 0x7f7cd413f4c0 2023-07-05T18:56:47.482 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:47.474+0000 7f7cda943700 1 -- 172.21.15.46:0/4106867810 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7cd413cf70 con 0x7f7cd413f4c0 2023-07-05T18:56:47.482 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:47.474+0000 7f7cd0ff9700 1 -- 172.21.15.46:0/4106867810 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7cbc003a40 con 0x7f7cd413f4c0 2023-07-05T18:56:47.482 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:47.475+0000 7f7cda943700 1 -- 172.21.15.46:0/4106867810 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7cd413c9b0 con 0x7f7cd413f4c0 2023-07-05T18:56:47.483 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:47.475+0000 7f7cda943700 1 -- 172.21.15.46:0/4106867810 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7cd40ace70 con 0x7f7cd413f4c0 2023-07-05T18:56:47.483 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:47.476+0000 7f7cd0ff9700 1 -- 172.21.15.46:0/4106867810 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f7cbc003ba0 con 0x7f7cd413f4c0 2023-07-05T18:56:47.484 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:47.476+0000 7f7cd0ff9700 1 --2- 172.21.15.46:0/4106867810 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7f7cb406ace0 0x7f7cb406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:56:47.484 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:47.476+0000 7f7cd0ff9700 1 -- 172.21.15.46:0/4106867810 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f7cbc08a360 con 0x7f7cd413f4c0 2023-07-05T18:56:47.484 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:47.477+0000 7f7cd3fff700 1 --2- 172.21.15.46:0/4106867810 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7f7cb406ace0 0x7f7cb406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:56:47.484 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:47.477+0000 7f7cd3fff700 1 --2- 172.21.15.46:0/4106867810 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7f7cb406ace0 0x7f7cb406d190 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f7cc40016c0 tx=0x7f7cc4009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-05T18:56:47.485 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:47.481+0000 7f7cd0ff9700 1 -- 172.21.15.46:0/4106867810 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f7cd40ace70 con 0x7f7cd413f4c0 2023-07-05T18:56:47.681 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:47.679+0000 7f7cda943700 1 -- 172.21.15.46:0/4106867810 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f7cd40ace70 con 0x7f7cd413f4c0 2023-07-05T18:56:47.682 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:47.681+0000 7f7cd0ff9700 1 -- 172.21.15.46:0/4106867810 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) v1 ==== 74+0+18161 (secure 0 0 0) 0x7f7cd40ace70 con 0x7f7cd413f4c0 2023-07-05T18:56:47.683 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T18:56:47.683 INFO:teuthology.orchestra.run.smithi046.stdout:{"epoch":21,"fsid":"042652d3-d80c-4ad8-9366-3e94f2a0a512","created":"2023-07-05T18:55:56.455710+0000","modified":"2023-07-05T18:56:16.095672+0000","last_up_change":"2023-07-05T18:56:06.594022+0000","last_in_change":"2023-07-05T18:55:58.879340+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-07-05T18:56:07.729620+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2023-07-05T18:56:08.128122+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-07-05T18:56:12.954625+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-07-05T18:56:14.068396+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"20009183-9a47-4392-8751-883f88d2bfb1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6813","nonce":4151971443},{"type":"v1","addr":"172.21.15.46:6815","nonce":4151971443}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6817","nonce":4151971443},{"type":"v1","addr":"172.21.15.46:6818","nonce":4151971443}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6822","nonce":4151971443},{"type":"v1","addr":"172.21.15.46:6823","nonce":4151971443}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6820","nonce":4151971443},{"type":"v1","addr":"172.21.15.46:6821","nonce":4151971443}]},"public_addr":"172.21.15.46:6815/4151971443","cluster_addr":"172.21.15.46:6818/4151971443","heartbeat_back_addr":"172.21.15.46:6823/4151971443","heartbeat_front_addr":"172.21.15.46:6821/4151971443","state":["exists","up"]},{"osd":1,"uuid":"91b4a7b0-e4e4-4888-a1fe-9edb0d68004c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6808","nonce":502575881},{"type":"v1","addr":"172.21.15.46:6809","nonce":502575881}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6810","nonce":502575881},{"type":"v1","addr":"172.21.15.46:6811","nonce":502575881}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6816","nonce":502575881},{"type":"v1","addr":"172.21.15.46:6819","nonce":502575881}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6812","nonce":502575881},{"type":"v1","addr":"172.21.15.46:6814","nonce":502575881}]},"public_addr":"172.21.15.46:6809/502575881","cluster_addr":"172.21.15.46:6811/502575881","heartbeat_back_addr":"172.21.15.46:6819/502575881","heartbeat_front_addr":"172.21.15.46:6814/502575881","state":["exists","up"]},{"osd":2,"uuid":"669ff744-1331-47c5-8579-0440731c889a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6800","nonce":2115251461},{"type":"v1","addr":"172.21.15.46:6801","nonce":2115251461}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6802","nonce":2115251461},{"type":"v1","addr":"172.21.15.46:6803","nonce":2115251461}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6806","nonce":2115251461},{"type":"v1","addr":"172.21.15.46:6807","nonce":2115251461}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6804","nonce":2115251461},{"type":"v1","addr":"172.21.15.46:6805","nonce":2115251461}]},"public_addr":"172.21.15.46:6801/2115251461","cluster_addr":"172.21.15.46:6803/2115251461","heartbeat_back_addr":"172.21.15.46:6807/2115251461","heartbeat_front_addr":"172.21.15.46:6805/2115251461","state":["exists","up"]},{"osd":3,"uuid":"34e1b86d-ffad-415d-861c-07a5f08068a6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6824","nonce":2981388766},{"type":"v1","addr":"172.21.15.46:6825","nonce":2981388766}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6826","nonce":2981388766},{"type":"v1","addr":"172.21.15.46:6827","nonce":2981388766}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6830","nonce":2981388766},{"type":"v1","addr":"172.21.15.46:6831","nonce":2981388766}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6828","nonce":2981388766},{"type":"v1","addr":"172.21.15.46:6829","nonce":2981388766}]},"public_addr":"172.21.15.46:6825/2981388766","cluster_addr":"172.21.15.46:6827/2981388766","heartbeat_back_addr":"172.21.15.46:6831/2981388766","heartbeat_front_addr":"172.21.15.46:6829/2981388766","state":["exists","up"]},{"osd":4,"uuid":"57ffcb91-c7dc-4a69-ae71-4d9622a14a05","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6800","nonce":2083655348},{"type":"v1","addr":"172.21.15.73:6801","nonce":2083655348}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6802","nonce":2083655348},{"type":"v1","addr":"172.21.15.73:6803","nonce":2083655348}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6806","nonce":2083655348},{"type":"v1","addr":"172.21.15.73:6807","nonce":2083655348}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6804","nonce":2083655348},{"type":"v1","addr":"172.21.15.73:6805","nonce":2083655348}]},"public_addr":"172.21.15.73:6801/2083655348","cluster_addr":"172.21.15.73:6803/2083655348","heartbeat_back_addr":"172.21.15.73:6807/2083655348","heartbeat_front_addr":"172.21.15.73:6805/2083655348","state":["exists","up"]},{"osd":5,"uuid":"665f41c9-ee20-49cf-bf0e-fbe0c03d3aed","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6824","nonce":2803788401},{"type":"v1","addr":"172.21.15.73:6825","nonce":2803788401}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6826","nonce":2803788401},{"type":"v1","addr":"172.21.15.73:6827","nonce":2803788401}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6830","nonce":2803788401},{"type":"v1","addr":"172.21.15.73:6831","nonce":2803788401}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6828","nonce":2803788401},{"type":"v1","addr":"172.21.15.73:6829","nonce":2803788401}]},"public_addr":"172.21.15.73:6825/2803788401","cluster_addr":"172.21.15.73:6827/2803788401","heartbeat_back_addr":"172.21.15.73:6831/2803788401","heartbeat_front_addr":"172.21.15.73:6829/2803788401","state":["exists","up"]},{"osd":6,"uuid":"5790c6cc-bd56-4ce4-9a7c-0f0c3b59215c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6808","nonce":974108383},{"type":"v1","addr":"172.21.15.73:6809","nonce":974108383}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6810","nonce":974108383},{"type":"v1","addr":"172.21.15.73:6811","nonce":974108383}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6815","nonce":974108383},{"type":"v1","addr":"172.21.15.73:6817","nonce":974108383}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6812","nonce":974108383},{"type":"v1","addr":"172.21.15.73:6813","nonce":974108383}]},"public_addr":"172.21.15.73:6809/974108383","cluster_addr":"172.21.15.73:6811/974108383","heartbeat_back_addr":"172.21.15.73:6817/974108383","heartbeat_front_addr":"172.21.15.73:6813/974108383","state":["exists","up"]},{"osd":7,"uuid":"b66f4d2e-147e-4c9b-97dd-cbd59d33802e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6814","nonce":3772673248},{"type":"v1","addr":"172.21.15.73:6816","nonce":3772673248}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6818","nonce":3772673248},{"type":"v1","addr":"172.21.15.73:6819","nonce":3772673248}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6822","nonce":3772673248},{"type":"v1","addr":"172.21.15.73:6823","nonce":3772673248}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6820","nonce":3772673248},{"type":"v1","addr":"172.21.15.73:6821","nonce":3772673248}]},"public_addr":"172.21.15.73:6816/3772673248","cluster_addr":"172.21.15.73:6819/3772673248","heartbeat_back_addr":"172.21.15.73:6823/3772673248","heartbeat_front_addr":"172.21.15.73:6821/3772673248","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-05T18:56:04.115334+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-05T18:56:04.071250+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-05T18:56:04.044387+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-05T18:56:04.085389+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-05T18:56:04.090726+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-05T18:56:04.074529+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-05T18:56:04.058841+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-05T18:56:04.043054+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-05T18:56:47.685 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:47.683+0000 7f7cda943700 1 -- 172.21.15.46:0/4106867810 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7f7cb406ace0 msgr2=0x7f7cb406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:56:47.686 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:47.683+0000 7f7cda943700 1 --2- 172.21.15.46:0/4106867810 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7f7cb406ace0 0x7f7cb406d190 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f7cc40016c0 tx=0x7f7cc4009040 comp rx=0 tx=0).stop 2023-07-05T18:56:47.686 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:47.683+0000 7f7cda943700 1 -- 172.21.15.46:0/4106867810 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7cd413f4c0 msgr2=0x7f7cd413bff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:56:47.686 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:47.683+0000 7f7cda943700 1 --2- 172.21.15.46:0/4106867810 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7cd413f4c0 0x7f7cd413bff0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f7cbc009c10 tx=0x7f7cbc004750 comp rx=0 tx=0).stop 2023-07-05T18:56:47.686 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:47.683+0000 7f7cda943700 1 -- 172.21.15.46:0/4106867810 shutdown_connections 2023-07-05T18:56:47.686 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:47.683+0000 7f7cda943700 1 --2- 172.21.15.46:0/4106867810 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7f7cb406ace0 0x7f7cb406d190 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:47.686 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:47.683+0000 7f7cda943700 1 --2- 172.21.15.46:0/4106867810 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f7cd4142480 0x7f7cd415a130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:47.687 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:47.683+0000 7f7cda943700 1 --2- 172.21.15.46:0/4106867810 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7cd40b4710 0x7f7cd4134310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:47.687 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:47.683+0000 7f7cda943700 1 --2- 172.21.15.46:0/4106867810 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7cd413f4c0 0x7f7cd413bff0 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:47.687 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:47.683+0000 7f7cda943700 1 -- 172.21.15.46:0/4106867810 >> 172.21.15.46:0/4106867810 conn(0x7f7cd406af10 msgr2=0x7f7cd41410d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-05T18:56:47.687 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:47.683+0000 7f7cda943700 1 -- 172.21.15.46:0/4106867810 shutdown_connections 2023-07-05T18:56:47.687 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:47.683+0000 7f7cda943700 1 -- 172.21.15.46:0/4106867810 wait complete. 2023-07-05T18:56:47.698 INFO:tasks.cephfs.cephfs_test_case.ceph_manager:[{'pool': 1, 'pool_name': 'rbd', 'create_time': '2023-07-05T18:56:07.729620+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': '.mgr', 'create_time': '2023-07-05T18:56:08.128122+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-07-05T18:56:12.954625+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-07-05T18:56:14.068396+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-07-05T18:56:47.699 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-07-05T18:56:47.828 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:47.826+0000 7f94de216700 1 Processor -- start 2023-07-05T18:56:47.829 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:47.826+0000 7f94de216700 1 -- start start 2023-07-05T18:56:47.832 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:47.827+0000 7f94de216700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f94d80b1ce0 0x7f94d806ebf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:56:47.832 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:47.827+0000 7f94de216700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f94d80ce530 0x7f94d8160980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:56:47.833 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:47.827+0000 7f94de216700 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f94d80ce0a0 con 0x7f94d815fa70 2023-07-05T18:56:47.833 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:47.827+0000 7f94de216700 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f94d80cf4b0 con 0x7f94d80b1ce0 2023-07-05T18:56:47.833 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:47.827+0000 7f94de216700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f94d8160ec0 con 0x7f94d80ce530 2023-07-05T18:56:47.833 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:47.827+0000 7f94d7fff700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f94d80ce530 0x7f94d8160980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:56:47.833 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:47.827+0000 7f94d6ffd700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f94d80b1ce0 0x7f94d806ebf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:56:47.833 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:47.827+0000 7f94d77fe700 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7f94d815fa70 0x7f94d80b15d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.46:44086/0 (socket says 172.21.15.46:44086) 2023-07-05T18:56:47.833 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:47.827+0000 7f94d77fe700 1 -- 172.21.15.46:0/3936210503 learned_addr learned my addr 172.21.15.46:0/3936210503 (peer_addr_for_me v1:172.21.15.46:0/0) 2023-07-05T18:56:47.833 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:47.828+0000 7f94d67fc700 1 -- 172.21.15.46:0/3936210503 <== mon.1 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 364676511 0 0) 0x7f94d80ce0a0 con 0x7f94d815fa70 2023-07-05T18:56:47.834 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:47.828+0000 7f94d67fc700 1 -- 172.21.15.46:0/3936210503 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f94c40035b0 con 0x7f94d815fa70 2023-07-05T18:56:47.834 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:47.828+0000 7f94d6ffd700 1 -- 172.21.15.46:0/3936210503 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f94d80ce530 msgr2=0x7f94d8160980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-05T18:56:47.834 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:47.828+0000 7f94d6ffd700 1 --2- 172.21.15.46:0/3936210503 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f94d80ce530 0x7f94d8160980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:47.834 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:47.828+0000 7f94d6ffd700 1 -- 172.21.15.46:0/3936210503 >> v1:172.21.15.73:6789/0 conn(0x7f94d815fa70 legacy=0x7f94d80b15d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:56:47.834 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:47.828+0000 7f94d6ffd700 1 -- 172.21.15.46:0/3936210503 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f94d80cd4b0 con 0x7f94d80b1ce0 2023-07-05T18:56:47.834 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:47.828+0000 7f94d7fff700 1 --2- 172.21.15.46:0/3936210503 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f94d80ce530 0x7f94d8160980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-05T18:56:47.834 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:47.828+0000 7f94d6ffd700 1 --2- 172.21.15.46:0/3936210503 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f94d80b1ce0 0x7f94d806ebf0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f94c8009840 tx=0x7f94c8009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f6435545a41d0554 server_cookie=0 in_seq=0 out_seq=0 2023-07-05T18:56:47.835 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:47.828+0000 7f94d67fc700 1 -- 172.21.15.46:0/3936210503 <== mon.1 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94c8011830 con 0x7f94d80b1ce0 2023-07-05T18:56:47.835 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:47.828+0000 7f94d67fc700 1 -- 172.21.15.46:0/3936210503 <== mon.1 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f94c8011990 con 0x7f94d80b1ce0 2023-07-05T18:56:47.835 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:47.828+0000 7f94d67fc700 1 -- 172.21.15.46:0/3936210503 <== mon.1 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94c8011d00 con 0x7f94d80b1ce0 2023-07-05T18:56:47.835 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:47.829+0000 7f94de216700 1 -- 172.21.15.46:0/3936210503 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f94d80b1ce0 msgr2=0x7f94d806ebf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:56:47.835 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:47.829+0000 7f94de216700 1 --2- 172.21.15.46:0/3936210503 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f94d80b1ce0 0x7f94d806ebf0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f94c8009840 tx=0x7f94c8009b50 comp rx=0 tx=0).stop 2023-07-05T18:56:47.835 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:47.829+0000 7f94de216700 1 -- 172.21.15.46:0/3936210503 shutdown_connections 2023-07-05T18:56:47.836 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:47.829+0000 7f94de216700 1 --2- 172.21.15.46:0/3936210503 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f94d80ce530 0x7f94d8160980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:47.836 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:47.829+0000 7f94de216700 1 --2- 172.21.15.46:0/3936210503 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f94d80b1ce0 0x7f94d806ebf0 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:47.836 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:47.829+0000 7f94de216700 1 -- 172.21.15.46:0/3936210503 >> 172.21.15.46:0/3936210503 conn(0x7f94d80cf970 msgr2=0x7f94d80cfd40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-05T18:56:47.837 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:47.829+0000 7f94de216700 1 -- 172.21.15.46:0/3936210503 shutdown_connections 2023-07-05T18:56:47.837 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:47.829+0000 7f94de216700 1 -- 172.21.15.46:0/3936210503 wait complete. 2023-07-05T18:56:47.837 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:47.830+0000 7f94de216700 1 Processor -- start 2023-07-05T18:56:47.837 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:47.831+0000 7f94de216700 1 -- start start 2023-07-05T18:56:47.839 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:47.831+0000 7f94de216700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f94d80b1ce0 0x7f94d81575a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:56:47.839 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:47.831+0000 7f94de216700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f94d80ce530 0x7f94d815b790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:56:47.839 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:47.832+0000 7f94de216700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f94d815fa70 0x7f94d80b2940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:56:47.839 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:47.832+0000 7f94de216700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94d80b4730 con 0x7f94d815fa70 2023-07-05T18:56:47.839 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:47.832+0000 7f94de216700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94d80b3a30 con 0x7f94d80b1ce0 2023-07-05T18:56:47.840 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:47.832+0000 7f94de216700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f94d80b3190 con 0x7f94d80ce530 2023-07-05T18:56:47.840 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:47.832+0000 7f94d7fff700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f94d815fa70 0x7f94d80b2940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:56:47.840 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:47.832+0000 7f94d7fff700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f94d815fa70 0x7f94d80b2940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:58908/0 (socket says 172.21.15.46:58908) 2023-07-05T18:56:47.840 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:47.832+0000 7f94d7fff700 1 -- 172.21.15.46:0/3797426030 learned_addr learned my addr 172.21.15.46:0/3797426030 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-07-05T18:56:47.840 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:47.832+0000 7f94d6ffd700 1 --2- 172.21.15.46:0/3797426030 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f94d80ce530 0x7f94d815b790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:56:47.841 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:47.832+0000 7f94d77fe700 1 --2- 172.21.15.46:0/3797426030 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f94d80b1ce0 0x7f94d81575a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:56:47.842 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:47.832+0000 7f94d7fff700 1 -- 172.21.15.46:0/3797426030 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f94d80ce530 msgr2=0x7f94d815b790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:56:47.842 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:47.832+0000 7f94d7fff700 1 --2- 172.21.15.46:0/3797426030 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f94d80ce530 0x7f94d815b790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:47.842 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:47.832+0000 7f94d7fff700 1 -- 172.21.15.46:0/3797426030 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f94d80b1ce0 msgr2=0x7f94d81575a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:56:47.842 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:47.832+0000 7f94d7fff700 1 --2- 172.21.15.46:0/3797426030 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f94d80b1ce0 0x7f94d81575a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:47.842 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:47.832+0000 7f94d7fff700 1 -- 172.21.15.46:0/3797426030 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f94d0009a70 con 0x7f94d815fa70 2023-07-05T18:56:47.843 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:47.832+0000 7f94d7fff700 1 --2- 172.21.15.46:0/3797426030 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f94d815fa70 0x7f94d80b2940 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f94d000efc0 tx=0x7f94d000c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-05T18:56:47.843 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:47.832+0000 7f94cffff700 1 -- 172.21.15.46:0/3797426030 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94d000ca90 con 0x7f94d815fa70 2023-07-05T18:56:47.844 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:47.832+0000 7f94cffff700 1 -- 172.21.15.46:0/3797426030 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f94d000f040 con 0x7f94d815fa70 2023-07-05T18:56:47.844 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:47.832+0000 7f94de216700 1 -- 172.21.15.46:0/3797426030 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f94c80094a0 con 0x7f94d815fa70 2023-07-05T18:56:47.844 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:47.832+0000 7f94cffff700 1 -- 172.21.15.46:0/3797426030 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94d000ce10 con 0x7f94d815fa70 2023-07-05T18:56:47.844 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:47.833+0000 7f94de216700 1 -- 172.21.15.46:0/3797426030 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f94d80b3750 con 0x7f94d815fa70 2023-07-05T18:56:47.844 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:47.833+0000 7f94de216700 1 -- 172.21.15.46:0/3797426030 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f94d80b48a0 con 0x7f94d815fa70 2023-07-05T18:56:47.844 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:47.834+0000 7f94cffff700 1 -- 172.21.15.46:0/3797426030 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f94d0014480 con 0x7f94d815fa70 2023-07-05T18:56:47.844 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:47.834+0000 7f94cffff700 1 --2- 172.21.15.46:0/3797426030 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7f94b806ace0 0x7f94b806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:56:47.845 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:47.834+0000 7f94cffff700 1 -- 172.21.15.46:0/3797426030 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f94d0089ad0 con 0x7f94d815fa70 2023-07-05T18:56:47.845 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:47.834+0000 7f94d77fe700 1 --2- 172.21.15.46:0/3797426030 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7f94b806ace0 0x7f94b806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:56:47.845 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:47.835+0000 7f94d77fe700 1 --2- 172.21.15.46:0/3797426030 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7f94b806ace0 0x7f94b806d190 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f94c0007fd0 tx=0x7f94c0009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-05T18:56:47.845 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:47.839+0000 7f94cffff700 1 -- 172.21.15.46:0/3797426030 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f94d00586a0 con 0x7f94d815fa70 2023-07-05T18:56:48.041 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:48.036+0000 7f94de216700 1 -- 172.21.15.46:0/3797426030 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f94d80672e0 con 0x7f94d815fa70 2023-07-05T18:56:48.041 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:48.036+0000 7f94cffff700 1 -- 172.21.15.46:0/3797426030 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v21) v1 ==== 92+0+10 (secure 0 0 0) 0x7f94d0009d70 con 0x7f94d815fa70 2023-07-05T18:56:48.042 INFO:teuthology.orchestra.run.smithi046.stdout:pg_num: 8 2023-07-05T18:56:48.044 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:48.038+0000 7f94de216700 1 -- 172.21.15.46:0/3797426030 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7f94b806ace0 msgr2=0x7f94b806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:56:48.045 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:48.038+0000 7f94de216700 1 --2- 172.21.15.46:0/3797426030 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7f94b806ace0 0x7f94b806d190 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f94c0007fd0 tx=0x7f94c0009040 comp rx=0 tx=0).stop 2023-07-05T18:56:48.045 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:48.038+0000 7f94de216700 1 -- 172.21.15.46:0/3797426030 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f94d815fa70 msgr2=0x7f94d80b2940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:56:48.045 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:48.038+0000 7f94de216700 1 --2- 172.21.15.46:0/3797426030 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f94d815fa70 0x7f94d80b2940 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f94d000efc0 tx=0x7f94d000c3a0 comp rx=0 tx=0).stop 2023-07-05T18:56:48.046 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:48.038+0000 7f94de216700 1 -- 172.21.15.46:0/3797426030 shutdown_connections 2023-07-05T18:56:48.046 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:48.038+0000 7f94de216700 1 --2- 172.21.15.46:0/3797426030 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7f94b806ace0 0x7f94b806d190 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:48.046 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:48.038+0000 7f94de216700 1 --2- 172.21.15.46:0/3797426030 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f94d815fa70 0x7f94d80b2940 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:48.047 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:48.038+0000 7f94de216700 1 --2- 172.21.15.46:0/3797426030 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f94d80b1ce0 0x7f94d81575a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:48.047 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:48.038+0000 7f94de216700 1 --2- 172.21.15.46:0/3797426030 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f94d80ce530 0x7f94d815b790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:48.047 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:48.038+0000 7f94de216700 1 -- 172.21.15.46:0/3797426030 >> 172.21.15.46:0/3797426030 conn(0x7f94d80cf970 msgr2=0x7f94d815a110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-05T18:56:48.048 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:48.039+0000 7f94de216700 1 -- 172.21.15.46:0/3797426030 shutdown_connections 2023-07-05T18:56:48.048 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:48.039+0000 7f94de216700 1 -- 172.21.15.46:0/3797426030 wait complete. 2023-07-05T18:56:48.053 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-07-05T18:56:48.181 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:48.179+0000 7f762fb48700 1 Processor -- start 2023-07-05T18:56:48.181 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:48.179+0000 7f762fb48700 1 -- start start 2023-07-05T18:56:48.183 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:48.180+0000 7f762fb48700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f76281594f0 0x7f76280cd690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:56:48.183 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:48.180+0000 7f762fb48700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f76280cdbd0 0x7f76280b13f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:56:48.183 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:48.180+0000 7f762fb48700 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f762815e040 con 0x7f76280b1930 2023-07-05T18:56:48.183 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:48.180+0000 7f762fb48700 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f76280ce200 con 0x7f76280cdbd0 2023-07-05T18:56:48.184 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:48.180+0000 7f762fb48700 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f762815dbb0 con 0x7f76281594f0 2023-07-05T18:56:48.184 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:48.180+0000 7f762d0e3700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f76280cdbd0 0x7f76280b13f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:56:48.184 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:48.180+0000 7f762d0e3700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f76280cdbd0 0x7f76280b13f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:58912/0 (socket says 172.21.15.46:58912) 2023-07-05T18:56:48.184 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:48.180+0000 7f762d0e3700 1 -- 172.21.15.46:0/3552665978 learned_addr learned my addr 172.21.15.46:0/3552665978 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-07-05T18:56:48.184 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:48.180+0000 7f762d8e4700 1 --2- 172.21.15.46:0/3552665978 >> v2:172.21.15.73:3300/0 conn(0x7f76281594f0 0x7f76280cd690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:56:48.184 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:48.180+0000 7f762d0e3700 1 -- 172.21.15.46:0/3552665978 >> v2:172.21.15.73:3300/0 conn(0x7f76281594f0 msgr2=0x7f76280cd690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-05T18:56:48.184 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:48.180+0000 7f762d0e3700 1 --2- 172.21.15.46:0/3552665978 >> v2:172.21.15.73:3300/0 conn(0x7f76281594f0 0x7f76280cd690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:48.185 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:48.180+0000 7f762d0e3700 1 -- 172.21.15.46:0/3552665978 >> v1:172.21.15.73:6789/0 conn(0x7f76280b1930 legacy=0x7f7628070620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:56:48.185 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:48.180+0000 7f762d0e3700 1 -- 172.21.15.46:0/3552665978 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f76280b1d60 con 0x7f76280cdbd0 2023-07-05T18:56:48.185 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:48.181+0000 7f762d0e3700 1 --2- 172.21.15.46:0/3552665978 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f76280cdbd0 0x7f76280b13f0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f7628066be0 tx=0x7f7624009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3dc78e9779a780f6 server_cookie=0 in_seq=0 out_seq=0 2023-07-05T18:56:48.185 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:48.181+0000 7f762c8e2700 1 -- 172.21.15.46:0/3552665978 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7624011830 con 0x7f76280cdbd0 2023-07-05T18:56:48.185 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:48.181+0000 7f762c8e2700 1 -- 172.21.15.46:0/3552665978 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7624011990 con 0x7f76280cdbd0 2023-07-05T18:56:48.185 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:48.181+0000 7f762c8e2700 1 -- 172.21.15.46:0/3552665978 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7624011d20 con 0x7f76280cdbd0 2023-07-05T18:56:48.188 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:48.181+0000 7f762fb48700 1 -- 172.21.15.46:0/3552665978 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f76280cdbd0 msgr2=0x7f76280b13f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:56:48.188 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:48.181+0000 7f762fb48700 1 --2- 172.21.15.46:0/3552665978 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f76280cdbd0 0x7f76280b13f0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f7628066be0 tx=0x7f7624009bd0 comp rx=0 tx=0).stop 2023-07-05T18:56:48.188 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:48.181+0000 7f762fb48700 1 -- 172.21.15.46:0/3552665978 shutdown_connections 2023-07-05T18:56:48.188 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:48.181+0000 7f762fb48700 1 --2- 172.21.15.46:0/3552665978 >> v2:172.21.15.73:3300/0 conn(0x7f76281594f0 0x7f76280cd690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:48.188 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:48.181+0000 7f762fb48700 1 --2- 172.21.15.46:0/3552665978 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f76280cdbd0 0x7f76280b13f0 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:48.189 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:48.181+0000 7f762fb48700 1 -- 172.21.15.46:0/3552665978 >> 172.21.15.46:0/3552665978 conn(0x7f762806bba0 msgr2=0x7f76280cc3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-05T18:56:48.189 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:48.181+0000 7f762fb48700 1 -- 172.21.15.46:0/3552665978 shutdown_connections 2023-07-05T18:56:48.189 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:48.181+0000 7f762fb48700 1 -- 172.21.15.46:0/3552665978 wait complete. 2023-07-05T18:56:48.189 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:48.183+0000 7f762fb48700 1 Processor -- start 2023-07-05T18:56:48.189 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:48.183+0000 7f762fb48700 1 -- start start 2023-07-05T18:56:48.189 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:48.183+0000 7f762fb48700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f76280b1930 0x7f76280b5100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:56:48.189 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:48.183+0000 7f762fb48700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f76280cdbd0 0x7f7628158470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:56:48.189 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:48.183+0000 7f762fb48700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f76281594f0 0x7f76281440e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:56:48.190 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:48.183+0000 7f762fb48700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76280b4970 con 0x7f76281594f0 2023-07-05T18:56:48.190 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:48.183+0000 7f762fb48700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76281459c0 con 0x7f76280cdbd0 2023-07-05T18:56:48.190 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:48.183+0000 7f762fb48700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7628145ca0 con 0x7f76280b1930 2023-07-05T18:56:48.190 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:48.183+0000 7f762e0e5700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f76281594f0 0x7f76281440e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:56:48.190 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:48.184+0000 7f762e0e5700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f76281594f0 0x7f76281440e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:58922/0 (socket says 172.21.15.46:58922) 2023-07-05T18:56:48.191 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:48.184+0000 7f762e0e5700 1 -- 172.21.15.46:0/1912890315 learned_addr learned my addr 172.21.15.46:0/1912890315 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-07-05T18:56:48.191 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:48.184+0000 7f762d8e4700 1 --2- 172.21.15.46:0/1912890315 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f76280b1930 0x7f76280b5100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:56:48.191 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:48.184+0000 7f762d0e3700 1 --2- 172.21.15.46:0/1912890315 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f76280cdbd0 0x7f7628158470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:56:48.191 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:48.184+0000 7f762e0e5700 1 -- 172.21.15.46:0/1912890315 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f76280b1930 msgr2=0x7f76280b5100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:56:48.192 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:48.184+0000 7f762e0e5700 1 --2- 172.21.15.46:0/1912890315 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f76280b1930 0x7f76280b5100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:48.192 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:48.184+0000 7f762e0e5700 1 -- 172.21.15.46:0/1912890315 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f76280cdbd0 msgr2=0x7f7628158470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:56:48.192 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:48.184+0000 7f762e0e5700 1 --2- 172.21.15.46:0/1912890315 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f76280cdbd0 0x7f7628158470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:48.192 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:48.184+0000 7f762e0e5700 1 -- 172.21.15.46:0/1912890315 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7624009550 con 0x7f76281594f0 2023-07-05T18:56:48.193 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:48.184+0000 7f762e0e5700 1 --2- 172.21.15.46:0/1912890315 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f76281594f0 0x7f76281440e0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f762000cc50 tx=0x7f762000cf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-05T18:56:48.193 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:48.184+0000 7f761e7fc700 1 -- 172.21.15.46:0/1912890315 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7620003c00 con 0x7f76281594f0 2023-07-05T18:56:48.193 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:48.184+0000 7f761e7fc700 1 -- 172.21.15.46:0/1912890315 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7620003d60 con 0x7f76281594f0 2023-07-05T18:56:48.193 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:48.184+0000 7f762fb48700 1 -- 172.21.15.46:0/1912890315 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f76280b4be0 con 0x7f76281594f0 2023-07-05T18:56:48.193 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:48.184+0000 7f761e7fc700 1 -- 172.21.15.46:0/1912890315 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f762000aab0 con 0x7f76281594f0 2023-07-05T18:56:48.194 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:48.184+0000 7f762fb48700 1 -- 172.21.15.46:0/1912890315 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f76281589b0 con 0x7f76281594f0 2023-07-05T18:56:48.194 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:48.185+0000 7f762fb48700 1 -- 172.21.15.46:0/1912890315 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f76280b47d0 con 0x7f76281594f0 2023-07-05T18:56:48.199 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:48.186+0000 7f761e7fc700 1 -- 172.21.15.46:0/1912890315 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f762000ac10 con 0x7f76281594f0 2023-07-05T18:56:48.200 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:48.186+0000 7f761e7fc700 1 --2- 172.21.15.46:0/1912890315 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7f760c06ace0 0x7f760c06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:56:48.201 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:48.186+0000 7f761e7fc700 1 -- 172.21.15.46:0/1912890315 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f7620089430 con 0x7f76281594f0 2023-07-05T18:56:48.202 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:48.186+0000 7f762d8e4700 1 --2- 172.21.15.46:0/1912890315 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7f760c06ace0 0x7f760c06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:56:48.203 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:48.187+0000 7f762d8e4700 1 --2- 172.21.15.46:0/1912890315 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7f760c06ace0 0x7f760c06d190 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f7618009b40 tx=0x7f7618009210 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-05T18:56:48.203 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:48.191+0000 7f761e7fc700 1 -- 172.21.15.46:0/1912890315 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f76280b47d0 con 0x7f76281594f0 2023-07-05T18:56:48.390 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:48.388+0000 7f762fb48700 1 -- 172.21.15.46:0/1912890315 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f76280b47d0 con 0x7f76281594f0 2023-07-05T18:56:48.390 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:48.388+0000 7f761e7fc700 1 -- 172.21.15.46:0/1912890315 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v21) v1 ==== 93+0+10 (secure 0 0 0) 0x7f76280b47d0 con 0x7f76281594f0 2023-07-05T18:56:48.391 INFO:teuthology.orchestra.run.smithi046.stdout:pg_num: 1 2023-07-05T18:56:48.392 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:48.390+0000 7f762fb48700 1 -- 172.21.15.46:0/1912890315 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7f760c06ace0 msgr2=0x7f760c06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:56:48.393 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:48.390+0000 7f762fb48700 1 --2- 172.21.15.46:0/1912890315 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7f760c06ace0 0x7f760c06d190 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f7618009b40 tx=0x7f7618009210 comp rx=0 tx=0).stop 2023-07-05T18:56:48.394 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:48.390+0000 7f762fb48700 1 -- 172.21.15.46:0/1912890315 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f76281594f0 msgr2=0x7f76281440e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:56:48.394 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:48.390+0000 7f762fb48700 1 --2- 172.21.15.46:0/1912890315 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f76281594f0 0x7f76281440e0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f762000cc50 tx=0x7f762000cf60 comp rx=0 tx=0).stop 2023-07-05T18:56:48.394 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:48.390+0000 7f762fb48700 1 -- 172.21.15.46:0/1912890315 shutdown_connections 2023-07-05T18:56:48.394 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:48.390+0000 7f762fb48700 1 --2- 172.21.15.46:0/1912890315 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7f760c06ace0 0x7f760c06d190 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:48.395 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:48.390+0000 7f762fb48700 1 --2- 172.21.15.46:0/1912890315 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f76281594f0 0x7f76281440e0 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:48.395 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:48.390+0000 7f762fb48700 1 --2- 172.21.15.46:0/1912890315 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f76280b1930 0x7f76280b5100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:48.395 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:48.390+0000 7f762fb48700 1 --2- 172.21.15.46:0/1912890315 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f76280cdbd0 0x7f7628158470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:48.396 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:48.390+0000 7f762fb48700 1 -- 172.21.15.46:0/1912890315 >> 172.21.15.46:0/1912890315 conn(0x7f762806bba0 msgr2=0x7f762814b6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-05T18:56:48.396 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:48.390+0000 7f762fb48700 1 -- 172.21.15.46:0/1912890315 shutdown_connections 2023-07-05T18:56:48.396 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:48.390+0000 7f762fb48700 1 -- 172.21.15.46:0/1912890315 wait complete. 2023-07-05T18:56:48.405 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-07-05T18:56:48.535 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:48.533+0000 7f407c609700 1 Processor -- start 2023-07-05T18:56:48.535 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:48.533+0000 7f407c609700 1 -- start start 2023-07-05T18:56:48.537 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:48.534+0000 7f407c609700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f40741537f0 0x7f40740aeec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:56:48.538 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:48.534+0000 7f407c609700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f4074159690 0x7f4074070c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:56:48.538 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:48.534+0000 7f407c609700 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f40740707f0 con 0x7f40740711c0 2023-07-05T18:56:48.538 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:48.534+0000 7f407c609700 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f40740af400 con 0x7f40741537f0 2023-07-05T18:56:48.538 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:48.534+0000 7f407c609700 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f407406c940 con 0x7f4074159690 2023-07-05T18:56:48.538 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:48.534+0000 7f407a3a5700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f40741537f0 0x7f40740aeec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:56:48.539 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:48.534+0000 7f407aba6700 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7f40740711c0 0x7f40740cdb00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:58202/0 (socket says 172.21.15.46:58202) 2023-07-05T18:56:48.539 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:48.534+0000 7f407a3a5700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f40741537f0 0x7f40740aeec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:58926/0 (socket says 172.21.15.46:58926) 2023-07-05T18:56:48.539 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:48.534+0000 7f407aba6700 1 -- 172.21.15.46:0/4060961609 learned_addr learned my addr 172.21.15.46:0/4060961609 (peer_addr_for_me v1:172.21.15.46:0/0) 2023-07-05T18:56:48.539 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:48.534+0000 7f4079ba4700 1 --2- 172.21.15.46:0/4060961609 >> v2:172.21.15.73:3300/0 conn(0x7f4074159690 0x7f4074070c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:56:48.539 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:48.535+0000 7f407a3a5700 1 -- 172.21.15.46:0/4060961609 >> v2:172.21.15.73:3300/0 conn(0x7f4074159690 msgr2=0x7f4074070c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-05T18:56:48.539 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:48.535+0000 7f407a3a5700 1 --2- 172.21.15.46:0/4060961609 >> v2:172.21.15.73:3300/0 conn(0x7f4074159690 0x7f4074070c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:48.540 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:48.535+0000 7f407a3a5700 1 -- 172.21.15.46:0/4060961609 >> v1:172.21.15.46:6789/0 conn(0x7f40740711c0 legacy=0x7f40740cdb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:56:48.540 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:48.535+0000 7f407a3a5700 1 -- 172.21.15.46:0/4060961609 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4074159e00 con 0x7f40741537f0 2023-07-05T18:56:48.540 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:48.535+0000 7f407a3a5700 1 --2- 172.21.15.46:0/4060961609 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f40741537f0 0x7f40740aeec0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f40740669e0 tx=0x7f4064009b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=96b61d8fc1c7a1c3 server_cookie=0 in_seq=0 out_seq=0 2023-07-05T18:56:48.540 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:48.535+0000 7f40793a3700 1 -- 172.21.15.46:0/4060961609 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4064011830 con 0x7f40741537f0 2023-07-05T18:56:48.540 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:48.535+0000 7f40793a3700 1 -- 172.21.15.46:0/4060961609 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4064011990 con 0x7f40741537f0 2023-07-05T18:56:48.541 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:48.535+0000 7f40793a3700 1 -- 172.21.15.46:0/4060961609 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4064011d20 con 0x7f40741537f0 2023-07-05T18:56:48.543 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:48.535+0000 7f407c609700 1 -- 172.21.15.46:0/4060961609 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f40741537f0 msgr2=0x7f40740aeec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:56:48.543 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:48.535+0000 7f407c609700 1 --2- 172.21.15.46:0/4060961609 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f40741537f0 0x7f40740aeec0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f40740669e0 tx=0x7f4064009b20 comp rx=0 tx=0).stop 2023-07-05T18:56:48.543 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:48.535+0000 7f407c609700 1 -- 172.21.15.46:0/4060961609 shutdown_connections 2023-07-05T18:56:48.543 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:48.535+0000 7f407c609700 1 --2- 172.21.15.46:0/4060961609 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f40741537f0 0x7f40740aeec0 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:48.544 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:48.535+0000 7f407c609700 1 --2- 172.21.15.46:0/4060961609 >> v2:172.21.15.73:3300/0 conn(0x7f4074159690 0x7f4074070c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:48.544 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:48.535+0000 7f407c609700 1 -- 172.21.15.46:0/4060961609 >> 172.21.15.46:0/4060961609 conn(0x7f40740cf970 msgr2=0x7f40740cfd40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-05T18:56:48.544 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:48.536+0000 7f407c609700 1 -- 172.21.15.46:0/4060961609 shutdown_connections 2023-07-05T18:56:48.544 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:48.536+0000 7f407c609700 1 -- 172.21.15.46:0/4060961609 wait complete. 2023-07-05T18:56:48.548 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:48.537+0000 7f407c609700 1 Processor -- start 2023-07-05T18:56:48.548 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:48.537+0000 7f407c609700 1 -- start start 2023-07-05T18:56:48.549 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:48.537+0000 7f407c609700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f40740711c0 0x7f40740b3c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:56:48.549 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:48.537+0000 7f407c609700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f40741537f0 0x7f40741e3a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:56:48.549 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:48.537+0000 7f407c609700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4074159690 0x7f40740c8cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:56:48.549 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:48.537+0000 7f407c609700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f407414d5f0 con 0x7f4074159690 2023-07-05T18:56:48.549 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:48.538+0000 7f407c609700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f407406d090 con 0x7f40741537f0 2023-07-05T18:56:48.549 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:48.538+0000 7f407c609700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f40740b41a0 con 0x7f40740711c0 2023-07-05T18:56:48.549 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:48.538+0000 7f407aba6700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4074159690 0x7f40740c8cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:56:48.550 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:48.538+0000 7f407aba6700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4074159690 0x7f40740c8cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:58936/0 (socket says 172.21.15.46:58936) 2023-07-05T18:56:48.550 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:48.538+0000 7f407aba6700 1 -- 172.21.15.46:0/4225569769 learned_addr learned my addr 172.21.15.46:0/4225569769 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-07-05T18:56:48.550 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:48.538+0000 7f407a3a5700 1 --2- 172.21.15.46:0/4225569769 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f40740711c0 0x7f40740b3c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:56:48.550 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:48.538+0000 7f4079ba4700 1 --2- 172.21.15.46:0/4225569769 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f40741537f0 0x7f40741e3a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:56:48.550 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:48.538+0000 7f407aba6700 1 -- 172.21.15.46:0/4225569769 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f40740711c0 msgr2=0x7f40740b3c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:56:48.551 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:48.538+0000 7f407aba6700 1 --2- 172.21.15.46:0/4225569769 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f40740711c0 0x7f40740b3c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:48.552 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:48.538+0000 7f407aba6700 1 -- 172.21.15.46:0/4225569769 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f40741537f0 msgr2=0x7f40741e3a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:56:48.552 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:48.538+0000 7f407aba6700 1 --2- 172.21.15.46:0/4225569769 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f40741537f0 0x7f40741e3a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:48.552 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:48.538+0000 7f407aba6700 1 -- 172.21.15.46:0/4225569769 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f40640094a0 con 0x7f4074159690 2023-07-05T18:56:48.553 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:48.538+0000 7f407a3a5700 1 --2- 172.21.15.46:0/4225569769 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f40740711c0 0x7f40740b3c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-05T18:56:48.553 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:48.538+0000 7f407aba6700 1 --2- 172.21.15.46:0/4225569769 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4074159690 0x7f40740c8cc0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f406c00cbc0 tx=0x7f406c00cf80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-05T18:56:48.554 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:48.538+0000 7f406affd700 1 -- 172.21.15.46:0/4225569769 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f406c00ab50 con 0x7f4074159690 2023-07-05T18:56:48.554 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:48.538+0000 7f406affd700 1 -- 172.21.15.46:0/4225569769 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f406c00acb0 con 0x7f4074159690 2023-07-05T18:56:48.554 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:48.538+0000 7f407c609700 1 -- 172.21.15.46:0/4225569769 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f407406d330 con 0x7f4074159690 2023-07-05T18:56:48.554 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:48.538+0000 7f406affd700 1 -- 172.21.15.46:0/4225569769 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f406c012600 con 0x7f4074159690 2023-07-05T18:56:48.555 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:48.538+0000 7f407c609700 1 -- 172.21.15.46:0/4225569769 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f407406d8f0 con 0x7f4074159690 2023-07-05T18:56:48.555 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:48.539+0000 7f407c609700 1 -- 172.21.15.46:0/4225569769 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f40740cb3a0 con 0x7f4074159690 2023-07-05T18:56:48.555 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:48.540+0000 7f406affd700 1 -- 172.21.15.46:0/4225569769 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f406c01b3b0 con 0x7f4074159690 2023-07-05T18:56:48.555 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:48.540+0000 7f406affd700 1 --2- 172.21.15.46:0/4225569769 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7f405806ace0 0x7f405806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:56:48.556 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:48.540+0000 7f406affd700 1 -- 172.21.15.46:0/4225569769 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f406c089060 con 0x7f4074159690 2023-07-05T18:56:48.556 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:48.540+0000 7f407a3a5700 1 --2- 172.21.15.46:0/4225569769 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7f405806ace0 0x7f405806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:56:48.556 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:48.541+0000 7f407a3a5700 1 --2- 172.21.15.46:0/4225569769 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7f405806ace0 0x7f405806d190 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f40640090b0 tx=0x7f4064008030 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-05T18:56:48.557 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:48.545+0000 7f406affd700 1 -- 172.21.15.46:0/4225569769 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f406c054250 con 0x7f4074159690 2023-07-05T18:56:48.743 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:48.740+0000 7f407c609700 1 -- 172.21.15.46:0/4225569769 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f40740672e0 con 0x7f4074159690 2023-07-05T18:56:48.743 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:48.741+0000 7f406affd700 1 -- 172.21.15.46:0/4225569769 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v21) v1 ==== 104+0+11 (secure 0 0 0) 0x7f406c057870 con 0x7f4074159690 2023-07-05T18:56:48.743 INFO:teuthology.orchestra.run.smithi046.stdout:pg_num: 32 2023-07-05T18:56:48.745 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:48.742+0000 7f407c609700 1 -- 172.21.15.46:0/4225569769 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7f405806ace0 msgr2=0x7f405806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:56:48.746 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:48.742+0000 7f407c609700 1 --2- 172.21.15.46:0/4225569769 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7f405806ace0 0x7f405806d190 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f40640090b0 tx=0x7f4064008030 comp rx=0 tx=0).stop 2023-07-05T18:56:48.746 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:48.742+0000 7f407c609700 1 -- 172.21.15.46:0/4225569769 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4074159690 msgr2=0x7f40740c8cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:56:48.746 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:48.742+0000 7f407c609700 1 --2- 172.21.15.46:0/4225569769 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4074159690 0x7f40740c8cc0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f406c00cbc0 tx=0x7f406c00cf80 comp rx=0 tx=0).stop 2023-07-05T18:56:48.746 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:48.743+0000 7f407c609700 1 -- 172.21.15.46:0/4225569769 shutdown_connections 2023-07-05T18:56:48.746 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:48.743+0000 7f407c609700 1 --2- 172.21.15.46:0/4225569769 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7f405806ace0 0x7f405806d190 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:48.746 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:48.743+0000 7f407c609700 1 --2- 172.21.15.46:0/4225569769 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4074159690 0x7f40740c8cc0 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:48.746 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:48.743+0000 7f407c609700 1 --2- 172.21.15.46:0/4225569769 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f40740711c0 0x7f40740b3c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:48.747 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:48.743+0000 7f407c609700 1 --2- 172.21.15.46:0/4225569769 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f40741537f0 0x7f40741e3a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:48.747 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:48.743+0000 7f407c609700 1 -- 172.21.15.46:0/4225569769 >> 172.21.15.46:0/4225569769 conn(0x7f40740cf970 msgr2=0x7f407414ddb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-05T18:56:48.747 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:48.743+0000 7f407c609700 1 -- 172.21.15.46:0/4225569769 shutdown_connections 2023-07-05T18:56:48.747 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:48.743+0000 7f407c609700 1 -- 172.21.15.46:0/4225569769 wait complete. 2023-07-05T18:56:48.757 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-07-05T18:56:48.886 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:48.883+0000 7fdda7fdd700 1 Processor -- start 2023-07-05T18:56:48.886 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:48.884+0000 7fdda7fdd700 1 -- start start 2023-07-05T18:56:48.888 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:48.884+0000 7fdda7fdd700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fdda00ce990 0x7fdda00ced60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:56:48.888 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:48.884+0000 7fdda7fdd700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fdda00b5290 0x7fdda01662e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:56:48.888 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:48.884+0000 7fdda7fdd700 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdda006c7e0 con 0x7fdda006bc60 2023-07-05T18:56:48.889 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:48.884+0000 7fdda7fdd700 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdda006cfd0 con 0x7fdda00ce990 2023-07-05T18:56:48.889 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:48.884+0000 7fdda7fdd700 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdda00b3df0 con 0x7fdda00b5290 2023-07-05T18:56:48.889 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:48.885+0000 7fdda5d79700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fdda00ce990 0x7fdda00ced60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:56:48.889 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:48.885+0000 7fdda5d79700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fdda00ce990 0x7fdda00ced60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:58940/0 (socket says 172.21.15.46:58940) 2023-07-05T18:56:48.889 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:48.885+0000 7fdda5d79700 1 -- 172.21.15.46:0/1663484704 learned_addr learned my addr 172.21.15.46:0/1663484704 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-07-05T18:56:48.889 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:48.885+0000 7fdda657a700 1 --2- 172.21.15.46:0/1663484704 >> v2:172.21.15.73:3300/0 conn(0x7fdda00b5290 0x7fdda01662e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:56:48.889 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:48.885+0000 7fdda5d79700 1 -- 172.21.15.46:0/1663484704 >> v2:172.21.15.73:3300/0 conn(0x7fdda00b5290 msgr2=0x7fdda01662e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-05T18:56:48.890 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:48.885+0000 7fdda5d79700 1 --2- 172.21.15.46:0/1663484704 >> v2:172.21.15.73:3300/0 conn(0x7fdda00b5290 0x7fdda01662e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:48.890 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:48.885+0000 7fdda5d79700 1 -- 172.21.15.46:0/1663484704 >> v1:172.21.15.73:6789/0 conn(0x7fdda006bc60 legacy=0x7fdda006c0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-05T18:56:48.890 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:48.885+0000 7fdda5d79700 1 -- 172.21.15.46:0/1663484704 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdda00cf2a0 con 0x7fdda00ce990 2023-07-05T18:56:48.890 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:48.885+0000 7fdda5d79700 1 --2- 172.21.15.46:0/1663484704 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fdda00ce990 0x7fdda00ced60 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7fdda0073df0 tx=0x7fdd9c009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3e262781fd3fb4a0 server_cookie=0 in_seq=0 out_seq=0 2023-07-05T18:56:48.890 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:48.885+0000 7fdda4d77700 1 -- 172.21.15.46:0/1663484704 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd9c004230 con 0x7fdda00ce990 2023-07-05T18:56:48.890 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:48.885+0000 7fdda4d77700 1 -- 172.21.15.46:0/1663484704 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdd9c004390 con 0x7fdda00ce990 2023-07-05T18:56:48.891 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:48.885+0000 7fdda4d77700 1 -- 172.21.15.46:0/1663484704 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd9c0036a0 con 0x7fdda00ce990 2023-07-05T18:56:48.891 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:48.886+0000 7fdda7fdd700 1 -- 172.21.15.46:0/1663484704 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fdda00ce990 msgr2=0x7fdda00ced60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:56:48.891 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:48.886+0000 7fdda7fdd700 1 --2- 172.21.15.46:0/1663484704 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fdda00ce990 0x7fdda00ced60 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7fdda0073df0 tx=0x7fdd9c009bd0 comp rx=0 tx=0).stop 2023-07-05T18:56:48.891 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:48.886+0000 7fdda7fdd700 1 -- 172.21.15.46:0/1663484704 shutdown_connections 2023-07-05T18:56:48.891 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:48.886+0000 7fdda7fdd700 1 --2- 172.21.15.46:0/1663484704 >> v2:172.21.15.73:3300/0 conn(0x7fdda00b5290 0x7fdda01662e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:48.892 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:48.886+0000 7fdda7fdd700 1 --2- 172.21.15.46:0/1663484704 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fdda00ce990 0x7fdda00ced60 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:48.892 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:48.886+0000 7fdda7fdd700 1 -- 172.21.15.46:0/1663484704 >> 172.21.15.46:0/1663484704 conn(0x7fdda0099de0 msgr2=0x7fdda00d0a90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-05T18:56:48.892 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:48.886+0000 7fdda7fdd700 1 -- 172.21.15.46:0/1663484704 shutdown_connections 2023-07-05T18:56:48.892 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:48.886+0000 7fdda7fdd700 1 -- 172.21.15.46:0/1663484704 wait complete. 2023-07-05T18:56:48.895 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:48.887+0000 7fdda7fdd700 1 Processor -- start 2023-07-05T18:56:48.895 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:48.887+0000 7fdda7fdd700 1 -- start start 2023-07-05T18:56:48.895 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:48.888+0000 7fdda7fdd700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fdda006bc60 0x7fdda00c9350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:56:48.895 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:48.888+0000 7fdda7fdd700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fdda00b5290 0x7fdda00c7b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:56:48.896 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:48.888+0000 7fdda7fdd700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fdda00ce990 0x7fdda009c670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:56:48.896 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:48.888+0000 7fdda7fdd700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdda00c80a0 con 0x7fdda00b5290 2023-07-05T18:56:48.896 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:48.888+0000 7fdda7fdd700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdda00c82b0 con 0x7fdda006bc60 2023-07-05T18:56:48.897 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:48.888+0000 7fdda7fdd700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdda00c8590 con 0x7fdda00ce990 2023-07-05T18:56:48.897 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:48.888+0000 7fdda5578700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fdda00b5290 0x7fdda00c7b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:56:48.897 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:48.888+0000 7fdda5578700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fdda00b5290 0x7fdda00c7b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:58948/0 (socket says 172.21.15.46:58948) 2023-07-05T18:56:48.897 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:48.888+0000 7fdda5578700 1 -- 172.21.15.46:0/1351150184 learned_addr learned my addr 172.21.15.46:0/1351150184 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-07-05T18:56:48.897 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:48.888+0000 7fdda657a700 1 --2- 172.21.15.46:0/1351150184 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fdda00ce990 0x7fdda009c670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:56:48.898 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:48.888+0000 7fdda5d79700 1 --2- 172.21.15.46:0/1351150184 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fdda006bc60 0x7fdda00c9350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:56:48.898 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:48.888+0000 7fdda5578700 1 -- 172.21.15.46:0/1351150184 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fdda00ce990 msgr2=0x7fdda009c670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:56:48.898 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:48.888+0000 7fdda5578700 1 --2- 172.21.15.46:0/1351150184 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fdda00ce990 0x7fdda009c670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:48.898 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:48.888+0000 7fdda5578700 1 -- 172.21.15.46:0/1351150184 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fdda006bc60 msgr2=0x7fdda00c9350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:56:48.898 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:48.888+0000 7fdda5578700 1 --2- 172.21.15.46:0/1351150184 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fdda006bc60 0x7fdda00c9350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:48.898 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:48.888+0000 7fdda5578700 1 -- 172.21.15.46:0/1351150184 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdd9c009550 con 0x7fdda00b5290 2023-07-05T18:56:48.898 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:48.888+0000 7fdda5578700 1 --2- 172.21.15.46:0/1351150184 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fdda00b5290 0x7fdda00c7b60 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7fdd9400c4b0 tx=0x7fdd9400c870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-05T18:56:48.899 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:48.889+0000 7fdd927fc700 1 -- 172.21.15.46:0/1351150184 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd94011790 con 0x7fdda00b5290 2023-07-05T18:56:48.899 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:48.889+0000 7fdd927fc700 1 -- 172.21.15.46:0/1351150184 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdd940118f0 con 0x7fdda00b5290 2023-07-05T18:56:48.900 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:48.889+0000 7fdda7fdd700 1 -- 172.21.15.46:0/1351150184 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdda00c8870 con 0x7fdda00b5290 2023-07-05T18:56:48.900 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:48.889+0000 7fdd927fc700 1 -- 172.21.15.46:0/1351150184 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd94011ca0 con 0x7fdda00b5290 2023-07-05T18:56:48.900 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:48.889+0000 7fdda7fdd700 1 -- 172.21.15.46:0/1351150184 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdda00c8e30 con 0x7fdda00b5290 2023-07-05T18:56:48.901 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:48.890+0000 7fdda7fdd700 1 -- 172.21.15.46:0/1351150184 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdda0066ed0 con 0x7fdda00b5290 2023-07-05T18:56:48.901 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:48.890+0000 7fdd927fc700 1 -- 172.21.15.46:0/1351150184 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fdd94012420 con 0x7fdda00b5290 2023-07-05T18:56:48.901 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:48.890+0000 7fdd927fc700 1 --2- 172.21.15.46:0/1351150184 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7fdd8406ace0 0x7fdd8406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:56:48.901 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:48.891+0000 7fdd927fc700 1 -- 172.21.15.46:0/1351150184 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fdd940890b0 con 0x7fdda00b5290 2023-07-05T18:56:48.902 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:48.891+0000 7fdda5d79700 1 --2- 172.21.15.46:0/1351150184 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7fdd8406ace0 0x7fdd8406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:56:48.902 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:48.891+0000 7fdda5d79700 1 --2- 172.21.15.46:0/1351150184 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7fdd8406ace0 0x7fdd8406d190 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fdd9c009c10 tx=0x7fdd9c008030 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-05T18:56:48.903 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:48.895+0000 7fdd927fc700 1 -- 172.21.15.46:0/1351150184 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fdd94054170 con 0x7fdda00b5290 2023-07-05T18:56:49.094 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:49.092+0000 7fdda7fdd700 1 -- 172.21.15.46:0/1351150184 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fdda00672e0 con 0x7fdda00b5290 2023-07-05T18:56:49.096 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:49.092+0000 7fdd927fc700 1 -- 172.21.15.46:0/1351150184 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v21) v1 ==== 100+0+11 (secure 0 0 0) 0x7fdd94057790 con 0x7fdda00b5290 2023-07-05T18:56:49.097 INFO:teuthology.orchestra.run.smithi046.stdout:pg_num: 64 2023-07-05T18:56:49.098 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:49.094+0000 7fdda7fdd700 1 -- 172.21.15.46:0/1351150184 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7fdd8406ace0 msgr2=0x7fdd8406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:56:49.098 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:49.094+0000 7fdda7fdd700 1 --2- 172.21.15.46:0/1351150184 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7fdd8406ace0 0x7fdd8406d190 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fdd9c009c10 tx=0x7fdd9c008030 comp rx=0 tx=0).stop 2023-07-05T18:56:49.099 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:49.094+0000 7fdda7fdd700 1 -- 172.21.15.46:0/1351150184 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fdda00b5290 msgr2=0x7fdda00c7b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:56:49.099 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:49.094+0000 7fdda7fdd700 1 --2- 172.21.15.46:0/1351150184 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fdda00b5290 0x7fdda00c7b60 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7fdd9400c4b0 tx=0x7fdd9400c870 comp rx=0 tx=0).stop 2023-07-05T18:56:49.099 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:49.094+0000 7fdda7fdd700 1 -- 172.21.15.46:0/1351150184 shutdown_connections 2023-07-05T18:56:49.099 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:49.094+0000 7fdda7fdd700 1 --2- 172.21.15.46:0/1351150184 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7fdd8406ace0 0x7fdd8406d190 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:49.099 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:49.094+0000 7fdda7fdd700 1 --2- 172.21.15.46:0/1351150184 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fdda00ce990 0x7fdda009c670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:49.099 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:49.094+0000 7fdda7fdd700 1 --2- 172.21.15.46:0/1351150184 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fdda006bc60 0x7fdda00c9350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:49.100 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:49.094+0000 7fdda7fdd700 1 --2- 172.21.15.46:0/1351150184 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fdda00b5290 0x7fdda00c7b60 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:49.100 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:49.094+0000 7fdda7fdd700 1 -- 172.21.15.46:0/1351150184 >> 172.21.15.46:0/1351150184 conn(0x7fdda0099de0 msgr2=0x7fdda006ede0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-05T18:56:49.100 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:49.094+0000 7fdda7fdd700 1 -- 172.21.15.46:0/1351150184 shutdown_connections 2023-07-05T18:56:49.100 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:49.094+0000 7fdda7fdd700 1 -- 172.21.15.46:0/1351150184 wait complete. 2023-07-05T18:56:49.108 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2023-07-05T18:56:49.237 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:49.235+0000 7fbe7a29a700 1 Processor -- start 2023-07-05T18:56:49.237 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:49.235+0000 7fbe7a29a700 1 -- start start 2023-07-05T18:56:49.240 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:49.235+0000 7fbe7a29a700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fbe7406a510 0x7fbe7415de90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:56:49.241 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:49.235+0000 7fbe7a29a700 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbe740cd580 con 0x7fbe740ce2d0 2023-07-05T18:56:49.241 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:49.235+0000 7fbe7a29a700 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbe740cc970 con 0x7fbe74070980 2023-07-05T18:56:49.241 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:49.235+0000 7fbe7a29a700 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbe740cc760 con 0x7fbe7406a510 2023-07-05T18:56:49.241 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:49.236+0000 7fbe73fff700 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7fbe740ce2d0 0x7fbe74069e00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:58226/0 (socket says 172.21.15.46:58226) 2023-07-05T18:56:49.242 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:49.236+0000 7fbe73fff700 1 -- 172.21.15.46:0/1836883184 learned_addr learned my addr 172.21.15.46:0/1836883184 (peer_addr_for_me v1:172.21.15.46:0/0) 2023-07-05T18:56:49.242 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:49.236+0000 7fbe737fe700 1 --2- 172.21.15.46:0/1836883184 >> v2:172.21.15.73:3300/0 conn(0x7fbe7406a510 0x7fbe7415de90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:56:49.242 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:49.236+0000 7fbe72ffd700 1 -- 172.21.15.46:0/1836883184 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1872698343 0 0) 0x7fbe740cd580 con 0x7fbe740ce2d0 2023-07-05T18:56:49.242 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:49.236+0000 7fbe72ffd700 1 -- 172.21.15.46:0/1836883184 --> v1:172.21.15.46:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbe5c0035b0 con 0x7fbe740ce2d0 2023-07-05T18:56:49.243 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:49.236+0000 7fbe72ffd700 1 -- 172.21.15.46:0/1836883184 <== mon.0 v1:172.21.15.46:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1209430143 0 0) 0x7fbe5c0035b0 con 0x7fbe740ce2d0 2023-07-05T18:56:49.243 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:49.236+0000 7fbe737fe700 1 -- 172.21.15.46:0/1836883184 >> v1:172.21.15.73:6789/0 conn(0x7fbe74070980 legacy=0x7fbe74070dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:56:49.243 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:49.236+0000 7fbe737fe700 1 -- 172.21.15.46:0/1836883184 >> v1:172.21.15.46:6789/0 conn(0x7fbe740ce2d0 legacy=0x7fbe74069e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:56:49.243 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:49.236+0000 7fbe737fe700 1 -- 172.21.15.46:0/1836883184 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbe740ccc50 con 0x7fbe7406a510 2023-07-05T18:56:49.244 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:49.236+0000 7fbe737fe700 1 --2- 172.21.15.46:0/1836883184 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fbe7406a510 0x7fbe7415de90 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fbe68009840 tx=0x7fbe68009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ff3e8aeec9304e0a server_cookie=0 in_seq=0 out_seq=0 2023-07-05T18:56:49.244 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:49.236+0000 7fbe72ffd700 1 -- 172.21.15.46:0/1836883184 <== mon.1 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe64001670 con 0x7fbe7406a510 2023-07-05T18:56:49.244 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:49.236+0000 7fbe72ffd700 1 -- 172.21.15.46:0/1836883184 <== mon.1 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbe68004030 con 0x7fbe7406a510 2023-07-05T18:56:49.245 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:49.236+0000 7fbe72ffd700 1 -- 172.21.15.46:0/1836883184 <== mon.1 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe680043c0 con 0x7fbe7406a510 2023-07-05T18:56:49.245 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:49.237+0000 7fbe7a29a700 1 -- 172.21.15.46:0/1836883184 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fbe7406a510 msgr2=0x7fbe7415de90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:56:49.245 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:49.237+0000 7fbe7a29a700 1 --2- 172.21.15.46:0/1836883184 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fbe7406a510 0x7fbe7415de90 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fbe68009840 tx=0x7fbe68009b50 comp rx=0 tx=0).stop 2023-07-05T18:56:49.245 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:49.237+0000 7fbe7a29a700 1 -- 172.21.15.46:0/1836883184 shutdown_connections 2023-07-05T18:56:49.245 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:49.237+0000 7fbe7a29a700 1 --2- 172.21.15.46:0/1836883184 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fbe7406a510 0x7fbe7415de90 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:49.245 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:49.237+0000 7fbe7a29a700 1 -- 172.21.15.46:0/1836883184 >> 172.21.15.46:0/1836883184 conn(0x7fbe740b0fc0 msgr2=0x7fbe740ce860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-05T18:56:49.245 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:49.237+0000 7fbe7a29a700 1 -- 172.21.15.46:0/1836883184 shutdown_connections 2023-07-05T18:56:49.246 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:49.237+0000 7fbe7a29a700 1 -- 172.21.15.46:0/1836883184 wait complete. 2023-07-05T18:56:49.246 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:49.239+0000 7fbe7a29a700 1 Processor -- start 2023-07-05T18:56:49.248 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:49.239+0000 7fbe7a29a700 1 -- start start 2023-07-05T18:56:49.248 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:49.240+0000 7fbe7a29a700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fbe7406a510 0x7fbe7414cbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:56:49.248 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:49.240+0000 7fbe7a29a700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fbe74070980 0x7fbe740cb3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:56:49.249 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:49.240+0000 7fbe7a29a700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fbe740ce2d0 0x7fbe740cb930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:56:49.249 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:49.240+0000 7fbe7a29a700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe7414d0f0 con 0x7fbe7406a510 2023-07-05T18:56:49.249 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:49.240+0000 7fbe7a29a700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe740c59d0 con 0x7fbe74070980 2023-07-05T18:56:49.249 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:49.240+0000 7fbe7a29a700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbe740c5cb0 con 0x7fbe740ce2d0 2023-07-05T18:56:49.249 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:49.240+0000 7fbe73fff700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fbe7406a510 0x7fbe7414cbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:56:49.249 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:49.240+0000 7fbe73fff700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fbe7406a510 0x7fbe7414cbb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:58960/0 (socket says 172.21.15.46:58960) 2023-07-05T18:56:49.249 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:49.240+0000 7fbe73fff700 1 -- 172.21.15.46:0/3226559810 learned_addr learned my addr 172.21.15.46:0/3226559810 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-07-05T18:56:49.250 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:49.240+0000 7fbe737fe700 1 --2- 172.21.15.46:0/3226559810 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fbe74070980 0x7fbe740cb3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:56:49.250 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:49.240+0000 7fbe78837700 1 --2- 172.21.15.46:0/3226559810 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fbe740ce2d0 0x7fbe740cb930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:56:49.250 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:49.240+0000 7fbe73fff700 1 -- 172.21.15.46:0/3226559810 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fbe740ce2d0 msgr2=0x7fbe740cb930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:56:49.250 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:49.240+0000 7fbe73fff700 1 --2- 172.21.15.46:0/3226559810 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fbe740ce2d0 0x7fbe740cb930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:49.250 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:49.240+0000 7fbe73fff700 1 -- 172.21.15.46:0/3226559810 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fbe74070980 msgr2=0x7fbe740cb3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:56:49.250 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:49.240+0000 7fbe73fff700 1 --2- 172.21.15.46:0/3226559810 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fbe74070980 0x7fbe740cb3f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:49.251 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:49.240+0000 7fbe73fff700 1 -- 172.21.15.46:0/3226559810 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbe680094a0 con 0x7fbe7406a510 2023-07-05T18:56:49.251 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:49.240+0000 7fbe78837700 1 --2- 172.21.15.46:0/3226559810 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fbe740ce2d0 0x7fbe740cb930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-05T18:56:49.251 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:49.240+0000 7fbe73fff700 1 --2- 172.21.15.46:0/3226559810 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fbe7406a510 0x7fbe7414cbb0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7fbe6400c520 tx=0x7fbe6400c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-05T18:56:49.251 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:49.240+0000 7fbe70ff9700 1 -- 172.21.15.46:0/3226559810 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe64004c80 con 0x7fbe7406a510 2023-07-05T18:56:49.251 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:49.240+0000 7fbe70ff9700 1 -- 172.21.15.46:0/3226559810 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbe64004e20 con 0x7fbe7406a510 2023-07-05T18:56:49.251 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:49.241+0000 7fbe7a29a700 1 -- 172.21.15.46:0/3226559810 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbe740c5f90 con 0x7fbe7406a510 2023-07-05T18:56:49.251 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:49.241+0000 7fbe70ff9700 1 -- 172.21.15.46:0/3226559810 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe64007310 con 0x7fbe7406a510 2023-07-05T18:56:49.251 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:49.241+0000 7fbe7a29a700 1 -- 172.21.15.46:0/3226559810 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbe740b4540 con 0x7fbe7406a510 2023-07-05T18:56:49.252 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:49.242+0000 7fbe7a29a700 1 -- 172.21.15.46:0/3226559810 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbe7415abf0 con 0x7fbe7406a510 2023-07-05T18:56:49.252 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:49.242+0000 7fbe70ff9700 1 -- 172.21.15.46:0/3226559810 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fbe64007470 con 0x7fbe7406a510 2023-07-05T18:56:49.252 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:49.242+0000 7fbe70ff9700 1 --2- 172.21.15.46:0/3226559810 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7fbe6006ace0 0x7fbe6006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:56:49.252 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:49.242+0000 7fbe70ff9700 1 -- 172.21.15.46:0/3226559810 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fbe640892a0 con 0x7fbe7406a510 2023-07-05T18:56:49.252 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:49.243+0000 7fbe737fe700 1 --2- 172.21.15.46:0/3226559810 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7fbe6006ace0 0x7fbe6006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:56:49.252 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:49.243+0000 7fbe737fe700 1 --2- 172.21.15.46:0/3226559810 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7fbe6006ace0 0x7fbe6006d190 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fbe740af060 tx=0x7fbe68008030 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-05T18:56:49.253 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:49.247+0000 7fbe70ff9700 1 -- 172.21.15.46:0/3226559810 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fbe7415abf0 con 0x7fbe7406a510 2023-07-05T18:56:49.447 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:49.445+0000 7fbe7a29a700 1 -- 172.21.15.46:0/3226559810 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7fbe7415abf0 con 0x7fbe7406a510 2023-07-05T18:56:49.450 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:49.448+0000 7fbe70ff9700 1 -- 172.21.15.46:0/3226559810 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v10)=0 v10) v1 ==== 122+0+0 (secure 0 0 0) 0x7fbe7415abf0 con 0x7fbe7406a510 2023-07-05T18:56:49.453 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:49.450+0000 7fbe7a29a700 1 -- 172.21.15.46:0/3226559810 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7fbe6006ace0 msgr2=0x7fbe6006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:56:49.453 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:49.450+0000 7fbe7a29a700 1 --2- 172.21.15.46:0/3226559810 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7fbe6006ace0 0x7fbe6006d190 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fbe740af060 tx=0x7fbe68008030 comp rx=0 tx=0).stop 2023-07-05T18:56:49.453 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:49.450+0000 7fbe7a29a700 1 -- 172.21.15.46:0/3226559810 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fbe7406a510 msgr2=0x7fbe7414cbb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:56:49.453 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:49.450+0000 7fbe7a29a700 1 --2- 172.21.15.46:0/3226559810 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fbe7406a510 0x7fbe7414cbb0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7fbe6400c520 tx=0x7fbe6400c8e0 comp rx=0 tx=0).stop 2023-07-05T18:56:49.453 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:49.450+0000 7fbe7a29a700 1 -- 172.21.15.46:0/3226559810 shutdown_connections 2023-07-05T18:56:49.453 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:49.450+0000 7fbe7a29a700 1 --2- 172.21.15.46:0/3226559810 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7fbe6006ace0 0x7fbe6006d190 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:49.454 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:49.450+0000 7fbe7a29a700 1 --2- 172.21.15.46:0/3226559810 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fbe740ce2d0 0x7fbe740cb930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:49.454 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:49.450+0000 7fbe7a29a700 1 --2- 172.21.15.46:0/3226559810 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fbe7406a510 0x7fbe7414cbb0 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:49.454 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:49.450+0000 7fbe7a29a700 1 --2- 172.21.15.46:0/3226559810 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fbe74070980 0x7fbe740cb3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:49.454 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:49.450+0000 7fbe7a29a700 1 -- 172.21.15.46:0/3226559810 >> 172.21.15.46:0/3226559810 conn(0x7fbe740b0fc0 msgr2=0x7fbe740ae7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-05T18:56:49.454 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:49.451+0000 7fbe7a29a700 1 -- 172.21.15.46:0/3226559810 shutdown_connections 2023-07-05T18:56:49.454 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:49.451+0000 7fbe7a29a700 1 -- 172.21.15.46:0/3226559810 wait complete. 2023-07-05T18:56:49.465 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-07-05T18:56:49.466 DEBUG:teuthology.orchestra.run.smithi046:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-07-05T18:56:49.508 DEBUG:teuthology.orchestra.run.smithi073:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-07-05T18:56:49.560 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-07-05T18:56:49.561 DEBUG:teuthology.orchestra.run.smithi046:> set -ex 2023-07-05T18:56:49.561 DEBUG:teuthology.orchestra.run.smithi046:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-05T18:56:49.586 DEBUG:teuthology.orchestra.run.smithi046:> set -ex 2023-07-05T18:56:49.587 DEBUG:teuthology.orchestra.run.smithi046:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-05T18:56:49.647 DEBUG:teuthology.orchestra.run.smithi046:> set -ex 2023-07-05T18:56:49.648 DEBUG:teuthology.orchestra.run.smithi046:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-05T18:56:49.705 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-05T18:56:49.869 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:49.867+0000 7fc62148e700 1 Processor -- start 2023-07-05T18:56:49.869 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:49.867+0000 7fc62148e700 1 -- start start 2023-07-05T18:56:49.870 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:49.868+0000 7fc62148e700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fc61c0d08f0 0x7fc61c0d0d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:56:49.870 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:49.868+0000 7fc62148e700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fc61c0b62e0 0x7fc61c0b6740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:56:49.870 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:49.868+0000 7fc62148e700 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc61c0d1280 con 0x7fc61c0b43a0 2023-07-05T18:56:49.870 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:49.868+0000 7fc62148e700 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc61c0b5b70 con 0x7fc61c0b62e0 2023-07-05T18:56:49.870 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:49.868+0000 7fc62148e700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc61c0b5e50 con 0x7fc61c0d08f0 2023-07-05T18:56:49.871 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:49.868+0000 7fc61a7fc700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fc61c0d08f0 0x7fc61c0d0d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:56:49.871 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:49.868+0000 7fc61a7fc700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fc61c0d08f0 0x7fc61c0d0d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3301/0 says I am v2:172.21.15.46:42656/0 (socket says 172.21.15.46:42656) 2023-07-05T18:56:49.871 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:49.868+0000 7fc61b7fe700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fc61c0b62e0 0x7fc61c0b6740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:56:49.871 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:49.868+0000 7fc61a7fc700 1 -- 172.21.15.46:0/1866103843 learned_addr learned my addr 172.21.15.46:0/1866103843 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-07-05T18:56:49.872 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:49.869+0000 7fc61a7fc700 1 -- 172.21.15.46:0/1866103843 >> v2:172.21.15.73:3300/0 conn(0x7fc61c0b62e0 msgr2=0x7fc61c0b6740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-05T18:56:49.873 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:49.869+0000 7fc61a7fc700 1 --2- 172.21.15.46:0/1866103843 >> v2:172.21.15.73:3300/0 conn(0x7fc61c0b62e0 0x7fc61c0b6740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:49.873 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:49.869+0000 7fc61a7fc700 1 -- 172.21.15.46:0/1866103843 >> v1:172.21.15.73:6789/0 conn(0x7fc61c0b43a0 legacy=0x7fc61c0ce290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:56:49.873 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:49.869+0000 7fc61a7fc700 1 -- 172.21.15.46:0/1866103843 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc61c15cb90 con 0x7fc61c0d08f0 2023-07-05T18:56:49.874 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:49.869+0000 7fc61b7fe700 1 --2- 172.21.15.46:0/1866103843 >> v2:172.21.15.73:3300/0 conn(0x7fc61c0b62e0 0x7fc61c0b6740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-05T18:56:49.874 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:49.869+0000 7fc61a7fc700 1 --2- 172.21.15.46:0/1866103843 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fc61c0d08f0 0x7fc61c0d0d40 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fc6040098f0 tx=0x7fc604009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=87d39d928ccfdab7 server_cookie=0 in_seq=0 out_seq=0 2023-07-05T18:56:49.874 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:49.869+0000 7fc619ffb700 1 -- 172.21.15.46:0/1866103843 <== mon.2 v2:172.21.15.73:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc604011830 con 0x7fc61c0d08f0 2023-07-05T18:56:49.874 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:49.869+0000 7fc619ffb700 1 -- 172.21.15.46:0/1866103843 <== mon.2 v2:172.21.15.73:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc604011990 con 0x7fc61c0d08f0 2023-07-05T18:56:49.874 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:49.869+0000 7fc619ffb700 1 -- 172.21.15.46:0/1866103843 <== mon.2 v2:172.21.15.73:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc604011d20 con 0x7fc61c0d08f0 2023-07-05T18:56:49.874 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:49.869+0000 7fc62148e700 1 -- 172.21.15.46:0/1866103843 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fc61c0d08f0 msgr2=0x7fc61c0d0d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:56:49.875 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:49.869+0000 7fc62148e700 1 --2- 172.21.15.46:0/1866103843 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fc61c0d08f0 0x7fc61c0d0d40 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fc6040098f0 tx=0x7fc604009c00 comp rx=0 tx=0).stop 2023-07-05T18:56:49.875 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:49.869+0000 7fc62148e700 1 -- 172.21.15.46:0/1866103843 shutdown_connections 2023-07-05T18:56:49.875 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:49.869+0000 7fc62148e700 1 --2- 172.21.15.46:0/1866103843 >> v2:172.21.15.73:3300/0 conn(0x7fc61c0b62e0 0x7fc61c0b6740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:49.875 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:49.869+0000 7fc62148e700 1 --2- 172.21.15.46:0/1866103843 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fc61c0d08f0 0x7fc61c0d0d40 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:49.876 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:49.870+0000 7fc62148e700 1 -- 172.21.15.46:0/1866103843 >> 172.21.15.46:0/1866103843 conn(0x7fc61c09bff0 msgr2=0x7fc61c0d2d20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-05T18:56:49.876 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:49.870+0000 7fc62148e700 1 -- 172.21.15.46:0/1866103843 shutdown_connections 2023-07-05T18:56:49.876 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:49.870+0000 7fc62148e700 1 -- 172.21.15.46:0/1866103843 wait complete. 2023-07-05T18:56:49.876 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:49.871+0000 7fc62148e700 1 Processor -- start 2023-07-05T18:56:49.876 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:49.871+0000 7fc62148e700 1 -- start start 2023-07-05T18:56:49.879 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:49.872+0000 7fc62148e700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc61c0b43a0 0x7fc61c159750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:56:49.879 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:49.872+0000 7fc62148e700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fc61c0b62e0 0x7fc61c09ca60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:56:49.880 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:49.872+0000 7fc62148e700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc61c0d08f0 0x7fc61c09ff30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:56:49.880 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:49.872+0000 7fc62148e700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc61c159c90 con 0x7fc61c0b43a0 2023-07-05T18:56:49.880 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:49.872+0000 7fc62148e700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc61c0c8fe0 con 0x7fc61c0d08f0 2023-07-05T18:56:49.880 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:49.872+0000 7fc62148e700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc61c0cb240 con 0x7fc61c0b62e0 2023-07-05T18:56:49.880 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:49.872+0000 7fc61affd700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc61c0b43a0 0x7fc61c159750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:56:49.880 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:49.872+0000 7fc61affd700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc61c0b43a0 0x7fc61c159750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:58974/0 (socket says 172.21.15.46:58974) 2023-07-05T18:56:49.880 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:49.872+0000 7fc61affd700 1 -- 172.21.15.46:0/1504529266 learned_addr learned my addr 172.21.15.46:0/1504529266 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-07-05T18:56:49.881 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:49.872+0000 7fc61a7fc700 1 --2- 172.21.15.46:0/1504529266 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fc61c0b62e0 0x7fc61c09ca60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:56:49.881 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:49.872+0000 7fc61b7fe700 1 --2- 172.21.15.46:0/1504529266 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc61c0d08f0 0x7fc61c09ff30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:56:49.881 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:49.872+0000 7fc61affd700 1 -- 172.21.15.46:0/1504529266 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fc61c0b62e0 msgr2=0x7fc61c09ca60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:56:49.881 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:49.872+0000 7fc61affd700 1 --2- 172.21.15.46:0/1504529266 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fc61c0b62e0 0x7fc61c09ca60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:49.881 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:49.872+0000 7fc61affd700 1 -- 172.21.15.46:0/1504529266 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc61c0d08f0 msgr2=0x7fc61c09ff30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:56:49.881 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:49.872+0000 7fc61affd700 1 --2- 172.21.15.46:0/1504529266 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc61c0d08f0 0x7fc61c09ff30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:49.881 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:49.872+0000 7fc61affd700 1 -- 172.21.15.46:0/1504529266 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc614009a70 con 0x7fc61c0b43a0 2023-07-05T18:56:49.882 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:49.872+0000 7fc61affd700 1 --2- 172.21.15.46:0/1504529266 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc61c0b43a0 0x7fc61c159750 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7fc60c00c480 tx=0x7fc60c00c790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-05T18:56:49.882 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:49.873+0000 7fc6137fe700 1 -- 172.21.15.46:0/1504529266 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc60c0052d0 con 0x7fc61c0b43a0 2023-07-05T18:56:49.882 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:49.873+0000 7fc6137fe700 1 -- 172.21.15.46:0/1504529266 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc60c005450 con 0x7fc61c0b43a0 2023-07-05T18:56:49.883 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:49.873+0000 7fc6137fe700 1 -- 172.21.15.46:0/1504529266 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc60c006af0 con 0x7fc61c0b43a0 2023-07-05T18:56:49.883 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:49.873+0000 7fc62148e700 1 -- 172.21.15.46:0/1504529266 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc604009550 con 0x7fc61c0b43a0 2023-07-05T18:56:49.883 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:49.873+0000 7fc62148e700 1 -- 172.21.15.46:0/1504529266 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc61c0cb800 con 0x7fc61c0b43a0 2023-07-05T18:56:49.883 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:49.874+0000 7fc62148e700 1 -- 172.21.15.46:0/1504529266 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc61c04e1d0 con 0x7fc61c0b43a0 2023-07-05T18:56:49.883 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:49.874+0000 7fc6137fe700 1 -- 172.21.15.46:0/1504529266 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fc60c0036d0 con 0x7fc61c0b43a0 2023-07-05T18:56:49.884 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:49.874+0000 7fc6137fe700 1 --2- 172.21.15.46:0/1504529266 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7fc5fc06ace0 0x7fc5fc06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:56:49.884 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:49.875+0000 7fc6137fe700 1 -- 172.21.15.46:0/1504529266 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fc60c088460 con 0x7fc61c0b43a0 2023-07-05T18:56:49.884 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:49.875+0000 7fc61a7fc700 1 --2- 172.21.15.46:0/1504529266 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7fc5fc06ace0 0x7fc5fc06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:56:49.884 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:49.875+0000 7fc61a7fc700 1 --2- 172.21.15.46:0/1504529266 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7fc5fc06ace0 0x7fc5fc06d190 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fc604014040 tx=0x7fc604008030 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-05T18:56:49.885 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:49.879+0000 7fc6137fe700 1 -- 172.21.15.46:0/1504529266 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fc60c053520 con 0x7fc61c0b43a0 2023-07-05T18:56:50.077 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:50.075+0000 7fc62148e700 1 -- 172.21.15.46:0/1504529266 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fc61c0d1280 con 0x7fc61c0b43a0 2023-07-05T18:56:50.078 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:50.076+0000 7fc6137fe700 1 -- 172.21.15.46:0/1504529266 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) v1 ==== 74+0+18161 (secure 0 0 0) 0x7fc61c0d1280 con 0x7fc61c0b43a0 2023-07-05T18:56:50.078 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T18:56:50.078 INFO:teuthology.orchestra.run.smithi046.stdout:{"epoch":21,"fsid":"042652d3-d80c-4ad8-9366-3e94f2a0a512","created":"2023-07-05T18:55:56.455710+0000","modified":"2023-07-05T18:56:16.095672+0000","last_up_change":"2023-07-05T18:56:06.594022+0000","last_in_change":"2023-07-05T18:55:58.879340+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-07-05T18:56:07.729620+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2023-07-05T18:56:08.128122+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-07-05T18:56:12.954625+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-07-05T18:56:14.068396+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"20009183-9a47-4392-8751-883f88d2bfb1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6813","nonce":4151971443},{"type":"v1","addr":"172.21.15.46:6815","nonce":4151971443}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6817","nonce":4151971443},{"type":"v1","addr":"172.21.15.46:6818","nonce":4151971443}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6822","nonce":4151971443},{"type":"v1","addr":"172.21.15.46:6823","nonce":4151971443}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6820","nonce":4151971443},{"type":"v1","addr":"172.21.15.46:6821","nonce":4151971443}]},"public_addr":"172.21.15.46:6815/4151971443","cluster_addr":"172.21.15.46:6818/4151971443","heartbeat_back_addr":"172.21.15.46:6823/4151971443","heartbeat_front_addr":"172.21.15.46:6821/4151971443","state":["exists","up"]},{"osd":1,"uuid":"91b4a7b0-e4e4-4888-a1fe-9edb0d68004c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6808","nonce":502575881},{"type":"v1","addr":"172.21.15.46:6809","nonce":502575881}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6810","nonce":502575881},{"type":"v1","addr":"172.21.15.46:6811","nonce":502575881}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6816","nonce":502575881},{"type":"v1","addr":"172.21.15.46:6819","nonce":502575881}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6812","nonce":502575881},{"type":"v1","addr":"172.21.15.46:6814","nonce":502575881}]},"public_addr":"172.21.15.46:6809/502575881","cluster_addr":"172.21.15.46:6811/502575881","heartbeat_back_addr":"172.21.15.46:6819/502575881","heartbeat_front_addr":"172.21.15.46:6814/502575881","state":["exists","up"]},{"osd":2,"uuid":"669ff744-1331-47c5-8579-0440731c889a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6800","nonce":2115251461},{"type":"v1","addr":"172.21.15.46:6801","nonce":2115251461}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6802","nonce":2115251461},{"type":"v1","addr":"172.21.15.46:6803","nonce":2115251461}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6806","nonce":2115251461},{"type":"v1","addr":"172.21.15.46:6807","nonce":2115251461}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6804","nonce":2115251461},{"type":"v1","addr":"172.21.15.46:6805","nonce":2115251461}]},"public_addr":"172.21.15.46:6801/2115251461","cluster_addr":"172.21.15.46:6803/2115251461","heartbeat_back_addr":"172.21.15.46:6807/2115251461","heartbeat_front_addr":"172.21.15.46:6805/2115251461","state":["exists","up"]},{"osd":3,"uuid":"34e1b86d-ffad-415d-861c-07a5f08068a6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6824","nonce":2981388766},{"type":"v1","addr":"172.21.15.46:6825","nonce":2981388766}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6826","nonce":2981388766},{"type":"v1","addr":"172.21.15.46:6827","nonce":2981388766}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6830","nonce":2981388766},{"type":"v1","addr":"172.21.15.46:6831","nonce":2981388766}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6828","nonce":2981388766},{"type":"v1","addr":"172.21.15.46:6829","nonce":2981388766}]},"public_addr":"172.21.15.46:6825/2981388766","cluster_addr":"172.21.15.46:6827/2981388766","heartbeat_back_addr":"172.21.15.46:6831/2981388766","heartbeat_front_addr":"172.21.15.46:6829/2981388766","state":["exists","up"]},{"osd":4,"uuid":"57ffcb91-c7dc-4a69-ae71-4d9622a14a05","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6800","nonce":2083655348},{"type":"v1","addr":"172.21.15.73:6801","nonce":2083655348}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6802","nonce":2083655348},{"type":"v1","addr":"172.21.15.73:6803","nonce":2083655348}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6806","nonce":2083655348},{"type":"v1","addr":"172.21.15.73:6807","nonce":2083655348}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6804","nonce":2083655348},{"type":"v1","addr":"172.21.15.73:6805","nonce":2083655348}]},"public_addr":"172.21.15.73:6801/2083655348","cluster_addr":"172.21.15.73:6803/2083655348","heartbeat_back_addr":"172.21.15.73:6807/2083655348","heartbeat_front_addr":"172.21.15.73:6805/2083655348","state":["exists","up"]},{"osd":5,"uuid":"665f41c9-ee20-49cf-bf0e-fbe0c03d3aed","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6824","nonce":2803788401},{"type":"v1","addr":"172.21.15.73:6825","nonce":2803788401}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6826","nonce":2803788401},{"type":"v1","addr":"172.21.15.73:6827","nonce":2803788401}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6830","nonce":2803788401},{"type":"v1","addr":"172.21.15.73:6831","nonce":2803788401}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6828","nonce":2803788401},{"type":"v1","addr":"172.21.15.73:6829","nonce":2803788401}]},"public_addr":"172.21.15.73:6825/2803788401","cluster_addr":"172.21.15.73:6827/2803788401","heartbeat_back_addr":"172.21.15.73:6831/2803788401","heartbeat_front_addr":"172.21.15.73:6829/2803788401","state":["exists","up"]},{"osd":6,"uuid":"5790c6cc-bd56-4ce4-9a7c-0f0c3b59215c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6808","nonce":974108383},{"type":"v1","addr":"172.21.15.73:6809","nonce":974108383}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6810","nonce":974108383},{"type":"v1","addr":"172.21.15.73:6811","nonce":974108383}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6815","nonce":974108383},{"type":"v1","addr":"172.21.15.73:6817","nonce":974108383}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6812","nonce":974108383},{"type":"v1","addr":"172.21.15.73:6813","nonce":974108383}]},"public_addr":"172.21.15.73:6809/974108383","cluster_addr":"172.21.15.73:6811/974108383","heartbeat_back_addr":"172.21.15.73:6817/974108383","heartbeat_front_addr":"172.21.15.73:6813/974108383","state":["exists","up"]},{"osd":7,"uuid":"b66f4d2e-147e-4c9b-97dd-cbd59d33802e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6814","nonce":3772673248},{"type":"v1","addr":"172.21.15.73:6816","nonce":3772673248}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6818","nonce":3772673248},{"type":"v1","addr":"172.21.15.73:6819","nonce":3772673248}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6822","nonce":3772673248},{"type":"v1","addr":"172.21.15.73:6823","nonce":3772673248}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6820","nonce":3772673248},{"type":"v1","addr":"172.21.15.73:6821","nonce":3772673248}]},"public_addr":"172.21.15.73:6816/3772673248","cluster_addr":"172.21.15.73:6819/3772673248","heartbeat_back_addr":"172.21.15.73:6823/3772673248","heartbeat_front_addr":"172.21.15.73:6821/3772673248","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-05T18:56:04.115334+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-05T18:56:04.071250+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-05T18:56:04.044387+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-05T18:56:04.085389+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-05T18:56:04.090726+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-05T18:56:04.074529+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-05T18:56:04.058841+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-05T18:56:04.043054+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-05T18:56:50.081 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:50.078+0000 7fc62148e700 1 -- 172.21.15.46:0/1504529266 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7fc5fc06ace0 msgr2=0x7fc5fc06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:56:50.081 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:50.078+0000 7fc62148e700 1 --2- 172.21.15.46:0/1504529266 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7fc5fc06ace0 0x7fc5fc06d190 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fc604014040 tx=0x7fc604008030 comp rx=0 tx=0).stop 2023-07-05T18:56:50.082 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:50.078+0000 7fc62148e700 1 -- 172.21.15.46:0/1504529266 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc61c0b43a0 msgr2=0x7fc61c159750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:56:50.082 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:50.078+0000 7fc62148e700 1 --2- 172.21.15.46:0/1504529266 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc61c0b43a0 0x7fc61c159750 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7fc60c00c480 tx=0x7fc60c00c790 comp rx=0 tx=0).stop 2023-07-05T18:56:50.082 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:50.078+0000 7fc62148e700 1 -- 172.21.15.46:0/1504529266 shutdown_connections 2023-07-05T18:56:50.083 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:50.078+0000 7fc62148e700 1 --2- 172.21.15.46:0/1504529266 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7fc5fc06ace0 0x7fc5fc06d190 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:50.084 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:50.078+0000 7fc62148e700 1 --2- 172.21.15.46:0/1504529266 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc61c0d08f0 0x7fc61c09ff30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:50.084 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:50.078+0000 7fc62148e700 1 --2- 172.21.15.46:0/1504529266 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc61c0b43a0 0x7fc61c159750 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:50.085 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:50.078+0000 7fc62148e700 1 --2- 172.21.15.46:0/1504529266 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fc61c0b62e0 0x7fc61c09ca60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:50.085 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:50.078+0000 7fc62148e700 1 -- 172.21.15.46:0/1504529266 >> 172.21.15.46:0/1504529266 conn(0x7fc61c09bff0 msgr2=0x7fc61c0b4810 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-05T18:56:50.085 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:50.078+0000 7fc62148e700 1 -- 172.21.15.46:0/1504529266 shutdown_connections 2023-07-05T18:56:50.086 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:50.078+0000 7fc62148e700 1 -- 172.21.15.46:0/1504529266 wait complete. 2023-07-05T18:56:50.095 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'rbd', 'create_time': '2023-07-05T18:56:07.729620+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': '.mgr', 'create_time': '2023-07-05T18:56:08.128122+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-07-05T18:56:12.954625+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-07-05T18:56:14.068396+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-07-05T18:56:50.097 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-07-05T18:56:50.228 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:50.224+0000 7f1b10447700 1 Processor -- start 2023-07-05T18:56:50.228 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:50.224+0000 7f1b10447700 1 -- start start 2023-07-05T18:56:50.228 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:50.225+0000 7f1b10447700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f1b080b1640 0x7f1b080b1a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:56:50.228 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:50.225+0000 7f1b10447700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f1b0806a9a0 0x7f1b08071370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:56:50.229 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:50.225+0000 7f1b10447700 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1b08154da0 con 0x7f1b0806c7e0 2023-07-05T18:56:50.229 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:50.225+0000 7f1b10447700 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1b0815b620 con 0x7f1b080b1640 2023-07-05T18:56:50.229 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:50.225+0000 7f1b10447700 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1b0815ee90 con 0x7f1b0806a9a0 2023-07-05T18:56:50.229 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:50.225+0000 7f1b0e1e3700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f1b080b1640 0x7f1b080b1a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:56:50.229 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:50.225+0000 7f1b0e1e3700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f1b080b1640 0x7f1b080b1a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:58984/0 (socket says 172.21.15.46:58984) 2023-07-05T18:56:50.230 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:50.225+0000 7f1b0e1e3700 1 -- 172.21.15.46:0/833904591 learned_addr learned my addr 172.21.15.46:0/833904591 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-07-05T18:56:50.231 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:50.225+0000 7f1b0d9e2700 1 --2- 172.21.15.46:0/833904591 >> v2:172.21.15.73:3300/0 conn(0x7f1b0806a9a0 0x7f1b08071370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:56:50.231 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:50.225+0000 7f1b0e1e3700 1 -- 172.21.15.46:0/833904591 >> v2:172.21.15.73:3300/0 conn(0x7f1b0806a9a0 msgr2=0x7f1b08071370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-05T18:56:50.231 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:50.225+0000 7f1b0e1e3700 1 --2- 172.21.15.46:0/833904591 >> v2:172.21.15.73:3300/0 conn(0x7f1b0806a9a0 0x7f1b08071370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:50.232 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:50.225+0000 7f1b0e1e3700 1 -- 172.21.15.46:0/833904591 >> v1:172.21.15.73:6789/0 conn(0x7f1b0806c7e0 legacy=0x7f1b0806cc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:56:50.232 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:50.225+0000 7f1b0e1e3700 1 -- 172.21.15.46:0/833904591 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1b080b1f50 con 0x7f1b080b1640 2023-07-05T18:56:50.232 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:50.225+0000 7f1b0d9e2700 1 --2- 172.21.15.46:0/833904591 >> v2:172.21.15.73:3300/0 conn(0x7f1b0806a9a0 0x7f1b08071370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-05T18:56:50.233 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:50.225+0000 7f1b0e1e3700 1 --2- 172.21.15.46:0/833904591 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1b080b1640 0x7f1b080b1a10 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f1b080712c0 tx=0x7f1af8009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=274bf8cd3c477ddd server_cookie=0 in_seq=0 out_seq=0 2023-07-05T18:56:50.233 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:50.225+0000 7f1b0d1e1700 1 -- 172.21.15.46:0/833904591 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1af800b870 con 0x7f1b080b1640 2023-07-05T18:56:50.233 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:50.225+0000 7f1b0d1e1700 1 -- 172.21.15.46:0/833904591 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1af800b9d0 con 0x7f1b080b1640 2023-07-05T18:56:50.233 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:50.225+0000 7f1b0d1e1700 1 -- 172.21.15.46:0/833904591 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1af800bd60 con 0x7f1b080b1640 2023-07-05T18:56:50.233 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:50.225+0000 7f1b10447700 1 -- 172.21.15.46:0/833904591 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1b080b1640 msgr2=0x7f1b080b1a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:56:50.233 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:50.225+0000 7f1b10447700 1 --2- 172.21.15.46:0/833904591 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1b080b1640 0x7f1b080b1a10 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f1b080712c0 tx=0x7f1af8009bd0 comp rx=0 tx=0).stop 2023-07-05T18:56:50.234 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:50.225+0000 7f1b10447700 1 -- 172.21.15.46:0/833904591 shutdown_connections 2023-07-05T18:56:50.234 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:50.225+0000 7f1b10447700 1 --2- 172.21.15.46:0/833904591 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1b080b1640 0x7f1b080b1a10 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:50.234 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:50.225+0000 7f1b10447700 1 --2- 172.21.15.46:0/833904591 >> v2:172.21.15.73:3300/0 conn(0x7f1b0806a9a0 0x7f1b08071370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:50.234 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:50.225+0000 7f1b10447700 1 -- 172.21.15.46:0/833904591 >> 172.21.15.46:0/833904591 conn(0x7f1b080cf980 msgr2=0x7f1b080cfd50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-05T18:56:50.234 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:50.225+0000 7f1b10447700 1 -- 172.21.15.46:0/833904591 shutdown_connections 2023-07-05T18:56:50.234 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:50.226+0000 7f1b10447700 1 -- 172.21.15.46:0/833904591 wait complete. 2023-07-05T18:56:50.238 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:50.227+0000 7f1b10447700 1 Processor -- start 2023-07-05T18:56:50.238 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:50.227+0000 7f1b10447700 1 -- start start 2023-07-05T18:56:50.238 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:50.227+0000 7f1b10447700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f1b0806a9a0 0x7f1b08153420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:56:50.238 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:50.227+0000 7f1b10447700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1b0806c7e0 0x7f1b081ecfa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:56:50.239 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:50.227+0000 7f1b10447700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1b080b1640 0x7f1b081ed4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:56:50.239 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:50.227+0000 7f1b10447700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b080ce600 con 0x7f1b080b1640 2023-07-05T18:56:50.239 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:50.228+0000 7f1b10447700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b081eda20 con 0x7f1b0806c7e0 2023-07-05T18:56:50.239 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:50.228+0000 7f1b10447700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1b080cd560 con 0x7f1b0806a9a0 2023-07-05T18:56:50.239 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:50.228+0000 7f1b0e9e4700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1b080b1640 0x7f1b081ed4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:56:50.239 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:50.228+0000 7f1b0e9e4700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1b080b1640 0x7f1b081ed4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:58992/0 (socket says 172.21.15.46:58992) 2023-07-05T18:56:50.240 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:50.228+0000 7f1b0e9e4700 1 -- 172.21.15.46:0/1302275294 learned_addr learned my addr 172.21.15.46:0/1302275294 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-07-05T18:56:50.240 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:50.228+0000 7f1b0e1e3700 1 --2- 172.21.15.46:0/1302275294 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f1b0806a9a0 0x7f1b08153420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:56:50.240 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:50.228+0000 7f1b0d9e2700 1 --2- 172.21.15.46:0/1302275294 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1b0806c7e0 0x7f1b081ecfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:56:50.240 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:50.228+0000 7f1b0e9e4700 1 -- 172.21.15.46:0/1302275294 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f1b0806a9a0 msgr2=0x7f1b08153420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:56:50.240 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:50.228+0000 7f1b0e9e4700 1 --2- 172.21.15.46:0/1302275294 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f1b0806a9a0 0x7f1b08153420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:50.240 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:50.228+0000 7f1b0e9e4700 1 -- 172.21.15.46:0/1302275294 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1b0806c7e0 msgr2=0x7f1b081ecfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:56:50.240 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:50.228+0000 7f1b0e9e4700 1 --2- 172.21.15.46:0/1302275294 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1b0806c7e0 0x7f1b081ecfa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:50.241 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:50.228+0000 7f1b0e9e4700 1 -- 172.21.15.46:0/1302275294 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1af8009550 con 0x7f1b080b1640 2023-07-05T18:56:50.241 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:50.228+0000 7f1b0d9e2700 1 --2- 172.21.15.46:0/1302275294 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1b0806c7e0 0x7f1b081ecfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-05T18:56:50.241 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:50.228+0000 7f1b0e9e4700 1 --2- 172.21.15.46:0/1302275294 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1b080b1640 0x7f1b081ed4e0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f1b0000cc50 tx=0x7f1b0000cf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-05T18:56:50.241 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:50.228+0000 7f1afeffd700 1 -- 172.21.15.46:0/1302275294 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b00003c00 con 0x7f1b080b1640 2023-07-05T18:56:50.241 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:50.228+0000 7f1afeffd700 1 -- 172.21.15.46:0/1302275294 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1b00003d60 con 0x7f1b080b1640 2023-07-05T18:56:50.242 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:50.228+0000 7f1b10447700 1 -- 172.21.15.46:0/1302275294 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1b080cd840 con 0x7f1b080b1640 2023-07-05T18:56:50.243 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:50.228+0000 7f1afeffd700 1 -- 172.21.15.46:0/1302275294 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b0000ab60 con 0x7f1b080b1640 2023-07-05T18:56:50.243 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:50.228+0000 7f1b10447700 1 -- 172.21.15.46:0/1302275294 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1b080ce0e0 con 0x7f1b080b1640 2023-07-05T18:56:50.243 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:50.229+0000 7f1b10447700 1 -- 172.21.15.46:0/1302275294 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1b080cdc60 con 0x7f1b080b1640 2023-07-05T18:56:50.243 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:50.230+0000 7f1afeffd700 1 -- 172.21.15.46:0/1302275294 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f1b0000acc0 con 0x7f1b080b1640 2023-07-05T18:56:50.243 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:50.230+0000 7f1afeffd700 1 --2- 172.21.15.46:0/1302275294 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7f1aec06ace0 0x7f1aec06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:56:50.244 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:50.230+0000 7f1afeffd700 1 -- 172.21.15.46:0/1302275294 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f1b00089540 con 0x7f1b080b1640 2023-07-05T18:56:50.244 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:50.230+0000 7f1b0e1e3700 1 --2- 172.21.15.46:0/1302275294 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7f1aec06ace0 0x7f1aec06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:56:50.244 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:50.231+0000 7f1b0e1e3700 1 --2- 172.21.15.46:0/1302275294 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7f1aec06ace0 0x7f1aec06d190 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f1af8014040 tx=0x7f1af8008030 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-05T18:56:50.244 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:50.234+0000 7f1afeffd700 1 -- 172.21.15.46:0/1302275294 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f1b080cdc60 con 0x7f1b080b1640 2023-07-05T18:56:50.433 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:50.431+0000 7f1b10447700 1 -- 172.21.15.46:0/1302275294 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f1b080cdc60 con 0x7f1b080b1640 2023-07-05T18:56:50.433 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:50.431+0000 7f1afeffd700 1 -- 172.21.15.46:0/1302275294 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v21) v1 ==== 92+0+10 (secure 0 0 0) 0x7f1b080cdc60 con 0x7f1b080b1640 2023-07-05T18:56:50.434 INFO:teuthology.orchestra.run.smithi046.stdout:pg_num: 8 2023-07-05T18:56:50.436 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:50.434+0000 7f1b10447700 1 -- 172.21.15.46:0/1302275294 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7f1aec06ace0 msgr2=0x7f1aec06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:56:50.436 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:50.434+0000 7f1b10447700 1 --2- 172.21.15.46:0/1302275294 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7f1aec06ace0 0x7f1aec06d190 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f1af8014040 tx=0x7f1af8008030 comp rx=0 tx=0).stop 2023-07-05T18:56:50.436 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:50.434+0000 7f1b10447700 1 -- 172.21.15.46:0/1302275294 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1b080b1640 msgr2=0x7f1b081ed4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:56:50.436 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:50.434+0000 7f1b10447700 1 --2- 172.21.15.46:0/1302275294 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1b080b1640 0x7f1b081ed4e0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f1b0000cc50 tx=0x7f1b0000cf60 comp rx=0 tx=0).stop 2023-07-05T18:56:50.437 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:50.434+0000 7f1b10447700 1 -- 172.21.15.46:0/1302275294 shutdown_connections 2023-07-05T18:56:50.437 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:50.434+0000 7f1b10447700 1 --2- 172.21.15.46:0/1302275294 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7f1aec06ace0 0x7f1aec06d190 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:50.437 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:50.434+0000 7f1b10447700 1 --2- 172.21.15.46:0/1302275294 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1b080b1640 0x7f1b081ed4e0 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:50.437 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:50.434+0000 7f1b10447700 1 --2- 172.21.15.46:0/1302275294 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f1b0806a9a0 0x7f1b08153420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:50.437 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:50.434+0000 7f1b10447700 1 --2- 172.21.15.46:0/1302275294 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1b0806c7e0 0x7f1b081ecfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:50.438 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:50.434+0000 7f1b10447700 1 -- 172.21.15.46:0/1302275294 >> 172.21.15.46:0/1302275294 conn(0x7f1b080cf980 msgr2=0x7f1b0806cc00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-05T18:56:50.438 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:50.434+0000 7f1b10447700 1 -- 172.21.15.46:0/1302275294 shutdown_connections 2023-07-05T18:56:50.438 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:50.434+0000 7f1b10447700 1 -- 172.21.15.46:0/1302275294 wait complete. 2023-07-05T18:56:50.449 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-07-05T18:56:50.577 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:50.575+0000 7f7ddf754700 1 Processor -- start 2023-07-05T18:56:50.578 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:50.575+0000 7f7ddf754700 1 -- start start 2023-07-05T18:56:50.579 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:50.576+0000 7f7ddf754700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f7dd815c860 0x7f7dd8160ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:56:50.579 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:50.576+0000 7f7ddf754700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f7dd806a510 0x7f7dd806c1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:56:50.579 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:50.576+0000 7f7ddf754700 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7dd80ce640 con 0x7f7dd80715c0 2023-07-05T18:56:50.579 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:50.576+0000 7f7ddf754700 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7dd81611e0 con 0x7f7dd806a510 2023-07-05T18:56:50.580 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:50.576+0000 7f7ddf754700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7dd80ce870 con 0x7f7dd815c860 2023-07-05T18:56:50.580 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:50.576+0000 7f7dddcf1700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f7dd806a510 0x7f7dd806c1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:56:50.580 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:50.576+0000 7f7dddcf1700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f7dd806a510 0x7f7dd806c1f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:59000/0 (socket says 172.21.15.46:59000) 2023-07-05T18:56:50.580 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:50.576+0000 7f7dddcf1700 1 -- 172.21.15.46:0/3237662170 learned_addr learned my addr 172.21.15.46:0/3237662170 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-07-05T18:56:50.580 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:50.577+0000 7f7ddd4f0700 1 --2- 172.21.15.46:0/3237662170 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f7dd815c860 0x7f7dd8160ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:56:50.580 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:50.577+0000 7f7dddcf1700 1 -- 172.21.15.46:0/3237662170 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f7dd815c860 msgr2=0x7f7dd8160ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-05T18:56:50.581 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:50.577+0000 7f7dddcf1700 1 --2- 172.21.15.46:0/3237662170 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f7dd815c860 0x7f7dd8160ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:50.581 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:50.577+0000 7f7dddcf1700 1 -- 172.21.15.46:0/3237662170 >> v1:172.21.15.73:6789/0 conn(0x7f7dd80715c0 legacy=0x7f7dd8069e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:56:50.581 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:50.577+0000 7f7dddcf1700 1 -- 172.21.15.46:0/3237662170 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7dd80ceb50 con 0x7f7dd806a510 2023-07-05T18:56:50.581 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:50.577+0000 7f7dddcf1700 1 --2- 172.21.15.46:0/3237662170 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7dd806a510 0x7f7dd806c1f0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f7dd0009e50 tx=0x7f7dd000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=43759a362de98167 server_cookie=0 in_seq=0 out_seq=0 2023-07-05T18:56:50.581 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:50.577+0000 7f7dcffff700 1 -- 172.21.15.46:0/3237662170 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7dd000e070 con 0x7f7dd806a510 2023-07-05T18:56:50.581 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:50.577+0000 7f7dcffff700 1 -- 172.21.15.46:0/3237662170 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7dd000b910 con 0x7f7dd806a510 2023-07-05T18:56:50.581 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:50.577+0000 7f7dcffff700 1 -- 172.21.15.46:0/3237662170 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7dd000bcc0 con 0x7f7dd806a510 2023-07-05T18:56:50.583 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:50.578+0000 7f7ddf754700 1 -- 172.21.15.46:0/3237662170 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7dd806a510 msgr2=0x7f7dd806c1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:56:50.583 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:50.578+0000 7f7ddf754700 1 --2- 172.21.15.46:0/3237662170 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7dd806a510 0x7f7dd806c1f0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f7dd0009e50 tx=0x7f7dd000b330 comp rx=0 tx=0).stop 2023-07-05T18:56:50.584 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:50.578+0000 7f7ddf754700 1 -- 172.21.15.46:0/3237662170 shutdown_connections 2023-07-05T18:56:50.584 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:50.578+0000 7f7ddf754700 1 --2- 172.21.15.46:0/3237662170 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f7dd815c860 0x7f7dd8160ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:50.584 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:50.578+0000 7f7ddf754700 1 --2- 172.21.15.46:0/3237662170 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7dd806a510 0x7f7dd806c1f0 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:50.584 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:50.578+0000 7f7ddf754700 1 -- 172.21.15.46:0/3237662170 >> 172.21.15.46:0/3237662170 conn(0x7f7dd806bba0 msgr2=0x7f7dd80cc3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-05T18:56:50.584 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:50.578+0000 7f7ddf754700 1 -- 172.21.15.46:0/3237662170 shutdown_connections 2023-07-05T18:56:50.584 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:50.578+0000 7f7ddf754700 1 -- 172.21.15.46:0/3237662170 wait complete. 2023-07-05T18:56:50.584 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:50.579+0000 7f7ddf754700 1 Processor -- start 2023-07-05T18:56:50.585 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:50.579+0000 7f7ddf754700 1 -- start start 2023-07-05T18:56:50.585 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:50.580+0000 7f7ddf754700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f7dd806a510 0x7f7dd80c5fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:56:50.585 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:50.580+0000 7f7ddf754700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7dd80715c0 0x7f7dd81459d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:56:50.585 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:50.580+0000 7f7ddf754700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7dd815c860 0x7f7dd81566b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:56:50.585 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:50.580+0000 7f7ddf754700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7dd814b890 con 0x7f7dd815c860 2023-07-05T18:56:50.585 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:50.580+0000 7f7ddf754700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7dd815e920 con 0x7f7dd80715c0 2023-07-05T18:56:50.585 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:50.580+0000 7f7ddf754700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7dd815dd10 con 0x7f7dd806a510 2023-07-05T18:56:50.585 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:50.580+0000 7f7dddcf1700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7dd815c860 0x7f7dd81566b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:56:50.586 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:50.580+0000 7f7dddcf1700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7dd815c860 0x7f7dd81566b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:59006/0 (socket says 172.21.15.46:59006) 2023-07-05T18:56:50.586 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:50.580+0000 7f7dddcf1700 1 -- 172.21.15.46:0/3838499483 learned_addr learned my addr 172.21.15.46:0/3838499483 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-07-05T18:56:50.586 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:50.580+0000 7f7ddd4f0700 1 --2- 172.21.15.46:0/3838499483 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f7dd806a510 0x7f7dd80c5fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:56:50.586 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:50.580+0000 7f7ddccef700 1 --2- 172.21.15.46:0/3838499483 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7dd80715c0 0x7f7dd81459d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:56:50.586 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:50.581+0000 7f7dddcf1700 1 -- 172.21.15.46:0/3838499483 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f7dd806a510 msgr2=0x7f7dd80c5fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:56:50.586 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:50.581+0000 7f7dddcf1700 1 --2- 172.21.15.46:0/3838499483 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f7dd806a510 0x7f7dd80c5fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:50.586 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:50.581+0000 7f7dddcf1700 1 -- 172.21.15.46:0/3838499483 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7dd80715c0 msgr2=0x7f7dd81459d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:56:50.587 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:50.581+0000 7f7dddcf1700 1 --2- 172.21.15.46:0/3838499483 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7dd80715c0 0x7f7dd81459d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:50.587 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:50.581+0000 7f7dddcf1700 1 -- 172.21.15.46:0/3838499483 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7dd0009b30 con 0x7f7dd815c860 2023-07-05T18:56:50.587 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:50.581+0000 7f7dddcf1700 1 --2- 172.21.15.46:0/3838499483 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7dd815c860 0x7f7dd81566b0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f7dd0012000 tx=0x7f7dd0004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-05T18:56:50.587 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:50.581+0000 7f7dcdffb700 1 -- 172.21.15.46:0/3838499483 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7dd0004800 con 0x7f7dd815c860 2023-07-05T18:56:50.587 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:50.581+0000 7f7dcdffb700 1 -- 172.21.15.46:0/3838499483 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7dd0004960 con 0x7f7dd815c860 2023-07-05T18:56:50.587 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:50.581+0000 7f7ddf754700 1 -- 172.21.15.46:0/3838499483 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7dd815dff0 con 0x7f7dd815c860 2023-07-05T18:56:50.587 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:50.581+0000 7f7dcdffb700 1 -- 172.21.15.46:0/3838499483 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7dd001c680 con 0x7f7dd815c860 2023-07-05T18:56:50.587 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:50.581+0000 7f7ddf754700 1 -- 172.21.15.46:0/3838499483 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7dd815e5b0 con 0x7f7dd815c860 2023-07-05T18:56:50.588 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:50.582+0000 7f7ddf754700 1 -- 172.21.15.46:0/3838499483 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7dd8067e40 con 0x7f7dd815c860 2023-07-05T18:56:50.588 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:50.583+0000 7f7dcdffb700 1 -- 172.21.15.46:0/3838499483 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f7dd001c7e0 con 0x7f7dd815c860 2023-07-05T18:56:50.589 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:50.583+0000 7f7dcdffb700 1 --2- 172.21.15.46:0/3838499483 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7f7dbc06ace0 0x7f7dbc06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:56:50.589 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:50.583+0000 7f7dcdffb700 1 -- 172.21.15.46:0/3838499483 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f7dd008b1a0 con 0x7f7dd815c860 2023-07-05T18:56:50.589 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:50.583+0000 7f7ddd4f0700 1 --2- 172.21.15.46:0/3838499483 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7f7dbc06ace0 0x7f7dbc06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:56:50.589 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:50.584+0000 7f7ddd4f0700 1 --2- 172.21.15.46:0/3838499483 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7f7dbc06ace0 0x7f7dbc06d190 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f7dc8009b40 tx=0x7f7dc8009210 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-05T18:56:50.589 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:50.587+0000 7f7dcdffb700 1 -- 172.21.15.46:0/3838499483 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f7dd00564e0 con 0x7f7dd815c860 2023-07-05T18:56:50.785 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:50.783+0000 7f7ddf754700 1 -- 172.21.15.46:0/3838499483 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f7dd80672e0 con 0x7f7dd815c860 2023-07-05T18:56:50.785 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:50.783+0000 7f7dcdffb700 1 -- 172.21.15.46:0/3838499483 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v21) v1 ==== 93+0+10 (secure 0 0 0) 0x7f7dd0059b00 con 0x7f7dd815c860 2023-07-05T18:56:50.785 INFO:teuthology.orchestra.run.smithi046.stdout:pg_num: 1 2023-07-05T18:56:50.789 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:50.785+0000 7f7ddf754700 1 -- 172.21.15.46:0/3838499483 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7f7dbc06ace0 msgr2=0x7f7dbc06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:56:50.789 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:50.785+0000 7f7ddf754700 1 --2- 172.21.15.46:0/3838499483 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7f7dbc06ace0 0x7f7dbc06d190 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f7dc8009b40 tx=0x7f7dc8009210 comp rx=0 tx=0).stop 2023-07-05T18:56:50.789 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:50.785+0000 7f7ddf754700 1 -- 172.21.15.46:0/3838499483 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7dd815c860 msgr2=0x7f7dd81566b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:56:50.789 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:50.785+0000 7f7ddf754700 1 --2- 172.21.15.46:0/3838499483 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7dd815c860 0x7f7dd81566b0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f7dd0012000 tx=0x7f7dd0004ad0 comp rx=0 tx=0).stop 2023-07-05T18:56:50.789 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:50.785+0000 7f7ddf754700 1 -- 172.21.15.46:0/3838499483 shutdown_connections 2023-07-05T18:56:50.790 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:50.785+0000 7f7ddf754700 1 --2- 172.21.15.46:0/3838499483 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7f7dbc06ace0 0x7f7dbc06d190 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:50.790 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:50.785+0000 7f7ddf754700 1 --2- 172.21.15.46:0/3838499483 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7dd815c860 0x7f7dd81566b0 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:50.790 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:50.785+0000 7f7ddf754700 1 --2- 172.21.15.46:0/3838499483 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f7dd806a510 0x7f7dd80c5fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:50.790 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:50.785+0000 7f7ddf754700 1 --2- 172.21.15.46:0/3838499483 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7dd80715c0 0x7f7dd81459d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:50.790 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:50.785+0000 7f7ddf754700 1 -- 172.21.15.46:0/3838499483 >> 172.21.15.46:0/3838499483 conn(0x7f7dd806bba0 msgr2=0x7f7dd80b27a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-05T18:56:50.791 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:50.785+0000 7f7ddf754700 1 -- 172.21.15.46:0/3838499483 shutdown_connections 2023-07-05T18:56:50.791 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:50.785+0000 7f7ddf754700 1 -- 172.21.15.46:0/3838499483 wait complete. 2023-07-05T18:56:50.799 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-07-05T18:56:50.928 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:50.927+0000 7f02e3b47700 1 Processor -- start 2023-07-05T18:56:50.928 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:50.927+0000 7f02e3b47700 1 -- start start 2023-07-05T18:56:50.929 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:50.927+0000 7f02e3b47700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f02dc13f550 0x7f02dc15d890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:56:50.930 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:50.927+0000 7f02e3b47700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f02dc06c7c0 0x7f02dc0cdc80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:56:50.930 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:50.927+0000 7f02e3b47700 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f02dc06cfa0 con 0x7f02dc0b1640 2023-07-05T18:56:50.930 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:50.927+0000 7f02e3b47700 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f02dc159910 con 0x7f02dc06c7c0 2023-07-05T18:56:50.930 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:50.927+0000 7f02e3b47700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f02dc13f920 con 0x7f02dc13f550 2023-07-05T18:56:50.930 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:50.927+0000 7f02e18e3700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f02dc13f550 0x7f02dc15d890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:56:50.930 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:50.927+0000 7f02e10e2700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f02dc06c7c0 0x7f02dc0cdc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:56:50.931 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:50.927+0000 7f02e18e3700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f02dc13f550 0x7f02dc15d890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3301/0 says I am v2:172.21.15.46:42696/0 (socket says 172.21.15.46:42696) 2023-07-05T18:56:50.931 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:50.927+0000 7f02e18e3700 1 -- 172.21.15.46:0/1418088518 learned_addr learned my addr 172.21.15.46:0/1418088518 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-07-05T18:56:50.931 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:50.927+0000 7f02e10e2700 1 -- 172.21.15.46:0/1418088518 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f02dc13f550 msgr2=0x7f02dc15d890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-05T18:56:50.931 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:50.927+0000 7f02e10e2700 1 --2- 172.21.15.46:0/1418088518 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f02dc13f550 0x7f02dc15d890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:50.931 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:50.927+0000 7f02e10e2700 1 -- 172.21.15.46:0/1418088518 >> v1:172.21.15.73:6789/0 conn(0x7f02dc0b1640 legacy=0x7f02dc159d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:56:50.931 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:50.927+0000 7f02e08e1700 1 -- 172.21.15.46:0/1418088518 <== mon.1 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 780438280 0 0) 0x7f02dc06cfa0 con 0x7f02dc0b1640 2023-07-05T18:56:50.932 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:50.928+0000 7f02e10e2700 1 -- 172.21.15.46:0/1418088518 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f02dc06d300 con 0x7f02dc06c7c0 2023-07-05T18:56:50.932 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:50.928+0000 7f02e18e3700 1 --2- 172.21.15.46:0/1418088518 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f02dc13f550 0x7f02dc15d890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-05T18:56:50.932 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:50.928+0000 7f02e10e2700 1 --2- 172.21.15.46:0/1418088518 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f02dc06c7c0 0x7f02dc0cdc80 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f02cc009840 tx=0x7f02cc009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=788ee8c4fa6ddbda server_cookie=0 in_seq=0 out_seq=0 2023-07-05T18:56:50.932 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:50.928+0000 7f02e08e1700 1 -- 172.21.15.46:0/1418088518 <== mon.1 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02cc011830 con 0x7f02dc06c7c0 2023-07-05T18:56:50.932 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:50.928+0000 7f02e08e1700 1 -- 172.21.15.46:0/1418088518 <== mon.1 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f02cc011990 con 0x7f02dc06c7c0 2023-07-05T18:56:50.933 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:50.928+0000 7f02e08e1700 1 -- 172.21.15.46:0/1418088518 <== mon.1 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02cc011d20 con 0x7f02dc06c7c0 2023-07-05T18:56:50.935 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:50.928+0000 7f02e3b47700 1 -- 172.21.15.46:0/1418088518 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f02dc06c7c0 msgr2=0x7f02dc0cdc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:56:50.935 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:50.928+0000 7f02e3b47700 1 --2- 172.21.15.46:0/1418088518 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f02dc06c7c0 0x7f02dc0cdc80 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f02cc009840 tx=0x7f02cc009b50 comp rx=0 tx=0).stop 2023-07-05T18:56:50.935 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:50.928+0000 7f02e3b47700 1 -- 172.21.15.46:0/1418088518 shutdown_connections 2023-07-05T18:56:50.936 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:50.928+0000 7f02e3b47700 1 --2- 172.21.15.46:0/1418088518 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f02dc13f550 0x7f02dc15d890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:50.936 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:50.928+0000 7f02e3b47700 1 --2- 172.21.15.46:0/1418088518 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f02dc06c7c0 0x7f02dc0cdc80 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:50.936 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:50.928+0000 7f02e3b47700 1 -- 172.21.15.46:0/1418088518 >> 172.21.15.46:0/1418088518 conn(0x7f02dc0cf9a0 msgr2=0x7f02dc0cfda0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-05T18:56:50.936 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:50.929+0000 7f02e3b47700 1 -- 172.21.15.46:0/1418088518 shutdown_connections 2023-07-05T18:56:50.936 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:50.929+0000 7f02e3b47700 1 -- 172.21.15.46:0/1418088518 wait complete. 2023-07-05T18:56:50.936 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:50.930+0000 7f02e3b47700 1 Processor -- start 2023-07-05T18:56:50.937 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:50.930+0000 7f02e3b47700 1 -- start start 2023-07-05T18:56:50.937 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:50.930+0000 7f02e3b47700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f02dc06c7c0 0x7f02dc0cad60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:56:50.937 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:50.930+0000 7f02e3b47700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f02dc0b1640 0x7f02dc13e640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:56:50.937 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:50.930+0000 7f02e3b47700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f02dc13f550 0x7f02dc0c8820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:56:50.937 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:50.930+0000 7f02e3b47700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02dc0c5af0 con 0x7f02dc0b1640 2023-07-05T18:56:50.937 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:50.930+0000 7f02e3b47700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02dc0cb3b0 con 0x7f02dc06c7c0 2023-07-05T18:56:50.937 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:50.930+0000 7f02e3b47700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f02dc0cb690 con 0x7f02dc13f550 2023-07-05T18:56:50.937 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:50.931+0000 7f02e10e2700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f02dc0b1640 0x7f02dc13e640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:56:50.938 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:50.931+0000 7f02e10e2700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f02dc0b1640 0x7f02dc13e640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:59018/0 (socket says 172.21.15.46:59018) 2023-07-05T18:56:50.938 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:50.931+0000 7f02e10e2700 1 -- 172.21.15.46:0/71417863 learned_addr learned my addr 172.21.15.46:0/71417863 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-07-05T18:56:50.938 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:50.931+0000 7f02e20e4700 1 --2- 172.21.15.46:0/71417863 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f02dc13f550 0x7f02dc0c8820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:56:50.938 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:50.931+0000 7f02e18e3700 1 --2- 172.21.15.46:0/71417863 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f02dc06c7c0 0x7f02dc0cad60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:56:50.938 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:50.931+0000 7f02e10e2700 1 -- 172.21.15.46:0/71417863 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f02dc13f550 msgr2=0x7f02dc0c8820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:56:50.938 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:50.931+0000 7f02e10e2700 1 --2- 172.21.15.46:0/71417863 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f02dc13f550 0x7f02dc0c8820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:50.938 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:50.931+0000 7f02e10e2700 1 -- 172.21.15.46:0/71417863 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f02dc06c7c0 msgr2=0x7f02dc0cad60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:56:50.939 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:50.931+0000 7f02e10e2700 1 --2- 172.21.15.46:0/71417863 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f02dc06c7c0 0x7f02dc0cad60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:50.939 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:50.931+0000 7f02e10e2700 1 -- 172.21.15.46:0/71417863 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f02d8009550 con 0x7f02dc0b1640 2023-07-05T18:56:50.939 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:50.931+0000 7f02e10e2700 1 --2- 172.21.15.46:0/71417863 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f02dc0b1640 0x7f02dc13e640 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f02cc009fd0 tx=0x7f02cc004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-05T18:56:50.939 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:50.931+0000 7f02d27fc700 1 -- 172.21.15.46:0/71417863 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02cc0038a0 con 0x7f02dc0b1640 2023-07-05T18:56:50.939 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:50.931+0000 7f02d27fc700 1 -- 172.21.15.46:0/71417863 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f02cc01f070 con 0x7f02dc0b1640 2023-07-05T18:56:50.939 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:50.931+0000 7f02e3b47700 1 -- 172.21.15.46:0/71417863 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f02cc0094a0 con 0x7f02dc0b1640 2023-07-05T18:56:50.939 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:50.931+0000 7f02d27fc700 1 -- 172.21.15.46:0/71417863 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02cc003c40 con 0x7f02dc0b1640 2023-07-05T18:56:50.939 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:50.931+0000 7f02e3b47700 1 -- 172.21.15.46:0/71417863 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f02dc0c6090 con 0x7f02dc0b1640 2023-07-05T18:56:50.940 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:50.932+0000 7f02e3b47700 1 -- 172.21.15.46:0/71417863 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f02dc0672e0 con 0x7f02dc0b1640 2023-07-05T18:56:50.940 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:50.933+0000 7f02d27fc700 1 -- 172.21.15.46:0/71417863 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f02cc026480 con 0x7f02dc0b1640 2023-07-05T18:56:50.940 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:50.933+0000 7f02d27fc700 1 --2- 172.21.15.46:0/71417863 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7f02c006ad10 0x7f02c006d1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:56:50.940 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:50.933+0000 7f02d27fc700 1 -- 172.21.15.46:0/71417863 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f02cc021070 con 0x7f02dc0b1640 2023-07-05T18:56:50.941 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:50.933+0000 7f02e18e3700 1 --2- 172.21.15.46:0/71417863 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7f02c006ad10 0x7f02c006d1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:56:50.941 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:50.934+0000 7f02e18e3700 1 --2- 172.21.15.46:0/71417863 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7f02c006ad10 0x7f02c006d1c0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f02d8009c50 tx=0x7f02d8008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-05T18:56:50.941 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:50.938+0000 7f02d27fc700 1 -- 172.21.15.46:0/71417863 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f02cc055f10 con 0x7f02dc0b1640 2023-07-05T18:56:51.138 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:51.136+0000 7f02e3b47700 1 -- 172.21.15.46:0/71417863 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f02dc0cd890 con 0x7f02dc0b1640 2023-07-05T18:56:51.138 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:51.136+0000 7f02d27fc700 1 -- 172.21.15.46:0/71417863 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v21) v1 ==== 104+0+11 (secure 0 0 0) 0x7f02cc015020 con 0x7f02dc0b1640 2023-07-05T18:56:51.139 INFO:teuthology.orchestra.run.smithi046.stdout:pg_num: 32 2023-07-05T18:56:51.141 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:51.139+0000 7f02e3b47700 1 -- 172.21.15.46:0/71417863 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7f02c006ad10 msgr2=0x7f02c006d1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:56:51.141 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:51.139+0000 7f02e3b47700 1 --2- 172.21.15.46:0/71417863 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7f02c006ad10 0x7f02c006d1c0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f02d8009c50 tx=0x7f02d8008040 comp rx=0 tx=0).stop 2023-07-05T18:56:51.141 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:51.139+0000 7f02e3b47700 1 -- 172.21.15.46:0/71417863 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f02dc0b1640 msgr2=0x7f02dc13e640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:56:51.141 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:51.139+0000 7f02e3b47700 1 --2- 172.21.15.46:0/71417863 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f02dc0b1640 0x7f02dc13e640 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f02cc009fd0 tx=0x7f02cc004750 comp rx=0 tx=0).stop 2023-07-05T18:56:51.141 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:51.139+0000 7f02e3b47700 1 -- 172.21.15.46:0/71417863 shutdown_connections 2023-07-05T18:56:51.141 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:51.139+0000 7f02e3b47700 1 --2- 172.21.15.46:0/71417863 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7f02c006ad10 0x7f02c006d1c0 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:51.141 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:51.139+0000 7f02e3b47700 1 --2- 172.21.15.46:0/71417863 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f02dc13f550 0x7f02dc0c8820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:51.142 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:51.139+0000 7f02e3b47700 1 --2- 172.21.15.46:0/71417863 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f02dc06c7c0 0x7f02dc0cad60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:51.142 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:51.139+0000 7f02e3b47700 1 --2- 172.21.15.46:0/71417863 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f02dc0b1640 0x7f02dc13e640 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:51.142 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:51.139+0000 7f02e3b47700 1 -- 172.21.15.46:0/71417863 >> 172.21.15.46:0/71417863 conn(0x7f02dc0cf9a0 msgr2=0x7f02dc15bd40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-05T18:56:51.142 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:51.139+0000 7f02e3b47700 1 -- 172.21.15.46:0/71417863 shutdown_connections 2023-07-05T18:56:51.142 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:51.139+0000 7f02e3b47700 1 -- 172.21.15.46:0/71417863 wait complete. 2023-07-05T18:56:51.152 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-07-05T18:56:51.283 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:51.279+0000 7fd0a4a6e700 1 Processor -- start 2023-07-05T18:56:51.284 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:51.279+0000 7fd0a4a6e700 1 -- start start 2023-07-05T18:56:51.284 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:51.280+0000 7fd0a4a6e700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fd0a00b13f0 0x7fd0a00b1870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:56:51.284 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:51.280+0000 7fd0a4a6e700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fd0a00c9fc0 0x7fd0a00ca3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:56:51.285 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:51.280+0000 7fd0a4a6e700 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd0a015e040 con 0x7fd0a01594f0 2023-07-05T18:56:51.285 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:51.280+0000 7fd0a4a6e700 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd0a00ce200 con 0x7fd0a00c9fc0 2023-07-05T18:56:51.285 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:51.280+0000 7fd0a4a6e700 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd0a00b1db0 con 0x7fd0a00b13f0 2023-07-05T18:56:51.285 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:51.280+0000 7fd09ed9d700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fd0a00c9fc0 0x7fd0a00ca3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:56:51.285 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:51.280+0000 7fd09ed9d700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fd0a00c9fc0 0x7fd0a00ca3f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:59028/0 (socket says 172.21.15.46:59028) 2023-07-05T18:56:51.285 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:51.280+0000 7fd09ed9d700 1 -- 172.21.15.46:0/158925055 learned_addr learned my addr 172.21.15.46:0/158925055 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-07-05T18:56:51.285 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:51.280+0000 7fd09dd9b700 1 --2- 172.21.15.46:0/158925055 >> v2:172.21.15.73:3300/0 conn(0x7fd0a00b13f0 0x7fd0a00b1870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:56:51.286 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:51.281+0000 7fd09ed9d700 1 -- 172.21.15.46:0/158925055 >> v2:172.21.15.73:3300/0 conn(0x7fd0a00b13f0 msgr2=0x7fd0a00b1870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-05T18:56:51.286 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:51.281+0000 7fd09ed9d700 1 --2- 172.21.15.46:0/158925055 >> v2:172.21.15.73:3300/0 conn(0x7fd0a00b13f0 0x7fd0a00b1870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:51.286 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:51.281+0000 7fd09ed9d700 1 -- 172.21.15.46:0/158925055 >> v1:172.21.15.73:6789/0 conn(0x7fd0a01594f0 legacy=0x7fd0a00cd690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:56:51.286 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:51.281+0000 7fd09ed9d700 1 -- 172.21.15.46:0/158925055 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd0a015dbb0 con 0x7fd0a00c9fc0 2023-07-05T18:56:51.286 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:51.281+0000 7fd09ed9d700 1 --2- 172.21.15.46:0/158925055 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd0a00c9fc0 0x7fd0a00ca3f0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7fd0a0066a40 tx=0x7fd09800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7b4d05d70e427bde server_cookie=0 in_seq=0 out_seq=0 2023-07-05T18:56:51.286 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:51.281+0000 7fd09d59a700 1 -- 172.21.15.46:0/158925055 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd09800e070 con 0x7fd0a00c9fc0 2023-07-05T18:56:51.286 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:51.281+0000 7fd09d59a700 1 -- 172.21.15.46:0/158925055 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd09800b9c0 con 0x7fd0a00c9fc0 2023-07-05T18:56:51.286 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:51.281+0000 7fd09d59a700 1 -- 172.21.15.46:0/158925055 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd09800bd70 con 0x7fd0a00c9fc0 2023-07-05T18:56:51.287 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:51.281+0000 7fd0a4a6e700 1 -- 172.21.15.46:0/158925055 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd0a00c9fc0 msgr2=0x7fd0a00ca3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:56:51.287 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:51.281+0000 7fd0a4a6e700 1 --2- 172.21.15.46:0/158925055 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd0a00c9fc0 0x7fd0a00ca3f0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7fd0a0066a40 tx=0x7fd09800b330 comp rx=0 tx=0).stop 2023-07-05T18:56:51.287 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:51.282+0000 7fd0a4a6e700 1 -- 172.21.15.46:0/158925055 shutdown_connections 2023-07-05T18:56:51.287 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:51.282+0000 7fd0a4a6e700 1 --2- 172.21.15.46:0/158925055 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd0a00c9fc0 0x7fd0a00ca3f0 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:51.287 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:51.282+0000 7fd0a4a6e700 1 --2- 172.21.15.46:0/158925055 >> v2:172.21.15.73:3300/0 conn(0x7fd0a00b13f0 0x7fd0a00b1870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:51.288 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:51.282+0000 7fd0a4a6e700 1 -- 172.21.15.46:0/158925055 >> 172.21.15.46:0/158925055 conn(0x7fd0a006bba0 msgr2=0x7fd0a00cc3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-05T18:56:51.288 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:51.282+0000 7fd0a4a6e700 1 -- 172.21.15.46:0/158925055 shutdown_connections 2023-07-05T18:56:51.288 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:51.282+0000 7fd0a4a6e700 1 -- 172.21.15.46:0/158925055 wait complete. 2023-07-05T18:56:51.291 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:51.283+0000 7fd0a4a6e700 1 Processor -- start 2023-07-05T18:56:51.291 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:51.283+0000 7fd0a4a6e700 1 -- start start 2023-07-05T18:56:51.291 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:51.284+0000 7fd0a4a6e700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd0a00b13f0 0x7fd0a00b4d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:56:51.292 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:51.284+0000 7fd0a4a6e700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fd0a00c9fc0 0x7fd0a00b52c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:56:51.292 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:51.284+0000 7fd0a4a6e700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd0a01594f0 0x7fd0a00c7420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:56:51.292 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:51.284+0000 7fd0a4a6e700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0a00b3a90 con 0x7fd0a01594f0 2023-07-05T18:56:51.292 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:51.284+0000 7fd0a4a6e700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0a00b3ce0 con 0x7fd0a00b13f0 2023-07-05T18:56:51.292 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:51.284+0000 7fd0a4a6e700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd0a00b3fc0 con 0x7fd0a00c9fc0 2023-07-05T18:56:51.292 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:51.284+0000 7fd09ed9d700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd0a01594f0 0x7fd0a00c7420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:56:51.292 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:51.284+0000 7fd09ed9d700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd0a01594f0 0x7fd0a00c7420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:59034/0 (socket says 172.21.15.46:59034) 2023-07-05T18:56:51.293 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:51.284+0000 7fd09ed9d700 1 -- 172.21.15.46:0/2253109202 learned_addr learned my addr 172.21.15.46:0/2253109202 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-07-05T18:56:51.293 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:51.284+0000 7fd09dd9b700 1 --2- 172.21.15.46:0/2253109202 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fd0a00c9fc0 0x7fd0a00b52c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:56:51.293 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:51.284+0000 7fd09e59c700 1 --2- 172.21.15.46:0/2253109202 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd0a00b13f0 0x7fd0a00b4d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:56:51.293 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:51.284+0000 7fd09ed9d700 1 -- 172.21.15.46:0/2253109202 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fd0a00c9fc0 msgr2=0x7fd0a00b52c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:56:51.293 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:51.284+0000 7fd09ed9d700 1 --2- 172.21.15.46:0/2253109202 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fd0a00c9fc0 0x7fd0a00b52c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:51.293 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:51.284+0000 7fd09ed9d700 1 -- 172.21.15.46:0/2253109202 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd0a00b13f0 msgr2=0x7fd0a00b4d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:56:51.294 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:51.284+0000 7fd09ed9d700 1 --2- 172.21.15.46:0/2253109202 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd0a00b13f0 0x7fd0a00b4d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:51.294 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:51.284+0000 7fd09ed9d700 1 -- 172.21.15.46:0/2253109202 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd098009b30 con 0x7fd0a01594f0 2023-07-05T18:56:51.294 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:51.284+0000 7fd09dd9b700 1 --2- 172.21.15.46:0/2253109202 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fd0a00c9fc0 0x7fd0a00b52c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-05T18:56:51.295 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:51.284+0000 7fd09ed9d700 1 --2- 172.21.15.46:0/2253109202 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd0a01594f0 0x7fd0a00c7420 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7fd0a0072540 tx=0x7fd098004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-05T18:56:51.295 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:51.284+0000 7fd08effd700 1 -- 172.21.15.46:0/2253109202 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0980099b0 con 0x7fd0a01594f0 2023-07-05T18:56:51.295 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:51.285+0000 7fd08effd700 1 -- 172.21.15.46:0/2253109202 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd0980092e0 con 0x7fd0a01594f0 2023-07-05T18:56:51.295 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:51.285+0000 7fd0a4a6e700 1 -- 172.21.15.46:0/2253109202 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd0a00b42a0 con 0x7fd0a01594f0 2023-07-05T18:56:51.296 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:51.285+0000 7fd08effd700 1 -- 172.21.15.46:0/2253109202 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd09801c640 con 0x7fd0a01594f0 2023-07-05T18:56:51.296 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:51.285+0000 7fd0a4a6e700 1 -- 172.21.15.46:0/2253109202 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd0a00b4860 con 0x7fd0a01594f0 2023-07-05T18:56:51.296 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:51.286+0000 7fd0a4a6e700 1 -- 172.21.15.46:0/2253109202 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd0a00672e0 con 0x7fd0a01594f0 2023-07-05T18:56:51.296 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:51.286+0000 7fd08effd700 1 -- 172.21.15.46:0/2253109202 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fd09801c7a0 con 0x7fd0a01594f0 2023-07-05T18:56:51.297 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:51.286+0000 7fd08effd700 1 --2- 172.21.15.46:0/2253109202 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7fd08006ace0 0x7fd08006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:56:51.297 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:51.286+0000 7fd08effd700 1 -- 172.21.15.46:0/2253109202 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fd09808b100 con 0x7fd0a01594f0 2023-07-05T18:56:51.297 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:51.287+0000 7fd09e59c700 1 --2- 172.21.15.46:0/2253109202 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7fd08006ace0 0x7fd08006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:56:51.298 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:51.287+0000 7fd09e59c700 1 --2- 172.21.15.46:0/2253109202 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7fd08006ace0 0x7fd08006d190 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fd094000f60 tx=0x7fd094009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-05T18:56:51.298 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:51.291+0000 7fd08effd700 1 -- 172.21.15.46:0/2253109202 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fd098056240 con 0x7fd0a01594f0 2023-07-05T18:56:51.452 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-05T18:56:51.456 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-05T18:56:51.490 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:51.488+0000 7fd0a4a6e700 1 -- 172.21.15.46:0/2253109202 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fd0a00cd210 con 0x7fd0a01594f0 2023-07-05T18:56:51.490 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:51.489+0000 7fd08effd700 1 -- 172.21.15.46:0/2253109202 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v21) v1 ==== 100+0+11 (secure 0 0 0) 0x7fd098059860 con 0x7fd0a01594f0 2023-07-05T18:56:51.491 INFO:teuthology.orchestra.run.smithi046.stdout:pg_num: 64 2023-07-05T18:56:51.495 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:51.491+0000 7fd0a4a6e700 1 -- 172.21.15.46:0/2253109202 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7fd08006ace0 msgr2=0x7fd08006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:56:51.495 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:51.491+0000 7fd0a4a6e700 1 --2- 172.21.15.46:0/2253109202 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7fd08006ace0 0x7fd08006d190 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fd094000f60 tx=0x7fd094009040 comp rx=0 tx=0).stop 2023-07-05T18:56:51.495 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:51.491+0000 7fd0a4a6e700 1 -- 172.21.15.46:0/2253109202 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd0a01594f0 msgr2=0x7fd0a00c7420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:56:51.496 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:51.491+0000 7fd0a4a6e700 1 --2- 172.21.15.46:0/2253109202 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd0a01594f0 0x7fd0a00c7420 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7fd0a0072540 tx=0x7fd098004ad0 comp rx=0 tx=0).stop 2023-07-05T18:56:51.496 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:51.491+0000 7fd0a4a6e700 1 -- 172.21.15.46:0/2253109202 shutdown_connections 2023-07-05T18:56:51.496 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:51.491+0000 7fd0a4a6e700 1 --2- 172.21.15.46:0/2253109202 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7fd08006ace0 0x7fd08006d190 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:51.496 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:51.491+0000 7fd0a4a6e700 1 --2- 172.21.15.46:0/2253109202 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd0a01594f0 0x7fd0a00c7420 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:51.497 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:51.491+0000 7fd0a4a6e700 1 --2- 172.21.15.46:0/2253109202 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd0a00b13f0 0x7fd0a00b4d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:51.497 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:51.491+0000 7fd0a4a6e700 1 --2- 172.21.15.46:0/2253109202 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fd0a00c9fc0 0x7fd0a00b52c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:51.497 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:51.491+0000 7fd0a4a6e700 1 -- 172.21.15.46:0/2253109202 >> 172.21.15.46:0/2253109202 conn(0x7fd0a006bba0 msgr2=0x7fd0a00b0ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-05T18:56:51.497 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:51.491+0000 7fd0a4a6e700 1 -- 172.21.15.46:0/2253109202 shutdown_connections 2023-07-05T18:56:51.497 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:51.491+0000 7fd0a4a6e700 1 -- 172.21.15.46:0/2253109202 wait complete. 2023-07-05T18:56:51.505 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-07-05T18:56:51.672 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:51.671+0000 7ffaf6d78700 1 Processor -- start 2023-07-05T18:56:51.672 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:51.671+0000 7ffaf6d78700 1 -- start start 2023-07-05T18:56:51.673 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:51.672+0000 7ffaf6d78700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7ffaf00af710 0x7ffaf00b00a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:56:51.674 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:51.672+0000 7ffaf6d78700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7ffaf00ae0d0 0x7ffaf00b05e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:56:51.675 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:51.672+0000 7ffaf6d78700 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffaf00af280 con 0x7ffaf00ce700 2023-07-05T18:56:51.675 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:51.672+0000 7ffaf6d78700 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffaf015a910 con 0x7ffaf00ae0d0 2023-07-05T18:56:51.675 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:51.672+0000 7ffaf6d78700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffaf00ae670 con 0x7ffaf00af710 2023-07-05T18:56:51.676 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:51.672+0000 7ffaeffff700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7ffaf00af710 0x7ffaf00b00a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:56:51.676 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:51.672+0000 7ffaf5315700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7ffaf00ae0d0 0x7ffaf00b05e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:56:51.676 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:51.672+0000 7ffaeffff700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7ffaf00af710 0x7ffaf00b00a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3301/0 says I am v2:172.21.15.46:42726/0 (socket says 172.21.15.46:42726) 2023-07-05T18:56:51.676 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:51.672+0000 7ffaeffff700 1 -- 172.21.15.46:0/3922327322 learned_addr learned my addr 172.21.15.46:0/3922327322 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-07-05T18:56:51.676 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:51.672+0000 7ffaf4b14700 1 --1- 172.21.15.46:0/3922327322 >> v1:172.21.15.73:6789/0 conn(0x7ffaf00ce700 0x7ffaf00cead0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.46:44226/0 (socket says 172.21.15.46:44226) 2023-07-05T18:56:51.676 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:51.672+0000 7ffaf5315700 1 -- 172.21.15.46:0/3922327322 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7ffaf00af710 msgr2=0x7ffaf00b00a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-05T18:56:51.676 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:51.672+0000 7ffaf5315700 1 --2- 172.21.15.46:0/3922327322 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7ffaf00af710 0x7ffaf00b00a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:51.677 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:51.672+0000 7ffaf5315700 1 -- 172.21.15.46:0/3922327322 >> v1:172.21.15.73:6789/0 conn(0x7ffaf00ce700 legacy=0x7ffaf00cead0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:56:51.677 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:51.672+0000 7ffaf5315700 1 -- 172.21.15.46:0/3922327322 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffaf00ae950 con 0x7ffaf00ae0d0 2023-07-05T18:56:51.677 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:51.672+0000 7ffaef7fe700 1 -- 172.21.15.46:0/3922327322 <== mon.1 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1190989247 0 0) 0x7ffaf00af280 con 0x7ffaf00ce700 2023-07-05T18:56:51.677 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:51.672+0000 7ffaeffff700 1 --2- 172.21.15.46:0/3922327322 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7ffaf00af710 0x7ffaf00b00a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-05T18:56:51.677 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:51.673+0000 7ffaf5315700 1 --2- 172.21.15.46:0/3922327322 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ffaf00ae0d0 0x7ffaf00b05e0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7ffae8009d90 tx=0x7ffae800b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=507fd0f42ce09bb3 server_cookie=0 in_seq=0 out_seq=0 2023-07-05T18:56:51.677 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:51.673+0000 7ffaef7fe700 1 -- 172.21.15.46:0/3922327322 <== mon.1 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffae800e070 con 0x7ffaf00ae0d0 2023-07-05T18:56:51.677 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:51.673+0000 7ffaef7fe700 1 -- 172.21.15.46:0/3922327322 <== mon.1 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffae800bb20 con 0x7ffaf00ae0d0 2023-07-05T18:56:51.678 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:51.673+0000 7ffaef7fe700 1 -- 172.21.15.46:0/3922327322 <== mon.1 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffae8012430 con 0x7ffaf00ae0d0 2023-07-05T18:56:51.679 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:51.673+0000 7ffaf6d78700 1 -- 172.21.15.46:0/3922327322 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ffaf00ae0d0 msgr2=0x7ffaf00b05e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:56:51.680 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:51.673+0000 7ffaf6d78700 1 --2- 172.21.15.46:0/3922327322 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ffaf00ae0d0 0x7ffaf00b05e0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7ffae8009d90 tx=0x7ffae800b330 comp rx=0 tx=0).stop 2023-07-05T18:56:51.681 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:51.673+0000 7ffaf6d78700 1 -- 172.21.15.46:0/3922327322 shutdown_connections 2023-07-05T18:56:51.681 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:51.673+0000 7ffaf6d78700 1 --2- 172.21.15.46:0/3922327322 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ffaf00ae0d0 0x7ffaf00b05e0 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:51.681 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:51.673+0000 7ffaf6d78700 1 --2- 172.21.15.46:0/3922327322 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7ffaf00af710 0x7ffaf00b00a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:51.681 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:51.673+0000 7ffaf6d78700 1 -- 172.21.15.46:0/3922327322 >> 172.21.15.46:0/3922327322 conn(0x7ffaf0099e00 msgr2=0x7ffaf00d0b30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-05T18:56:51.681 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:51.673+0000 7ffaf6d78700 1 -- 172.21.15.46:0/3922327322 shutdown_connections 2023-07-05T18:56:51.681 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:51.673+0000 7ffaf6d78700 1 -- 172.21.15.46:0/3922327322 wait complete. 2023-07-05T18:56:51.682 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:51.674+0000 7ffaf6d78700 1 Processor -- start 2023-07-05T18:56:51.682 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:51.675+0000 7ffaf6d78700 1 -- start start 2023-07-05T18:56:51.682 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:51.675+0000 7ffaf6d78700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7ffaf00ae0d0 0x7ffaf00c5fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:56:51.682 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:51.675+0000 7ffaf6d78700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ffaf00af710 0x7ffaf0149770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:56:51.682 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:51.675+0000 7ffaf6d78700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ffaf00ce700 0x7ffaf0149cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:56:51.682 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:51.675+0000 7ffaf6d78700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffaf01f5150 con 0x7ffaf00af710 2023-07-05T18:56:51.682 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:51.675+0000 7ffaf6d78700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffaf014a2e0 con 0x7ffaf00ce700 2023-07-05T18:56:51.682 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:51.675+0000 7ffaf6d78700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffaf014a5c0 con 0x7ffaf00ae0d0 2023-07-05T18:56:51.683 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:51.675+0000 7ffaeffff700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ffaf00af710 0x7ffaf0149770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:56:51.683 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:51.676+0000 7ffaf4b14700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7ffaf00ae0d0 0x7ffaf00c5fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:56:51.683 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:51.676+0000 7ffaeffff700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ffaf00af710 0x7ffaf0149770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:59046/0 (socket says 172.21.15.46:59046) 2023-07-05T18:56:51.683 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:51.676+0000 7ffaeffff700 1 -- 172.21.15.46:0/3971447301 learned_addr learned my addr 172.21.15.46:0/3971447301 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-07-05T18:56:51.683 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:51.676+0000 7ffaf5315700 1 --2- 172.21.15.46:0/3971447301 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ffaf00ce700 0x7ffaf0149cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:56:51.685 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:51.676+0000 7ffaeffff700 1 -- 172.21.15.46:0/3971447301 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7ffaf00ae0d0 msgr2=0x7ffaf00c5fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:56:51.686 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:51.676+0000 7ffaeffff700 1 --2- 172.21.15.46:0/3971447301 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7ffaf00ae0d0 0x7ffaf00c5fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:51.686 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:51.676+0000 7ffaeffff700 1 -- 172.21.15.46:0/3971447301 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ffaf00ce700 msgr2=0x7ffaf0149cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:56:51.687 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:51.676+0000 7ffaeffff700 1 --2- 172.21.15.46:0/3971447301 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ffaf00ce700 0x7ffaf0149cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:51.687 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:51.676+0000 7ffaeffff700 1 -- 172.21.15.46:0/3971447301 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffadc009550 con 0x7ffaf00af710 2023-07-05T18:56:51.687 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:51.676+0000 7ffaeffff700 1 --2- 172.21.15.46:0/3971447301 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ffaf00af710 0x7ffaf0149770 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7ffadc00ebb0 tx=0x7ffadc00eec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-05T18:56:51.687 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:51.676+0000 7ffaed7fa700 1 -- 172.21.15.46:0/3971447301 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffadc00c850 con 0x7ffaf00af710 2023-07-05T18:56:51.688 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:51.676+0000 7ffaed7fa700 1 -- 172.21.15.46:0/3971447301 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffadc00c9b0 con 0x7ffaf00af710 2023-07-05T18:56:51.688 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:51.676+0000 7ffaed7fa700 1 -- 172.21.15.46:0/3971447301 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffadc00cd40 con 0x7ffaf00af710 2023-07-05T18:56:51.688 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:51.676+0000 7ffaf6d78700 1 -- 172.21.15.46:0/3971447301 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffae8009a70 con 0x7ffaf00af710 2023-07-05T18:56:51.689 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:51.676+0000 7ffaf6d78700 1 -- 172.21.15.46:0/3971447301 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffaf014ab80 con 0x7ffaf00af710 2023-07-05T18:56:51.689 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:51.677+0000 7ffaf6d78700 1 -- 172.21.15.46:0/3971447301 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffaf00672e0 con 0x7ffaf00af710 2023-07-05T18:56:51.689 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:51.678+0000 7ffaed7fa700 1 -- 172.21.15.46:0/3971447301 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7ffadc013470 con 0x7ffaf00af710 2023-07-05T18:56:51.689 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:51.678+0000 7ffaed7fa700 1 --2- 172.21.15.46:0/3971447301 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7ffad406ace0 0x7ffad406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:56:51.689 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:51.678+0000 7ffaed7fa700 1 -- 172.21.15.46:0/3971447301 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6062+0+0 (secure 0 0 0) 0x7ffadc089500 con 0x7ffaf00af710 2023-07-05T18:56:51.689 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:51.678+0000 7ffaf4b14700 1 --2- 172.21.15.46:0/3971447301 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7ffad406ace0 0x7ffad406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:56:51.690 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:51.679+0000 7ffaf4b14700 1 --2- 172.21.15.46:0/3971447301 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7ffad406ace0 0x7ffad406d190 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7ffae4007fd0 tx=0x7ffae4007de0 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-05T18:56:51.690 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:51.682+0000 7ffaed7fa700 1 -- 172.21.15.46:0/3971447301 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7ffadc054640 con 0x7ffaf00af710 2023-07-05T18:56:51.896 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:51.895+0000 7ffaf6d78700 1 -- 172.21.15.46:0/3971447301 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7ffaf00b0740 con 0x7ffaf00af710 2023-07-05T18:56:51.897 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:51.895+0000 7ffaed7fa700 1 -- 172.21.15.46:0/3971447301 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v21) v1 ==== 80+0+0 (secure 0 0 0) 0x7ffadc057c60 con 0x7ffaf00af710 2023-07-05T18:56:51.900 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:51.897+0000 7ffaf6d78700 1 -- 172.21.15.46:0/3971447301 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7ffad406ace0 msgr2=0x7ffad406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:56:51.901 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:51.897+0000 7ffaf6d78700 1 --2- 172.21.15.46:0/3971447301 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7ffad406ace0 0x7ffad406d190 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7ffae4007fd0 tx=0x7ffae4007de0 comp rx=0 tx=0).stop 2023-07-05T18:56:51.901 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:51.897+0000 7ffaf6d78700 1 -- 172.21.15.46:0/3971447301 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ffaf00af710 msgr2=0x7ffaf0149770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:56:51.901 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:51.897+0000 7ffaf6d78700 1 --2- 172.21.15.46:0/3971447301 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ffaf00af710 0x7ffaf0149770 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7ffadc00ebb0 tx=0x7ffadc00eec0 comp rx=0 tx=0).stop 2023-07-05T18:56:51.901 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:51.898+0000 7ffaf6d78700 1 -- 172.21.15.46:0/3971447301 shutdown_connections 2023-07-05T18:56:51.902 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:51.898+0000 7ffaf6d78700 1 --2- 172.21.15.46:0/3971447301 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7ffad406ace0 0x7ffad406d190 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:51.902 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:51.898+0000 7ffaf6d78700 1 --2- 172.21.15.46:0/3971447301 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ffaf00ce700 0x7ffaf0149cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:51.903 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:51.898+0000 7ffaf6d78700 1 --2- 172.21.15.46:0/3971447301 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7ffaf00ae0d0 0x7ffaf00c5fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:51.903 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:51.898+0000 7ffaf6d78700 1 --2- 172.21.15.46:0/3971447301 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ffaf00af710 0x7ffaf0149770 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:51.903 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:51.898+0000 7ffaf6d78700 1 -- 172.21.15.46:0/3971447301 >> 172.21.15.46:0/3971447301 conn(0x7ffaf0099e00 msgr2=0x7ffaf006eee0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-05T18:56:51.903 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:51.898+0000 7ffaf6d78700 1 -- 172.21.15.46:0/3971447301 shutdown_connections 2023-07-05T18:56:51.903 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:51.898+0000 7ffaf6d78700 1 -- 172.21.15.46:0/3971447301 wait complete. 2023-07-05T18:56:51.903 INFO:teuthology.orchestra.run.smithi046.stderr:listed 0 entries 2023-07-05T18:56:51.910 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2023-07-05T18:56:51.911 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-05T18:56:51.911 DEBUG:teuthology.orchestra.run.smithi046:> sudo umount /home/ubuntu/cephtest/mnt.0 -f 2023-07-05T18:56:51.973 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi046.front.sepia.ceph.com 2023-07-05T18:56:51.974 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-05T18:56:51.974 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-07-05T18:56:51.998 DEBUG:teuthology.orchestra.run.smithi073:> set -ex 2023-07-05T18:56:51.999 DEBUG:teuthology.orchestra.run.smithi073:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-05T18:56:52.020 DEBUG:teuthology.orchestra.run.smithi073:> set -ex 2023-07-05T18:56:52.020 DEBUG:teuthology.orchestra.run.smithi073:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-05T18:56:52.079 DEBUG:teuthology.orchestra.run.smithi073:> set -ex 2023-07-05T18:56:52.079 DEBUG:teuthology.orchestra.run.smithi073:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-05T18:56:52.139 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-05T18:56:52.265 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:52.264+0000 7fbe78850700 1 Processor -- start 2023-07-05T18:56:52.265 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:52.264+0000 7fbe78850700 1 -- start start 2023-07-05T18:56:52.267 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:52.265+0000 7fbe78850700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fbe740aef40 0x7fbe740b3530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:56:52.267 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:52.265+0000 7fbe78850700 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbe740b30a0 con 0x7fbe7415d190 2023-07-05T18:56:52.267 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:52.265+0000 7fbe78850700 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbe7406ca80 con 0x7fbe74069e00 2023-07-05T18:56:52.267 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:52.265+0000 7fbe78850700 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbe7415d940 con 0x7fbe740aef40 2023-07-05T18:56:52.267 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:52.265+0000 7fbe7259c700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fbe740aef40 0x7fbe740b3530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:56:52.267 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:52.265+0000 7fbe72d9d700 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7fbe7415d190 0x7fbe74152c10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:58328/0 (socket says 172.21.15.46:58328) 2023-07-05T18:56:52.267 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:52.265+0000 7fbe72d9d700 1 -- 172.21.15.46:0/304198310 learned_addr learned my addr 172.21.15.46:0/304198310 (peer_addr_for_me v1:172.21.15.46:0/0) 2023-07-05T18:56:52.268 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:52.266+0000 7fbe7259c700 1 -- 172.21.15.46:0/304198310 >> v1:172.21.15.73:6789/0 conn(0x7fbe74069e00 legacy=0x7fbe7415ca80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-05T18:56:52.268 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:52.266+0000 7fbe7259c700 1 -- 172.21.15.46:0/304198310 >> v1:172.21.15.46:6789/0 conn(0x7fbe7415d190 legacy=0x7fbe74152c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:56:52.268 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:52.266+0000 7fbe7159a700 1 -- 172.21.15.46:0/304198310 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2960969047 0 0) 0x7fbe740b30a0 con 0x7fbe7415d190 2023-07-05T18:56:52.268 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:52.266+0000 7fbe7259c700 1 -- 172.21.15.46:0/304198310 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbe7415d660 con 0x7fbe740aef40 2023-07-05T18:56:52.268 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:52.266+0000 7fbe7259c700 1 --2- 172.21.15.46:0/304198310 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fbe740aef40 0x7fbe740b3530 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7fbe68009840 tx=0x7fbe68009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e6123c8b56445f4f server_cookie=0 in_seq=0 out_seq=0 2023-07-05T18:56:52.268 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:52.266+0000 7fbe7159a700 1 -- 172.21.15.46:0/304198310 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe68004230 con 0x7fbe740aef40 2023-07-05T18:56:52.269 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:52.266+0000 7fbe7159a700 1 -- 172.21.15.46:0/304198310 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbe68004390 con 0x7fbe740aef40 2023-07-05T18:56:52.270 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:52.266+0000 7fbe7159a700 1 -- 172.21.15.46:0/304198310 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe680036a0 con 0x7fbe740aef40 2023-07-05T18:56:52.272 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:52.266+0000 7fbe78850700 1 -- 172.21.15.46:0/304198310 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fbe740aef40 msgr2=0x7fbe740b3530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:56:52.272 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:52.266+0000 7fbe78850700 1 --2- 172.21.15.46:0/304198310 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fbe740aef40 0x7fbe740b3530 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7fbe68009840 tx=0x7fbe68009b50 comp rx=0 tx=0).stop 2023-07-05T18:56:52.273 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:52.267+0000 7fbe78850700 1 -- 172.21.15.46:0/304198310 shutdown_connections 2023-07-05T18:56:52.273 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:52.267+0000 7fbe78850700 1 --2- 172.21.15.46:0/304198310 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fbe740aef40 0x7fbe740b3530 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:52.273 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:52.267+0000 7fbe78850700 1 -- 172.21.15.46:0/304198310 >> 172.21.15.46:0/304198310 conn(0x7fbe7406af10 msgr2=0x7fbe7406b2e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-05T18:56:52.273 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:52.267+0000 7fbe78850700 1 -- 172.21.15.46:0/304198310 shutdown_connections 2023-07-05T18:56:52.273 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:52.267+0000 7fbe78850700 1 -- 172.21.15.46:0/304198310 wait complete. 2023-07-05T18:56:52.274 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:52.268+0000 7fbe78850700 1 Processor -- start 2023-07-05T18:56:52.274 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:52.268+0000 7fbe78850700 1 -- start start 2023-07-05T18:56:52.275 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:52.269+0000 7fbe78850700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fbe74069e00 0x7fbe741474d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:56:52.275 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:52.269+0000 7fbe78850700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fbe740aef40 0x7fbe740cff00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:56:52.275 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:52.269+0000 7fbe78850700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fbe7415d190 0x7fbe740cdee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:56:52.275 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:52.269+0000 7fbe78850700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe741e8210 con 0x7fbe740aef40 2023-07-05T18:56:52.275 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:52.269+0000 7fbe78850700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe740cd420 con 0x7fbe7415d190 2023-07-05T18:56:52.275 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:52.269+0000 7fbe78850700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbe740cce60 con 0x7fbe74069e00 2023-07-05T18:56:52.275 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:52.269+0000 7fbe71d9b700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fbe740aef40 0x7fbe740cff00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:56:52.276 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:52.269+0000 7fbe71d9b700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fbe740aef40 0x7fbe740cff00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:59060/0 (socket says 172.21.15.46:59060) 2023-07-05T18:56:52.276 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:52.269+0000 7fbe71d9b700 1 -- 172.21.15.46:0/463567446 learned_addr learned my addr 172.21.15.46:0/463567446 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-07-05T18:56:52.276 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:52.269+0000 7fbe7259c700 1 --2- 172.21.15.46:0/463567446 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fbe74069e00 0x7fbe741474d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:56:52.276 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:52.269+0000 7fbe72d9d700 1 --2- 172.21.15.46:0/463567446 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fbe7415d190 0x7fbe740cdee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:56:52.276 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:52.269+0000 7fbe71d9b700 1 -- 172.21.15.46:0/463567446 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fbe74069e00 msgr2=0x7fbe741474d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:56:52.276 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:52.269+0000 7fbe71d9b700 1 --2- 172.21.15.46:0/463567446 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fbe74069e00 0x7fbe741474d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:52.276 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:52.269+0000 7fbe71d9b700 1 -- 172.21.15.46:0/463567446 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fbe7415d190 msgr2=0x7fbe740cdee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:56:52.277 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:52.269+0000 7fbe71d9b700 1 --2- 172.21.15.46:0/463567446 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fbe7415d190 0x7fbe740cdee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:52.277 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:52.269+0000 7fbe71d9b700 1 -- 172.21.15.46:0/463567446 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbe680094a0 con 0x7fbe740aef40 2023-07-05T18:56:52.277 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:52.269+0000 7fbe71d9b700 1 --2- 172.21.15.46:0/463567446 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fbe740aef40 0x7fbe740cff00 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7fbe6400c500 tx=0x7fbe6400c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-05T18:56:52.277 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:52.269+0000 7fbe62ffd700 1 -- 172.21.15.46:0/463567446 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe64011790 con 0x7fbe740aef40 2023-07-05T18:56:52.277 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:52.269+0000 7fbe62ffd700 1 -- 172.21.15.46:0/463567446 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbe640118f0 con 0x7fbe740aef40 2023-07-05T18:56:52.277 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:52.269+0000 7fbe78850700 1 -- 172.21.15.46:0/463567446 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbe740cd140 con 0x7fbe740aef40 2023-07-05T18:56:52.277 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:52.269+0000 7fbe62ffd700 1 -- 172.21.15.46:0/463567446 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe64011ca0 con 0x7fbe740aef40 2023-07-05T18:56:52.278 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:52.270+0000 7fbe78850700 1 -- 172.21.15.46:0/463567446 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbe741e5b40 con 0x7fbe740aef40 2023-07-05T18:56:52.278 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:52.271+0000 7fbe78850700 1 -- 172.21.15.46:0/463567446 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbe740cc220 con 0x7fbe740aef40 2023-07-05T18:56:52.278 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:52.271+0000 7fbe62ffd700 1 -- 172.21.15.46:0/463567446 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fbe6401c460 con 0x7fbe740aef40 2023-07-05T18:56:52.278 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:52.271+0000 7fbe62ffd700 1 --2- 172.21.15.46:0/463567446 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7fbe5406ace0 0x7fbe5406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:56:52.278 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:52.271+0000 7fbe62ffd700 1 -- 172.21.15.46:0/463567446 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fbe64089250 con 0x7fbe740aef40 2023-07-05T18:56:52.278 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:52.272+0000 7fbe7259c700 1 --2- 172.21.15.46:0/463567446 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7fbe5406ace0 0x7fbe5406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:56:52.279 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:52.272+0000 7fbe7259c700 1 --2- 172.21.15.46:0/463567446 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7fbe5406ace0 0x7fbe5406d190 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fbe741e7cc0 tx=0x7fbe68008030 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-05T18:56:52.279 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:52.276+0000 7fbe62ffd700 1 -- 172.21.15.46:0/463567446 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fbe64054390 con 0x7fbe740aef40 2023-07-05T18:56:52.477 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:52.477+0000 7fbe78850700 1 -- 172.21.15.46:0/463567446 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fbe741e83c0 con 0x7fbe740aef40 2023-07-05T18:56:52.479 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:52.478+0000 7fbe62ffd700 1 -- 172.21.15.46:0/463567446 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) v1 ==== 74+0+18161 (secure 0 0 0) 0x7fbe741e83c0 con 0x7fbe740aef40 2023-07-05T18:56:52.479 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T18:56:52.479 INFO:teuthology.orchestra.run.smithi046.stdout:{"epoch":21,"fsid":"042652d3-d80c-4ad8-9366-3e94f2a0a512","created":"2023-07-05T18:55:56.455710+0000","modified":"2023-07-05T18:56:16.095672+0000","last_up_change":"2023-07-05T18:56:06.594022+0000","last_in_change":"2023-07-05T18:55:58.879340+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-07-05T18:56:07.729620+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2023-07-05T18:56:08.128122+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-07-05T18:56:12.954625+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-07-05T18:56:14.068396+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"20009183-9a47-4392-8751-883f88d2bfb1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6813","nonce":4151971443},{"type":"v1","addr":"172.21.15.46:6815","nonce":4151971443}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6817","nonce":4151971443},{"type":"v1","addr":"172.21.15.46:6818","nonce":4151971443}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6822","nonce":4151971443},{"type":"v1","addr":"172.21.15.46:6823","nonce":4151971443}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6820","nonce":4151971443},{"type":"v1","addr":"172.21.15.46:6821","nonce":4151971443}]},"public_addr":"172.21.15.46:6815/4151971443","cluster_addr":"172.21.15.46:6818/4151971443","heartbeat_back_addr":"172.21.15.46:6823/4151971443","heartbeat_front_addr":"172.21.15.46:6821/4151971443","state":["exists","up"]},{"osd":1,"uuid":"91b4a7b0-e4e4-4888-a1fe-9edb0d68004c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6808","nonce":502575881},{"type":"v1","addr":"172.21.15.46:6809","nonce":502575881}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6810","nonce":502575881},{"type":"v1","addr":"172.21.15.46:6811","nonce":502575881}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6816","nonce":502575881},{"type":"v1","addr":"172.21.15.46:6819","nonce":502575881}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6812","nonce":502575881},{"type":"v1","addr":"172.21.15.46:6814","nonce":502575881}]},"public_addr":"172.21.15.46:6809/502575881","cluster_addr":"172.21.15.46:6811/502575881","heartbeat_back_addr":"172.21.15.46:6819/502575881","heartbeat_front_addr":"172.21.15.46:6814/502575881","state":["exists","up"]},{"osd":2,"uuid":"669ff744-1331-47c5-8579-0440731c889a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6800","nonce":2115251461},{"type":"v1","addr":"172.21.15.46:6801","nonce":2115251461}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6802","nonce":2115251461},{"type":"v1","addr":"172.21.15.46:6803","nonce":2115251461}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6806","nonce":2115251461},{"type":"v1","addr":"172.21.15.46:6807","nonce":2115251461}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6804","nonce":2115251461},{"type":"v1","addr":"172.21.15.46:6805","nonce":2115251461}]},"public_addr":"172.21.15.46:6801/2115251461","cluster_addr":"172.21.15.46:6803/2115251461","heartbeat_back_addr":"172.21.15.46:6807/2115251461","heartbeat_front_addr":"172.21.15.46:6805/2115251461","state":["exists","up"]},{"osd":3,"uuid":"34e1b86d-ffad-415d-861c-07a5f08068a6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6824","nonce":2981388766},{"type":"v1","addr":"172.21.15.46:6825","nonce":2981388766}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6826","nonce":2981388766},{"type":"v1","addr":"172.21.15.46:6827","nonce":2981388766}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6830","nonce":2981388766},{"type":"v1","addr":"172.21.15.46:6831","nonce":2981388766}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6828","nonce":2981388766},{"type":"v1","addr":"172.21.15.46:6829","nonce":2981388766}]},"public_addr":"172.21.15.46:6825/2981388766","cluster_addr":"172.21.15.46:6827/2981388766","heartbeat_back_addr":"172.21.15.46:6831/2981388766","heartbeat_front_addr":"172.21.15.46:6829/2981388766","state":["exists","up"]},{"osd":4,"uuid":"57ffcb91-c7dc-4a69-ae71-4d9622a14a05","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6800","nonce":2083655348},{"type":"v1","addr":"172.21.15.73:6801","nonce":2083655348}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6802","nonce":2083655348},{"type":"v1","addr":"172.21.15.73:6803","nonce":2083655348}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6806","nonce":2083655348},{"type":"v1","addr":"172.21.15.73:6807","nonce":2083655348}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6804","nonce":2083655348},{"type":"v1","addr":"172.21.15.73:6805","nonce":2083655348}]},"public_addr":"172.21.15.73:6801/2083655348","cluster_addr":"172.21.15.73:6803/2083655348","heartbeat_back_addr":"172.21.15.73:6807/2083655348","heartbeat_front_addr":"172.21.15.73:6805/2083655348","state":["exists","up"]},{"osd":5,"uuid":"665f41c9-ee20-49cf-bf0e-fbe0c03d3aed","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6824","nonce":2803788401},{"type":"v1","addr":"172.21.15.73:6825","nonce":2803788401}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6826","nonce":2803788401},{"type":"v1","addr":"172.21.15.73:6827","nonce":2803788401}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6830","nonce":2803788401},{"type":"v1","addr":"172.21.15.73:6831","nonce":2803788401}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6828","nonce":2803788401},{"type":"v1","addr":"172.21.15.73:6829","nonce":2803788401}]},"public_addr":"172.21.15.73:6825/2803788401","cluster_addr":"172.21.15.73:6827/2803788401","heartbeat_back_addr":"172.21.15.73:6831/2803788401","heartbeat_front_addr":"172.21.15.73:6829/2803788401","state":["exists","up"]},{"osd":6,"uuid":"5790c6cc-bd56-4ce4-9a7c-0f0c3b59215c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6808","nonce":974108383},{"type":"v1","addr":"172.21.15.73:6809","nonce":974108383}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6810","nonce":974108383},{"type":"v1","addr":"172.21.15.73:6811","nonce":974108383}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6815","nonce":974108383},{"type":"v1","addr":"172.21.15.73:6817","nonce":974108383}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6812","nonce":974108383},{"type":"v1","addr":"172.21.15.73:6813","nonce":974108383}]},"public_addr":"172.21.15.73:6809/974108383","cluster_addr":"172.21.15.73:6811/974108383","heartbeat_back_addr":"172.21.15.73:6817/974108383","heartbeat_front_addr":"172.21.15.73:6813/974108383","state":["exists","up"]},{"osd":7,"uuid":"b66f4d2e-147e-4c9b-97dd-cbd59d33802e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6814","nonce":3772673248},{"type":"v1","addr":"172.21.15.73:6816","nonce":3772673248}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6818","nonce":3772673248},{"type":"v1","addr":"172.21.15.73:6819","nonce":3772673248}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6822","nonce":3772673248},{"type":"v1","addr":"172.21.15.73:6823","nonce":3772673248}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6820","nonce":3772673248},{"type":"v1","addr":"172.21.15.73:6821","nonce":3772673248}]},"public_addr":"172.21.15.73:6816/3772673248","cluster_addr":"172.21.15.73:6819/3772673248","heartbeat_back_addr":"172.21.15.73:6823/3772673248","heartbeat_front_addr":"172.21.15.73:6821/3772673248","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-05T18:56:04.115334+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-05T18:56:04.071250+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-05T18:56:04.044387+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-05T18:56:04.085389+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-05T18:56:04.090726+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-05T18:56:04.074529+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-05T18:56:04.058841+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-05T18:56:04.043054+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-05T18:56:52.485 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:52.480+0000 7fbe78850700 1 -- 172.21.15.46:0/463567446 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7fbe5406ace0 msgr2=0x7fbe5406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:56:52.485 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:52.480+0000 7fbe78850700 1 --2- 172.21.15.46:0/463567446 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7fbe5406ace0 0x7fbe5406d190 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fbe741e7cc0 tx=0x7fbe68008030 comp rx=0 tx=0).stop 2023-07-05T18:56:52.485 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:52.480+0000 7fbe78850700 1 -- 172.21.15.46:0/463567446 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fbe740aef40 msgr2=0x7fbe740cff00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:56:52.485 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:52.480+0000 7fbe78850700 1 --2- 172.21.15.46:0/463567446 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fbe740aef40 0x7fbe740cff00 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7fbe6400c500 tx=0x7fbe6400c8c0 comp rx=0 tx=0).stop 2023-07-05T18:56:52.486 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:52.480+0000 7fbe78850700 1 -- 172.21.15.46:0/463567446 shutdown_connections 2023-07-05T18:56:52.486 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:52.480+0000 7fbe78850700 1 --2- 172.21.15.46:0/463567446 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7fbe5406ace0 0x7fbe5406d190 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:52.486 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:52.480+0000 7fbe78850700 1 --2- 172.21.15.46:0/463567446 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fbe7415d190 0x7fbe740cdee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:52.486 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:52.480+0000 7fbe78850700 1 --2- 172.21.15.46:0/463567446 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fbe74069e00 0x7fbe741474d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:52.486 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:52.480+0000 7fbe78850700 1 --2- 172.21.15.46:0/463567446 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fbe740aef40 0x7fbe740cff00 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:52.486 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:52.480+0000 7fbe78850700 1 -- 172.21.15.46:0/463567446 >> 172.21.15.46:0/463567446 conn(0x7fbe7406af10 msgr2=0x7fbe740ad580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-05T18:56:52.486 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:52.480+0000 7fbe78850700 1 -- 172.21.15.46:0/463567446 shutdown_connections 2023-07-05T18:56:52.486 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:52.480+0000 7fbe78850700 1 -- 172.21.15.46:0/463567446 wait complete. 2023-07-05T18:56:52.493 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'rbd', 'create_time': '2023-07-05T18:56:07.729620+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': '.mgr', 'create_time': '2023-07-05T18:56:08.128122+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-07-05T18:56:12.954625+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-07-05T18:56:14.068396+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-07-05T18:56:52.494 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-07-05T18:56:52.623 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:52.622+0000 7ff20baa6700 1 Processor -- start 2023-07-05T18:56:52.623 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:52.622+0000 7ff20baa6700 1 -- start start 2023-07-05T18:56:52.624 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:52.623+0000 7ff20baa6700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7ff20415c860 0x7ff204160ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:56:52.625 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:52.623+0000 7ff20baa6700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7ff2040715c0 0x7ff204069e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:56:52.625 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:52.623+0000 7ff20baa6700 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff2040ce640 con 0x7ff20406a340 2023-07-05T18:56:52.625 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:52.623+0000 7ff20baa6700 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff2041611e0 con 0x7ff20415c860 2023-07-05T18:56:52.625 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:52.623+0000 7ff20baa6700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff2040ce870 con 0x7ff2040715c0 2023-07-05T18:56:52.625 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:52.623+0000 7ff209041700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7ff2040715c0 0x7ff204069e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:56:52.625 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:52.623+0000 7ff209842700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7ff20415c860 0x7ff204160ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:56:52.625 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:52.623+0000 7ff209041700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7ff2040715c0 0x7ff204069e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3301/0 says I am v2:172.21.15.46:42752/0 (socket says 172.21.15.46:42752) 2023-07-05T18:56:52.626 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:52.623+0000 7ff20a043700 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7ff20406a340 0x7ff2040b13f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.46:44258/0 (socket says 172.21.15.46:44258) 2023-07-05T18:56:52.626 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:52.623+0000 7ff209041700 1 -- 172.21.15.46:0/2347280098 learned_addr learned my addr 172.21.15.46:0/2347280098 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-07-05T18:56:52.626 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:52.624+0000 7ff209041700 1 -- 172.21.15.46:0/2347280098 >> v2:172.21.15.73:3300/0 conn(0x7ff20415c860 msgr2=0x7ff204160ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-05T18:56:52.626 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:52.624+0000 7ff209041700 1 --2- 172.21.15.46:0/2347280098 >> v2:172.21.15.73:3300/0 conn(0x7ff20415c860 0x7ff204160ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:52.626 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:52.624+0000 7ff209041700 1 -- 172.21.15.46:0/2347280098 >> v1:172.21.15.73:6789/0 conn(0x7ff20406a340 legacy=0x7ff2040b13f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:56:52.626 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:52.624+0000 7ff209041700 1 -- 172.21.15.46:0/2347280098 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff20406a7a0 con 0x7ff2040715c0 2023-07-05T18:56:52.626 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:52.624+0000 7ff209842700 1 --2- 172.21.15.46:0/2347280098 >> v2:172.21.15.73:3300/0 conn(0x7ff20415c860 0x7ff204160ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-05T18:56:52.629 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:52.624+0000 7ff209041700 1 --2- 172.21.15.46:0/2347280098 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7ff2040715c0 0x7ff204069e00 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7ff2000098f0 tx=0x7ff200009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=78f9a105b5906212 server_cookie=0 in_seq=0 out_seq=0 2023-07-05T18:56:52.629 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:52.624+0000 7ff208840700 1 -- 172.21.15.46:0/2347280098 <== mon.2 v2:172.21.15.73:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff200011830 con 0x7ff2040715c0 2023-07-05T18:56:52.629 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:52.624+0000 7ff208840700 1 -- 172.21.15.46:0/2347280098 <== mon.2 v2:172.21.15.73:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff200011990 con 0x7ff2040715c0 2023-07-05T18:56:52.629 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:52.624+0000 7ff208840700 1 -- 172.21.15.46:0/2347280098 <== mon.2 v2:172.21.15.73:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff200011d20 con 0x7ff2040715c0 2023-07-05T18:56:52.629 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:52.625+0000 7ff20baa6700 1 -- 172.21.15.46:0/2347280098 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7ff2040715c0 msgr2=0x7ff204069e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:56:52.630 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:52.625+0000 7ff20baa6700 1 --2- 172.21.15.46:0/2347280098 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7ff2040715c0 0x7ff204069e00 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7ff2000098f0 tx=0x7ff200009c00 comp rx=0 tx=0).stop 2023-07-05T18:56:52.630 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:52.625+0000 7ff20baa6700 1 -- 172.21.15.46:0/2347280098 shutdown_connections 2023-07-05T18:56:52.630 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:52.625+0000 7ff20baa6700 1 --2- 172.21.15.46:0/2347280098 >> v2:172.21.15.73:3300/0 conn(0x7ff20415c860 0x7ff204160ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:52.630 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:52.625+0000 7ff20baa6700 1 --2- 172.21.15.46:0/2347280098 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7ff2040715c0 0x7ff204069e00 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:52.630 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:52.625+0000 7ff20baa6700 1 -- 172.21.15.46:0/2347280098 >> 172.21.15.46:0/2347280098 conn(0x7ff20406bba0 msgr2=0x7ff2040cc3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-05T18:56:52.631 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:52.625+0000 7ff20baa6700 1 -- 172.21.15.46:0/2347280098 shutdown_connections 2023-07-05T18:56:52.631 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:52.625+0000 7ff20baa6700 1 -- 172.21.15.46:0/2347280098 wait complete. 2023-07-05T18:56:52.631 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:52.626+0000 7ff20baa6700 1 Processor -- start 2023-07-05T18:56:52.631 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:52.626+0000 7ff20baa6700 1 -- start start 2023-07-05T18:56:52.631 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:52.627+0000 7ff20baa6700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7ff20406a340 0x7ff20415e7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:56:52.632 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:52.627+0000 7ff20baa6700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff2040715c0 0x7ff2040b0230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:56:52.632 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:52.627+0000 7ff20baa6700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff20415c860 0x7ff204149d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:56:52.632 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:52.627+0000 7ff20baa6700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff20415f9b0 con 0x7ff2040715c0 2023-07-05T18:56:52.632 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:52.627+0000 7ff20baa6700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2040aedc0 con 0x7ff20415c860 2023-07-05T18:56:52.632 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:52.627+0000 7ff20baa6700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff20415eda0 con 0x7ff20406a340 2023-07-05T18:56:52.632 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:52.627+0000 7ff209041700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff2040715c0 0x7ff2040b0230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:56:52.632 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:52.627+0000 7ff209041700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff2040715c0 0x7ff2040b0230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:59074/0 (socket says 172.21.15.46:59074) 2023-07-05T18:56:52.633 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:52.627+0000 7ff209041700 1 -- 172.21.15.46:0/3048612088 learned_addr learned my addr 172.21.15.46:0/3048612088 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-07-05T18:56:52.633 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:52.627+0000 7ff20a043700 1 --2- 172.21.15.46:0/3048612088 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff20415c860 0x7ff204149d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:56:52.633 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:52.627+0000 7ff209842700 1 --2- 172.21.15.46:0/3048612088 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7ff20406a340 0x7ff20415e7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:56:52.633 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:52.627+0000 7ff209041700 1 -- 172.21.15.46:0/3048612088 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7ff20406a340 msgr2=0x7ff20415e7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:56:52.634 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:52.627+0000 7ff209041700 1 --2- 172.21.15.46:0/3048612088 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7ff20406a340 0x7ff20415e7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:52.634 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:52.627+0000 7ff209041700 1 -- 172.21.15.46:0/3048612088 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff20415c860 msgr2=0x7ff204149d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:56:52.634 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:52.627+0000 7ff209041700 1 --2- 172.21.15.46:0/3048612088 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff20415c860 0x7ff204149d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:52.634 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:52.627+0000 7ff209041700 1 -- 172.21.15.46:0/3048612088 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff1f40094a0 con 0x7ff2040715c0 2023-07-05T18:56:52.634 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:52.627+0000 7ff209041700 1 --2- 172.21.15.46:0/3048612088 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff2040715c0 0x7ff2040b0230 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7ff200000c00 tx=0x7ff200004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-05T18:56:52.634 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:52.628+0000 7ff1fa7fc700 1 -- 172.21.15.46:0/3048612088 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff200004570 con 0x7ff2040715c0 2023-07-05T18:56:52.634 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:52.628+0000 7ff1fa7fc700 1 -- 172.21.15.46:0/3048612088 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff20001f070 con 0x7ff2040715c0 2023-07-05T18:56:52.635 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:52.628+0000 7ff20baa6700 1 -- 172.21.15.46:0/3048612088 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff200009550 con 0x7ff2040715c0 2023-07-05T18:56:52.635 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:52.628+0000 7ff1fa7fc700 1 -- 172.21.15.46:0/3048612088 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2000038c0 con 0x7ff2040715c0 2023-07-05T18:56:52.635 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:52.628+0000 7ff20baa6700 1 -- 172.21.15.46:0/3048612088 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff20415f360 con 0x7ff2040715c0 2023-07-05T18:56:52.636 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:52.629+0000 7ff20baa6700 1 -- 172.21.15.46:0/3048612088 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff20415fb20 con 0x7ff2040715c0 2023-07-05T18:56:52.636 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:52.629+0000 7ff1fa7fc700 1 -- 172.21.15.46:0/3048612088 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7ff200021030 con 0x7ff2040715c0 2023-07-05T18:56:52.636 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:52.630+0000 7ff1fa7fc700 1 --2- 172.21.15.46:0/3048612088 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7ff1e806ace0 0x7ff1e806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:56:52.636 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:52.630+0000 7ff1fa7fc700 1 -- 172.21.15.46:0/3048612088 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6062+0+0 (secure 0 0 0) 0x7ff20008a8f0 con 0x7ff2040715c0 2023-07-05T18:56:52.636 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:52.630+0000 7ff209842700 1 --2- 172.21.15.46:0/3048612088 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7ff1e806ace0 0x7ff1e806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:56:52.636 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:52.630+0000 7ff209842700 1 --2- 172.21.15.46:0/3048612088 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7ff1e806ace0 0x7ff1e806d190 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7ff1f4009d00 tx=0x7ff1f4008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-05T18:56:52.637 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:52.634+0000 7ff1fa7fc700 1 -- 172.21.15.46:0/3048612088 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7ff200055a30 con 0x7ff2040715c0 2023-07-05T18:56:52.829 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:52.829+0000 7ff20baa6700 1 -- 172.21.15.46:0/3048612088 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7ff2040672e0 con 0x7ff2040715c0 2023-07-05T18:56:52.830 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:52.829+0000 7ff1fa7fc700 1 -- 172.21.15.46:0/3048612088 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v21) v1 ==== 92+0+10 (secure 0 0 0) 0x7ff2000150a0 con 0x7ff2040715c0 2023-07-05T18:56:52.830 INFO:teuthology.orchestra.run.smithi046.stdout:pg_num: 8 2023-07-05T18:56:52.832 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:52.831+0000 7ff20baa6700 1 -- 172.21.15.46:0/3048612088 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7ff1e806ace0 msgr2=0x7ff1e806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:56:52.832 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:52.831+0000 7ff20baa6700 1 --2- 172.21.15.46:0/3048612088 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7ff1e806ace0 0x7ff1e806d190 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7ff1f4009d00 tx=0x7ff1f4008040 comp rx=0 tx=0).stop 2023-07-05T18:56:52.832 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:52.831+0000 7ff20baa6700 1 -- 172.21.15.46:0/3048612088 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff2040715c0 msgr2=0x7ff2040b0230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:56:52.832 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:52.831+0000 7ff20baa6700 1 --2- 172.21.15.46:0/3048612088 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff2040715c0 0x7ff2040b0230 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7ff200000c00 tx=0x7ff200004750 comp rx=0 tx=0).stop 2023-07-05T18:56:52.833 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:52.831+0000 7ff20baa6700 1 -- 172.21.15.46:0/3048612088 shutdown_connections 2023-07-05T18:56:52.833 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:52.831+0000 7ff20baa6700 1 --2- 172.21.15.46:0/3048612088 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7ff1e806ace0 0x7ff1e806d190 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:52.833 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:52.831+0000 7ff20baa6700 1 --2- 172.21.15.46:0/3048612088 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff20415c860 0x7ff204149d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:52.833 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:52.831+0000 7ff20baa6700 1 --2- 172.21.15.46:0/3048612088 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7ff20406a340 0x7ff20415e7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:52.833 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:52.831+0000 7ff20baa6700 1 --2- 172.21.15.46:0/3048612088 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff2040715c0 0x7ff2040b0230 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:52.833 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:52.831+0000 7ff20baa6700 1 -- 172.21.15.46:0/3048612088 >> 172.21.15.46:0/3048612088 conn(0x7ff20406bba0 msgr2=0x7ff20415be50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-05T18:56:52.833 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:52.831+0000 7ff20baa6700 1 -- 172.21.15.46:0/3048612088 shutdown_connections 2023-07-05T18:56:52.833 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:52.831+0000 7ff20baa6700 1 -- 172.21.15.46:0/3048612088 wait complete. 2023-07-05T18:56:52.845 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-07-05T18:56:52.973 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:52.972+0000 7f03b358b700 1 Processor -- start 2023-07-05T18:56:52.974 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:52.973+0000 7f03b358b700 1 -- start start 2023-07-05T18:56:52.976 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:52.973+0000 7f03b358b700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f03ac15c860 0x7f03ac160ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:56:52.976 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:52.973+0000 7f03b358b700 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f03ac0ce640 con 0x7f03ac0715c0 2023-07-05T18:56:52.976 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:52.973+0000 7f03b358b700 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f03ac1611e0 con 0x7f03ac06a510 2023-07-05T18:56:52.976 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:52.973+0000 7f03b358b700 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f03ac0ce870 con 0x7f03ac15c860 2023-07-05T18:56:52.977 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:52.973+0000 7f03b0b26700 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7f03ac0715c0 0x7f03ac069e00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:58354/0 (socket says 172.21.15.46:58354) 2023-07-05T18:56:52.977 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:52.974+0000 7f03b0b26700 1 -- 172.21.15.46:0/3949143303 learned_addr learned my addr 172.21.15.46:0/3949143303 (peer_addr_for_me v1:172.21.15.46:0/0) 2023-07-05T18:56:52.977 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:52.974+0000 7f03b1327700 1 --2- 172.21.15.46:0/3949143303 >> v2:172.21.15.73:3300/0 conn(0x7f03ac15c860 0x7f03ac160ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:56:52.977 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:52.974+0000 7f039ffff700 1 -- 172.21.15.46:0/3949143303 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2457845109 0 0) 0x7f03ac0ce640 con 0x7f03ac0715c0 2023-07-05T18:56:52.977 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:52.974+0000 7f039ffff700 1 -- 172.21.15.46:0/3949143303 --> v1:172.21.15.46:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f03980035b0 con 0x7f03ac0715c0 2023-07-05T18:56:52.977 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:52.974+0000 7f039ffff700 1 -- 172.21.15.46:0/3949143303 <== mon.0 v1:172.21.15.46:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3005387023 0 0) 0x7f03980035b0 con 0x7f03ac0715c0 2023-07-05T18:56:52.977 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:52.974+0000 7f039ffff700 1 -- 172.21.15.46:0/3949143303 >> v2:172.21.15.73:3300/0 conn(0x7f03ac15c860 msgr2=0x7f03ac160ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-05T18:56:52.978 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:52.974+0000 7f039ffff700 1 --2- 172.21.15.46:0/3949143303 >> v2:172.21.15.73:3300/0 conn(0x7f03ac15c860 0x7f03ac160ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:52.978 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:52.974+0000 7f039ffff700 1 -- 172.21.15.46:0/3949143303 >> v1:172.21.15.73:6789/0 conn(0x7f03ac06a510 legacy=0x7f03ac06c1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:56:52.978 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:52.974+0000 7f039ffff700 1 -- 172.21.15.46:0/3949143303 --> v1:172.21.15.46:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f03ac0ceb50 con 0x7f03ac0715c0 2023-07-05T18:56:52.978 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:52.974+0000 7f039ffff700 1 -- 172.21.15.46:0/3949143303 <== mon.0 v1:172.21.15.46:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2195585215 0 0) 0x7f03a0001670 con 0x7f03ac0715c0 2023-07-05T18:56:52.978 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:52.974+0000 7f039ffff700 1 -- 172.21.15.46:0/3949143303 >> v1:172.21.15.46:6789/0 conn(0x7f03ac0715c0 legacy=0x7f03ac069e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:56:52.978 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:52.974+0000 7f039ffff700 1 --2- 172.21.15.46:0/3949143303 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f0398003a00 0x7f0398003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:56:52.978 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:52.974+0000 7f039ffff700 1 --2- 172.21.15.46:0/3949143303 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0398004850 0x7f0398004cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:56:52.978 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:52.974+0000 7f039ffff700 1 --2- 172.21.15.46:0/3949143303 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0398005200 0x7f039800ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:56:52.979 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:52.974+0000 7f039ffff700 1 -- 172.21.15.46:0/3949143303 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03ac0ce870 con 0x7f0398005200 2023-07-05T18:56:52.979 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:52.974+0000 7f039ffff700 1 -- 172.21.15.46:0/3949143303 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f039800c110 con 0x7f0398004850 2023-07-05T18:56:52.979 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:52.974+0000 7f039ffff700 1 -- 172.21.15.46:0/3949143303 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f039800c2d0 con 0x7f0398003a00 2023-07-05T18:56:52.979 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:52.974+0000 7f03b1b28700 1 --2- 172.21.15.46:0/3949143303 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0398005200 0x7f039800ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:56:52.979 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:52.974+0000 7f03b0b26700 1 --2- 172.21.15.46:0/3949143303 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0398004850 0x7f0398004cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:56:52.979 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:52.974+0000 7f03b1327700 1 --2- 172.21.15.46:0/3949143303 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f0398003a00 0x7f0398003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:56:52.979 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:52.975+0000 7f03b0b26700 1 -- 172.21.15.46:0/3949143303 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f0398003a00 msgr2=0x7f0398003e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-05T18:56:52.980 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:52.975+0000 7f03b0b26700 1 --2- 172.21.15.46:0/3949143303 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f0398003a00 0x7f0398003e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:52.980 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:52.975+0000 7f03b0b26700 1 -- 172.21.15.46:0/3949143303 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0398005200 msgr2=0x7f039800ba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-05T18:56:52.980 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:52.975+0000 7f03b0b26700 1 --2- 172.21.15.46:0/3949143303 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0398005200 0x7f039800ba10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:52.980 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:52.975+0000 7f03b0b26700 1 -- 172.21.15.46:0/3949143303 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f03980035b0 con 0x7f0398004850 2023-07-05T18:56:52.980 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:52.975+0000 7f03b1b28700 1 --2- 172.21.15.46:0/3949143303 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0398005200 0x7f039800ba10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-05T18:56:52.980 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:52.975+0000 7f03b1b28700 1 -- 172.21.15.46:0/3949143303 reap_dead start 2023-07-05T18:56:52.980 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:52.975+0000 7f03b0b26700 1 --2- 172.21.15.46:0/3949143303 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0398004850 0x7f0398004cc0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f03a0001050 tx=0x7f0398005880 comp rx=0 tx=0).ready entity=mon.1 client_cookie=45b4935c8d9c3c56 server_cookie=0 in_seq=0 out_seq=0 2023-07-05T18:56:52.980 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:52.975+0000 7f039ffff700 1 -- 172.21.15.46:0/3949143303 <== mon.1 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03a000cd80 con 0x7f0398004850 2023-07-05T18:56:52.981 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:52.975+0000 7f039ffff700 1 -- 172.21.15.46:0/3949143303 <== mon.1 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f03a0005960 con 0x7f0398004850 2023-07-05T18:56:52.981 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:52.975+0000 7f039ffff700 1 -- 172.21.15.46:0/3949143303 <== mon.1 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03a0005d10 con 0x7f0398004850 2023-07-05T18:56:52.983 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:52.975+0000 7f03b358b700 1 -- 172.21.15.46:0/3949143303 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0398004850 msgr2=0x7f0398004cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:56:52.984 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:52.975+0000 7f03b358b700 1 --2- 172.21.15.46:0/3949143303 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0398004850 0x7f0398004cc0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f03a0001050 tx=0x7f0398005880 comp rx=0 tx=0).stop 2023-07-05T18:56:52.984 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:52.975+0000 7f03b358b700 1 -- 172.21.15.46:0/3949143303 shutdown_connections 2023-07-05T18:56:52.984 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:52.975+0000 7f03b358b700 1 --2- 172.21.15.46:0/3949143303 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0398004850 0x7f0398004cc0 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:52.984 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:52.975+0000 7f03b358b700 1 -- 172.21.15.46:0/3949143303 >> 172.21.15.46:0/3949143303 conn(0x7f03ac06bba0 msgr2=0x7f03ac0cc3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-05T18:56:52.985 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:52.976+0000 7f03b358b700 1 -- 172.21.15.46:0/3949143303 shutdown_connections 2023-07-05T18:56:52.985 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:52.976+0000 7f03b358b700 1 -- 172.21.15.46:0/3949143303 wait complete. 2023-07-05T18:56:52.985 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:52.977+0000 7f03b358b700 1 Processor -- start 2023-07-05T18:56:52.985 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:52.977+0000 7f03b358b700 1 -- start start 2023-07-05T18:56:52.985 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:52.978+0000 7f03b358b700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f0398004850 0x7f03ac15fd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:56:52.985 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:52.978+0000 7f03b358b700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f03ac14f220 0x7f03ac0adb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:56:52.985 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:52.978+0000 7f03b358b700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f03ac0ae0a0 0x7f03ac0c7420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:56:52.986 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:52.978+0000 7f03b358b700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03ac0ae520 con 0x7f03ac14f220 2023-07-05T18:56:52.986 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:52.978+0000 7f03b358b700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03ac15f900 con 0x7f03ac0ae0a0 2023-07-05T18:56:52.986 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:52.978+0000 7f03b358b700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f03ac1602d0 con 0x7f0398004850 2023-07-05T18:56:52.986 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:52.978+0000 7f03b0b26700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f03ac14f220 0x7f03ac0adb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:56:52.986 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:52.978+0000 7f03b0b26700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f03ac14f220 0x7f03ac0adb60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:59094/0 (socket says 172.21.15.46:59094) 2023-07-05T18:56:52.986 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:52.978+0000 7f03b0b26700 1 -- 172.21.15.46:0/3941172472 learned_addr learned my addr 172.21.15.46:0/3941172472 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-07-05T18:56:52.986 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:52.978+0000 7f03b1327700 1 --2- 172.21.15.46:0/3941172472 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f0398004850 0x7f03ac15fd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:56:52.986 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:52.978+0000 7f03b1b28700 1 --2- 172.21.15.46:0/3941172472 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f03ac0ae0a0 0x7f03ac0c7420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:56:52.987 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:52.978+0000 7f03b0b26700 1 -- 172.21.15.46:0/3941172472 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f0398004850 msgr2=0x7f03ac15fd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:56:52.987 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:52.978+0000 7f03b0b26700 1 --2- 172.21.15.46:0/3941172472 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f0398004850 0x7f03ac15fd90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:52.987 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:52.978+0000 7f03b0b26700 1 -- 172.21.15.46:0/3941172472 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f03ac0ae0a0 msgr2=0x7f03ac0c7420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:56:52.987 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:52.978+0000 7f03b0b26700 1 --2- 172.21.15.46:0/3941172472 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f03ac0ae0a0 0x7f03ac0c7420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:52.987 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:52.978+0000 7f03b0b26700 1 -- 172.21.15.46:0/3941172472 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f03ac15ecf0 con 0x7f03ac14f220 2023-07-05T18:56:52.987 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:52.978+0000 7f03b1327700 1 --2- 172.21.15.46:0/3941172472 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f0398004850 0x7f03ac15fd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-05T18:56:52.987 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:52.978+0000 7f03b1b28700 1 --2- 172.21.15.46:0/3941172472 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f03ac0ae0a0 0x7f03ac0c7420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-05T18:56:52.987 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:52.978+0000 7f03b0b26700 1 --2- 172.21.15.46:0/3941172472 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f03ac14f220 0x7f03ac0adb60 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f039800c2a0 tx=0x7f03a0000fe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-05T18:56:52.988 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:52.978+0000 7f039dffb700 1 -- 172.21.15.46:0/3941172472 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03a00070d0 con 0x7f03ac14f220 2023-07-05T18:56:52.988 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:52.978+0000 7f039dffb700 1 -- 172.21.15.46:0/3941172472 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f03a0007230 con 0x7f03ac14f220 2023-07-05T18:56:52.988 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:52.978+0000 7f03b358b700 1 -- 172.21.15.46:0/3941172472 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f03ac15efd0 con 0x7f03ac14f220 2023-07-05T18:56:52.988 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:52.978+0000 7f039dffb700 1 -- 172.21.15.46:0/3941172472 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03a00075e0 con 0x7f03ac14f220 2023-07-05T18:56:52.988 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:52.979+0000 7f03b358b700 1 -- 172.21.15.46:0/3941172472 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f03ac15f590 con 0x7f03ac14f220 2023-07-05T18:56:52.989 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:52.980+0000 7f03b358b700 1 -- 172.21.15.46:0/3941172472 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f03ac0c67a0 con 0x7f03ac14f220 2023-07-05T18:56:52.989 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:52.980+0000 7f039dffb700 1 -- 172.21.15.46:0/3941172472 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f03a001e430 con 0x7f03ac14f220 2023-07-05T18:56:52.989 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:52.980+0000 7f039dffb700 1 --2- 172.21.15.46:0/3941172472 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7f039006ace0 0x7f039006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:56:52.989 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:52.981+0000 7f039dffb700 1 -- 172.21.15.46:0/3941172472 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f03a008a7b0 con 0x7f03ac14f220 2023-07-05T18:56:52.989 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:52.981+0000 7f03b1327700 1 --2- 172.21.15.46:0/3941172472 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7f039006ace0 0x7f039006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:56:52.989 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:52.981+0000 7f03b1327700 1 --2- 172.21.15.46:0/3941172472 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7f039006ace0 0x7f039006d190 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f03a8009bd0 tx=0x7f03a8008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-05T18:56:52.990 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:52.985+0000 7f039dffb700 1 -- 172.21.15.46:0/3941172472 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f03a0055850 con 0x7f03ac14f220 2023-07-05T18:56:53.182 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:53.181+0000 7f03b358b700 1 -- 172.21.15.46:0/3941172472 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f03ac15fa70 con 0x7f03ac14f220 2023-07-05T18:56:53.182 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:53.181+0000 7f039dffb700 1 -- 172.21.15.46:0/3941172472 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v21) v1 ==== 93+0+10 (secure 0 0 0) 0x7f03a0058e70 con 0x7f03ac14f220 2023-07-05T18:56:53.183 INFO:teuthology.orchestra.run.smithi046.stdout:pg_num: 1 2023-07-05T18:56:53.185 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:53.183+0000 7f03b358b700 1 -- 172.21.15.46:0/3941172472 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7f039006ace0 msgr2=0x7f039006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:56:53.185 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:53.183+0000 7f03b358b700 1 --2- 172.21.15.46:0/3941172472 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7f039006ace0 0x7f039006d190 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f03a8009bd0 tx=0x7f03a8008040 comp rx=0 tx=0).stop 2023-07-05T18:56:53.185 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:53.183+0000 7f03b358b700 1 -- 172.21.15.46:0/3941172472 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f03ac14f220 msgr2=0x7f03ac0adb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:56:53.185 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:53.183+0000 7f03b358b700 1 --2- 172.21.15.46:0/3941172472 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f03ac14f220 0x7f03ac0adb60 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f039800c2a0 tx=0x7f03a0000fe0 comp rx=0 tx=0).stop 2023-07-05T18:56:53.186 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:53.183+0000 7f03b358b700 1 -- 172.21.15.46:0/3941172472 shutdown_connections 2023-07-05T18:56:53.186 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:53.183+0000 7f03b358b700 1 --2- 172.21.15.46:0/3941172472 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7f039006ace0 0x7f039006d190 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:53.186 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:53.183+0000 7f03b358b700 1 --2- 172.21.15.46:0/3941172472 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f03ac0ae0a0 0x7f03ac0c7420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:53.186 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:53.183+0000 7f03b358b700 1 --2- 172.21.15.46:0/3941172472 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f0398004850 0x7f03ac15fd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:53.186 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:53.183+0000 7f03b358b700 1 --2- 172.21.15.46:0/3941172472 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f03ac14f220 0x7f03ac0adb60 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:53.186 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:53.183+0000 7f03b358b700 1 -- 172.21.15.46:0/3941172472 >> 172.21.15.46:0/3941172472 conn(0x7f03ac06bba0 msgr2=0x7f03ac0b2d00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-05T18:56:53.186 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:53.183+0000 7f03b358b700 1 -- 172.21.15.46:0/3941172472 shutdown_connections 2023-07-05T18:56:53.187 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:53.183+0000 7f03b358b700 1 -- 172.21.15.46:0/3941172472 wait complete. 2023-07-05T18:56:53.197 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-07-05T18:56:53.325 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:53.324+0000 7f721a8a6700 1 Processor -- start 2023-07-05T18:56:53.325 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:53.324+0000 7f721a8a6700 1 -- start start 2023-07-05T18:56:53.328 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:53.325+0000 7f721a8a6700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f72140cb110 0x7f721406b0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:56:53.328 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:53.325+0000 7f721a8a6700 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f721415e260 con 0x7f721406c3a0 2023-07-05T18:56:53.328 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:53.325+0000 7f721a8a6700 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f721415e540 con 0x7f721415a890 2023-07-05T18:56:53.329 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:53.325+0000 7f721a8a6700 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f721415ede0 con 0x7f72140cb110 2023-07-05T18:56:53.329 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:53.325+0000 7f7218e43700 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7f721406c3a0 0x7f721406a1e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:58376/0 (socket says 172.21.15.46:58376) 2023-07-05T18:56:53.329 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:53.325+0000 7f7218e43700 1 -- 172.21.15.46:0/2817162087 learned_addr learned my addr 172.21.15.46:0/2817162087 (peer_addr_for_me v1:172.21.15.46:0/0) 2023-07-05T18:56:53.329 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:53.325+0000 7f7213fff700 1 --2- 172.21.15.46:0/2817162087 >> v2:172.21.15.73:3300/0 conn(0x7f72140cb110 0x7f721406b0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:56:53.329 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:53.325+0000 7f7212ffd700 1 -- 172.21.15.46:0/2817162087 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2943621121 0 0) 0x7f721415e260 con 0x7f721406c3a0 2023-07-05T18:56:53.329 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:53.325+0000 7f7212ffd700 1 -- 172.21.15.46:0/2817162087 --> v1:172.21.15.46:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f71fc0035b0 con 0x7f721406c3a0 2023-07-05T18:56:53.330 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:53.326+0000 7f7212ffd700 1 -- 172.21.15.46:0/2817162087 <== mon.0 v1:172.21.15.46:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1804659910 0 0) 0x7f71fc0035b0 con 0x7f721406c3a0 2023-07-05T18:56:53.330 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:53.326+0000 7f7212ffd700 1 -- 172.21.15.46:0/2817162087 >> v2:172.21.15.73:3300/0 conn(0x7f72140cb110 msgr2=0x7f721406b0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-05T18:56:53.330 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:53.326+0000 7f7212ffd700 1 --2- 172.21.15.46:0/2817162087 >> v2:172.21.15.73:3300/0 conn(0x7f72140cb110 0x7f721406b0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:53.330 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:53.326+0000 7f7212ffd700 1 -- 172.21.15.46:0/2817162087 >> v1:172.21.15.73:6789/0 conn(0x7f721415a890 legacy=0x7f721406bc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:56:53.330 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:53.326+0000 7f7212ffd700 1 -- 172.21.15.46:0/2817162087 --> v1:172.21.15.46:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f721415e820 con 0x7f721406c3a0 2023-07-05T18:56:53.330 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:53.326+0000 7f7212ffd700 1 -- 172.21.15.46:0/2817162087 <== mon.0 v1:172.21.15.46:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2195585215 0 0) 0x7f720c0019f0 con 0x7f721406c3a0 2023-07-05T18:56:53.330 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:53.326+0000 7f7212ffd700 1 -- 172.21.15.46:0/2817162087 >> v1:172.21.15.46:6789/0 conn(0x7f721406c3a0 legacy=0x7f721406a1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:56:53.331 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:53.326+0000 7f7212ffd700 1 --2- 172.21.15.46:0/2817162087 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f71fc003a00 0x7f71fc003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:56:53.331 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:53.326+0000 7f7212ffd700 1 --2- 172.21.15.46:0/2817162087 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f71fc004850 0x7f71fc004cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:56:53.331 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:53.326+0000 7f7212ffd700 1 --2- 172.21.15.46:0/2817162087 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f71fc005200 0x7f71fc00ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:56:53.331 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:53.326+0000 7f7212ffd700 1 -- 172.21.15.46:0/2817162087 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f721415ede0 con 0x7f71fc003a00 2023-07-05T18:56:53.331 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:53.326+0000 7f7212ffd700 1 -- 172.21.15.46:0/2817162087 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71fc00c110 con 0x7f71fc005200 2023-07-05T18:56:53.331 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:53.326+0000 7f7212ffd700 1 -- 172.21.15.46:0/2817162087 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f71fc00c2d0 con 0x7f71fc004850 2023-07-05T18:56:53.332 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:53.326+0000 7f7213fff700 1 --2- 172.21.15.46:0/2817162087 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f71fc003a00 0x7f71fc003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:56:53.332 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:53.326+0000 7f72137fe700 1 --2- 172.21.15.46:0/2817162087 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f71fc004850 0x7f71fc004cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:56:53.332 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:53.326+0000 7f7218e43700 1 --2- 172.21.15.46:0/2817162087 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f71fc005200 0x7f71fc00ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:56:53.332 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:53.326+0000 7f7213fff700 1 -- 172.21.15.46:0/2817162087 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f71fc004850 msgr2=0x7f71fc004cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-05T18:56:53.332 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:53.326+0000 7f7213fff700 1 --2- 172.21.15.46:0/2817162087 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f71fc004850 0x7f71fc004cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:53.332 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:53.326+0000 7f7213fff700 1 -- 172.21.15.46:0/2817162087 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f71fc005200 msgr2=0x7f71fc00ba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-05T18:56:53.332 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:53.326+0000 7f7213fff700 1 --2- 172.21.15.46:0/2817162087 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f71fc005200 0x7f71fc00ba10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:53.333 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:53.326+0000 7f7213fff700 1 -- 172.21.15.46:0/2817162087 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f71fc0035b0 con 0x7f71fc003a00 2023-07-05T18:56:53.333 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:53.326+0000 7f7218e43700 1 -- 172.21.15.46:0/2817162087 reap_dead start 2023-07-05T18:56:53.333 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:53.326+0000 7f7213fff700 1 --2- 172.21.15.46:0/2817162087 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f71fc003a00 0x7f71fc003e10 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f7208009b60 tx=0x7f71fc005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=423897a199f4c3b5 server_cookie=0 in_seq=0 out_seq=0 2023-07-05T18:56:53.333 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:53.327+0000 7f7212ffd700 1 -- 172.21.15.46:0/2817162087 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f720800e6c0 con 0x7f71fc003a00 2023-07-05T18:56:53.333 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:53.327+0000 7f7212ffd700 1 -- 172.21.15.46:0/2817162087 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f720800e820 con 0x7f71fc003a00 2023-07-05T18:56:53.333 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:53.327+0000 7f7212ffd700 1 -- 172.21.15.46:0/2817162087 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f720800eb90 con 0x7f71fc003a00 2023-07-05T18:56:53.333 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:53.327+0000 7f721a8a6700 1 -- 172.21.15.46:0/2817162087 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f71fc003a00 msgr2=0x7f71fc003e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:56:53.334 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:53.327+0000 7f721a8a6700 1 --2- 172.21.15.46:0/2817162087 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f71fc003a00 0x7f71fc003e10 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f7208009b60 tx=0x7f71fc005880 comp rx=0 tx=0).stop 2023-07-05T18:56:53.334 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:53.327+0000 7f721a8a6700 1 -- 172.21.15.46:0/2817162087 shutdown_connections 2023-07-05T18:56:53.334 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:53.327+0000 7f721a8a6700 1 --2- 172.21.15.46:0/2817162087 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f71fc003a00 0x7f71fc003e10 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:53.334 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:53.327+0000 7f721a8a6700 1 -- 172.21.15.46:0/2817162087 >> 172.21.15.46:0/2817162087 conn(0x7f72140b19a0 msgr2=0x7f72140cf1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-05T18:56:53.334 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:53.327+0000 7f721a8a6700 1 -- 172.21.15.46:0/2817162087 shutdown_connections 2023-07-05T18:56:53.334 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:53.327+0000 7f721a8a6700 1 -- 172.21.15.46:0/2817162087 wait complete. 2023-07-05T18:56:53.337 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:53.329+0000 7f721a8a6700 1 Processor -- start 2023-07-05T18:56:53.337 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:53.329+0000 7f721a8a6700 1 -- start start 2023-07-05T18:56:53.337 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:53.330+0000 7f721a8a6700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f71fc003a00 0x7f72140b2190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:56:53.337 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:53.330+0000 7f721a8a6700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f72140ca210 0x7f7214153070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:56:53.337 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:53.330+0000 7f721a8a6700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f72140ca680 0x7f72141535b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:56:53.337 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:53.330+0000 7f721a8a6700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7214153af0 con 0x7f71fc003a00 2023-07-05T18:56:53.337 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:53.330+0000 7f721a8a6700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72140afe20 con 0x7f72140ca210 2023-07-05T18:56:53.338 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:53.330+0000 7f721a8a6700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f72140c2d90 con 0x7f72140ca680 2023-07-05T18:56:53.338 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:53.330+0000 7f7213fff700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f71fc003a00 0x7f72140b2190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:56:53.338 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:53.330+0000 7f7213fff700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f71fc003a00 0x7f72140b2190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:59112/0 (socket says 172.21.15.46:59112) 2023-07-05T18:56:53.338 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:53.330+0000 7f7213fff700 1 -- 172.21.15.46:0/764511403 learned_addr learned my addr 172.21.15.46:0/764511403 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-07-05T18:56:53.338 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:53.330+0000 7f7213fff700 1 -- 172.21.15.46:0/764511403 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f72140ca680 msgr2=0x7f72141535b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:56:53.338 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:53.330+0000 7f7218e43700 1 --2- 172.21.15.46:0/764511403 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f72140ca680 0x7f72141535b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:56:53.338 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:53.330+0000 7f7213fff700 1 --2- 172.21.15.46:0/764511403 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f72140ca680 0x7f72141535b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:53.338 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:53.330+0000 7f72137fe700 1 --2- 172.21.15.46:0/764511403 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f72140ca210 0x7f7214153070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:56:53.339 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:53.330+0000 7f7213fff700 1 -- 172.21.15.46:0/764511403 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f72140ca210 msgr2=0x7f7214153070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:56:53.339 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:53.330+0000 7f7213fff700 1 --2- 172.21.15.46:0/764511403 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f72140ca210 0x7f7214153070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:53.339 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:53.330+0000 7f7213fff700 1 -- 172.21.15.46:0/764511403 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f72140c3070 con 0x7f71fc003a00 2023-07-05T18:56:53.339 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:53.330+0000 7f72137fe700 1 --2- 172.21.15.46:0/764511403 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f72140ca210 0x7f7214153070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-05T18:56:53.339 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:53.331+0000 7f7213fff700 1 --2- 172.21.15.46:0/764511403 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f71fc003a00 0x7f72140b2190 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f71fc00c0e0 tx=0x7f72080047c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-05T18:56:53.339 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:53.331+0000 7f7210ff9700 1 -- 172.21.15.46:0/764511403 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f720800e6c0 con 0x7f71fc003a00 2023-07-05T18:56:53.339 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:53.331+0000 7f7210ff9700 1 -- 172.21.15.46:0/764511403 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7208003ad0 con 0x7f71fc003a00 2023-07-05T18:56:53.340 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:53.331+0000 7f721a8a6700 1 -- 172.21.15.46:0/764511403 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f72140c3350 con 0x7f71fc003a00 2023-07-05T18:56:53.340 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:53.331+0000 7f7210ff9700 1 -- 172.21.15.46:0/764511403 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7208003e80 con 0x7f71fc003a00 2023-07-05T18:56:53.340 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:53.331+0000 7f721a8a6700 1 -- 172.21.15.46:0/764511403 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f72140af0f0 con 0x7f71fc003a00 2023-07-05T18:56:53.340 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:53.332+0000 7f721a8a6700 1 -- 172.21.15.46:0/764511403 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f72140672e0 con 0x7f71fc003a00 2023-07-05T18:56:53.340 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:53.332+0000 7f7210ff9700 1 -- 172.21.15.46:0/764511403 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f7208013470 con 0x7f71fc003a00 2023-07-05T18:56:53.340 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:53.333+0000 7f7210ff9700 1 --2- 172.21.15.46:0/764511403 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7f720006ace0 0x7f720006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:56:53.340 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:53.333+0000 7f7210ff9700 1 -- 172.21.15.46:0/764511403 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f720808aed0 con 0x7f71fc003a00 2023-07-05T18:56:53.340 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:53.333+0000 7f72137fe700 1 --2- 172.21.15.46:0/764511403 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7f720006ace0 0x7f720006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:56:53.341 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:53.333+0000 7f72137fe700 1 --2- 172.21.15.46:0/764511403 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7f720006ace0 0x7f720006d190 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f7204007fd0 tx=0x7f7204009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-05T18:56:53.342 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:53.337+0000 7f7210ff9700 1 -- 172.21.15.46:0/764511403 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f7208055f70 con 0x7f71fc003a00 2023-07-05T18:56:53.536 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:53.534+0000 7f721a8a6700 1 -- 172.21.15.46:0/764511403 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f72140cf8f0 con 0x7f71fc003a00 2023-07-05T18:56:53.536 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:53.534+0000 7f7210ff9700 1 -- 172.21.15.46:0/764511403 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v21) v1 ==== 104+0+11 (secure 0 0 0) 0x7f720802d020 con 0x7f71fc003a00 2023-07-05T18:56:53.537 INFO:teuthology.orchestra.run.smithi046.stdout:pg_num: 32 2023-07-05T18:56:53.537 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:53.536+0000 7f721a8a6700 1 -- 172.21.15.46:0/764511403 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7f720006ace0 msgr2=0x7f720006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:56:53.537 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:53.536+0000 7f721a8a6700 1 --2- 172.21.15.46:0/764511403 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7f720006ace0 0x7f720006d190 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f7204007fd0 tx=0x7f7204009040 comp rx=0 tx=0).stop 2023-07-05T18:56:53.538 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:53.536+0000 7f721a8a6700 1 -- 172.21.15.46:0/764511403 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f71fc003a00 msgr2=0x7f72140b2190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:56:53.538 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:53.536+0000 7f721a8a6700 1 --2- 172.21.15.46:0/764511403 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f71fc003a00 0x7f72140b2190 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f71fc00c0e0 tx=0x7f72080047c0 comp rx=0 tx=0).stop 2023-07-05T18:56:53.538 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:53.536+0000 7f721a8a6700 1 -- 172.21.15.46:0/764511403 shutdown_connections 2023-07-05T18:56:53.538 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:53.536+0000 7f721a8a6700 1 --2- 172.21.15.46:0/764511403 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7f720006ace0 0x7f720006d190 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:53.538 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:53.536+0000 7f721a8a6700 1 --2- 172.21.15.46:0/764511403 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f72140ca680 0x7f72141535b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:53.538 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:53.536+0000 7f721a8a6700 1 --2- 172.21.15.46:0/764511403 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f71fc003a00 0x7f72140b2190 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:53.538 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:53.536+0000 7f721a8a6700 1 --2- 172.21.15.46:0/764511403 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f72140ca210 0x7f7214153070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:53.539 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:53.536+0000 7f721a8a6700 1 -- 172.21.15.46:0/764511403 >> 172.21.15.46:0/764511403 conn(0x7f72140b19a0 msgr2=0x7f721406a030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-05T18:56:53.539 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:53.536+0000 7f721a8a6700 1 -- 172.21.15.46:0/764511403 shutdown_connections 2023-07-05T18:56:53.539 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:53.536+0000 7f721a8a6700 1 -- 172.21.15.46:0/764511403 wait complete. 2023-07-05T18:56:53.549 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-07-05T18:56:53.677 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:53.676+0000 7fa3cdee3700 1 Processor -- start 2023-07-05T18:56:53.678 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:53.677+0000 7fa3cdee3700 1 -- start start 2023-07-05T18:56:53.680 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:53.677+0000 7fa3cdee3700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fa3c80b4880 0x7fa3c815d420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:56:53.680 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:53.677+0000 7fa3cdee3700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fa3c806c9c0 0x7fa3c80cf860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:56:53.680 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:53.677+0000 7fa3cdee3700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fa3c80cfda0 0x7fa3c8069e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:56:53.680 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:53.677+0000 7fa3cdee3700 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa3c815d960 con 0x7fa3c80b4880 2023-07-05T18:56:53.680 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:53.677+0000 7fa3cdee3700 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa3c815c960 con 0x7fa3c806c9c0 2023-07-05T18:56:53.681 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:53.677+0000 7fa3cdee3700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa3c80d0290 con 0x7fa3c80cfda0 2023-07-05T18:56:53.681 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:53.678+0000 7fa3c77fe700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fa3c80b4880 0x7fa3c815d420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:56:53.681 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:53.678+0000 7fa3c77fe700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fa3c80b4880 0x7fa3c815d420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:59120/0 (socket says 172.21.15.46:59120) 2023-07-05T18:56:53.681 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:53.678+0000 7fa3c77fe700 1 -- 172.21.15.46:0/397472680 learned_addr learned my addr 172.21.15.46:0/397472680 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-07-05T18:56:53.681 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:53.678+0000 7fa3c7fff700 1 --2- 172.21.15.46:0/397472680 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fa3c80cfda0 0x7fa3c8069e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:56:53.681 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:53.678+0000 7fa3c6ffd700 1 --2- 172.21.15.46:0/397472680 >> v2:172.21.15.73:3300/0 conn(0x7fa3c806c9c0 0x7fa3c80cf860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:56:53.681 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:53.678+0000 7fa3c77fe700 1 -- 172.21.15.46:0/397472680 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fa3c80cfda0 msgr2=0x7fa3c8069e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-05T18:56:53.681 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:53.678+0000 7fa3c77fe700 1 --2- 172.21.15.46:0/397472680 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fa3c80cfda0 0x7fa3c8069e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:53.682 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:53.678+0000 7fa3c77fe700 1 -- 172.21.15.46:0/397472680 >> v2:172.21.15.73:3300/0 conn(0x7fa3c806c9c0 msgr2=0x7fa3c80cf860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-05T18:56:53.682 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:53.678+0000 7fa3c77fe700 1 --2- 172.21.15.46:0/397472680 >> v2:172.21.15.73:3300/0 conn(0x7fa3c806c9c0 0x7fa3c80cf860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:53.682 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:53.678+0000 7fa3c77fe700 1 -- 172.21.15.46:0/397472680 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa3c80d0570 con 0x7fa3c80b4880 2023-07-05T18:56:53.682 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:53.678+0000 7fa3c7fff700 1 --2- 172.21.15.46:0/397472680 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fa3c80cfda0 0x7fa3c8069e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-05T18:56:53.682 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:53.678+0000 7fa3c77fe700 1 --2- 172.21.15.46:0/397472680 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa3c80b4880 0x7fa3c815d420 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7fa3b0006fd0 tx=0x7fa3b0009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9238153df7173f73 server_cookie=0 in_seq=0 out_seq=0 2023-07-05T18:56:53.682 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:53.678+0000 7fa3c67fc700 1 -- 172.21.15.46:0/397472680 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3b0005e30 con 0x7fa3c80b4880 2023-07-05T18:56:53.683 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:53.678+0000 7fa3c67fc700 1 -- 172.21.15.46:0/397472680 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa3b0004030 con 0x7fa3c80b4880 2023-07-05T18:56:53.683 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:53.678+0000 7fa3c67fc700 1 -- 172.21.15.46:0/397472680 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3b00043e0 con 0x7fa3c80b4880 2023-07-05T18:56:53.683 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:53.679+0000 7fa3cdee3700 1 -- 172.21.15.46:0/397472680 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa3c80b4880 msgr2=0x7fa3c815d420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:56:53.683 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:53.679+0000 7fa3cdee3700 1 --2- 172.21.15.46:0/397472680 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa3c80b4880 0x7fa3c815d420 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7fa3b0006fd0 tx=0x7fa3b0009bd0 comp rx=0 tx=0).stop 2023-07-05T18:56:53.683 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:53.679+0000 7fa3cdee3700 1 -- 172.21.15.46:0/397472680 shutdown_connections 2023-07-05T18:56:53.684 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:53.679+0000 7fa3cdee3700 1 --2- 172.21.15.46:0/397472680 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fa3c80cfda0 0x7fa3c8069e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:53.684 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:53.679+0000 7fa3cdee3700 1 --2- 172.21.15.46:0/397472680 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa3c80b4880 0x7fa3c815d420 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:53.684 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:53.679+0000 7fa3cdee3700 1 --2- 172.21.15.46:0/397472680 >> v2:172.21.15.73:3300/0 conn(0x7fa3c806c9c0 0x7fa3c80cf860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:53.684 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:53.679+0000 7fa3cdee3700 1 -- 172.21.15.46:0/397472680 >> 172.21.15.46:0/397472680 conn(0x7fa3c806af10 msgr2=0x7fa3c806b2e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-05T18:56:53.684 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:53.679+0000 7fa3cdee3700 1 -- 172.21.15.46:0/397472680 shutdown_connections 2023-07-05T18:56:53.685 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:53.679+0000 7fa3cdee3700 1 -- 172.21.15.46:0/397472680 wait complete. 2023-07-05T18:56:53.687 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:53.680+0000 7fa3cdee3700 1 Processor -- start 2023-07-05T18:56:53.687 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:53.680+0000 7fa3cdee3700 1 -- start start 2023-07-05T18:56:53.687 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:53.681+0000 7fa3cdee3700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fa3c80b4880 0x7fa3c8157260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:56:53.687 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:53.681+0000 7fa3cdee3700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa3c80cfda0 0x7fa3c8144f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:56:53.688 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:53.681+0000 7fa3cdee3700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa3c81454b0 0x7fa3c8158e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:56:53.688 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:53.681+0000 7fa3cdee3700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3c815a3c0 con 0x7fa3c81454b0 2023-07-05T18:56:53.688 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:53.681+0000 7fa3cdee3700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3c8148050 con 0x7fa3c80cfda0 2023-07-05T18:56:53.688 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:53.681+0000 7fa3cdee3700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa3c8145950 con 0x7fa3c80b4880 2023-07-05T18:56:53.688 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:53.681+0000 7fa3c7fff700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa3c81454b0 0x7fa3c8158e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:56:53.688 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:53.681+0000 7fa3c7fff700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa3c81454b0 0x7fa3c8158e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:59126/0 (socket says 172.21.15.46:59126) 2023-07-05T18:56:53.688 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:53.681+0000 7fa3c7fff700 1 -- 172.21.15.46:0/14119662 learned_addr learned my addr 172.21.15.46:0/14119662 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-07-05T18:56:53.689 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:53.681+0000 7fa3c77fe700 1 --2- 172.21.15.46:0/14119662 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fa3c80b4880 0x7fa3c8157260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:56:53.689 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:53.681+0000 7fa3c6ffd700 1 --2- 172.21.15.46:0/14119662 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa3c80cfda0 0x7fa3c8144f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:56:53.689 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:53.681+0000 7fa3c7fff700 1 -- 172.21.15.46:0/14119662 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fa3c80b4880 msgr2=0x7fa3c8157260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:56:53.689 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:53.681+0000 7fa3c7fff700 1 --2- 172.21.15.46:0/14119662 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fa3c80b4880 0x7fa3c8157260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:53.689 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:53.681+0000 7fa3c7fff700 1 -- 172.21.15.46:0/14119662 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa3c80cfda0 msgr2=0x7fa3c8144f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:56:53.689 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:53.681+0000 7fa3c7fff700 1 --2- 172.21.15.46:0/14119662 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa3c80cfda0 0x7fa3c8144f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:53.689 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:53.681+0000 7fa3c7fff700 1 -- 172.21.15.46:0/14119662 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa3b0009500 con 0x7fa3c81454b0 2023-07-05T18:56:53.690 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:53.682+0000 7fa3c7fff700 1 --2- 172.21.15.46:0/14119662 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa3c81454b0 0x7fa3c8158e60 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7fa3c0007e10 tx=0x7fa3c000d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-05T18:56:53.690 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:53.682+0000 7fa3bffff700 1 -- 172.21.15.46:0/14119662 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3c000dcc0 con 0x7fa3c81454b0 2023-07-05T18:56:53.690 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:53.682+0000 7fa3bffff700 1 -- 172.21.15.46:0/14119662 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa3c000f040 con 0x7fa3c81454b0 2023-07-05T18:56:53.690 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:53.682+0000 7fa3cdee3700 1 -- 172.21.15.46:0/14119662 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa3c8159b20 con 0x7fa3c81454b0 2023-07-05T18:56:53.690 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:53.682+0000 7fa3bffff700 1 -- 172.21.15.46:0/14119662 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3c0003c60 con 0x7fa3c81454b0 2023-07-05T18:56:53.691 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:53.682+0000 7fa3cdee3700 1 -- 172.21.15.46:0/14119662 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa3c815a0e0 con 0x7fa3c81454b0 2023-07-05T18:56:53.691 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:53.683+0000 7fa3cdee3700 1 -- 172.21.15.46:0/14119662 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa3c80672e0 con 0x7fa3c81454b0 2023-07-05T18:56:53.691 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:53.683+0000 7fa3bffff700 1 -- 172.21.15.46:0/14119662 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fa3c0004030 con 0x7fa3c81454b0 2023-07-05T18:56:53.691 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:53.684+0000 7fa3bffff700 1 --2- 172.21.15.46:0/14119662 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7fa3a806ad10 0x7fa3a806d1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:56:53.691 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:53.684+0000 7fa3bffff700 1 -- 172.21.15.46:0/14119662 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fa3c0089330 con 0x7fa3c81454b0 2023-07-05T18:56:53.691 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:53.684+0000 7fa3c77fe700 1 --2- 172.21.15.46:0/14119662 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7fa3a806ad10 0x7fa3a806d1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:56:53.691 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:53.684+0000 7fa3c77fe700 1 --2- 172.21.15.46:0/14119662 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7fa3a806ad10 0x7fa3a806d1c0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fa3b0009c10 tx=0x7fa3b0008070 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-05T18:56:53.692 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:53.688+0000 7fa3bffff700 1 -- 172.21.15.46:0/14119662 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fa3c0057e70 con 0x7fa3c81454b0 2023-07-05T18:56:53.886 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:53.885+0000 7fa3cdee3700 1 -- 172.21.15.46:0/14119662 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fa3c8071310 con 0x7fa3c81454b0 2023-07-05T18:56:53.886 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:53.885+0000 7fa3bffff700 1 -- 172.21.15.46:0/14119662 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v21) v1 ==== 100+0+11 (secure 0 0 0) 0x7fa3c0057a00 con 0x7fa3c81454b0 2023-07-05T18:56:53.887 INFO:teuthology.orchestra.run.smithi046.stdout:pg_num: 64 2023-07-05T18:56:53.888 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:53.887+0000 7fa3cdee3700 1 -- 172.21.15.46:0/14119662 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7fa3a806ad10 msgr2=0x7fa3a806d1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:56:53.888 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:53.887+0000 7fa3cdee3700 1 --2- 172.21.15.46:0/14119662 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7fa3a806ad10 0x7fa3a806d1c0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fa3b0009c10 tx=0x7fa3b0008070 comp rx=0 tx=0).stop 2023-07-05T18:56:53.889 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:53.887+0000 7fa3cdee3700 1 -- 172.21.15.46:0/14119662 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa3c81454b0 msgr2=0x7fa3c8158e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:56:53.889 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:53.887+0000 7fa3cdee3700 1 --2- 172.21.15.46:0/14119662 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa3c81454b0 0x7fa3c8158e60 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7fa3c0007e10 tx=0x7fa3c000d3b0 comp rx=0 tx=0).stop 2023-07-05T18:56:53.889 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:53.887+0000 7fa3cdee3700 1 -- 172.21.15.46:0/14119662 shutdown_connections 2023-07-05T18:56:53.889 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:53.887+0000 7fa3cdee3700 1 --2- 172.21.15.46:0/14119662 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7fa3a806ad10 0x7fa3a806d1c0 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:53.893 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:53.887+0000 7fa3cdee3700 1 --2- 172.21.15.46:0/14119662 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa3c81454b0 0x7fa3c8158e60 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:53.893 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:53.887+0000 7fa3cdee3700 1 --2- 172.21.15.46:0/14119662 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fa3c80b4880 0x7fa3c8157260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:53.893 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:53.887+0000 7fa3cdee3700 1 --2- 172.21.15.46:0/14119662 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa3c80cfda0 0x7fa3c8144f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:53.894 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:53.887+0000 7fa3cdee3700 1 -- 172.21.15.46:0/14119662 >> 172.21.15.46:0/14119662 conn(0x7fa3c806af10 msgr2=0x7fa3c80ae870 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-05T18:56:53.894 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:53.887+0000 7fa3cdee3700 1 -- 172.21.15.46:0/14119662 shutdown_connections 2023-07-05T18:56:53.894 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:53.887+0000 7fa3cdee3700 1 -- 172.21.15.46:0/14119662 wait complete. 2023-07-05T18:56:53.901 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-07-05T18:56:54.027 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:54.026+0000 7f55f0f8e700 1 Processor -- start 2023-07-05T18:56:54.027 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:54.026+0000 7f55f0f8e700 1 -- start start 2023-07-05T18:56:54.029 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:54.027+0000 7f55f0f8e700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f55ec0ce700 0x7f55ec0cead0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:56:54.029 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:54.027+0000 7f55f0f8e700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f55ec0af710 0x7f55ec15e020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:56:54.029 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:54.027+0000 7f55f0f8e700 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f55ec0af280 con 0x7f55ec0ae0d0 2023-07-05T18:56:54.029 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:54.027+0000 7f55f0f8e700 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f55ec15a910 con 0x7f55ec0af710 2023-07-05T18:56:54.029 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:54.027+0000 7f55f0f8e700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f55ec0cf010 con 0x7f55ec0ce700 2023-07-05T18:56:54.030 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:54.027+0000 7f55e9d9b700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f55ec0af710 0x7f55ec15e020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:56:54.030 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:54.027+0000 7f55ead9d700 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7f55ec0ae0d0 0x7f55ec15e560 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:58406/0 (socket says 172.21.15.46:58406) 2023-07-05T18:56:54.030 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:54.027+0000 7f55ead9d700 1 -- 172.21.15.46:0/788850398 learned_addr learned my addr 172.21.15.46:0/788850398 (peer_addr_for_me v1:172.21.15.46:0/0) 2023-07-05T18:56:54.030 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:54.027+0000 7f55ea59c700 1 --2- 172.21.15.46:0/788850398 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f55ec0ce700 0x7f55ec0cead0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:56:54.030 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:54.028+0000 7f55e9d9b700 1 -- 172.21.15.46:0/788850398 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f55ec0ce700 msgr2=0x7f55ec0cead0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-05T18:56:54.030 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:54.028+0000 7f55e9d9b700 1 --2- 172.21.15.46:0/788850398 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f55ec0ce700 0x7f55ec0cead0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:54.030 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:54.028+0000 7f55e9d9b700 1 -- 172.21.15.46:0/788850398 >> v1:172.21.15.46:6789/0 conn(0x7f55ec0ae0d0 legacy=0x7f55ec15e560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:56:54.031 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:54.028+0000 7f55e959a700 1 -- 172.21.15.46:0/788850398 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1197362080 0 0) 0x7f55ec0af280 con 0x7f55ec0ae0d0 2023-07-05T18:56:54.031 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:54.028+0000 7f55e9d9b700 1 -- 172.21.15.46:0/788850398 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f55ec0ae670 con 0x7f55ec0af710 2023-07-05T18:56:54.031 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:54.028+0000 7f55e9d9b700 1 --2- 172.21.15.46:0/788850398 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f55ec0af710 0x7f55ec15e020 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f55dc009840 tx=0x7f55dc009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d9fe6a783409e06e server_cookie=0 in_seq=0 out_seq=0 2023-07-05T18:56:54.031 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:54.028+0000 7f55e959a700 1 -- 172.21.15.46:0/788850398 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55dc011830 con 0x7f55ec0af710 2023-07-05T18:56:54.031 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:54.028+0000 7f55e959a700 1 -- 172.21.15.46:0/788850398 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f55dc011990 con 0x7f55ec0af710 2023-07-05T18:56:54.031 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:54.028+0000 7f55e959a700 1 -- 172.21.15.46:0/788850398 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55dc011d20 con 0x7f55ec0af710 2023-07-05T18:56:54.032 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:54.029+0000 7f55f0f8e700 1 -- 172.21.15.46:0/788850398 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f55ec0af710 msgr2=0x7f55ec15e020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:56:54.032 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:54.029+0000 7f55f0f8e700 1 --2- 172.21.15.46:0/788850398 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f55ec0af710 0x7f55ec15e020 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f55dc009840 tx=0x7f55dc009b50 comp rx=0 tx=0).stop 2023-07-05T18:56:54.032 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:54.029+0000 7f55f0f8e700 1 -- 172.21.15.46:0/788850398 shutdown_connections 2023-07-05T18:56:54.032 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:54.029+0000 7f55f0f8e700 1 --2- 172.21.15.46:0/788850398 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f55ec0ce700 0x7f55ec0cead0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:54.033 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:54.029+0000 7f55f0f8e700 1 --2- 172.21.15.46:0/788850398 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f55ec0af710 0x7f55ec15e020 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:54.033 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:54.029+0000 7f55f0f8e700 1 -- 172.21.15.46:0/788850398 >> 172.21.15.46:0/788850398 conn(0x7f55ec099e00 msgr2=0x7f55ec0d0b30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-05T18:56:54.033 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:54.029+0000 7f55f0f8e700 1 -- 172.21.15.46:0/788850398 shutdown_connections 2023-07-05T18:56:54.034 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:54.029+0000 7f55f0f8e700 1 -- 172.21.15.46:0/788850398 wait complete. 2023-07-05T18:56:54.035 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:54.030+0000 7f55f0f8e700 1 Processor -- start 2023-07-05T18:56:54.035 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:54.030+0000 7f55f0f8e700 1 -- start start 2023-07-05T18:56:54.035 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:54.031+0000 7f55f0f8e700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f55ec0ae0d0 0x7f55ec1500c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:56:54.035 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:54.031+0000 7f55f0f8e700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f55ec0af710 0x7f55ec06c0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:56:54.035 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:54.031+0000 7f55f0f8e700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f55ec0ce700 0x7f55ec0c4640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:56:54.035 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:54.031+0000 7f55f0f8e700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f55ec0c59f0 con 0x7f55ec0ce700 2023-07-05T18:56:54.036 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:54.031+0000 7f55f0f8e700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f55ec0c4b80 con 0x7f55ec0ae0d0 2023-07-05T18:56:54.036 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:54.031+0000 7f55f0f8e700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f55ec0c4de0 con 0x7f55ec0af710 2023-07-05T18:56:54.036 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:54.031+0000 7f55ead9d700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f55ec0ce700 0x7f55ec0c4640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:56:54.036 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:54.031+0000 7f55ead9d700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f55ec0ce700 0x7f55ec0c4640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:59140/0 (socket says 172.21.15.46:59140) 2023-07-05T18:56:54.036 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:54.031+0000 7f55ead9d700 1 -- 172.21.15.46:0/2595052967 learned_addr learned my addr 172.21.15.46:0/2595052967 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-07-05T18:56:54.036 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:54.031+0000 7f55e9d9b700 1 --2- 172.21.15.46:0/2595052967 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f55ec0af710 0x7f55ec06c0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:56:54.036 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:54.031+0000 7f55ea59c700 1 --2- 172.21.15.46:0/2595052967 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f55ec0ae0d0 0x7f55ec1500c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:56:54.037 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:54.031+0000 7f55ead9d700 1 -- 172.21.15.46:0/2595052967 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f55ec0af710 msgr2=0x7f55ec06c0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:56:54.037 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:54.031+0000 7f55ead9d700 1 --2- 172.21.15.46:0/2595052967 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f55ec0af710 0x7f55ec06c0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:54.037 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:54.031+0000 7f55ead9d700 1 -- 172.21.15.46:0/2595052967 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f55ec0ae0d0 msgr2=0x7f55ec1500c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:56:54.037 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:54.031+0000 7f55ead9d700 1 --2- 172.21.15.46:0/2595052967 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f55ec0ae0d0 0x7f55ec1500c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:54.038 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:54.031+0000 7f55ead9d700 1 -- 172.21.15.46:0/2595052967 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f55dc0094a0 con 0x7f55ec0ce700 2023-07-05T18:56:54.038 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:54.031+0000 7f55ea59c700 1 --2- 172.21.15.46:0/2595052967 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f55ec0ae0d0 0x7f55ec1500c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-05T18:56:54.039 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:54.031+0000 7f55ead9d700 1 --2- 172.21.15.46:0/2595052967 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f55ec0ce700 0x7f55ec0c4640 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f55e4002230 tx=0x7f55e400cf50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-05T18:56:54.039 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:54.032+0000 7f55daffd700 1 -- 172.21.15.46:0/2595052967 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55e400ab70 con 0x7f55ec0ce700 2023-07-05T18:56:54.039 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:54.032+0000 7f55daffd700 1 -- 172.21.15.46:0/2595052967 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f55e400acf0 con 0x7f55ec0ce700 2023-07-05T18:56:54.039 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:54.032+0000 7f55f0f8e700 1 -- 172.21.15.46:0/2595052967 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f55ec0c50c0 con 0x7f55ec0ce700 2023-07-05T18:56:54.039 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:54.032+0000 7f55daffd700 1 -- 172.21.15.46:0/2595052967 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55e4007310 con 0x7f55ec0ce700 2023-07-05T18:56:54.039 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:54.032+0000 7f55f0f8e700 1 -- 172.21.15.46:0/2595052967 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f55ec0c5680 con 0x7f55ec0ce700 2023-07-05T18:56:54.039 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:54.033+0000 7f55f0f8e700 1 -- 172.21.15.46:0/2595052967 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f55ec0c5b60 con 0x7f55ec0ce700 2023-07-05T18:56:54.040 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:54.033+0000 7f55daffd700 1 -- 172.21.15.46:0/2595052967 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f55e4007470 con 0x7f55ec0ce700 2023-07-05T18:56:54.040 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:54.033+0000 7f55daffd700 1 --2- 172.21.15.46:0/2595052967 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7f55cc06ace0 0x7f55cc06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:56:54.041 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:54.034+0000 7f55daffd700 1 -- 172.21.15.46:0/2595052967 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f55e4089330 con 0x7f55ec0ce700 2023-07-05T18:56:54.041 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:54.034+0000 7f55ea59c700 1 --2- 172.21.15.46:0/2595052967 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7f55cc06ace0 0x7f55cc06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:56:54.041 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:54.034+0000 7f55ea59c700 1 --2- 172.21.15.46:0/2595052967 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7f55cc06ace0 0x7f55cc06d190 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f55e0007a50 tx=0x7f55e0008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-05T18:56:54.041 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:54.038+0000 7f55daffd700 1 -- 172.21.15.46:0/2595052967 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f55e40543e0 con 0x7f55ec0ce700 2023-07-05T18:56:54.250 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:54.250+0000 7f55f0f8e700 1 -- 172.21.15.46:0/2595052967 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f55ec0672e0 con 0x7f55ec0ce700 2023-07-05T18:56:54.251 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:54.250+0000 7f55daffd700 1 -- 172.21.15.46:0/2595052967 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v21) v1 ==== 80+0+0 (secure 0 0 0) 0x7f55e400ae60 con 0x7f55ec0ce700 2023-07-05T18:56:54.253 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:54.252+0000 7f55f0f8e700 1 -- 172.21.15.46:0/2595052967 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7f55cc06ace0 msgr2=0x7f55cc06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:56:54.253 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:54.252+0000 7f55f0f8e700 1 --2- 172.21.15.46:0/2595052967 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7f55cc06ace0 0x7f55cc06d190 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f55e0007a50 tx=0x7f55e0008040 comp rx=0 tx=0).stop 2023-07-05T18:56:54.253 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:54.252+0000 7f55f0f8e700 1 -- 172.21.15.46:0/2595052967 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f55ec0ce700 msgr2=0x7f55ec0c4640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:56:54.254 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:54.252+0000 7f55f0f8e700 1 --2- 172.21.15.46:0/2595052967 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f55ec0ce700 0x7f55ec0c4640 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f55e4002230 tx=0x7f55e400cf50 comp rx=0 tx=0).stop 2023-07-05T18:56:54.254 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:54.252+0000 7f55f0f8e700 1 -- 172.21.15.46:0/2595052967 shutdown_connections 2023-07-05T18:56:54.254 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:54.252+0000 7f55f0f8e700 1 --2- 172.21.15.46:0/2595052967 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7f55cc06ace0 0x7f55cc06d190 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:54.254 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:54.252+0000 7f55f0f8e700 1 --2- 172.21.15.46:0/2595052967 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f55ec0ce700 0x7f55ec0c4640 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:54.254 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:54.252+0000 7f55f0f8e700 1 --2- 172.21.15.46:0/2595052967 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f55ec0ae0d0 0x7f55ec1500c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:54.254 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:54.252+0000 7f55f0f8e700 1 --2- 172.21.15.46:0/2595052967 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f55ec0af710 0x7f55ec06c0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:54.254 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:54.252+0000 7f55f0f8e700 1 -- 172.21.15.46:0/2595052967 >> 172.21.15.46:0/2595052967 conn(0x7f55ec099e00 msgr2=0x7f55ec0b1150 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-05T18:56:54.255 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:54.252+0000 7f55f0f8e700 1 -- 172.21.15.46:0/2595052967 shutdown_connections 2023-07-05T18:56:54.255 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:54.252+0000 7f55f0f8e700 1 -- 172.21.15.46:0/2595052967 wait complete. 2023-07-05T18:56:54.255 INFO:teuthology.orchestra.run.smithi046.stderr:listed 0 entries 2023-07-05T18:56:54.265 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.1... 2023-07-05T18:56:54.266 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-05T18:56:54.266 DEBUG:teuthology.orchestra.run.smithi073:> sudo umount /home/ubuntu/cephtest/mnt.1 -f 2023-07-05T18:56:54.312 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi073.front.sepia.ceph.com 2023-07-05T18:56:54.313 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-05T18:56:54.313 DEBUG:teuthology.orchestra.run.smithi073:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2023-07-05T18:56:54.346 DEBUG:teuthology.orchestra.run.smithi046:> set -ex 2023-07-05T18:56:54.347 DEBUG:teuthology.orchestra.run.smithi046:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-05T18:56:54.367 DEBUG:teuthology.orchestra.run.smithi046:> set -ex 2023-07-05T18:56:54.368 DEBUG:teuthology.orchestra.run.smithi046:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-05T18:56:54.424 DEBUG:teuthology.orchestra.run.smithi046:> set -ex 2023-07-05T18:56:54.424 DEBUG:teuthology.orchestra.run.smithi046:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-05T18:56:54.481 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-05T18:56:54.647 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:54.646+0000 7f7e2ad03700 1 Processor -- start 2023-07-05T18:56:54.647 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:54.646+0000 7f7e2ad03700 1 -- start start 2023-07-05T18:56:54.650 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:54.646+0000 7f7e2ad03700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f7e24159d60 0x7f7e24163ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:56:54.650 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:54.647+0000 7f7e2ad03700 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7e24070520 con 0x7f7e24159280 2023-07-05T18:56:54.650 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:54.647+0000 7f7e2ad03700 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7e240b3f90 con 0x7f7e24070af0 2023-07-05T18:56:54.650 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:54.647+0000 7f7e2ad03700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7e240cbc00 con 0x7f7e24159d60 2023-07-05T18:56:54.651 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:54.647+0000 7f7e28a9f700 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7f7e24159280 0x7f7e2406fe10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:58416/0 (socket says 172.21.15.46:58416) 2023-07-05T18:56:54.651 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:54.647+0000 7f7e28a9f700 1 -- 172.21.15.46:0/2631737795 learned_addr learned my addr 172.21.15.46:0/2631737795 (peer_addr_for_me v1:172.21.15.46:0/0) 2023-07-05T18:56:54.652 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:54.647+0000 7f7e292a0700 1 --2- 172.21.15.46:0/2631737795 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f7e24159d60 0x7f7e24163ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:56:54.652 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:54.647+0000 7f7e237fe700 1 -- 172.21.15.46:0/2631737795 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1920573381 0 0) 0x7f7e18001110 con 0x7f7e24159280 2023-07-05T18:56:54.652 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:54.647+0000 7f7e237fe700 1 -- 172.21.15.46:0/2631737795 --> v1:172.21.15.46:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7e140035b0 con 0x7f7e24159280 2023-07-05T18:56:54.652 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:54.647+0000 7f7e237fe700 1 -- 172.21.15.46:0/2631737795 <== mon.0 v1:172.21.15.46:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 125645057 0 0) 0x7f7e140035b0 con 0x7f7e24159280 2023-07-05T18:56:54.652 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:54.647+0000 7f7e237fe700 1 -- 172.21.15.46:0/2631737795 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f7e24159d60 msgr2=0x7f7e24163ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-05T18:56:54.652 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:54.647+0000 7f7e237fe700 1 --2- 172.21.15.46:0/2631737795 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f7e24159d60 0x7f7e24163ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:54.653 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:54.647+0000 7f7e237fe700 1 -- 172.21.15.46:0/2631737795 >> v1:172.21.15.73:6789/0 conn(0x7f7e24070af0 legacy=0x7f7e24159650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:56:54.653 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:54.647+0000 7f7e237fe700 1 -- 172.21.15.46:0/2631737795 --> v1:172.21.15.46:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e240b3190 con 0x7f7e24159280 2023-07-05T18:56:54.653 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:54.647+0000 7f7e237fe700 1 -- 172.21.15.46:0/2631737795 <== mon.0 v1:172.21.15.46:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2195585215 0 0) 0x7f7e18001800 con 0x7f7e24159280 2023-07-05T18:56:54.653 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:54.647+0000 7f7e237fe700 1 -- 172.21.15.46:0/2631737795 >> v1:172.21.15.46:6789/0 conn(0x7f7e24159280 legacy=0x7f7e2406fe10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:56:54.653 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:54.647+0000 7f7e237fe700 1 --2- 172.21.15.46:0/2631737795 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7e14003a30 0x7f7e14003e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:56:54.653 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:54.647+0000 7f7e237fe700 1 --2- 172.21.15.46:0/2631737795 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f7e24159d60 0x7f7e14004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:56:54.653 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:54.647+0000 7f7e237fe700 1 --2- 172.21.15.46:0/2631737795 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7e14004d90 0x7f7e14005200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:56:54.654 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:54.647+0000 7f7e237fe700 1 -- 172.21.15.46:0/2631737795 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e240cbc00 con 0x7f7e14003a30 2023-07-05T18:56:54.654 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:54.647+0000 7f7e237fe700 1 -- 172.21.15.46:0/2631737795 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e1400bac0 con 0x7f7e14004d90 2023-07-05T18:56:54.654 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:54.647+0000 7f7e237fe700 1 -- 172.21.15.46:0/2631737795 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7e1400bc50 con 0x7f7e24159d60 2023-07-05T18:56:54.654 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:54.647+0000 7f7e28a9f700 1 --2- 172.21.15.46:0/2631737795 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7e14003a30 0x7f7e14003e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:56:54.654 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:54.647+0000 7f7e23fff700 1 --2- 172.21.15.46:0/2631737795 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f7e24159d60 0x7f7e14004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:56:54.654 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:54.648+0000 7f7e292a0700 1 --2- 172.21.15.46:0/2631737795 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7e14004d90 0x7f7e14005200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:56:54.655 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:54.648+0000 7f7e28a9f700 1 -- 172.21.15.46:0/2631737795 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f7e24159d60 msgr2=0x7f7e14004850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-05T18:56:54.655 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:54.648+0000 7f7e28a9f700 1 --2- 172.21.15.46:0/2631737795 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f7e24159d60 0x7f7e14004850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:54.655 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:54.648+0000 7f7e28a9f700 1 -- 172.21.15.46:0/2631737795 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7e14004d90 msgr2=0x7f7e14005200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-05T18:56:54.656 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:54.648+0000 7f7e28a9f700 1 --2- 172.21.15.46:0/2631737795 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7e14004d90 0x7f7e14005200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:54.656 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:54.648+0000 7f7e28a9f700 1 -- 172.21.15.46:0/2631737795 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e140035b0 con 0x7f7e14003a30 2023-07-05T18:56:54.656 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:54.648+0000 7f7e28a9f700 1 --2- 172.21.15.46:0/2631737795 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7e14003a30 0x7f7e14003e40 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f7e1800c240 tx=0x7f7e14005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=300d23451cd93588 server_cookie=0 in_seq=0 out_seq=0 2023-07-05T18:56:54.656 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:54.648+0000 7f7e237fe700 1 -- 172.21.15.46:0/2631737795 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e18007db0 con 0x7f7e14003a30 2023-07-05T18:56:54.656 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:54.648+0000 7f7e237fe700 1 -- 172.21.15.46:0/2631737795 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7e1800ce00 con 0x7f7e14003a30 2023-07-05T18:56:54.656 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:54.648+0000 7f7e237fe700 1 -- 172.21.15.46:0/2631737795 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e18005ba0 con 0x7f7e14003a30 2023-07-05T18:56:54.656 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:54.649+0000 7f7e2ad03700 1 -- 172.21.15.46:0/2631737795 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7e14003a30 msgr2=0x7f7e14003e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:56:54.657 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:54.649+0000 7f7e2ad03700 1 --2- 172.21.15.46:0/2631737795 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7e14003a30 0x7f7e14003e40 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f7e1800c240 tx=0x7f7e14005880 comp rx=0 tx=0).stop 2023-07-05T18:56:54.657 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:54.649+0000 7f7e292a0700 1 -- 172.21.15.46:0/2631737795 reap_dead start 2023-07-05T18:56:54.657 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:54.649+0000 7f7e2ad03700 1 -- 172.21.15.46:0/2631737795 shutdown_connections 2023-07-05T18:56:54.657 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:54.649+0000 7f7e2ad03700 1 -- 172.21.15.46:0/2631737795 >> 172.21.15.46:0/2631737795 conn(0x7f7e240b0d50 msgr2=0x7f7e240b1150 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-05T18:56:54.657 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:54.649+0000 7f7e2ad03700 1 -- 172.21.15.46:0/2631737795 shutdown_connections 2023-07-05T18:56:54.657 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:54.649+0000 7f7e2ad03700 1 -- 172.21.15.46:0/2631737795 wait complete. 2023-07-05T18:56:54.660 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:54.650+0000 7f7e2ad03700 1 Processor -- start 2023-07-05T18:56:54.660 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:54.650+0000 7f7e2ad03700 1 -- start start 2023-07-05T18:56:54.660 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:54.651+0000 7f7e2ad03700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7e14003a30 0x7f7e241f14f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:56:54.660 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:54.651+0000 7f7e2ad03700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f7e24152110 0x7f7e24152580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:56:54.660 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:54.651+0000 7f7e2ad03700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7e24153930 0x7f7e24153dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:56:54.661 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:54.651+0000 7f7e2ad03700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e24154310 con 0x7f7e14003a30 2023-07-05T18:56:54.661 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:54.651+0000 7f7e2ad03700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e24151040 con 0x7f7e24153930 2023-07-05T18:56:54.661 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:54.651+0000 7f7e2ad03700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7e24151320 con 0x7f7e24152110 2023-07-05T18:56:54.661 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:54.651+0000 7f7e28a9f700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7e14003a30 0x7f7e241f14f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:56:54.661 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:54.651+0000 7f7e28a9f700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7e14003a30 0x7f7e241f14f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:59156/0 (socket says 172.21.15.46:59156) 2023-07-05T18:56:54.661 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:54.651+0000 7f7e28a9f700 1 -- 172.21.15.46:0/2174564838 learned_addr learned my addr 172.21.15.46:0/2174564838 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-07-05T18:56:54.662 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:54.651+0000 7f7e292a0700 1 --2- 172.21.15.46:0/2174564838 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7e24153930 0x7f7e24153dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:56:54.662 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:54.651+0000 7f7e23fff700 1 --2- 172.21.15.46:0/2174564838 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f7e24152110 0x7f7e24152580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:56:54.663 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:54.651+0000 7f7e28a9f700 1 -- 172.21.15.46:0/2174564838 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f7e24152110 msgr2=0x7f7e24152580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:56:54.663 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:54.651+0000 7f7e28a9f700 1 --2- 172.21.15.46:0/2174564838 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f7e24152110 0x7f7e24152580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:54.664 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:54.651+0000 7f7e28a9f700 1 -- 172.21.15.46:0/2174564838 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7e24153930 msgr2=0x7f7e24153dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:56:54.664 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:54.651+0000 7f7e28a9f700 1 --2- 172.21.15.46:0/2174564838 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7e24153930 0x7f7e24153dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:54.664 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:54.651+0000 7f7e28a9f700 1 -- 172.21.15.46:0/2174564838 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e24151600 con 0x7f7e14003a30 2023-07-05T18:56:54.664 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:54.651+0000 7f7e28a9f700 1 --2- 172.21.15.46:0/2174564838 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7e14003a30 0x7f7e241f14f0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f7e1800c830 tx=0x7f7e18001b90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-05T18:56:54.664 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:54.652+0000 7f7e217fa700 1 -- 172.21.15.46:0/2174564838 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e180015c0 con 0x7f7e14003a30 2023-07-05T18:56:54.665 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:54.652+0000 7f7e217fa700 1 -- 172.21.15.46:0/2174564838 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7e18001720 con 0x7f7e14003a30 2023-07-05T18:56:54.665 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:54.652+0000 7f7e217fa700 1 -- 172.21.15.46:0/2174564838 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e18007310 con 0x7f7e14003a30 2023-07-05T18:56:54.665 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:54.652+0000 7f7e2ad03700 1 -- 172.21.15.46:0/2174564838 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7e241518e0 con 0x7f7e14003a30 2023-07-05T18:56:54.665 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:54.652+0000 7f7e2ad03700 1 -- 172.21.15.46:0/2174564838 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7e24152bd0 con 0x7f7e14003a30 2023-07-05T18:56:54.666 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:54.653+0000 7f7e2ad03700 1 -- 172.21.15.46:0/2174564838 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7e240672e0 con 0x7f7e14003a30 2023-07-05T18:56:54.666 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:54.653+0000 7f7e217fa700 1 -- 172.21.15.46:0/2174564838 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f7e18019030 con 0x7f7e14003a30 2023-07-05T18:56:54.668 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:54.653+0000 7f7e217fa700 1 --2- 172.21.15.46:0/2174564838 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7f7e0806ace0 0x7f7e0806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:56:54.668 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:54.654+0000 7f7e217fa700 1 -- 172.21.15.46:0/2174564838 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f7e1808a180 con 0x7f7e14003a30 2023-07-05T18:56:54.668 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:54.654+0000 7f7e23fff700 1 --2- 172.21.15.46:0/2174564838 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7f7e0806ace0 0x7f7e0806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:56:54.668 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:54.654+0000 7f7e23fff700 1 --2- 172.21.15.46:0/2174564838 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7f7e0806ace0 0x7f7e0806d190 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f7e241520c0 tx=0x7f7e10009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-05T18:56:54.668 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:54.658+0000 7f7e217fa700 1 -- 172.21.15.46:0/2174564838 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f7e180552c0 con 0x7f7e14003a30 2023-07-05T18:56:54.862 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:54.861+0000 7f7e2ad03700 1 -- 172.21.15.46:0/2174564838 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f7e24070520 con 0x7f7e14003a30 2023-07-05T18:56:54.863 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:54.862+0000 7f7e217fa700 1 -- 172.21.15.46:0/2174564838 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) v1 ==== 74+0+18161 (secure 0 0 0) 0x7f7e24070520 con 0x7f7e14003a30 2023-07-05T18:56:54.863 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T18:56:54.864 INFO:teuthology.orchestra.run.smithi046.stdout:{"epoch":21,"fsid":"042652d3-d80c-4ad8-9366-3e94f2a0a512","created":"2023-07-05T18:55:56.455710+0000","modified":"2023-07-05T18:56:16.095672+0000","last_up_change":"2023-07-05T18:56:06.594022+0000","last_in_change":"2023-07-05T18:55:58.879340+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-07-05T18:56:07.729620+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2023-07-05T18:56:08.128122+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-07-05T18:56:12.954625+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-07-05T18:56:14.068396+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"20009183-9a47-4392-8751-883f88d2bfb1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6813","nonce":4151971443},{"type":"v1","addr":"172.21.15.46:6815","nonce":4151971443}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6817","nonce":4151971443},{"type":"v1","addr":"172.21.15.46:6818","nonce":4151971443}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6822","nonce":4151971443},{"type":"v1","addr":"172.21.15.46:6823","nonce":4151971443}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6820","nonce":4151971443},{"type":"v1","addr":"172.21.15.46:6821","nonce":4151971443}]},"public_addr":"172.21.15.46:6815/4151971443","cluster_addr":"172.21.15.46:6818/4151971443","heartbeat_back_addr":"172.21.15.46:6823/4151971443","heartbeat_front_addr":"172.21.15.46:6821/4151971443","state":["exists","up"]},{"osd":1,"uuid":"91b4a7b0-e4e4-4888-a1fe-9edb0d68004c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6808","nonce":502575881},{"type":"v1","addr":"172.21.15.46:6809","nonce":502575881}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6810","nonce":502575881},{"type":"v1","addr":"172.21.15.46:6811","nonce":502575881}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6816","nonce":502575881},{"type":"v1","addr":"172.21.15.46:6819","nonce":502575881}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6812","nonce":502575881},{"type":"v1","addr":"172.21.15.46:6814","nonce":502575881}]},"public_addr":"172.21.15.46:6809/502575881","cluster_addr":"172.21.15.46:6811/502575881","heartbeat_back_addr":"172.21.15.46:6819/502575881","heartbeat_front_addr":"172.21.15.46:6814/502575881","state":["exists","up"]},{"osd":2,"uuid":"669ff744-1331-47c5-8579-0440731c889a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6800","nonce":2115251461},{"type":"v1","addr":"172.21.15.46:6801","nonce":2115251461}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6802","nonce":2115251461},{"type":"v1","addr":"172.21.15.46:6803","nonce":2115251461}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6806","nonce":2115251461},{"type":"v1","addr":"172.21.15.46:6807","nonce":2115251461}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6804","nonce":2115251461},{"type":"v1","addr":"172.21.15.46:6805","nonce":2115251461}]},"public_addr":"172.21.15.46:6801/2115251461","cluster_addr":"172.21.15.46:6803/2115251461","heartbeat_back_addr":"172.21.15.46:6807/2115251461","heartbeat_front_addr":"172.21.15.46:6805/2115251461","state":["exists","up"]},{"osd":3,"uuid":"34e1b86d-ffad-415d-861c-07a5f08068a6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6824","nonce":2981388766},{"type":"v1","addr":"172.21.15.46:6825","nonce":2981388766}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6826","nonce":2981388766},{"type":"v1","addr":"172.21.15.46:6827","nonce":2981388766}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6830","nonce":2981388766},{"type":"v1","addr":"172.21.15.46:6831","nonce":2981388766}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6828","nonce":2981388766},{"type":"v1","addr":"172.21.15.46:6829","nonce":2981388766}]},"public_addr":"172.21.15.46:6825/2981388766","cluster_addr":"172.21.15.46:6827/2981388766","heartbeat_back_addr":"172.21.15.46:6831/2981388766","heartbeat_front_addr":"172.21.15.46:6829/2981388766","state":["exists","up"]},{"osd":4,"uuid":"57ffcb91-c7dc-4a69-ae71-4d9622a14a05","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6800","nonce":2083655348},{"type":"v1","addr":"172.21.15.73:6801","nonce":2083655348}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6802","nonce":2083655348},{"type":"v1","addr":"172.21.15.73:6803","nonce":2083655348}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6806","nonce":2083655348},{"type":"v1","addr":"172.21.15.73:6807","nonce":2083655348}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6804","nonce":2083655348},{"type":"v1","addr":"172.21.15.73:6805","nonce":2083655348}]},"public_addr":"172.21.15.73:6801/2083655348","cluster_addr":"172.21.15.73:6803/2083655348","heartbeat_back_addr":"172.21.15.73:6807/2083655348","heartbeat_front_addr":"172.21.15.73:6805/2083655348","state":["exists","up"]},{"osd":5,"uuid":"665f41c9-ee20-49cf-bf0e-fbe0c03d3aed","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6824","nonce":2803788401},{"type":"v1","addr":"172.21.15.73:6825","nonce":2803788401}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6826","nonce":2803788401},{"type":"v1","addr":"172.21.15.73:6827","nonce":2803788401}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6830","nonce":2803788401},{"type":"v1","addr":"172.21.15.73:6831","nonce":2803788401}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6828","nonce":2803788401},{"type":"v1","addr":"172.21.15.73:6829","nonce":2803788401}]},"public_addr":"172.21.15.73:6825/2803788401","cluster_addr":"172.21.15.73:6827/2803788401","heartbeat_back_addr":"172.21.15.73:6831/2803788401","heartbeat_front_addr":"172.21.15.73:6829/2803788401","state":["exists","up"]},{"osd":6,"uuid":"5790c6cc-bd56-4ce4-9a7c-0f0c3b59215c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6808","nonce":974108383},{"type":"v1","addr":"172.21.15.73:6809","nonce":974108383}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6810","nonce":974108383},{"type":"v1","addr":"172.21.15.73:6811","nonce":974108383}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6815","nonce":974108383},{"type":"v1","addr":"172.21.15.73:6817","nonce":974108383}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6812","nonce":974108383},{"type":"v1","addr":"172.21.15.73:6813","nonce":974108383}]},"public_addr":"172.21.15.73:6809/974108383","cluster_addr":"172.21.15.73:6811/974108383","heartbeat_back_addr":"172.21.15.73:6817/974108383","heartbeat_front_addr":"172.21.15.73:6813/974108383","state":["exists","up"]},{"osd":7,"uuid":"b66f4d2e-147e-4c9b-97dd-cbd59d33802e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6814","nonce":3772673248},{"type":"v1","addr":"172.21.15.73:6816","nonce":3772673248}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6818","nonce":3772673248},{"type":"v1","addr":"172.21.15.73:6819","nonce":3772673248}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6822","nonce":3772673248},{"type":"v1","addr":"172.21.15.73:6823","nonce":3772673248}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6820","nonce":3772673248},{"type":"v1","addr":"172.21.15.73:6821","nonce":3772673248}]},"public_addr":"172.21.15.73:6816/3772673248","cluster_addr":"172.21.15.73:6819/3772673248","heartbeat_back_addr":"172.21.15.73:6823/3772673248","heartbeat_front_addr":"172.21.15.73:6821/3772673248","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-05T18:56:04.115334+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-05T18:56:04.071250+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-05T18:56:04.044387+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-05T18:56:04.085389+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-05T18:56:04.090726+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-05T18:56:04.074529+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-05T18:56:04.058841+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-05T18:56:04.043054+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-05T18:56:54.866 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:54.864+0000 7f7e2ad03700 1 -- 172.21.15.46:0/2174564838 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7f7e0806ace0 msgr2=0x7f7e0806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:56:54.866 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:54.864+0000 7f7e2ad03700 1 --2- 172.21.15.46:0/2174564838 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7f7e0806ace0 0x7f7e0806d190 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f7e241520c0 tx=0x7f7e10009040 comp rx=0 tx=0).stop 2023-07-05T18:56:54.867 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:54.864+0000 7f7e2ad03700 1 -- 172.21.15.46:0/2174564838 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7e14003a30 msgr2=0x7f7e241f14f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:56:54.867 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:54.864+0000 7f7e2ad03700 1 --2- 172.21.15.46:0/2174564838 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7e14003a30 0x7f7e241f14f0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f7e1800c830 tx=0x7f7e18001b90 comp rx=0 tx=0).stop 2023-07-05T18:56:54.867 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:54.864+0000 7f7e2ad03700 1 -- 172.21.15.46:0/2174564838 shutdown_connections 2023-07-05T18:56:54.867 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:54.864+0000 7f7e2ad03700 1 --2- 172.21.15.46:0/2174564838 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7f7e0806ace0 0x7f7e0806d190 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:54.868 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:54.864+0000 7f7e2ad03700 1 --2- 172.21.15.46:0/2174564838 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7e24153930 0x7f7e24153dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:54.868 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:54.864+0000 7f7e2ad03700 1 --2- 172.21.15.46:0/2174564838 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7e14003a30 0x7f7e241f14f0 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:54.868 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:54.864+0000 7f7e2ad03700 1 --2- 172.21.15.46:0/2174564838 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f7e24152110 0x7f7e24152580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:54.869 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:54.864+0000 7f7e2ad03700 1 -- 172.21.15.46:0/2174564838 >> 172.21.15.46:0/2174564838 conn(0x7f7e240b0d50 msgr2=0x7f7e240cbd40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-05T18:56:54.869 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:54.864+0000 7f7e2ad03700 1 -- 172.21.15.46:0/2174564838 shutdown_connections 2023-07-05T18:56:54.869 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:54.864+0000 7f7e2ad03700 1 -- 172.21.15.46:0/2174564838 wait complete. 2023-07-05T18:56:54.878 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'rbd', 'create_time': '2023-07-05T18:56:07.729620+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': '.mgr', 'create_time': '2023-07-05T18:56:08.128122+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-07-05T18:56:12.954625+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-07-05T18:56:14.068396+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-07-05T18:56:54.879 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-07-05T18:56:55.007 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:55.006+0000 7fd2a4794700 1 Processor -- start 2023-07-05T18:56:55.007 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:55.006+0000 7fd2a4794700 1 -- start start 2023-07-05T18:56:55.009 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:55.007+0000 7fd2a4794700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fd29c0b1cd0 0x7fd29c0cb1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:56:55.009 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:55.007+0000 7fd2a4794700 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd29c0ce210 con 0x7fd29c06c280 2023-07-05T18:56:55.009 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:55.007+0000 7fd2a4794700 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd29c06b090 con 0x7fd29c0cb710 2023-07-05T18:56:55.010 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:55.007+0000 7fd2a4794700 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd29c06b370 con 0x7fd29c0b1cd0 2023-07-05T18:56:55.010 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:55.007+0000 7fd2a2d31700 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7fd29c06c280 0x7fd29c0cea80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:58440/0 (socket says 172.21.15.46:58440) 2023-07-05T18:56:55.010 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:55.007+0000 7fd2a2d31700 1 -- 172.21.15.46:0/3306902824 learned_addr learned my addr 172.21.15.46:0/3306902824 (peer_addr_for_me v1:172.21.15.46:0/0) 2023-07-05T18:56:55.010 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:55.007+0000 7fd2a2530700 1 --2- 172.21.15.46:0/3306902824 >> v2:172.21.15.73:3300/0 conn(0x7fd29c0b1cd0 0x7fd29c0cb1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:56:55.010 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:55.007+0000 7fd2a152e700 1 -- 172.21.15.46:0/3306902824 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 328376928 0 0) 0x7fd29c0ce210 con 0x7fd29c06c280 2023-07-05T18:56:55.010 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:55.007+0000 7fd2a152e700 1 -- 172.21.15.46:0/3306902824 --> v1:172.21.15.46:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd2880035b0 con 0x7fd29c06c280 2023-07-05T18:56:55.010 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:55.007+0000 7fd2a2530700 1 -- 172.21.15.46:0/3306902824 >> v1:172.21.15.73:6789/0 conn(0x7fd29c0cb710 legacy=0x7fd29c06bb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:56:55.010 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:55.007+0000 7fd2a152e700 1 -- 172.21.15.46:0/3306902824 <== mon.0 v1:172.21.15.46:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3982660782 0 0) 0x7fd2880035b0 con 0x7fd29c06c280 2023-07-05T18:56:55.011 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:55.007+0000 7fd2a2530700 1 -- 172.21.15.46:0/3306902824 >> v1:172.21.15.46:6789/0 conn(0x7fd29c06c280 legacy=0x7fd29c0cea80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:56:55.011 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:55.007+0000 7fd2a2530700 1 -- 172.21.15.46:0/3306902824 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd29c06b650 con 0x7fd29c0b1cd0 2023-07-05T18:56:55.011 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:55.008+0000 7fd2a2530700 1 --2- 172.21.15.46:0/3306902824 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd29c0b1cd0 0x7fd29c0cb1d0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fd298009840 tx=0x7fd298009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=53dbc0b0b121a2c8 server_cookie=0 in_seq=0 out_seq=0 2023-07-05T18:56:55.011 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:55.008+0000 7fd2a152e700 1 -- 172.21.15.46:0/3306902824 <== mon.1 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2940019f0 con 0x7fd29c0b1cd0 2023-07-05T18:56:55.011 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:55.008+0000 7fd2a152e700 1 -- 172.21.15.46:0/3306902824 <== mon.1 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd298004030 con 0x7fd29c0b1cd0 2023-07-05T18:56:55.011 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:55.008+0000 7fd2a152e700 1 -- 172.21.15.46:0/3306902824 <== mon.1 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2980043a0 con 0x7fd29c0b1cd0 2023-07-05T18:56:55.011 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:55.008+0000 7fd2a4794700 1 -- 172.21.15.46:0/3306902824 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd29c0b1cd0 msgr2=0x7fd29c0cb1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:56:55.012 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:55.008+0000 7fd2a4794700 1 --2- 172.21.15.46:0/3306902824 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd29c0b1cd0 0x7fd29c0cb1d0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fd298009840 tx=0x7fd298009b50 comp rx=0 tx=0).stop 2023-07-05T18:56:55.012 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:55.008+0000 7fd2a4794700 1 -- 172.21.15.46:0/3306902824 shutdown_connections 2023-07-05T18:56:55.012 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:55.008+0000 7fd2a4794700 1 --2- 172.21.15.46:0/3306902824 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd29c0b1cd0 0x7fd29c0cb1d0 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:55.012 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:55.008+0000 7fd2a4794700 1 -- 172.21.15.46:0/3306902824 >> 172.21.15.46:0/3306902824 conn(0x7fd29c0664b0 msgr2=0x7fd29c099de0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-05T18:56:55.012 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:55.008+0000 7fd2a4794700 1 -- 172.21.15.46:0/3306902824 shutdown_connections 2023-07-05T18:56:55.012 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:55.008+0000 7fd2a4794700 1 -- 172.21.15.46:0/3306902824 wait complete. 2023-07-05T18:56:55.015 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:55.010+0000 7fd2a4794700 1 Processor -- start 2023-07-05T18:56:55.017 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:55.010+0000 7fd2a4794700 1 -- start start 2023-07-05T18:56:55.017 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:55.010+0000 7fd2a4794700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd29c06c280 0x7fd29c0c8060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:56:55.017 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:55.010+0000 7fd2a4794700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd29c0b1cd0 0x7fd29c1f52b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:56:55.017 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:55.010+0000 7fd2a4794700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fd29c0cb710 0x7fd29c0ca5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:56:55.018 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:55.010+0000 7fd2a4794700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd29c0c9b20 con 0x7fd29c06c280 2023-07-05T18:56:55.018 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:55.010+0000 7fd2a4794700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd29c1f5d00 con 0x7fd29c0b1cd0 2023-07-05T18:56:55.018 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:55.010+0000 7fd2a4794700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd29c1f5fe0 con 0x7fd29c0cb710 2023-07-05T18:56:55.018 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:55.010+0000 7fd2a2530700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd29c06c280 0x7fd29c0c8060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:56:55.018 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:55.010+0000 7fd2a2530700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd29c06c280 0x7fd29c0c8060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:59170/0 (socket says 172.21.15.46:59170) 2023-07-05T18:56:55.018 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:55.010+0000 7fd2a2530700 1 -- 172.21.15.46:0/3447373710 learned_addr learned my addr 172.21.15.46:0/3447373710 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-07-05T18:56:55.018 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:55.011+0000 7fd2a2d31700 1 --2- 172.21.15.46:0/3447373710 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fd29c0cb710 0x7fd29c0ca5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:56:55.018 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:55.011+0000 7fd2a1d2f700 1 --2- 172.21.15.46:0/3447373710 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd29c0b1cd0 0x7fd29c1f52b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:56:55.019 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:55.011+0000 7fd2a2530700 1 -- 172.21.15.46:0/3447373710 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fd29c0cb710 msgr2=0x7fd29c0ca5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:56:55.019 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:55.011+0000 7fd2a2530700 1 --2- 172.21.15.46:0/3447373710 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fd29c0cb710 0x7fd29c0ca5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:55.019 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:55.011+0000 7fd2a2530700 1 -- 172.21.15.46:0/3447373710 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd29c0b1cd0 msgr2=0x7fd29c1f52b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:56:55.019 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:55.011+0000 7fd2a2530700 1 --2- 172.21.15.46:0/3447373710 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd29c0b1cd0 0x7fd29c1f52b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:55.019 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:55.011+0000 7fd2a2530700 1 -- 172.21.15.46:0/3447373710 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd2980094a0 con 0x7fd29c06c280 2023-07-05T18:56:55.019 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:55.011+0000 7fd2a2530700 1 --2- 172.21.15.46:0/3447373710 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd29c06c280 0x7fd29c0c8060 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7fd298009b90 tx=0x7fd298004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-05T18:56:55.019 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:55.011+0000 7fd292ffd700 1 -- 172.21.15.46:0/3447373710 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd298003e80 con 0x7fd29c06c280 2023-07-05T18:56:55.020 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:55.011+0000 7fd292ffd700 1 -- 172.21.15.46:0/3447373710 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd298010590 con 0x7fd29c06c280 2023-07-05T18:56:55.021 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:55.011+0000 7fd2a4794700 1 -- 172.21.15.46:0/3447373710 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd29c0c9da0 con 0x7fd29c06c280 2023-07-05T18:56:55.021 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:55.011+0000 7fd292ffd700 1 -- 172.21.15.46:0/3447373710 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd298010920 con 0x7fd29c06c280 2023-07-05T18:56:55.021 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:55.011+0000 7fd2a4794700 1 -- 172.21.15.46:0/3447373710 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd29c0c85a0 con 0x7fd29c06c280 2023-07-05T18:56:55.021 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:55.012+0000 7fd2a4794700 1 -- 172.21.15.46:0/3447373710 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd29c0672e0 con 0x7fd29c06c280 2023-07-05T18:56:55.022 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:55.013+0000 7fd292ffd700 1 -- 172.21.15.46:0/3447373710 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fd298010a80 con 0x7fd29c06c280 2023-07-05T18:56:55.022 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:55.013+0000 7fd292ffd700 1 --2- 172.21.15.46:0/3447373710 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7fd28006ace0 0x7fd28006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:56:55.022 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:55.013+0000 7fd292ffd700 1 -- 172.21.15.46:0/3447373710 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fd29808ad90 con 0x7fd29c06c280 2023-07-05T18:56:55.023 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:55.013+0000 7fd2a1d2f700 1 --2- 172.21.15.46:0/3447373710 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7fd28006ace0 0x7fd28006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:56:55.023 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:55.014+0000 7fd2a1d2f700 1 --2- 172.21.15.46:0/3447373710 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7fd28006ace0 0x7fd28006d190 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fd29c0c4640 tx=0x7fd28c009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-05T18:56:55.023 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:55.018+0000 7fd292ffd700 1 -- 172.21.15.46:0/3447373710 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fd298055ed0 con 0x7fd29c06c280 2023-07-05T18:56:55.219 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:55.218+0000 7fd2a4794700 1 -- 172.21.15.46:0/3447373710 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fd29c0cef40 con 0x7fd29c06c280 2023-07-05T18:56:55.220 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:55.218+0000 7fd292ffd700 1 -- 172.21.15.46:0/3447373710 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v21) v1 ==== 92+0+10 (secure 0 0 0) 0x7fd2980594f0 con 0x7fd29c06c280 2023-07-05T18:56:55.220 INFO:teuthology.orchestra.run.smithi046.stdout:pg_num: 8 2023-07-05T18:56:55.221 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:55.220+0000 7fd2a4794700 1 -- 172.21.15.46:0/3447373710 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7fd28006ace0 msgr2=0x7fd28006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:56:55.222 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:55.220+0000 7fd2a4794700 1 --2- 172.21.15.46:0/3447373710 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7fd28006ace0 0x7fd28006d190 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fd29c0c4640 tx=0x7fd28c009040 comp rx=0 tx=0).stop 2023-07-05T18:56:55.222 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:55.220+0000 7fd2a4794700 1 -- 172.21.15.46:0/3447373710 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd29c06c280 msgr2=0x7fd29c0c8060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:56:55.222 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:55.220+0000 7fd2a4794700 1 --2- 172.21.15.46:0/3447373710 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd29c06c280 0x7fd29c0c8060 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7fd298009b90 tx=0x7fd298004750 comp rx=0 tx=0).stop 2023-07-05T18:56:55.222 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:55.220+0000 7fd2a4794700 1 -- 172.21.15.46:0/3447373710 shutdown_connections 2023-07-05T18:56:55.222 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:55.220+0000 7fd2a4794700 1 --2- 172.21.15.46:0/3447373710 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7fd28006ace0 0x7fd28006d190 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:55.222 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:55.220+0000 7fd2a4794700 1 --2- 172.21.15.46:0/3447373710 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fd29c0cb710 0x7fd29c0ca5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:55.222 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:55.220+0000 7fd2a4794700 1 --2- 172.21.15.46:0/3447373710 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd29c06c280 0x7fd29c0c8060 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:55.222 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:55.220+0000 7fd2a4794700 1 --2- 172.21.15.46:0/3447373710 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd29c0b1cd0 0x7fd29c1f52b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:55.223 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:55.220+0000 7fd2a4794700 1 -- 172.21.15.46:0/3447373710 >> 172.21.15.46:0/3447373710 conn(0x7fd29c0664b0 msgr2=0x7fd29c15bc30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-05T18:56:55.223 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:55.221+0000 7fd2a4794700 1 -- 172.21.15.46:0/3447373710 shutdown_connections 2023-07-05T18:56:55.223 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:55.221+0000 7fd2a4794700 1 -- 172.21.15.46:0/3447373710 wait complete. 2023-07-05T18:56:55.234 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-07-05T18:56:55.362 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:55.361+0000 7fc945467700 1 Processor -- start 2023-07-05T18:56:55.363 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:55.361+0000 7fc945467700 1 -- start start 2023-07-05T18:56:55.363 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:55.363+0000 7fc945467700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fc9401594f0 0x7fc9400cd690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:56:55.364 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:55.363+0000 7fc945467700 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc94015e040 con 0x7fc9400b1b00 2023-07-05T18:56:55.364 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:55.363+0000 7fc945467700 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc94015dbb0 con 0x7fc9400cdbd0 2023-07-05T18:56:55.364 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:55.363+0000 7fc945467700 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc9400ce200 con 0x7fc9401594f0 2023-07-05T18:56:55.364 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:55.363+0000 7fc93f7fe700 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7fc9400b1b00 0x7fc9400c9fc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:58454/0 (socket says 172.21.15.46:58454) 2023-07-05T18:56:55.364 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:55.363+0000 7fc93f7fe700 1 -- 172.21.15.46:0/1160819924 learned_addr learned my addr 172.21.15.46:0/1160819924 (peer_addr_for_me v1:172.21.15.46:0/0) 2023-07-05T18:56:55.367 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:55.363+0000 7fc93effd700 1 --2- 172.21.15.46:0/1160819924 >> v2:172.21.15.73:3300/0 conn(0x7fc9401594f0 0x7fc9400cd690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:56:55.367 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:55.363+0000 7fc93dffb700 1 -- 172.21.15.46:0/1160819924 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 205906165 0 0) 0x7fc94015e040 con 0x7fc9400b1b00 2023-07-05T18:56:55.367 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:55.363+0000 7fc93dffb700 1 -- 172.21.15.46:0/1160819924 --> v1:172.21.15.46:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc9280035b0 con 0x7fc9400b1b00 2023-07-05T18:56:55.367 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:55.363+0000 7fc93dffb700 1 -- 172.21.15.46:0/1160819924 <== mon.0 v1:172.21.15.46:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2709307859 0 0) 0x7fc9280035b0 con 0x7fc9400b1b00 2023-07-05T18:56:55.367 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:55.363+0000 7fc93dffb700 1 -- 172.21.15.46:0/1160819924 >> v2:172.21.15.73:3300/0 conn(0x7fc9401594f0 msgr2=0x7fc9400cd690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-05T18:56:55.367 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:55.363+0000 7fc93dffb700 1 --2- 172.21.15.46:0/1160819924 >> v2:172.21.15.73:3300/0 conn(0x7fc9401594f0 0x7fc9400cd690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:55.368 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:55.363+0000 7fc93dffb700 1 -- 172.21.15.46:0/1160819924 >> v1:172.21.15.73:6789/0 conn(0x7fc9400cdbd0 legacy=0x7fc9400b13f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:56:55.368 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:55.363+0000 7fc93dffb700 1 -- 172.21.15.46:0/1160819924 --> v1:172.21.15.46:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc9400cc1c0 con 0x7fc9400b1b00 2023-07-05T18:56:55.368 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:55.363+0000 7fc93dffb700 1 -- 172.21.15.46:0/1160819924 <== mon.0 v1:172.21.15.46:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2195585215 0 0) 0x7fc9380019f0 con 0x7fc9400b1b00 2023-07-05T18:56:55.368 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:55.363+0000 7fc93effd700 1 --2- 172.21.15.46:0/1160819924 >> v2:172.21.15.73:3300/0 conn(0x7fc9401594f0 0x7fc9400cd690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-05T18:56:55.368 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:55.363+0000 7fc93dffb700 1 -- 172.21.15.46:0/1160819924 >> v1:172.21.15.46:6789/0 conn(0x7fc9400b1b00 legacy=0x7fc9400c9fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:56:55.368 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:55.363+0000 7fc93dffb700 1 --2- 172.21.15.46:0/1160819924 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc928003a00 0x7fc928003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:56:55.368 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:55.363+0000 7fc93dffb700 1 --2- 172.21.15.46:0/1160819924 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fc928004850 0x7fc928004cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:56:55.369 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:55.363+0000 7fc93dffb700 1 --2- 172.21.15.46:0/1160819924 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc928005200 0x7fc92800ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:56:55.369 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:55.363+0000 7fc93dffb700 1 -- 172.21.15.46:0/1160819924 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9400ce200 con 0x7fc928003a00 2023-07-05T18:56:55.369 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:55.363+0000 7fc93dffb700 1 -- 172.21.15.46:0/1160819924 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc92800c110 con 0x7fc928005200 2023-07-05T18:56:55.369 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:55.363+0000 7fc93dffb700 1 -- 172.21.15.46:0/1160819924 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc92800e4e0 con 0x7fc928004850 2023-07-05T18:56:55.369 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:55.364+0000 7fc93effd700 1 --2- 172.21.15.46:0/1160819924 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc928003a00 0x7fc928003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:56:55.369 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:55.364+0000 7fc93e7fc700 1 --2- 172.21.15.46:0/1160819924 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fc928004850 0x7fc928004cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:56:55.369 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:55.364+0000 7fc93f7fe700 1 --2- 172.21.15.46:0/1160819924 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc928005200 0x7fc92800ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:56:55.369 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:55.364+0000 7fc93effd700 1 -- 172.21.15.46:0/1160819924 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fc928004850 msgr2=0x7fc928004cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-05T18:56:55.370 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:55.364+0000 7fc93effd700 1 --2- 172.21.15.46:0/1160819924 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fc928004850 0x7fc928004cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:55.370 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:55.364+0000 7fc93effd700 1 -- 172.21.15.46:0/1160819924 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc928005200 msgr2=0x7fc92800ba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-05T18:56:55.370 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:55.364+0000 7fc93effd700 1 --2- 172.21.15.46:0/1160819924 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc928005200 0x7fc92800ba10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:55.370 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:55.364+0000 7fc93effd700 1 -- 172.21.15.46:0/1160819924 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc9280035b0 con 0x7fc928003a00 2023-07-05T18:56:55.370 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:55.364+0000 7fc93f7fe700 1 --2- 172.21.15.46:0/1160819924 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc928005200 0x7fc92800ba10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-05T18:56:55.370 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:55.364+0000 7fc93f7fe700 1 -- 172.21.15.46:0/1160819924 reap_dead start 2023-07-05T18:56:55.370 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:55.364+0000 7fc93effd700 1 --2- 172.21.15.46:0/1160819924 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc928003a00 0x7fc928003e10 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7fc934009d30 tx=0x7fc928005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=913a593156847d52 server_cookie=0 in_seq=0 out_seq=0 2023-07-05T18:56:55.370 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:55.364+0000 7fc93dffb700 1 -- 172.21.15.46:0/1160819924 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc934009e80 con 0x7fc928003a00 2023-07-05T18:56:55.371 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:55.364+0000 7fc93dffb700 1 -- 172.21.15.46:0/1160819924 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc93400e9a0 con 0x7fc928003a00 2023-07-05T18:56:55.371 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:55.364+0000 7fc93dffb700 1 -- 172.21.15.46:0/1160819924 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc93400ed10 con 0x7fc928003a00 2023-07-05T18:56:55.371 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:55.365+0000 7fc945467700 1 -- 172.21.15.46:0/1160819924 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc928003a00 msgr2=0x7fc928003e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:56:55.371 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:55.365+0000 7fc945467700 1 --2- 172.21.15.46:0/1160819924 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc928003a00 0x7fc928003e10 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7fc934009d30 tx=0x7fc928005880 comp rx=0 tx=0).stop 2023-07-05T18:56:55.371 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:55.365+0000 7fc945467700 1 -- 172.21.15.46:0/1160819924 shutdown_connections 2023-07-05T18:56:55.371 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:55.365+0000 7fc945467700 1 --2- 172.21.15.46:0/1160819924 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc928003a00 0x7fc928003e10 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:55.371 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:55.365+0000 7fc945467700 1 -- 172.21.15.46:0/1160819924 >> 172.21.15.46:0/1160819924 conn(0x7fc94006bba0 msgr2=0x7fc9400cc3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-05T18:56:55.372 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:55.365+0000 7fc945467700 1 -- 172.21.15.46:0/1160819924 shutdown_connections 2023-07-05T18:56:55.372 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:55.365+0000 7fc945467700 1 -- 172.21.15.46:0/1160819924 wait complete. 2023-07-05T18:56:55.372 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:55.366+0000 7fc945467700 1 Processor -- start 2023-07-05T18:56:55.372 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:55.366+0000 7fc945467700 1 -- start start 2023-07-05T18:56:55.376 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:55.367+0000 7fc945467700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fc928003a00 0x7fc940157440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:56:55.376 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:55.367+0000 7fc945467700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc9400b27a0 0x7fc9400b2c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:56:55.376 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:55.367+0000 7fc945467700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc9400b48b0 0x7fc9400b4d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:56:55.377 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:55.367+0000 7fc945467700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9400b3150 con 0x7fc9400b27a0 2023-07-05T18:56:55.377 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:55.367+0000 7fc945467700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc940157980 con 0x7fc9400b48b0 2023-07-05T18:56:55.377 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:55.367+0000 7fc945467700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc9400b5630 con 0x7fc928003a00 2023-07-05T18:56:55.377 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:55.367+0000 7fc93e7fc700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc9400b27a0 0x7fc9400b2c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:56:55.377 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:55.367+0000 7fc93e7fc700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc9400b27a0 0x7fc9400b2c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:59192/0 (socket says 172.21.15.46:59192) 2023-07-05T18:56:55.377 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:55.367+0000 7fc93e7fc700 1 -- 172.21.15.46:0/227546246 learned_addr learned my addr 172.21.15.46:0/227546246 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-07-05T18:56:55.377 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:55.367+0000 7fc93effd700 1 --2- 172.21.15.46:0/227546246 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fc928003a00 0x7fc940157440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:56:55.378 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:55.367+0000 7fc93f7fe700 1 --2- 172.21.15.46:0/227546246 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc9400b48b0 0x7fc9400b4d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:56:55.378 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:55.367+0000 7fc93e7fc700 1 -- 172.21.15.46:0/227546246 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fc928003a00 msgr2=0x7fc940157440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:56:55.378 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:55.367+0000 7fc93e7fc700 1 --2- 172.21.15.46:0/227546246 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fc928003a00 0x7fc940157440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:55.379 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:55.367+0000 7fc93e7fc700 1 -- 172.21.15.46:0/227546246 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc9400b48b0 msgr2=0x7fc9400b4d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:56:55.379 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:55.367+0000 7fc93e7fc700 1 --2- 172.21.15.46:0/227546246 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc9400b48b0 0x7fc9400b4d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:55.379 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:55.367+0000 7fc93e7fc700 1 -- 172.21.15.46:0/227546246 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc9400c3ca0 con 0x7fc9400b27a0 2023-07-05T18:56:55.379 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:55.367+0000 7fc93f7fe700 1 --2- 172.21.15.46:0/227546246 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc9400b48b0 0x7fc9400b4d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-05T18:56:55.380 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:55.368+0000 7fc93e7fc700 1 --2- 172.21.15.46:0/227546246 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc9400b27a0 0x7fc9400b2c10 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7fc93000f820 tx=0x7fc93000fb30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-05T18:56:55.380 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:55.368+0000 7fc9277fe700 1 -- 172.21.15.46:0/227546246 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9300052e0 con 0x7fc9400b27a0 2023-07-05T18:56:55.380 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:55.368+0000 7fc9277fe700 1 -- 172.21.15.46:0/227546246 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc930005440 con 0x7fc9400b27a0 2023-07-05T18:56:55.380 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:55.368+0000 7fc945467700 1 -- 172.21.15.46:0/227546246 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc9400c3f80 con 0x7fc9400b27a0 2023-07-05T18:56:55.380 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:55.368+0000 7fc9277fe700 1 -- 172.21.15.46:0/227546246 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9300038c0 con 0x7fc9400b27a0 2023-07-05T18:56:55.380 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:55.368+0000 7fc945467700 1 -- 172.21.15.46:0/227546246 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc9400c4540 con 0x7fc9400b27a0 2023-07-05T18:56:55.380 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:55.369+0000 7fc945467700 1 -- 172.21.15.46:0/227546246 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc9400c46d0 con 0x7fc9400b27a0 2023-07-05T18:56:55.381 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:55.369+0000 7fc9277fe700 1 -- 172.21.15.46:0/227546246 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fc930003a20 con 0x7fc9400b27a0 2023-07-05T18:56:55.381 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:55.370+0000 7fc9277fe700 1 --2- 172.21.15.46:0/227546246 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7fc92c06ace0 0x7fc92c06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:56:55.381 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:55.370+0000 7fc9277fe700 1 -- 172.21.15.46:0/227546246 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fc930089280 con 0x7fc9400b27a0 2023-07-05T18:56:55.381 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:55.370+0000 7fc93effd700 1 --2- 172.21.15.46:0/227546246 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7fc92c06ace0 0x7fc92c06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:56:55.381 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:55.370+0000 7fc93effd700 1 --2- 172.21.15.46:0/227546246 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7fc92c06ace0 0x7fc92c06d190 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fc9340090b0 tx=0x7fc93401e040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-05T18:56:55.382 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:55.374+0000 7fc9277fe700 1 -- 172.21.15.46:0/227546246 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fc930054290 con 0x7fc9400b27a0 2023-07-05T18:56:55.574 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:55.572+0000 7fc945467700 1 -- 172.21.15.46:0/227546246 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fc9400672e0 con 0x7fc9400b27a0 2023-07-05T18:56:55.574 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:55.573+0000 7fc9277fe700 1 -- 172.21.15.46:0/227546246 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v21) v1 ==== 93+0+10 (secure 0 0 0) 0x7fc93005d0a0 con 0x7fc9400b27a0 2023-07-05T18:56:55.574 INFO:teuthology.orchestra.run.smithi046.stdout:pg_num: 1 2023-07-05T18:56:55.575 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:55.575+0000 7fc945467700 1 -- 172.21.15.46:0/227546246 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7fc92c06ace0 msgr2=0x7fc92c06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:56:55.576 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:55.575+0000 7fc945467700 1 --2- 172.21.15.46:0/227546246 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7fc92c06ace0 0x7fc92c06d190 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fc9340090b0 tx=0x7fc93401e040 comp rx=0 tx=0).stop 2023-07-05T18:56:55.576 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:55.575+0000 7fc945467700 1 -- 172.21.15.46:0/227546246 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc9400b27a0 msgr2=0x7fc9400b2c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:56:55.577 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:55.575+0000 7fc945467700 1 --2- 172.21.15.46:0/227546246 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc9400b27a0 0x7fc9400b2c10 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7fc93000f820 tx=0x7fc93000fb30 comp rx=0 tx=0).stop 2023-07-05T18:56:55.578 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:55.575+0000 7fc945467700 1 -- 172.21.15.46:0/227546246 shutdown_connections 2023-07-05T18:56:55.578 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:55.575+0000 7fc945467700 1 --2- 172.21.15.46:0/227546246 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7fc92c06ace0 0x7fc92c06d190 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:55.578 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:55.575+0000 7fc945467700 1 --2- 172.21.15.46:0/227546246 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc9400b48b0 0x7fc9400b4d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:55.578 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:55.575+0000 7fc945467700 1 --2- 172.21.15.46:0/227546246 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fc928003a00 0x7fc940157440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:55.579 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:55.575+0000 7fc945467700 1 --2- 172.21.15.46:0/227546246 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc9400b27a0 0x7fc9400b2c10 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:55.579 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:55.575+0000 7fc945467700 1 -- 172.21.15.46:0/227546246 >> 172.21.15.46:0/227546246 conn(0x7fc94006bba0 msgr2=0x7fc9401528f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-05T18:56:55.580 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:55.575+0000 7fc945467700 1 -- 172.21.15.46:0/227546246 shutdown_connections 2023-07-05T18:56:55.580 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:55.575+0000 7fc945467700 1 -- 172.21.15.46:0/227546246 wait complete. 2023-07-05T18:56:55.589 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-07-05T18:56:55.718 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:55.717+0000 7f3e9dc74700 1 Processor -- start 2023-07-05T18:56:55.719 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:55.717+0000 7f3e9dc74700 1 -- start start 2023-07-05T18:56:55.726 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:55.718+0000 7f3e9dc74700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f3e9815c6f0 0x7f3e98160a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:56:55.727 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:55.718+0000 7f3e9dc74700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f3e980b15d0 0x7f3e980b1a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:56:55.727 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:55.718+0000 7f3e9dc74700 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3e980b1f60 con 0x7f3e98069e00 2023-07-05T18:56:55.727 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:55.718+0000 7f3e9dc74700 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3e98160fc0 con 0x7f3e980b15d0 2023-07-05T18:56:55.727 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:55.718+0000 7f3e9dc74700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3e980ce230 con 0x7f3e9815c6f0 2023-07-05T18:56:55.728 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:55.718+0000 7f3e96ffd700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f3e980b15d0 0x7f3e980b1a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:56:55.728 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:55.718+0000 7f3e96ffd700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f3e980b15d0 0x7f3e980b1a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:59200/0 (socket says 172.21.15.46:59200) 2023-07-05T18:56:55.729 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:55.718+0000 7f3e96ffd700 1 -- 172.21.15.46:0/3372575847 learned_addr learned my addr 172.21.15.46:0/3372575847 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-07-05T18:56:55.730 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:55.718+0000 7f3e977fe700 1 --2- 172.21.15.46:0/3372575847 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f3e9815c6f0 0x7f3e98160a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:56:55.731 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:55.718+0000 7f3e96ffd700 1 -- 172.21.15.46:0/3372575847 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f3e9815c6f0 msgr2=0x7f3e98160a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-05T18:56:55.732 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:55.718+0000 7f3e96ffd700 1 --2- 172.21.15.46:0/3372575847 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f3e9815c6f0 0x7f3e98160a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:55.734 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:55.718+0000 7f3e96ffd700 1 -- 172.21.15.46:0/3372575847 >> v1:172.21.15.73:6789/0 conn(0x7f3e98069e00 legacy=0x7f3e9806a280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:56:55.734 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:55.719+0000 7f3e96ffd700 1 -- 172.21.15.46:0/3372575847 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3e980ce510 con 0x7f3e980b15d0 2023-07-05T18:56:55.734 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:55.719+0000 7f3e96ffd700 1 --2- 172.21.15.46:0/3372575847 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3e980b15d0 0x7f3e980b1a20 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f3e800098f0 tx=0x7f3e80009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1cd3ae31a7544fad server_cookie=0 in_seq=0 out_seq=0 2023-07-05T18:56:55.734 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:55.719+0000 7f3e967fc700 1 -- 172.21.15.46:0/3372575847 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e80011830 con 0x7f3e980b15d0 2023-07-05T18:56:55.735 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:55.719+0000 7f3e967fc700 1 -- 172.21.15.46:0/3372575847 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3e80011990 con 0x7f3e980b15d0 2023-07-05T18:56:55.735 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:55.719+0000 7f3e967fc700 1 -- 172.21.15.46:0/3372575847 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e80011d20 con 0x7f3e980b15d0 2023-07-05T18:56:55.735 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:55.719+0000 7f3e9dc74700 1 -- 172.21.15.46:0/3372575847 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3e980b15d0 msgr2=0x7f3e980b1a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:56:55.736 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:55.719+0000 7f3e9dc74700 1 --2- 172.21.15.46:0/3372575847 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3e980b15d0 0x7f3e980b1a20 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f3e800098f0 tx=0x7f3e80009c00 comp rx=0 tx=0).stop 2023-07-05T18:56:55.736 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:55.719+0000 7f3e9dc74700 1 -- 172.21.15.46:0/3372575847 shutdown_connections 2023-07-05T18:56:55.736 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:55.719+0000 7f3e9dc74700 1 --2- 172.21.15.46:0/3372575847 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f3e9815c6f0 0x7f3e98160a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:55.737 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:55.719+0000 7f3e9dc74700 1 --2- 172.21.15.46:0/3372575847 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3e980b15d0 0x7f3e980b1a20 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:55.737 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:55.719+0000 7f3e9dc74700 1 -- 172.21.15.46:0/3372575847 >> 172.21.15.46:0/3372575847 conn(0x7f3e980cf970 msgr2=0x7f3e980cfd40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-05T18:56:55.737 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:55.719+0000 7f3e9dc74700 1 -- 172.21.15.46:0/3372575847 shutdown_connections 2023-07-05T18:56:55.738 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:55.719+0000 7f3e9dc74700 1 -- 172.21.15.46:0/3372575847 wait complete. 2023-07-05T18:56:55.738 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:55.721+0000 7f3e9dc74700 1 Processor -- start 2023-07-05T18:56:55.738 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:55.721+0000 7f3e9dc74700 1 -- start start 2023-07-05T18:56:55.739 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:55.721+0000 7f3e9dc74700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f3e98069e00 0x7f3e98159200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:56:55.739 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:55.721+0000 7f3e9dc74700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3e980b15d0 0x7f3e980af940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:56:55.739 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:55.722+0000 7f3e9dc74700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3e9815c6f0 0x7f3e980afe80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:56:55.739 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:55.722+0000 7f3e9dc74700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e980b04b0 con 0x7f3e980b15d0 2023-07-05T18:56:55.740 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:55.722+0000 7f3e9dc74700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e980b3350 con 0x7f3e9815c6f0 2023-07-05T18:56:55.740 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:55.722+0000 7f3e9dc74700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3e980b3630 con 0x7f3e98069e00 2023-07-05T18:56:55.740 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:55.722+0000 7f3e96ffd700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3e980b15d0 0x7f3e980af940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:56:55.741 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:55.722+0000 7f3e96ffd700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3e980b15d0 0x7f3e980af940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:59206/0 (socket says 172.21.15.46:59206) 2023-07-05T18:56:55.741 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:55.722+0000 7f3e96ffd700 1 -- 172.21.15.46:0/2074448061 learned_addr learned my addr 172.21.15.46:0/2074448061 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-07-05T18:56:55.741 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:55.722+0000 7f3e977fe700 1 --2- 172.21.15.46:0/2074448061 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f3e98069e00 0x7f3e98159200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:56:55.741 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:55.722+0000 7f3e97fff700 1 --2- 172.21.15.46:0/2074448061 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3e9815c6f0 0x7f3e980afe80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:56:55.742 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:55.722+0000 7f3e96ffd700 1 -- 172.21.15.46:0/2074448061 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f3e98069e00 msgr2=0x7f3e98159200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:56:55.742 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:55.722+0000 7f3e96ffd700 1 --2- 172.21.15.46:0/2074448061 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f3e98069e00 0x7f3e98159200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:55.745 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:55.722+0000 7f3e96ffd700 1 -- 172.21.15.46:0/2074448061 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3e9815c6f0 msgr2=0x7f3e980afe80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:56:55.746 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:55.722+0000 7f3e96ffd700 1 --2- 172.21.15.46:0/2074448061 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3e9815c6f0 0x7f3e980afe80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:55.746 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:55.722+0000 7f3e96ffd700 1 -- 172.21.15.46:0/2074448061 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3e80009550 con 0x7f3e980b15d0 2023-07-05T18:56:55.750 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:55.722+0000 7f3e96ffd700 1 --2- 172.21.15.46:0/2074448061 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3e980b15d0 0x7f3e980af940 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f3e80000c00 tx=0x7f3e80004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-05T18:56:55.751 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:55.722+0000 7f3e8ffff700 1 -- 172.21.15.46:0/2074448061 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e80004400 con 0x7f3e980b15d0 2023-07-05T18:56:55.751 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:55.722+0000 7f3e8ffff700 1 -- 172.21.15.46:0/2074448061 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3e8001f070 con 0x7f3e980b15d0 2023-07-05T18:56:55.751 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:55.722+0000 7f3e9dc74700 1 -- 172.21.15.46:0/2074448061 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3e980b3910 con 0x7f3e980b15d0 2023-07-05T18:56:55.751 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:55.722+0000 7f3e8ffff700 1 -- 172.21.15.46:0/2074448061 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e800038e0 con 0x7f3e980b15d0 2023-07-05T18:56:55.752 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:55.722+0000 7f3e9dc74700 1 -- 172.21.15.46:0/2074448061 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3e9815f8f0 con 0x7f3e980b15d0 2023-07-05T18:56:55.752 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:55.723+0000 7f3e9dc74700 1 -- 172.21.15.46:0/2074448061 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3e980672e0 con 0x7f3e980b15d0 2023-07-05T18:56:55.752 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:55.724+0000 7f3e8ffff700 1 -- 172.21.15.46:0/2074448061 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f3e80021030 con 0x7f3e980b15d0 2023-07-05T18:56:55.752 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:55.724+0000 7f3e8ffff700 1 --2- 172.21.15.46:0/2074448061 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7f3e7806ace0 0x7f3e7806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:56:55.753 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:55.724+0000 7f3e8ffff700 1 -- 172.21.15.46:0/2074448061 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f3e8008a7f0 con 0x7f3e980b15d0 2023-07-05T18:56:55.753 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:55.724+0000 7f3e977fe700 1 --2- 172.21.15.46:0/2074448061 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7f3e7806ace0 0x7f3e7806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:56:55.755 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:55.725+0000 7f3e977fe700 1 --2- 172.21.15.46:0/2074448061 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7f3e7806ace0 0x7f3e7806d190 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f3e981f53b0 tx=0x7f3e88009210 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-05T18:56:55.755 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:55.729+0000 7f3e8ffff700 1 -- 172.21.15.46:0/2074448061 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f3e80055a80 con 0x7f3e980b15d0 2023-07-05T18:56:55.926 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:55.925+0000 7f3e9dc74700 1 -- 172.21.15.46:0/2074448061 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f3e980c92b0 con 0x7f3e980b15d0 2023-07-05T18:56:55.926 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:55.925+0000 7f3e8ffff700 1 -- 172.21.15.46:0/2074448061 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v21) v1 ==== 104+0+11 (secure 0 0 0) 0x7f3e800590a0 con 0x7f3e980b15d0 2023-07-05T18:56:55.927 INFO:teuthology.orchestra.run.smithi046.stdout:pg_num: 32 2023-07-05T18:56:55.929 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:55.927+0000 7f3e9dc74700 1 -- 172.21.15.46:0/2074448061 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7f3e7806ace0 msgr2=0x7f3e7806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:56:55.929 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:55.927+0000 7f3e9dc74700 1 --2- 172.21.15.46:0/2074448061 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7f3e7806ace0 0x7f3e7806d190 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f3e981f53b0 tx=0x7f3e88009210 comp rx=0 tx=0).stop 2023-07-05T18:56:55.929 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:55.928+0000 7f3e9dc74700 1 -- 172.21.15.46:0/2074448061 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3e980b15d0 msgr2=0x7f3e980af940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:56:55.929 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:55.928+0000 7f3e9dc74700 1 --2- 172.21.15.46:0/2074448061 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3e980b15d0 0x7f3e980af940 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f3e80000c00 tx=0x7f3e80004750 comp rx=0 tx=0).stop 2023-07-05T18:56:55.929 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:55.928+0000 7f3e9dc74700 1 -- 172.21.15.46:0/2074448061 shutdown_connections 2023-07-05T18:56:55.929 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:55.928+0000 7f3e9dc74700 1 --2- 172.21.15.46:0/2074448061 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7f3e7806ace0 0x7f3e7806d190 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:55.929 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:55.928+0000 7f3e9dc74700 1 --2- 172.21.15.46:0/2074448061 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3e9815c6f0 0x7f3e980afe80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:55.930 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:55.928+0000 7f3e9dc74700 1 --2- 172.21.15.46:0/2074448061 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f3e98069e00 0x7f3e98159200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:55.930 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:55.928+0000 7f3e9dc74700 1 --2- 172.21.15.46:0/2074448061 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3e980b15d0 0x7f3e980af940 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:55.930 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:55.928+0000 7f3e9dc74700 1 -- 172.21.15.46:0/2074448061 >> 172.21.15.46:0/2074448061 conn(0x7f3e980cf970 msgr2=0x7f3e980ca310 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-05T18:56:55.930 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:55.928+0000 7f3e9dc74700 1 -- 172.21.15.46:0/2074448061 shutdown_connections 2023-07-05T18:56:55.930 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:55.928+0000 7f3e9dc74700 1 -- 172.21.15.46:0/2074448061 wait complete. 2023-07-05T18:56:55.941 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-07-05T18:56:56.069 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:56.068+0000 7f6980622700 1 Processor -- start 2023-07-05T18:56:56.069 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:56.068+0000 7f6980622700 1 -- start start 2023-07-05T18:56:56.070 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:56.069+0000 7f6980622700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f697806a510 0x7f6978160ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:56:56.070 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:56.069+0000 7f6980622700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f69780715c0 0x7f697806c1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:56:56.070 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:56.069+0000 7f6980622700 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f69780ce640 con 0x7f697815c860 2023-07-05T18:56:56.070 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:56.069+0000 7f6980622700 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f69781611e0 con 0x7f69780715c0 2023-07-05T18:56:56.070 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:56.069+0000 7f6980622700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f69780ce870 con 0x7f697806a510 2023-07-05T18:56:56.072 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:56.069+0000 7f697dbbd700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f697806a510 0x7f6978160ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:56:56.072 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:56.069+0000 7f697ebbf700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f69780715c0 0x7f697806c1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:56:56.072 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:56.069+0000 7f697dbbd700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f697806a510 0x7f6978160ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3301/0 says I am v2:172.21.15.46:42898/0 (socket says 172.21.15.46:42898) 2023-07-05T18:56:56.072 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:56.069+0000 7f697e3be700 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7f697815c860 0x7f6978069e00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.46:44400/0 (socket says 172.21.15.46:44400) 2023-07-05T18:56:56.072 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:56.069+0000 7f697dbbd700 1 -- 172.21.15.46:0/836849118 learned_addr learned my addr 172.21.15.46:0/836849118 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-07-05T18:56:56.073 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:56.069+0000 7f697dbbd700 1 -- 172.21.15.46:0/836849118 >> v2:172.21.15.73:3300/0 conn(0x7f69780715c0 msgr2=0x7f697806c1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-05T18:56:56.073 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:56.069+0000 7f697dbbd700 1 --2- 172.21.15.46:0/836849118 >> v2:172.21.15.73:3300/0 conn(0x7f69780715c0 0x7f697806c1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:56.073 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:56.069+0000 7f697dbbd700 1 -- 172.21.15.46:0/836849118 >> v1:172.21.15.73:6789/0 conn(0x7f697815c860 legacy=0x7f6978069e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:56:56.073 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:56.069+0000 7f697dbbd700 1 -- 172.21.15.46:0/836849118 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f69780ceb50 con 0x7f697806a510 2023-07-05T18:56:56.073 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:56.070+0000 7f697dbbd700 1 --2- 172.21.15.46:0/836849118 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f697806a510 0x7f6978160ca0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f69740098f0 tx=0x7f6974009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=742bd6fc03b19d4 server_cookie=0 in_seq=0 out_seq=0 2023-07-05T18:56:56.073 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:56.070+0000 7f697d3bc700 1 -- 172.21.15.46:0/836849118 <== mon.2 v2:172.21.15.73:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6974011830 con 0x7f697806a510 2023-07-05T18:56:56.074 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:56.070+0000 7f697d3bc700 1 -- 172.21.15.46:0/836849118 <== mon.2 v2:172.21.15.73:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6974011990 con 0x7f697806a510 2023-07-05T18:56:56.074 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:56.070+0000 7f697d3bc700 1 -- 172.21.15.46:0/836849118 <== mon.2 v2:172.21.15.73:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6974011d20 con 0x7f697806a510 2023-07-05T18:56:56.074 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:56.070+0000 7f6980622700 1 -- 172.21.15.46:0/836849118 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f697806a510 msgr2=0x7f6978160ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:56:56.075 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:56.070+0000 7f6980622700 1 --2- 172.21.15.46:0/836849118 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f697806a510 0x7f6978160ca0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f69740098f0 tx=0x7f6974009c00 comp rx=0 tx=0).stop 2023-07-05T18:56:56.075 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:56.070+0000 7f6980622700 1 -- 172.21.15.46:0/836849118 shutdown_connections 2023-07-05T18:56:56.075 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:56.070+0000 7f6980622700 1 --2- 172.21.15.46:0/836849118 >> v2:172.21.15.73:3300/0 conn(0x7f69780715c0 0x7f697806c1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:56.075 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:56.070+0000 7f6980622700 1 --2- 172.21.15.46:0/836849118 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f697806a510 0x7f6978160ca0 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:56.075 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:56.070+0000 7f6980622700 1 -- 172.21.15.46:0/836849118 >> 172.21.15.46:0/836849118 conn(0x7f697806bba0 msgr2=0x7f69780cc3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-05T18:56:56.075 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:56.071+0000 7f6980622700 1 -- 172.21.15.46:0/836849118 shutdown_connections 2023-07-05T18:56:56.076 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:56.071+0000 7f6980622700 1 -- 172.21.15.46:0/836849118 wait complete. 2023-07-05T18:56:56.078 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:56.072+0000 7f6980622700 1 Processor -- start 2023-07-05T18:56:56.078 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:56.072+0000 7f6980622700 1 -- start start 2023-07-05T18:56:56.078 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:56.072+0000 7f6980622700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f697806a510 0x7f69781f69f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:56:56.078 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:56.072+0000 7f6980622700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f69780715c0 0x7f6978159cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:56:56.078 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:56.072+0000 7f6980622700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f697815c860 0x7f69780c34a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:56:56.078 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:56.072+0000 7f6980622700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f69781f6560 con 0x7f697806a510 2023-07-05T18:56:56.079 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:56.072+0000 7f6980622700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f69780c3f60 con 0x7f69780715c0 2023-07-05T18:56:56.079 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:56.072+0000 7f6980622700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f69781f5f10 con 0x7f697815c860 2023-07-05T18:56:56.079 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:56.073+0000 7f697e3be700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f697806a510 0x7f69781f69f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:56:56.079 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:56.073+0000 7f697e3be700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f697806a510 0x7f69781f69f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:59216/0 (socket says 172.21.15.46:59216) 2023-07-05T18:56:56.079 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:56.073+0000 7f697e3be700 1 -- 172.21.15.46:0/1983864159 learned_addr learned my addr 172.21.15.46:0/1983864159 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-07-05T18:56:56.079 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:56.073+0000 7f697ebbf700 1 --2- 172.21.15.46:0/1983864159 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f697815c860 0x7f69780c34a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:56:56.079 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:56.073+0000 7f697dbbd700 1 --2- 172.21.15.46:0/1983864159 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f69780715c0 0x7f6978159cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:56:56.079 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:56.073+0000 7f697e3be700 1 -- 172.21.15.46:0/1983864159 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f697815c860 msgr2=0x7f69780c34a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:56:56.080 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:56.073+0000 7f697e3be700 1 --2- 172.21.15.46:0/1983864159 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f697815c860 0x7f69780c34a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:56.080 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:56.073+0000 7f697e3be700 1 -- 172.21.15.46:0/1983864159 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f69780715c0 msgr2=0x7f6978159cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:56:56.080 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:56.073+0000 7f697e3be700 1 --2- 172.21.15.46:0/1983864159 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f69780715c0 0x7f6978159cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:56.080 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:56.073+0000 7f697e3be700 1 -- 172.21.15.46:0/1983864159 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6974009550 con 0x7f697806a510 2023-07-05T18:56:56.080 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:56.073+0000 7f697e3be700 1 --2- 172.21.15.46:0/1983864159 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f697806a510 0x7f69781f69f0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f696800c520 tx=0x7f696800c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-05T18:56:56.080 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:56.073+0000 7f696effd700 1 -- 172.21.15.46:0/1983864159 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6968005cb0 con 0x7f697806a510 2023-07-05T18:56:56.080 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:56.073+0000 7f696effd700 1 -- 172.21.15.46:0/1983864159 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6968005e10 con 0x7f697806a510 2023-07-05T18:56:56.080 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:56.073+0000 7f6980622700 1 -- 172.21.15.46:0/1983864159 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f69781f61f0 con 0x7f697806a510 2023-07-05T18:56:56.081 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:56.073+0000 7f696effd700 1 -- 172.21.15.46:0/1983864159 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69680072d0 con 0x7f697806a510 2023-07-05T18:56:56.081 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:56.074+0000 7f6980622700 1 -- 172.21.15.46:0/1983864159 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f697815d8a0 con 0x7f697806a510 2023-07-05T18:56:56.081 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:56.074+0000 7f6980622700 1 -- 172.21.15.46:0/1983864159 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f69780cd290 con 0x7f697806a510 2023-07-05T18:56:56.081 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:56.075+0000 7f696effd700 1 -- 172.21.15.46:0/1983864159 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f6968007430 con 0x7f697806a510 2023-07-05T18:56:56.081 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:56.075+0000 7f696effd700 1 --2- 172.21.15.46:0/1983864159 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7f695c06ace0 0x7f695c06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:56:56.081 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:56.075+0000 7f696effd700 1 -- 172.21.15.46:0/1983864159 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f69680887e0 con 0x7f697806a510 2023-07-05T18:56:56.081 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:56.076+0000 7f697dbbd700 1 --2- 172.21.15.46:0/1983864159 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7f695c06ace0 0x7f695c06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:56:56.082 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:56.076+0000 7f697dbbd700 1 --2- 172.21.15.46:0/1983864159 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7f695c06ace0 0x7f695c06d190 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f6974014040 tx=0x7f6974008030 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-05T18:56:56.082 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:56.080+0000 7f696effd700 1 -- 172.21.15.46:0/1983864159 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f69680539d0 con 0x7f697806a510 2023-07-05T18:56:56.279 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:56.278+0000 7f6980622700 1 -- 172.21.15.46:0/1983864159 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f69780672e0 con 0x7f697806a510 2023-07-05T18:56:56.279 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:56.278+0000 7f696effd700 1 -- 172.21.15.46:0/1983864159 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v21) v1 ==== 100+0+11 (secure 0 0 0) 0x7f6968017020 con 0x7f697806a510 2023-07-05T18:56:56.280 INFO:teuthology.orchestra.run.smithi046.stdout:pg_num: 64 2023-07-05T18:56:56.286 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:56.280+0000 7f6980622700 1 -- 172.21.15.46:0/1983864159 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7f695c06ace0 msgr2=0x7f695c06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:56:56.286 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:56.280+0000 7f6980622700 1 --2- 172.21.15.46:0/1983864159 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7f695c06ace0 0x7f695c06d190 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f6974014040 tx=0x7f6974008030 comp rx=0 tx=0).stop 2023-07-05T18:56:56.286 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:56.280+0000 7f6980622700 1 -- 172.21.15.46:0/1983864159 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f697806a510 msgr2=0x7f69781f69f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:56:56.286 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:56.280+0000 7f6980622700 1 --2- 172.21.15.46:0/1983864159 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f697806a510 0x7f69781f69f0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f696800c520 tx=0x7f696800c8e0 comp rx=0 tx=0).stop 2023-07-05T18:56:56.286 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:56.280+0000 7f6980622700 1 -- 172.21.15.46:0/1983864159 shutdown_connections 2023-07-05T18:56:56.287 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:56.280+0000 7f6980622700 1 --2- 172.21.15.46:0/1983864159 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7f695c06ace0 0x7f695c06d190 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:56.287 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:56.280+0000 7f6980622700 1 --2- 172.21.15.46:0/1983864159 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f697815c860 0x7f69780c34a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:56.287 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:56.280+0000 7f6980622700 1 --2- 172.21.15.46:0/1983864159 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f697806a510 0x7f69781f69f0 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:56.287 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:56.280+0000 7f6980622700 1 --2- 172.21.15.46:0/1983864159 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f69780715c0 0x7f6978159cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:56.287 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:56.280+0000 7f6980622700 1 -- 172.21.15.46:0/1983864159 >> 172.21.15.46:0/1983864159 conn(0x7f697806bba0 msgr2=0x7f69780aeac0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-05T18:56:56.287 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:56.280+0000 7f6980622700 1 -- 172.21.15.46:0/1983864159 shutdown_connections 2023-07-05T18:56:56.287 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:56.280+0000 7f6980622700 1 -- 172.21.15.46:0/1983864159 wait complete. 2023-07-05T18:56:56.303 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-07-05T18:56:56.429 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:56.428+0000 7fe7f72d7700 1 Processor -- start 2023-07-05T18:56:56.429 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:56.428+0000 7fe7f72d7700 1 -- start start 2023-07-05T18:56:56.433 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:56.429+0000 7fe7f72d7700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fe7f015c630 0x7fe7f006d8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:56:56.433 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:56.429+0000 7fe7f72d7700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fe7f0160120 0x7fe7f0160570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:56:56.433 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:56.429+0000 7fe7f72d7700 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe7f0070a80 con 0x7fe7f00b17b0 2023-07-05T18:56:56.433 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:56.429+0000 7fe7f72d7700 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe7f015ca00 con 0x7fe7f015c630 2023-07-05T18:56:56.433 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:56.429+0000 7fe7f72d7700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe7f0160fc0 con 0x7fe7f0160120 2023-07-05T18:56:56.433 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:56.429+0000 7fe7f5874700 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7fe7f00b17b0 0x7fe7f00ce6c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:58500/0 (socket says 172.21.15.46:58500) 2023-07-05T18:56:56.434 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:56.429+0000 7fe7f5874700 1 -- 172.21.15.46:0/1104175543 learned_addr learned my addr 172.21.15.46:0/1104175543 (peer_addr_for_me v1:172.21.15.46:0/0) 2023-07-05T18:56:56.434 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:56.429+0000 7fe7f4872700 1 --2- 172.21.15.46:0/1104175543 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fe7f0160120 0x7fe7f0160570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:56:56.434 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:56.429+0000 7fe7f5073700 1 --2- 172.21.15.46:0/1104175543 >> v2:172.21.15.73:3300/0 conn(0x7fe7f015c630 0x7fe7f006d8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:56:56.434 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:56.429+0000 7fe7e7fff700 1 -- 172.21.15.46:0/1104175543 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3006275619 0 0) 0x7fe7f0070a80 con 0x7fe7f00b17b0 2023-07-05T18:56:56.434 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:56.429+0000 7fe7e7fff700 1 -- 172.21.15.46:0/1104175543 --> v1:172.21.15.46:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe7dc0035b0 con 0x7fe7f00b17b0 2023-07-05T18:56:56.434 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:56.430+0000 7fe7e7fff700 1 -- 172.21.15.46:0/1104175543 <== mon.0 v1:172.21.15.46:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3116553893 0 0) 0x7fe7dc0035b0 con 0x7fe7f00b17b0 2023-07-05T18:56:56.434 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:56.430+0000 7fe7e7fff700 1 -- 172.21.15.46:0/1104175543 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fe7f0160120 msgr2=0x7fe7f0160570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-05T18:56:56.434 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:56.430+0000 7fe7e7fff700 1 --2- 172.21.15.46:0/1104175543 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fe7f0160120 0x7fe7f0160570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:56.435 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:56.430+0000 7fe7e7fff700 1 -- 172.21.15.46:0/1104175543 >> v2:172.21.15.73:3300/0 conn(0x7fe7f015c630 msgr2=0x7fe7f006d8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-05T18:56:56.435 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:56.430+0000 7fe7e7fff700 1 --2- 172.21.15.46:0/1104175543 >> v2:172.21.15.73:3300/0 conn(0x7fe7f015c630 0x7fe7f006d8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:56.435 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:56.430+0000 7fe7e7fff700 1 -- 172.21.15.46:0/1104175543 --> v1:172.21.15.46:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe7f0160ab0 con 0x7fe7f00b17b0 2023-07-05T18:56:56.435 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:56.430+0000 7fe7e7fff700 1 -- 172.21.15.46:0/1104175543 <== mon.0 v1:172.21.15.46:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2195585215 0 0) 0x7fe7e80019f0 con 0x7fe7f00b17b0 2023-07-05T18:56:56.436 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:56.430+0000 7fe7e7fff700 1 -- 172.21.15.46:0/1104175543 >> v1:172.21.15.46:6789/0 conn(0x7fe7f00b17b0 legacy=0x7fe7f00ce6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:56:56.436 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:56.430+0000 7fe7e7fff700 1 --2- 172.21.15.46:0/1104175543 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fe7f0160120 0x7fe7dc003a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:56:56.437 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:56.430+0000 7fe7e7fff700 1 --2- 172.21.15.46:0/1104175543 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe7dc003f80 0x7fe7dc004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:56:56.437 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:56.430+0000 7fe7e7fff700 1 --2- 172.21.15.46:0/1104175543 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe7dc004d90 0x7fe7dc005200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:56:56.437 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:56.430+0000 7fe7e7fff700 1 -- 172.21.15.46:0/1104175543 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7f015ca00 con 0x7fe7dc003f80 2023-07-05T18:56:56.437 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:56.430+0000 7fe7e7fff700 1 -- 172.21.15.46:0/1104175543 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7f0160fc0 con 0x7fe7dc004d90 2023-07-05T18:56:56.438 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:56.430+0000 7fe7e7fff700 1 -- 172.21.15.46:0/1104175543 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe7dc00ba10 con 0x7fe7f0160120 2023-07-05T18:56:56.438 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:56.430+0000 7fe7f4872700 1 --2- 172.21.15.46:0/1104175543 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe7dc003f80 0x7fe7dc004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:56:56.438 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:56.430+0000 7fe7f5073700 1 --2- 172.21.15.46:0/1104175543 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fe7f0160120 0x7fe7dc003a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:56:56.438 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:56.430+0000 7fe7f5874700 1 --2- 172.21.15.46:0/1104175543 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe7dc004d90 0x7fe7dc005200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:56:56.439 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:56.430+0000 7fe7f4872700 1 -- 172.21.15.46:0/1104175543 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fe7f0160120 msgr2=0x7fe7dc003a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-05T18:56:56.439 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:56.430+0000 7fe7f4872700 1 --2- 172.21.15.46:0/1104175543 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fe7f0160120 0x7fe7dc003a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:56.439 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:56.430+0000 7fe7f4872700 1 -- 172.21.15.46:0/1104175543 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe7dc004d90 msgr2=0x7fe7dc005200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-05T18:56:56.439 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:56.430+0000 7fe7f4872700 1 --2- 172.21.15.46:0/1104175543 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe7dc004d90 0x7fe7dc005200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:56.439 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:56.430+0000 7fe7f4872700 1 -- 172.21.15.46:0/1104175543 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe7dc0035b0 con 0x7fe7dc003f80 2023-07-05T18:56:56.439 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:56.430+0000 7fe7f5073700 1 --2- 172.21.15.46:0/1104175543 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fe7f0160120 0x7fe7dc003a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-05T18:56:56.439 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:56.430+0000 7fe7f4872700 1 --2- 172.21.15.46:0/1104175543 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe7dc003f80 0x7fe7dc004850 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7fe7ec009b60 tx=0x7fe7dc005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=15693a63894c22e0 server_cookie=0 in_seq=0 out_seq=0 2023-07-05T18:56:56.440 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:56.431+0000 7fe7e7fff700 1 -- 172.21.15.46:0/1104175543 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7ec00e6c0 con 0x7fe7dc003f80 2023-07-05T18:56:56.440 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:56.431+0000 7fe7e7fff700 1 -- 172.21.15.46:0/1104175543 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe7ec00e820 con 0x7fe7dc003f80 2023-07-05T18:56:56.440 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:56.431+0000 7fe7e7fff700 1 -- 172.21.15.46:0/1104175543 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7ec00eb90 con 0x7fe7dc003f80 2023-07-05T18:56:56.446 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:56.431+0000 7fe7f72d7700 1 -- 172.21.15.46:0/1104175543 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe7dc003f80 msgr2=0x7fe7dc004850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:56:56.447 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:56.431+0000 7fe7f72d7700 1 --2- 172.21.15.46:0/1104175543 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe7dc003f80 0x7fe7dc004850 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7fe7ec009b60 tx=0x7fe7dc005880 comp rx=0 tx=0).stop 2023-07-05T18:56:56.447 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:56.431+0000 7fe7f5874700 1 -- 172.21.15.46:0/1104175543 reap_dead start 2023-07-05T18:56:56.447 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:56.431+0000 7fe7f72d7700 1 -- 172.21.15.46:0/1104175543 shutdown_connections 2023-07-05T18:56:56.447 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:56.431+0000 7fe7f72d7700 1 -- 172.21.15.46:0/1104175543 >> 172.21.15.46:0/1104175543 conn(0x7fe7f006af10 msgr2=0x7fe7f006b310 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-05T18:56:56.447 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:56.431+0000 7fe7f72d7700 1 -- 172.21.15.46:0/1104175543 shutdown_connections 2023-07-05T18:56:56.447 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:56.431+0000 7fe7f72d7700 1 -- 172.21.15.46:0/1104175543 wait complete. 2023-07-05T18:56:56.450 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:56.433+0000 7fe7f72d7700 1 Processor -- start 2023-07-05T18:56:56.450 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:56.433+0000 7fe7f72d7700 1 -- start start 2023-07-05T18:56:56.450 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:56.434+0000 7fe7f72d7700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fe7dc003f80 0x7fe7f0153b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:56:56.450 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:56.434+0000 7fe7f72d7700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe7f00b0be0 0x7fe7f00b1050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:56:56.450 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:56.434+0000 7fe7f72d7700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe7f00b3f90 0x7fe7f00b4400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:56:56.450 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:56.434+0000 7fe7f72d7700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7f00b3800 con 0x7fe7f00b3f90 2023-07-05T18:56:56.451 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:56.434+0000 7fe7f72d7700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7f00b3c20 con 0x7fe7f00b0be0 2023-07-05T18:56:56.451 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:56.434+0000 7fe7f72d7700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe7f00b1590 con 0x7fe7dc003f80 2023-07-05T18:56:56.451 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:56.434+0000 7fe7f5874700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe7f00b3f90 0x7fe7f00b4400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:56:56.451 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:56.434+0000 7fe7f5874700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe7f00b3f90 0x7fe7f00b4400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:59240/0 (socket says 172.21.15.46:59240) 2023-07-05T18:56:56.451 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:56.434+0000 7fe7f5874700 1 -- 172.21.15.46:0/292843859 learned_addr learned my addr 172.21.15.46:0/292843859 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-07-05T18:56:56.451 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:56.434+0000 7fe7f5073700 1 --2- 172.21.15.46:0/292843859 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fe7dc003f80 0x7fe7f0153b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:56:56.451 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:56.434+0000 7fe7f4872700 1 --2- 172.21.15.46:0/292843859 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe7f00b0be0 0x7fe7f00b1050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:56:56.452 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:56.434+0000 7fe7f5874700 1 -- 172.21.15.46:0/292843859 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fe7dc003f80 msgr2=0x7fe7f0153b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:56:56.452 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:56.434+0000 7fe7f5874700 1 --2- 172.21.15.46:0/292843859 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fe7dc003f80 0x7fe7f0153b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:56.452 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:56.434+0000 7fe7f5874700 1 -- 172.21.15.46:0/292843859 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe7f00b0be0 msgr2=0x7fe7f00b1050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:56:56.452 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:56.434+0000 7fe7f5874700 1 --2- 172.21.15.46:0/292843859 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe7f00b0be0 0x7fe7f00b1050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:56.453 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:56.434+0000 7fe7f5874700 1 -- 172.21.15.46:0/292843859 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe7f00b2bc0 con 0x7fe7f00b3f90 2023-07-05T18:56:56.453 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:56.434+0000 7fe7f5874700 1 --2- 172.21.15.46:0/292843859 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe7f00b3f90 0x7fe7f00b4400 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7fe7f0071bb0 tx=0x7fe7e800a640 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-05T18:56:56.453 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:56.435+0000 7fe7e5ffb700 1 -- 172.21.15.46:0/292843859 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7e8007b80 con 0x7fe7f00b3f90 2023-07-05T18:56:56.453 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:56.435+0000 7fe7e5ffb700 1 -- 172.21.15.46:0/292843859 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe7e800ad50 con 0x7fe7f00b3f90 2023-07-05T18:56:56.453 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:56.435+0000 7fe7e5ffb700 1 -- 172.21.15.46:0/292843859 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7e8013610 con 0x7fe7f00b3f90 2023-07-05T18:56:56.453 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:56.435+0000 7fe7f72d7700 1 -- 172.21.15.46:0/292843859 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe7f00b2e60 con 0x7fe7f00b3f90 2023-07-05T18:56:56.453 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:56.435+0000 7fe7f72d7700 1 -- 172.21.15.46:0/292843859 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe7f00b3420 con 0x7fe7f00b3f90 2023-07-05T18:56:56.453 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:56.436+0000 7fe7f72d7700 1 -- 172.21.15.46:0/292843859 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe7f00b35e0 con 0x7fe7f00b3f90 2023-07-05T18:56:56.454 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:56.436+0000 7fe7e5ffb700 1 -- 172.21.15.46:0/292843859 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fe7e8013770 con 0x7fe7f00b3f90 2023-07-05T18:56:56.454 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:56.437+0000 7fe7e5ffb700 1 --2- 172.21.15.46:0/292843859 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7fe7d406ad10 0x7fe7d406d1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:56:56.454 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:56.437+0000 7fe7e5ffb700 1 -- 172.21.15.46:0/292843859 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fe7e8089a90 con 0x7fe7f00b3f90 2023-07-05T18:56:56.454 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:56.437+0000 7fe7f5073700 1 --2- 172.21.15.46:0/292843859 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7fe7d406ad10 0x7fe7d406d1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:56:56.454 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:56.437+0000 7fe7f5073700 1 --2- 172.21.15.46:0/292843859 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7fe7d406ad10 0x7fe7d406d1c0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fe7e0009ce0 tx=0x7fe7e0009210 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-05T18:56:56.454 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:56.441+0000 7fe7e5ffb700 1 -- 172.21.15.46:0/292843859 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fe7e8054b40 con 0x7fe7f00b3f90 2023-07-05T18:56:56.659 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:56.657+0000 7fe7f72d7700 1 -- 172.21.15.46:0/292843859 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7fe7f00b3940 con 0x7fe7f00b3f90 2023-07-05T18:56:56.659 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:56.658+0000 7fe7e5ffb700 1 -- 172.21.15.46:0/292843859 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v21) v1 ==== 80+0+0 (secure 0 0 0) 0x7fe7f00b3940 con 0x7fe7f00b3f90 2023-07-05T18:56:56.665 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:56.660+0000 7fe7f72d7700 1 -- 172.21.15.46:0/292843859 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7fe7d406ad10 msgr2=0x7fe7d406d1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:56:56.665 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:56.660+0000 7fe7f72d7700 1 --2- 172.21.15.46:0/292843859 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7fe7d406ad10 0x7fe7d406d1c0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fe7e0009ce0 tx=0x7fe7e0009210 comp rx=0 tx=0).stop 2023-07-05T18:56:56.665 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:56.660+0000 7fe7f72d7700 1 -- 172.21.15.46:0/292843859 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe7f00b3f90 msgr2=0x7fe7f00b4400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:56:56.665 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:56.660+0000 7fe7f72d7700 1 --2- 172.21.15.46:0/292843859 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe7f00b3f90 0x7fe7f00b4400 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7fe7f0071bb0 tx=0x7fe7e800a640 comp rx=0 tx=0).stop 2023-07-05T18:56:56.666 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:56.660+0000 7fe7f72d7700 1 -- 172.21.15.46:0/292843859 shutdown_connections 2023-07-05T18:56:56.666 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:56.660+0000 7fe7f72d7700 1 --2- 172.21.15.46:0/292843859 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7fe7d406ad10 0x7fe7d406d1c0 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:56.666 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:56.660+0000 7fe7f72d7700 1 --2- 172.21.15.46:0/292843859 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe7f00b3f90 0x7fe7f00b4400 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:56.666 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:56.660+0000 7fe7f72d7700 1 --2- 172.21.15.46:0/292843859 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fe7dc003f80 0x7fe7f0153b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:56.666 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:56.660+0000 7fe7f72d7700 1 --2- 172.21.15.46:0/292843859 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe7f00b0be0 0x7fe7f00b1050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:56.667 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:56.660+0000 7fe7f72d7700 1 -- 172.21.15.46:0/292843859 >> 172.21.15.46:0/292843859 conn(0x7fe7f006af10 msgr2=0x7fe7f0070a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-05T18:56:56.667 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:56.660+0000 7fe7f72d7700 1 -- 172.21.15.46:0/292843859 shutdown_connections 2023-07-05T18:56:56.667 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:56.660+0000 7fe7f72d7700 1 -- 172.21.15.46:0/292843859 wait complete. 2023-07-05T18:56:56.667 INFO:teuthology.orchestra.run.smithi046.stderr:listed 0 entries 2023-07-05T18:56:56.673 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.2... 2023-07-05T18:56:56.674 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-05T18:56:56.674 DEBUG:teuthology.orchestra.run.smithi046:> sudo umount /home/ubuntu/cephtest/mnt.2 -f 2023-07-05T18:56:56.717 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi046.front.sepia.ceph.com 2023-07-05T18:56:56.717 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-05T18:56:56.718 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.2) 2023-07-05T18:56:56.774 DEBUG:teuthology.orchestra.run.smithi073:> set -ex 2023-07-05T18:56:56.775 DEBUG:teuthology.orchestra.run.smithi073:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-05T18:56:56.796 DEBUG:teuthology.orchestra.run.smithi073:> set -ex 2023-07-05T18:56:56.797 DEBUG:teuthology.orchestra.run.smithi073:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-05T18:56:56.857 DEBUG:teuthology.orchestra.run.smithi073:> set -ex 2023-07-05T18:56:56.858 DEBUG:teuthology.orchestra.run.smithi073:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-05T18:56:56.925 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-05T18:56:57.052 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:57.049+0000 7f5a22c7e700 1 Processor -- start 2023-07-05T18:56:57.052 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:57.050+0000 7f5a22c7e700 1 -- start start 2023-07-05T18:56:57.052 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:57.050+0000 7f5a22c7e700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f5a1c0ccde0 0x7f5a1c0cbc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:56:57.053 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:57.050+0000 7f5a22c7e700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f5a1c06b7d0 0x7f5a1c06bc50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:56:57.053 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:57.050+0000 7f5a22c7e700 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5a1c0cd250 con 0x7f5a1c0ce910 2023-07-05T18:56:57.053 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:57.050+0000 7f5a22c7e700 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5a1c0cc1a0 con 0x7f5a1c0ccde0 2023-07-05T18:56:57.053 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:57.050+0000 7f5a22c7e700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5a1c0cc400 con 0x7f5a1c06b7d0 2023-07-05T18:56:57.053 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:57.051+0000 7f5a1bfff700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f5a1c0ccde0 0x7f5a1c0cbc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:56:57.053 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:57.051+0000 7f5a2121b700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f5a1c06b7d0 0x7f5a1c06bc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:56:57.053 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:57.051+0000 7f5a1bfff700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f5a1c0ccde0 0x7f5a1c0cbc60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.46:58730/0 (socket says 172.21.15.46:58730) 2023-07-05T18:56:57.054 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:57.051+0000 7f5a2121b700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f5a1c06b7d0 0x7f5a1c06bc50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3301/0 says I am v2:172.21.15.46:42934/0 (socket says 172.21.15.46:42934) 2023-07-05T18:56:57.054 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:57.051+0000 7f5a1bfff700 1 -- 172.21.15.46:0/1320106066 learned_addr learned my addr 172.21.15.46:0/1320106066 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-07-05T18:56:57.054 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:57.051+0000 7f5a2121b700 1 -- 172.21.15.46:0/1320106066 >> v2:172.21.15.73:3300/0 conn(0x7f5a1c0ccde0 msgr2=0x7f5a1c0cbc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-05T18:56:57.054 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:57.051+0000 7f5a2121b700 1 --2- 172.21.15.46:0/1320106066 >> v2:172.21.15.73:3300/0 conn(0x7f5a1c0ccde0 0x7f5a1c0cbc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:57.054 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:57.051+0000 7f5a2121b700 1 -- 172.21.15.46:0/1320106066 >> v1:172.21.15.73:6789/0 conn(0x7f5a1c0ce910 legacy=0x7f5a1c0cece0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:56:57.054 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:57.051+0000 7f5a2121b700 1 -- 172.21.15.46:0/1320106066 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5a1c0cc6e0 con 0x7f5a1c06b7d0 2023-07-05T18:56:57.054 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:57.051+0000 7f5a1bfff700 1 --2- 172.21.15.46:0/1320106066 >> v2:172.21.15.73:3300/0 conn(0x7f5a1c0ccde0 0x7f5a1c0cbc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-05T18:56:57.055 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:57.051+0000 7f5a2121b700 1 --2- 172.21.15.46:0/1320106066 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f5a1c06b7d0 0x7f5a1c06bc50 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f5a14009d90 tx=0x7f5a1400b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=75da92b9ea4558e6 server_cookie=0 in_seq=0 out_seq=0 2023-07-05T18:56:57.061 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:57.051+0000 7f5a1b7fe700 1 -- 172.21.15.46:0/1320106066 <== mon.2 v2:172.21.15.73:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a1400e070 con 0x7f5a1c06b7d0 2023-07-05T18:56:57.061 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:57.051+0000 7f5a1b7fe700 1 -- 172.21.15.46:0/1320106066 <== mon.2 v2:172.21.15.73:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5a1400bb20 con 0x7f5a1c06b7d0 2023-07-05T18:56:57.061 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:57.051+0000 7f5a1b7fe700 1 -- 172.21.15.46:0/1320106066 <== mon.2 v2:172.21.15.73:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a14012430 con 0x7f5a1c06b7d0 2023-07-05T18:56:57.074 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:57.052+0000 7f5a22c7e700 1 -- 172.21.15.46:0/1320106066 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f5a1c06b7d0 msgr2=0x7f5a1c06bc50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:56:57.074 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:57.052+0000 7f5a22c7e700 1 --2- 172.21.15.46:0/1320106066 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f5a1c06b7d0 0x7f5a1c06bc50 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f5a14009d90 tx=0x7f5a1400b330 comp rx=0 tx=0).stop 2023-07-05T18:56:57.074 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:57.052+0000 7f5a22c7e700 1 -- 172.21.15.46:0/1320106066 shutdown_connections 2023-07-05T18:56:57.074 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:57.052+0000 7f5a22c7e700 1 --2- 172.21.15.46:0/1320106066 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f5a1c06b7d0 0x7f5a1c06bc50 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:57.075 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:57.052+0000 7f5a22c7e700 1 --2- 172.21.15.46:0/1320106066 >> v2:172.21.15.73:3300/0 conn(0x7f5a1c0ccde0 0x7f5a1c0cbc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:57.075 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:57.052+0000 7f5a22c7e700 1 -- 172.21.15.46:0/1320106066 >> 172.21.15.46:0/1320106066 conn(0x7f5a1c099e00 msgr2=0x7f5a1c0d0b30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-05T18:56:57.075 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:57.052+0000 7f5a22c7e700 1 -- 172.21.15.46:0/1320106066 shutdown_connections 2023-07-05T18:56:57.075 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:57.052+0000 7f5a22c7e700 1 -- 172.21.15.46:0/1320106066 wait complete. 2023-07-05T18:56:57.075 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:57.054+0000 7f5a22c7e700 1 Processor -- start 2023-07-05T18:56:57.075 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:57.054+0000 7f5a22c7e700 1 -- start start 2023-07-05T18:56:57.075 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:57.055+0000 7f5a22c7e700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5a1c06b7d0 0x7f5a1c15c010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:56:57.076 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:57.055+0000 7f5a22c7e700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5a1c0ccde0 0x7f5a1c1f2dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:56:57.077 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:57.055+0000 7f5a22c7e700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f5a1c0ce910 0x7f5a1c06dc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:56:57.078 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:57.055+0000 7f5a22c7e700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a1c1e6110 con 0x7f5a1c06b7d0 2023-07-05T18:56:57.078 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:57.055+0000 7f5a22c7e700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a1c0b3960 con 0x7f5a1c0ccde0 2023-07-05T18:56:57.078 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:57.055+0000 7f5a22c7e700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5a1c1f3300 con 0x7f5a1c0ce910 2023-07-05T18:56:57.083 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:57.055+0000 7f5a20a1a700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5a1c06b7d0 0x7f5a1c15c010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:56:57.084 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:57.055+0000 7f5a20a1a700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5a1c06b7d0 0x7f5a1c15c010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:59250/0 (socket says 172.21.15.46:59250) 2023-07-05T18:56:57.084 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:57.055+0000 7f5a20a1a700 1 -- 172.21.15.46:0/3601895525 learned_addr learned my addr 172.21.15.46:0/3601895525 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-07-05T18:56:57.084 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:57.055+0000 7f5a2121b700 1 --2- 172.21.15.46:0/3601895525 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f5a1c0ce910 0x7f5a1c06dc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:56:57.084 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:57.055+0000 7f5a1bfff700 1 --2- 172.21.15.46:0/3601895525 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5a1c0ccde0 0x7f5a1c1f2dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:56:57.084 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:57.055+0000 7f5a20a1a700 1 -- 172.21.15.46:0/3601895525 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f5a1c0ce910 msgr2=0x7f5a1c06dc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:56:57.084 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:57.055+0000 7f5a20a1a700 1 --2- 172.21.15.46:0/3601895525 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f5a1c0ce910 0x7f5a1c06dc70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:57.084 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:57.055+0000 7f5a20a1a700 1 -- 172.21.15.46:0/3601895525 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5a1c0ccde0 msgr2=0x7f5a1c1f2dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:56:57.085 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:57.055+0000 7f5a20a1a700 1 --2- 172.21.15.46:0/3601895525 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5a1c0ccde0 0x7f5a1c1f2dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:57.085 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:57.055+0000 7f5a20a1a700 1 -- 172.21.15.46:0/3601895525 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5a08009550 con 0x7f5a1c06b7d0 2023-07-05T18:56:57.085 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:57.055+0000 7f5a20a1a700 1 --2- 172.21.15.46:0/3601895525 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5a1c06b7d0 0x7f5a1c15c010 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f5a1000c450 tx=0x7f5a1000c810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-05T18:56:57.086 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:57.056+0000 7f5a197fa700 1 -- 172.21.15.46:0/3601895525 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a100052d0 con 0x7f5a1c06b7d0 2023-07-05T18:56:57.086 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:57.056+0000 7f5a197fa700 1 -- 172.21.15.46:0/3601895525 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5a10005430 con 0x7f5a1c06b7d0 2023-07-05T18:56:57.086 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:57.056+0000 7f5a197fa700 1 -- 172.21.15.46:0/3601895525 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a100038c0 con 0x7f5a1c06b7d0 2023-07-05T18:56:57.086 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:57.056+0000 7f5a22c7e700 1 -- 172.21.15.46:0/3601895525 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5a14009a70 con 0x7f5a1c06b7d0 2023-07-05T18:56:57.088 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:57.056+0000 7f5a22c7e700 1 -- 172.21.15.46:0/3601895525 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5a1c0b3bb0 con 0x7f5a1c06b7d0 2023-07-05T18:56:57.088 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:57.057+0000 7f5a22c7e700 1 -- 172.21.15.46:0/3601895525 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5a1c0672e0 con 0x7f5a1c06b7d0 2023-07-05T18:56:57.088 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:57.057+0000 7f5a197fa700 1 -- 172.21.15.46:0/3601895525 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f5a10003a20 con 0x7f5a1c06b7d0 2023-07-05T18:56:57.088 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:57.057+0000 7f5a197fa700 1 --2- 172.21.15.46:0/3601895525 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7f5a0006ace0 0x7f5a0006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:56:57.088 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:57.058+0000 7f5a197fa700 1 -- 172.21.15.46:0/3601895525 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f5a10088660 con 0x7f5a1c06b7d0 2023-07-05T18:56:57.089 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:57.058+0000 7f5a1bfff700 1 --2- 172.21.15.46:0/3601895525 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7f5a0006ace0 0x7f5a0006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:56:57.089 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:57.058+0000 7f5a1bfff700 1 --2- 172.21.15.46:0/3601895525 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7f5a0006ace0 0x7f5a0006d190 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f5a1c15c730 tx=0x7f5a08008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-05T18:56:57.089 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:57.062+0000 7f5a197fa700 1 -- 172.21.15.46:0/3601895525 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f5a100537a0 con 0x7f5a1c06b7d0 2023-07-05T18:56:57.261 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:57.260+0000 7f5a22c7e700 1 -- 172.21.15.46:0/3601895525 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f5a1c0cd250 con 0x7f5a1c06b7d0 2023-07-05T18:56:57.264 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:57.261+0000 7f5a197fa700 1 -- 172.21.15.46:0/3601895525 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) v1 ==== 74+0+18161 (secure 0 0 0) 0x7f5a1c0cd250 con 0x7f5a1c06b7d0 2023-07-05T18:56:57.265 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T18:56:57.265 INFO:teuthology.orchestra.run.smithi046.stdout:{"epoch":21,"fsid":"042652d3-d80c-4ad8-9366-3e94f2a0a512","created":"2023-07-05T18:55:56.455710+0000","modified":"2023-07-05T18:56:16.095672+0000","last_up_change":"2023-07-05T18:56:06.594022+0000","last_in_change":"2023-07-05T18:55:58.879340+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-07-05T18:56:07.729620+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2023-07-05T18:56:08.128122+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-07-05T18:56:12.954625+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-07-05T18:56:14.068396+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"20009183-9a47-4392-8751-883f88d2bfb1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6813","nonce":4151971443},{"type":"v1","addr":"172.21.15.46:6815","nonce":4151971443}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6817","nonce":4151971443},{"type":"v1","addr":"172.21.15.46:6818","nonce":4151971443}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6822","nonce":4151971443},{"type":"v1","addr":"172.21.15.46:6823","nonce":4151971443}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6820","nonce":4151971443},{"type":"v1","addr":"172.21.15.46:6821","nonce":4151971443}]},"public_addr":"172.21.15.46:6815/4151971443","cluster_addr":"172.21.15.46:6818/4151971443","heartbeat_back_addr":"172.21.15.46:6823/4151971443","heartbeat_front_addr":"172.21.15.46:6821/4151971443","state":["exists","up"]},{"osd":1,"uuid":"91b4a7b0-e4e4-4888-a1fe-9edb0d68004c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6808","nonce":502575881},{"type":"v1","addr":"172.21.15.46:6809","nonce":502575881}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6810","nonce":502575881},{"type":"v1","addr":"172.21.15.46:6811","nonce":502575881}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6816","nonce":502575881},{"type":"v1","addr":"172.21.15.46:6819","nonce":502575881}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6812","nonce":502575881},{"type":"v1","addr":"172.21.15.46:6814","nonce":502575881}]},"public_addr":"172.21.15.46:6809/502575881","cluster_addr":"172.21.15.46:6811/502575881","heartbeat_back_addr":"172.21.15.46:6819/502575881","heartbeat_front_addr":"172.21.15.46:6814/502575881","state":["exists","up"]},{"osd":2,"uuid":"669ff744-1331-47c5-8579-0440731c889a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6800","nonce":2115251461},{"type":"v1","addr":"172.21.15.46:6801","nonce":2115251461}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6802","nonce":2115251461},{"type":"v1","addr":"172.21.15.46:6803","nonce":2115251461}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6806","nonce":2115251461},{"type":"v1","addr":"172.21.15.46:6807","nonce":2115251461}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6804","nonce":2115251461},{"type":"v1","addr":"172.21.15.46:6805","nonce":2115251461}]},"public_addr":"172.21.15.46:6801/2115251461","cluster_addr":"172.21.15.46:6803/2115251461","heartbeat_back_addr":"172.21.15.46:6807/2115251461","heartbeat_front_addr":"172.21.15.46:6805/2115251461","state":["exists","up"]},{"osd":3,"uuid":"34e1b86d-ffad-415d-861c-07a5f08068a6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6824","nonce":2981388766},{"type":"v1","addr":"172.21.15.46:6825","nonce":2981388766}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6826","nonce":2981388766},{"type":"v1","addr":"172.21.15.46:6827","nonce":2981388766}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6830","nonce":2981388766},{"type":"v1","addr":"172.21.15.46:6831","nonce":2981388766}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6828","nonce":2981388766},{"type":"v1","addr":"172.21.15.46:6829","nonce":2981388766}]},"public_addr":"172.21.15.46:6825/2981388766","cluster_addr":"172.21.15.46:6827/2981388766","heartbeat_back_addr":"172.21.15.46:6831/2981388766","heartbeat_front_addr":"172.21.15.46:6829/2981388766","state":["exists","up"]},{"osd":4,"uuid":"57ffcb91-c7dc-4a69-ae71-4d9622a14a05","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6800","nonce":2083655348},{"type":"v1","addr":"172.21.15.73:6801","nonce":2083655348}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6802","nonce":2083655348},{"type":"v1","addr":"172.21.15.73:6803","nonce":2083655348}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6806","nonce":2083655348},{"type":"v1","addr":"172.21.15.73:6807","nonce":2083655348}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6804","nonce":2083655348},{"type":"v1","addr":"172.21.15.73:6805","nonce":2083655348}]},"public_addr":"172.21.15.73:6801/2083655348","cluster_addr":"172.21.15.73:6803/2083655348","heartbeat_back_addr":"172.21.15.73:6807/2083655348","heartbeat_front_addr":"172.21.15.73:6805/2083655348","state":["exists","up"]},{"osd":5,"uuid":"665f41c9-ee20-49cf-bf0e-fbe0c03d3aed","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6824","nonce":2803788401},{"type":"v1","addr":"172.21.15.73:6825","nonce":2803788401}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6826","nonce":2803788401},{"type":"v1","addr":"172.21.15.73:6827","nonce":2803788401}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6830","nonce":2803788401},{"type":"v1","addr":"172.21.15.73:6831","nonce":2803788401}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6828","nonce":2803788401},{"type":"v1","addr":"172.21.15.73:6829","nonce":2803788401}]},"public_addr":"172.21.15.73:6825/2803788401","cluster_addr":"172.21.15.73:6827/2803788401","heartbeat_back_addr":"172.21.15.73:6831/2803788401","heartbeat_front_addr":"172.21.15.73:6829/2803788401","state":["exists","up"]},{"osd":6,"uuid":"5790c6cc-bd56-4ce4-9a7c-0f0c3b59215c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6808","nonce":974108383},{"type":"v1","addr":"172.21.15.73:6809","nonce":974108383}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6810","nonce":974108383},{"type":"v1","addr":"172.21.15.73:6811","nonce":974108383}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6815","nonce":974108383},{"type":"v1","addr":"172.21.15.73:6817","nonce":974108383}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6812","nonce":974108383},{"type":"v1","addr":"172.21.15.73:6813","nonce":974108383}]},"public_addr":"172.21.15.73:6809/974108383","cluster_addr":"172.21.15.73:6811/974108383","heartbeat_back_addr":"172.21.15.73:6817/974108383","heartbeat_front_addr":"172.21.15.73:6813/974108383","state":["exists","up"]},{"osd":7,"uuid":"b66f4d2e-147e-4c9b-97dd-cbd59d33802e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6814","nonce":3772673248},{"type":"v1","addr":"172.21.15.73:6816","nonce":3772673248}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6818","nonce":3772673248},{"type":"v1","addr":"172.21.15.73:6819","nonce":3772673248}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6822","nonce":3772673248},{"type":"v1","addr":"172.21.15.73:6823","nonce":3772673248}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6820","nonce":3772673248},{"type":"v1","addr":"172.21.15.73:6821","nonce":3772673248}]},"public_addr":"172.21.15.73:6816/3772673248","cluster_addr":"172.21.15.73:6819/3772673248","heartbeat_back_addr":"172.21.15.73:6823/3772673248","heartbeat_front_addr":"172.21.15.73:6821/3772673248","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-05T18:56:04.115334+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-05T18:56:04.071250+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-05T18:56:04.044387+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-05T18:56:04.085389+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-05T18:56:04.090726+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-05T18:56:04.074529+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-05T18:56:04.058841+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-05T18:56:04.043054+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-05T18:56:57.266 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:57.263+0000 7f5a22c7e700 1 -- 172.21.15.46:0/3601895525 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7f5a0006ace0 msgr2=0x7f5a0006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:56:57.267 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:57.263+0000 7f5a22c7e700 1 --2- 172.21.15.46:0/3601895525 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7f5a0006ace0 0x7f5a0006d190 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f5a1c15c730 tx=0x7f5a08008040 comp rx=0 tx=0).stop 2023-07-05T18:56:57.267 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:57.263+0000 7f5a22c7e700 1 -- 172.21.15.46:0/3601895525 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5a1c06b7d0 msgr2=0x7f5a1c15c010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:56:57.267 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:57.263+0000 7f5a22c7e700 1 --2- 172.21.15.46:0/3601895525 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5a1c06b7d0 0x7f5a1c15c010 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f5a1000c450 tx=0x7f5a1000c810 comp rx=0 tx=0).stop 2023-07-05T18:56:57.267 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:57.264+0000 7f5a22c7e700 1 -- 172.21.15.46:0/3601895525 shutdown_connections 2023-07-05T18:56:57.267 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:57.264+0000 7f5a22c7e700 1 --2- 172.21.15.46:0/3601895525 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7f5a0006ace0 0x7f5a0006d190 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:57.267 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:57.264+0000 7f5a22c7e700 1 --2- 172.21.15.46:0/3601895525 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f5a1c0ce910 0x7f5a1c06dc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:57.268 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:57.264+0000 7f5a22c7e700 1 --2- 172.21.15.46:0/3601895525 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5a1c06b7d0 0x7f5a1c15c010 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:57.268 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:57.264+0000 7f5a22c7e700 1 --2- 172.21.15.46:0/3601895525 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5a1c0ccde0 0x7f5a1c1f2dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:57.268 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:57.264+0000 7f5a22c7e700 1 -- 172.21.15.46:0/3601895525 >> 172.21.15.46:0/3601895525 conn(0x7f5a1c099e00 msgr2=0x7f5a1c0ca300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-05T18:56:57.268 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:57.264+0000 7f5a22c7e700 1 -- 172.21.15.46:0/3601895525 shutdown_connections 2023-07-05T18:56:57.268 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:57.264+0000 7f5a22c7e700 1 -- 172.21.15.46:0/3601895525 wait complete. 2023-07-05T18:56:57.279 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'rbd', 'create_time': '2023-07-05T18:56:07.729620+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': '.mgr', 'create_time': '2023-07-05T18:56:08.128122+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-07-05T18:56:12.954625+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-07-05T18:56:14.068396+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-07-05T18:56:57.280 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-07-05T18:56:57.408 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:57.407+0000 7fabe7733700 1 Processor -- start 2023-07-05T18:56:57.409 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:57.407+0000 7fabe7733700 1 -- start start 2023-07-05T18:56:57.411 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:57.408+0000 7fabe7733700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fabe00af530 0x7fabe00cea80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:56:57.411 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:57.408+0000 7fabe7733700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fabe015ee20 0x7fabe00cefc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:56:57.411 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:57.408+0000 7fabe7733700 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fabe00b0ae0 con 0x7fabe00af160 2023-07-05T18:56:57.411 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:57.408+0000 7fabe7733700 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fabe00d15f0 con 0x7fabe015ee20 2023-07-05T18:56:57.411 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:57.408+0000 7fabe7733700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fabe00d1110 con 0x7fabe00af530 2023-07-05T18:56:57.411 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:57.408+0000 7fabe5cd0700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fabe015ee20 0x7fabe00cefc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:56:57.412 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:57.408+0000 7fabe54cf700 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7fabe00af160 0x7fabe00d0a00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:58530/0 (socket says 172.21.15.46:58530) 2023-07-05T18:56:57.412 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:57.408+0000 7fabe54cf700 1 -- 172.21.15.46:0/2000687406 learned_addr learned my addr 172.21.15.46:0/2000687406 (peer_addr_for_me v1:172.21.15.46:0/0) 2023-07-05T18:56:57.412 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:57.409+0000 7fabe4cce700 1 --2- 172.21.15.46:0/2000687406 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fabe00af530 0x7fabe00cea80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:56:57.412 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:57.409+0000 7fabd7fff700 1 -- 172.21.15.46:0/2000687406 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2853579991 0 0) 0x7fabe00b0ae0 con 0x7fabe00af160 2023-07-05T18:56:57.416 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:57.409+0000 7fabd7fff700 1 -- 172.21.15.46:0/2000687406 --> v1:172.21.15.46:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fabcc0035b0 con 0x7fabe00af160 2023-07-05T18:56:57.416 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:57.409+0000 7fabe5cd0700 1 -- 172.21.15.46:0/2000687406 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fabe00af530 msgr2=0x7fabe00cea80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-05T18:56:57.416 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:57.409+0000 7fabe5cd0700 1 --2- 172.21.15.46:0/2000687406 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fabe00af530 0x7fabe00cea80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:57.417 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:57.409+0000 7fabe5cd0700 1 -- 172.21.15.46:0/2000687406 >> v1:172.21.15.46:6789/0 conn(0x7fabe00af160 legacy=0x7fabe00d0a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:56:57.417 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:57.409+0000 7fabe5cd0700 1 -- 172.21.15.46:0/2000687406 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fabe00b1f80 con 0x7fabe015ee20 2023-07-05T18:56:57.417 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:57.409+0000 7fabe4cce700 1 --2- 172.21.15.46:0/2000687406 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fabe00af530 0x7fabe00cea80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-05T18:56:57.417 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:57.409+0000 7fabe5cd0700 1 --2- 172.21.15.46:0/2000687406 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fabe015ee20 0x7fabe00cefc0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7fabd8009d90 tx=0x7fabd800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7f5981af9d4129f server_cookie=0 in_seq=0 out_seq=0 2023-07-05T18:56:57.417 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:57.409+0000 7fabd7fff700 1 -- 172.21.15.46:0/2000687406 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fabd800e070 con 0x7fabe015ee20 2023-07-05T18:56:57.417 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:57.409+0000 7fabd7fff700 1 -- 172.21.15.46:0/2000687406 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fabd800bb20 con 0x7fabe015ee20 2023-07-05T18:56:57.417 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:57.409+0000 7fabd7fff700 1 -- 172.21.15.46:0/2000687406 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fabd8012430 con 0x7fabe015ee20 2023-07-05T18:56:57.418 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:57.410+0000 7fabe7733700 1 -- 172.21.15.46:0/2000687406 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fabe015ee20 msgr2=0x7fabe00cefc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:56:57.418 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:57.410+0000 7fabe7733700 1 --2- 172.21.15.46:0/2000687406 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fabe015ee20 0x7fabe00cefc0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7fabd8009d90 tx=0x7fabd800b330 comp rx=0 tx=0).stop 2023-07-05T18:56:57.418 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:57.410+0000 7fabe7733700 1 -- 172.21.15.46:0/2000687406 shutdown_connections 2023-07-05T18:56:57.418 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:57.410+0000 7fabe7733700 1 --2- 172.21.15.46:0/2000687406 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fabe015ee20 0x7fabe00cefc0 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:57.418 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:57.410+0000 7fabe7733700 1 --2- 172.21.15.46:0/2000687406 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fabe00af530 0x7fabe00cea80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:57.418 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:57.410+0000 7fabe7733700 1 -- 172.21.15.46:0/2000687406 >> 172.21.15.46:0/2000687406 conn(0x7fabe00664b0 msgr2=0x7fabe0099de0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-05T18:56:57.418 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:57.410+0000 7fabe7733700 1 -- 172.21.15.46:0/2000687406 shutdown_connections 2023-07-05T18:56:57.418 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:57.410+0000 7fabe7733700 1 -- 172.21.15.46:0/2000687406 wait complete. 2023-07-05T18:56:57.421 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:57.411+0000 7fabe7733700 1 Processor -- start 2023-07-05T18:56:57.421 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:57.411+0000 7fabe7733700 1 -- start start 2023-07-05T18:56:57.421 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:57.412+0000 7fabe7733700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fabe00af160 0x7fabe0157cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:56:57.421 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:57.412+0000 7fabe7733700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fabe00af530 0x7fabe01f3080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:56:57.422 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:57.412+0000 7fabe7733700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fabe015ee20 0x7fabe01f35c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:56:57.422 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:57.412+0000 7fabe7733700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fabe00b4710 con 0x7fabe00af160 2023-07-05T18:56:57.424 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:57.412+0000 7fabe7733700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fabe00b49f0 con 0x7fabe00af530 2023-07-05T18:56:57.424 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:57.412+0000 7fabe7733700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fabe00b4cd0 con 0x7fabe015ee20 2023-07-05T18:56:57.425 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:57.412+0000 7fabe54cf700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fabe00af160 0x7fabe0157cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:56:57.425 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:57.412+0000 7fabe54cf700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fabe00af160 0x7fabe0157cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:59264/0 (socket says 172.21.15.46:59264) 2023-07-05T18:56:57.425 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:57.412+0000 7fabe54cf700 1 -- 172.21.15.46:0/3196622441 learned_addr learned my addr 172.21.15.46:0/3196622441 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-07-05T18:56:57.425 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:57.412+0000 7fabe5cd0700 1 --2- 172.21.15.46:0/3196622441 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fabe015ee20 0x7fabe01f35c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:56:57.425 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:57.412+0000 7fabe4cce700 1 --2- 172.21.15.46:0/3196622441 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fabe00af530 0x7fabe01f3080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:56:57.425 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:57.412+0000 7fabe54cf700 1 -- 172.21.15.46:0/3196622441 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fabe015ee20 msgr2=0x7fabe01f35c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:56:57.426 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:57.412+0000 7fabe54cf700 1 --2- 172.21.15.46:0/3196622441 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fabe015ee20 0x7fabe01f35c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:57.426 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:57.412+0000 7fabe54cf700 1 -- 172.21.15.46:0/3196622441 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fabe00af530 msgr2=0x7fabe01f3080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:56:57.426 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:57.412+0000 7fabe54cf700 1 --2- 172.21.15.46:0/3196622441 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fabe00af530 0x7fabe01f3080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:57.426 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:57.412+0000 7fabe54cf700 1 -- 172.21.15.46:0/3196622441 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fabd8009a70 con 0x7fabe00af160 2023-07-05T18:56:57.426 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:57.412+0000 7fabe4cce700 1 --2- 172.21.15.46:0/3196622441 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fabe00af530 0x7fabe01f3080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-05T18:56:57.426 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:57.412+0000 7fabe54cf700 1 --2- 172.21.15.46:0/3196622441 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fabe00af160 0x7fabe0157cd0 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7fabd0001eb0 tx=0x7fabd000c860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-05T18:56:57.426 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:57.412+0000 7fabd5ffb700 1 -- 172.21.15.46:0/3196622441 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fabd0005d70 con 0x7fabe00af160 2023-07-05T18:56:57.426 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:57.412+0000 7fabd5ffb700 1 -- 172.21.15.46:0/3196622441 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fabd00070d0 con 0x7fabe00af160 2023-07-05T18:56:57.427 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:57.412+0000 7fabd5ffb700 1 -- 172.21.15.46:0/3196622441 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fabd0007460 con 0x7fabe00af160 2023-07-05T18:56:57.427 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:57.413+0000 7fabe7733700 1 -- 172.21.15.46:0/3196622441 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fabe015bf00 con 0x7fabe00af160 2023-07-05T18:56:57.427 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:57.413+0000 7fabe7733700 1 -- 172.21.15.46:0/3196622441 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fabe0158210 con 0x7fabe00af160 2023-07-05T18:56:57.427 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:57.414+0000 7fabe7733700 1 -- 172.21.15.46:0/3196622441 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fabe015bd60 con 0x7fabe00af160 2023-07-05T18:56:57.427 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:57.414+0000 7fabd5ffb700 1 -- 172.21.15.46:0/3196622441 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fabd00075c0 con 0x7fabe00af160 2023-07-05T18:56:57.427 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:57.414+0000 7fabd5ffb700 1 --2- 172.21.15.46:0/3196622441 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7fabc406ace0 0x7fabc406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:56:57.427 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:57.415+0000 7fabd5ffb700 1 -- 172.21.15.46:0/3196622441 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fabd0088a40 con 0x7fabe00af160 2023-07-05T18:56:57.428 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:57.415+0000 7fabe4cce700 1 --2- 172.21.15.46:0/3196622441 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7fabc406ace0 0x7fabc406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:56:57.428 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:57.415+0000 7fabe4cce700 1 --2- 172.21.15.46:0/3196622441 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7fabc406ace0 0x7fabc406d190 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fabe00b07a0 tx=0x7fabdc008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-05T18:56:57.428 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:57.419+0000 7fabd5ffb700 1 -- 172.21.15.46:0/3196622441 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fabe015bd60 con 0x7fabe00af160 2023-07-05T18:56:57.618 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:57.617+0000 7fabe7733700 1 -- 172.21.15.46:0/3196622441 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fabe015bd60 con 0x7fabe00af160 2023-07-05T18:56:57.620 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:57.617+0000 7fabd5ffb700 1 -- 172.21.15.46:0/3196622441 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v21) v1 ==== 92+0+10 (secure 0 0 0) 0x7fabe015bd60 con 0x7fabe00af160 2023-07-05T18:56:57.621 INFO:teuthology.orchestra.run.smithi046.stdout:pg_num: 8 2023-07-05T18:56:57.621 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:57.619+0000 7fabe7733700 1 -- 172.21.15.46:0/3196622441 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7fabc406ace0 msgr2=0x7fabc406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:56:57.622 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:57.619+0000 7fabe7733700 1 --2- 172.21.15.46:0/3196622441 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7fabc406ace0 0x7fabc406d190 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fabe00b07a0 tx=0x7fabdc008040 comp rx=0 tx=0).stop 2023-07-05T18:56:57.622 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:57.619+0000 7fabe7733700 1 -- 172.21.15.46:0/3196622441 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fabe00af160 msgr2=0x7fabe0157cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:56:57.622 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:57.619+0000 7fabe7733700 1 --2- 172.21.15.46:0/3196622441 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fabe00af160 0x7fabe0157cd0 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7fabd0001eb0 tx=0x7fabd000c860 comp rx=0 tx=0).stop 2023-07-05T18:56:57.622 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:57.619+0000 7fabe7733700 1 -- 172.21.15.46:0/3196622441 shutdown_connections 2023-07-05T18:56:57.622 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:57.619+0000 7fabe7733700 1 --2- 172.21.15.46:0/3196622441 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7fabc406ace0 0x7fabc406d190 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:57.622 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:57.619+0000 7fabe7733700 1 --2- 172.21.15.46:0/3196622441 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fabe015ee20 0x7fabe01f35c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:57.624 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:57.619+0000 7fabe7733700 1 --2- 172.21.15.46:0/3196622441 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fabe00af160 0x7fabe0157cd0 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:57.625 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:57.619+0000 7fabe7733700 1 --2- 172.21.15.46:0/3196622441 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fabe00af530 0x7fabe01f3080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:57.625 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:57.619+0000 7fabe7733700 1 -- 172.21.15.46:0/3196622441 >> 172.21.15.46:0/3196622441 conn(0x7fabe00664b0 msgr2=0x7fabe015e1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-05T18:56:57.625 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:57.619+0000 7fabe7733700 1 -- 172.21.15.46:0/3196622441 shutdown_connections 2023-07-05T18:56:57.625 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:57.619+0000 7fabe7733700 1 -- 172.21.15.46:0/3196622441 wait complete. 2023-07-05T18:56:57.638 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-07-05T18:56:57.770 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:57.765+0000 7f9de3f52700 1 Processor -- start 2023-07-05T18:56:57.771 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:57.765+0000 7f9de3f52700 1 -- start start 2023-07-05T18:56:57.771 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:57.766+0000 7f9de3f52700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f9ddc06b4e0 0x7f9ddc0ccd90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:56:57.772 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:57.766+0000 7f9de3f52700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f9ddc0ce9a0 0x7f9ddc0cd2d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:56:57.772 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:57.766+0000 7f9de3f52700 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9ddc142e90 con 0x7f9ddc0c9810 2023-07-05T18:56:57.772 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:57.766+0000 7f9de3f52700 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9ddc0ca5d0 con 0x7f9ddc0ce9a0 2023-07-05T18:56:57.772 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:57.766+0000 7f9de3f52700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9ddc0ce510 con 0x7f9ddc06b4e0 2023-07-05T18:56:57.774 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:57.766+0000 7f9de14ed700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f9ddc0ce9a0 0x7f9ddc0cd2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:56:57.774 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:57.766+0000 7f9de1cee700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f9ddc06b4e0 0x7f9ddc0ccd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:56:57.774 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:57.766+0000 7f9de14ed700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f9ddc0ce9a0 0x7f9ddc0cd2d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.46:58756/0 (socket says 172.21.15.46:58756) 2023-07-05T18:56:57.774 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:57.766+0000 7f9de14ed700 1 -- 172.21.15.46:0/3247197813 learned_addr learned my addr 172.21.15.46:0/3247197813 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-07-05T18:56:57.774 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:57.766+0000 7f9de1cee700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f9ddc06b4e0 0x7f9ddc0ccd90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3301/0 says I am v2:172.21.15.46:42958/0 (socket says 172.21.15.46:42958) 2023-07-05T18:56:57.775 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:57.766+0000 7f9de24ef700 1 --1- 172.21.15.46:0/3247197813 >> v1:172.21.15.73:6789/0 conn(0x7f9ddc0c9810 0x7f9ddc06fd80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.46:44464/0 (socket says 172.21.15.46:44464) 2023-07-05T18:56:57.775 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:57.767+0000 7f9de0cec700 1 -- 172.21.15.46:0/3247197813 <== mon.1 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3871862001 0 0) 0x7f9ddc142e90 con 0x7f9ddc0c9810 2023-07-05T18:56:57.775 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:57.767+0000 7f9de0cec700 1 -- 172.21.15.46:0/3247197813 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9dc80035b0 con 0x7f9ddc0c9810 2023-07-05T18:56:57.775 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:57.767+0000 7f9de14ed700 1 -- 172.21.15.46:0/3247197813 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f9ddc06b4e0 msgr2=0x7f9ddc0ccd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-05T18:56:57.775 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:57.767+0000 7f9de14ed700 1 --2- 172.21.15.46:0/3247197813 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f9ddc06b4e0 0x7f9ddc0ccd90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:57.775 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:57.767+0000 7f9de14ed700 1 -- 172.21.15.46:0/3247197813 >> v1:172.21.15.73:6789/0 conn(0x7f9ddc0c9810 legacy=0x7f9ddc06fd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:56:57.776 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:57.767+0000 7f9de14ed700 1 -- 172.21.15.46:0/3247197813 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ddc159780 con 0x7f9ddc0ce9a0 2023-07-05T18:56:57.776 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:57.767+0000 7f9de1cee700 1 --2- 172.21.15.46:0/3247197813 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f9ddc06b4e0 0x7f9ddc0ccd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-05T18:56:57.776 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:57.767+0000 7f9de14ed700 1 --2- 172.21.15.46:0/3247197813 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9ddc0ce9a0 0x7f9ddc0cd2d0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f9dd800bb90 tx=0x7f9dd800bea0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3a1c2d7f376e2443 server_cookie=0 in_seq=0 out_seq=0 2023-07-05T18:56:57.776 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:57.767+0000 7f9de0cec700 1 -- 172.21.15.46:0/3247197813 <== mon.1 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9dd800dd30 con 0x7f9ddc0ce9a0 2023-07-05T18:56:57.776 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:57.767+0000 7f9de0cec700 1 -- 172.21.15.46:0/3247197813 <== mon.1 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9dd800de90 con 0x7f9ddc0ce9a0 2023-07-05T18:56:57.776 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:57.767+0000 7f9de0cec700 1 -- 172.21.15.46:0/3247197813 <== mon.1 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9dd8010690 con 0x7f9ddc0ce9a0 2023-07-05T18:56:57.776 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:57.768+0000 7f9de3f52700 1 -- 172.21.15.46:0/3247197813 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9ddc0ce9a0 msgr2=0x7f9ddc0cd2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:56:57.777 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:57.768+0000 7f9de3f52700 1 --2- 172.21.15.46:0/3247197813 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9ddc0ce9a0 0x7f9ddc0cd2d0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f9dd800bb90 tx=0x7f9dd800bea0 comp rx=0 tx=0).stop 2023-07-05T18:56:57.777 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:57.768+0000 7f9de3f52700 1 -- 172.21.15.46:0/3247197813 shutdown_connections 2023-07-05T18:56:57.777 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:57.768+0000 7f9de3f52700 1 --2- 172.21.15.46:0/3247197813 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f9ddc06b4e0 0x7f9ddc0ccd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:57.777 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:57.768+0000 7f9de3f52700 1 --2- 172.21.15.46:0/3247197813 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9ddc0ce9a0 0x7f9ddc0cd2d0 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:57.777 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:57.768+0000 7f9de3f52700 1 -- 172.21.15.46:0/3247197813 >> 172.21.15.46:0/3247197813 conn(0x7f9ddc0b19a0 msgr2=0x7f9ddc0cf1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-05T18:56:57.777 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:57.768+0000 7f9de3f52700 1 -- 172.21.15.46:0/3247197813 shutdown_connections 2023-07-05T18:56:57.777 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:57.768+0000 7f9de3f52700 1 -- 172.21.15.46:0/3247197813 wait complete. 2023-07-05T18:56:57.778 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:57.769+0000 7f9de3f52700 1 Processor -- start 2023-07-05T18:56:57.778 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:57.769+0000 7f9de3f52700 1 -- start start 2023-07-05T18:56:57.782 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:57.770+0000 7f9de3f52700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9ddc06b4e0 0x7f9ddc0b4c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:56:57.782 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:57.770+0000 7f9de3f52700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9ddc0c9810 0x7f9ddc1f0fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:56:57.783 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:57.770+0000 7f9de3f52700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f9ddc0ce9a0 0x7f9ddc1f14e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:56:57.783 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:57.770+0000 7f9de3f52700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ddc0b5160 con 0x7f9ddc0c9810 2023-07-05T18:56:57.783 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:57.770+0000 7f9de3f52700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ddc1f1af0 con 0x7f9ddc06b4e0 2023-07-05T18:56:57.783 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:57.770+0000 7f9de3f52700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9ddc15ac30 con 0x7f9ddc0ce9a0 2023-07-05T18:56:57.783 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:57.770+0000 7f9de14ed700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9ddc0c9810 0x7f9ddc1f0fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:56:57.783 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:57.770+0000 7f9de14ed700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9ddc0c9810 0x7f9ddc1f0fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:59280/0 (socket says 172.21.15.46:59280) 2023-07-05T18:56:57.783 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:57.770+0000 7f9de14ed700 1 -- 172.21.15.46:0/834925377 learned_addr learned my addr 172.21.15.46:0/834925377 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-07-05T18:56:57.784 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:57.770+0000 7f9de24ef700 1 --2- 172.21.15.46:0/834925377 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f9ddc0ce9a0 0x7f9ddc1f14e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:56:57.784 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:57.770+0000 7f9de1cee700 1 --2- 172.21.15.46:0/834925377 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9ddc06b4e0 0x7f9ddc0b4c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:56:57.784 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:57.770+0000 7f9de14ed700 1 -- 172.21.15.46:0/834925377 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f9ddc0ce9a0 msgr2=0x7f9ddc1f14e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:56:57.784 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:57.770+0000 7f9de14ed700 1 --2- 172.21.15.46:0/834925377 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f9ddc0ce9a0 0x7f9ddc1f14e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:57.784 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:57.770+0000 7f9de14ed700 1 -- 172.21.15.46:0/834925377 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9ddc06b4e0 msgr2=0x7f9ddc0b4c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:56:57.784 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:57.770+0000 7f9de14ed700 1 --2- 172.21.15.46:0/834925377 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9ddc06b4e0 0x7f9ddc0b4c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:57.785 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:57.770+0000 7f9de14ed700 1 -- 172.21.15.46:0/834925377 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9dcc0094a0 con 0x7f9ddc0c9810 2023-07-05T18:56:57.785 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:57.771+0000 7f9de14ed700 1 --2- 172.21.15.46:0/834925377 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9ddc0c9810 0x7f9ddc1f0fa0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f9dd8000c00 tx=0x7f9dd8004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-05T18:56:57.785 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:57.771+0000 7f9dd27fc700 1 -- 172.21.15.46:0/834925377 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9dd801f070 con 0x7f9ddc0c9810 2023-07-05T18:56:57.785 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:57.771+0000 7f9dd27fc700 1 -- 172.21.15.46:0/834925377 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9dd80038b0 con 0x7f9ddc0c9810 2023-07-05T18:56:57.785 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:57.771+0000 7f9de3f52700 1 -- 172.21.15.46:0/834925377 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9dd800b7f0 con 0x7f9ddc0c9810 2023-07-05T18:56:57.785 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:57.771+0000 7f9dd27fc700 1 -- 172.21.15.46:0/834925377 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9dd8003c60 con 0x7f9ddc0c9810 2023-07-05T18:56:57.785 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:57.771+0000 7f9de3f52700 1 -- 172.21.15.46:0/834925377 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9ddc15b1f0 con 0x7f9ddc0c9810 2023-07-05T18:56:57.786 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:57.772+0000 7f9de3f52700 1 -- 172.21.15.46:0/834925377 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9ddc0672e0 con 0x7f9ddc0c9810 2023-07-05T18:56:57.786 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:57.772+0000 7f9dd27fc700 1 -- 172.21.15.46:0/834925377 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f9dd8024470 con 0x7f9ddc0c9810 2023-07-05T18:56:57.786 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:57.772+0000 7f9dd27fc700 1 --2- 172.21.15.46:0/834925377 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7f9dc006ace0 0x7f9dc006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:56:57.786 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:57.773+0000 7f9dd27fc700 1 -- 172.21.15.46:0/834925377 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f9dd808cd90 con 0x7f9ddc0c9810 2023-07-05T18:56:57.786 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:57.773+0000 7f9de1cee700 1 --2- 172.21.15.46:0/834925377 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7f9dc006ace0 0x7f9dc006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:56:57.786 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:57.773+0000 7f9de1cee700 1 --2- 172.21.15.46:0/834925377 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7f9dc006ace0 0x7f9dc006d190 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f9dcc009cd0 tx=0x7f9dcc009210 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-05T18:56:57.786 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:57.777+0000 7f9dd27fc700 1 -- 172.21.15.46:0/834925377 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f9dd8057ed0 con 0x7f9ddc0c9810 2023-07-05T18:56:57.974 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:57.973+0000 7f9de3f52700 1 -- 172.21.15.46:0/834925377 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f9ddc15b3b0 con 0x7f9ddc0c9810 2023-07-05T18:56:57.974 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:57.973+0000 7f9dd27fc700 1 -- 172.21.15.46:0/834925377 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v21) v1 ==== 93+0+10 (secure 0 0 0) 0x7f9dd805b4f0 con 0x7f9ddc0c9810 2023-07-05T18:56:57.975 INFO:teuthology.orchestra.run.smithi046.stdout:pg_num: 1 2023-07-05T18:56:57.977 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:57.976+0000 7f9de3f52700 1 -- 172.21.15.46:0/834925377 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7f9dc006ace0 msgr2=0x7f9dc006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:56:57.977 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:57.976+0000 7f9de3f52700 1 --2- 172.21.15.46:0/834925377 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7f9dc006ace0 0x7f9dc006d190 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f9dcc009cd0 tx=0x7f9dcc009210 comp rx=0 tx=0).stop 2023-07-05T18:56:57.977 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:57.976+0000 7f9de3f52700 1 -- 172.21.15.46:0/834925377 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9ddc0c9810 msgr2=0x7f9ddc1f0fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:56:57.977 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:57.976+0000 7f9de3f52700 1 --2- 172.21.15.46:0/834925377 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9ddc0c9810 0x7f9ddc1f0fa0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f9dd8000c00 tx=0x7f9dd8004750 comp rx=0 tx=0).stop 2023-07-05T18:56:57.977 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:57.976+0000 7f9de3f52700 1 -- 172.21.15.46:0/834925377 shutdown_connections 2023-07-05T18:56:57.977 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:57.976+0000 7f9de3f52700 1 --2- 172.21.15.46:0/834925377 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7f9dc006ace0 0x7f9dc006d190 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:57.978 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:57.976+0000 7f9de3f52700 1 --2- 172.21.15.46:0/834925377 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f9ddc0ce9a0 0x7f9ddc1f14e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:57.978 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:57.976+0000 7f9de3f52700 1 --2- 172.21.15.46:0/834925377 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9ddc06b4e0 0x7f9ddc0b4c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:57.978 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:57.976+0000 7f9de3f52700 1 --2- 172.21.15.46:0/834925377 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9ddc0c9810 0x7f9ddc1f0fa0 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:57.978 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:57.976+0000 7f9de3f52700 1 -- 172.21.15.46:0/834925377 >> 172.21.15.46:0/834925377 conn(0x7f9ddc0b19a0 msgr2=0x7f9ddc158f40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-05T18:56:57.978 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:57.976+0000 7f9de3f52700 1 -- 172.21.15.46:0/834925377 shutdown_connections 2023-07-05T18:56:57.978 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:57.976+0000 7f9de3f52700 1 -- 172.21.15.46:0/834925377 wait complete. 2023-07-05T18:56:57.989 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-07-05T18:56:58.117 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:58.117+0000 7f74b79e6700 1 Processor -- start 2023-07-05T18:56:58.118 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:58.117+0000 7f74b79e6700 1 -- start start 2023-07-05T18:56:58.119 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:58.118+0000 7f74b79e6700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f74b00d0ab0 0x7f74b00d0f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:56:58.119 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:58.118+0000 7f74b79e6700 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f74b00aed40 con 0x7f74b00ce6f0 2023-07-05T18:56:58.119 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:58.118+0000 7f74b79e6700 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f74b00ae130 con 0x7f74b015a400 2023-07-05T18:56:58.120 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:58.118+0000 7f74b79e6700 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f74b015a7d0 con 0x7f74b00d0ab0 2023-07-05T18:56:58.120 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:58.118+0000 7f74b4f81700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f74b00d0ab0 0x7f74b00d0f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:56:58.120 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:58.118+0000 7f74b5f83700 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7f74b00ce6f0 0x7f74b00ceb30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:58562/0 (socket says 172.21.15.46:58562) 2023-07-05T18:56:58.120 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:58.118+0000 7f74b5f83700 1 -- 172.21.15.46:0/4001189638 learned_addr learned my addr 172.21.15.46:0/4001189638 (peer_addr_for_me v1:172.21.15.46:0/0) 2023-07-05T18:56:58.120 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:58.118+0000 7f74b4f81700 1 -- 172.21.15.46:0/4001189638 >> v1:172.21.15.73:6789/0 conn(0x7f74b015a400 legacy=0x7f74b00af1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:56:58.121 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:58.118+0000 7f74b4f81700 1 -- 172.21.15.46:0/4001189638 >> v1:172.21.15.46:6789/0 conn(0x7f74b00ce6f0 legacy=0x7f74b00ceb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:56:58.121 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:58.118+0000 7f74b4f81700 1 -- 172.21.15.46:0/4001189638 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f74b00ae410 con 0x7f74b00d0ab0 2023-07-05T18:56:58.121 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:58.118+0000 7f74a7fff700 1 -- 172.21.15.46:0/4001189638 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 764601225 0 0) 0x7f74b00aed40 con 0x7f74b00ce6f0 2023-07-05T18:56:58.121 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:58.118+0000 7f74b4f81700 1 --2- 172.21.15.46:0/4001189638 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f74b00d0ab0 0x7f74b00d0f50 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f74ac009840 tx=0x7f74ac009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=575e669f8fcea8d2 server_cookie=0 in_seq=0 out_seq=0 2023-07-05T18:56:58.121 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:58.118+0000 7f74a7fff700 1 -- 172.21.15.46:0/4001189638 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74ac011830 con 0x7f74b00d0ab0 2023-07-05T18:56:58.122 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:58.118+0000 7f74a7fff700 1 -- 172.21.15.46:0/4001189638 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f74ac011990 con 0x7f74b00d0ab0 2023-07-05T18:56:58.122 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:58.118+0000 7f74a7fff700 1 -- 172.21.15.46:0/4001189638 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74ac011d20 con 0x7f74b00d0ab0 2023-07-05T18:56:58.126 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:58.119+0000 7f74b79e6700 1 -- 172.21.15.46:0/4001189638 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f74b00d0ab0 msgr2=0x7f74b00d0f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:56:58.126 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:58.119+0000 7f74b79e6700 1 --2- 172.21.15.46:0/4001189638 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f74b00d0ab0 0x7f74b00d0f50 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f74ac009840 tx=0x7f74ac009b50 comp rx=0 tx=0).stop 2023-07-05T18:56:58.126 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:58.119+0000 7f74b79e6700 1 -- 172.21.15.46:0/4001189638 shutdown_connections 2023-07-05T18:56:58.126 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:58.119+0000 7f74b79e6700 1 --2- 172.21.15.46:0/4001189638 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f74b00d0ab0 0x7f74b00d0f50 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:58.126 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:58.119+0000 7f74b79e6700 1 -- 172.21.15.46:0/4001189638 >> 172.21.15.46:0/4001189638 conn(0x7f74b0071cf0 msgr2=0x7f74b0099e30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-05T18:56:58.127 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:58.119+0000 7f74b79e6700 1 -- 172.21.15.46:0/4001189638 shutdown_connections 2023-07-05T18:56:58.127 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:58.119+0000 7f74b79e6700 1 -- 172.21.15.46:0/4001189638 wait complete. 2023-07-05T18:56:58.127 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:58.120+0000 7f74b79e6700 1 Processor -- start 2023-07-05T18:56:58.127 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:58.120+0000 7f74b79e6700 1 -- start start 2023-07-05T18:56:58.127 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:58.121+0000 7f74b79e6700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f74b00ce6f0 0x7f74b00b62f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:56:58.127 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:58.121+0000 7f74b79e6700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f74b00d0ab0 0x7f74b00b5550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:56:58.127 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:58.121+0000 7f74b79e6700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f74b015a400 0x7f74b00b5a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:56:58.128 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:58.121+0000 7f74b79e6700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74b00cf240 con 0x7f74b00d0ab0 2023-07-05T18:56:58.128 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:58.121+0000 7f74b79e6700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74b00c4fb0 con 0x7f74b015a400 2023-07-05T18:56:58.128 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:58.121+0000 7f74b79e6700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f74b00b5fd0 con 0x7f74b00ce6f0 2023-07-05T18:56:58.128 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:58.121+0000 7f74b4f81700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f74b00d0ab0 0x7f74b00b5550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:56:58.128 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:58.121+0000 7f74b4f81700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f74b00d0ab0 0x7f74b00b5550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:59294/0 (socket says 172.21.15.46:59294) 2023-07-05T18:56:58.128 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:58.121+0000 7f74b4f81700 1 -- 172.21.15.46:0/1169802513 learned_addr learned my addr 172.21.15.46:0/1169802513 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-07-05T18:56:58.128 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:58.121+0000 7f74b5782700 1 --2- 172.21.15.46:0/1169802513 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f74b00ce6f0 0x7f74b00b62f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:56:58.129 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:58.121+0000 7f74b5f83700 1 --2- 172.21.15.46:0/1169802513 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f74b015a400 0x7f74b00b5a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:56:58.129 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:58.121+0000 7f74b4f81700 1 -- 172.21.15.46:0/1169802513 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f74b00ce6f0 msgr2=0x7f74b00b62f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:56:58.129 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:58.121+0000 7f74b4f81700 1 --2- 172.21.15.46:0/1169802513 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f74b00ce6f0 0x7f74b00b62f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:58.129 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:58.121+0000 7f74b4f81700 1 -- 172.21.15.46:0/1169802513 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f74b015a400 msgr2=0x7f74b00b5a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:56:58.130 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:58.121+0000 7f74b4f81700 1 --2- 172.21.15.46:0/1169802513 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f74b015a400 0x7f74b00b5a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:58.130 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:58.121+0000 7f74b4f81700 1 -- 172.21.15.46:0/1169802513 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f74ac0094a0 con 0x7f74b00d0ab0 2023-07-05T18:56:58.130 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:58.121+0000 7f74b5782700 1 --2- 172.21.15.46:0/1169802513 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f74b00ce6f0 0x7f74b00b62f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-05T18:56:58.130 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:58.122+0000 7f74b4f81700 1 --2- 172.21.15.46:0/1169802513 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f74b00d0ab0 0x7f74b00b5550 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f74ac0090b0 tx=0x7f74ac004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-05T18:56:58.130 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:58.122+0000 7f74a5ffb700 1 -- 172.21.15.46:0/1169802513 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74ac01a900 con 0x7f74b00d0ab0 2023-07-05T18:56:58.130 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:58.122+0000 7f74a5ffb700 1 -- 172.21.15.46:0/1169802513 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f74ac01aa60 con 0x7f74b00d0ab0 2023-07-05T18:56:58.130 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:58.122+0000 7f74b79e6700 1 -- 172.21.15.46:0/1169802513 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f74b00b3950 con 0x7f74b00d0ab0 2023-07-05T18:56:58.131 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:58.122+0000 7f74a5ffb700 1 -- 172.21.15.46:0/1169802513 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74ac01add0 con 0x7f74b00d0ab0 2023-07-05T18:56:58.131 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:58.122+0000 7f74b79e6700 1 -- 172.21.15.46:0/1169802513 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f74b00b3ef0 con 0x7f74b00d0ab0 2023-07-05T18:56:58.131 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:58.123+0000 7f74b79e6700 1 -- 172.21.15.46:0/1169802513 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f74b00b4110 con 0x7f74b00d0ab0 2023-07-05T18:56:58.131 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:58.123+0000 7f74a5ffb700 1 -- 172.21.15.46:0/1169802513 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f74ac022070 con 0x7f74b00d0ab0 2023-07-05T18:56:58.131 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:58.124+0000 7f74a5ffb700 1 --2- 172.21.15.46:0/1169802513 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7f749406ace0 0x7f749406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:56:58.131 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:58.124+0000 7f74a5ffb700 1 -- 172.21.15.46:0/1169802513 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f74ac08a690 con 0x7f74b00d0ab0 2023-07-05T18:56:58.132 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:58.124+0000 7f74b5782700 1 --2- 172.21.15.46:0/1169802513 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7f749406ace0 0x7f749406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:56:58.132 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:58.125+0000 7f74b5782700 1 --2- 172.21.15.46:0/1169802513 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7f749406ace0 0x7f749406d190 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f74a0000f60 tx=0x7f74a0009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-05T18:56:58.133 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:58.128+0000 7f74a5ffb700 1 -- 172.21.15.46:0/1169802513 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f74ac055880 con 0x7f74b00d0ab0 2023-07-05T18:56:58.324 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:58.323+0000 7f74b79e6700 1 -- 172.21.15.46:0/1169802513 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f74b00b6140 con 0x7f74b00d0ab0 2023-07-05T18:56:58.325 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:58.324+0000 7f74a5ffb700 1 -- 172.21.15.46:0/1169802513 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v21) v1 ==== 104+0+11 (secure 0 0 0) 0x7f74ac058ea0 con 0x7f74b00d0ab0 2023-07-05T18:56:58.325 INFO:teuthology.orchestra.run.smithi046.stdout:pg_num: 32 2023-07-05T18:56:58.327 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:58.326+0000 7f74b79e6700 1 -- 172.21.15.46:0/1169802513 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7f749406ace0 msgr2=0x7f749406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:56:58.327 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:58.326+0000 7f74b79e6700 1 --2- 172.21.15.46:0/1169802513 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7f749406ace0 0x7f749406d190 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f74a0000f60 tx=0x7f74a0009040 comp rx=0 tx=0).stop 2023-07-05T18:56:58.327 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:58.326+0000 7f74b79e6700 1 -- 172.21.15.46:0/1169802513 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f74b00d0ab0 msgr2=0x7f74b00b5550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:56:58.327 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:58.326+0000 7f74b79e6700 1 --2- 172.21.15.46:0/1169802513 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f74b00d0ab0 0x7f74b00b5550 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f74ac0090b0 tx=0x7f74ac004750 comp rx=0 tx=0).stop 2023-07-05T18:56:58.327 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:58.326+0000 7f74b79e6700 1 -- 172.21.15.46:0/1169802513 shutdown_connections 2023-07-05T18:56:58.327 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:58.326+0000 7f74b79e6700 1 --2- 172.21.15.46:0/1169802513 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7f749406ace0 0x7f749406d190 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:58.328 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:58.326+0000 7f74b79e6700 1 --2- 172.21.15.46:0/1169802513 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f74b015a400 0x7f74b00b5a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:58.328 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:58.326+0000 7f74b79e6700 1 --2- 172.21.15.46:0/1169802513 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f74b00ce6f0 0x7f74b00b62f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:58.328 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:58.326+0000 7f74b79e6700 1 --2- 172.21.15.46:0/1169802513 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f74b00d0ab0 0x7f74b00b5550 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:58.328 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:58.326+0000 7f74b79e6700 1 -- 172.21.15.46:0/1169802513 >> 172.21.15.46:0/1169802513 conn(0x7f74b0071cf0 msgr2=0x7f74b006db80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-05T18:56:58.328 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:58.326+0000 7f74b79e6700 1 -- 172.21.15.46:0/1169802513 shutdown_connections 2023-07-05T18:56:58.328 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:58.326+0000 7f74b79e6700 1 -- 172.21.15.46:0/1169802513 wait complete. 2023-07-05T18:56:58.339 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-07-05T18:56:58.468 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:58.467+0000 7f3455346700 1 Processor -- start 2023-07-05T18:56:58.468 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:58.467+0000 7f3455346700 1 -- start start 2023-07-05T18:56:58.469 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:58.468+0000 7f3455346700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f345015c6c0 0x7f34500cd2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:56:58.469 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:58.468+0000 7f3455346700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f34500b5ae0 0x7f34500b5f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:56:58.469 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:58.468+0000 7f3455346700 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f34500cd8c0 con 0x7f345015c2f0 2023-07-05T18:56:58.470 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:58.468+0000 7f3455346700 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f34500d0990 con 0x7f34500b5ae0 2023-07-05T18:56:58.470 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:58.468+0000 7f3455346700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f34500d0c70 con 0x7f345015c6c0 2023-07-05T18:56:58.470 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:58.468+0000 7f344e7fc700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f345015c6c0 0x7f34500cd2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:56:58.471 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:58.468+0000 7f344f7fe700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f34500b5ae0 0x7f34500b5f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:56:58.471 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:58.468+0000 7f344e7fc700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f345015c6c0 0x7f34500cd2e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3301/0 says I am v2:172.21.15.46:42986/0 (socket says 172.21.15.46:42986) 2023-07-05T18:56:58.471 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:58.468+0000 7f344e7fc700 1 -- 172.21.15.46:0/3956230436 learned_addr learned my addr 172.21.15.46:0/3956230436 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-07-05T18:56:58.471 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:58.468+0000 7f344f7fe700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f34500b5ae0 0x7f34500b5f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.46:58788/0 (socket says 172.21.15.46:58788) 2023-07-05T18:56:58.471 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:58.469+0000 7f344f7fe700 1 -- 172.21.15.46:0/3956230436 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f345015c6c0 msgr2=0x7f34500cd2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-05T18:56:58.471 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:58.469+0000 7f344f7fe700 1 --2- 172.21.15.46:0/3956230436 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f345015c6c0 0x7f34500cd2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:58.472 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:58.469+0000 7f344f7fe700 1 -- 172.21.15.46:0/3956230436 >> v1:172.21.15.73:6789/0 conn(0x7f345015c2f0 legacy=0x7f345006c760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:56:58.472 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:58.469+0000 7f344f7fe700 1 -- 172.21.15.46:0/3956230436 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f34500d0f50 con 0x7f34500b5ae0 2023-07-05T18:56:58.472 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:58.469+0000 7f344e7fc700 1 --2- 172.21.15.46:0/3956230436 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f345015c6c0 0x7f34500cd2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-05T18:56:58.476 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:58.469+0000 7f344f7fe700 1 --2- 172.21.15.46:0/3956230436 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f34500b5ae0 0x7f34500b5f00 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f3448009d90 tx=0x7f344800b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5e867a132358abb2 server_cookie=0 in_seq=0 out_seq=0 2023-07-05T18:56:58.476 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:58.469+0000 7f344dffb700 1 -- 172.21.15.46:0/3956230436 <== mon.1 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f344800e070 con 0x7f34500b5ae0 2023-07-05T18:56:58.476 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:58.469+0000 7f344dffb700 1 -- 172.21.15.46:0/3956230436 <== mon.1 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f344800bb20 con 0x7f34500b5ae0 2023-07-05T18:56:58.477 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:58.469+0000 7f344dffb700 1 -- 172.21.15.46:0/3956230436 <== mon.1 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3448012430 con 0x7f34500b5ae0 2023-07-05T18:56:58.477 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:58.469+0000 7f3455346700 1 -- 172.21.15.46:0/3956230436 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f34500b5ae0 msgr2=0x7f34500b5f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:56:58.477 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:58.469+0000 7f3455346700 1 --2- 172.21.15.46:0/3956230436 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f34500b5ae0 0x7f34500b5f00 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f3448009d90 tx=0x7f344800b330 comp rx=0 tx=0).stop 2023-07-05T18:56:58.477 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:58.469+0000 7f3455346700 1 -- 172.21.15.46:0/3956230436 shutdown_connections 2023-07-05T18:56:58.477 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:58.469+0000 7f3455346700 1 --2- 172.21.15.46:0/3956230436 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f34500b5ae0 0x7f34500b5f00 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:58.477 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:58.469+0000 7f3455346700 1 --2- 172.21.15.46:0/3956230436 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f345015c6c0 0x7f34500cd2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:58.478 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:58.469+0000 7f3455346700 1 -- 172.21.15.46:0/3956230436 >> 172.21.15.46:0/3956230436 conn(0x7f345006afa0 msgr2=0x7f34500cf710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-05T18:56:58.478 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:58.469+0000 7f3455346700 1 -- 172.21.15.46:0/3956230436 shutdown_connections 2023-07-05T18:56:58.478 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:58.470+0000 7f3455346700 1 -- 172.21.15.46:0/3956230436 wait complete. 2023-07-05T18:56:58.478 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:58.471+0000 7f3455346700 1 Processor -- start 2023-07-05T18:56:58.478 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:58.471+0000 7f3455346700 1 -- start start 2023-07-05T18:56:58.478 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:58.472+0000 7f3455346700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f34500b5ae0 0x7f34501e7790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:56:58.478 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:58.472+0000 7f3455346700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f345015c2f0 0x7f3450149320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:56:58.479 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:58.472+0000 7f3455346700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f345015c6c0 0x7f34500b7620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:56:58.479 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:58.472+0000 7f3455346700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34501477c0 con 0x7f345015c6c0 2023-07-05T18:56:58.479 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:58.472+0000 7f3455346700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3450149db0 con 0x7f345015c2f0 2023-07-05T18:56:58.479 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:58.472+0000 7f3455346700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f345014a090 con 0x7f34500b5ae0 2023-07-05T18:56:58.479 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:58.472+0000 7f344f7fe700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f345015c6c0 0x7f34500b7620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:56:58.479 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:58.472+0000 7f344f7fe700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f345015c6c0 0x7f34500b7620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:59310/0 (socket says 172.21.15.46:59310) 2023-07-05T18:56:58.479 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:58.472+0000 7f344f7fe700 1 -- 172.21.15.46:0/2586242294 learned_addr learned my addr 172.21.15.46:0/2586242294 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-07-05T18:56:58.480 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:58.472+0000 7f344e7fc700 1 --2- 172.21.15.46:0/2586242294 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f345015c2f0 0x7f3450149320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:56:58.480 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:58.472+0000 7f344effd700 1 --2- 172.21.15.46:0/2586242294 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f34500b5ae0 0x7f34501e7790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:56:58.480 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:58.472+0000 7f344f7fe700 1 -- 172.21.15.46:0/2586242294 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f34500b5ae0 msgr2=0x7f34501e7790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:56:58.480 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:58.472+0000 7f344f7fe700 1 --2- 172.21.15.46:0/2586242294 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f34500b5ae0 0x7f34501e7790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:58.481 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:58.472+0000 7f344f7fe700 1 -- 172.21.15.46:0/2586242294 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f345015c2f0 msgr2=0x7f3450149320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:56:58.481 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:58.472+0000 7f344f7fe700 1 --2- 172.21.15.46:0/2586242294 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f345015c2f0 0x7f3450149320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:58.481 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:58.472+0000 7f344f7fe700 1 -- 172.21.15.46:0/2586242294 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3440009550 con 0x7f345015c6c0 2023-07-05T18:56:58.481 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:58.472+0000 7f344f7fe700 1 --2- 172.21.15.46:0/2586242294 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f345015c6c0 0x7f34500b7620 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f3448014040 tx=0x7f3448004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-05T18:56:58.482 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:58.472+0000 7f34377fe700 1 -- 172.21.15.46:0/2586242294 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3448012430 con 0x7f345015c6c0 2023-07-05T18:56:58.482 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:58.472+0000 7f34377fe700 1 -- 172.21.15.46:0/2586242294 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3448020070 con 0x7f345015c6c0 2023-07-05T18:56:58.482 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:58.472+0000 7f3455346700 1 -- 172.21.15.46:0/2586242294 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3448009a70 con 0x7f345015c6c0 2023-07-05T18:56:58.482 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:58.472+0000 7f34377fe700 1 -- 172.21.15.46:0/2586242294 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3448003ea0 con 0x7f345015c6c0 2023-07-05T18:56:58.482 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:58.472+0000 7f3455346700 1 -- 172.21.15.46:0/2586242294 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f345015a5b0 con 0x7f345015c6c0 2023-07-05T18:56:58.483 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:58.473+0000 7f3455346700 1 -- 172.21.15.46:0/2586242294 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3450147970 con 0x7f345015c6c0 2023-07-05T18:56:58.483 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:58.474+0000 7f34377fe700 1 -- 172.21.15.46:0/2586242294 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f3448004280 con 0x7f345015c6c0 2023-07-05T18:56:58.484 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:58.474+0000 7f34377fe700 1 --2- 172.21.15.46:0/2586242294 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7f343c06ad10 0x7f343c06d1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:56:58.485 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:58.474+0000 7f34377fe700 1 -- 172.21.15.46:0/2586242294 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f3448022070 con 0x7f345015c6c0 2023-07-05T18:56:58.485 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:58.474+0000 7f344effd700 1 --2- 172.21.15.46:0/2586242294 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7f343c06ad10 0x7f343c06d1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:56:58.485 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:58.475+0000 7f344effd700 1 --2- 172.21.15.46:0/2586242294 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7f343c06ad10 0x7f343c06d1c0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f3444000f60 tx=0x7f3444009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-05T18:56:58.486 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:58.479+0000 7f34377fe700 1 -- 172.21.15.46:0/2586242294 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f3450147970 con 0x7f345015c6c0 2023-07-05T18:56:58.678 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:58.675+0000 7f3455346700 1 -- 172.21.15.46:0/2586242294 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f3450147970 con 0x7f345015c6c0 2023-07-05T18:56:58.678 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:58.676+0000 7f34377fe700 1 -- 172.21.15.46:0/2586242294 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v21) v1 ==== 100+0+11 (secure 0 0 0) 0x7f3450147970 con 0x7f345015c6c0 2023-07-05T18:56:58.679 INFO:teuthology.orchestra.run.smithi046.stdout:pg_num: 64 2023-07-05T18:56:58.683 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:58.677+0000 7f3455346700 1 -- 172.21.15.46:0/2586242294 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7f343c06ad10 msgr2=0x7f343c06d1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:56:58.683 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:58.677+0000 7f3455346700 1 --2- 172.21.15.46:0/2586242294 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7f343c06ad10 0x7f343c06d1c0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f3444000f60 tx=0x7f3444009040 comp rx=0 tx=0).stop 2023-07-05T18:56:58.684 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:58.677+0000 7f3455346700 1 -- 172.21.15.46:0/2586242294 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f345015c6c0 msgr2=0x7f34500b7620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:56:58.684 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:58.677+0000 7f3455346700 1 --2- 172.21.15.46:0/2586242294 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f345015c6c0 0x7f34500b7620 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f3448014040 tx=0x7f3448004ad0 comp rx=0 tx=0).stop 2023-07-05T18:56:58.684 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:58.678+0000 7f3455346700 1 -- 172.21.15.46:0/2586242294 shutdown_connections 2023-07-05T18:56:58.684 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:58.678+0000 7f3455346700 1 --2- 172.21.15.46:0/2586242294 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7f343c06ad10 0x7f343c06d1c0 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:58.684 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:58.678+0000 7f3455346700 1 --2- 172.21.15.46:0/2586242294 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f345015c6c0 0x7f34500b7620 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:58.684 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:58.678+0000 7f3455346700 1 --2- 172.21.15.46:0/2586242294 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f34500b5ae0 0x7f34501e7790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:58.684 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:58.678+0000 7f3455346700 1 --2- 172.21.15.46:0/2586242294 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f345015c2f0 0x7f3450149320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:58.685 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:58.678+0000 7f3455346700 1 -- 172.21.15.46:0/2586242294 >> 172.21.15.46:0/2586242294 conn(0x7f345006afa0 msgr2=0x7f34500cf6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-05T18:56:58.685 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:58.678+0000 7f3455346700 1 -- 172.21.15.46:0/2586242294 shutdown_connections 2023-07-05T18:56:58.685 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:58.678+0000 7f3455346700 1 -- 172.21.15.46:0/2586242294 wait complete. 2023-07-05T18:56:58.697 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-07-05T18:56:58.823 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:58.822+0000 7f3f18230700 1 Processor -- start 2023-07-05T18:56:58.823 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:58.822+0000 7f3f18230700 1 -- start start 2023-07-05T18:56:58.826 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:58.823+0000 7f3f18230700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f3f10159280 0x7f3f1006fe10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:56:58.827 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:58.823+0000 7f3f18230700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f3f10159d60 0x7f3f10162ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:56:58.827 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:58.823+0000 7f3f18230700 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3f100b3f90 con 0x7f3f10070af0 2023-07-05T18:56:58.827 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:58.823+0000 7f3f18230700 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3f100cbc00 con 0x7f3f10159280 2023-07-05T18:56:58.827 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:58.823+0000 7f3f18230700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3f100b4420 con 0x7f3f10159d60 2023-07-05T18:56:58.827 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:58.823+0000 7f3f157cb700 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7f3f10070af0 0x7f3f10159650 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:58588/0 (socket says 172.21.15.46:58588) 2023-07-05T18:56:58.828 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:58.823+0000 7f3f157cb700 1 -- 172.21.15.46:0/784865194 learned_addr learned my addr 172.21.15.46:0/784865194 (peer_addr_for_me v1:172.21.15.46:0/0) 2023-07-05T18:56:58.829 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:58.823+0000 7f3f167cd700 1 --2- 172.21.15.46:0/784865194 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f3f10159d60 0x7f3f10162ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:56:58.829 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:58.823+0000 7f3f15fcc700 1 --2- 172.21.15.46:0/784865194 >> v2:172.21.15.73:3300/0 conn(0x7f3f10159280 0x7f3f1006fe10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:56:58.829 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:58.823+0000 7f3f14fca700 1 -- 172.21.15.46:0/784865194 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4094947510 0 0) 0x7f3f100b3f90 con 0x7f3f10070af0 2023-07-05T18:56:58.829 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:58.823+0000 7f3f14fca700 1 -- 172.21.15.46:0/784865194 --> v1:172.21.15.46:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3efc0035b0 con 0x7f3f10070af0 2023-07-05T18:56:58.829 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:58.824+0000 7f3f14fca700 1 -- 172.21.15.46:0/784865194 <== mon.0 v1:172.21.15.46:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 826602083 0 0) 0x7f3efc0035b0 con 0x7f3f10070af0 2023-07-05T18:56:58.829 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:58.824+0000 7f3f14fca700 1 -- 172.21.15.46:0/784865194 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f3f10159d60 msgr2=0x7f3f10162ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-05T18:56:58.830 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:58.824+0000 7f3f14fca700 1 --2- 172.21.15.46:0/784865194 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f3f10159d60 0x7f3f10162ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:58.830 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:58.824+0000 7f3f14fca700 1 -- 172.21.15.46:0/784865194 >> v2:172.21.15.73:3300/0 conn(0x7f3f10159280 msgr2=0x7f3f1006fe10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-05T18:56:58.830 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:58.824+0000 7f3f14fca700 1 --2- 172.21.15.46:0/784865194 >> v2:172.21.15.73:3300/0 conn(0x7f3f10159280 0x7f3f1006fe10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:58.830 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:58.824+0000 7f3f14fca700 1 -- 172.21.15.46:0/784865194 --> v1:172.21.15.46:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3f100b3190 con 0x7f3f10070af0 2023-07-05T18:56:58.830 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:58.824+0000 7f3f14fca700 1 -- 172.21.15.46:0/784865194 <== mon.0 v1:172.21.15.46:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2195585215 0 0) 0x7f3f0c001670 con 0x7f3f10070af0 2023-07-05T18:56:58.830 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:58.824+0000 7f3f167cd700 1 --2- 172.21.15.46:0/784865194 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f3f10159d60 0x7f3f10162ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-05T18:56:58.830 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:58.824+0000 7f3f14fca700 1 -- 172.21.15.46:0/784865194 >> v1:172.21.15.46:6789/0 conn(0x7f3f10070af0 legacy=0x7f3f10159650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:56:58.831 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:58.824+0000 7f3f14fca700 1 --2- 172.21.15.46:0/784865194 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3efc003a00 0x7f3efc003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:56:58.831 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:58.824+0000 7f3f14fca700 1 --2- 172.21.15.46:0/784865194 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3efc004430 0x7f3efc0048f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:56:58.831 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:58.824+0000 7f3f14fca700 1 --2- 172.21.15.46:0/784865194 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f3f10159d60 0x7f3efc004f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:56:58.831 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:58.824+0000 7f3f14fca700 1 -- 172.21.15.46:0/784865194 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f100cbc00 con 0x7f3efc003a00 2023-07-05T18:56:58.831 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:58.824+0000 7f3f14fca700 1 -- 172.21.15.46:0/784865194 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f100b4420 con 0x7f3efc004430 2023-07-05T18:56:58.831 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:58.824+0000 7f3f14fca700 1 -- 172.21.15.46:0/784865194 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3efc00ba10 con 0x7f3f10159d60 2023-07-05T18:56:58.831 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:58.824+0000 7f3f15fcc700 1 --2- 172.21.15.46:0/784865194 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3efc003a00 0x7f3efc003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:56:58.832 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:58.824+0000 7f3f157cb700 1 --2- 172.21.15.46:0/784865194 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3efc004430 0x7f3efc0048f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:56:58.832 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:58.824+0000 7f3f167cd700 1 --2- 172.21.15.46:0/784865194 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f3f10159d60 0x7f3efc004f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:56:58.832 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:58.824+0000 7f3f15fcc700 1 -- 172.21.15.46:0/784865194 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f3f10159d60 msgr2=0x7f3efc004f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-05T18:56:58.832 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:58.824+0000 7f3f15fcc700 1 --2- 172.21.15.46:0/784865194 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f3f10159d60 0x7f3efc004f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:58.832 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:58.824+0000 7f3f15fcc700 1 -- 172.21.15.46:0/784865194 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3efc004430 msgr2=0x7f3efc0048f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-05T18:56:58.832 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:58.824+0000 7f3f15fcc700 1 --2- 172.21.15.46:0/784865194 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3efc004430 0x7f3efc0048f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:58.832 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:58.824+0000 7f3f15fcc700 1 -- 172.21.15.46:0/784865194 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3f08009a70 con 0x7f3efc003a00 2023-07-05T18:56:58.833 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:58.824+0000 7f3f15fcc700 1 --2- 172.21.15.46:0/784865194 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3efc003a00 0x7f3efc003e10 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f3f000096f0 tx=0x7f3efc005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3485f6fb3c1cd060 server_cookie=0 in_seq=0 out_seq=0 2023-07-05T18:56:58.833 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:58.825+0000 7f3f14fca700 1 -- 172.21.15.46:0/784865194 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f0000e6c0 con 0x7f3efc003a00 2023-07-05T18:56:58.833 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:58.825+0000 7f3f14fca700 1 -- 172.21.15.46:0/784865194 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3f0000e820 con 0x7f3efc003a00 2023-07-05T18:56:58.834 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:58.825+0000 7f3f14fca700 1 -- 172.21.15.46:0/784865194 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f0000ebb0 con 0x7f3efc003a00 2023-07-05T18:56:58.834 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:58.825+0000 7f3f18230700 1 -- 172.21.15.46:0/784865194 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3efc003a00 msgr2=0x7f3efc003e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:56:58.834 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:58.825+0000 7f3f18230700 1 --2- 172.21.15.46:0/784865194 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3efc003a00 0x7f3efc003e10 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f3f000096f0 tx=0x7f3efc005880 comp rx=0 tx=0).stop 2023-07-05T18:56:58.834 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:58.825+0000 7f3f167cd700 1 -- 172.21.15.46:0/784865194 reap_dead start 2023-07-05T18:56:58.834 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:58.825+0000 7f3f18230700 1 -- 172.21.15.46:0/784865194 shutdown_connections 2023-07-05T18:56:58.834 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:58.825+0000 7f3f18230700 1 -- 172.21.15.46:0/784865194 >> 172.21.15.46:0/784865194 conn(0x7f3f100b0d50 msgr2=0x7f3f100b1150 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-05T18:56:58.834 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:58.825+0000 7f3f18230700 1 -- 172.21.15.46:0/784865194 shutdown_connections 2023-07-05T18:56:58.835 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:58.825+0000 7f3f18230700 1 -- 172.21.15.46:0/784865194 wait complete. 2023-07-05T18:56:58.839 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:58.827+0000 7f3f18230700 1 Processor -- start 2023-07-05T18:56:58.839 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:58.827+0000 7f3f18230700 1 -- start start 2023-07-05T18:56:58.839 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:58.827+0000 7f3f18230700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3efc003a00 0x7f3f1014d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:56:58.840 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:58.827+0000 7f3f18230700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3f1014a5b0 0x7f3f1013c2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:56:58.840 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:58.827+0000 7f3f18230700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f3f1014aa20 0x7f3f1013c830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:56:58.840 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:58.827+0000 7f3f18230700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f1014cf40 con 0x7f3f1014a5b0 2023-07-05T18:56:58.840 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:58.827+0000 7f3f18230700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f1013cd70 con 0x7f3efc003a00 2023-07-05T18:56:58.840 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:58.827+0000 7f3f18230700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3f1014c5a0 con 0x7f3f1014aa20 2023-07-05T18:56:58.840 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:58.827+0000 7f3f157cb700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3f1014a5b0 0x7f3f1013c2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:56:58.840 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:58.827+0000 7f3f157cb700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3f1014a5b0 0x7f3f1013c2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:59328/0 (socket says 172.21.15.46:59328) 2023-07-05T18:56:58.841 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:58.827+0000 7f3f157cb700 1 -- 172.21.15.46:0/2325320599 learned_addr learned my addr 172.21.15.46:0/2325320599 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-07-05T18:56:58.841 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:58.828+0000 7f3f15fcc700 1 --2- 172.21.15.46:0/2325320599 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3efc003a00 0x7f3f1014d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:56:58.841 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:58.828+0000 7f3f167cd700 1 --2- 172.21.15.46:0/2325320599 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f3f1014aa20 0x7f3f1013c830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:56:58.841 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:58.828+0000 7f3f157cb700 1 -- 172.21.15.46:0/2325320599 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f3f1014aa20 msgr2=0x7f3f1013c830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:56:58.841 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:58.828+0000 7f3f157cb700 1 --2- 172.21.15.46:0/2325320599 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f3f1014aa20 0x7f3f1013c830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:58.841 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:58.828+0000 7f3f157cb700 1 -- 172.21.15.46:0/2325320599 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3efc003a00 msgr2=0x7f3f1014d360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:56:58.841 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:58.828+0000 7f3f157cb700 1 --2- 172.21.15.46:0/2325320599 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3efc003a00 0x7f3f1014d360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:58.842 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:58.828+0000 7f3f157cb700 1 -- 172.21.15.46:0/2325320599 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3f1014c880 con 0x7f3f1014a5b0 2023-07-05T18:56:58.842 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:58.828+0000 7f3f157cb700 1 --2- 172.21.15.46:0/2325320599 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3f1014a5b0 0x7f3f1013c2f0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f3f0c007310 tx=0x7f3f0c007620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-05T18:56:58.842 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:58.828+0000 7f3f067fc700 1 -- 172.21.15.46:0/2325320599 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f0c011580 con 0x7f3f1014a5b0 2023-07-05T18:56:58.842 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:58.828+0000 7f3f067fc700 1 -- 172.21.15.46:0/2325320599 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3f0c011700 con 0x7f3f1014a5b0 2023-07-05T18:56:58.842 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:58.828+0000 7f3f18230700 1 -- 172.21.15.46:0/2325320599 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3f1014cb60 con 0x7f3f1014a5b0 2023-07-05T18:56:58.842 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:58.828+0000 7f3f067fc700 1 -- 172.21.15.46:0/2325320599 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f0c011ab0 con 0x7f3f1014a5b0 2023-07-05T18:56:58.842 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:58.828+0000 7f3f18230700 1 -- 172.21.15.46:0/2325320599 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3f1013f370 con 0x7f3f1014a5b0 2023-07-05T18:56:58.842 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:58.829+0000 7f3f18230700 1 -- 172.21.15.46:0/2325320599 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3f1014d080 con 0x7f3f1014a5b0 2023-07-05T18:56:58.843 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:58.830+0000 7f3f067fc700 1 -- 172.21.15.46:0/2325320599 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f3f0c011c10 con 0x7f3f1014a5b0 2023-07-05T18:56:58.843 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:58.830+0000 7f3f067fc700 1 --2- 172.21.15.46:0/2325320599 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7f3ef406ace0 0x7f3ef406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:56:58.843 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:58.830+0000 7f3f067fc700 1 -- 172.21.15.46:0/2325320599 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f3f0c089370 con 0x7f3f1014a5b0 2023-07-05T18:56:58.843 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:58.830+0000 7f3f15fcc700 1 --2- 172.21.15.46:0/2325320599 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7f3ef406ace0 0x7f3ef406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:56:58.843 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:58.831+0000 7f3f15fcc700 1 --2- 172.21.15.46:0/2325320599 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7f3ef406ace0 0x7f3ef406d190 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f3f0001c040 tx=0x7f3f00011040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-05T18:56:58.843 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:58.835+0000 7f3f067fc700 1 -- 172.21.15.46:0/2325320599 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f3f1014d080 con 0x7f3f1014a5b0 2023-07-05T18:56:59.052 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:59.051+0000 7f3f18230700 1 -- 172.21.15.46:0/2325320599 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f3f1014d080 con 0x7f3f1014a5b0 2023-07-05T18:56:59.052 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:59.051+0000 7f3f067fc700 1 -- 172.21.15.46:0/2325320599 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v21) v1 ==== 80+0+0 (secure 0 0 0) 0x7f3f1014d080 con 0x7f3f1014a5b0 2023-07-05T18:56:59.058 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:59.053+0000 7f3f18230700 1 -- 172.21.15.46:0/2325320599 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7f3ef406ace0 msgr2=0x7f3ef406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:56:59.059 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:59.053+0000 7f3f18230700 1 --2- 172.21.15.46:0/2325320599 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7f3ef406ace0 0x7f3ef406d190 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f3f0001c040 tx=0x7f3f00011040 comp rx=0 tx=0).stop 2023-07-05T18:56:59.059 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:59.053+0000 7f3f18230700 1 -- 172.21.15.46:0/2325320599 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3f1014a5b0 msgr2=0x7f3f1013c2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:56:59.059 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:59.053+0000 7f3f18230700 1 --2- 172.21.15.46:0/2325320599 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3f1014a5b0 0x7f3f1013c2f0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f3f0c007310 tx=0x7f3f0c007620 comp rx=0 tx=0).stop 2023-07-05T18:56:59.059 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:59.053+0000 7f3f18230700 1 -- 172.21.15.46:0/2325320599 shutdown_connections 2023-07-05T18:56:59.059 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:59.053+0000 7f3f18230700 1 --2- 172.21.15.46:0/2325320599 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7f3ef406ace0 0x7f3ef406d190 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:59.059 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:59.053+0000 7f3f18230700 1 --2- 172.21.15.46:0/2325320599 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f3f1014aa20 0x7f3f1013c830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:59.060 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:59.053+0000 7f3f18230700 1 --2- 172.21.15.46:0/2325320599 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3efc003a00 0x7f3f1014d360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:59.060 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:59.053+0000 7f3f18230700 1 --2- 172.21.15.46:0/2325320599 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3f1014a5b0 0x7f3f1013c2f0 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:59.060 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:59.053+0000 7f3f18230700 1 -- 172.21.15.46:0/2325320599 >> 172.21.15.46:0/2325320599 conn(0x7f3f100b0d50 msgr2=0x7f3f10070230 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-05T18:56:59.060 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:59.053+0000 7f3f18230700 1 -- 172.21.15.46:0/2325320599 shutdown_connections 2023-07-05T18:56:59.060 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:59.053+0000 7f3f18230700 1 -- 172.21.15.46:0/2325320599 wait complete. 2023-07-05T18:56:59.060 INFO:teuthology.orchestra.run.smithi046.stderr:listed 0 entries 2023-07-05T18:56:59.066 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.3... 2023-07-05T18:56:59.067 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-05T18:56:59.067 DEBUG:teuthology.orchestra.run.smithi073:> sudo umount /home/ubuntu/cephtest/mnt.3 -f 2023-07-05T18:56:59.118 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi073.front.sepia.ceph.com 2023-07-05T18:56:59.119 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-05T18:56:59.119 DEBUG:teuthology.orchestra.run.smithi073:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.3) 2023-07-05T18:56:59.140 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2023-07-05T18:56:59.141 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-05T18:56:59.270 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:59.266+0000 7f3ecde60700 1 Processor -- start 2023-07-05T18:56:59.270 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:59.266+0000 7f3ecde60700 1 -- start start 2023-07-05T18:56:59.271 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:59.267+0000 7f3ecde60700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f3ec815c6a0 0x7f3ec80cd310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:56:59.271 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:59.267+0000 7f3ecde60700 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3ec8160fb0 con 0x7f3ec80b4ee0 2023-07-05T18:56:59.271 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:59.267+0000 7f3ecde60700 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3ec80cd9f0 con 0x7f3ec8160b10 2023-07-05T18:56:59.271 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:59.267+0000 7f3ecde60700 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3ec815ce60 con 0x7f3ec815c6a0 2023-07-05T18:56:59.271 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:59.267+0000 7f3ec77fe700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f3ec815c6a0 0x7f3ec80cd310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:56:59.271 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:59.267+0000 7f3ec7fff700 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7f3ec80b4ee0 0x7f3ec80d0a20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:58610/0 (socket says 172.21.15.46:58610) 2023-07-05T18:56:59.272 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:59.267+0000 7f3ec7fff700 1 -- 172.21.15.46:0/2280901463 learned_addr learned my addr 172.21.15.46:0/2280901463 (peer_addr_for_me v1:172.21.15.46:0/0) 2023-07-05T18:56:59.272 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:59.267+0000 7f3ec77fe700 1 -- 172.21.15.46:0/2280901463 >> v1:172.21.15.73:6789/0 conn(0x7f3ec8160b10 legacy=0x7f3ec80b47d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-05T18:56:59.272 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:59.267+0000 7f3ec77fe700 1 -- 172.21.15.46:0/2280901463 >> v1:172.21.15.46:6789/0 conn(0x7f3ec80b4ee0 legacy=0x7f3ec80d0a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:56:59.273 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:59.267+0000 7f3ec67fc700 1 -- 172.21.15.46:0/2280901463 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4170074994 0 0) 0x7f3ec8160fb0 con 0x7f3ec80b4ee0 2023-07-05T18:56:59.273 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:59.267+0000 7f3ec77fe700 1 -- 172.21.15.46:0/2280901463 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ec815d140 con 0x7f3ec815c6a0 2023-07-05T18:56:59.274 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:59.267+0000 7f3ec77fe700 1 --2- 172.21.15.46:0/2280901463 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3ec815c6a0 0x7f3ec80cd310 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f3eb8009840 tx=0x7f3eb8009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=20577cd31e2ab277 server_cookie=0 in_seq=0 out_seq=0 2023-07-05T18:56:59.274 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:59.267+0000 7f3ec67fc700 1 -- 172.21.15.46:0/2280901463 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3eb8004230 con 0x7f3ec815c6a0 2023-07-05T18:56:59.274 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:59.267+0000 7f3ec67fc700 1 -- 172.21.15.46:0/2280901463 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3eb8004390 con 0x7f3ec815c6a0 2023-07-05T18:56:59.274 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:59.267+0000 7f3ec67fc700 1 -- 172.21.15.46:0/2280901463 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3eb80036a0 con 0x7f3ec815c6a0 2023-07-05T18:56:59.274 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:59.268+0000 7f3ecde60700 1 -- 172.21.15.46:0/2280901463 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3ec815c6a0 msgr2=0x7f3ec80cd310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:56:59.274 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:59.268+0000 7f3ecde60700 1 --2- 172.21.15.46:0/2280901463 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3ec815c6a0 0x7f3ec80cd310 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f3eb8009840 tx=0x7f3eb8009b50 comp rx=0 tx=0).stop 2023-07-05T18:56:59.274 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:59.268+0000 7f3ecde60700 1 -- 172.21.15.46:0/2280901463 shutdown_connections 2023-07-05T18:56:59.275 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:59.268+0000 7f3ecde60700 1 --2- 172.21.15.46:0/2280901463 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3ec815c6a0 0x7f3ec80cd310 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:59.275 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:59.268+0000 7f3ecde60700 1 -- 172.21.15.46:0/2280901463 >> 172.21.15.46:0/2280901463 conn(0x7f3ec80d39e0 msgr2=0x7f3ec80cf7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-05T18:56:59.275 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:59.268+0000 7f3ecde60700 1 -- 172.21.15.46:0/2280901463 shutdown_connections 2023-07-05T18:56:59.275 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:59.268+0000 7f3ecde60700 1 -- 172.21.15.46:0/2280901463 wait complete. 2023-07-05T18:56:59.278 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:59.270+0000 7f3ecde60700 1 Processor -- start 2023-07-05T18:56:59.278 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:59.270+0000 7f3ecde60700 1 -- start start 2023-07-05T18:56:59.278 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:59.271+0000 7f3ecde60700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3ec80b4ee0 0x7f3ec81476f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:56:59.278 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:59.271+0000 7f3ecde60700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3ec815c6a0 0x7f3ec814a960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:56:59.278 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:59.271+0000 7f3ecde60700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f3ec8160b10 0x7f3ec8147ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:56:59.279 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:59.271+0000 7f3ecde60700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ec8147c30 con 0x7f3ec80b4ee0 2023-07-05T18:56:59.279 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:59.271+0000 7f3ecde60700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ec814aea0 con 0x7f3ec815c6a0 2023-07-05T18:56:59.279 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:59.271+0000 7f3ecde60700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3ec80b72d0 con 0x7f3ec8160b10 2023-07-05T18:56:59.279 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:59.271+0000 7f3ec77fe700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3ec80b4ee0 0x7f3ec81476f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:56:59.279 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:59.271+0000 7f3ec77fe700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3ec80b4ee0 0x7f3ec81476f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:59340/0 (socket says 172.21.15.46:59340) 2023-07-05T18:56:59.279 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:59.271+0000 7f3ec77fe700 1 -- 172.21.15.46:0/717317554 learned_addr learned my addr 172.21.15.46:0/717317554 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-07-05T18:56:59.279 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:59.271+0000 7f3ec7fff700 1 --2- 172.21.15.46:0/717317554 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f3ec8160b10 0x7f3ec8147ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:56:59.279 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:59.271+0000 7f3ec77fe700 1 -- 172.21.15.46:0/717317554 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f3ec8160b10 msgr2=0x7f3ec8147ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:56:59.280 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:59.271+0000 7f3ec6ffd700 1 --2- 172.21.15.46:0/717317554 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3ec815c6a0 0x7f3ec814a960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:56:59.280 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:59.271+0000 7f3ec77fe700 1 --2- 172.21.15.46:0/717317554 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f3ec8160b10 0x7f3ec8147ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:59.280 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:59.271+0000 7f3ec77fe700 1 -- 172.21.15.46:0/717317554 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3ec815c6a0 msgr2=0x7f3ec814a960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:56:59.280 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:59.271+0000 7f3ec77fe700 1 --2- 172.21.15.46:0/717317554 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3ec815c6a0 0x7f3ec814a960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:59.280 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:59.271+0000 7f3ec77fe700 1 -- 172.21.15.46:0/717317554 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3eb80094a0 con 0x7f3ec80b4ee0 2023-07-05T18:56:59.280 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:59.271+0000 7f3ec77fe700 1 --2- 172.21.15.46:0/717317554 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3ec80b4ee0 0x7f3ec81476f0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f3eb8009b90 tx=0x7f3eb8004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-05T18:56:59.280 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:59.272+0000 7f3eaffff700 1 -- 172.21.15.46:0/717317554 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3eb8011630 con 0x7f3ec80b4ee0 2023-07-05T18:56:59.281 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:59.272+0000 7f3eaffff700 1 -- 172.21.15.46:0/717317554 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3eb801e070 con 0x7f3ec80b4ee0 2023-07-05T18:56:59.281 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:59.272+0000 7f3eaffff700 1 -- 172.21.15.46:0/717317554 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3eb80119b0 con 0x7f3ec80b4ee0 2023-07-05T18:56:59.281 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:59.272+0000 7f3ecde60700 1 -- 172.21.15.46:0/717317554 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3ec80b75b0 con 0x7f3ec80b4ee0 2023-07-05T18:56:59.281 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:59.272+0000 7f3ecde60700 1 -- 172.21.15.46:0/717317554 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3ec80b7b70 con 0x7f3ec80b4ee0 2023-07-05T18:56:59.281 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:59.273+0000 7f3ecde60700 1 -- 172.21.15.46:0/717317554 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3ec80672e0 con 0x7f3ec80b4ee0 2023-07-05T18:56:59.281 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:59.273+0000 7f3eaffff700 1 -- 172.21.15.46:0/717317554 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f3eb8011b10 con 0x7f3ec80b4ee0 2023-07-05T18:56:59.281 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:59.273+0000 7f3eaffff700 1 --2- 172.21.15.46:0/717317554 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7f3eb406ace0 0x7f3eb406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:56:59.281 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:59.274+0000 7f3eaffff700 1 -- 172.21.15.46:0/717317554 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f3eb808a8e0 con 0x7f3ec80b4ee0 2023-07-05T18:56:59.282 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:59.274+0000 7f3ec6ffd700 1 --2- 172.21.15.46:0/717317554 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7f3eb406ace0 0x7f3eb406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:56:59.282 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:59.274+0000 7f3ec6ffd700 1 --2- 172.21.15.46:0/717317554 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7f3eb406ace0 0x7f3eb406d190 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f3ec80b2d20 tx=0x7f3ebc008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-05T18:56:59.282 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:59.278+0000 7f3eaffff700 1 -- 172.21.15.46:0/717317554 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f3eb80559a0 con 0x7f3ec80b4ee0 2023-07-05T18:56:59.519 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:59.518+0000 7f3ecde60700 1 -- 172.21.15.46:0/717317554 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f3ec80cd540 con 0x7f3ec80b4ee0 2023-07-05T18:56:59.520 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:59.519+0000 7f3eaffff700 1 -- 172.21.15.46:0/717317554 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4656 (secure 0 0 0) 0x7f3eb8058fc0 con 0x7f3ec80b4ee0 2023-07-05T18:56:59.520 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T18:56:59.520 INFO:teuthology.orchestra.run.smithi046.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4247,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.73:6837/75231790","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6835","nonce":75231790},{"type":"v1","addr":"172.21.15.73:6837","nonce":75231790}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4284,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.46:6834/378741372","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6832","nonce":378741372},{"type":"v1","addr":"172.21.15.46:6834","nonce":378741372}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4287,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.46:6835/1674703862","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6833","nonce":1674703862},{"type":"v1","addr":"172.21.15.46:6835","nonce":1674703862}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-07-05T18:56:15.093940+0000","modified":"2023-07-05T18:56:18.225033+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4296},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4296":{"gid":4296,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.73:6836/2654190748","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6834","nonce":2654190748},{"type":"v1","addr":"172.21.15.73:6836","nonce":2654190748}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-07-05T18:56:59.522 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:59.521+0000 7f3ecde60700 1 -- 172.21.15.46:0/717317554 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7f3eb406ace0 msgr2=0x7f3eb406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:56:59.522 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:59.521+0000 7f3ecde60700 1 --2- 172.21.15.46:0/717317554 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7f3eb406ace0 0x7f3eb406d190 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f3ec80b2d20 tx=0x7f3ebc008040 comp rx=0 tx=0).stop 2023-07-05T18:56:59.522 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:59.521+0000 7f3ecde60700 1 -- 172.21.15.46:0/717317554 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3ec80b4ee0 msgr2=0x7f3ec81476f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:56:59.523 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:59.521+0000 7f3ecde60700 1 --2- 172.21.15.46:0/717317554 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3ec80b4ee0 0x7f3ec81476f0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f3eb8009b90 tx=0x7f3eb8004750 comp rx=0 tx=0).stop 2023-07-05T18:56:59.523 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:59.521+0000 7f3ecde60700 1 -- 172.21.15.46:0/717317554 shutdown_connections 2023-07-05T18:56:59.523 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:59.521+0000 7f3ecde60700 1 --2- 172.21.15.46:0/717317554 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7f3eb406ace0 0x7f3eb406d190 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:59.523 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:59.521+0000 7f3ecde60700 1 --2- 172.21.15.46:0/717317554 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f3ec8160b10 0x7f3ec8147ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:59.523 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:59.521+0000 7f3ecde60700 1 --2- 172.21.15.46:0/717317554 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3ec80b4ee0 0x7f3ec81476f0 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:59.523 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:59.521+0000 7f3ecde60700 1 --2- 172.21.15.46:0/717317554 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3ec815c6a0 0x7f3ec814a960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:59.523 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:59.521+0000 7f3ecde60700 1 -- 172.21.15.46:0/717317554 >> 172.21.15.46:0/717317554 conn(0x7f3ec80d39e0 msgr2=0x7f3ec815dc40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-05T18:56:59.524 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:59.521+0000 7f3ecde60700 1 -- 172.21.15.46:0/717317554 shutdown_connections 2023-07-05T18:56:59.524 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:59.521+0000 7f3ecde60700 1 -- 172.21.15.46:0/717317554 wait complete. 2023-07-05T18:56:59.524 INFO:teuthology.orchestra.run.smithi046.stderr:dumped fsmap epoch 8 2023-07-05T18:56:59.538 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-05T18:56:59.666 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:59.664+0000 7f0bedd26700 1 Processor -- start 2023-07-05T18:56:59.666 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:59.665+0000 7f0bedd26700 1 -- start start 2023-07-05T18:56:59.671 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:59.665+0000 7f0bedd26700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f0be806d830 0x7f0be8070730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:56:59.671 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:59.665+0000 7f0bedd26700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f0be80b1ec0 0x7f0be8160350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:56:59.671 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:59.665+0000 7f0bedd26700 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0be815ce30 con 0x7f0be80af000 2023-07-05T18:56:59.671 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:59.665+0000 7f0bedd26700 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0be815d110 con 0x7f0be80b1ec0 2023-07-05T18:56:59.671 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:59.665+0000 7f0bedd26700 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0be815d3f0 con 0x7f0be806d830 2023-07-05T18:56:59.671 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:59.666+0000 7f0be7fff700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f0be80b1ec0 0x7f0be8160350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:56:59.672 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:59.666+0000 7f0be7fff700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f0be80b1ec0 0x7f0be8160350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:59352/0 (socket says 172.21.15.46:59352) 2023-07-05T18:56:59.672 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:59.666+0000 7f0be7fff700 1 -- 172.21.15.46:0/1226959730 learned_addr learned my addr 172.21.15.46:0/1226959730 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-07-05T18:56:59.672 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:59.666+0000 7f0be77fe700 1 --2- 172.21.15.46:0/1226959730 >> v2:172.21.15.73:3300/0 conn(0x7f0be806d830 0x7f0be8070730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:56:59.673 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:59.666+0000 7f0be7fff700 1 -- 172.21.15.46:0/1226959730 >> v2:172.21.15.73:3300/0 conn(0x7f0be806d830 msgr2=0x7f0be8070730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-05T18:56:59.674 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:59.666+0000 7f0be7fff700 1 --2- 172.21.15.46:0/1226959730 >> v2:172.21.15.73:3300/0 conn(0x7f0be806d830 0x7f0be8070730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:59.674 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:59.666+0000 7f0be7fff700 1 -- 172.21.15.46:0/1226959730 >> v1:172.21.15.73:6789/0 conn(0x7f0be80af000 legacy=0x7f0be80b17b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:56:59.674 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:59.666+0000 7f0be7fff700 1 -- 172.21.15.46:0/1226959730 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0be815d6d0 con 0x7f0be80b1ec0 2023-07-05T18:56:59.674 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:59.666+0000 7f0be7fff700 1 --2- 172.21.15.46:0/1226959730 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0be80b1ec0 0x7f0be8160350 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f0be80cfee0 tx=0x7f0be000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=77755c8b1649a3f5 server_cookie=0 in_seq=0 out_seq=0 2023-07-05T18:56:59.674 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:59.666+0000 7f0be67fc700 1 -- 172.21.15.46:0/1226959730 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0be000e070 con 0x7f0be80b1ec0 2023-07-05T18:56:59.674 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:59.666+0000 7f0be67fc700 1 -- 172.21.15.46:0/1226959730 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0be000b910 con 0x7f0be80b1ec0 2023-07-05T18:56:59.674 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:59.666+0000 7f0be67fc700 1 -- 172.21.15.46:0/1226959730 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0be000bcc0 con 0x7f0be80b1ec0 2023-07-05T18:56:59.676 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:59.667+0000 7f0bedd26700 1 -- 172.21.15.46:0/1226959730 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0be80b1ec0 msgr2=0x7f0be8160350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:56:59.676 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:59.667+0000 7f0bedd26700 1 --2- 172.21.15.46:0/1226959730 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0be80b1ec0 0x7f0be8160350 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f0be80cfee0 tx=0x7f0be000b330 comp rx=0 tx=0).stop 2023-07-05T18:56:59.676 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:59.667+0000 7f0bedd26700 1 -- 172.21.15.46:0/1226959730 shutdown_connections 2023-07-05T18:56:59.680 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:59.667+0000 7f0bedd26700 1 --2- 172.21.15.46:0/1226959730 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0be80b1ec0 0x7f0be8160350 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:59.680 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:59.667+0000 7f0bedd26700 1 --2- 172.21.15.46:0/1226959730 >> v2:172.21.15.73:3300/0 conn(0x7f0be806d830 0x7f0be8070730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:59.680 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:59.667+0000 7f0bedd26700 1 -- 172.21.15.46:0/1226959730 >> 172.21.15.46:0/1226959730 conn(0x7f0be806af10 msgr2=0x7f0be806b2e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-05T18:56:59.681 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:59.667+0000 7f0bedd26700 1 -- 172.21.15.46:0/1226959730 shutdown_connections 2023-07-05T18:56:59.681 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:59.667+0000 7f0bedd26700 1 -- 172.21.15.46:0/1226959730 wait complete. 2023-07-05T18:56:59.681 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:59.668+0000 7f0bedd26700 1 Processor -- start 2023-07-05T18:56:59.681 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:59.668+0000 7f0bedd26700 1 -- start start 2023-07-05T18:56:59.685 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:59.669+0000 7f0bedd26700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0be806d830 0x7f0be81f2770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:56:59.685 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:59.669+0000 7f0bedd26700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f0be80af000 0x7f0be8143480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:56:59.686 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:59.669+0000 7f0bedd26700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0be80b1ec0 0x7f0be815eb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:56:59.686 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:59.669+0000 7f0bedd26700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0be8145dc0 con 0x7f0be80b1ec0 2023-07-05T18:56:59.686 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:59.669+0000 7f0bedd26700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0be81f2cb0 con 0x7f0be806d830 2023-07-05T18:56:59.686 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:59.669+0000 7f0bedd26700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0be8146010 con 0x7f0be80af000 2023-07-05T18:56:59.686 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:59.669+0000 7f0be7fff700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0be80b1ec0 0x7f0be815eb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:56:59.686 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:59.669+0000 7f0be7fff700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0be80b1ec0 0x7f0be815eb90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:59358/0 (socket says 172.21.15.46:59358) 2023-07-05T18:56:59.686 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:59.669+0000 7f0be7fff700 1 -- 172.21.15.46:0/3282442648 learned_addr learned my addr 172.21.15.46:0/3282442648 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-07-05T18:56:59.687 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:59.669+0000 7f0be6ffd700 1 --2- 172.21.15.46:0/3282442648 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f0be80af000 0x7f0be8143480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:56:59.687 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:59.669+0000 7f0be77fe700 1 --2- 172.21.15.46:0/3282442648 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0be806d830 0x7f0be81f2770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:56:59.687 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:59.669+0000 7f0be7fff700 1 -- 172.21.15.46:0/3282442648 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f0be80af000 msgr2=0x7f0be8143480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:56:59.687 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:59.669+0000 7f0be7fff700 1 --2- 172.21.15.46:0/3282442648 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f0be80af000 0x7f0be8143480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:59.688 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:59.669+0000 7f0be7fff700 1 -- 172.21.15.46:0/3282442648 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0be806d830 msgr2=0x7f0be81f2770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:56:59.688 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:59.669+0000 7f0be7fff700 1 --2- 172.21.15.46:0/3282442648 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0be806d830 0x7f0be81f2770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:59.688 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:59.669+0000 7f0be7fff700 1 -- 172.21.15.46:0/3282442648 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0be0009b30 con 0x7f0be80b1ec0 2023-07-05T18:56:59.688 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:59.669+0000 7f0be77fe700 1 --2- 172.21.15.46:0/3282442648 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0be806d830 0x7f0be81f2770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-05T18:56:59.688 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:59.669+0000 7f0be7fff700 1 --2- 172.21.15.46:0/3282442648 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0be80b1ec0 0x7f0be815eb90 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f0be806bae0 tx=0x7f0be0004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-05T18:56:59.688 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:59.670+0000 7f0bcffff700 1 -- 172.21.15.46:0/3282442648 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0be00099b0 con 0x7f0be80b1ec0 2023-07-05T18:56:59.689 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:59.670+0000 7f0bcffff700 1 -- 172.21.15.46:0/3282442648 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0be00092e0 con 0x7f0be80b1ec0 2023-07-05T18:56:59.689 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:59.670+0000 7f0bedd26700 1 -- 172.21.15.46:0/3282442648 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0be81462f0 con 0x7f0be80b1ec0 2023-07-05T18:56:59.689 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:59.670+0000 7f0bcffff700 1 -- 172.21.15.46:0/3282442648 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0be001b630 con 0x7f0be80b1ec0 2023-07-05T18:56:59.690 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:59.670+0000 7f0bedd26700 1 -- 172.21.15.46:0/3282442648 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0be81468b0 con 0x7f0be80b1ec0 2023-07-05T18:56:59.690 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:59.671+0000 7f0bedd26700 1 -- 172.21.15.46:0/3282442648 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0be8146be0 con 0x7f0be80b1ec0 2023-07-05T18:56:59.690 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:59.671+0000 7f0bcffff700 1 -- 172.21.15.46:0/3282442648 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f0be001b790 con 0x7f0be80b1ec0 2023-07-05T18:56:59.690 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:59.672+0000 7f0bcffff700 1 --2- 172.21.15.46:0/3282442648 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7f0bd406ace0 0x7f0bd406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:56:59.691 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:59.672+0000 7f0bcffff700 1 -- 172.21.15.46:0/3282442648 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f0be008ade0 con 0x7f0be80b1ec0 2023-07-05T18:56:59.691 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:59.672+0000 7f0be77fe700 1 --2- 172.21.15.46:0/3282442648 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7f0bd406ace0 0x7f0bd406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:56:59.691 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:59.672+0000 7f0be77fe700 1 --2- 172.21.15.46:0/3282442648 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7f0bd406ace0 0x7f0bd406d190 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f0bd8009b60 tx=0x7f0bd8008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-05T18:56:59.691 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:59.676+0000 7f0bcffff700 1 -- 172.21.15.46:0/3282442648 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f0be0055e80 con 0x7f0be80b1ec0 2023-07-05T18:56:59.879 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:59.879+0000 7f0bedd26700 1 -- 172.21.15.46:0/3282442648 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f0be80672e0 con 0x7f0be80b1ec0 2023-07-05T18:56:59.881 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:59.880+0000 7f0bcffff700 1 -- 172.21.15.46:0/3282442648 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) v1 ==== 74+0+18161 (secure 0 0 0) 0x7f0be00594a0 con 0x7f0be80b1ec0 2023-07-05T18:56:59.882 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T18:56:59.882 INFO:teuthology.orchestra.run.smithi046.stdout:{"epoch":21,"fsid":"042652d3-d80c-4ad8-9366-3e94f2a0a512","created":"2023-07-05T18:55:56.455710+0000","modified":"2023-07-05T18:56:16.095672+0000","last_up_change":"2023-07-05T18:56:06.594022+0000","last_in_change":"2023-07-05T18:55:58.879340+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-07-05T18:56:07.729620+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2023-07-05T18:56:08.128122+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-07-05T18:56:12.954625+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-07-05T18:56:14.068396+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"20009183-9a47-4392-8751-883f88d2bfb1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6813","nonce":4151971443},{"type":"v1","addr":"172.21.15.46:6815","nonce":4151971443}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6817","nonce":4151971443},{"type":"v1","addr":"172.21.15.46:6818","nonce":4151971443}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6822","nonce":4151971443},{"type":"v1","addr":"172.21.15.46:6823","nonce":4151971443}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6820","nonce":4151971443},{"type":"v1","addr":"172.21.15.46:6821","nonce":4151971443}]},"public_addr":"172.21.15.46:6815/4151971443","cluster_addr":"172.21.15.46:6818/4151971443","heartbeat_back_addr":"172.21.15.46:6823/4151971443","heartbeat_front_addr":"172.21.15.46:6821/4151971443","state":["exists","up"]},{"osd":1,"uuid":"91b4a7b0-e4e4-4888-a1fe-9edb0d68004c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6808","nonce":502575881},{"type":"v1","addr":"172.21.15.46:6809","nonce":502575881}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6810","nonce":502575881},{"type":"v1","addr":"172.21.15.46:6811","nonce":502575881}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6816","nonce":502575881},{"type":"v1","addr":"172.21.15.46:6819","nonce":502575881}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6812","nonce":502575881},{"type":"v1","addr":"172.21.15.46:6814","nonce":502575881}]},"public_addr":"172.21.15.46:6809/502575881","cluster_addr":"172.21.15.46:6811/502575881","heartbeat_back_addr":"172.21.15.46:6819/502575881","heartbeat_front_addr":"172.21.15.46:6814/502575881","state":["exists","up"]},{"osd":2,"uuid":"669ff744-1331-47c5-8579-0440731c889a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6800","nonce":2115251461},{"type":"v1","addr":"172.21.15.46:6801","nonce":2115251461}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6802","nonce":2115251461},{"type":"v1","addr":"172.21.15.46:6803","nonce":2115251461}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6806","nonce":2115251461},{"type":"v1","addr":"172.21.15.46:6807","nonce":2115251461}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6804","nonce":2115251461},{"type":"v1","addr":"172.21.15.46:6805","nonce":2115251461}]},"public_addr":"172.21.15.46:6801/2115251461","cluster_addr":"172.21.15.46:6803/2115251461","heartbeat_back_addr":"172.21.15.46:6807/2115251461","heartbeat_front_addr":"172.21.15.46:6805/2115251461","state":["exists","up"]},{"osd":3,"uuid":"34e1b86d-ffad-415d-861c-07a5f08068a6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6824","nonce":2981388766},{"type":"v1","addr":"172.21.15.46:6825","nonce":2981388766}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6826","nonce":2981388766},{"type":"v1","addr":"172.21.15.46:6827","nonce":2981388766}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6830","nonce":2981388766},{"type":"v1","addr":"172.21.15.46:6831","nonce":2981388766}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6828","nonce":2981388766},{"type":"v1","addr":"172.21.15.46:6829","nonce":2981388766}]},"public_addr":"172.21.15.46:6825/2981388766","cluster_addr":"172.21.15.46:6827/2981388766","heartbeat_back_addr":"172.21.15.46:6831/2981388766","heartbeat_front_addr":"172.21.15.46:6829/2981388766","state":["exists","up"]},{"osd":4,"uuid":"57ffcb91-c7dc-4a69-ae71-4d9622a14a05","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6800","nonce":2083655348},{"type":"v1","addr":"172.21.15.73:6801","nonce":2083655348}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6802","nonce":2083655348},{"type":"v1","addr":"172.21.15.73:6803","nonce":2083655348}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6806","nonce":2083655348},{"type":"v1","addr":"172.21.15.73:6807","nonce":2083655348}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6804","nonce":2083655348},{"type":"v1","addr":"172.21.15.73:6805","nonce":2083655348}]},"public_addr":"172.21.15.73:6801/2083655348","cluster_addr":"172.21.15.73:6803/2083655348","heartbeat_back_addr":"172.21.15.73:6807/2083655348","heartbeat_front_addr":"172.21.15.73:6805/2083655348","state":["exists","up"]},{"osd":5,"uuid":"665f41c9-ee20-49cf-bf0e-fbe0c03d3aed","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6824","nonce":2803788401},{"type":"v1","addr":"172.21.15.73:6825","nonce":2803788401}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6826","nonce":2803788401},{"type":"v1","addr":"172.21.15.73:6827","nonce":2803788401}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6830","nonce":2803788401},{"type":"v1","addr":"172.21.15.73:6831","nonce":2803788401}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6828","nonce":2803788401},{"type":"v1","addr":"172.21.15.73:6829","nonce":2803788401}]},"public_addr":"172.21.15.73:6825/2803788401","cluster_addr":"172.21.15.73:6827/2803788401","heartbeat_back_addr":"172.21.15.73:6831/2803788401","heartbeat_front_addr":"172.21.15.73:6829/2803788401","state":["exists","up"]},{"osd":6,"uuid":"5790c6cc-bd56-4ce4-9a7c-0f0c3b59215c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6808","nonce":974108383},{"type":"v1","addr":"172.21.15.73:6809","nonce":974108383}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6810","nonce":974108383},{"type":"v1","addr":"172.21.15.73:6811","nonce":974108383}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6815","nonce":974108383},{"type":"v1","addr":"172.21.15.73:6817","nonce":974108383}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6812","nonce":974108383},{"type":"v1","addr":"172.21.15.73:6813","nonce":974108383}]},"public_addr":"172.21.15.73:6809/974108383","cluster_addr":"172.21.15.73:6811/974108383","heartbeat_back_addr":"172.21.15.73:6817/974108383","heartbeat_front_addr":"172.21.15.73:6813/974108383","state":["exists","up"]},{"osd":7,"uuid":"b66f4d2e-147e-4c9b-97dd-cbd59d33802e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6814","nonce":3772673248},{"type":"v1","addr":"172.21.15.73:6816","nonce":3772673248}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6818","nonce":3772673248},{"type":"v1","addr":"172.21.15.73:6819","nonce":3772673248}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6822","nonce":3772673248},{"type":"v1","addr":"172.21.15.73:6823","nonce":3772673248}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6820","nonce":3772673248},{"type":"v1","addr":"172.21.15.73:6821","nonce":3772673248}]},"public_addr":"172.21.15.73:6816/3772673248","cluster_addr":"172.21.15.73:6819/3772673248","heartbeat_back_addr":"172.21.15.73:6823/3772673248","heartbeat_front_addr":"172.21.15.73:6821/3772673248","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-05T18:56:04.115334+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-05T18:56:04.071250+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-05T18:56:04.044387+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-05T18:56:04.085389+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-05T18:56:04.090726+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-05T18:56:04.074529+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-05T18:56:04.058841+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-05T18:56:04.043054+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-05T18:56:59.883 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:59.882+0000 7f0bedd26700 1 -- 172.21.15.46:0/3282442648 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7f0bd406ace0 msgr2=0x7f0bd406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:56:59.888 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:59.882+0000 7f0bedd26700 1 --2- 172.21.15.46:0/3282442648 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7f0bd406ace0 0x7f0bd406d190 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f0bd8009b60 tx=0x7f0bd8008040 comp rx=0 tx=0).stop 2023-07-05T18:56:59.888 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:59.882+0000 7f0bedd26700 1 -- 172.21.15.46:0/3282442648 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0be80b1ec0 msgr2=0x7f0be815eb90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:56:59.888 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:59.882+0000 7f0bedd26700 1 --2- 172.21.15.46:0/3282442648 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0be80b1ec0 0x7f0be815eb90 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f0be806bae0 tx=0x7f0be0004ad0 comp rx=0 tx=0).stop 2023-07-05T18:56:59.888 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:59.882+0000 7f0bedd26700 1 -- 172.21.15.46:0/3282442648 shutdown_connections 2023-07-05T18:56:59.889 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:59.882+0000 7f0bedd26700 1 --2- 172.21.15.46:0/3282442648 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7f0bd406ace0 0x7f0bd406d190 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:59.889 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:59.882+0000 7f0bedd26700 1 --2- 172.21.15.46:0/3282442648 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0be80b1ec0 0x7f0be815eb90 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:59.889 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:59.882+0000 7f0bedd26700 1 --2- 172.21.15.46:0/3282442648 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0be806d830 0x7f0be81f2770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:59.889 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:59.882+0000 7f0bedd26700 1 --2- 172.21.15.46:0/3282442648 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f0be80af000 0x7f0be8143480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:56:59.890 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:59.882+0000 7f0bedd26700 1 -- 172.21.15.46:0/3282442648 >> 172.21.15.46:0/3282442648 conn(0x7f0be806af10 msgr2=0x7f0be8072e50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-05T18:56:59.891 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:59.882+0000 7f0bedd26700 1 -- 172.21.15.46:0/3282442648 shutdown_connections 2023-07-05T18:56:59.891 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:56:59.882+0000 7f0bedd26700 1 -- 172.21.15.46:0/3282442648 wait complete. 2023-07-05T18:56:59.895 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'rbd', 'create_time': '2023-07-05T18:56:07.729620+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': '.mgr', 'create_time': '2023-07-05T18:56:08.128122+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-07-05T18:56:12.954625+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-07-05T18:56:14.068396+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-07-05T18:56:59.897 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-07-05T18:57:00.028 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:00.025+0000 7f45cd630700 1 Processor -- start 2023-07-05T18:57:00.028 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:00.025+0000 7f45cd630700 1 -- start start 2023-07-05T18:57:00.028 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:00.026+0000 7f45cd630700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f45c813f2a0 0x7f45c80cf410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:57:00.028 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:00.026+0000 7f45cd630700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f45c813f670 0x7f45c806c7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:57:00.029 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:00.026+0000 7f45cd630700 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f45c815ce00 con 0x7f45c80b1640 2023-07-05T18:57:00.029 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:00.026+0000 7f45cd630700 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f45c815d0e0 con 0x7f45c813f670 2023-07-05T18:57:00.029 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:00.026+0000 7f45cd630700 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f45c815d3c0 con 0x7f45c813f2a0 2023-07-05T18:57:00.029 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:00.026+0000 7f45c67fc700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f45c813f670 0x7f45c806c7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:57:00.029 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:00.026+0000 7f45c67fc700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f45c813f670 0x7f45c806c7e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:59364/0 (socket says 172.21.15.46:59364) 2023-07-05T18:57:00.029 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:00.026+0000 7f45c67fc700 1 -- 172.21.15.46:0/1543941945 learned_addr learned my addr 172.21.15.46:0/1543941945 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-07-05T18:57:00.030 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:00.026+0000 7f45c6ffd700 1 --2- 172.21.15.46:0/1543941945 >> v2:172.21.15.73:3300/0 conn(0x7f45c813f2a0 0x7f45c80cf410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:57:00.030 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:00.027+0000 7f45c67fc700 1 -- 172.21.15.46:0/1543941945 >> v2:172.21.15.73:3300/0 conn(0x7f45c813f2a0 msgr2=0x7f45c80cf410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-05T18:57:00.030 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:00.027+0000 7f45c67fc700 1 --2- 172.21.15.46:0/1543941945 >> v2:172.21.15.73:3300/0 conn(0x7f45c813f2a0 0x7f45c80cf410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:57:00.030 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:00.027+0000 7f45c67fc700 1 -- 172.21.15.46:0/1543941945 >> v1:172.21.15.73:6789/0 conn(0x7f45c80b1640 legacy=0x7f45c8070630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:57:00.031 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:00.027+0000 7f45c67fc700 1 -- 172.21.15.46:0/1543941945 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f45c815d6a0 con 0x7f45c813f670 2023-07-05T18:57:00.031 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:00.027+0000 7f45c67fc700 1 --2- 172.21.15.46:0/1543941945 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f45c813f670 0x7f45c806c7e0 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f45c806c490 tx=0x7f45b8009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=19467f41617fa903 server_cookie=0 in_seq=0 out_seq=0 2023-07-05T18:57:00.031 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:00.027+0000 7f45c5ffb700 1 -- 172.21.15.46:0/1543941945 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45b8011830 con 0x7f45c813f670 2023-07-05T18:57:00.032 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:00.027+0000 7f45c5ffb700 1 -- 172.21.15.46:0/1543941945 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f45b8011990 con 0x7f45c813f670 2023-07-05T18:57:00.032 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:00.027+0000 7f45c5ffb700 1 -- 172.21.15.46:0/1543941945 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45b8011d20 con 0x7f45c813f670 2023-07-05T18:57:00.039 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:00.027+0000 7f45cd630700 1 -- 172.21.15.46:0/1543941945 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f45c813f670 msgr2=0x7f45c806c7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:57:00.041 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:00.028+0000 7f45cd630700 1 --2- 172.21.15.46:0/1543941945 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f45c813f670 0x7f45c806c7e0 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f45c806c490 tx=0x7f45b8009bd0 comp rx=0 tx=0).stop 2023-07-05T18:57:00.041 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:00.028+0000 7f45cd630700 1 -- 172.21.15.46:0/1543941945 shutdown_connections 2023-07-05T18:57:00.041 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:00.028+0000 7f45cd630700 1 --2- 172.21.15.46:0/1543941945 >> v2:172.21.15.73:3300/0 conn(0x7f45c813f2a0 0x7f45c80cf410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:57:00.041 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:00.028+0000 7f45cd630700 1 --2- 172.21.15.46:0/1543941945 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f45c813f670 0x7f45c806c7e0 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:57:00.041 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:00.028+0000 7f45cd630700 1 -- 172.21.15.46:0/1543941945 >> 172.21.15.46:0/1543941945 conn(0x7f45c80cf980 msgr2=0x7f45c80cfd50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-05T18:57:00.042 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:00.028+0000 7f45cd630700 1 -- 172.21.15.46:0/1543941945 shutdown_connections 2023-07-05T18:57:00.042 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:00.028+0000 7f45cd630700 1 -- 172.21.15.46:0/1543941945 wait complete. 2023-07-05T18:57:00.042 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:00.029+0000 7f45cd630700 1 Processor -- start 2023-07-05T18:57:00.042 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:00.029+0000 7f45cd630700 1 -- start start 2023-07-05T18:57:00.042 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:00.030+0000 7f45cd630700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f45c80b1640 0x7f45c813dd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:57:00.042 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:00.030+0000 7f45cd630700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f45c813f2a0 0x7f45c80c8d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:57:00.042 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:00.030+0000 7f45cd630700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f45c813f670 0x7f45c80b53b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:57:00.043 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:00.030+0000 7f45cd630700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45c80cb510 con 0x7f45c813f670 2023-07-05T18:57:00.043 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:00.030+0000 7f45cd630700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45c80b3ab0 con 0x7f45c80b1640 2023-07-05T18:57:00.043 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:00.030+0000 7f45cd630700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f45c80c9270 con 0x7f45c813f2a0 2023-07-05T18:57:00.043 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:00.030+0000 7f45c77fe700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f45c813f670 0x7f45c80b53b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:57:00.043 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:00.030+0000 7f45c77fe700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f45c813f670 0x7f45c80b53b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:59372/0 (socket says 172.21.15.46:59372) 2023-07-05T18:57:00.043 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:00.030+0000 7f45c77fe700 1 -- 172.21.15.46:0/3297107472 learned_addr learned my addr 172.21.15.46:0/3297107472 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-07-05T18:57:00.043 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:00.030+0000 7f45c67fc700 1 --2- 172.21.15.46:0/3297107472 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f45c813f2a0 0x7f45c80c8d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:57:00.043 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:00.030+0000 7f45c6ffd700 1 --2- 172.21.15.46:0/3297107472 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f45c80b1640 0x7f45c813dd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:57:00.044 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:00.030+0000 7f45c77fe700 1 -- 172.21.15.46:0/3297107472 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f45c813f2a0 msgr2=0x7f45c80c8d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:57:00.044 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:00.030+0000 7f45c77fe700 1 --2- 172.21.15.46:0/3297107472 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f45c813f2a0 0x7f45c80c8d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:57:00.046 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:00.030+0000 7f45c77fe700 1 -- 172.21.15.46:0/3297107472 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f45c80b1640 msgr2=0x7f45c813dd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:57:00.046 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:00.030+0000 7f45c77fe700 1 --2- 172.21.15.46:0/3297107472 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f45c80b1640 0x7f45c813dd90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:57:00.046 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:00.030+0000 7f45c77fe700 1 -- 172.21.15.46:0/3297107472 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f45b8009550 con 0x7f45c813f670 2023-07-05T18:57:00.046 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:00.030+0000 7f45c77fe700 1 --2- 172.21.15.46:0/3297107472 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f45c813f670 0x7f45c80b53b0 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f45c000cc80 tx=0x7f45c000cf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-05T18:57:00.046 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:00.030+0000 7f45af7fe700 1 -- 172.21.15.46:0/3297107472 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45c0003c00 con 0x7f45c813f670 2023-07-05T18:57:00.047 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:00.031+0000 7f45af7fe700 1 -- 172.21.15.46:0/3297107472 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f45c0003d60 con 0x7f45c813f670 2023-07-05T18:57:00.047 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:00.031+0000 7f45af7fe700 1 -- 172.21.15.46:0/3297107472 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45c000aaa0 con 0x7f45c813f670 2023-07-05T18:57:00.047 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:00.031+0000 7f45cd630700 1 -- 172.21.15.46:0/3297107472 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f45c80b3780 con 0x7f45c813f670 2023-07-05T18:57:00.047 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:00.031+0000 7f45cd630700 1 -- 172.21.15.46:0/3297107472 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f45c8157a90 con 0x7f45c813f670 2023-07-05T18:57:00.047 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:00.032+0000 7f45cd630700 1 -- 172.21.15.46:0/3297107472 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f45c806f180 con 0x7f45c813f670 2023-07-05T18:57:00.047 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:00.032+0000 7f45af7fe700 1 -- 172.21.15.46:0/3297107472 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f45c000ac00 con 0x7f45c813f670 2023-07-05T18:57:00.047 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:00.033+0000 7f45af7fe700 1 --2- 172.21.15.46:0/3297107472 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7f45b406ace0 0x7f45b406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:57:00.047 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:00.033+0000 7f45af7fe700 1 -- 172.21.15.46:0/3297107472 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f45c00893d0 con 0x7f45c813f670 2023-07-05T18:57:00.048 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:00.033+0000 7f45c6ffd700 1 --2- 172.21.15.46:0/3297107472 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7f45b406ace0 0x7f45b406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:57:00.048 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:00.033+0000 7f45c6ffd700 1 --2- 172.21.15.46:0/3297107472 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7f45b406ace0 0x7f45b406d190 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f45bc009be0 tx=0x7f45bc009210 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-05T18:57:00.048 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:00.037+0000 7f45af7fe700 1 -- 172.21.15.46:0/3297107472 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f45c0054480 con 0x7f45c813f670 2023-07-05T18:57:00.236 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:00.235+0000 7f45cd630700 1 -- 172.21.15.46:0/3297107472 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f45c80672e0 con 0x7f45c813f670 2023-07-05T18:57:00.237 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:00.235+0000 7f45af7fe700 1 -- 172.21.15.46:0/3297107472 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v21) v1 ==== 92+0+10 (secure 0 0 0) 0x7f45c0057aa0 con 0x7f45c813f670 2023-07-05T18:57:00.238 INFO:teuthology.orchestra.run.smithi046.stdout:pg_num: 8 2023-07-05T18:57:00.239 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:00.237+0000 7f45cd630700 1 -- 172.21.15.46:0/3297107472 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7f45b406ace0 msgr2=0x7f45b406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:57:00.240 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:00.237+0000 7f45cd630700 1 --2- 172.21.15.46:0/3297107472 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7f45b406ace0 0x7f45b406d190 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f45bc009be0 tx=0x7f45bc009210 comp rx=0 tx=0).stop 2023-07-05T18:57:00.241 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:00.237+0000 7f45cd630700 1 -- 172.21.15.46:0/3297107472 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f45c813f670 msgr2=0x7f45c80b53b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:57:00.242 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:00.237+0000 7f45cd630700 1 --2- 172.21.15.46:0/3297107472 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f45c813f670 0x7f45c80b53b0 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f45c000cc80 tx=0x7f45c000cf90 comp rx=0 tx=0).stop 2023-07-05T18:57:00.242 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:00.237+0000 7f45cd630700 1 -- 172.21.15.46:0/3297107472 shutdown_connections 2023-07-05T18:57:00.242 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:00.237+0000 7f45cd630700 1 --2- 172.21.15.46:0/3297107472 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7f45b406ace0 0x7f45b406d190 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:57:00.242 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:00.237+0000 7f45cd630700 1 --2- 172.21.15.46:0/3297107472 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f45c813f670 0x7f45c80b53b0 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:57:00.242 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:00.237+0000 7f45cd630700 1 --2- 172.21.15.46:0/3297107472 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f45c80b1640 0x7f45c813dd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:57:00.242 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:00.237+0000 7f45cd630700 1 --2- 172.21.15.46:0/3297107472 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f45c813f2a0 0x7f45c80c8d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:57:00.242 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:00.237+0000 7f45cd630700 1 -- 172.21.15.46:0/3297107472 >> 172.21.15.46:0/3297107472 conn(0x7f45c80cf980 msgr2=0x7f45c80cfd50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-05T18:57:00.243 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:00.238+0000 7f45cd630700 1 -- 172.21.15.46:0/3297107472 shutdown_connections 2023-07-05T18:57:00.243 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:00.238+0000 7f45cd630700 1 -- 172.21.15.46:0/3297107472 wait complete. 2023-07-05T18:57:00.251 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-07-05T18:57:00.382 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:00.381+0000 7f28efb10700 1 Processor -- start 2023-07-05T18:57:00.383 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:00.381+0000 7f28efb10700 1 -- start start 2023-07-05T18:57:00.394 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:00.382+0000 7f28efb10700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f28e80cd540 0x7f28e815b310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:57:00.394 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:00.382+0000 7f28efb10700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f28e80cd990 0x7f28e8069e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:57:00.394 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:00.382+0000 7f28efb10700 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f28e815e800 con 0x7f28e815af40 2023-07-05T18:57:00.395 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:00.382+0000 7f28efb10700 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f28e80cb370 con 0x7f28e80cd990 2023-07-05T18:57:00.395 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:00.382+0000 7f28efb10700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f28e815a990 con 0x7f28e80cd540 2023-07-05T18:57:00.395 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:00.382+0000 7f28ee0ad700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f28e80cd990 0x7f28e8069e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:57:00.395 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:00.382+0000 7f28ed8ac700 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7f28e815af40 0x7f28e815e040 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:58648/0 (socket says 172.21.15.46:58648) 2023-07-05T18:57:00.395 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:00.382+0000 7f28ed8ac700 1 -- 172.21.15.46:0/3225384694 learned_addr learned my addr 172.21.15.46:0/3225384694 (peer_addr_for_me v1:172.21.15.46:0/0) 2023-07-05T18:57:00.404 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:00.382+0000 7f28ed0ab700 1 --2- 172.21.15.46:0/3225384694 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f28e80cd540 0x7f28e815b310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:57:00.405 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:00.383+0000 7f28ee0ad700 1 -- 172.21.15.46:0/3225384694 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f28e80cd540 msgr2=0x7f28e815b310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-05T18:57:00.405 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:00.383+0000 7f28ee0ad700 1 --2- 172.21.15.46:0/3225384694 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f28e80cd540 0x7f28e815b310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:57:00.405 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:00.383+0000 7f28ee0ad700 1 -- 172.21.15.46:0/3225384694 >> v1:172.21.15.46:6789/0 conn(0x7f28e815af40 legacy=0x7f28e815e040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:57:00.406 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:00.383+0000 7f28ee0ad700 1 -- 172.21.15.46:0/3225384694 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f28e815eae0 con 0x7f28e80cd990 2023-07-05T18:57:00.406 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:00.383+0000 7f28ec8aa700 1 -- 172.21.15.46:0/3225384694 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3310024737 0 0) 0x7f28e815e800 con 0x7f28e815af40 2023-07-05T18:57:00.406 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:00.383+0000 7f28ee0ad700 1 --2- 172.21.15.46:0/3225384694 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f28e80cd990 0x7f28e8069e00 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f28e0009d90 tx=0x7f28e000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9821dd4dce0b4a24 server_cookie=0 in_seq=0 out_seq=0 2023-07-05T18:57:00.406 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:00.383+0000 7f28ec8aa700 1 -- 172.21.15.46:0/3225384694 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28e000e070 con 0x7f28e80cd990 2023-07-05T18:57:00.407 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:00.383+0000 7f28ec8aa700 1 -- 172.21.15.46:0/3225384694 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f28e000bb20 con 0x7f28e80cd990 2023-07-05T18:57:00.407 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:00.383+0000 7f28ec8aa700 1 -- 172.21.15.46:0/3225384694 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28e0012430 con 0x7f28e80cd990 2023-07-05T18:57:00.407 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:00.383+0000 7f28efb10700 1 -- 172.21.15.46:0/3225384694 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f28e80cd990 msgr2=0x7f28e8069e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:57:00.408 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:00.383+0000 7f28efb10700 1 --2- 172.21.15.46:0/3225384694 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f28e80cd990 0x7f28e8069e00 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f28e0009d90 tx=0x7f28e000b330 comp rx=0 tx=0).stop 2023-07-05T18:57:00.410 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:00.383+0000 7f28efb10700 1 -- 172.21.15.46:0/3225384694 shutdown_connections 2023-07-05T18:57:00.410 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:00.384+0000 7f28efb10700 1 --2- 172.21.15.46:0/3225384694 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f28e80cd990 0x7f28e8069e00 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:57:00.411 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:00.384+0000 7f28efb10700 1 --2- 172.21.15.46:0/3225384694 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f28e80cd540 0x7f28e815b310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:57:00.411 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:00.384+0000 7f28efb10700 1 -- 172.21.15.46:0/3225384694 >> 172.21.15.46:0/3225384694 conn(0x7f28e806bba0 msgr2=0x7f28e80cc3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-05T18:57:00.411 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:00.384+0000 7f28efb10700 1 -- 172.21.15.46:0/3225384694 shutdown_connections 2023-07-05T18:57:00.411 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:00.384+0000 7f28efb10700 1 -- 172.21.15.46:0/3225384694 wait complete. 2023-07-05T18:57:00.411 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:00.385+0000 7f28efb10700 1 Processor -- start 2023-07-05T18:57:00.411 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:00.385+0000 7f28efb10700 1 -- start start 2023-07-05T18:57:00.412 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:00.386+0000 7f28efb10700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f28e80cd540 0x7f28e81eff70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:57:00.412 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:00.386+0000 7f28efb10700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f28e80cd990 0x7f28e814ce30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:57:00.412 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:00.386+0000 7f28efb10700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f28e815af40 0x7f28e815c020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:57:00.412 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:00.386+0000 7f28efb10700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28e814d370 con 0x7f28e80cd990 2023-07-05T18:57:00.412 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:00.386+0000 7f28efb10700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28e80b1490 con 0x7f28e80cd540 2023-07-05T18:57:00.412 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:00.386+0000 7f28efb10700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f28e80c6b70 con 0x7f28e815af40 2023-07-05T18:57:00.412 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:00.386+0000 7f28ed0ab700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f28e80cd990 0x7f28e814ce30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:57:00.413 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:00.386+0000 7f28ed0ab700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f28e80cd990 0x7f28e814ce30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:59384/0 (socket says 172.21.15.46:59384) 2023-07-05T18:57:00.413 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:00.386+0000 7f28ed0ab700 1 -- 172.21.15.46:0/2758451589 learned_addr learned my addr 172.21.15.46:0/2758451589 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-07-05T18:57:00.413 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:00.386+0000 7f28ed8ac700 1 --2- 172.21.15.46:0/2758451589 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f28e80cd540 0x7f28e81eff70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:57:00.413 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:00.386+0000 7f28ee0ad700 1 --2- 172.21.15.46:0/2758451589 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f28e815af40 0x7f28e815c020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:57:00.413 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:00.387+0000 7f28ed0ab700 1 -- 172.21.15.46:0/2758451589 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f28e815af40 msgr2=0x7f28e815c020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:57:00.414 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:00.387+0000 7f28ed0ab700 1 --2- 172.21.15.46:0/2758451589 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f28e815af40 0x7f28e815c020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:57:00.414 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:00.387+0000 7f28ed0ab700 1 -- 172.21.15.46:0/2758451589 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f28e80cd540 msgr2=0x7f28e81eff70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:57:00.414 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:00.387+0000 7f28ed0ab700 1 --2- 172.21.15.46:0/2758451589 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f28e80cd540 0x7f28e81eff70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:57:00.414 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:00.387+0000 7f28ed0ab700 1 -- 172.21.15.46:0/2758451589 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f28e0009a70 con 0x7f28e80cd990 2023-07-05T18:57:00.414 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:00.387+0000 7f28ed0ab700 1 --2- 172.21.15.46:0/2758451589 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f28e80cd990 0x7f28e814ce30 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f28d800e9b0 tx=0x7f28d800ecc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-05T18:57:00.414 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:00.387+0000 7f28de7fc700 1 -- 172.21.15.46:0/2758451589 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28d8009710 con 0x7f28e80cd990 2023-07-05T18:57:00.415 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:00.387+0000 7f28de7fc700 1 -- 172.21.15.46:0/2758451589 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f28d800ee50 con 0x7f28e80cd990 2023-07-05T18:57:00.416 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:00.387+0000 7f28efb10700 1 -- 172.21.15.46:0/2758451589 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f28e80c6e50 con 0x7f28e80cd990 2023-07-05T18:57:00.416 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:00.387+0000 7f28de7fc700 1 -- 172.21.15.46:0/2758451589 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28d800ca50 con 0x7f28e80cd990 2023-07-05T18:57:00.416 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:00.387+0000 7f28efb10700 1 -- 172.21.15.46:0/2758451589 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f28e80c7410 con 0x7f28e80cd990 2023-07-05T18:57:00.416 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:00.388+0000 7f28efb10700 1 -- 172.21.15.46:0/2758451589 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f28e80c7780 con 0x7f28e80cd990 2023-07-05T18:57:00.417 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:00.388+0000 7f28de7fc700 1 -- 172.21.15.46:0/2758451589 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f28d800cbb0 con 0x7f28e80cd990 2023-07-05T18:57:00.417 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:00.389+0000 7f28de7fc700 1 --2- 172.21.15.46:0/2758451589 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7f28cc06ace0 0x7f28cc06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:57:00.417 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:00.389+0000 7f28de7fc700 1 -- 172.21.15.46:0/2758451589 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f28d8089410 con 0x7f28e80cd990 2023-07-05T18:57:00.417 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:00.389+0000 7f28ed8ac700 1 --2- 172.21.15.46:0/2758451589 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7f28cc06ace0 0x7f28cc06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:57:00.418 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:00.390+0000 7f28ed8ac700 1 --2- 172.21.15.46:0/2758451589 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7f28cc06ace0 0x7f28cc06d190 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f28e4000f60 tx=0x7f28e4007e70 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-05T18:57:00.418 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:00.393+0000 7f28de7fc700 1 -- 172.21.15.46:0/2758451589 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f28d8057fe0 con 0x7f28e80cd990 2023-07-05T18:57:00.597 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:00.592+0000 7f28efb10700 1 -- 172.21.15.46:0/2758451589 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f28e80672e0 con 0x7f28e80cd990 2023-07-05T18:57:00.598 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:00.592+0000 7f28de7fc700 1 -- 172.21.15.46:0/2758451589 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v21) v1 ==== 93+0+10 (secure 0 0 0) 0x7f28d800ce60 con 0x7f28e80cd990 2023-07-05T18:57:00.598 INFO:teuthology.orchestra.run.smithi046.stdout:pg_num: 1 2023-07-05T18:57:00.599 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:00.594+0000 7f28efb10700 1 -- 172.21.15.46:0/2758451589 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7f28cc06ace0 msgr2=0x7f28cc06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:57:00.600 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:00.594+0000 7f28efb10700 1 --2- 172.21.15.46:0/2758451589 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7f28cc06ace0 0x7f28cc06d190 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f28e4000f60 tx=0x7f28e4007e70 comp rx=0 tx=0).stop 2023-07-05T18:57:00.600 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:00.594+0000 7f28efb10700 1 -- 172.21.15.46:0/2758451589 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f28e80cd990 msgr2=0x7f28e814ce30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:57:00.600 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:00.594+0000 7f28efb10700 1 --2- 172.21.15.46:0/2758451589 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f28e80cd990 0x7f28e814ce30 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f28d800e9b0 tx=0x7f28d800ecc0 comp rx=0 tx=0).stop 2023-07-05T18:57:00.600 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:00.594+0000 7f28efb10700 1 -- 172.21.15.46:0/2758451589 shutdown_connections 2023-07-05T18:57:00.600 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:00.594+0000 7f28efb10700 1 --2- 172.21.15.46:0/2758451589 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7f28cc06ace0 0x7f28cc06d190 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:57:00.601 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:00.594+0000 7f28efb10700 1 --2- 172.21.15.46:0/2758451589 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f28e815af40 0x7f28e815c020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:57:00.601 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:00.594+0000 7f28efb10700 1 --2- 172.21.15.46:0/2758451589 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f28e80cd540 0x7f28e81eff70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:57:00.601 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:00.594+0000 7f28efb10700 1 --2- 172.21.15.46:0/2758451589 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f28e80cd990 0x7f28e814ce30 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:57:00.601 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:00.594+0000 7f28efb10700 1 -- 172.21.15.46:0/2758451589 >> 172.21.15.46:0/2758451589 conn(0x7f28e806bba0 msgr2=0x7f28e815d440 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-05T18:57:00.601 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:00.595+0000 7f28efb10700 1 -- 172.21.15.46:0/2758451589 shutdown_connections 2023-07-05T18:57:00.601 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:00.595+0000 7f28efb10700 1 -- 172.21.15.46:0/2758451589 wait complete. 2023-07-05T18:57:00.608 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-07-05T18:57:00.747 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:00.734+0000 7f5ee7f85700 1 Processor -- start 2023-07-05T18:57:00.747 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:00.734+0000 7f5ee7f85700 1 -- start start 2023-07-05T18:57:00.747 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:00.735+0000 7f5ee7f85700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f5ee015fa70 0x7f5ee006ebf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:57:00.748 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:00.735+0000 7f5ee7f85700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f5ee00ce530 0x7f5ee0160980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:57:00.748 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:00.735+0000 7f5ee7f85700 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5ee00ce0a0 con 0x7f5ee00b15d0 2023-07-05T18:57:00.748 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:00.735+0000 7f5ee7f85700 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5ee00cf4b0 con 0x7f5ee00ce530 2023-07-05T18:57:00.748 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:00.735+0000 7f5ee7f85700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5ee0160ec0 con 0x7f5ee015fa70 2023-07-05T18:57:00.748 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:00.735+0000 7f5ee5520700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f5ee00ce530 0x7f5ee0160980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:57:00.748 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:00.735+0000 7f5ee5520700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f5ee00ce530 0x7f5ee0160980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:59390/0 (socket says 172.21.15.46:59390) 2023-07-05T18:57:00.748 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:00.735+0000 7f5ee5520700 1 -- 172.21.15.46:0/1841101062 learned_addr learned my addr 172.21.15.46:0/1841101062 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-07-05T18:57:00.749 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:00.736+0000 7f5ee5d21700 1 --2- 172.21.15.46:0/1841101062 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f5ee015fa70 0x7f5ee006ebf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:57:00.749 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:00.736+0000 7f5ee5520700 1 -- 172.21.15.46:0/1841101062 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f5ee015fa70 msgr2=0x7f5ee006ebf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-05T18:57:00.749 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:00.736+0000 7f5ee5520700 1 --2- 172.21.15.46:0/1841101062 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f5ee015fa70 0x7f5ee006ebf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:57:00.749 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:00.736+0000 7f5ee5520700 1 -- 172.21.15.46:0/1841101062 >> v1:172.21.15.73:6789/0 conn(0x7f5ee00b15d0 legacy=0x7f5ee0069e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-05T18:57:00.749 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:00.736+0000 7f5ee5520700 1 -- 172.21.15.46:0/1841101062 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ee00cd4b0 con 0x7f5ee00ce530 2023-07-05T18:57:00.749 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:00.736+0000 7f5ee5520700 1 --2- 172.21.15.46:0/1841101062 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5ee00ce530 0x7f5ee0160980 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f5edc0098f0 tx=0x7f5edc009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1c422c2907ba1d7d server_cookie=0 in_seq=0 out_seq=0 2023-07-05T18:57:00.751 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:00.736+0000 7f5ee4d1f700 1 -- 172.21.15.46:0/1841101062 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5edc004230 con 0x7f5ee00ce530 2023-07-05T18:57:00.751 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:00.736+0000 7f5ee4d1f700 1 -- 172.21.15.46:0/1841101062 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5edc004390 con 0x7f5ee00ce530 2023-07-05T18:57:00.752 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:00.736+0000 7f5ee4d1f700 1 -- 172.21.15.46:0/1841101062 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5edc0036a0 con 0x7f5ee00ce530 2023-07-05T18:57:00.752 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:00.736+0000 7f5ee7f85700 1 -- 172.21.15.46:0/1841101062 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5ee00ce530 msgr2=0x7f5ee0160980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:57:00.753 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:00.736+0000 7f5ee7f85700 1 --2- 172.21.15.46:0/1841101062 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5ee00ce530 0x7f5ee0160980 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f5edc0098f0 tx=0x7f5edc009c00 comp rx=0 tx=0).stop 2023-07-05T18:57:00.754 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:00.737+0000 7f5ee7f85700 1 -- 172.21.15.46:0/1841101062 shutdown_connections 2023-07-05T18:57:00.755 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:00.737+0000 7f5ee7f85700 1 --2- 172.21.15.46:0/1841101062 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f5ee015fa70 0x7f5ee006ebf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:57:00.755 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:00.737+0000 7f5ee7f85700 1 --2- 172.21.15.46:0/1841101062 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5ee00ce530 0x7f5ee0160980 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:57:00.755 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:00.737+0000 7f5ee7f85700 1 -- 172.21.15.46:0/1841101062 >> 172.21.15.46:0/1841101062 conn(0x7f5ee00cf970 msgr2=0x7f5ee00cfd40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-05T18:57:00.755 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:00.737+0000 7f5ee7f85700 1 -- 172.21.15.46:0/1841101062 shutdown_connections 2023-07-05T18:57:00.755 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:00.737+0000 7f5ee7f85700 1 -- 172.21.15.46:0/1841101062 wait complete. 2023-07-05T18:57:00.755 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:00.738+0000 7f5ee7f85700 1 Processor -- start 2023-07-05T18:57:00.756 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:00.738+0000 7f5ee7f85700 1 -- start start 2023-07-05T18:57:00.758 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:00.738+0000 7f5ee7f85700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5ee00b15d0 0x7f5ee01493c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:57:00.758 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:00.739+0000 7f5ee7f85700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5ee00ce530 0x7f5ee015d260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:57:00.758 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:00.739+0000 7f5ee7f85700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f5ee015fa70 0x7f5ee00a8450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:57:00.758 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:00.739+0000 7f5ee7f85700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ee014a060 con 0x7f5ee00b15d0 2023-07-05T18:57:00.759 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:00.739+0000 7f5ee7f85700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ee0149a30 con 0x7f5ee00ce530 2023-07-05T18:57:00.759 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:00.739+0000 7f5ee7f85700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5ee015dd10 con 0x7f5ee015fa70 2023-07-05T18:57:00.759 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:00.739+0000 7f5ee5d21700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5ee00b15d0 0x7f5ee01493c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:57:00.759 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:00.739+0000 7f5ee5d21700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5ee00b15d0 0x7f5ee01493c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:59396/0 (socket says 172.21.15.46:59396) 2023-07-05T18:57:00.759 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:00.739+0000 7f5ee5d21700 1 -- 172.21.15.46:0/1267175611 learned_addr learned my addr 172.21.15.46:0/1267175611 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-07-05T18:57:00.759 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:00.739+0000 7f5ee6522700 1 --2- 172.21.15.46:0/1267175611 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f5ee015fa70 0x7f5ee00a8450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:57:00.759 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:00.739+0000 7f5ee5d21700 1 -- 172.21.15.46:0/1267175611 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f5ee015fa70 msgr2=0x7f5ee00a8450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:57:00.760 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:00.739+0000 7f5ee5520700 1 --2- 172.21.15.46:0/1267175611 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5ee00ce530 0x7f5ee015d260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:57:00.760 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:00.739+0000 7f5ee5d21700 1 --2- 172.21.15.46:0/1267175611 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f5ee015fa70 0x7f5ee00a8450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:57:00.760 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:00.739+0000 7f5ee5d21700 1 -- 172.21.15.46:0/1267175611 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5ee00ce530 msgr2=0x7f5ee015d260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:57:00.760 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:00.739+0000 7f5ee5d21700 1 --2- 172.21.15.46:0/1267175611 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5ee00ce530 0x7f5ee015d260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:57:00.760 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:00.739+0000 7f5ee5d21700 1 -- 172.21.15.46:0/1267175611 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5edc009550 con 0x7f5ee00b15d0 2023-07-05T18:57:00.760 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:00.739+0000 7f5ee6522700 1 --2- 172.21.15.46:0/1267175611 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f5ee015fa70 0x7f5ee00a8450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-05T18:57:00.760 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:00.739+0000 7f5ee5d21700 1 --2- 172.21.15.46:0/1267175611 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5ee00b15d0 0x7f5ee01493c0 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f5ed000d800 tx=0x7f5ed000dbc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-05T18:57:00.761 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:00.739+0000 7f5ed67fc700 1 -- 172.21.15.46:0/1267175611 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ed00125f0 con 0x7f5ee00b15d0 2023-07-05T18:57:00.761 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:00.739+0000 7f5ed67fc700 1 -- 172.21.15.46:0/1267175611 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5ed0012750 con 0x7f5ee00b15d0 2023-07-05T18:57:00.761 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:00.739+0000 7f5ed67fc700 1 -- 172.21.15.46:0/1267175611 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ed0012b00 con 0x7f5ee00b15d0 2023-07-05T18:57:00.761 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:00.739+0000 7f5ee7f85700 1 -- 172.21.15.46:0/1267175611 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5ee015dff0 con 0x7f5ee00b15d0 2023-07-05T18:57:00.761 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:00.739+0000 7f5ee7f85700 1 -- 172.21.15.46:0/1267175611 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5ee0159cd0 con 0x7f5ee00b15d0 2023-07-05T18:57:00.761 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:00.740+0000 7f5ee7f85700 1 -- 172.21.15.46:0/1267175611 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5ee015e230 con 0x7f5ee00b15d0 2023-07-05T18:57:00.761 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:00.741+0000 7f5ed67fc700 1 -- 172.21.15.46:0/1267175611 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f5ed0012c60 con 0x7f5ee00b15d0 2023-07-05T18:57:00.762 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:00.741+0000 7f5ed67fc700 1 --2- 172.21.15.46:0/1267175611 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7f5ec406ace0 0x7f5ec406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:57:00.762 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:00.741+0000 7f5ed67fc700 1 -- 172.21.15.46:0/1267175611 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f5ed0089880 con 0x7f5ee00b15d0 2023-07-05T18:57:00.762 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:00.741+0000 7f5ee5520700 1 --2- 172.21.15.46:0/1267175611 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7f5ec406ace0 0x7f5ec406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:57:00.762 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:00.742+0000 7f5ee5520700 1 --2- 172.21.15.46:0/1267175611 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7f5ec406ace0 0x7f5ec406d190 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f5ee015e4a0 tx=0x7f5edc008030 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-05T18:57:00.762 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:00.746+0000 7f5ed67fc700 1 -- 172.21.15.46:0/1267175611 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f5ed0054920 con 0x7f5ee00b15d0 2023-07-05T18:57:00.942 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:00.941+0000 7f5ee7f85700 1 -- 172.21.15.46:0/1267175611 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f5ee00672e0 con 0x7f5ee00b15d0 2023-07-05T18:57:00.942 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:00.941+0000 7f5ed67fc700 1 -- 172.21.15.46:0/1267175611 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v21) v1 ==== 104+0+11 (secure 0 0 0) 0x7f5ed0057f40 con 0x7f5ee00b15d0 2023-07-05T18:57:00.943 INFO:teuthology.orchestra.run.smithi046.stdout:pg_num: 32 2023-07-05T18:57:00.946 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:00.944+0000 7f5ee7f85700 1 -- 172.21.15.46:0/1267175611 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7f5ec406ace0 msgr2=0x7f5ec406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:57:00.946 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:00.944+0000 7f5ee7f85700 1 --2- 172.21.15.46:0/1267175611 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7f5ec406ace0 0x7f5ec406d190 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f5ee015e4a0 tx=0x7f5edc008030 comp rx=0 tx=0).stop 2023-07-05T18:57:00.946 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:00.944+0000 7f5ee7f85700 1 -- 172.21.15.46:0/1267175611 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5ee00b15d0 msgr2=0x7f5ee01493c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:57:00.946 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:00.944+0000 7f5ee7f85700 1 --2- 172.21.15.46:0/1267175611 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5ee00b15d0 0x7f5ee01493c0 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f5ed000d800 tx=0x7f5ed000dbc0 comp rx=0 tx=0).stop 2023-07-05T18:57:00.947 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:00.944+0000 7f5ee7f85700 1 -- 172.21.15.46:0/1267175611 shutdown_connections 2023-07-05T18:57:00.947 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:00.944+0000 7f5ee7f85700 1 --2- 172.21.15.46:0/1267175611 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7f5ec406ace0 0x7f5ec406d190 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:57:00.947 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:00.944+0000 7f5ee7f85700 1 --2- 172.21.15.46:0/1267175611 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f5ee015fa70 0x7f5ee00a8450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:57:00.947 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:00.944+0000 7f5ee7f85700 1 --2- 172.21.15.46:0/1267175611 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5ee00b15d0 0x7f5ee01493c0 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:57:00.965 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:00.944+0000 7f5ee7f85700 1 --2- 172.21.15.46:0/1267175611 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5ee00ce530 0x7f5ee015d260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:57:00.965 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:00.944+0000 7f5ee7f85700 1 -- 172.21.15.46:0/1267175611 >> 172.21.15.46:0/1267175611 conn(0x7f5ee00cf970 msgr2=0x7f5ee00af5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-05T18:57:00.966 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:00.944+0000 7f5ee7f85700 1 -- 172.21.15.46:0/1267175611 shutdown_connections 2023-07-05T18:57:00.966 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:00.944+0000 7f5ee7f85700 1 -- 172.21.15.46:0/1267175611 wait complete. 2023-07-05T18:57:00.968 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-07-05T18:57:01.097 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:01.096+0000 7f17a8527700 1 Processor -- start 2023-07-05T18:57:01.097 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:01.096+0000 7f17a8527700 1 -- start start 2023-07-05T18:57:01.099 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:01.097+0000 7f17a8527700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f17a00cecc0 0x7f17a00d0b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:57:01.100 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:01.097+0000 7f17a8527700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f17a00d1090 0x7f17a006b540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:57:01.100 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:01.097+0000 7f17a8527700 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f17a00d14f0 con 0x7f17a00afe50 2023-07-05T18:57:01.100 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:01.097+0000 7f17a8527700 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f17a006ad80 con 0x7f17a00d1090 2023-07-05T18:57:01.100 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:01.097+0000 7f17a8527700 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f17a00b1d30 con 0x7f17a00cecc0 2023-07-05T18:57:01.100 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:01.097+0000 7f17a6ac4700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f17a00d1090 0x7f17a006b540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:57:01.101 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:01.097+0000 7f17a6ac4700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f17a00d1090 0x7f17a006b540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:59408/0 (socket says 172.21.15.46:59408) 2023-07-05T18:57:01.101 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:01.097+0000 7f17a6ac4700 1 -- 172.21.15.46:0/2592227924 learned_addr learned my addr 172.21.15.46:0/2592227924 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-07-05T18:57:01.101 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:01.097+0000 7f17a62c3700 1 --1- 172.21.15.46:0/2592227924 >> v1:172.21.15.46:6789/0 conn(0x7f17a00afe50 0x7f17a00b1620 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:58676/0 (socket says 172.21.15.46:58676) 2023-07-05T18:57:01.108 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:01.097+0000 7f17a5ac2700 1 --2- 172.21.15.46:0/2592227924 >> v2:172.21.15.73:3300/0 conn(0x7f17a00cecc0 0x7f17a00d0b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:57:01.108 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:01.097+0000 7f17a6ac4700 1 -- 172.21.15.46:0/2592227924 >> v2:172.21.15.73:3300/0 conn(0x7f17a00cecc0 msgr2=0x7f17a00d0b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-05T18:57:01.108 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:01.097+0000 7f17a6ac4700 1 --2- 172.21.15.46:0/2592227924 >> v2:172.21.15.73:3300/0 conn(0x7f17a00cecc0 0x7f17a00d0b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:57:01.108 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:01.097+0000 7f17a6ac4700 1 -- 172.21.15.46:0/2592227924 >> v1:172.21.15.46:6789/0 conn(0x7f17a00afe50 legacy=0x7f17a00b1620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:57:01.108 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:01.097+0000 7f17a52c1700 1 -- 172.21.15.46:0/2592227924 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2457179553 0 0) 0x7f17a00d14f0 con 0x7f17a00afe50 2023-07-05T18:57:01.109 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:01.097+0000 7f17a6ac4700 1 -- 172.21.15.46:0/2592227924 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f17a00cf150 con 0x7f17a00d1090 2023-07-05T18:57:01.109 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:01.097+0000 7f17a6ac4700 1 --2- 172.21.15.46:0/2592227924 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f17a00d1090 0x7f17a006b540 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f17a0071480 tx=0x7f179800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2c6c15d12668f247 server_cookie=0 in_seq=0 out_seq=0 2023-07-05T18:57:01.109 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:01.098+0000 7f17a52c1700 1 -- 172.21.15.46:0/2592227924 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f179800e070 con 0x7f17a00d1090 2023-07-05T18:57:01.109 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:01.098+0000 7f17a52c1700 1 -- 172.21.15.46:0/2592227924 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f179800b9c0 con 0x7f17a00d1090 2023-07-05T18:57:01.109 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:01.098+0000 7f17a52c1700 1 -- 172.21.15.46:0/2592227924 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f179800bd70 con 0x7f17a00d1090 2023-07-05T18:57:01.109 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:01.098+0000 7f17a8527700 1 -- 172.21.15.46:0/2592227924 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f17a00d1090 msgr2=0x7f17a006b540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:57:01.109 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:01.098+0000 7f17a8527700 1 --2- 172.21.15.46:0/2592227924 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f17a00d1090 0x7f17a006b540 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f17a0071480 tx=0x7f179800b330 comp rx=0 tx=0).stop 2023-07-05T18:57:01.110 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:01.098+0000 7f17a8527700 1 -- 172.21.15.46:0/2592227924 shutdown_connections 2023-07-05T18:57:01.110 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:01.098+0000 7f17a8527700 1 --2- 172.21.15.46:0/2592227924 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f17a00d1090 0x7f17a006b540 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:57:01.110 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:01.098+0000 7f17a8527700 1 --2- 172.21.15.46:0/2592227924 >> v2:172.21.15.73:3300/0 conn(0x7f17a00cecc0 0x7f17a00d0b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:57:01.110 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:01.098+0000 7f17a8527700 1 -- 172.21.15.46:0/2592227924 >> 172.21.15.46:0/2592227924 conn(0x7f17a00664b0 msgr2=0x7f17a0099e10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-05T18:57:01.110 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:01.098+0000 7f17a8527700 1 -- 172.21.15.46:0/2592227924 shutdown_connections 2023-07-05T18:57:01.110 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:01.098+0000 7f17a8527700 1 -- 172.21.15.46:0/2592227924 wait complete. 2023-07-05T18:57:01.113 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:01.099+0000 7f17a8527700 1 Processor -- start 2023-07-05T18:57:01.113 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:01.099+0000 7f17a8527700 1 -- start start 2023-07-05T18:57:01.114 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:01.100+0000 7f17a8527700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f17a00afe50 0x7f17a00b65b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:57:01.114 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:01.100+0000 7f17a8527700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f17a00cecc0 0x7f17a00b43e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:57:01.114 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:01.100+0000 7f17a8527700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f17a00d1090 0x7f17a00b4920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:57:01.114 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:01.100+0000 7f17a8527700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17a00ae9c0 con 0x7f17a00afe50 2023-07-05T18:57:01.114 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:01.100+0000 7f17a8527700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17a00b6af0 con 0x7f17a00d1090 2023-07-05T18:57:01.114 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:01.100+0000 7f17a8527700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f17a00cbc90 con 0x7f17a00cecc0 2023-07-05T18:57:01.114 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:01.100+0000 7f17a62c3700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f17a00afe50 0x7f17a00b65b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:57:01.115 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:01.100+0000 7f17a62c3700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f17a00afe50 0x7f17a00b65b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:59410/0 (socket says 172.21.15.46:59410) 2023-07-05T18:57:01.115 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:01.100+0000 7f17a62c3700 1 -- 172.21.15.46:0/2444926445 learned_addr learned my addr 172.21.15.46:0/2444926445 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-07-05T18:57:01.115 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:01.101+0000 7f17a5ac2700 1 --2- 172.21.15.46:0/2444926445 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f17a00cecc0 0x7f17a00b43e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:57:01.115 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:01.101+0000 7f17a6ac4700 1 --2- 172.21.15.46:0/2444926445 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f17a00d1090 0x7f17a00b4920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:57:01.115 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:01.101+0000 7f17a62c3700 1 -- 172.21.15.46:0/2444926445 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f17a00cecc0 msgr2=0x7f17a00b43e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:57:01.115 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:01.101+0000 7f17a62c3700 1 --2- 172.21.15.46:0/2444926445 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f17a00cecc0 0x7f17a00b43e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:57:01.115 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:01.101+0000 7f17a62c3700 1 -- 172.21.15.46:0/2444926445 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f17a00d1090 msgr2=0x7f17a00b4920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:57:01.115 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:01.101+0000 7f17a62c3700 1 --2- 172.21.15.46:0/2444926445 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f17a00d1090 0x7f17a00b4920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:57:01.116 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:01.101+0000 7f17a62c3700 1 -- 172.21.15.46:0/2444926445 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1798009b30 con 0x7f17a00afe50 2023-07-05T18:57:01.116 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:01.101+0000 7f17a6ac4700 1 --2- 172.21.15.46:0/2444926445 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f17a00d1090 0x7f17a00b4920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-05T18:57:01.116 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:01.101+0000 7f17a5ac2700 1 --2- 172.21.15.46:0/2444926445 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f17a00cecc0 0x7f17a00b43e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-05T18:57:01.124 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:01.101+0000 7f17a62c3700 1 --2- 172.21.15.46:0/2444926445 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f17a00afe50 0x7f17a00b65b0 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f179c00c550 tx=0x7f179c00c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-05T18:57:01.124 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:01.101+0000 7f1796ffd700 1 -- 172.21.15.46:0/2444926445 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f179c004c80 con 0x7f17a00afe50 2023-07-05T18:57:01.125 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:01.101+0000 7f1796ffd700 1 -- 172.21.15.46:0/2444926445 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f179c004e00 con 0x7f17a00afe50 2023-07-05T18:57:01.125 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:01.101+0000 7f17a8527700 1 -- 172.21.15.46:0/2444926445 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f17a00cc250 con 0x7f17a00afe50 2023-07-05T18:57:01.125 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:01.101+0000 7f1796ffd700 1 -- 172.21.15.46:0/2444926445 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f179c007310 con 0x7f17a00afe50 2023-07-05T18:57:01.125 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:01.101+0000 7f17a8527700 1 -- 172.21.15.46:0/2444926445 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f17a00aeeb0 con 0x7f17a00afe50 2023-07-05T18:57:01.125 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:01.102+0000 7f17a8527700 1 -- 172.21.15.46:0/2444926445 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f17a00af0d0 con 0x7f17a00afe50 2023-07-05T18:57:01.125 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:01.103+0000 7f1796ffd700 1 -- 172.21.15.46:0/2444926445 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f179c007470 con 0x7f17a00afe50 2023-07-05T18:57:01.126 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:01.103+0000 7f1796ffd700 1 --2- 172.21.15.46:0/2444926445 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7f178406ace0 0x7f178406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:57:01.126 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:01.103+0000 7f1796ffd700 1 -- 172.21.15.46:0/2444926445 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f179c0891c0 con 0x7f17a00afe50 2023-07-05T18:57:01.126 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:01.103+0000 7f17a5ac2700 1 --2- 172.21.15.46:0/2444926445 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7f178406ace0 0x7f178406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:57:01.126 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:01.104+0000 7f17a5ac2700 1 --2- 172.21.15.46:0/2444926445 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7f178406ace0 0x7f178406d190 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f17a015b640 tx=0x7f1790008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-05T18:57:01.126 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:01.107+0000 7f1796ffd700 1 -- 172.21.15.46:0/2444926445 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f17a00af0d0 con 0x7f17a00afe50 2023-07-05T18:57:01.306 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:01.304+0000 7f17a8527700 1 -- 172.21.15.46:0/2444926445 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f17a00af0d0 con 0x7f17a00afe50 2023-07-05T18:57:01.308 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:01.305+0000 7f1796ffd700 1 -- 172.21.15.46:0/2444926445 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v21) v1 ==== 100+0+11 (secure 0 0 0) 0x7f17a00af0d0 con 0x7f17a00afe50 2023-07-05T18:57:01.309 INFO:teuthology.orchestra.run.smithi046.stdout:pg_num: 64 2023-07-05T18:57:01.310 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:01.307+0000 7f17a8527700 1 -- 172.21.15.46:0/2444926445 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7f178406ace0 msgr2=0x7f178406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:57:01.310 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:01.307+0000 7f17a8527700 1 --2- 172.21.15.46:0/2444926445 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7f178406ace0 0x7f178406d190 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f17a015b640 tx=0x7f1790008040 comp rx=0 tx=0).stop 2023-07-05T18:57:01.310 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:01.307+0000 7f17a8527700 1 -- 172.21.15.46:0/2444926445 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f17a00afe50 msgr2=0x7f17a00b65b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:57:01.310 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:01.307+0000 7f17a8527700 1 --2- 172.21.15.46:0/2444926445 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f17a00afe50 0x7f17a00b65b0 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f179c00c550 tx=0x7f179c00c910 comp rx=0 tx=0).stop 2023-07-05T18:57:01.310 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:01.307+0000 7f17a8527700 1 -- 172.21.15.46:0/2444926445 shutdown_connections 2023-07-05T18:57:01.310 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:01.307+0000 7f17a8527700 1 --2- 172.21.15.46:0/2444926445 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7f178406ace0 0x7f178406d190 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:57:01.311 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:01.307+0000 7f17a8527700 1 --2- 172.21.15.46:0/2444926445 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f17a00d1090 0x7f17a00b4920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:57:01.311 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:01.307+0000 7f17a8527700 1 --2- 172.21.15.46:0/2444926445 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f17a00afe50 0x7f17a00b65b0 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:57:01.311 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:01.307+0000 7f17a8527700 1 --2- 172.21.15.46:0/2444926445 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f17a00cecc0 0x7f17a00b43e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:57:01.311 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:01.307+0000 7f17a8527700 1 -- 172.21.15.46:0/2444926445 >> 172.21.15.46:0/2444926445 conn(0x7f17a00664b0 msgr2=0x7f17a006eaa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-05T18:57:01.312 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:01.307+0000 7f17a8527700 1 -- 172.21.15.46:0/2444926445 shutdown_connections 2023-07-05T18:57:01.312 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:01.307+0000 7f17a8527700 1 -- 172.21.15.46:0/2444926445 wait complete. 2023-07-05T18:57:01.320 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-05T18:57:01.451 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:01.450+0000 7f3c305ec700 1 Processor -- start 2023-07-05T18:57:01.451 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:01.450+0000 7f3c305ec700 1 -- start start 2023-07-05T18:57:01.454 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:01.451+0000 7f3c305ec700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f3c2806c5a0 0x7f3c28071620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:57:01.454 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:01.451+0000 7f3c305ec700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f3c2815d900 0x7f3c28069e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:57:01.455 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:01.451+0000 7f3c305ec700 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3c2806b650 con 0x7f3c2815c6d0 2023-07-05T18:57:01.455 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:01.451+0000 7f3c305ec700 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3c2815ce20 con 0x7f3c2806c5a0 2023-07-05T18:57:01.455 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:01.451+0000 7f3c305ec700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3c2815d100 con 0x7f3c2815d900 2023-07-05T18:57:01.455 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:01.451+0000 7f3c2e388700 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7f3c2815c6d0 0x7f3c2806be90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:58690/0 (socket says 172.21.15.46:58690) 2023-07-05T18:57:01.455 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:01.451+0000 7f3c2e388700 1 -- 172.21.15.46:0/1900966183 learned_addr learned my addr 172.21.15.46:0/1900966183 (peer_addr_for_me v1:172.21.15.46:0/0) 2023-07-05T18:57:01.455 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:01.451+0000 7f3c2eb89700 1 --2- 172.21.15.46:0/1900966183 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f3c2815d900 0x7f3c28069e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:57:01.455 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:01.451+0000 7f3c2db87700 1 --2- 172.21.15.46:0/1900966183 >> v2:172.21.15.73:3300/0 conn(0x7f3c2806c5a0 0x7f3c28071620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:57:01.456 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:01.451+0000 7f3c2d386700 1 -- 172.21.15.46:0/1900966183 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1034784512 0 0) 0x7f3c2806b650 con 0x7f3c2815c6d0 2023-07-05T18:57:01.456 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:01.451+0000 7f3c2d386700 1 -- 172.21.15.46:0/1900966183 --> v1:172.21.15.46:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3c140035b0 con 0x7f3c2815c6d0 2023-07-05T18:57:01.456 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:01.451+0000 7f3c2d386700 1 -- 172.21.15.46:0/1900966183 <== mon.0 v1:172.21.15.46:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3959026123 0 0) 0x7f3c140035b0 con 0x7f3c2815c6d0 2023-07-05T18:57:01.456 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:01.451+0000 7f3c2d386700 1 -- 172.21.15.46:0/1900966183 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f3c2815d900 msgr2=0x7f3c28069e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-05T18:57:01.456 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:01.451+0000 7f3c2d386700 1 --2- 172.21.15.46:0/1900966183 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f3c2815d900 0x7f3c28069e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:57:01.457 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:01.451+0000 7f3c2d386700 1 -- 172.21.15.46:0/1900966183 >> v2:172.21.15.73:3300/0 conn(0x7f3c2806c5a0 msgr2=0x7f3c28071620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-05T18:57:01.457 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:01.451+0000 7f3c2d386700 1 --2- 172.21.15.46:0/1900966183 >> v2:172.21.15.73:3300/0 conn(0x7f3c2806c5a0 0x7f3c28071620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:57:01.457 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:01.451+0000 7f3c2d386700 1 -- 172.21.15.46:0/1900966183 --> v1:172.21.15.46:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c2815d3e0 con 0x7f3c2815c6d0 2023-07-05T18:57:01.457 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:01.451+0000 7f3c2d386700 1 -- 172.21.15.46:0/1900966183 <== mon.0 v1:172.21.15.46:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2195585215 0 0) 0x7f3c24001670 con 0x7f3c2815c6d0 2023-07-05T18:57:01.457 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:01.451+0000 7f3c2d386700 1 -- 172.21.15.46:0/1900966183 >> v1:172.21.15.46:6789/0 conn(0x7f3c2815c6d0 legacy=0x7f3c2806be90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:57:01.457 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:01.451+0000 7f3c2d386700 1 --2- 172.21.15.46:0/1900966183 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f3c2815d900 0x7f3c14003a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:57:01.458 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:01.451+0000 7f3c2d386700 1 --2- 172.21.15.46:0/1900966183 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3c14003f80 0x7f3c14004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:57:01.458 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:01.451+0000 7f3c2d386700 1 --2- 172.21.15.46:0/1900966183 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3c14004d90 0x7f3c14005200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:57:01.458 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:01.452+0000 7f3c2d386700 1 -- 172.21.15.46:0/1900966183 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c2815ce20 con 0x7f3c14003f80 2023-07-05T18:57:01.458 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:01.452+0000 7f3c2d386700 1 -- 172.21.15.46:0/1900966183 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c2815d100 con 0x7f3c14004d90 2023-07-05T18:57:01.458 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:01.452+0000 7f3c2d386700 1 -- 172.21.15.46:0/1900966183 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3c1400ba10 con 0x7f3c2815d900 2023-07-05T18:57:01.458 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:01.452+0000 7f3c2db87700 1 --2- 172.21.15.46:0/1900966183 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3c14003f80 0x7f3c14004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:57:01.458 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:01.452+0000 7f3c2e388700 1 --2- 172.21.15.46:0/1900966183 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f3c2815d900 0x7f3c14003a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:57:01.459 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:01.452+0000 7f3c2eb89700 1 --2- 172.21.15.46:0/1900966183 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3c14004d90 0x7f3c14005200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:57:01.459 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:01.452+0000 7f3c2db87700 1 -- 172.21.15.46:0/1900966183 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f3c2815d900 msgr2=0x7f3c14003a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-05T18:57:01.459 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:01.452+0000 7f3c2db87700 1 --2- 172.21.15.46:0/1900966183 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f3c2815d900 0x7f3c14003a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:57:01.460 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:01.452+0000 7f3c2db87700 1 -- 172.21.15.46:0/1900966183 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3c14004d90 msgr2=0x7f3c14005200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-05T18:57:01.460 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:01.452+0000 7f3c2db87700 1 --2- 172.21.15.46:0/1900966183 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3c14004d90 0x7f3c14005200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:57:01.460 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:01.452+0000 7f3c2db87700 1 -- 172.21.15.46:0/1900966183 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c140035b0 con 0x7f3c14003f80 2023-07-05T18:57:01.460 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:01.452+0000 7f3c2db87700 1 --2- 172.21.15.46:0/1900966183 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3c14003f80 0x7f3c14004850 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f3c18009b30 tx=0x7f3c14005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=771564e85ed3e71a server_cookie=0 in_seq=0 out_seq=0 2023-07-05T18:57:01.460 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:01.452+0000 7f3c2d386700 1 -- 172.21.15.46:0/1900966183 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c1800e6c0 con 0x7f3c14003f80 2023-07-05T18:57:01.461 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:01.452+0000 7f3c2d386700 1 -- 172.21.15.46:0/1900966183 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3c1800e820 con 0x7f3c14003f80 2023-07-05T18:57:01.461 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:01.452+0000 7f3c2d386700 1 -- 172.21.15.46:0/1900966183 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c1800eb90 con 0x7f3c14003f80 2023-07-05T18:57:01.461 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:01.453+0000 7f3c305ec700 1 -- 172.21.15.46:0/1900966183 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3c14003f80 msgr2=0x7f3c14004850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:57:01.461 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:01.453+0000 7f3c305ec700 1 --2- 172.21.15.46:0/1900966183 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3c14003f80 0x7f3c14004850 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f3c18009b30 tx=0x7f3c14005880 comp rx=0 tx=0).stop 2023-07-05T18:57:01.461 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:01.453+0000 7f3c2eb89700 1 -- 172.21.15.46:0/1900966183 reap_dead start 2023-07-05T18:57:01.462 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:01.453+0000 7f3c305ec700 1 -- 172.21.15.46:0/1900966183 shutdown_connections 2023-07-05T18:57:01.462 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:01.453+0000 7f3c305ec700 1 -- 172.21.15.46:0/1900966183 >> 172.21.15.46:0/1900966183 conn(0x7f3c280b0d50 msgr2=0x7f3c280b1150 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-05T18:57:01.462 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:01.453+0000 7f3c305ec700 1 -- 172.21.15.46:0/1900966183 shutdown_connections 2023-07-05T18:57:01.462 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:01.453+0000 7f3c305ec700 1 -- 172.21.15.46:0/1900966183 wait complete. 2023-07-05T18:57:01.464 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:01.454+0000 7f3c305ec700 1 Processor -- start 2023-07-05T18:57:01.464 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:01.454+0000 7f3c305ec700 1 -- start start 2023-07-05T18:57:01.465 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:01.455+0000 7f3c305ec700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3c14003f80 0x7f3c28147c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:57:01.465 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:01.455+0000 7f3c305ec700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f3c280cd830 0x7f3c2815a680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:57:01.465 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:01.455+0000 7f3c305ec700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3c280cdca0 0x7f3c2815abc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:57:01.465 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:01.455+0000 7f3c305ec700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c280acb00 con 0x7f3c14003f80 2023-07-05T18:57:01.465 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:01.455+0000 7f3c305ec700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c281f27d0 con 0x7f3c280cdca0 2023-07-05T18:57:01.465 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:01.455+0000 7f3c305ec700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3c281f2ab0 con 0x7f3c280cd830 2023-07-05T18:57:01.466 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:01.455+0000 7f3c2e388700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3c14003f80 0x7f3c28147c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:57:01.466 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:01.455+0000 7f3c2e388700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3c14003f80 0x7f3c28147c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:59430/0 (socket says 172.21.15.46:59430) 2023-07-05T18:57:01.466 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:01.455+0000 7f3c2e388700 1 -- 172.21.15.46:0/3075136839 learned_addr learned my addr 172.21.15.46:0/3075136839 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-07-05T18:57:01.466 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:01.455+0000 7f3c2db87700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f3c280cd830 0x7f3c2815a680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:57:01.466 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:01.455+0000 7f3c2eb89700 1 --2- 172.21.15.46:0/3075136839 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3c280cdca0 0x7f3c2815abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:57:01.466 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:01.455+0000 7f3c2e388700 1 -- 172.21.15.46:0/3075136839 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f3c280cd830 msgr2=0x7f3c2815a680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:57:01.466 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:01.455+0000 7f3c2e388700 1 --2- 172.21.15.46:0/3075136839 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f3c280cd830 0x7f3c2815a680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:57:01.467 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:01.455+0000 7f3c2e388700 1 -- 172.21.15.46:0/3075136839 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3c280cdca0 msgr2=0x7f3c2815abc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:57:01.467 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:01.455+0000 7f3c2e388700 1 --2- 172.21.15.46:0/3075136839 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3c280cdca0 0x7f3c2815abc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:57:01.467 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:01.455+0000 7f3c2e388700 1 -- 172.21.15.46:0/3075136839 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c280af740 con 0x7f3c14003f80 2023-07-05T18:57:01.467 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:01.455+0000 7f3c2e388700 1 --2- 172.21.15.46:0/3075136839 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3c14003f80 0x7f3c28147c00 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f3c24000c00 tx=0x7f3c240075f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-05T18:57:01.467 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:01.456+0000 7f3c1effd700 1 -- 172.21.15.46:0/3075136839 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c24011580 con 0x7f3c14003f80 2023-07-05T18:57:01.467 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:01.456+0000 7f3c1effd700 1 -- 172.21.15.46:0/3075136839 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3c240116e0 con 0x7f3c14003f80 2023-07-05T18:57:01.467 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:01.456+0000 7f3c1effd700 1 -- 172.21.15.46:0/3075136839 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c24011a90 con 0x7f3c14003f80 2023-07-05T18:57:01.467 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:01.456+0000 7f3c305ec700 1 -- 172.21.15.46:0/3075136839 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3c280afa20 con 0x7f3c14003f80 2023-07-05T18:57:01.468 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:01.456+0000 7f3c305ec700 1 -- 172.21.15.46:0/3075136839 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3c280af380 con 0x7f3c14003f80 2023-07-05T18:57:01.468 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:01.457+0000 7f3c305ec700 1 -- 172.21.15.46:0/3075136839 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3c280af5a0 con 0x7f3c14003f80 2023-07-05T18:57:01.468 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:01.457+0000 7f3c1effd700 1 -- 172.21.15.46:0/3075136839 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f3c24011bf0 con 0x7f3c14003f80 2023-07-05T18:57:01.468 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:01.457+0000 7f3c1effd700 1 --2- 172.21.15.46:0/3075136839 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7f3c0c06ace0 0x7f3c0c06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:57:01.468 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:01.458+0000 7f3c1effd700 1 -- 172.21.15.46:0/3075136839 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f3c240894b0 con 0x7f3c14003f80 2023-07-05T18:57:01.468 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:01.458+0000 7f3c2db87700 1 --2- 172.21.15.46:0/3075136839 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7f3c0c06ace0 0x7f3c0c06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:57:01.468 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:01.458+0000 7f3c2db87700 1 --2- 172.21.15.46:0/3075136839 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7f3c0c06ace0 0x7f3c0c06d190 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f3c180090b0 tx=0x7f3c1801f040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-05T18:57:01.468 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:01.462+0000 7f3c1effd700 1 -- 172.21.15.46:0/3075136839 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f3c280af5a0 con 0x7f3c14003f80 2023-07-05T18:57:01.710 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:01.705+0000 7f3c305ec700 1 -- 172.21.15.46:0/3075136839 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f3c280af5a0 con 0x7f3c14003f80 2023-07-05T18:57:01.711 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:01.706+0000 7f3c1effd700 1 -- 172.21.15.46:0/3075136839 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4656 (secure 0 0 0) 0x7f3c280af5a0 con 0x7f3c14003f80 2023-07-05T18:57:01.711 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T18:57:01.711 INFO:teuthology.orchestra.run.smithi046.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4247,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.73:6837/75231790","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6835","nonce":75231790},{"type":"v1","addr":"172.21.15.73:6837","nonce":75231790}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4284,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.46:6834/378741372","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6832","nonce":378741372},{"type":"v1","addr":"172.21.15.46:6834","nonce":378741372}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4287,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.46:6835/1674703862","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6833","nonce":1674703862},{"type":"v1","addr":"172.21.15.46:6835","nonce":1674703862}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-07-05T18:56:15.093940+0000","modified":"2023-07-05T18:56:18.225033+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4296},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4296":{"gid":4296,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.73:6836/2654190748","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6834","nonce":2654190748},{"type":"v1","addr":"172.21.15.73:6836","nonce":2654190748}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-07-05T18:57:01.712 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:01.708+0000 7f3c305ec700 1 -- 172.21.15.46:0/3075136839 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7f3c0c06ace0 msgr2=0x7f3c0c06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:57:01.712 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:01.708+0000 7f3c305ec700 1 --2- 172.21.15.46:0/3075136839 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7f3c0c06ace0 0x7f3c0c06d190 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f3c180090b0 tx=0x7f3c1801f040 comp rx=0 tx=0).stop 2023-07-05T18:57:01.712 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:01.708+0000 7f3c305ec700 1 -- 172.21.15.46:0/3075136839 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3c14003f80 msgr2=0x7f3c28147c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:57:01.713 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:01.708+0000 7f3c305ec700 1 --2- 172.21.15.46:0/3075136839 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3c14003f80 0x7f3c28147c00 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f3c24000c00 tx=0x7f3c240075f0 comp rx=0 tx=0).stop 2023-07-05T18:57:01.713 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:01.708+0000 7f3c305ec700 1 -- 172.21.15.46:0/3075136839 shutdown_connections 2023-07-05T18:57:01.713 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:01.708+0000 7f3c305ec700 1 --2- 172.21.15.46:0/3075136839 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7f3c0c06ace0 0x7f3c0c06d190 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:57:01.713 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:01.708+0000 7f3c305ec700 1 --2- 172.21.15.46:0/3075136839 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3c280cdca0 0x7f3c2815abc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:57:01.713 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:01.708+0000 7f3c305ec700 1 --2- 172.21.15.46:0/3075136839 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3c14003f80 0x7f3c28147c00 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:57:01.713 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:01.708+0000 7f3c305ec700 1 --2- 172.21.15.46:0/3075136839 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f3c280cd830 0x7f3c2815a680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:57:01.713 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:01.708+0000 7f3c305ec700 1 -- 172.21.15.46:0/3075136839 >> 172.21.15.46:0/3075136839 conn(0x7f3c280b0d50 msgr2=0x7f3c281569e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-05T18:57:01.714 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:01.708+0000 7f3c305ec700 1 -- 172.21.15.46:0/3075136839 shutdown_connections 2023-07-05T18:57:01.714 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:01.708+0000 7f3c305ec700 1 -- 172.21.15.46:0/3075136839 wait complete. 2023-07-05T18:57:01.714 INFO:teuthology.orchestra.run.smithi046.stderr:dumped fsmap epoch 8 2023-07-05T18:57:01.721 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-05T18:57:01.847 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:01.845+0000 7fae867ab700 1 Processor -- start 2023-07-05T18:57:01.847 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:01.846+0000 7fae867ab700 1 -- start start 2023-07-05T18:57:01.850 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:01.846+0000 7fae867ab700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fae8013f4c0 0x7fae8015d6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:57:01.850 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:01.846+0000 7fae867ab700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fae8006d140 0x7fae8006d5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:57:01.850 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:01.846+0000 7fae867ab700 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fae8015dbe0 con 0x7fae80142480 2023-07-05T18:57:01.850 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:01.846+0000 7fae867ab700 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fae8006ce90 con 0x7fae8006d140 2023-07-05T18:57:01.851 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:01.846+0000 7fae867ab700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fae8006db00 con 0x7fae8013f4c0 2023-07-05T18:57:01.851 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:01.847+0000 7fae7f7fe700 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7fae80142480 0x7fae800b41d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:58710/0 (socket says 172.21.15.46:58710) 2023-07-05T18:57:01.851 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:01.847+0000 7fae7f7fe700 1 -- 172.21.15.46:0/1681386620 learned_addr learned my addr 172.21.15.46:0/1681386620 (peer_addr_for_me v1:172.21.15.46:0/0) 2023-07-05T18:57:01.851 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:01.847+0000 7fae84d48700 1 --2- 172.21.15.46:0/1681386620 >> v2:172.21.15.73:3300/0 conn(0x7fae8006d140 0x7fae8006d5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:57:01.851 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:01.847+0000 7fae7ffff700 1 --2- 172.21.15.46:0/1681386620 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fae8013f4c0 0x7fae8015d6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:57:01.851 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:01.847+0000 7fae7effd700 1 -- 172.21.15.46:0/1681386620 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 630868639 0 0) 0x7fae8015dbe0 con 0x7fae80142480 2023-07-05T18:57:01.851 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:01.847+0000 7fae7effd700 1 -- 172.21.15.46:0/1681386620 --> v1:172.21.15.46:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fae680035b0 con 0x7fae80142480 2023-07-05T18:57:01.851 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:01.847+0000 7fae7effd700 1 -- 172.21.15.46:0/1681386620 <== mon.0 v1:172.21.15.46:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3633356255 0 0) 0x7fae680035b0 con 0x7fae80142480 2023-07-05T18:57:01.852 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:01.847+0000 7fae7effd700 1 -- 172.21.15.46:0/1681386620 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fae8013f4c0 msgr2=0x7fae8015d6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-05T18:57:01.852 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:01.847+0000 7fae7effd700 1 --2- 172.21.15.46:0/1681386620 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fae8013f4c0 0x7fae8015d6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:57:01.853 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:01.847+0000 7fae7effd700 1 -- 172.21.15.46:0/1681386620 >> v2:172.21.15.73:3300/0 conn(0x7fae8006d140 msgr2=0x7fae8006d5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-05T18:57:01.853 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:01.847+0000 7fae7effd700 1 --2- 172.21.15.46:0/1681386620 >> v2:172.21.15.73:3300/0 conn(0x7fae8006d140 0x7fae8006d5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:57:01.854 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:01.847+0000 7fae7effd700 1 -- 172.21.15.46:0/1681386620 --> v1:172.21.15.46:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae8006c8d0 con 0x7fae80142480 2023-07-05T18:57:01.854 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:01.847+0000 7fae7effd700 1 -- 172.21.15.46:0/1681386620 <== mon.0 v1:172.21.15.46:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2195585215 0 0) 0x7fae74001670 con 0x7fae80142480 2023-07-05T18:57:01.855 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:01.847+0000 7fae84d48700 1 --2- 172.21.15.46:0/1681386620 >> v2:172.21.15.73:3300/0 conn(0x7fae8006d140 0x7fae8006d5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-05T18:57:01.855 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:01.847+0000 7fae7effd700 1 -- 172.21.15.46:0/1681386620 >> v1:172.21.15.46:6789/0 conn(0x7fae80142480 legacy=0x7fae800b41d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:57:01.855 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:01.847+0000 7fae7effd700 1 --2- 172.21.15.46:0/1681386620 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fae8013f4c0 0x7fae68003a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:57:01.855 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:01.847+0000 7fae7effd700 1 --2- 172.21.15.46:0/1681386620 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fae68003f80 0x7fae68004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:57:01.856 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:01.847+0000 7fae7effd700 1 --2- 172.21.15.46:0/1681386620 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fae68004d90 0x7fae68005200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:57:01.856 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:01.847+0000 7fae7effd700 1 -- 172.21.15.46:0/1681386620 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae8006ce90 con 0x7fae68004d90 2023-07-05T18:57:01.857 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:01.847+0000 7fae7effd700 1 -- 172.21.15.46:0/1681386620 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae8006db00 con 0x7fae68003f80 2023-07-05T18:57:01.857 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:01.847+0000 7fae7effd700 1 -- 172.21.15.46:0/1681386620 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fae6800ba10 con 0x7fae8013f4c0 2023-07-05T18:57:01.857 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:01.847+0000 7fae84d48700 1 --2- 172.21.15.46:0/1681386620 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fae68004d90 0x7fae68005200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:57:01.858 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:01.847+0000 7fae7ffff700 1 --2- 172.21.15.46:0/1681386620 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fae8013f4c0 0x7fae68003a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:57:01.858 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:01.847+0000 7fae7f7fe700 1 --2- 172.21.15.46:0/1681386620 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fae68003f80 0x7fae68004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:57:01.858 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:01.848+0000 7fae84d48700 1 -- 172.21.15.46:0/1681386620 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fae8013f4c0 msgr2=0x7fae68003a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-05T18:57:01.859 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:01.848+0000 7fae84d48700 1 --2- 172.21.15.46:0/1681386620 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fae8013f4c0 0x7fae68003a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:57:01.859 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:01.848+0000 7fae84d48700 1 -- 172.21.15.46:0/1681386620 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fae68003f80 msgr2=0x7fae68004850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-05T18:57:01.859 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:01.848+0000 7fae84d48700 1 --2- 172.21.15.46:0/1681386620 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fae68003f80 0x7fae68004850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:57:01.859 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:01.848+0000 7fae84d48700 1 -- 172.21.15.46:0/1681386620 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae680035b0 con 0x7fae68004d90 2023-07-05T18:57:01.859 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:01.848+0000 7fae84d48700 1 --2- 172.21.15.46:0/1681386620 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fae68004d90 0x7fae68005200 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7fae78009da0 tx=0x7fae68005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2a008442e7d532c0 server_cookie=0 in_seq=0 out_seq=0 2023-07-05T18:57:01.860 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:01.848+0000 7fae7effd700 1 -- 172.21.15.46:0/1681386620 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae7800edc0 con 0x7fae68004d90 2023-07-05T18:57:01.860 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:01.848+0000 7fae7effd700 1 -- 172.21.15.46:0/1681386620 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fae7800f040 con 0x7fae68004d90 2023-07-05T18:57:01.860 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:01.848+0000 7fae7effd700 1 -- 172.21.15.46:0/1681386620 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae78012650 con 0x7fae68004d90 2023-07-05T18:57:01.861 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:01.848+0000 7fae867ab700 1 -- 172.21.15.46:0/1681386620 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fae68004d90 msgr2=0x7fae68005200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:57:01.861 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:01.848+0000 7fae867ab700 1 --2- 172.21.15.46:0/1681386620 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fae68004d90 0x7fae68005200 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7fae78009da0 tx=0x7fae68005880 comp rx=0 tx=0).stop 2023-07-05T18:57:01.861 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:01.848+0000 7fae84d48700 1 -- 172.21.15.46:0/1681386620 reap_dead start 2023-07-05T18:57:01.862 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:01.848+0000 7fae867ab700 1 -- 172.21.15.46:0/1681386620 shutdown_connections 2023-07-05T18:57:01.862 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:01.848+0000 7fae867ab700 1 -- 172.21.15.46:0/1681386620 >> 172.21.15.46:0/1681386620 conn(0x7fae8006af10 msgr2=0x7fae8006b2e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-05T18:57:01.862 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:01.849+0000 7fae867ab700 1 -- 172.21.15.46:0/1681386620 shutdown_connections 2023-07-05T18:57:01.863 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:01.849+0000 7fae867ab700 1 -- 172.21.15.46:0/1681386620 wait complete. 2023-07-05T18:57:01.866 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:01.850+0000 7fae867ab700 1 Processor -- start 2023-07-05T18:57:01.866 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:01.850+0000 7fae867ab700 1 -- start start 2023-07-05T18:57:01.867 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:01.851+0000 7fae867ab700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fae8013e390 0x7fae8015ab20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:57:01.867 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:01.851+0000 7fae867ab700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fae8013e760 0x7fae8015b060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:57:01.867 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:01.851+0000 7fae867ab700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fae801408e0 0x7fae80140d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:57:01.868 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:01.851+0000 7fae867ab700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae801f7150 con 0x7fae801408e0 2023-07-05T18:57:01.868 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:01.851+0000 7fae867ab700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae801f67b0 con 0x7fae8013e390 2023-07-05T18:57:01.868 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:01.851+0000 7fae867ab700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fae801f6a90 con 0x7fae8013e760 2023-07-05T18:57:01.868 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:01.851+0000 7fae84d48700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fae801408e0 0x7fae80140d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:57:01.869 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:01.851+0000 7fae84d48700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fae801408e0 0x7fae80140d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:59454/0 (socket says 172.21.15.46:59454) 2023-07-05T18:57:01.869 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:01.851+0000 7fae84d48700 1 -- 172.21.15.46:0/918820982 learned_addr learned my addr 172.21.15.46:0/918820982 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-07-05T18:57:01.869 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:01.851+0000 7fae7ffff700 1 --2- 172.21.15.46:0/918820982 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fae8013e390 0x7fae8015ab20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:57:01.869 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:01.851+0000 7fae7f7fe700 1 --2- 172.21.15.46:0/918820982 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fae8013e760 0x7fae8015b060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:57:01.869 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:01.851+0000 7fae84d48700 1 -- 172.21.15.46:0/918820982 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fae8013e760 msgr2=0x7fae8015b060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:57:01.869 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:01.851+0000 7fae84d48700 1 --2- 172.21.15.46:0/918820982 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fae8013e760 0x7fae8015b060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:57:01.869 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:01.851+0000 7fae84d48700 1 -- 172.21.15.46:0/918820982 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fae8013e390 msgr2=0x7fae8015ab20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:57:01.869 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:01.851+0000 7fae84d48700 1 --2- 172.21.15.46:0/918820982 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fae8013e390 0x7fae8015ab20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:57:01.870 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:01.851+0000 7fae84d48700 1 -- 172.21.15.46:0/918820982 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae801f6d70 con 0x7fae801408e0 2023-07-05T18:57:01.870 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:01.851+0000 7fae7ffff700 1 --2- 172.21.15.46:0/918820982 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fae8013e390 0x7fae8015ab20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-05T18:57:01.870 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:01.851+0000 7fae84d48700 1 --2- 172.21.15.46:0/918820982 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fae801408e0 0x7fae80140d60 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7fae680046d0 tx=0x7fae78009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-05T18:57:01.870 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:01.851+0000 7fae7cff9700 1 -- 172.21.15.46:0/918820982 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae78007000 con 0x7fae801408e0 2023-07-05T18:57:01.870 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:01.851+0000 7fae7cff9700 1 -- 172.21.15.46:0/918820982 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fae78009410 con 0x7fae801408e0 2023-07-05T18:57:01.870 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:01.851+0000 7fae7cff9700 1 -- 172.21.15.46:0/918820982 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae78003a20 con 0x7fae801408e0 2023-07-05T18:57:01.870 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:01.851+0000 7fae867ab700 1 -- 172.21.15.46:0/918820982 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fae801412a0 con 0x7fae801408e0 2023-07-05T18:57:01.871 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:01.852+0000 7fae867ab700 1 -- 172.21.15.46:0/918820982 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fae801f9a50 con 0x7fae801408e0 2023-07-05T18:57:01.871 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:01.852+0000 7fae867ab700 1 -- 172.21.15.46:0/918820982 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fae801f7290 con 0x7fae801408e0 2023-07-05T18:57:01.871 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:01.853+0000 7fae7cff9700 1 -- 172.21.15.46:0/918820982 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fae78003b80 con 0x7fae801408e0 2023-07-05T18:57:01.871 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:01.853+0000 7fae7cff9700 1 --2- 172.21.15.46:0/918820982 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7fae6c06ace0 0x7fae6c06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:57:01.871 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:01.853+0000 7fae7cff9700 1 -- 172.21.15.46:0/918820982 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fae78016070 con 0x7fae801408e0 2023-07-05T18:57:01.871 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:01.854+0000 7fae7ffff700 1 --2- 172.21.15.46:0/918820982 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7fae6c06ace0 0x7fae6c06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:57:01.871 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:01.854+0000 7fae7ffff700 1 --2- 172.21.15.46:0/918820982 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7fae6c06ace0 0x7fae6c06d190 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fae70009c60 tx=0x7fae70008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-05T18:57:01.871 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:01.858+0000 7fae7cff9700 1 -- 172.21.15.46:0/918820982 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fae801f7290 con 0x7fae801408e0 2023-07-05T18:57:02.059 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:02.058+0000 7fae867ab700 1 -- 172.21.15.46:0/918820982 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fae801f7290 con 0x7fae801408e0 2023-07-05T18:57:02.061 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:02.059+0000 7fae7cff9700 1 -- 172.21.15.46:0/918820982 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) v1 ==== 74+0+18161 (secure 0 0 0) 0x7fae801f7290 con 0x7fae801408e0 2023-07-05T18:57:02.061 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T18:57:02.062 INFO:teuthology.orchestra.run.smithi046.stdout:{"epoch":21,"fsid":"042652d3-d80c-4ad8-9366-3e94f2a0a512","created":"2023-07-05T18:55:56.455710+0000","modified":"2023-07-05T18:56:16.095672+0000","last_up_change":"2023-07-05T18:56:06.594022+0000","last_in_change":"2023-07-05T18:55:58.879340+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-07-05T18:56:07.729620+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2023-07-05T18:56:08.128122+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-07-05T18:56:12.954625+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-07-05T18:56:14.068396+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"20009183-9a47-4392-8751-883f88d2bfb1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6813","nonce":4151971443},{"type":"v1","addr":"172.21.15.46:6815","nonce":4151971443}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6817","nonce":4151971443},{"type":"v1","addr":"172.21.15.46:6818","nonce":4151971443}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6822","nonce":4151971443},{"type":"v1","addr":"172.21.15.46:6823","nonce":4151971443}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6820","nonce":4151971443},{"type":"v1","addr":"172.21.15.46:6821","nonce":4151971443}]},"public_addr":"172.21.15.46:6815/4151971443","cluster_addr":"172.21.15.46:6818/4151971443","heartbeat_back_addr":"172.21.15.46:6823/4151971443","heartbeat_front_addr":"172.21.15.46:6821/4151971443","state":["exists","up"]},{"osd":1,"uuid":"91b4a7b0-e4e4-4888-a1fe-9edb0d68004c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6808","nonce":502575881},{"type":"v1","addr":"172.21.15.46:6809","nonce":502575881}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6810","nonce":502575881},{"type":"v1","addr":"172.21.15.46:6811","nonce":502575881}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6816","nonce":502575881},{"type":"v1","addr":"172.21.15.46:6819","nonce":502575881}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6812","nonce":502575881},{"type":"v1","addr":"172.21.15.46:6814","nonce":502575881}]},"public_addr":"172.21.15.46:6809/502575881","cluster_addr":"172.21.15.46:6811/502575881","heartbeat_back_addr":"172.21.15.46:6819/502575881","heartbeat_front_addr":"172.21.15.46:6814/502575881","state":["exists","up"]},{"osd":2,"uuid":"669ff744-1331-47c5-8579-0440731c889a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6800","nonce":2115251461},{"type":"v1","addr":"172.21.15.46:6801","nonce":2115251461}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6802","nonce":2115251461},{"type":"v1","addr":"172.21.15.46:6803","nonce":2115251461}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6806","nonce":2115251461},{"type":"v1","addr":"172.21.15.46:6807","nonce":2115251461}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6804","nonce":2115251461},{"type":"v1","addr":"172.21.15.46:6805","nonce":2115251461}]},"public_addr":"172.21.15.46:6801/2115251461","cluster_addr":"172.21.15.46:6803/2115251461","heartbeat_back_addr":"172.21.15.46:6807/2115251461","heartbeat_front_addr":"172.21.15.46:6805/2115251461","state":["exists","up"]},{"osd":3,"uuid":"34e1b86d-ffad-415d-861c-07a5f08068a6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6824","nonce":2981388766},{"type":"v1","addr":"172.21.15.46:6825","nonce":2981388766}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6826","nonce":2981388766},{"type":"v1","addr":"172.21.15.46:6827","nonce":2981388766}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6830","nonce":2981388766},{"type":"v1","addr":"172.21.15.46:6831","nonce":2981388766}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6828","nonce":2981388766},{"type":"v1","addr":"172.21.15.46:6829","nonce":2981388766}]},"public_addr":"172.21.15.46:6825/2981388766","cluster_addr":"172.21.15.46:6827/2981388766","heartbeat_back_addr":"172.21.15.46:6831/2981388766","heartbeat_front_addr":"172.21.15.46:6829/2981388766","state":["exists","up"]},{"osd":4,"uuid":"57ffcb91-c7dc-4a69-ae71-4d9622a14a05","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6800","nonce":2083655348},{"type":"v1","addr":"172.21.15.73:6801","nonce":2083655348}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6802","nonce":2083655348},{"type":"v1","addr":"172.21.15.73:6803","nonce":2083655348}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6806","nonce":2083655348},{"type":"v1","addr":"172.21.15.73:6807","nonce":2083655348}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6804","nonce":2083655348},{"type":"v1","addr":"172.21.15.73:6805","nonce":2083655348}]},"public_addr":"172.21.15.73:6801/2083655348","cluster_addr":"172.21.15.73:6803/2083655348","heartbeat_back_addr":"172.21.15.73:6807/2083655348","heartbeat_front_addr":"172.21.15.73:6805/2083655348","state":["exists","up"]},{"osd":5,"uuid":"665f41c9-ee20-49cf-bf0e-fbe0c03d3aed","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6824","nonce":2803788401},{"type":"v1","addr":"172.21.15.73:6825","nonce":2803788401}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6826","nonce":2803788401},{"type":"v1","addr":"172.21.15.73:6827","nonce":2803788401}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6830","nonce":2803788401},{"type":"v1","addr":"172.21.15.73:6831","nonce":2803788401}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6828","nonce":2803788401},{"type":"v1","addr":"172.21.15.73:6829","nonce":2803788401}]},"public_addr":"172.21.15.73:6825/2803788401","cluster_addr":"172.21.15.73:6827/2803788401","heartbeat_back_addr":"172.21.15.73:6831/2803788401","heartbeat_front_addr":"172.21.15.73:6829/2803788401","state":["exists","up"]},{"osd":6,"uuid":"5790c6cc-bd56-4ce4-9a7c-0f0c3b59215c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6808","nonce":974108383},{"type":"v1","addr":"172.21.15.73:6809","nonce":974108383}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6810","nonce":974108383},{"type":"v1","addr":"172.21.15.73:6811","nonce":974108383}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6815","nonce":974108383},{"type":"v1","addr":"172.21.15.73:6817","nonce":974108383}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6812","nonce":974108383},{"type":"v1","addr":"172.21.15.73:6813","nonce":974108383}]},"public_addr":"172.21.15.73:6809/974108383","cluster_addr":"172.21.15.73:6811/974108383","heartbeat_back_addr":"172.21.15.73:6817/974108383","heartbeat_front_addr":"172.21.15.73:6813/974108383","state":["exists","up"]},{"osd":7,"uuid":"b66f4d2e-147e-4c9b-97dd-cbd59d33802e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6814","nonce":3772673248},{"type":"v1","addr":"172.21.15.73:6816","nonce":3772673248}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6818","nonce":3772673248},{"type":"v1","addr":"172.21.15.73:6819","nonce":3772673248}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6822","nonce":3772673248},{"type":"v1","addr":"172.21.15.73:6823","nonce":3772673248}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6820","nonce":3772673248},{"type":"v1","addr":"172.21.15.73:6821","nonce":3772673248}]},"public_addr":"172.21.15.73:6816/3772673248","cluster_addr":"172.21.15.73:6819/3772673248","heartbeat_back_addr":"172.21.15.73:6823/3772673248","heartbeat_front_addr":"172.21.15.73:6821/3772673248","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-05T18:56:04.115334+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-05T18:56:04.071250+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-05T18:56:04.044387+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-05T18:56:04.085389+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-05T18:56:04.090726+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-05T18:56:04.074529+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-05T18:56:04.058841+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-05T18:56:04.043054+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-05T18:57:02.063 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:02.061+0000 7fae867ab700 1 -- 172.21.15.46:0/918820982 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7fae6c06ace0 msgr2=0x7fae6c06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:57:02.063 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:02.061+0000 7fae867ab700 1 --2- 172.21.15.46:0/918820982 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7fae6c06ace0 0x7fae6c06d190 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fae70009c60 tx=0x7fae70008040 comp rx=0 tx=0).stop 2023-07-05T18:57:02.063 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:02.061+0000 7fae867ab700 1 -- 172.21.15.46:0/918820982 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fae801408e0 msgr2=0x7fae80140d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:57:02.063 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:02.061+0000 7fae867ab700 1 --2- 172.21.15.46:0/918820982 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fae801408e0 0x7fae80140d60 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7fae680046d0 tx=0x7fae78009750 comp rx=0 tx=0).stop 2023-07-05T18:57:02.063 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:02.061+0000 7fae867ab700 1 -- 172.21.15.46:0/918820982 shutdown_connections 2023-07-05T18:57:02.063 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:02.061+0000 7fae867ab700 1 --2- 172.21.15.46:0/918820982 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7fae6c06ace0 0x7fae6c06d190 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:57:02.064 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:02.061+0000 7fae867ab700 1 --2- 172.21.15.46:0/918820982 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fae801408e0 0x7fae80140d60 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:57:02.064 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:02.061+0000 7fae867ab700 1 --2- 172.21.15.46:0/918820982 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fae8013e390 0x7fae8015ab20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:57:02.065 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:02.061+0000 7fae867ab700 1 --2- 172.21.15.46:0/918820982 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fae8013e760 0x7fae8015b060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:57:02.065 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:02.061+0000 7fae867ab700 1 -- 172.21.15.46:0/918820982 >> 172.21.15.46:0/918820982 conn(0x7fae8006af10 msgr2=0x7fae8015d500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-05T18:57:02.066 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:02.061+0000 7fae867ab700 1 -- 172.21.15.46:0/918820982 shutdown_connections 2023-07-05T18:57:02.066 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:02.062+0000 7fae867ab700 1 -- 172.21.15.46:0/918820982 wait complete. 2023-07-05T18:57:02.075 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-07-05T18:57:02.076 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-05T18:57:02.201 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:02.200+0000 7f96f8101700 1 Processor -- start 2023-07-05T18:57:02.201 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:02.200+0000 7f96f8101700 1 -- start start 2023-07-05T18:57:02.202 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:02.201+0000 7f96f8101700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f96f014f8c0 0x7f96f00b29f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:57:02.202 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:02.201+0000 7f96f8101700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f96f006c5a0 0x7f96f015c5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:57:02.203 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:02.201+0000 7f96f8101700 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f96f00b2f30 con 0x7f96f0071a10 2023-07-05T18:57:02.203 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:02.201+0000 7f96f8101700 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f96f0072190 con 0x7f96f006c5a0 2023-07-05T18:57:02.203 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:02.201+0000 7f96f8101700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f96f0071eb0 con 0x7f96f014f8c0 2023-07-05T18:57:02.203 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:02.201+0000 7f96f669e700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f96f006c5a0 0x7f96f015c5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:57:02.203 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:02.201+0000 7f96f669e700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f96f006c5a0 0x7f96f015c5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:59462/0 (socket says 172.21.15.46:59462) 2023-07-05T18:57:02.203 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:02.201+0000 7f96f669e700 1 -- 172.21.15.46:0/1923304030 learned_addr learned my addr 172.21.15.46:0/1923304030 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-07-05T18:57:02.204 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:02.201+0000 7f96f5e9d700 1 --2- 172.21.15.46:0/1923304030 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f96f014f8c0 0x7f96f00b29f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:57:02.204 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:02.201+0000 7f96f669e700 1 -- 172.21.15.46:0/1923304030 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f96f014f8c0 msgr2=0x7f96f00b29f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-05T18:57:02.204 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:02.201+0000 7f96f669e700 1 --2- 172.21.15.46:0/1923304030 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f96f014f8c0 0x7f96f00b29f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:57:02.205 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:02.201+0000 7f96f669e700 1 -- 172.21.15.46:0/1923304030 >> v1:172.21.15.73:6789/0 conn(0x7f96f0071a10 legacy=0x7f96f006be90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:57:02.205 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:02.201+0000 7f96f669e700 1 -- 172.21.15.46:0/1923304030 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f96f006ff90 con 0x7f96f006c5a0 2023-07-05T18:57:02.205 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:02.201+0000 7f96f669e700 1 --2- 172.21.15.46:0/1923304030 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f96f006c5a0 0x7f96f015c5c0 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f96e8009e50 tx=0x7f96e800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7807db91b7a2f192 server_cookie=0 in_seq=0 out_seq=0 2023-07-05T18:57:02.205 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:02.201+0000 7f96f4e9b700 1 -- 172.21.15.46:0/1923304030 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96e800e070 con 0x7f96f006c5a0 2023-07-05T18:57:02.206 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:02.202+0000 7f96f4e9b700 1 -- 172.21.15.46:0/1923304030 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f96e800b910 con 0x7f96f006c5a0 2023-07-05T18:57:02.206 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:02.202+0000 7f96f4e9b700 1 -- 172.21.15.46:0/1923304030 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96e800bcc0 con 0x7f96f006c5a0 2023-07-05T18:57:02.208 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:02.202+0000 7f96f8101700 1 -- 172.21.15.46:0/1923304030 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f96f006c5a0 msgr2=0x7f96f015c5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:57:02.208 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:02.202+0000 7f96f8101700 1 --2- 172.21.15.46:0/1923304030 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f96f006c5a0 0x7f96f015c5c0 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f96e8009e50 tx=0x7f96e800b330 comp rx=0 tx=0).stop 2023-07-05T18:57:02.208 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:02.202+0000 7f96f8101700 1 -- 172.21.15.46:0/1923304030 shutdown_connections 2023-07-05T18:57:02.208 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:02.202+0000 7f96f8101700 1 --2- 172.21.15.46:0/1923304030 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f96f014f8c0 0x7f96f00b29f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:57:02.208 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:02.202+0000 7f96f8101700 1 --2- 172.21.15.46:0/1923304030 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f96f006c5a0 0x7f96f015c5c0 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:57:02.209 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:02.202+0000 7f96f8101700 1 -- 172.21.15.46:0/1923304030 >> 172.21.15.46:0/1923304030 conn(0x7f96f00b0d50 msgr2=0x7f96f00b1150 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-05T18:57:02.209 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:02.202+0000 7f96f8101700 1 -- 172.21.15.46:0/1923304030 shutdown_connections 2023-07-05T18:57:02.209 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:02.202+0000 7f96f8101700 1 -- 172.21.15.46:0/1923304030 wait complete. 2023-07-05T18:57:02.209 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:02.203+0000 7f96f8101700 1 Processor -- start 2023-07-05T18:57:02.209 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:02.203+0000 7f96f8101700 1 -- start start 2023-07-05T18:57:02.209 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:02.204+0000 7f96f8101700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f96f006c5a0 0x7f96f00cd570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:57:02.209 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:02.204+0000 7f96f8101700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f96f0071a10 0x7f96f01f51b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:57:02.210 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:02.204+0000 7f96f8101700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f96f014f8c0 0x7f96f0146830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:57:02.210 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:02.204+0000 7f96f8101700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96f01f56f0 con 0x7f96f006c5a0 2023-07-05T18:57:02.210 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:02.204+0000 7f96f8101700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96f014fec0 con 0x7f96f014f8c0 2023-07-05T18:57:02.210 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:02.204+0000 7f96f8101700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f96f01f5900 con 0x7f96f0071a10 2023-07-05T18:57:02.210 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:02.204+0000 7f96f5e9d700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f96f006c5a0 0x7f96f00cd570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:57:02.210 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:02.204+0000 7f96f5e9d700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f96f006c5a0 0x7f96f00cd570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:59464/0 (socket says 172.21.15.46:59464) 2023-07-05T18:57:02.210 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:02.204+0000 7f96f5e9d700 1 -- 172.21.15.46:0/2227845003 learned_addr learned my addr 172.21.15.46:0/2227845003 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-07-05T18:57:02.210 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:02.204+0000 7f96f669e700 1 --2- 172.21.15.46:0/2227845003 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f96f014f8c0 0x7f96f0146830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:57:02.211 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:02.204+0000 7f96f569c700 1 --2- 172.21.15.46:0/2227845003 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f96f0071a10 0x7f96f01f51b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:57:02.211 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:02.205+0000 7f96f5e9d700 1 -- 172.21.15.46:0/2227845003 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f96f0071a10 msgr2=0x7f96f01f51b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:57:02.211 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:02.205+0000 7f96f5e9d700 1 --2- 172.21.15.46:0/2227845003 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f96f0071a10 0x7f96f01f51b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:57:02.211 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:02.205+0000 7f96f5e9d700 1 -- 172.21.15.46:0/2227845003 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f96f014f8c0 msgr2=0x7f96f0146830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:57:02.211 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:02.205+0000 7f96f5e9d700 1 --2- 172.21.15.46:0/2227845003 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f96f014f8c0 0x7f96f0146830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:57:02.211 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:02.205+0000 7f96f5e9d700 1 -- 172.21.15.46:0/2227845003 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f96e8009b30 con 0x7f96f006c5a0 2023-07-05T18:57:02.211 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:02.205+0000 7f96f5e9d700 1 --2- 172.21.15.46:0/2227845003 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f96f006c5a0 0x7f96f00cd570 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f96ec00e870 tx=0x7f96ec00eb80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-05T18:57:02.212 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:02.205+0000 7f96e67fc700 1 -- 172.21.15.46:0/2227845003 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96ec009590 con 0x7f96f006c5a0 2023-07-05T18:57:02.212 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:02.205+0000 7f96e67fc700 1 -- 172.21.15.46:0/2227845003 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f96ec013680 con 0x7f96f006c5a0 2023-07-05T18:57:02.212 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:02.205+0000 7f96e67fc700 1 -- 172.21.15.46:0/2227845003 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96ec0139f0 con 0x7f96f006c5a0 2023-07-05T18:57:02.212 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:02.205+0000 7f96f8101700 1 -- 172.21.15.46:0/2227845003 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f96f01f5be0 con 0x7f96f006c5a0 2023-07-05T18:57:02.212 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:02.205+0000 7f96f8101700 1 -- 172.21.15.46:0/2227845003 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f96f0146d70 con 0x7f96f006c5a0 2023-07-05T18:57:02.212 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:02.206+0000 7f96f8101700 1 -- 172.21.15.46:0/2227845003 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f96f01501a0 con 0x7f96f006c5a0 2023-07-05T18:57:02.212 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:02.207+0000 7f96e67fc700 1 -- 172.21.15.46:0/2227845003 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f96ec013b50 con 0x7f96f006c5a0 2023-07-05T18:57:02.213 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:02.207+0000 7f96e67fc700 1 --2- 172.21.15.46:0/2227845003 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7f96d406ace0 0x7f96d406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:57:02.213 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:02.207+0000 7f96e67fc700 1 -- 172.21.15.46:0/2227845003 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f96ec0892f0 con 0x7f96f006c5a0 2023-07-05T18:57:02.213 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:02.207+0000 7f96f569c700 1 --2- 172.21.15.46:0/2227845003 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7f96d406ace0 0x7f96d406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:57:02.213 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:02.208+0000 7f96f569c700 1 --2- 172.21.15.46:0/2227845003 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7f96d406ace0 0x7f96d406d190 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f96f00ced30 tx=0x7f96e0009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-05T18:57:02.214 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:02.211+0000 7f96e67fc700 1 -- 172.21.15.46:0/2227845003 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f96ec057e30 con 0x7f96f006c5a0 2023-07-05T18:57:02.456 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:02.455+0000 7f96f8101700 1 -- 172.21.15.46:0/2227845003 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f96f01f6100 con 0x7f96f006c5a0 2023-07-05T18:57:02.457 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:02.456+0000 7f96e67fc700 1 -- 172.21.15.46:0/2227845003 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4656 (secure 0 0 0) 0x7f96f01f6100 con 0x7f96f006c5a0 2023-07-05T18:57:02.457 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T18:57:02.457 INFO:teuthology.orchestra.run.smithi046.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4247,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.73:6837/75231790","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6835","nonce":75231790},{"type":"v1","addr":"172.21.15.73:6837","nonce":75231790}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4284,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.46:6834/378741372","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6832","nonce":378741372},{"type":"v1","addr":"172.21.15.46:6834","nonce":378741372}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4287,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.46:6835/1674703862","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6833","nonce":1674703862},{"type":"v1","addr":"172.21.15.46:6835","nonce":1674703862}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-07-05T18:56:15.093940+0000","modified":"2023-07-05T18:56:18.225033+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4296},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4296":{"gid":4296,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.73:6836/2654190748","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6834","nonce":2654190748},{"type":"v1","addr":"172.21.15.73:6836","nonce":2654190748}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-07-05T18:57:02.459 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:02.458+0000 7f96f8101700 1 -- 172.21.15.46:0/2227845003 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7f96d406ace0 msgr2=0x7f96d406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:57:02.459 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:02.458+0000 7f96f8101700 1 --2- 172.21.15.46:0/2227845003 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7f96d406ace0 0x7f96d406d190 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f96f00ced30 tx=0x7f96e0009040 comp rx=0 tx=0).stop 2023-07-05T18:57:02.459 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:02.458+0000 7f96f8101700 1 -- 172.21.15.46:0/2227845003 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f96f006c5a0 msgr2=0x7f96f00cd570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:57:02.459 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:02.458+0000 7f96f8101700 1 --2- 172.21.15.46:0/2227845003 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f96f006c5a0 0x7f96f00cd570 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f96ec00e870 tx=0x7f96ec00eb80 comp rx=0 tx=0).stop 2023-07-05T18:57:02.459 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:02.458+0000 7f96f8101700 1 -- 172.21.15.46:0/2227845003 shutdown_connections 2023-07-05T18:57:02.460 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:02.458+0000 7f96f8101700 1 --2- 172.21.15.46:0/2227845003 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7f96d406ace0 0x7f96d406d190 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:57:02.460 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:02.458+0000 7f96f8101700 1 --2- 172.21.15.46:0/2227845003 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f96f014f8c0 0x7f96f0146830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:57:02.460 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:02.458+0000 7f96f8101700 1 --2- 172.21.15.46:0/2227845003 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f96f006c5a0 0x7f96f00cd570 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:57:02.460 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:02.458+0000 7f96f8101700 1 --2- 172.21.15.46:0/2227845003 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f96f0071a10 0x7f96f01f51b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:57:02.461 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:02.458+0000 7f96f8101700 1 -- 172.21.15.46:0/2227845003 >> 172.21.15.46:0/2227845003 conn(0x7f96f00b0d50 msgr2=0x7f96f01e0fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-05T18:57:02.462 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:02.458+0000 7f96f8101700 1 -- 172.21.15.46:0/2227845003 shutdown_connections 2023-07-05T18:57:02.462 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:02.458+0000 7f96f8101700 1 -- 172.21.15.46:0/2227845003 wait complete. 2023-07-05T18:57:02.462 INFO:teuthology.orchestra.run.smithi046.stderr:dumped fsmap epoch 8 2023-07-05T18:57:02.471 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-05T18:57:02.600 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:02.599+0000 7f777369d700 1 Processor -- start 2023-07-05T18:57:02.600 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:02.599+0000 7f777369d700 1 -- start start 2023-07-05T18:57:02.602 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:02.600+0000 7f777369d700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f776c15c630 0x7f776c06d8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:57:02.602 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:02.600+0000 7f777369d700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f776c160120 0x7f776c160570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:57:02.602 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:02.600+0000 7f777369d700 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f776c070a80 con 0x7f776c0b17b0 2023-07-05T18:57:02.602 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:02.600+0000 7f777369d700 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f776c15ca00 con 0x7f776c15c630 2023-07-05T18:57:02.602 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:02.600+0000 7f777369d700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f776c160fc0 con 0x7f776c160120 2023-07-05T18:57:02.602 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:02.600+0000 7f7771439700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f776c15c630 0x7f776c06d8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:57:02.603 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:02.600+0000 7f7770c38700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f776c160120 0x7f776c160570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:57:02.603 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:02.600+0000 7f7771c3a700 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7f776c0b17b0 0x7f776c0ce6c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.46:44664/0 (socket says 172.21.15.46:44664) 2023-07-05T18:57:02.603 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:02.600+0000 7f7771c3a700 1 -- 172.21.15.46:0/2597453557 learned_addr learned my addr 172.21.15.46:0/2597453557 (peer_addr_for_me v1:172.21.15.46:0/0) 2023-07-05T18:57:02.603 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:02.600+0000 7f7763fff700 1 -- 172.21.15.46:0/2597453557 <== mon.1 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2609805305 0 0) 0x7f776c070a80 con 0x7f776c0b17b0 2023-07-05T18:57:02.603 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:02.600+0000 7f7763fff700 1 -- 172.21.15.46:0/2597453557 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f77580035b0 con 0x7f776c0b17b0 2023-07-05T18:57:02.603 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:02.600+0000 7f7770c38700 1 -- 172.21.15.46:0/2597453557 >> v2:172.21.15.73:3300/0 conn(0x7f776c15c630 msgr2=0x7f776c06d8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-05T18:57:02.604 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:02.600+0000 7f7770c38700 1 --2- 172.21.15.46:0/2597453557 >> v2:172.21.15.73:3300/0 conn(0x7f776c15c630 0x7f776c06d8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:57:02.604 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:02.600+0000 7f7770c38700 1 -- 172.21.15.46:0/2597453557 >> v1:172.21.15.73:6789/0 conn(0x7f776c0b17b0 legacy=0x7f776c0ce6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:57:02.604 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:02.600+0000 7f7770c38700 1 -- 172.21.15.46:0/2597453557 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f776c160ab0 con 0x7f776c160120 2023-07-05T18:57:02.604 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:02.600+0000 7f7771439700 1 --2- 172.21.15.46:0/2597453557 >> v2:172.21.15.73:3300/0 conn(0x7f776c15c630 0x7f776c06d8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-05T18:57:02.605 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:02.601+0000 7f7770c38700 1 --2- 172.21.15.46:0/2597453557 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f776c160120 0x7f776c160570 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f775c009840 tx=0x7f775c009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4bbd2dec33305e81 server_cookie=0 in_seq=0 out_seq=0 2023-07-05T18:57:02.605 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:02.601+0000 7f7763fff700 1 -- 172.21.15.46:0/2597453557 <== mon.2 v2:172.21.15.73:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f775c011830 con 0x7f776c160120 2023-07-05T18:57:02.605 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:02.601+0000 7f7763fff700 1 -- 172.21.15.46:0/2597453557 <== mon.2 v2:172.21.15.73:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f775c011990 con 0x7f776c160120 2023-07-05T18:57:02.605 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:02.601+0000 7f7763fff700 1 -- 172.21.15.46:0/2597453557 <== mon.2 v2:172.21.15.73:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f775c011d20 con 0x7f776c160120 2023-07-05T18:57:02.608 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:02.601+0000 7f777369d700 1 -- 172.21.15.46:0/2597453557 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f776c160120 msgr2=0x7f776c160570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:57:02.609 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:02.601+0000 7f777369d700 1 --2- 172.21.15.46:0/2597453557 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f776c160120 0x7f776c160570 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f775c009840 tx=0x7f775c009b50 comp rx=0 tx=0).stop 2023-07-05T18:57:02.609 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:02.601+0000 7f777369d700 1 -- 172.21.15.46:0/2597453557 shutdown_connections 2023-07-05T18:57:02.609 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:02.601+0000 7f777369d700 1 --2- 172.21.15.46:0/2597453557 >> v2:172.21.15.73:3300/0 conn(0x7f776c15c630 0x7f776c06d8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:57:02.609 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:02.601+0000 7f777369d700 1 --2- 172.21.15.46:0/2597453557 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f776c160120 0x7f776c160570 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:57:02.609 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:02.601+0000 7f777369d700 1 -- 172.21.15.46:0/2597453557 >> 172.21.15.46:0/2597453557 conn(0x7f776c06af10 msgr2=0x7f776c06b310 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-05T18:57:02.609 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:02.601+0000 7f777369d700 1 -- 172.21.15.46:0/2597453557 shutdown_connections 2023-07-05T18:57:02.609 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:02.601+0000 7f777369d700 1 -- 172.21.15.46:0/2597453557 wait complete. 2023-07-05T18:57:02.610 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:02.603+0000 7f777369d700 1 Processor -- start 2023-07-05T18:57:02.610 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:02.603+0000 7f777369d700 1 -- start start 2023-07-05T18:57:02.610 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:02.603+0000 7f777369d700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f776c0b17b0 0x7f776c0aceb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:57:02.610 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:02.603+0000 7f777369d700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f776c15c630 0x7f776c0cca50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:57:02.610 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:02.603+0000 7f777369d700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f776c160120 0x7f776c0ccf90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:57:02.610 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:02.603+0000 7f777369d700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f776c15f0a0 con 0x7f776c0b17b0 2023-07-05T18:57:02.610 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:02.603+0000 7f777369d700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f776c15f380 con 0x7f776c15c630 2023-07-05T18:57:02.611 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:02.603+0000 7f777369d700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f776c15f660 con 0x7f776c160120 2023-07-05T18:57:02.611 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:02.603+0000 7f7771439700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f776c0b17b0 0x7f776c0aceb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:57:02.611 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:02.604+0000 7f7771439700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f776c0b17b0 0x7f776c0aceb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:59478/0 (socket says 172.21.15.46:59478) 2023-07-05T18:57:02.611 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:02.604+0000 7f7771439700 1 -- 172.21.15.46:0/3198763389 learned_addr learned my addr 172.21.15.46:0/3198763389 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-07-05T18:57:02.611 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:02.604+0000 7f7771c3a700 1 --2- 172.21.15.46:0/3198763389 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f776c160120 0x7f776c0ccf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:57:02.611 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:02.604+0000 7f7770c38700 1 --2- 172.21.15.46:0/3198763389 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f776c15c630 0x7f776c0cca50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:57:02.611 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:02.604+0000 7f7771439700 1 -- 172.21.15.46:0/3198763389 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f776c160120 msgr2=0x7f776c0ccf90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:57:02.612 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:02.604+0000 7f7771439700 1 --2- 172.21.15.46:0/3198763389 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f776c160120 0x7f776c0ccf90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:57:02.612 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:02.604+0000 7f7771439700 1 -- 172.21.15.46:0/3198763389 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f776c15c630 msgr2=0x7f776c0cca50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:57:02.612 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:02.604+0000 7f7771439700 1 --2- 172.21.15.46:0/3198763389 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f776c15c630 0x7f776c0cca50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:57:02.617 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:02.604+0000 7f7771439700 1 -- 172.21.15.46:0/3198763389 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f77680094a0 con 0x7f776c0b17b0 2023-07-05T18:57:02.617 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:02.604+0000 7f7771439700 1 --2- 172.21.15.46:0/3198763389 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f776c0b17b0 0x7f776c0aceb0 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f776800ebe0 tx=0x7f776800eef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-05T18:57:02.618 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:02.604+0000 7f7761ffb700 1 -- 172.21.15.46:0/3198763389 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f776800c850 con 0x7f776c0b17b0 2023-07-05T18:57:02.618 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:02.604+0000 7f7761ffb700 1 -- 172.21.15.46:0/3198763389 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f776800c9b0 con 0x7f776c0b17b0 2023-07-05T18:57:02.618 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:02.604+0000 7f7761ffb700 1 -- 172.21.15.46:0/3198763389 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f776800cd40 con 0x7f776c0b17b0 2023-07-05T18:57:02.619 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:02.604+0000 7f777369d700 1 -- 172.21.15.46:0/3198763389 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f775c0094a0 con 0x7f776c0b17b0 2023-07-05T18:57:02.619 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:02.604+0000 7f777369d700 1 -- 172.21.15.46:0/3198763389 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f776c15fc20 con 0x7f776c0b17b0 2023-07-05T18:57:02.619 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:02.605+0000 7f777369d700 1 -- 172.21.15.46:0/3198763389 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f776c0672e0 con 0x7f776c0b17b0 2023-07-05T18:57:02.619 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:02.606+0000 7f7761ffb700 1 -- 172.21.15.46:0/3198763389 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f7768013470 con 0x7f776c0b17b0 2023-07-05T18:57:02.620 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:02.606+0000 7f7761ffb700 1 --2- 172.21.15.46:0/3198763389 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7f775006ace0 0x7f775006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:57:02.620 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:02.606+0000 7f7761ffb700 1 -- 172.21.15.46:0/3198763389 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6120+0+0 (secure 0 0 0) 0x7f77680895f0 con 0x7f776c0b17b0 2023-07-05T18:57:02.620 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:02.606+0000 7f7770c38700 1 --2- 172.21.15.46:0/3198763389 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7f775006ace0 0x7f775006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:57:02.621 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:02.607+0000 7f7770c38700 1 --2- 172.21.15.46:0/3198763389 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7f775006ace0 0x7f775006d190 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f775c000c00 tx=0x7f775c01c040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-05T18:57:02.621 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:02.611+0000 7f7761ffb700 1 -- 172.21.15.46:0/3198763389 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f77680545e0 con 0x7f776c0b17b0 2023-07-05T18:57:02.856 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:02.855+0000 7f777369d700 1 -- 172.21.15.46:0/3198763389 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f776c0d0500 con 0x7f776c0b17b0 2023-07-05T18:57:02.857 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:02.855+0000 7f7761ffb700 1 -- 172.21.15.46:0/3198763389 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4656 (secure 0 0 0) 0x7f776800cea0 con 0x7f776c0b17b0 2023-07-05T18:57:02.857 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T18:57:02.857 INFO:teuthology.orchestra.run.smithi046.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4247,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.73:6837/75231790","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6835","nonce":75231790},{"type":"v1","addr":"172.21.15.73:6837","nonce":75231790}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4284,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.46:6834/378741372","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6832","nonce":378741372},{"type":"v1","addr":"172.21.15.46:6834","nonce":378741372}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4287,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.46:6835/1674703862","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6833","nonce":1674703862},{"type":"v1","addr":"172.21.15.46:6835","nonce":1674703862}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-07-05T18:56:15.093940+0000","modified":"2023-07-05T18:56:18.225033+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4296},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4296":{"gid":4296,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.73:6836/2654190748","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6834","nonce":2654190748},{"type":"v1","addr":"172.21.15.73:6836","nonce":2654190748}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-07-05T18:57:02.859 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:02.857+0000 7f777369d700 1 -- 172.21.15.46:0/3198763389 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7f775006ace0 msgr2=0x7f775006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:57:02.859 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:02.857+0000 7f777369d700 1 --2- 172.21.15.46:0/3198763389 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7f775006ace0 0x7f775006d190 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f775c000c00 tx=0x7f775c01c040 comp rx=0 tx=0).stop 2023-07-05T18:57:02.859 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:02.857+0000 7f777369d700 1 -- 172.21.15.46:0/3198763389 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f776c0b17b0 msgr2=0x7f776c0aceb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:57:02.859 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:02.857+0000 7f777369d700 1 --2- 172.21.15.46:0/3198763389 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f776c0b17b0 0x7f776c0aceb0 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f776800ebe0 tx=0x7f776800eef0 comp rx=0 tx=0).stop 2023-07-05T18:57:02.859 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:02.857+0000 7f777369d700 1 -- 172.21.15.46:0/3198763389 shutdown_connections 2023-07-05T18:57:02.860 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:02.857+0000 7f777369d700 1 --2- 172.21.15.46:0/3198763389 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7f775006ace0 0x7f775006d190 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:57:02.860 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:02.857+0000 7f777369d700 1 --2- 172.21.15.46:0/3198763389 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f776c160120 0x7f776c0ccf90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:57:02.860 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:02.857+0000 7f777369d700 1 --2- 172.21.15.46:0/3198763389 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f776c0b17b0 0x7f776c0aceb0 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:57:02.860 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:02.857+0000 7f777369d700 1 --2- 172.21.15.46:0/3198763389 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f776c15c630 0x7f776c0cca50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:57:02.860 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:02.857+0000 7f777369d700 1 -- 172.21.15.46:0/3198763389 >> 172.21.15.46:0/3198763389 conn(0x7f776c06af10 msgr2=0x7f776c0b0500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-05T18:57:02.862 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:02.858+0000 7f777369d700 1 -- 172.21.15.46:0/3198763389 shutdown_connections 2023-07-05T18:57:02.862 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:02.858+0000 7f777369d700 1 -- 172.21.15.46:0/3198763389 wait complete. 2023-07-05T18:57:02.863 INFO:teuthology.orchestra.run.smithi046.stderr:dumped fsmap epoch 8 2023-07-05T18:57:02.872 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-05T18:57:02.998 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:02.997+0000 7f70eb5d5700 1 Processor -- start 2023-07-05T18:57:02.998 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:02.997+0000 7f70eb5d5700 1 -- start start 2023-07-05T18:57:02.999 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:02.998+0000 7f70eb5d5700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f70e40aef40 0x7f70e40b3530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:57:03.000 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:02.998+0000 7f70eb5d5700 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f70e40b30a0 con 0x7f70e415d190 2023-07-05T18:57:03.000 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:02.998+0000 7f70eb5d5700 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f70e406ca80 con 0x7f70e4069e00 2023-07-05T18:57:03.000 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:02.998+0000 7f70eb5d5700 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f70e415d940 con 0x7f70e40aef40 2023-07-05T18:57:03.000 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:02.998+0000 7f70e9371700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f70e40aef40 0x7f70e40b3530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:57:03.000 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:02.998+0000 7f70e9b72700 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7f70e415d190 0x7f70e4152c10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:58762/0 (socket says 172.21.15.46:58762) 2023-07-05T18:57:03.000 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:02.998+0000 7f70e9b72700 1 -- 172.21.15.46:0/2377890817 learned_addr learned my addr 172.21.15.46:0/2377890817 (peer_addr_for_me v1:172.21.15.46:0/0) 2023-07-05T18:57:03.000 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:02.999+0000 7f70e9371700 1 -- 172.21.15.46:0/2377890817 >> v1:172.21.15.73:6789/0 conn(0x7f70e4069e00 legacy=0x7f70e415ca80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:57:03.001 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:02.999+0000 7f70e9371700 1 -- 172.21.15.46:0/2377890817 >> v1:172.21.15.46:6789/0 conn(0x7f70e415d190 legacy=0x7f70e4152c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:57:03.001 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:02.999+0000 7f70e9371700 1 -- 172.21.15.46:0/2377890817 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f70e415d660 con 0x7f70e40aef40 2023-07-05T18:57:03.001 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:02.999+0000 7f70dbfff700 1 -- 172.21.15.46:0/2377890817 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 150386510 0 0) 0x7f70e40b30a0 con 0x7f70e415d190 2023-07-05T18:57:03.002 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:02.999+0000 7f70e9371700 1 --2- 172.21.15.46:0/2377890817 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f70e40aef40 0x7f70e40b3530 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f70d4009840 tx=0x7f70d4009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dec272f8e50e1bf6 server_cookie=0 in_seq=0 out_seq=0 2023-07-05T18:57:03.002 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:02.999+0000 7f70dbfff700 1 -- 172.21.15.46:0/2377890817 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70d4011830 con 0x7f70e40aef40 2023-07-05T18:57:03.002 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:02.999+0000 7f70dbfff700 1 -- 172.21.15.46:0/2377890817 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f70d4011990 con 0x7f70e40aef40 2023-07-05T18:57:03.002 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:02.999+0000 7f70dbfff700 1 -- 172.21.15.46:0/2377890817 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70d4011d20 con 0x7f70e40aef40 2023-07-05T18:57:03.003 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:03.000+0000 7f70eb5d5700 1 -- 172.21.15.46:0/2377890817 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f70e40aef40 msgr2=0x7f70e40b3530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:57:03.003 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:03.000+0000 7f70eb5d5700 1 --2- 172.21.15.46:0/2377890817 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f70e40aef40 0x7f70e40b3530 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f70d4009840 tx=0x7f70d4009b50 comp rx=0 tx=0).stop 2023-07-05T18:57:03.003 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:03.000+0000 7f70eb5d5700 1 -- 172.21.15.46:0/2377890817 shutdown_connections 2023-07-05T18:57:03.003 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:03.000+0000 7f70eb5d5700 1 --2- 172.21.15.46:0/2377890817 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f70e40aef40 0x7f70e40b3530 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:57:03.003 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:03.000+0000 7f70eb5d5700 1 -- 172.21.15.46:0/2377890817 >> 172.21.15.46:0/2377890817 conn(0x7f70e406af10 msgr2=0x7f70e406b2e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-05T18:57:03.003 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:03.000+0000 7f70eb5d5700 1 -- 172.21.15.46:0/2377890817 shutdown_connections 2023-07-05T18:57:03.003 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:03.000+0000 7f70eb5d5700 1 -- 172.21.15.46:0/2377890817 wait complete. 2023-07-05T18:57:03.004 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:03.001+0000 7f70eb5d5700 1 Processor -- start 2023-07-05T18:57:03.004 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:03.001+0000 7f70eb5d5700 1 -- start start 2023-07-05T18:57:03.006 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:03.002+0000 7f70eb5d5700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f70e4069e00 0x7f70e4145db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:57:03.006 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:03.002+0000 7f70eb5d5700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f70e40aef40 0x7f70e415bd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:57:03.006 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:03.002+0000 7f70eb5d5700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f70e415d190 0x7f70e41486b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:57:03.006 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:03.002+0000 7f70eb5d5700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70e41462f0 con 0x7f70e40aef40 2023-07-05T18:57:03.006 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:03.002+0000 7f70eb5d5700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70e40cf1a0 con 0x7f70e415d190 2023-07-05T18:57:03.007 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:03.002+0000 7f70eb5d5700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f70e40cf480 con 0x7f70e4069e00 2023-07-05T18:57:03.007 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:03.003+0000 7f70e8b70700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f70e40aef40 0x7f70e415bd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:57:03.007 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:03.003+0000 7f70e8b70700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f70e40aef40 0x7f70e415bd30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:59494/0 (socket says 172.21.15.46:59494) 2023-07-05T18:57:03.007 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:03.003+0000 7f70e8b70700 1 -- 172.21.15.46:0/2985568920 learned_addr learned my addr 172.21.15.46:0/2985568920 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-07-05T18:57:03.007 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:03.003+0000 7f70e9371700 1 --2- 172.21.15.46:0/2985568920 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f70e4069e00 0x7f70e4145db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:57:03.007 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:03.003+0000 7f70e9b72700 1 --2- 172.21.15.46:0/2985568920 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f70e415d190 0x7f70e41486b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:57:03.007 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:03.003+0000 7f70e8b70700 1 -- 172.21.15.46:0/2985568920 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f70e4069e00 msgr2=0x7f70e4145db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:57:03.007 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:03.003+0000 7f70e8b70700 1 --2- 172.21.15.46:0/2985568920 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f70e4069e00 0x7f70e4145db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:57:03.008 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:03.003+0000 7f70e8b70700 1 -- 172.21.15.46:0/2985568920 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f70e415d190 msgr2=0x7f70e41486b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:57:03.008 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:03.003+0000 7f70e8b70700 1 --2- 172.21.15.46:0/2985568920 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f70e415d190 0x7f70e41486b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:57:03.008 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:03.003+0000 7f70e8b70700 1 -- 172.21.15.46:0/2985568920 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f70d40094a0 con 0x7f70e40aef40 2023-07-05T18:57:03.008 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:03.003+0000 7f70e9371700 1 --2- 172.21.15.46:0/2985568920 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f70e4069e00 0x7f70e4145db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-05T18:57:03.008 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:03.003+0000 7f70e8b70700 1 --2- 172.21.15.46:0/2985568920 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f70e40aef40 0x7f70e415bd30 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f70e000c4e0 tx=0x7f70e000c8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-05T18:57:03.008 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:03.003+0000 7f70d9ffb700 1 -- 172.21.15.46:0/2985568920 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70e00052d0 con 0x7f70e40aef40 2023-07-05T18:57:03.008 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:03.003+0000 7f70d9ffb700 1 -- 172.21.15.46:0/2985568920 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f70e0005430 con 0x7f70e40aef40 2023-07-05T18:57:03.009 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:03.003+0000 7f70eb5d5700 1 -- 172.21.15.46:0/2985568920 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f70e40cf760 con 0x7f70e40aef40 2023-07-05T18:57:03.009 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:03.003+0000 7f70d9ffb700 1 -- 172.21.15.46:0/2985568920 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70e00038c0 con 0x7f70e40aef40 2023-07-05T18:57:03.009 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:03.003+0000 7f70eb5d5700 1 -- 172.21.15.46:0/2985568920 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f70e40cfd20 con 0x7f70e40aef40 2023-07-05T18:57:03.009 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:03.004+0000 7f70eb5d5700 1 -- 172.21.15.46:0/2985568920 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f70e40cfee0 con 0x7f70e40aef40 2023-07-05T18:57:03.009 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:03.005+0000 7f70d9ffb700 1 -- 172.21.15.46:0/2985568920 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f70e0003a20 con 0x7f70e40aef40 2023-07-05T18:57:03.009 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:03.005+0000 7f70d9ffb700 1 --2- 172.21.15.46:0/2985568920 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7f70c806ace0 0x7f70c806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:57:03.009 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:03.005+0000 7f70d9ffb700 1 -- 172.21.15.46:0/2985568920 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6120+0+0 (secure 0 0 0) 0x7f70e0088940 con 0x7f70e40aef40 2023-07-05T18:57:03.009 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:03.005+0000 7f70e9371700 1 --2- 172.21.15.46:0/2985568920 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7f70c806ace0 0x7f70c806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:57:03.010 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:03.006+0000 7f70e9371700 1 --2- 172.21.15.46:0/2985568920 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7f70c806ace0 0x7f70c806d190 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f70d4000c00 tx=0x7f70d401c040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-05T18:57:03.010 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:03.010+0000 7f70d9ffb700 1 -- 172.21.15.46:0/2985568920 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f70e0053a40 con 0x7f70e40aef40 2023-07-05T18:57:03.214 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:03.213+0000 7f70eb5d5700 1 -- 172.21.15.46:0/2985568920 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f70e406d690 con 0x7f70e40aef40 2023-07-05T18:57:03.215 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:03.214+0000 7f70d9ffb700 1 -- 172.21.15.46:0/2985568920 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) v1 ==== 74+0+18256 (secure 0 0 0) 0x7f70e0057060 con 0x7f70e40aef40 2023-07-05T18:57:03.216 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T18:57:03.216 INFO:teuthology.orchestra.run.smithi046.stdout:{"epoch":22,"fsid":"042652d3-d80c-4ad8-9366-3e94f2a0a512","created":"2023-07-05T18:55:56.455710+0000","modified":"2023-07-05T18:57:02.490946+0000","last_up_change":"2023-07-05T18:56:06.594022+0000","last_in_change":"2023-07-05T18:55:58.879340+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-07-05T18:56:07.729620+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2023-07-05T18:56:08.128122+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-07-05T18:56:12.954625+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-07-05T18:56:14.068396+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"20009183-9a47-4392-8751-883f88d2bfb1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6813","nonce":4151971443},{"type":"v1","addr":"172.21.15.46:6815","nonce":4151971443}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6817","nonce":4151971443},{"type":"v1","addr":"172.21.15.46:6818","nonce":4151971443}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6822","nonce":4151971443},{"type":"v1","addr":"172.21.15.46:6823","nonce":4151971443}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6820","nonce":4151971443},{"type":"v1","addr":"172.21.15.46:6821","nonce":4151971443}]},"public_addr":"172.21.15.46:6815/4151971443","cluster_addr":"172.21.15.46:6818/4151971443","heartbeat_back_addr":"172.21.15.46:6823/4151971443","heartbeat_front_addr":"172.21.15.46:6821/4151971443","state":["exists","up"]},{"osd":1,"uuid":"91b4a7b0-e4e4-4888-a1fe-9edb0d68004c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6808","nonce":502575881},{"type":"v1","addr":"172.21.15.46:6809","nonce":502575881}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6810","nonce":502575881},{"type":"v1","addr":"172.21.15.46:6811","nonce":502575881}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6816","nonce":502575881},{"type":"v1","addr":"172.21.15.46:6819","nonce":502575881}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6812","nonce":502575881},{"type":"v1","addr":"172.21.15.46:6814","nonce":502575881}]},"public_addr":"172.21.15.46:6809/502575881","cluster_addr":"172.21.15.46:6811/502575881","heartbeat_back_addr":"172.21.15.46:6819/502575881","heartbeat_front_addr":"172.21.15.46:6814/502575881","state":["exists","up"]},{"osd":2,"uuid":"669ff744-1331-47c5-8579-0440731c889a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6800","nonce":2115251461},{"type":"v1","addr":"172.21.15.46:6801","nonce":2115251461}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6802","nonce":2115251461},{"type":"v1","addr":"172.21.15.46:6803","nonce":2115251461}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6806","nonce":2115251461},{"type":"v1","addr":"172.21.15.46:6807","nonce":2115251461}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6804","nonce":2115251461},{"type":"v1","addr":"172.21.15.46:6805","nonce":2115251461}]},"public_addr":"172.21.15.46:6801/2115251461","cluster_addr":"172.21.15.46:6803/2115251461","heartbeat_back_addr":"172.21.15.46:6807/2115251461","heartbeat_front_addr":"172.21.15.46:6805/2115251461","state":["exists","up"]},{"osd":3,"uuid":"34e1b86d-ffad-415d-861c-07a5f08068a6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6824","nonce":2981388766},{"type":"v1","addr":"172.21.15.46:6825","nonce":2981388766}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6826","nonce":2981388766},{"type":"v1","addr":"172.21.15.46:6827","nonce":2981388766}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6830","nonce":2981388766},{"type":"v1","addr":"172.21.15.46:6831","nonce":2981388766}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6828","nonce":2981388766},{"type":"v1","addr":"172.21.15.46:6829","nonce":2981388766}]},"public_addr":"172.21.15.46:6825/2981388766","cluster_addr":"172.21.15.46:6827/2981388766","heartbeat_back_addr":"172.21.15.46:6831/2981388766","heartbeat_front_addr":"172.21.15.46:6829/2981388766","state":["exists","up"]},{"osd":4,"uuid":"57ffcb91-c7dc-4a69-ae71-4d9622a14a05","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6800","nonce":2083655348},{"type":"v1","addr":"172.21.15.73:6801","nonce":2083655348}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6802","nonce":2083655348},{"type":"v1","addr":"172.21.15.73:6803","nonce":2083655348}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6806","nonce":2083655348},{"type":"v1","addr":"172.21.15.73:6807","nonce":2083655348}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6804","nonce":2083655348},{"type":"v1","addr":"172.21.15.73:6805","nonce":2083655348}]},"public_addr":"172.21.15.73:6801/2083655348","cluster_addr":"172.21.15.73:6803/2083655348","heartbeat_back_addr":"172.21.15.73:6807/2083655348","heartbeat_front_addr":"172.21.15.73:6805/2083655348","state":["exists","up"]},{"osd":5,"uuid":"665f41c9-ee20-49cf-bf0e-fbe0c03d3aed","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6824","nonce":2803788401},{"type":"v1","addr":"172.21.15.73:6825","nonce":2803788401}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6826","nonce":2803788401},{"type":"v1","addr":"172.21.15.73:6827","nonce":2803788401}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6830","nonce":2803788401},{"type":"v1","addr":"172.21.15.73:6831","nonce":2803788401}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6828","nonce":2803788401},{"type":"v1","addr":"172.21.15.73:6829","nonce":2803788401}]},"public_addr":"172.21.15.73:6825/2803788401","cluster_addr":"172.21.15.73:6827/2803788401","heartbeat_back_addr":"172.21.15.73:6831/2803788401","heartbeat_front_addr":"172.21.15.73:6829/2803788401","state":["exists","up"]},{"osd":6,"uuid":"5790c6cc-bd56-4ce4-9a7c-0f0c3b59215c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6808","nonce":974108383},{"type":"v1","addr":"172.21.15.73:6809","nonce":974108383}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6810","nonce":974108383},{"type":"v1","addr":"172.21.15.73:6811","nonce":974108383}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6815","nonce":974108383},{"type":"v1","addr":"172.21.15.73:6817","nonce":974108383}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6812","nonce":974108383},{"type":"v1","addr":"172.21.15.73:6813","nonce":974108383}]},"public_addr":"172.21.15.73:6809/974108383","cluster_addr":"172.21.15.73:6811/974108383","heartbeat_back_addr":"172.21.15.73:6817/974108383","heartbeat_front_addr":"172.21.15.73:6813/974108383","state":["exists","up"]},{"osd":7,"uuid":"b66f4d2e-147e-4c9b-97dd-cbd59d33802e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6814","nonce":3772673248},{"type":"v1","addr":"172.21.15.73:6816","nonce":3772673248}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6818","nonce":3772673248},{"type":"v1","addr":"172.21.15.73:6819","nonce":3772673248}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6822","nonce":3772673248},{"type":"v1","addr":"172.21.15.73:6823","nonce":3772673248}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6820","nonce":3772673248},{"type":"v1","addr":"172.21.15.73:6821","nonce":3772673248}]},"public_addr":"172.21.15.73:6816/3772673248","cluster_addr":"172.21.15.73:6819/3772673248","heartbeat_back_addr":"172.21.15.73:6823/3772673248","heartbeat_front_addr":"172.21.15.73:6821/3772673248","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-05T18:56:04.115334+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-05T18:56:04.071250+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-05T18:56:04.044387+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-05T18:56:04.085389+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-05T18:56:04.090726+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-05T18:56:04.074529+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-05T18:56:04.058841+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-05T18:56:04.043054+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"4.7","mappings":[{"from":1,"to":2}]},{"pgid":"4.1b","mappings":[{"from":3,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-05T18:57:03.218 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:03.216+0000 7f70eb5d5700 1 -- 172.21.15.46:0/2985568920 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7f70c806ace0 msgr2=0x7f70c806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:57:03.218 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:03.216+0000 7f70eb5d5700 1 --2- 172.21.15.46:0/2985568920 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7f70c806ace0 0x7f70c806d190 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f70d4000c00 tx=0x7f70d401c040 comp rx=0 tx=0).stop 2023-07-05T18:57:03.218 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:03.216+0000 7f70eb5d5700 1 -- 172.21.15.46:0/2985568920 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f70e40aef40 msgr2=0x7f70e415bd30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:57:03.218 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:03.216+0000 7f70eb5d5700 1 --2- 172.21.15.46:0/2985568920 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f70e40aef40 0x7f70e415bd30 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f70e000c4e0 tx=0x7f70e000c8a0 comp rx=0 tx=0).stop 2023-07-05T18:57:03.218 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:03.216+0000 7f70eb5d5700 1 -- 172.21.15.46:0/2985568920 shutdown_connections 2023-07-05T18:57:03.219 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:03.216+0000 7f70eb5d5700 1 --2- 172.21.15.46:0/2985568920 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7f70c806ace0 0x7f70c806d190 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:57:03.219 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:03.216+0000 7f70eb5d5700 1 --2- 172.21.15.46:0/2985568920 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f70e415d190 0x7f70e41486b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:57:03.219 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:03.216+0000 7f70eb5d5700 1 --2- 172.21.15.46:0/2985568920 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f70e4069e00 0x7f70e4145db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:57:03.219 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:03.216+0000 7f70eb5d5700 1 --2- 172.21.15.46:0/2985568920 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f70e40aef40 0x7f70e415bd30 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:57:03.219 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:03.216+0000 7f70eb5d5700 1 -- 172.21.15.46:0/2985568920 >> 172.21.15.46:0/2985568920 conn(0x7f70e406af10 msgr2=0x7f70e40ad330 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-05T18:57:03.220 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:03.216+0000 7f70eb5d5700 1 -- 172.21.15.46:0/2985568920 shutdown_connections 2023-07-05T18:57:03.220 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:03.216+0000 7f70eb5d5700 1 -- 172.21.15.46:0/2985568920 wait complete. 2023-07-05T18:57:03.230 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-07-05T18:57:03.356 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:03.355+0000 7f721f72c700 1 Processor -- start 2023-07-05T18:57:03.357 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:03.355+0000 7f721f72c700 1 -- start start 2023-07-05T18:57:03.360 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:03.356+0000 7f721f72c700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f721814f8c0 0x7f72180b29f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:57:03.360 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:03.356+0000 7f721f72c700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f7218071a10 0x7f721806be90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:57:03.360 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:03.356+0000 7f721f72c700 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f72180b2f30 con 0x7f721814fc90 2023-07-05T18:57:03.360 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:03.356+0000 7f721f72c700 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7218072190 con 0x7f7218071a10 2023-07-05T18:57:03.361 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:03.356+0000 7f721f72c700 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7218071eb0 con 0x7f721814f8c0 2023-07-05T18:57:03.361 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:03.356+0000 7f721ccc7700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f7218071a10 0x7f721806be90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:57:03.361 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:03.356+0000 7f721ccc7700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f7218071a10 0x7f721806be90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:59502/0 (socket says 172.21.15.46:59502) 2023-07-05T18:57:03.361 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:03.356+0000 7f721ccc7700 1 -- 172.21.15.46:0/3829035707 learned_addr learned my addr 172.21.15.46:0/3829035707 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-07-05T18:57:03.361 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:03.356+0000 7f721d4c8700 1 --2- 172.21.15.46:0/3829035707 >> v2:172.21.15.73:3300/0 conn(0x7f721814f8c0 0x7f72180b29f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:57:03.362 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:03.356+0000 7f721ccc7700 1 -- 172.21.15.46:0/3829035707 >> v2:172.21.15.73:3300/0 conn(0x7f721814f8c0 msgr2=0x7f72180b29f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-05T18:57:03.362 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:03.356+0000 7f721ccc7700 1 --2- 172.21.15.46:0/3829035707 >> v2:172.21.15.73:3300/0 conn(0x7f721814f8c0 0x7f72180b29f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:57:03.362 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:03.356+0000 7f721ccc7700 1 -- 172.21.15.46:0/3829035707 >> v1:172.21.15.73:6789/0 conn(0x7f721814fc90 legacy=0x7f721815c5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:57:03.362 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:03.356+0000 7f721ccc7700 1 -- 172.21.15.46:0/3829035707 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f721806ff90 con 0x7f7218071a10 2023-07-05T18:57:03.362 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:03.356+0000 7f721d4c8700 1 --2- 172.21.15.46:0/3829035707 >> v2:172.21.15.73:3300/0 conn(0x7f721814f8c0 0x7f72180b29f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-05T18:57:03.362 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:03.356+0000 7f721ccc7700 1 --2- 172.21.15.46:0/3829035707 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7218071a10 0x7f721806be90 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f72180b52d0 tx=0x7f721400be70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=da8ca681a5e0183f server_cookie=0 in_seq=0 out_seq=0 2023-07-05T18:57:03.362 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:03.356+0000 7f720ffff700 1 -- 172.21.15.46:0/3829035707 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f721400dd30 con 0x7f7218071a10 2023-07-05T18:57:03.363 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:03.356+0000 7f720ffff700 1 -- 172.21.15.46:0/3829035707 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f721400de90 con 0x7f7218071a10 2023-07-05T18:57:03.363 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:03.356+0000 7f720ffff700 1 -- 172.21.15.46:0/3829035707 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7214010690 con 0x7f7218071a10 2023-07-05T18:57:03.363 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:03.357+0000 7f721f72c700 1 -- 172.21.15.46:0/3829035707 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7218071a10 msgr2=0x7f721806be90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:57:03.363 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:03.357+0000 7f721f72c700 1 --2- 172.21.15.46:0/3829035707 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7218071a10 0x7f721806be90 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f72180b52d0 tx=0x7f721400be70 comp rx=0 tx=0).stop 2023-07-05T18:57:03.363 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:03.357+0000 7f721f72c700 1 -- 172.21.15.46:0/3829035707 shutdown_connections 2023-07-05T18:57:03.363 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:03.357+0000 7f721f72c700 1 --2- 172.21.15.46:0/3829035707 >> v2:172.21.15.73:3300/0 conn(0x7f721814f8c0 0x7f72180b29f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:57:03.363 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:03.357+0000 7f721f72c700 1 --2- 172.21.15.46:0/3829035707 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7218071a10 0x7f721806be90 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:57:03.363 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:03.357+0000 7f721f72c700 1 -- 172.21.15.46:0/3829035707 >> 172.21.15.46:0/3829035707 conn(0x7f72180b0d50 msgr2=0x7f72180b1150 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-05T18:57:03.364 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:03.357+0000 7f721f72c700 1 -- 172.21.15.46:0/3829035707 shutdown_connections 2023-07-05T18:57:03.364 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:03.357+0000 7f721f72c700 1 -- 172.21.15.46:0/3829035707 wait complete. 2023-07-05T18:57:03.364 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:03.359+0000 7f721f72c700 1 Processor -- start 2023-07-05T18:57:03.364 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:03.359+0000 7f721f72c700 1 -- start start 2023-07-05T18:57:03.366 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:03.360+0000 7f721f72c700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7218071a10 0x7f7218142bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:57:03.366 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:03.360+0000 7f721f72c700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f721814f8c0 0x7f721815add0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:57:03.366 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:03.360+0000 7f721f72c700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f721814fc90 0x7f72181e3150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:57:03.367 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:03.360+0000 7f721f72c700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7218143a70 con 0x7f7218071a10 2023-07-05T18:57:03.367 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:03.360+0000 7f721f72c700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72181433f0 con 0x7f721814f8c0 2023-07-05T18:57:03.368 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:03.360+0000 7f721f72c700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f721815b870 con 0x7f721814fc90 2023-07-05T18:57:03.368 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:03.360+0000 7f721d4c8700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7218071a10 0x7f7218142bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:57:03.368 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:03.360+0000 7f721d4c8700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7218071a10 0x7f7218142bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:59506/0 (socket says 172.21.15.46:59506) 2023-07-05T18:57:03.368 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:03.360+0000 7f721d4c8700 1 -- 172.21.15.46:0/4282805435 learned_addr learned my addr 172.21.15.46:0/4282805435 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-07-05T18:57:03.368 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:03.360+0000 7f721dcc9700 1 --2- 172.21.15.46:0/4282805435 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f721814fc90 0x7f72181e3150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:57:03.368 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:03.360+0000 7f721ccc7700 1 --2- 172.21.15.46:0/4282805435 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f721814f8c0 0x7f721815add0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:57:03.368 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:03.360+0000 7f721d4c8700 1 -- 172.21.15.46:0/4282805435 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f721814fc90 msgr2=0x7f72181e3150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:57:03.368 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:03.360+0000 7f721d4c8700 1 --2- 172.21.15.46:0/4282805435 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f721814fc90 0x7f72181e3150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:57:03.369 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:03.360+0000 7f721d4c8700 1 -- 172.21.15.46:0/4282805435 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f721814f8c0 msgr2=0x7f721815add0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:57:03.369 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:03.360+0000 7f721d4c8700 1 --2- 172.21.15.46:0/4282805435 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f721814f8c0 0x7f721815add0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:57:03.369 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:03.360+0000 7f721d4c8700 1 -- 172.21.15.46:0/4282805435 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f721400b7f0 con 0x7f7218071a10 2023-07-05T18:57:03.369 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:03.360+0000 7f721dcc9700 1 --2- 172.21.15.46:0/4282805435 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f721814fc90 0x7f72181e3150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-05T18:57:03.369 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:03.360+0000 7f721ccc7700 1 --2- 172.21.15.46:0/4282805435 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f721814f8c0 0x7f721815add0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-05T18:57:03.369 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:03.360+0000 7f721d4c8700 1 --2- 172.21.15.46:0/4282805435 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7218071a10 0x7f7218142bb0 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f720800e810 tx=0x7f720800ebd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-05T18:57:03.369 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:03.360+0000 7f720dffb700 1 -- 172.21.15.46:0/4282805435 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7208004230 con 0x7f7218071a10 2023-07-05T18:57:03.370 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:03.360+0000 7f720dffb700 1 -- 172.21.15.46:0/4282805435 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7208004390 con 0x7f7218071a10 2023-07-05T18:57:03.370 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:03.360+0000 7f721f72c700 1 -- 172.21.15.46:0/4282805435 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f721815bb50 con 0x7f7218071a10 2023-07-05T18:57:03.370 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:03.360+0000 7f720dffb700 1 -- 172.21.15.46:0/4282805435 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72080036a0 con 0x7f7218071a10 2023-07-05T18:57:03.370 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:03.361+0000 7f721f72c700 1 -- 172.21.15.46:0/4282805435 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f72181430f0 con 0x7f7218071a10 2023-07-05T18:57:03.370 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:03.362+0000 7f721f72c700 1 -- 172.21.15.46:0/4282805435 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7218143ce0 con 0x7f7218071a10 2023-07-05T18:57:03.370 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:03.362+0000 7f720dffb700 1 -- 172.21.15.46:0/4282805435 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f7208003800 con 0x7f7218071a10 2023-07-05T18:57:03.370 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:03.362+0000 7f720dffb700 1 --2- 172.21.15.46:0/4282805435 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7f71fc06ace0 0x7f71fc06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:57:03.370 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:03.363+0000 7f720dffb700 1 -- 172.21.15.46:0/4282805435 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6120+0+0 (secure 0 0 0) 0x7f7208088f40 con 0x7f7218071a10 2023-07-05T18:57:03.371 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:03.363+0000 7f721ccc7700 1 --2- 172.21.15.46:0/4282805435 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7f71fc06ace0 0x7f71fc06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:57:03.371 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:03.363+0000 7f721ccc7700 1 --2- 172.21.15.46:0/4282805435 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7f71fc06ace0 0x7f71fc06d190 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f7218071de0 tx=0x7f7214012000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-05T18:57:03.371 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:03.367+0000 7f720dffb700 1 -- 172.21.15.46:0/4282805435 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f7208054040 con 0x7f7218071a10 2023-07-05T18:57:03.613 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:03.612+0000 7f721f72c700 1 -- 172.21.15.46:0/4282805435 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f7218067010 con 0x7f7218071a10 2023-07-05T18:57:04.515 INFO:tasks.ceph.mon.a.smithi046.stderr:2023-07-05T18:57:04.508+0000 7f2989e7d700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-07-05T18:57:04.532 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:04.519+0000 7f720dffb700 1 -- 172.21.15.46:0/4282805435 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v9) v1 ==== 161+0+0 (secure 0 0 0) 0x7f7208057660 con 0x7f7218071a10 2023-07-05T18:57:04.533 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:04.522+0000 7f721f72c700 1 -- 172.21.15.46:0/4282805435 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7f71fc06ace0 msgr2=0x7f71fc06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:57:04.533 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:04.522+0000 7f721f72c700 1 --2- 172.21.15.46:0/4282805435 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7f71fc06ace0 0x7f71fc06d190 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f7218071de0 tx=0x7f7214012000 comp rx=0 tx=0).stop 2023-07-05T18:57:04.533 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:04.522+0000 7f721f72c700 1 -- 172.21.15.46:0/4282805435 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7218071a10 msgr2=0x7f7218142bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:57:04.533 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:04.522+0000 7f721f72c700 1 --2- 172.21.15.46:0/4282805435 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7218071a10 0x7f7218142bb0 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f720800e810 tx=0x7f720800ebd0 comp rx=0 tx=0).stop 2023-07-05T18:57:04.534 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:04.522+0000 7f721f72c700 1 -- 172.21.15.46:0/4282805435 shutdown_connections 2023-07-05T18:57:04.534 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:04.522+0000 7f721f72c700 1 --2- 172.21.15.46:0/4282805435 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7f71fc06ace0 0x7f71fc06d190 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:57:04.534 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:04.522+0000 7f721f72c700 1 --2- 172.21.15.46:0/4282805435 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f721814fc90 0x7f72181e3150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:57:04.534 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:04.522+0000 7f721f72c700 1 --2- 172.21.15.46:0/4282805435 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7218071a10 0x7f7218142bb0 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:57:04.535 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:04.522+0000 7f721f72c700 1 --2- 172.21.15.46:0/4282805435 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f721814f8c0 0x7f721815add0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:57:04.535 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:04.522+0000 7f721f72c700 1 -- 172.21.15.46:0/4282805435 >> 172.21.15.46:0/4282805435 conn(0x7f72180b0d50 msgr2=0x7f72180af8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-05T18:57:04.535 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:04.522+0000 7f721f72c700 1 -- 172.21.15.46:0/4282805435 shutdown_connections 2023-07-05T18:57:04.535 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:04.522+0000 7f721f72c700 1 -- 172.21.15.46:0/4282805435 wait complete. 2023-07-05T18:57:04.535 INFO:teuthology.orchestra.run.smithi046.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-07-05T18:57:04.541 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-07-05T18:57:04.563 INFO:tasks.ceph.mds.b.smithi073.stdout:starting mds.b at 2023-07-05T18:57:04.676 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:04.674+0000 7fca5dd9c700 1 Processor -- start 2023-07-05T18:57:04.677 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:04.674+0000 7fca5dd9c700 1 -- start start 2023-07-05T18:57:04.679 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:04.675+0000 7fca5dd9c700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fca5806a510 0x7fca5806ed50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:57:04.679 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:04.675+0000 7fca5dd9c700 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fca580b4850 con 0x7fca5815c500 2023-07-05T18:57:04.679 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:04.675+0000 7fca5dd9c700 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fca580b4b30 con 0x7fca580b33c0 2023-07-05T18:57:04.680 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:04.675+0000 7fca5dd9c700 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fca5815c8d0 con 0x7fca5806a510 2023-07-05T18:57:04.680 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:04.675+0000 7fca577fe700 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7fca5815c500 0x7fca58069e00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:58786/0 (socket says 172.21.15.46:58786) 2023-07-05T18:57:04.685 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:04.675+0000 7fca577fe700 1 -- 172.21.15.46:0/2756355554 learned_addr learned my addr 172.21.15.46:0/2756355554 (peer_addr_for_me v1:172.21.15.46:0/0) 2023-07-05T18:57:04.685 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:04.675+0000 7fca56ffd700 1 --2- 172.21.15.46:0/2756355554 >> v2:172.21.15.73:3300/0 conn(0x7fca5806a510 0x7fca5806ed50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:57:04.685 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:04.676+0000 7fca567fc700 1 -- 172.21.15.46:0/2756355554 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1470498906 0 0) 0x7fca580b4850 con 0x7fca5815c500 2023-07-05T18:57:04.686 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:04.676+0000 7fca567fc700 1 -- 172.21.15.46:0/2756355554 --> v1:172.21.15.46:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fca440035b0 con 0x7fca5815c500 2023-07-05T18:57:04.686 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:04.676+0000 7fca56ffd700 1 -- 172.21.15.46:0/2756355554 >> v1:172.21.15.73:6789/0 conn(0x7fca580b33c0 legacy=0x7fca580cf660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:57:04.686 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:04.676+0000 7fca567fc700 1 -- 172.21.15.46:0/2756355554 <== mon.1 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4125625970 0 0) 0x7fca580b4b30 con 0x7fca580b33c0 2023-07-05T18:57:04.687 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:04.676+0000 7fca56ffd700 1 -- 172.21.15.46:0/2756355554 >> v1:172.21.15.46:6789/0 conn(0x7fca5815c500 legacy=0x7fca58069e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:57:04.687 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:04.676+0000 7fca56ffd700 1 -- 172.21.15.46:0/2756355554 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fca5806e270 con 0x7fca5806a510 2023-07-05T18:57:04.687 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:04.676+0000 7fca56ffd700 1 --2- 172.21.15.46:0/2756355554 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fca5806a510 0x7fca5806ed50 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fca48009840 tx=0x7fca48009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5a8d37f27074a714 server_cookie=0 in_seq=0 out_seq=0 2023-07-05T18:57:04.687 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:04.676+0000 7fca567fc700 1 -- 172.21.15.46:0/2756355554 <== mon.1 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca48011830 con 0x7fca5806a510 2023-07-05T18:57:04.688 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:04.676+0000 7fca567fc700 1 -- 172.21.15.46:0/2756355554 <== mon.1 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fca48011990 con 0x7fca5806a510 2023-07-05T18:57:04.688 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:04.676+0000 7fca567fc700 1 -- 172.21.15.46:0/2756355554 <== mon.1 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca48011d20 con 0x7fca5806a510 2023-07-05T18:57:04.688 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:04.677+0000 7fca5dd9c700 1 -- 172.21.15.46:0/2756355554 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fca5806a510 msgr2=0x7fca5806ed50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:57:04.689 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:04.677+0000 7fca5dd9c700 1 --2- 172.21.15.46:0/2756355554 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fca5806a510 0x7fca5806ed50 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fca48009840 tx=0x7fca48009b50 comp rx=0 tx=0).stop 2023-07-05T18:57:04.689 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:04.677+0000 7fca5dd9c700 1 -- 172.21.15.46:0/2756355554 shutdown_connections 2023-07-05T18:57:04.689 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:04.677+0000 7fca5dd9c700 1 --2- 172.21.15.46:0/2756355554 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fca5806a510 0x7fca5806ed50 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:57:04.690 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:04.677+0000 7fca5dd9c700 1 -- 172.21.15.46:0/2756355554 >> 172.21.15.46:0/2756355554 conn(0x7fca5806af10 msgr2=0x7fca5806b2e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-05T18:57:04.690 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:04.677+0000 7fca5dd9c700 1 -- 172.21.15.46:0/2756355554 shutdown_connections 2023-07-05T18:57:04.690 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:04.677+0000 7fca5dd9c700 1 -- 172.21.15.46:0/2756355554 wait complete. 2023-07-05T18:57:04.704 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:04.678+0000 7fca5dd9c700 1 Processor -- start 2023-07-05T18:57:04.705 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:04.678+0000 7fca5dd9c700 1 -- start start 2023-07-05T18:57:04.705 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:04.679+0000 7fca5dd9c700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fca5806a510 0x7fca5815f290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:57:04.705 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:04.679+0000 7fca5dd9c700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fca580b33c0 0x7fca580cd8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:57:04.705 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:04.679+0000 7fca5dd9c700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fca5815c500 0x7fca580cf5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:57:04.705 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:04.679+0000 7fca5dd9c700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca580cc820 con 0x7fca5806a510 2023-07-05T18:57:04.706 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:04.679+0000 7fca5dd9c700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca580ccb00 con 0x7fca5815c500 2023-07-05T18:57:04.706 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:04.679+0000 7fca5dd9c700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fca580ccde0 con 0x7fca580b33c0 2023-07-05T18:57:04.706 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:04.679+0000 7fca577fe700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fca5806a510 0x7fca5815f290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:57:04.706 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:04.679+0000 7fca577fe700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fca5806a510 0x7fca5815f290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:59520/0 (socket says 172.21.15.46:59520) 2023-07-05T18:57:04.706 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:04.679+0000 7fca577fe700 1 -- 172.21.15.46:0/2082693224 learned_addr learned my addr 172.21.15.46:0/2082693224 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-07-05T18:57:04.706 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:04.679+0000 7fca57fff700 1 --2- 172.21.15.46:0/2082693224 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fca5815c500 0x7fca580cf5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:57:04.706 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:04.679+0000 7fca56ffd700 1 --2- 172.21.15.46:0/2082693224 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fca580b33c0 0x7fca580cd8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:57:04.707 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:04.679+0000 7fca577fe700 1 -- 172.21.15.46:0/2082693224 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fca580b33c0 msgr2=0x7fca580cd8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:57:04.707 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:04.679+0000 7fca577fe700 1 --2- 172.21.15.46:0/2082693224 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fca580b33c0 0x7fca580cd8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:57:04.707 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:04.679+0000 7fca577fe700 1 -- 172.21.15.46:0/2082693224 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fca5815c500 msgr2=0x7fca580cf5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:57:04.708 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:04.679+0000 7fca577fe700 1 --2- 172.21.15.46:0/2082693224 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fca5815c500 0x7fca580cf5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:57:04.708 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:04.679+0000 7fca577fe700 1 -- 172.21.15.46:0/2082693224 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fca480094a0 con 0x7fca5806a510 2023-07-05T18:57:04.708 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:04.679+0000 7fca56ffd700 1 --2- 172.21.15.46:0/2082693224 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fca580b33c0 0x7fca580cd8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-05T18:57:04.708 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:04.680+0000 7fca577fe700 1 --2- 172.21.15.46:0/2082693224 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fca5806a510 0x7fca5815f290 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7fca4000c4d0 tx=0x7fca4000c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-05T18:57:04.709 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:04.680+0000 7fca4ffff700 1 -- 172.21.15.46:0/2082693224 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca40005d70 con 0x7fca5806a510 2023-07-05T18:57:04.709 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:04.680+0000 7fca4ffff700 1 -- 172.21.15.46:0/2082693224 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fca400070d0 con 0x7fca5806a510 2023-07-05T18:57:04.709 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:04.680+0000 7fca5dd9c700 1 -- 172.21.15.46:0/2082693224 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fca580cd0c0 con 0x7fca5806a510 2023-07-05T18:57:04.709 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:04.680+0000 7fca4ffff700 1 -- 172.21.15.46:0/2082693224 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca40007440 con 0x7fca5806a510 2023-07-05T18:57:04.709 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:04.680+0000 7fca5dd9c700 1 -- 172.21.15.46:0/2082693224 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fca580cbbb0 con 0x7fca5806a510 2023-07-05T18:57:04.709 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:04.681+0000 7fca5dd9c700 1 -- 172.21.15.46:0/2082693224 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fca580cd5e0 con 0x7fca5806a510 2023-07-05T18:57:04.709 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:04.681+0000 7fca4ffff700 1 -- 172.21.15.46:0/2082693224 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fca400075a0 con 0x7fca5806a510 2023-07-05T18:57:04.709 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:04.682+0000 7fca4ffff700 1 --2- 172.21.15.46:0/2082693224 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7fca3806ace0 0x7fca3806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:57:04.710 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:04.682+0000 7fca4ffff700 1 -- 172.21.15.46:0/2082693224 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6206+0+0 (secure 0 0 0) 0x7fca400889a0 con 0x7fca5806a510 2023-07-05T18:57:04.710 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:04.682+0000 7fca56ffd700 1 --2- 172.21.15.46:0/2082693224 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7fca3806ace0 0x7fca3806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:57:04.710 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:04.682+0000 7fca56ffd700 1 --2- 172.21.15.46:0/2082693224 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7fca3806ace0 0x7fca3806d190 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fca48009840 tx=0x7fca4801c040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-05T18:57:04.710 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:04.686+0000 7fca4ffff700 1 -- 172.21.15.46:0/2082693224 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fca580cd5e0 con 0x7fca5806a510 2023-07-05T18:57:04.936 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:04.932+0000 7fca5dd9c700 1 -- 172.21.15.46:0/2082693224 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7fca580cd5e0 con 0x7fca5806a510 2023-07-05T18:57:05.522 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:05.520+0000 7fca4ffff700 1 -- 172.21.15.46:0/2082693224 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v10) v1 ==== 104+0+0 (secure 0 0 0) 0x7fca580cd5e0 con 0x7fca5806a510 2023-07-05T18:57:05.526 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:05.523+0000 7fca5dd9c700 1 -- 172.21.15.46:0/2082693224 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7fca3806ace0 msgr2=0x7fca3806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:57:05.527 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:05.523+0000 7fca5dd9c700 1 --2- 172.21.15.46:0/2082693224 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7fca3806ace0 0x7fca3806d190 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fca48009840 tx=0x7fca4801c040 comp rx=0 tx=0).stop 2023-07-05T18:57:05.527 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:05.523+0000 7fca5dd9c700 1 -- 172.21.15.46:0/2082693224 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fca5806a510 msgr2=0x7fca5815f290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:57:05.527 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:05.523+0000 7fca5dd9c700 1 --2- 172.21.15.46:0/2082693224 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fca5806a510 0x7fca5815f290 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7fca4000c4d0 tx=0x7fca4000c890 comp rx=0 tx=0).stop 2023-07-05T18:57:05.528 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:05.523+0000 7fca5dd9c700 1 -- 172.21.15.46:0/2082693224 shutdown_connections 2023-07-05T18:57:05.528 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:05.523+0000 7fca5dd9c700 1 --2- 172.21.15.46:0/2082693224 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7fca3806ace0 0x7fca3806d190 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:57:05.528 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:05.523+0000 7fca5dd9c700 1 --2- 172.21.15.46:0/2082693224 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fca5815c500 0x7fca580cf5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:57:05.529 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:05.523+0000 7fca5dd9c700 1 --2- 172.21.15.46:0/2082693224 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fca5806a510 0x7fca5815f290 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:57:05.529 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:05.523+0000 7fca5dd9c700 1 --2- 172.21.15.46:0/2082693224 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fca580b33c0 0x7fca580cd8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:57:05.529 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:05.523+0000 7fca5dd9c700 1 -- 172.21.15.46:0/2082693224 >> 172.21.15.46:0/2082693224 conn(0x7fca5806af10 msgr2=0x7fca5815b390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-05T18:57:05.529 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:05.523+0000 7fca5dd9c700 1 -- 172.21.15.46:0/2082693224 shutdown_connections 2023-07-05T18:57:05.530 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:05.523+0000 7fca5dd9c700 1 -- 172.21.15.46:0/2082693224 wait complete. 2023-07-05T18:57:05.539 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-07-05T18:57:05.684 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:05.679+0000 7f3e7f8ea700 1 Processor -- start 2023-07-05T18:57:05.685 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:05.679+0000 7f3e7f8ea700 1 -- start start 2023-07-05T18:57:05.686 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:05.680+0000 7f3e7f8ea700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f3e780cdff0 0x7f3e7806c6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:57:05.686 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:05.680+0000 7f3e7f8ea700 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3e780cc2d0 con 0x7f3e780cbf00 2023-07-05T18:57:05.686 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:05.680+0000 7f3e7f8ea700 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3e7806e250 con 0x7f3e780af060 2023-07-05T18:57:05.686 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:05.680+0000 7f3e7f8ea700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3e7806cc00 con 0x7f3e780cdff0 2023-07-05T18:57:05.694 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:05.680+0000 7f3e7d686700 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7f3e780cbf00 0x7f3e780cd8e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:58800/0 (socket says 172.21.15.46:58800) 2023-07-05T18:57:05.695 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:05.680+0000 7f3e7d686700 1 -- 172.21.15.46:0/2876499834 learned_addr learned my addr 172.21.15.46:0/2876499834 (peer_addr_for_me v1:172.21.15.46:0/0) 2023-07-05T18:57:05.695 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:05.680+0000 7f3e7ce85700 1 --2- 172.21.15.46:0/2876499834 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f3e780cdff0 0x7f3e7806c6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:57:05.695 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:05.680+0000 7f3e6ffff700 1 -- 172.21.15.46:0/2876499834 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3374978619 0 0) 0x7f3e780cc2d0 con 0x7f3e780cbf00 2023-07-05T18:57:05.695 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:05.680+0000 7f3e6ffff700 1 -- 172.21.15.46:0/2876499834 --> v1:172.21.15.46:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3e640035b0 con 0x7f3e780cbf00 2023-07-05T18:57:05.695 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:05.680+0000 7f3e6ffff700 1 -- 172.21.15.46:0/2876499834 <== mon.0 v1:172.21.15.46:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 725995059 0 0) 0x7f3e640035b0 con 0x7f3e780cbf00 2023-07-05T18:57:05.695 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:05.680+0000 7f3e6ffff700 1 -- 172.21.15.46:0/2876499834 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f3e780cdff0 msgr2=0x7f3e7806c6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-05T18:57:05.695 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:05.680+0000 7f3e6ffff700 1 --2- 172.21.15.46:0/2876499834 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f3e780cdff0 0x7f3e7806c6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:57:05.696 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:05.680+0000 7f3e6ffff700 1 -- 172.21.15.46:0/2876499834 >> v1:172.21.15.73:6789/0 conn(0x7f3e780af060 legacy=0x7f3e780ca270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:57:05.697 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:05.680+0000 7f3e6ffff700 1 -- 172.21.15.46:0/2876499834 --> v1:172.21.15.46:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3e7806e530 con 0x7f3e780cbf00 2023-07-05T18:57:05.698 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:05.681+0000 7f3e6ffff700 1 -- 172.21.15.46:0/2876499834 <== mon.0 v1:172.21.15.46:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2195585215 0 0) 0x7f3e74001670 con 0x7f3e780cbf00 2023-07-05T18:57:05.698 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:05.681+0000 7f3e6ffff700 1 -- 172.21.15.46:0/2876499834 >> v1:172.21.15.46:6789/0 conn(0x7f3e780cbf00 legacy=0x7f3e780cd8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:57:05.698 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:05.681+0000 7f3e6ffff700 1 --2- 172.21.15.46:0/2876499834 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f3e780cdff0 0x7f3e64003a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:57:05.698 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:05.681+0000 7f3e6ffff700 1 --2- 172.21.15.46:0/2876499834 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3e64003f70 0x7f3e64004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:57:05.698 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:05.681+0000 7f3e6ffff700 1 --2- 172.21.15.46:0/2876499834 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3e64004d90 0x7f3e64005200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:57:05.699 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:05.681+0000 7f3e6ffff700 1 -- 172.21.15.46:0/2876499834 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e7806cc00 con 0x7f3e64003f70 2023-07-05T18:57:05.699 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:05.681+0000 7f3e6ffff700 1 -- 172.21.15.46:0/2876499834 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e6400ba40 con 0x7f3e64004d90 2023-07-05T18:57:05.699 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:05.681+0000 7f3e6ffff700 1 -- 172.21.15.46:0/2876499834 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3e6400bc00 con 0x7f3e780cdff0 2023-07-05T18:57:05.699 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:05.681+0000 7f3e7ce85700 1 --2- 172.21.15.46:0/2876499834 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3e64003f70 0x7f3e64004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:57:05.699 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:05.681+0000 7f3e7d686700 1 --2- 172.21.15.46:0/2876499834 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f3e780cdff0 0x7f3e64003a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:57:05.699 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:05.681+0000 7f3e7de87700 1 --2- 172.21.15.46:0/2876499834 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3e64004d90 0x7f3e64005200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:57:05.700 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:05.681+0000 7f3e7ce85700 1 -- 172.21.15.46:0/2876499834 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f3e780cdff0 msgr2=0x7f3e64003a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-05T18:57:05.700 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:05.681+0000 7f3e7ce85700 1 --2- 172.21.15.46:0/2876499834 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f3e780cdff0 0x7f3e64003a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:57:05.700 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:05.681+0000 7f3e7ce85700 1 -- 172.21.15.46:0/2876499834 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3e64004d90 msgr2=0x7f3e64005200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-05T18:57:05.700 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:05.681+0000 7f3e7ce85700 1 --2- 172.21.15.46:0/2876499834 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3e64004d90 0x7f3e64005200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:57:05.700 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:05.681+0000 7f3e7ce85700 1 -- 172.21.15.46:0/2876499834 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3e640035b0 con 0x7f3e64003f70 2023-07-05T18:57:05.700 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:05.681+0000 7f3e7ce85700 1 --2- 172.21.15.46:0/2876499834 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3e64003f70 0x7f3e64004850 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f3e68009b30 tx=0x7f3e64005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=774c0465e23b3a19 server_cookie=0 in_seq=0 out_seq=0 2023-07-05T18:57:05.701 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:05.681+0000 7f3e6ffff700 1 -- 172.21.15.46:0/2876499834 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e6800e6c0 con 0x7f3e64003f70 2023-07-05T18:57:05.701 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:05.681+0000 7f3e6ffff700 1 -- 172.21.15.46:0/2876499834 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3e6800e820 con 0x7f3e64003f70 2023-07-05T18:57:05.701 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:05.681+0000 7f3e6ffff700 1 -- 172.21.15.46:0/2876499834 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e6800eb90 con 0x7f3e64003f70 2023-07-05T18:57:05.701 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:05.682+0000 7f3e7f8ea700 1 -- 172.21.15.46:0/2876499834 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3e64003f70 msgr2=0x7f3e64004850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:57:05.701 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:05.682+0000 7f3e7f8ea700 1 --2- 172.21.15.46:0/2876499834 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3e64003f70 0x7f3e64004850 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f3e68009b30 tx=0x7f3e64005880 comp rx=0 tx=0).stop 2023-07-05T18:57:05.703 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:05.682+0000 7f3e7de87700 1 -- 172.21.15.46:0/2876499834 reap_dead start 2023-07-05T18:57:05.703 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:05.682+0000 7f3e7f8ea700 1 -- 172.21.15.46:0/2876499834 shutdown_connections 2023-07-05T18:57:05.703 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:05.682+0000 7f3e7f8ea700 1 -- 172.21.15.46:0/2876499834 >> 172.21.15.46:0/2876499834 conn(0x7f3e780cf9e0 msgr2=0x7f3e780cfde0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-05T18:57:05.703 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:05.682+0000 7f3e7f8ea700 1 -- 172.21.15.46:0/2876499834 shutdown_connections 2023-07-05T18:57:05.703 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:05.682+0000 7f3e7f8ea700 1 -- 172.21.15.46:0/2876499834 wait complete. 2023-07-05T18:57:05.706 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:05.683+0000 7f3e7f8ea700 1 Processor -- start 2023-07-05T18:57:05.706 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:05.683+0000 7f3e7f8ea700 1 -- start start 2023-07-05T18:57:05.706 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:05.684+0000 7f3e7f8ea700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3e64003f70 0x7f3e78156aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:57:05.706 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:05.684+0000 7f3e7f8ea700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3e7815c2c0 0x7f3e780c8cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:57:05.706 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:05.684+0000 7f3e7f8ea700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f3e7815c730 0x7f3e780c9200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:57:05.707 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:05.684+0000 7f3e7f8ea700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e780adfe0 con 0x7f3e7815c2c0 2023-07-05T18:57:05.707 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:05.684+0000 7f3e7f8ea700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e7815b260 con 0x7f3e64003f70 2023-07-05T18:57:05.707 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:05.684+0000 7f3e7f8ea700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3e78156fe0 con 0x7f3e7815c730 2023-07-05T18:57:05.707 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:05.684+0000 7f3e7ce85700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3e7815c2c0 0x7f3e780c8cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:57:05.707 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:05.684+0000 7f3e7ce85700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3e7815c2c0 0x7f3e780c8cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:59542/0 (socket says 172.21.15.46:59542) 2023-07-05T18:57:05.707 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:05.684+0000 7f3e7ce85700 1 -- 172.21.15.46:0/1233283411 learned_addr learned my addr 172.21.15.46:0/1233283411 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-07-05T18:57:05.708 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:05.684+0000 7f3e7d686700 1 --2- 172.21.15.46:0/1233283411 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3e64003f70 0x7f3e78156aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:57:05.708 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:05.684+0000 7f3e7de87700 1 --2- 172.21.15.46:0/1233283411 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f3e7815c730 0x7f3e780c9200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:57:05.709 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:05.684+0000 7f3e7ce85700 1 -- 172.21.15.46:0/1233283411 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f3e7815c730 msgr2=0x7f3e780c9200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:57:05.709 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:05.684+0000 7f3e7ce85700 1 --2- 172.21.15.46:0/1233283411 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f3e7815c730 0x7f3e780c9200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:57:05.709 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:05.684+0000 7f3e7ce85700 1 -- 172.21.15.46:0/1233283411 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3e64003f70 msgr2=0x7f3e78156aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:57:05.709 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:05.684+0000 7f3e7ce85700 1 --2- 172.21.15.46:0/1233283411 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3e64003f70 0x7f3e78156aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:57:05.709 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:05.684+0000 7f3e7ce85700 1 -- 172.21.15.46:0/1233283411 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3e7815b500 con 0x7f3e7815c2c0 2023-07-05T18:57:05.709 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:05.685+0000 7f3e7ce85700 1 --2- 172.21.15.46:0/1233283411 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3e7815c2c0 0x7f3e780c8cc0 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f3e6400ba10 tx=0x7f3e680047c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-05T18:57:05.709 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:05.685+0000 7f3e6dffb700 1 -- 172.21.15.46:0/1233283411 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e68021070 con 0x7f3e7815c2c0 2023-07-05T18:57:05.710 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:05.685+0000 7f3e6dffb700 1 -- 172.21.15.46:0/1233283411 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3e68004470 con 0x7f3e7815c2c0 2023-07-05T18:57:05.710 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:05.685+0000 7f3e7f8ea700 1 -- 172.21.15.46:0/1233283411 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3e7815b7e0 con 0x7f3e7815c2c0 2023-07-05T18:57:05.710 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:05.685+0000 7f3e6dffb700 1 -- 172.21.15.46:0/1233283411 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e6800e6c0 con 0x7f3e7815c2c0 2023-07-05T18:57:05.710 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:05.685+0000 7f3e7f8ea700 1 -- 172.21.15.46:0/1233283411 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3e7815bda0 con 0x7f3e7815c2c0 2023-07-05T18:57:05.710 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:05.686+0000 7f3e7f8ea700 1 -- 172.21.15.46:0/1233283411 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3e7815c110 con 0x7f3e7815c2c0 2023-07-05T18:57:05.710 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:05.686+0000 7f3e6dffb700 1 -- 172.21.15.46:0/1233283411 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f3e68025070 con 0x7f3e7815c2c0 2023-07-05T18:57:05.711 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:05.687+0000 7f3e6dffb700 1 --2- 172.21.15.46:0/1233283411 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7f3e5c06ace0 0x7f3e5c06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:57:05.711 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:05.687+0000 7f3e6dffb700 1 -- 172.21.15.46:0/1233283411 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6206+0+0 (secure 0 0 0) 0x7f3e6808a5d0 con 0x7f3e7815c2c0 2023-07-05T18:57:05.711 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:05.687+0000 7f3e7d686700 1 --2- 172.21.15.46:0/1233283411 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7f3e5c06ace0 0x7f3e5c06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:57:05.711 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:05.687+0000 7f3e7d686700 1 --2- 172.21.15.46:0/1233283411 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7f3e5c06ace0 0x7f3e5c06d190 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f3e74001050 tx=0x7f3e74000f80 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-05T18:57:05.711 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:05.691+0000 7f3e6dffb700 1 -- 172.21.15.46:0/1233283411 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f3e680557a0 con 0x7f3e7815c2c0 2023-07-05T18:57:05.890 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:05.888+0000 7f3e7f8ea700 1 -- 172.21.15.46:0/1233283411 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f3e780adfc0 con 0x7f3e7815c2c0 2023-07-05T18:57:06.527 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:06.525+0000 7f3e6dffb700 1 -- 172.21.15.46:0/1233283411 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v25) v1 ==== 181+0+0 (secure 0 0 0) 0x7f3e68058dc0 con 0x7f3e7815c2c0 2023-07-05T18:57:06.532 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:06.528+0000 7f3e7f8ea700 1 -- 172.21.15.46:0/1233283411 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7f3e5c06ace0 msgr2=0x7f3e5c06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:57:06.532 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:06.528+0000 7f3e7f8ea700 1 --2- 172.21.15.46:0/1233283411 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7f3e5c06ace0 0x7f3e5c06d190 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f3e74001050 tx=0x7f3e74000f80 comp rx=0 tx=0).stop 2023-07-05T18:57:06.533 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:06.529+0000 7f3e7f8ea700 1 -- 172.21.15.46:0/1233283411 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3e7815c2c0 msgr2=0x7f3e780c8cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:57:06.533 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:06.529+0000 7f3e7f8ea700 1 --2- 172.21.15.46:0/1233283411 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3e7815c2c0 0x7f3e780c8cc0 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f3e6400ba10 tx=0x7f3e680047c0 comp rx=0 tx=0).stop 2023-07-05T18:57:06.533 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:06.529+0000 7f3e7f8ea700 1 -- 172.21.15.46:0/1233283411 shutdown_connections 2023-07-05T18:57:06.533 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:06.529+0000 7f3e7f8ea700 1 --2- 172.21.15.46:0/1233283411 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7f3e5c06ace0 0x7f3e5c06d190 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:57:06.533 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:06.529+0000 7f3e7f8ea700 1 --2- 172.21.15.46:0/1233283411 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f3e7815c730 0x7f3e780c9200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:57:06.533 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:06.529+0000 7f3e7f8ea700 1 --2- 172.21.15.46:0/1233283411 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3e64003f70 0x7f3e78156aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:57:06.533 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:06.529+0000 7f3e7f8ea700 1 --2- 172.21.15.46:0/1233283411 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3e7815c2c0 0x7f3e780c8cc0 secure :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f3e6400ba10 tx=0x7f3e680047c0 comp rx=0 tx=0).stop 2023-07-05T18:57:06.534 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:06.529+0000 7f3e7f8ea700 1 -- 172.21.15.46:0/1233283411 >> 172.21.15.46:0/1233283411 conn(0x7f3e780cf9e0 msgr2=0x7f3e78158f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-05T18:57:06.534 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:06.530+0000 7f3e7f8ea700 1 -- 172.21.15.46:0/1233283411 shutdown_connections 2023-07-05T18:57:06.534 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:06.530+0000 7f3e7f8ea700 1 -- 172.21.15.46:0/1233283411 wait complete. 2023-07-05T18:57:06.534 INFO:teuthology.orchestra.run.smithi046.stderr:pool 'cephfs_metadata' removed 2023-07-05T18:57:06.548 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-07-05T18:57:06.704 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:06.692+0000 7f7003b09700 1 Processor -- start 2023-07-05T18:57:06.705 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:06.693+0000 7f7003b09700 1 -- start start 2023-07-05T18:57:06.705 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:06.693+0000 7f7003b09700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f6ffc0b8540 0x7f6ffc0d08b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:57:06.705 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:06.693+0000 7f7003b09700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f6ffc1609f0 0x7f6ffc0cf660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:57:06.706 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:06.693+0000 7f7003b09700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f6ffc0cfba0 0x7f6ffc0d2c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:57:06.706 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:06.693+0000 7f7003b09700 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6ffc0cda50 con 0x7f6ffc0cfba0 2023-07-05T18:57:06.706 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:06.693+0000 7f7003b09700 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6ffc0b8910 con 0x7f6ffc1609f0 2023-07-05T18:57:06.708 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:06.693+0000 7f7003b09700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6ffc0cef30 con 0x7f6ffc0b8540 2023-07-05T18:57:06.708 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:06.694+0000 7f70020a6700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f6ffc0cfba0 0x7f6ffc0d2c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:57:06.708 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:06.694+0000 7f70020a6700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f6ffc0cfba0 0x7f6ffc0d2c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:59550/0 (socket says 172.21.15.46:59550) 2023-07-05T18:57:06.709 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:06.694+0000 7f70020a6700 1 -- 172.21.15.46:0/189339342 learned_addr learned my addr 172.21.15.46:0/189339342 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-07-05T18:57:06.709 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:06.694+0000 7f70018a5700 1 --2- 172.21.15.46:0/189339342 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f6ffc0b8540 0x7f6ffc0d08b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:57:06.709 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:06.694+0000 7f70010a4700 1 --2- 172.21.15.46:0/189339342 >> v2:172.21.15.73:3300/0 conn(0x7f6ffc1609f0 0x7f6ffc0cf660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:57:06.710 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:06.694+0000 7f70020a6700 1 -- 172.21.15.46:0/189339342 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f6ffc0b8540 msgr2=0x7f6ffc0d08b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-05T18:57:06.710 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:06.694+0000 7f70020a6700 1 --2- 172.21.15.46:0/189339342 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f6ffc0b8540 0x7f6ffc0d08b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:57:06.710 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:06.694+0000 7f70020a6700 1 -- 172.21.15.46:0/189339342 >> v2:172.21.15.73:3300/0 conn(0x7f6ffc1609f0 msgr2=0x7f6ffc0cf660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-05T18:57:06.710 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:06.694+0000 7f70020a6700 1 --2- 172.21.15.46:0/189339342 >> v2:172.21.15.73:3300/0 conn(0x7f6ffc1609f0 0x7f6ffc0cf660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:57:06.711 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:06.694+0000 7f70020a6700 1 -- 172.21.15.46:0/189339342 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ffc0cf1d0 con 0x7f6ffc0cfba0 2023-07-05T18:57:06.711 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:06.694+0000 7f70020a6700 1 --2- 172.21.15.46:0/189339342 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6ffc0cfba0 0x7f6ffc0d2c70 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f6ffc0d3db0 tx=0x7f6ff400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=165ccd7173f4cfe6 server_cookie=0 in_seq=0 out_seq=0 2023-07-05T18:57:06.711 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:06.694+0000 7f70008a3700 1 -- 172.21.15.46:0/189339342 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ff400e070 con 0x7f6ffc0cfba0 2023-07-05T18:57:06.711 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:06.694+0000 7f70008a3700 1 -- 172.21.15.46:0/189339342 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6ff400b9c0 con 0x7f6ffc0cfba0 2023-07-05T18:57:06.712 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:06.694+0000 7f70008a3700 1 -- 172.21.15.46:0/189339342 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ff400bd70 con 0x7f6ffc0cfba0 2023-07-05T18:57:06.712 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:06.695+0000 7f7003b09700 1 -- 172.21.15.46:0/189339342 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6ffc0cfba0 msgr2=0x7f6ffc0d2c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:57:06.712 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:06.695+0000 7f7003b09700 1 --2- 172.21.15.46:0/189339342 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6ffc0cfba0 0x7f6ffc0d2c70 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f6ffc0d3db0 tx=0x7f6ff400b330 comp rx=0 tx=0).stop 2023-07-05T18:57:06.713 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:06.695+0000 7f7003b09700 1 -- 172.21.15.46:0/189339342 shutdown_connections 2023-07-05T18:57:06.713 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:06.695+0000 7f7003b09700 1 --2- 172.21.15.46:0/189339342 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f6ffc0b8540 0x7f6ffc0d08b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:57:06.713 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:06.695+0000 7f7003b09700 1 --2- 172.21.15.46:0/189339342 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6ffc0cfba0 0x7f6ffc0d2c70 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:57:06.713 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:06.695+0000 7f7003b09700 1 --2- 172.21.15.46:0/189339342 >> v2:172.21.15.73:3300/0 conn(0x7f6ffc1609f0 0x7f6ffc0cf660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:57:06.713 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:06.695+0000 7f7003b09700 1 -- 172.21.15.46:0/189339342 >> 172.21.15.46:0/189339342 conn(0x7f6ffc06a3a0 msgr2=0x7f6ffc06a770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-05T18:57:06.713 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:06.695+0000 7f7003b09700 1 -- 172.21.15.46:0/189339342 shutdown_connections 2023-07-05T18:57:06.713 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:06.695+0000 7f7003b09700 1 -- 172.21.15.46:0/189339342 wait complete. 2023-07-05T18:57:06.714 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:06.696+0000 7f7003b09700 1 Processor -- start 2023-07-05T18:57:06.714 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:06.696+0000 7f7003b09700 1 -- start start 2023-07-05T18:57:06.714 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:06.697+0000 7f7003b09700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6ffc0b8540 0x7f6ffc0ca7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:57:06.714 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:06.697+0000 7f7003b09700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f6ffc0cfba0 0x7f6ffc1542b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:57:06.714 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:06.697+0000 7f7003b09700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6ffc1609f0 0x7f6ffc156e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:57:06.714 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:06.697+0000 7f7003b09700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ffc157370 con 0x7f6ffc0b8540 2023-07-05T18:57:06.714 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:06.697+0000 7f7003b09700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ffc1f2130 con 0x7f6ffc1609f0 2023-07-05T18:57:06.715 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:06.697+0000 7f7003b09700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6ffc0caec0 con 0x7f6ffc0cfba0 2023-07-05T18:57:06.715 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:06.697+0000 7f70018a5700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6ffc0b8540 0x7f6ffc0ca7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:57:06.715 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:06.697+0000 7f70018a5700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6ffc0b8540 0x7f6ffc0ca7c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:59554/0 (socket says 172.21.15.46:59554) 2023-07-05T18:57:06.715 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:06.697+0000 7f70018a5700 1 -- 172.21.15.46:0/4161031058 learned_addr learned my addr 172.21.15.46:0/4161031058 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-07-05T18:57:06.715 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:06.697+0000 7f70010a4700 1 --2- 172.21.15.46:0/4161031058 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f6ffc0cfba0 0x7f6ffc1542b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:57:06.715 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:06.697+0000 7f70020a6700 1 --2- 172.21.15.46:0/4161031058 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6ffc1609f0 0x7f6ffc156e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:57:06.715 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:06.697+0000 7f70018a5700 1 -- 172.21.15.46:0/4161031058 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f6ffc0cfba0 msgr2=0x7f6ffc1542b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:57:06.716 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:06.697+0000 7f70018a5700 1 --2- 172.21.15.46:0/4161031058 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f6ffc0cfba0 0x7f6ffc1542b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:57:06.716 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:06.697+0000 7f70018a5700 1 -- 172.21.15.46:0/4161031058 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6ffc1609f0 msgr2=0x7f6ffc156e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:57:06.716 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:06.697+0000 7f70018a5700 1 --2- 172.21.15.46:0/4161031058 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6ffc1609f0 0x7f6ffc156e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:57:06.716 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:06.697+0000 7f70018a5700 1 -- 172.21.15.46:0/4161031058 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ff4009b30 con 0x7f6ffc0b8540 2023-07-05T18:57:06.716 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:06.697+0000 7f70020a6700 1 --2- 172.21.15.46:0/4161031058 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6ffc1609f0 0x7f6ffc156e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-05T18:57:06.716 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:06.698+0000 7f70018a5700 1 --2- 172.21.15.46:0/4161031058 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6ffc0b8540 0x7f6ffc0ca7c0 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f6ff800c7f0 tx=0x7f6ff800cb00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-05T18:57:06.716 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:06.698+0000 7f6fee7fc700 1 -- 172.21.15.46:0/4161031058 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ff8011800 con 0x7f6ffc0b8540 2023-07-05T18:57:06.716 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:06.698+0000 7f6fee7fc700 1 -- 172.21.15.46:0/4161031058 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6ff8011960 con 0x7f6ffc0b8540 2023-07-05T18:57:06.717 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:06.698+0000 7f6fee7fc700 1 -- 172.21.15.46:0/4161031058 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ff8011d10 con 0x7f6ffc0b8540 2023-07-05T18:57:06.717 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:06.698+0000 7f7003b09700 1 -- 172.21.15.46:0/4161031058 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6ffc0cb1a0 con 0x7f6ffc0b8540 2023-07-05T18:57:06.717 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:06.698+0000 7f7003b09700 1 -- 172.21.15.46:0/4161031058 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6ffc0cb760 con 0x7f6ffc0b8540 2023-07-05T18:57:06.718 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:06.699+0000 7f7003b09700 1 -- 172.21.15.46:0/4161031058 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6ffc04e1d0 con 0x7f6ffc0b8540 2023-07-05T18:57:06.719 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:06.699+0000 7f6fee7fc700 1 -- 172.21.15.46:0/4161031058 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f6ff8018360 con 0x7f6ffc0b8540 2023-07-05T18:57:06.719 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:06.700+0000 7f6fee7fc700 1 --2- 172.21.15.46:0/4161031058 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7f6fe006ace0 0x7f6fe006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:57:06.719 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:06.700+0000 7f6fee7fc700 1 -- 172.21.15.46:0/4161031058 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 5768+0+0 (secure 0 0 0) 0x7f6ff8089250 con 0x7f6ffc0b8540 2023-07-05T18:57:06.719 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:06.700+0000 7f70010a4700 1 --2- 172.21.15.46:0/4161031058 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7f6fe006ace0 0x7f6fe006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:57:06.719 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:06.700+0000 7f70010a4700 1 --2- 172.21.15.46:0/4161031058 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7f6fe006ace0 0x7f6fe006d190 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f6ffc15a3c0 tx=0x7f6ff0008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-05T18:57:06.720 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:06.704+0000 7f6fee7fc700 1 -- 172.21.15.46:0/4161031058 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f6ff8054430 con 0x7f6ffc0b8540 2023-07-05T18:57:06.908 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:06.906+0000 7f7003b09700 1 -- 172.21.15.46:0/4161031058 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f6ffc0c9a80 con 0x7f6ffc0b8540 2023-07-05T18:57:07.529 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:07.527+0000 7f6fee7fc700 1 -- 172.21.15.46:0/4161031058 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v26) v1 ==== 169+0+0 (secure 0 0 0) 0x7f6ff8057a50 con 0x7f6ffc0b8540 2023-07-05T18:57:07.533 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:07.531+0000 7f7003b09700 1 -- 172.21.15.46:0/4161031058 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7f6fe006ace0 msgr2=0x7f6fe006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:57:07.533 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:07.531+0000 7f7003b09700 1 --2- 172.21.15.46:0/4161031058 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7f6fe006ace0 0x7f6fe006d190 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f6ffc15a3c0 tx=0x7f6ff0008040 comp rx=0 tx=0).stop 2023-07-05T18:57:07.533 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:07.531+0000 7f7003b09700 1 -- 172.21.15.46:0/4161031058 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6ffc0b8540 msgr2=0x7f6ffc0ca7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:57:07.533 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:07.531+0000 7f7003b09700 1 --2- 172.21.15.46:0/4161031058 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6ffc0b8540 0x7f6ffc0ca7c0 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f6ff800c7f0 tx=0x7f6ff800cb00 comp rx=0 tx=0).stop 2023-07-05T18:57:07.534 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:07.532+0000 7f7003b09700 1 -- 172.21.15.46:0/4161031058 shutdown_connections 2023-07-05T18:57:07.534 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:07.532+0000 7f7003b09700 1 --2- 172.21.15.46:0/4161031058 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7f6fe006ace0 0x7f6fe006d190 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:57:07.534 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:07.532+0000 7f7003b09700 1 --2- 172.21.15.46:0/4161031058 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6ffc1609f0 0x7f6ffc156e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:57:07.534 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:07.532+0000 7f7003b09700 1 --2- 172.21.15.46:0/4161031058 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6ffc0b8540 0x7f6ffc0ca7c0 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:57:07.534 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:07.532+0000 7f7003b09700 1 --2- 172.21.15.46:0/4161031058 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f6ffc0cfba0 0x7f6ffc1542b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:57:07.535 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:07.532+0000 7f7003b09700 1 -- 172.21.15.46:0/4161031058 >> 172.21.15.46:0/4161031058 conn(0x7f6ffc06a3a0 msgr2=0x7f6ffc15a740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-05T18:57:07.537 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:07.535+0000 7f7003b09700 1 -- 172.21.15.46:0/4161031058 shutdown_connections 2023-07-05T18:57:07.538 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:07.535+0000 7f7003b09700 1 -- 172.21.15.46:0/4161031058 wait complete. 2023-07-05T18:57:07.538 INFO:teuthology.orchestra.run.smithi046.stderr:pool 'cephfs_data' removed 2023-07-05T18:57:07.553 INFO:tasks.ceph.mds.a:Restarting daemon 2023-07-05T18:57:07.554 INFO:tasks.ceph.mds.a:Stopping old one... 2023-07-05T18:57:07.555 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-07-05T18:57:07.555 INFO:teuthology.orchestra.run:waiting for 300 2023-07-05T18:57:07.556 INFO:tasks.ceph.mds.c:Restarting daemon 2023-07-05T18:57:07.556 INFO:tasks.ceph.mds.c:Stopping old one... 2023-07-05T18:57:07.556 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-07-05T18:57:07.557 INFO:teuthology.orchestra.run:waiting for 300 2023-07-05T18:57:07.557 INFO:tasks.ceph.mds.b:Restarting daemon 2023-07-05T18:57:07.557 INFO:tasks.ceph.mds.b:Stopping old one... 2023-07-05T18:57:07.558 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-07-05T18:57:07.558 INFO:teuthology.orchestra.run:waiting for 300 2023-07-05T18:57:07.558 INFO:tasks.ceph.mds.d:Restarting daemon 2023-07-05T18:57:07.559 INFO:tasks.ceph.mds.d:Stopping old one... 2023-07-05T18:57:07.559 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-07-05T18:57:07.559 INFO:teuthology.orchestra.run:waiting for 300 2023-07-05T18:57:07.565 INFO:tasks.ceph.mds.a:Stopped 2023-07-05T18:57:07.566 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-07-05T18:57:07.568 INFO:tasks.ceph.mds.c:Stopped 2023-07-05T18:57:07.568 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-07-05T18:57:07.572 INFO:tasks.ceph.mds.b:Stopped 2023-07-05T18:57:07.573 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-07-05T18:57:07.574 INFO:tasks.ceph.mds.d:Stopped 2023-07-05T18:57:07.574 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-07-05T18:57:07.610 INFO:tasks.ceph.mds.a:Started 2023-07-05T18:57:07.611 DEBUG:teuthology.parallel:result is None 2023-07-05T18:57:07.612 INFO:tasks.ceph.mds.c:Started 2023-07-05T18:57:07.612 DEBUG:teuthology.parallel:result is None 2023-07-05T18:57:07.616 INFO:tasks.ceph.mds.b:Started 2023-07-05T18:57:07.616 DEBUG:teuthology.parallel:result is None 2023-07-05T18:57:07.618 INFO:tasks.ceph.mds.d:Started 2023-07-05T18:57:07.618 DEBUG:teuthology.parallel:result is None 2023-07-05T18:57:07.619 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2023-07-05T18:57:07.700 INFO:tasks.ceph.mds.b.smithi073.stdout:starting mds.b at 2023-07-05T18:57:07.701 INFO:tasks.ceph.mds.d.smithi073.stdout:starting mds.d at 2023-07-05T18:57:07.702 INFO:tasks.ceph.mds.a.smithi046.stdout:starting mds.a at 2023-07-05T18:57:07.702 INFO:tasks.ceph.mds.c.smithi046.stdout:starting mds.c at 2023-07-05T18:57:07.779 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:07.771+0000 7f95ae6bf700 1 Processor -- start 2023-07-05T18:57:07.779 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:07.772+0000 7f95ae6bf700 1 -- start start 2023-07-05T18:57:07.780 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:07.772+0000 7f95ae6bf700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f95a815a610 0x7f95a80b1ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:57:07.780 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:07.772+0000 7f95ae6bf700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f95a80ce6d0 0x7f95a80ceb20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:57:07.780 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:07.772+0000 7f95ae6bf700 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f95a80cf060 con 0x7f95a80affd0 2023-07-05T18:57:07.780 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:07.772+0000 7f95ae6bf700 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f95a80b2410 con 0x7f95a80ce6d0 2023-07-05T18:57:07.781 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:07.772+0000 7f95ae6bf700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f95a80ada20 con 0x7f95a815a610 2023-07-05T18:57:07.781 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:07.772+0000 7f95a77fe700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f95a80ce6d0 0x7f95a80ceb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:57:07.781 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:07.773+0000 7f95a77fe700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f95a80ce6d0 0x7f95a80ceb20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:59584/0 (socket says 172.21.15.46:59584) 2023-07-05T18:57:07.781 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:07.773+0000 7f95a77fe700 1 -- 172.21.15.46:0/3073784815 learned_addr learned my addr 172.21.15.46:0/3073784815 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-07-05T18:57:07.781 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:07.773+0000 7f95a7fff700 1 --2- 172.21.15.46:0/3073784815 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f95a815a610 0x7f95a80b1ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:57:07.781 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:07.773+0000 7f95a77fe700 1 -- 172.21.15.46:0/3073784815 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f95a815a610 msgr2=0x7f95a80b1ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-05T18:57:07.782 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:07.773+0000 7f95a77fe700 1 --2- 172.21.15.46:0/3073784815 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f95a815a610 0x7f95a80b1ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:57:07.782 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:07.773+0000 7f95a77fe700 1 -- 172.21.15.46:0/3073784815 >> v1:172.21.15.73:6789/0 conn(0x7f95a80affd0 legacy=0x7f95a80b0450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:57:07.782 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:07.773+0000 7f95a6ffd700 1 -- 172.21.15.46:0/3073784815 <== mon.1 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1437210561 0 0) 0x7f95a0001490 con 0x7f95a80affd0 2023-07-05T18:57:07.783 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:07.773+0000 7f95a77fe700 1 -- 172.21.15.46:0/3073784815 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f95a80add00 con 0x7f95a80ce6d0 2023-07-05T18:57:07.783 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:07.773+0000 7f95a77fe700 1 --2- 172.21.15.46:0/3073784815 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f95a80ce6d0 0x7f95a80ceb20 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f95980098f0 tx=0x7f9598009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f24a78492517eac4 server_cookie=0 in_seq=0 out_seq=0 2023-07-05T18:57:07.783 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:07.773+0000 7f95a6ffd700 1 -- 172.21.15.46:0/3073784815 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9598011830 con 0x7f95a80ce6d0 2023-07-05T18:57:07.783 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:07.773+0000 7f95a6ffd700 1 -- 172.21.15.46:0/3073784815 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9598011990 con 0x7f95a80ce6d0 2023-07-05T18:57:07.783 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:07.773+0000 7f95a6ffd700 1 -- 172.21.15.46:0/3073784815 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9598011d20 con 0x7f95a80ce6d0 2023-07-05T18:57:07.783 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:07.774+0000 7f95ae6bf700 1 -- 172.21.15.46:0/3073784815 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f95a80ce6d0 msgr2=0x7f95a80ceb20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:57:07.784 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:07.774+0000 7f95ae6bf700 1 --2- 172.21.15.46:0/3073784815 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f95a80ce6d0 0x7f95a80ceb20 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f95980098f0 tx=0x7f9598009c00 comp rx=0 tx=0).stop 2023-07-05T18:57:07.785 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:07.774+0000 7f95ae6bf700 1 -- 172.21.15.46:0/3073784815 shutdown_connections 2023-07-05T18:57:07.786 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:07.774+0000 7f95ae6bf700 1 --2- 172.21.15.46:0/3073784815 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f95a815a610 0x7f95a80b1ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:57:07.786 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:07.774+0000 7f95ae6bf700 1 --2- 172.21.15.46:0/3073784815 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f95a80ce6d0 0x7f95a80ceb20 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:57:07.787 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:07.774+0000 7f95ae6bf700 1 -- 172.21.15.46:0/3073784815 >> 172.21.15.46:0/3073784815 conn(0x7f95a8099e00 msgr2=0x7f95a80d0b00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-05T18:57:07.787 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:07.774+0000 7f95ae6bf700 1 -- 172.21.15.46:0/3073784815 shutdown_connections 2023-07-05T18:57:07.787 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:07.774+0000 7f95ae6bf700 1 -- 172.21.15.46:0/3073784815 wait complete. 2023-07-05T18:57:07.787 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:07.775+0000 7f95ae6bf700 1 Processor -- start 2023-07-05T18:57:07.788 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:07.775+0000 7f95ae6bf700 1 -- start start 2023-07-05T18:57:07.798 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:07.776+0000 7f95ae6bf700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f95a80affd0 0x7f95a81584f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:57:07.798 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:07.776+0000 7f95ae6bf700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f95a80ce6d0 0x7f95a80cdba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:57:07.799 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:07.776+0000 7f95ae6bf700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f95a815a610 0x7f95a80c59b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:57:07.799 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:07.776+0000 7f95ae6bf700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95a8158bf0 con 0x7f95a80ce6d0 2023-07-05T18:57:07.800 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:07.776+0000 7f95ae6bf700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95a806b040 con 0x7f95a80affd0 2023-07-05T18:57:07.800 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:07.776+0000 7f95ae6bf700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f95a806b2e0 con 0x7f95a815a610 2023-07-05T18:57:07.800 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:07.776+0000 7f95a77fe700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f95a80ce6d0 0x7f95a80cdba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:57:07.803 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:07.776+0000 7f95a77fe700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f95a80ce6d0 0x7f95a80cdba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:59592/0 (socket says 172.21.15.46:59592) 2023-07-05T18:57:07.803 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:07.776+0000 7f95a77fe700 1 -- 172.21.15.46:0/3626507049 learned_addr learned my addr 172.21.15.46:0/3626507049 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-07-05T18:57:07.803 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:07.776+0000 7f95a7fff700 1 --2- 172.21.15.46:0/3626507049 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f95a80affd0 0x7f95a81584f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:57:07.804 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:07.776+0000 7f95acc5c700 1 --2- 172.21.15.46:0/3626507049 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f95a815a610 0x7f95a80c59b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:57:07.804 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:07.776+0000 7f95a77fe700 1 -- 172.21.15.46:0/3626507049 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f95a815a610 msgr2=0x7f95a80c59b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:57:07.804 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:07.776+0000 7f95a77fe700 1 --2- 172.21.15.46:0/3626507049 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f95a815a610 0x7f95a80c59b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:57:07.805 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:07.776+0000 7f95a77fe700 1 -- 172.21.15.46:0/3626507049 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f95a80affd0 msgr2=0x7f95a81584f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:57:07.806 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:07.776+0000 7f95a77fe700 1 --2- 172.21.15.46:0/3626507049 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f95a80affd0 0x7f95a81584f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:57:07.806 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:07.776+0000 7f95a77fe700 1 -- 172.21.15.46:0/3626507049 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9598009550 con 0x7f95a80ce6d0 2023-07-05T18:57:07.806 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:07.776+0000 7f95acc5c700 1 --2- 172.21.15.46:0/3626507049 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f95a815a610 0x7f95a80c59b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-05T18:57:07.807 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:07.777+0000 7f95a77fe700 1 --2- 172.21.15.46:0/3626507049 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f95a80ce6d0 0x7f95a80cdba0 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f95a804e850 tx=0x7f9598004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-05T18:57:07.807 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:07.777+0000 7f95a4ff9700 1 -- 172.21.15.46:0/3626507049 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9598004480 con 0x7f95a80ce6d0 2023-07-05T18:57:07.807 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:07.777+0000 7f95a4ff9700 1 -- 172.21.15.46:0/3626507049 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f959801f070 con 0x7f95a80ce6d0 2023-07-05T18:57:07.807 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:07.777+0000 7f95ae6bf700 1 -- 172.21.15.46:0/3626507049 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f95a806b5c0 con 0x7f95a80ce6d0 2023-07-05T18:57:07.807 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:07.777+0000 7f95a4ff9700 1 -- 172.21.15.46:0/3626507049 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95980038a0 con 0x7f95a80ce6d0 2023-07-05T18:57:07.807 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:07.777+0000 7f95ae6bf700 1 -- 172.21.15.46:0/3626507049 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f95a80c5ef0 con 0x7f95a80ce6d0 2023-07-05T18:57:07.808 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:07.778+0000 7f95ae6bf700 1 -- 172.21.15.46:0/3626507049 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f95a806bae0 con 0x7f95a80ce6d0 2023-07-05T18:57:07.809 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:07.778+0000 7f95a4ff9700 1 -- 172.21.15.46:0/3626507049 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f9598021030 con 0x7f95a80ce6d0 2023-07-05T18:57:07.809 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:07.779+0000 7f95a4ff9700 1 --2- 172.21.15.46:0/3626507049 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7f959406ace0 0x7f959406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:57:07.809 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:07.779+0000 7f95a4ff9700 1 -- 172.21.15.46:0/3626507049 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 5296+0+0 (secure 0 0 0) 0x7f959808a640 con 0x7f95a80ce6d0 2023-07-05T18:57:07.809 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:07.779+0000 7f95a7fff700 1 --2- 172.21.15.46:0/3626507049 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7f959406ace0 0x7f959406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:57:07.809 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:07.779+0000 7f95a7fff700 1 --2- 172.21.15.46:0/3626507049 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7f959406ace0 0x7f959406d190 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f959c009b50 tx=0x7f959c008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-05T18:57:07.809 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:07.783+0000 7f95a4ff9700 1 -- 172.21.15.46:0/3626507049 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f95a806bae0 con 0x7f95a80ce6d0 2023-07-05T18:57:07.999 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:07.997+0000 7f95ae6bf700 1 -- 172.21.15.46:0/3626507049 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7f95a806bae0 con 0x7f95a80ce6d0 2023-07-05T18:57:08.747 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:08.745+0000 7f95a4ff9700 1 -- 172.21.15.46:0/3626507049 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v31) v1 ==== 97+0+0 (secure 0 0 0) 0x7f95a806bae0 con 0x7f95a80ce6d0 2023-07-05T18:57:08.753 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:08.747+0000 7f95ae6bf700 1 -- 172.21.15.46:0/3626507049 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7f959406ace0 msgr2=0x7f959406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:57:08.753 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:08.747+0000 7f95ae6bf700 1 --2- 172.21.15.46:0/3626507049 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7f959406ace0 0x7f959406d190 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f959c009b50 tx=0x7f959c008040 comp rx=0 tx=0).stop 2023-07-05T18:57:08.753 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:08.747+0000 7f95ae6bf700 1 -- 172.21.15.46:0/3626507049 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f95a80ce6d0 msgr2=0x7f95a80cdba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:57:08.753 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:08.747+0000 7f95ae6bf700 1 --2- 172.21.15.46:0/3626507049 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f95a80ce6d0 0x7f95a80cdba0 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f95a804e850 tx=0x7f9598004750 comp rx=0 tx=0).stop 2023-07-05T18:57:08.754 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:08.747+0000 7f95ae6bf700 1 -- 172.21.15.46:0/3626507049 shutdown_connections 2023-07-05T18:57:08.754 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:08.747+0000 7f95ae6bf700 1 --2- 172.21.15.46:0/3626507049 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7f959406ace0 0x7f959406d190 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:57:08.754 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:08.747+0000 7f95ae6bf700 1 --2- 172.21.15.46:0/3626507049 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f95a815a610 0x7f95a80c59b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:57:08.754 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:08.747+0000 7f95ae6bf700 1 --2- 172.21.15.46:0/3626507049 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f95a80affd0 0x7f95a81584f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:57:08.754 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:08.747+0000 7f95ae6bf700 1 --2- 172.21.15.46:0/3626507049 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f95a80ce6d0 0x7f95a80cdba0 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:57:08.754 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:08.747+0000 7f95ae6bf700 1 -- 172.21.15.46:0/3626507049 >> 172.21.15.46:0/3626507049 conn(0x7f95a8099e00 msgr2=0x7f95a80b1180 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-05T18:57:08.754 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:08.748+0000 7f95ae6bf700 1 -- 172.21.15.46:0/3626507049 shutdown_connections 2023-07-05T18:57:08.755 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:08.748+0000 7f95ae6bf700 1 -- 172.21.15.46:0/3626507049 wait complete. 2023-07-05T18:57:08.755 INFO:teuthology.orchestra.run.smithi046.stderr: removed all blocklist entries 2023-07-05T18:57:08.766 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2023-07-05T18:57:08.902 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:08.896+0000 7f230d6cf700 1 Processor -- start 2023-07-05T18:57:08.903 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:08.896+0000 7f230d6cf700 1 -- start start 2023-07-05T18:57:08.903 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:08.897+0000 7f230d6cf700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f230815c630 0x7f230806d8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:57:08.904 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:08.897+0000 7f230d6cf700 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2308070a80 con 0x7f2308160120 2023-07-05T18:57:08.904 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:08.897+0000 7f230d6cf700 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f230815ca00 con 0x7f23080b1ec0 2023-07-05T18:57:08.904 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:08.897+0000 7f230d6cf700 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2308160fc0 con 0x7f230815c630 2023-07-05T18:57:08.904 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:08.897+0000 7f23067fc700 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7f2308160120 0x7f23080b17b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:58874/0 (socket says 172.21.15.46:58874) 2023-07-05T18:57:08.905 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:08.897+0000 7f23067fc700 1 -- 172.21.15.46:0/1164504866 learned_addr learned my addr 172.21.15.46:0/1164504866 (peer_addr_for_me v1:172.21.15.46:0/0) 2023-07-05T18:57:08.905 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:08.898+0000 7f2306ffd700 1 --2- 172.21.15.46:0/1164504866 >> v2:172.21.15.73:3300/0 conn(0x7f230815c630 0x7f230806d8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:57:08.905 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:08.898+0000 7f2305ffb700 1 -- 172.21.15.46:0/1164504866 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2642833849 0 0) 0x7f2308070a80 con 0x7f2308160120 2023-07-05T18:57:08.905 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:08.898+0000 7f2305ffb700 1 -- 172.21.15.46:0/1164504866 --> v1:172.21.15.46:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f22f00035b0 con 0x7f2308160120 2023-07-05T18:57:08.905 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:08.898+0000 7f2305ffb700 1 -- 172.21.15.46:0/1164504866 <== mon.1 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 39869771 0 0) 0x7f230815ca00 con 0x7f23080b1ec0 2023-07-05T18:57:08.906 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:08.898+0000 7f2305ffb700 1 -- 172.21.15.46:0/1164504866 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2308070a80 con 0x7f23080b1ec0 2023-07-05T18:57:08.906 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:08.898+0000 7f2305ffb700 1 -- 172.21.15.46:0/1164504866 <== mon.0 v1:172.21.15.46:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2893329449 0 0) 0x7f22f00035b0 con 0x7f2308160120 2023-07-05T18:57:08.906 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:08.898+0000 7f2306ffd700 1 -- 172.21.15.46:0/1164504866 >> v1:172.21.15.73:6789/0 conn(0x7f23080b1ec0 legacy=0x7f23080ce6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:57:08.906 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:08.898+0000 7f2306ffd700 1 -- 172.21.15.46:0/1164504866 >> v1:172.21.15.46:6789/0 conn(0x7f2308160120 legacy=0x7f23080b17b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:57:08.906 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:08.898+0000 7f2306ffd700 1 -- 172.21.15.46:0/1164504866 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2308160ce0 con 0x7f230815c630 2023-07-05T18:57:08.907 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:08.898+0000 7f2306ffd700 1 --2- 172.21.15.46:0/1164504866 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f230815c630 0x7f230806d8b0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f22fc009840 tx=0x7f22fc009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=70a62f269a2c106c server_cookie=0 in_seq=0 out_seq=0 2023-07-05T18:57:08.907 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:08.898+0000 7f2305ffb700 1 -- 172.21.15.46:0/1164504866 <== mon.1 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22f8001670 con 0x7f230815c630 2023-07-05T18:57:08.907 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:08.898+0000 7f2305ffb700 1 -- 172.21.15.46:0/1164504866 <== mon.1 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f22fc004030 con 0x7f230815c630 2023-07-05T18:57:08.907 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:08.898+0000 7f2305ffb700 1 -- 172.21.15.46:0/1164504866 <== mon.1 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22fc0043c0 con 0x7f230815c630 2023-07-05T18:57:08.907 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:08.899+0000 7f230d6cf700 1 -- 172.21.15.46:0/1164504866 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f230815c630 msgr2=0x7f230806d8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:57:08.907 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:08.899+0000 7f230d6cf700 1 --2- 172.21.15.46:0/1164504866 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f230815c630 0x7f230806d8b0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f22fc009840 tx=0x7f22fc009b50 comp rx=0 tx=0).stop 2023-07-05T18:57:08.907 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:08.899+0000 7f230d6cf700 1 -- 172.21.15.46:0/1164504866 shutdown_connections 2023-07-05T18:57:08.908 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:08.899+0000 7f230d6cf700 1 --2- 172.21.15.46:0/1164504866 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f230815c630 0x7f230806d8b0 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:57:08.908 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:08.899+0000 7f230d6cf700 1 -- 172.21.15.46:0/1164504866 >> 172.21.15.46:0/1164504866 conn(0x7f230806af10 msgr2=0x7f230806b310 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-05T18:57:08.908 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:08.899+0000 7f230d6cf700 1 -- 172.21.15.46:0/1164504866 shutdown_connections 2023-07-05T18:57:08.908 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:08.899+0000 7f230d6cf700 1 -- 172.21.15.46:0/1164504866 wait complete. 2023-07-05T18:57:08.908 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:08.900+0000 7f230d6cf700 1 Processor -- start 2023-07-05T18:57:08.909 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:08.900+0000 7f230d6cf700 1 -- start start 2023-07-05T18:57:08.913 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:08.901+0000 7f230d6cf700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f23080b1ec0 0x7f230814ff40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:57:08.914 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:08.901+0000 7f230d6cf700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f230815c630 0x7f23080b2b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:57:08.914 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:08.901+0000 7f230d6cf700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2308160120 0x7f23080b0580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:57:08.914 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:08.901+0000 7f230d6cf700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23080b3490 con 0x7f2308160120 2023-07-05T18:57:08.915 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:08.901+0000 7f230d6cf700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23080b3770 con 0x7f23080b1ec0 2023-07-05T18:57:08.915 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:08.901+0000 7f230d6cf700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f23080b3a50 con 0x7f230815c630 2023-07-05T18:57:08.915 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:08.901+0000 7f23077fe700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2308160120 0x7f23080b0580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:57:08.915 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:08.901+0000 7f23077fe700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2308160120 0x7f23080b0580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:59612/0 (socket says 172.21.15.46:59612) 2023-07-05T18:57:08.915 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:08.901+0000 7f23077fe700 1 -- 172.21.15.46:0/2442836015 learned_addr learned my addr 172.21.15.46:0/2442836015 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-07-05T18:57:08.915 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:08.901+0000 7f2306ffd700 1 --2- 172.21.15.46:0/2442836015 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f23080b1ec0 0x7f230814ff40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:57:08.915 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:08.901+0000 7f23077fe700 1 -- 172.21.15.46:0/2442836015 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f230815c630 msgr2=0x7f23080b2b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:57:08.916 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:08.902+0000 7f23077fe700 1 --2- 172.21.15.46:0/2442836015 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f230815c630 0x7f23080b2b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:57:08.916 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:08.902+0000 7f23077fe700 1 -- 172.21.15.46:0/2442836015 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f23080b1ec0 msgr2=0x7f230814ff40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:57:08.916 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:08.902+0000 7f23077fe700 1 --2- 172.21.15.46:0/2442836015 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f23080b1ec0 0x7f230814ff40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:57:08.916 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:08.902+0000 7f23077fe700 1 -- 172.21.15.46:0/2442836015 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f22fc0094a0 con 0x7f2308160120 2023-07-05T18:57:08.916 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:08.902+0000 7f23077fe700 1 --2- 172.21.15.46:0/2442836015 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2308160120 0x7f23080b0580 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f230000cbc0 tx=0x7f230000cf80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-05T18:57:08.916 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:08.902+0000 7f22ef7fe700 1 -- 172.21.15.46:0/2442836015 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2300003c00 con 0x7f2308160120 2023-07-05T18:57:08.916 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:08.902+0000 7f22ef7fe700 1 -- 172.21.15.46:0/2442836015 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2300003d60 con 0x7f2308160120 2023-07-05T18:57:08.917 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:08.902+0000 7f230d6cf700 1 -- 172.21.15.46:0/2442836015 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f23080b3d30 con 0x7f2308160120 2023-07-05T18:57:08.917 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:08.902+0000 7f22ef7fe700 1 -- 172.21.15.46:0/2442836015 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f230000abf0 con 0x7f2308160120 2023-07-05T18:57:08.917 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:08.902+0000 7f230d6cf700 1 -- 172.21.15.46:0/2442836015 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f23080b3060 con 0x7f2308160120 2023-07-05T18:57:08.917 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:08.903+0000 7f230d6cf700 1 -- 172.21.15.46:0/2442836015 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f23080b4250 con 0x7f2308160120 2023-07-05T18:57:08.917 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:08.903+0000 7f22ef7fe700 1 -- 172.21.15.46:0/2442836015 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f230000ad50 con 0x7f2308160120 2023-07-05T18:57:08.917 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:08.904+0000 7f22ef7fe700 1 --2- 172.21.15.46:0/2442836015 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7f22f406ace0 0x7f22f406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:57:08.917 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:08.904+0000 7f22ef7fe700 1 -- 172.21.15.46:0/2442836015 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f23000892c0 con 0x7f2308160120 2023-07-05T18:57:08.917 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:08.904+0000 7f2306ffd700 1 --2- 172.21.15.46:0/2442836015 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7f22f406ace0 0x7f22f406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:57:08.918 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:08.905+0000 7f2306ffd700 1 --2- 172.21.15.46:0/2442836015 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7f22f406ace0 0x7f22f406d190 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f22fc0090b0 tx=0x7f22fc008030 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-05T18:57:08.918 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:08.908+0000 7f22ef7fe700 1 -- 172.21.15.46:0/2442836015 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f23080b4250 con 0x7f2308160120 2023-07-05T18:57:09.187 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:09.185+0000 7f230d6cf700 1 -- 172.21.15.46:0/2442836015 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7f23080b4250 con 0x7f2308160120 2023-07-05T18:57:09.187 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:09.185+0000 7f22ef7fe700 1 -- 172.21.15.46:0/2442836015 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v6) v1 ==== 80+0+6645 (secure 0 0 0) 0x7f23080b4250 con 0x7f2308160120 2023-07-05T18:57:09.187 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T18:57:09.188 INFO:teuthology.orchestra.run.smithi046.stdout:{ 2023-07-05T18:57:09.188 INFO:teuthology.orchestra.run.smithi046.stdout: "auth_dump": [ 2023-07-05T18:57:09.188 INFO:teuthology.orchestra.run.smithi046.stdout: { 2023-07-05T18:57:09.188 INFO:teuthology.orchestra.run.smithi046.stdout: "entity": "mds.a", 2023-07-05T18:57:09.188 INFO:teuthology.orchestra.run.smithi046.stdout: "key": "AQCcvKVkSyJqBhAAg8BNDzzXYyHzhVt+viqltQ==", 2023-07-05T18:57:09.188 INFO:teuthology.orchestra.run.smithi046.stdout: "caps": { 2023-07-05T18:57:09.189 INFO:teuthology.orchestra.run.smithi046.stdout: "mds": "allow", 2023-07-05T18:57:09.189 INFO:teuthology.orchestra.run.smithi046.stdout: "mgr": "allow *", 2023-07-05T18:57:09.189 INFO:teuthology.orchestra.run.smithi046.stdout: "mon": "allow *", 2023-07-05T18:57:09.189 INFO:teuthology.orchestra.run.smithi046.stdout: "osd": "allow *" 2023-07-05T18:57:09.189 INFO:teuthology.orchestra.run.smithi046.stdout: } 2023-07-05T18:57:09.189 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-07-05T18:57:09.189 INFO:teuthology.orchestra.run.smithi046.stdout: { 2023-07-05T18:57:09.190 INFO:teuthology.orchestra.run.smithi046.stdout: "entity": "mds.b", 2023-07-05T18:57:09.190 INFO:teuthology.orchestra.run.smithi046.stdout: "key": "AQCcvKVkooGkExAA5BtzsmXGFlxJFz6wdWWAww==", 2023-07-05T18:57:09.190 INFO:teuthology.orchestra.run.smithi046.stdout: "caps": { 2023-07-05T18:57:09.190 INFO:teuthology.orchestra.run.smithi046.stdout: "mds": "allow", 2023-07-05T18:57:09.190 INFO:teuthology.orchestra.run.smithi046.stdout: "mgr": "allow *", 2023-07-05T18:57:09.190 INFO:teuthology.orchestra.run.smithi046.stdout: "mon": "allow *", 2023-07-05T18:57:09.190 INFO:teuthology.orchestra.run.smithi046.stdout: "osd": "allow *" 2023-07-05T18:57:09.190 INFO:teuthology.orchestra.run.smithi046.stdout: } 2023-07-05T18:57:09.191 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-07-05T18:57:09.191 INFO:teuthology.orchestra.run.smithi046.stdout: { 2023-07-05T18:57:09.191 INFO:teuthology.orchestra.run.smithi046.stdout: "entity": "mds.c", 2023-07-05T18:57:09.191 INFO:teuthology.orchestra.run.smithi046.stdout: "key": "AQCcvKVkQCPnDRAA67WfGe98FpDUG7rwOHpN/A==", 2023-07-05T18:57:09.191 INFO:teuthology.orchestra.run.smithi046.stdout: "caps": { 2023-07-05T18:57:09.191 INFO:teuthology.orchestra.run.smithi046.stdout: "mds": "allow", 2023-07-05T18:57:09.191 INFO:teuthology.orchestra.run.smithi046.stdout: "mgr": "allow *", 2023-07-05T18:57:09.191 INFO:teuthology.orchestra.run.smithi046.stdout: "mon": "allow *", 2023-07-05T18:57:09.192 INFO:teuthology.orchestra.run.smithi046.stdout: "osd": "allow *" 2023-07-05T18:57:09.192 INFO:teuthology.orchestra.run.smithi046.stdout: } 2023-07-05T18:57:09.193 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-07-05T18:57:09.193 INFO:teuthology.orchestra.run.smithi046.stdout: { 2023-07-05T18:57:09.193 INFO:teuthology.orchestra.run.smithi046.stdout: "entity": "mds.d", 2023-07-05T18:57:09.193 INFO:teuthology.orchestra.run.smithi046.stdout: "key": "AQCcvKVkbgVUGxAAh0i8s6bO1YiJcx3pLpwHjA==", 2023-07-05T18:57:09.193 INFO:teuthology.orchestra.run.smithi046.stdout: "caps": { 2023-07-05T18:57:09.193 INFO:teuthology.orchestra.run.smithi046.stdout: "mds": "allow", 2023-07-05T18:57:09.193 INFO:teuthology.orchestra.run.smithi046.stdout: "mgr": "allow *", 2023-07-05T18:57:09.194 INFO:teuthology.orchestra.run.smithi046.stdout: "mon": "allow *", 2023-07-05T18:57:09.194 INFO:teuthology.orchestra.run.smithi046.stdout: "osd": "allow *" 2023-07-05T18:57:09.194 INFO:teuthology.orchestra.run.smithi046.stdout: } 2023-07-05T18:57:09.194 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-07-05T18:57:09.194 INFO:teuthology.orchestra.run.smithi046.stdout: { 2023-07-05T18:57:09.194 INFO:teuthology.orchestra.run.smithi046.stdout: "entity": "osd.0", 2023-07-05T18:57:09.194 INFO:teuthology.orchestra.run.smithi046.stdout: "key": "AQCevKVkJAjsEBAAG/M981ZejiEKWE9H9MgW3A==", 2023-07-05T18:57:09.195 INFO:teuthology.orchestra.run.smithi046.stdout: "caps": { 2023-07-05T18:57:09.195 INFO:teuthology.orchestra.run.smithi046.stdout: "mgr": "allow profile osd", 2023-07-05T18:57:09.195 INFO:teuthology.orchestra.run.smithi046.stdout: "mon": "allow profile osd", 2023-07-05T18:57:09.195 INFO:teuthology.orchestra.run.smithi046.stdout: "osd": "allow *" 2023-07-05T18:57:09.195 INFO:teuthology.orchestra.run.smithi046.stdout: } 2023-07-05T18:57:09.195 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-07-05T18:57:09.195 INFO:teuthology.orchestra.run.smithi046.stdout: { 2023-07-05T18:57:09.195 INFO:teuthology.orchestra.run.smithi046.stdout: "entity": "osd.1", 2023-07-05T18:57:09.196 INFO:teuthology.orchestra.run.smithi046.stdout: "key": "AQChvKVkGOPYEBAABUMv/LIkN/+e5PXc5SBknA==", 2023-07-05T18:57:09.196 INFO:teuthology.orchestra.run.smithi046.stdout: "caps": { 2023-07-05T18:57:09.196 INFO:teuthology.orchestra.run.smithi046.stdout: "mgr": "allow profile osd", 2023-07-05T18:57:09.197 INFO:teuthology.orchestra.run.smithi046.stdout: "mon": "allow profile osd", 2023-07-05T18:57:09.197 INFO:teuthology.orchestra.run.smithi046.stdout: "osd": "allow *" 2023-07-05T18:57:09.197 INFO:teuthology.orchestra.run.smithi046.stdout: } 2023-07-05T18:57:09.197 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-07-05T18:57:09.197 INFO:teuthology.orchestra.run.smithi046.stdout: { 2023-07-05T18:57:09.198 INFO:teuthology.orchestra.run.smithi046.stdout: "entity": "osd.2", 2023-07-05T18:57:09.198 INFO:teuthology.orchestra.run.smithi046.stdout: "key": "AQCkvKVk3nmbEBAAbKDHZnuO/x/UvH+A5bAOLQ==", 2023-07-05T18:57:09.198 INFO:teuthology.orchestra.run.smithi046.stdout: "caps": { 2023-07-05T18:57:09.198 INFO:teuthology.orchestra.run.smithi046.stdout: "mgr": "allow profile osd", 2023-07-05T18:57:09.198 INFO:teuthology.orchestra.run.smithi046.stdout: "mon": "allow profile osd", 2023-07-05T18:57:09.203 INFO:teuthology.orchestra.run.smithi046.stdout: "osd": "allow *" 2023-07-05T18:57:09.203 INFO:teuthology.orchestra.run.smithi046.stdout: } 2023-07-05T18:57:09.203 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-07-05T18:57:09.203 INFO:teuthology.orchestra.run.smithi046.stdout: { 2023-07-05T18:57:09.203 INFO:teuthology.orchestra.run.smithi046.stdout: "entity": "osd.3", 2023-07-05T18:57:09.204 INFO:teuthology.orchestra.run.smithi046.stdout: "key": "AQCnvKVkAGs3EBAAXcRN+CCYBniZkxD5JxV40Q==", 2023-07-05T18:57:09.204 INFO:teuthology.orchestra.run.smithi046.stdout: "caps": { 2023-07-05T18:57:09.204 INFO:teuthology.orchestra.run.smithi046.stdout: "mgr": "allow profile osd", 2023-07-05T18:57:09.204 INFO:teuthology.orchestra.run.smithi046.stdout: "mon": "allow profile osd", 2023-07-05T18:57:09.204 INFO:teuthology.orchestra.run.smithi046.stdout: "osd": "allow *" 2023-07-05T18:57:09.204 INFO:teuthology.orchestra.run.smithi046.stdout: } 2023-07-05T18:57:09.204 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-07-05T18:57:09.205 INFO:teuthology.orchestra.run.smithi046.stdout: { 2023-07-05T18:57:09.205 INFO:teuthology.orchestra.run.smithi046.stdout: "entity": "osd.4", 2023-07-05T18:57:09.205 INFO:teuthology.orchestra.run.smithi046.stdout: "key": "AQCtvKVkGzJQFxAAe8+vmDgU0bgrOGbGtG3epQ==", 2023-07-05T18:57:09.205 INFO:teuthology.orchestra.run.smithi046.stdout: "caps": { 2023-07-05T18:57:09.206 INFO:teuthology.orchestra.run.smithi046.stdout: "mgr": "allow profile osd", 2023-07-05T18:57:09.206 INFO:teuthology.orchestra.run.smithi046.stdout: "mon": "allow profile osd", 2023-07-05T18:57:09.206 INFO:teuthology.orchestra.run.smithi046.stdout: "osd": "allow *" 2023-07-05T18:57:09.206 INFO:teuthology.orchestra.run.smithi046.stdout: } 2023-07-05T18:57:09.206 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-07-05T18:57:09.206 INFO:teuthology.orchestra.run.smithi046.stdout: { 2023-07-05T18:57:09.206 INFO:teuthology.orchestra.run.smithi046.stdout: "entity": "osd.5", 2023-07-05T18:57:09.206 INFO:teuthology.orchestra.run.smithi046.stdout: "key": "AQCwvKVkAGJsFhAAKBzz0ePGRD7wLLrbI8MyqQ==", 2023-07-05T18:57:09.207 INFO:teuthology.orchestra.run.smithi046.stdout: "caps": { 2023-07-05T18:57:09.207 INFO:teuthology.orchestra.run.smithi046.stdout: "mgr": "allow profile osd", 2023-07-05T18:57:09.208 INFO:teuthology.orchestra.run.smithi046.stdout: "mon": "allow profile osd", 2023-07-05T18:57:09.208 INFO:teuthology.orchestra.run.smithi046.stdout: "osd": "allow *" 2023-07-05T18:57:09.208 INFO:teuthology.orchestra.run.smithi046.stdout: } 2023-07-05T18:57:09.208 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-07-05T18:57:09.208 INFO:teuthology.orchestra.run.smithi046.stdout: { 2023-07-05T18:57:09.208 INFO:teuthology.orchestra.run.smithi046.stdout: "entity": "osd.6", 2023-07-05T18:57:09.209 INFO:teuthology.orchestra.run.smithi046.stdout: "key": "AQCzvKVkSvAeFhAAAjyu21p6+GFiRUWefuXs7w==", 2023-07-05T18:57:09.209 INFO:teuthology.orchestra.run.smithi046.stdout: "caps": { 2023-07-05T18:57:09.209 INFO:teuthology.orchestra.run.smithi046.stdout: "mgr": "allow profile osd", 2023-07-05T18:57:09.209 INFO:teuthology.orchestra.run.smithi046.stdout: "mon": "allow profile osd", 2023-07-05T18:57:09.209 INFO:teuthology.orchestra.run.smithi046.stdout: "osd": "allow *" 2023-07-05T18:57:09.209 INFO:teuthology.orchestra.run.smithi046.stdout: } 2023-07-05T18:57:09.209 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-07-05T18:57:09.209 INFO:teuthology.orchestra.run.smithi046.stdout: { 2023-07-05T18:57:09.210 INFO:teuthology.orchestra.run.smithi046.stdout: "entity": "osd.7", 2023-07-05T18:57:09.210 INFO:teuthology.orchestra.run.smithi046.stdout: "key": "AQC2vKVk03JIFxAAf5MH+S9FhbPXG/ex1AoAAQ==", 2023-07-05T18:57:09.211 INFO:teuthology.orchestra.run.smithi046.stdout: "caps": { 2023-07-05T18:57:09.211 INFO:teuthology.orchestra.run.smithi046.stdout: "mgr": "allow profile osd", 2023-07-05T18:57:09.212 INFO:teuthology.orchestra.run.smithi046.stdout: "mon": "allow profile osd", 2023-07-05T18:57:09.212 INFO:teuthology.orchestra.run.smithi046.stdout: "osd": "allow *" 2023-07-05T18:57:09.212 INFO:teuthology.orchestra.run.smithi046.stdout: } 2023-07-05T18:57:09.212 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-07-05T18:57:09.212 INFO:teuthology.orchestra.run.smithi046.stdout: { 2023-07-05T18:57:09.212 INFO:teuthology.orchestra.run.smithi046.stdout: "entity": "client.0", 2023-07-05T18:57:09.212 INFO:teuthology.orchestra.run.smithi046.stdout: "key": "AQCcvKVkPxf4HxAALyNjHQc594Dg6fVfsq01hQ==", 2023-07-05T18:57:09.213 INFO:teuthology.orchestra.run.smithi046.stdout: "caps": { 2023-07-05T18:57:09.213 INFO:teuthology.orchestra.run.smithi046.stdout: "mds": "allow", 2023-07-05T18:57:09.213 INFO:teuthology.orchestra.run.smithi046.stdout: "mgr": "allow r", 2023-07-05T18:57:09.213 INFO:teuthology.orchestra.run.smithi046.stdout: "mon": "allow rw", 2023-07-05T18:57:09.213 INFO:teuthology.orchestra.run.smithi046.stdout: "osd": "allow rwx" 2023-07-05T18:57:09.213 INFO:teuthology.orchestra.run.smithi046.stdout: } 2023-07-05T18:57:09.213 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-07-05T18:57:09.213 INFO:teuthology.orchestra.run.smithi046.stdout: { 2023-07-05T18:57:09.214 INFO:teuthology.orchestra.run.smithi046.stdout: "entity": "client.1", 2023-07-05T18:57:09.214 INFO:teuthology.orchestra.run.smithi046.stdout: "key": "AQCcvKVkP39nJxAA20ddJDd4HtNA+LRLCTPXrg==", 2023-07-05T18:57:09.214 INFO:teuthology.orchestra.run.smithi046.stdout: "caps": { 2023-07-05T18:57:09.214 INFO:teuthology.orchestra.run.smithi046.stdout: "mds": "allow", 2023-07-05T18:57:09.214 INFO:teuthology.orchestra.run.smithi046.stdout: "mgr": "allow r", 2023-07-05T18:57:09.214 INFO:teuthology.orchestra.run.smithi046.stdout: "mon": "allow rw", 2023-07-05T18:57:09.214 INFO:teuthology.orchestra.run.smithi046.stdout: "osd": "allow rwx" 2023-07-05T18:57:09.214 INFO:teuthology.orchestra.run.smithi046.stdout: } 2023-07-05T18:57:09.215 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-07-05T18:57:09.215 INFO:teuthology.orchestra.run.smithi046.stdout: { 2023-07-05T18:57:09.215 INFO:teuthology.orchestra.run.smithi046.stdout: "entity": "client.2", 2023-07-05T18:57:09.215 INFO:teuthology.orchestra.run.smithi046.stdout: "key": "AQCcvKVkEHWDIxAAq2we83Gx4nijR7SjOOgtJg==", 2023-07-05T18:57:09.215 INFO:teuthology.orchestra.run.smithi046.stdout: "caps": { 2023-07-05T18:57:09.215 INFO:teuthology.orchestra.run.smithi046.stdout: "mds": "allow", 2023-07-05T18:57:09.215 INFO:teuthology.orchestra.run.smithi046.stdout: "mgr": "allow r", 2023-07-05T18:57:09.216 INFO:teuthology.orchestra.run.smithi046.stdout: "mon": "allow rw", 2023-07-05T18:57:09.216 INFO:teuthology.orchestra.run.smithi046.stdout: "osd": "allow rwx" 2023-07-05T18:57:09.216 INFO:teuthology.orchestra.run.smithi046.stdout: } 2023-07-05T18:57:09.216 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-07-05T18:57:09.216 INFO:teuthology.orchestra.run.smithi046.stdout: { 2023-07-05T18:57:09.216 INFO:teuthology.orchestra.run.smithi046.stdout: "entity": "client.3", 2023-07-05T18:57:09.216 INFO:teuthology.orchestra.run.smithi046.stdout: "key": "AQCcvKVkIs9NLRAArWr6ilA75p0/9/fcl5uC1Q==", 2023-07-05T18:57:09.216 INFO:teuthology.orchestra.run.smithi046.stdout: "caps": { 2023-07-05T18:57:09.217 INFO:teuthology.orchestra.run.smithi046.stdout: "mds": "allow", 2023-07-05T18:57:09.217 INFO:teuthology.orchestra.run.smithi046.stdout: "mgr": "allow r", 2023-07-05T18:57:09.217 INFO:teuthology.orchestra.run.smithi046.stdout: "mon": "allow rw", 2023-07-05T18:57:09.217 INFO:teuthology.orchestra.run.smithi046.stdout: "osd": "allow rwx" 2023-07-05T18:57:09.217 INFO:teuthology.orchestra.run.smithi046.stdout: } 2023-07-05T18:57:09.217 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-07-05T18:57:09.217 INFO:teuthology.orchestra.run.smithi046.stdout: { 2023-07-05T18:57:09.217 INFO:teuthology.orchestra.run.smithi046.stdout: "entity": "client.admin", 2023-07-05T18:57:09.218 INFO:teuthology.orchestra.run.smithi046.stdout: "key": "AQCbvKVkpp1TIhAAvJTELoeH8wkIFqjtppg17w==", 2023-07-05T18:57:09.218 INFO:teuthology.orchestra.run.smithi046.stdout: "caps": { 2023-07-05T18:57:09.218 INFO:teuthology.orchestra.run.smithi046.stdout: "mds": "allow *", 2023-07-05T18:57:09.218 INFO:teuthology.orchestra.run.smithi046.stdout: "mgr": "allow *", 2023-07-05T18:57:09.218 INFO:teuthology.orchestra.run.smithi046.stdout: "mon": "allow *", 2023-07-05T18:57:09.218 INFO:teuthology.orchestra.run.smithi046.stdout: "osd": "allow *" 2023-07-05T18:57:09.218 INFO:teuthology.orchestra.run.smithi046.stdout: } 2023-07-05T18:57:09.219 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-07-05T18:57:09.219 INFO:teuthology.orchestra.run.smithi046.stdout: { 2023-07-05T18:57:09.219 INFO:teuthology.orchestra.run.smithi046.stdout: "entity": "client.bootstrap-mds", 2023-07-05T18:57:09.219 INFO:teuthology.orchestra.run.smithi046.stdout: "key": "AQC8vKVkZUAwGxAAOdqz3JJUwV2zWv7lR49J2w==", 2023-07-05T18:57:09.219 INFO:teuthology.orchestra.run.smithi046.stdout: "caps": { 2023-07-05T18:57:09.219 INFO:teuthology.orchestra.run.smithi046.stdout: "mon": "allow profile bootstrap-mds" 2023-07-05T18:57:09.220 INFO:teuthology.orchestra.run.smithi046.stdout: } 2023-07-05T18:57:09.220 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-07-05T18:57:09.220 INFO:teuthology.orchestra.run.smithi046.stdout: { 2023-07-05T18:57:09.220 INFO:teuthology.orchestra.run.smithi046.stdout: "entity": "client.bootstrap-mgr", 2023-07-05T18:57:09.220 INFO:teuthology.orchestra.run.smithi046.stdout: "key": "AQC8vKVki0swGxAAA1p3NhYwSAnVvujz0lJCTg==", 2023-07-05T18:57:09.220 INFO:teuthology.orchestra.run.smithi046.stdout: "caps": { 2023-07-05T18:57:09.220 INFO:teuthology.orchestra.run.smithi046.stdout: "mon": "allow profile bootstrap-mgr" 2023-07-05T18:57:09.221 INFO:teuthology.orchestra.run.smithi046.stdout: } 2023-07-05T18:57:09.221 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-07-05T18:57:09.221 INFO:teuthology.orchestra.run.smithi046.stdout: { 2023-07-05T18:57:09.221 INFO:teuthology.orchestra.run.smithi046.stdout: "entity": "client.bootstrap-osd", 2023-07-05T18:57:09.221 INFO:teuthology.orchestra.run.smithi046.stdout: "key": "AQC8vKVk9lMwGxAAQ6dyuNfziBsBwUBKbEYuXA==", 2023-07-05T18:57:09.221 INFO:teuthology.orchestra.run.smithi046.stdout: "caps": { 2023-07-05T18:57:09.221 INFO:teuthology.orchestra.run.smithi046.stdout: "mon": "allow profile bootstrap-osd" 2023-07-05T18:57:09.221 INFO:teuthology.orchestra.run.smithi046.stdout: } 2023-07-05T18:57:09.222 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-07-05T18:57:09.222 INFO:teuthology.orchestra.run.smithi046.stdout: { 2023-07-05T18:57:09.222 INFO:teuthology.orchestra.run.smithi046.stdout: "entity": "client.bootstrap-rbd", 2023-07-05T18:57:09.222 INFO:teuthology.orchestra.run.smithi046.stdout: "key": "AQC8vKVknF0wGxAACtSwFUlYLdCqAGvvfz4TxQ==", 2023-07-05T18:57:09.222 INFO:teuthology.orchestra.run.smithi046.stdout: "caps": { 2023-07-05T18:57:09.222 INFO:teuthology.orchestra.run.smithi046.stdout: "mon": "allow profile bootstrap-rbd" 2023-07-05T18:57:09.222 INFO:teuthology.orchestra.run.smithi046.stdout: } 2023-07-05T18:57:09.222 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-07-05T18:57:09.223 INFO:teuthology.orchestra.run.smithi046.stdout: { 2023-07-05T18:57:09.223 INFO:teuthology.orchestra.run.smithi046.stdout: "entity": "client.bootstrap-rbd-mirror", 2023-07-05T18:57:09.223 INFO:teuthology.orchestra.run.smithi046.stdout: "key": "AQC8vKVkB2YwGxAApEzziOMJ8npFIIGj+4ZaIQ==", 2023-07-05T18:57:09.223 INFO:teuthology.orchestra.run.smithi046.stdout: "caps": { 2023-07-05T18:57:09.223 INFO:teuthology.orchestra.run.smithi046.stdout: "mon": "allow profile bootstrap-rbd-mirror" 2023-07-05T18:57:09.223 INFO:teuthology.orchestra.run.smithi046.stdout: } 2023-07-05T18:57:09.223 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-07-05T18:57:09.223 INFO:teuthology.orchestra.run.smithi046.stdout: { 2023-07-05T18:57:09.224 INFO:teuthology.orchestra.run.smithi046.stdout: "entity": "client.bootstrap-rgw", 2023-07-05T18:57:09.224 INFO:teuthology.orchestra.run.smithi046.stdout: "key": "AQC8vKVkiW4wGxAA43zwBhFMbABOL2clLRf1ow==", 2023-07-05T18:57:09.224 INFO:teuthology.orchestra.run.smithi046.stdout: "caps": { 2023-07-05T18:57:09.224 INFO:teuthology.orchestra.run.smithi046.stdout: "mon": "allow profile bootstrap-rgw" 2023-07-05T18:57:09.225 INFO:teuthology.orchestra.run.smithi046.stdout: } 2023-07-05T18:57:09.225 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-07-05T18:57:09.225 INFO:teuthology.orchestra.run.smithi046.stdout: { 2023-07-05T18:57:09.225 INFO:teuthology.orchestra.run.smithi046.stdout: "entity": "mgr.x", 2023-07-05T18:57:09.225 INFO:teuthology.orchestra.run.smithi046.stdout: "key": "AQCcvKVkvWrFAhAA/Aqe9qlW5+uCL0TUTPXuhA==", 2023-07-05T18:57:09.225 INFO:teuthology.orchestra.run.smithi046.stdout: "caps": { 2023-07-05T18:57:09.225 INFO:teuthology.orchestra.run.smithi046.stdout: "mds": "allow *", 2023-07-05T18:57:09.225 INFO:teuthology.orchestra.run.smithi046.stdout: "mon": "allow profile mgr", 2023-07-05T18:57:09.226 INFO:teuthology.orchestra.run.smithi046.stdout: "osd": "allow *" 2023-07-05T18:57:09.226 INFO:teuthology.orchestra.run.smithi046.stdout: } 2023-07-05T18:57:09.226 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-07-05T18:57:09.226 INFO:teuthology.orchestra.run.smithi046.stdout: { 2023-07-05T18:57:09.226 INFO:teuthology.orchestra.run.smithi046.stdout: "entity": "mgr.y", 2023-07-05T18:57:09.226 INFO:teuthology.orchestra.run.smithi046.stdout: "key": "AQCbvKVkmAeGORAARtEgzTDqIi/PI4u7OEey0g==", 2023-07-05T18:57:09.226 INFO:teuthology.orchestra.run.smithi046.stdout: "caps": { 2023-07-05T18:57:09.226 INFO:teuthology.orchestra.run.smithi046.stdout: "mds": "allow *", 2023-07-05T18:57:09.227 INFO:teuthology.orchestra.run.smithi046.stdout: "mon": "allow profile mgr", 2023-07-05T18:57:09.227 INFO:teuthology.orchestra.run.smithi046.stdout: "osd": "allow *" 2023-07-05T18:57:09.227 INFO:teuthology.orchestra.run.smithi046.stdout: } 2023-07-05T18:57:09.227 INFO:teuthology.orchestra.run.smithi046.stdout: } 2023-07-05T18:57:09.227 INFO:teuthology.orchestra.run.smithi046.stdout: ] 2023-07-05T18:57:09.227 INFO:teuthology.orchestra.run.smithi046.stdout:} 2023-07-05T18:57:09.229 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:09.187+0000 7f230d6cf700 1 -- 172.21.15.46:0/2442836015 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7f22f406ace0 msgr2=0x7f22f406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:57:09.229 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:09.187+0000 7f230d6cf700 1 --2- 172.21.15.46:0/2442836015 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7f22f406ace0 0x7f22f406d190 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f22fc0090b0 tx=0x7f22fc008030 comp rx=0 tx=0).stop 2023-07-05T18:57:09.229 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:09.187+0000 7f230d6cf700 1 -- 172.21.15.46:0/2442836015 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2308160120 msgr2=0x7f23080b0580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:57:09.229 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:09.187+0000 7f230d6cf700 1 --2- 172.21.15.46:0/2442836015 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2308160120 0x7f23080b0580 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f230000cbc0 tx=0x7f230000cf80 comp rx=0 tx=0).stop 2023-07-05T18:57:09.229 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:09.188+0000 7f230d6cf700 1 -- 172.21.15.46:0/2442836015 shutdown_connections 2023-07-05T18:57:09.229 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:09.188+0000 7f230d6cf700 1 --2- 172.21.15.46:0/2442836015 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7f22f406ace0 0x7f22f406d190 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:57:09.230 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:09.188+0000 7f230d6cf700 1 --2- 172.21.15.46:0/2442836015 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2308160120 0x7f23080b0580 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:57:09.230 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:09.188+0000 7f230d6cf700 1 --2- 172.21.15.46:0/2442836015 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f23080b1ec0 0x7f230814ff40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:57:09.230 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:09.188+0000 7f230d6cf700 1 --2- 172.21.15.46:0/2442836015 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f230815c630 0x7f23080b2b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:57:09.230 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:09.188+0000 7f230d6cf700 1 -- 172.21.15.46:0/2442836015 >> 172.21.15.46:0/2442836015 conn(0x7f230806af10 msgr2=0x7f2308072e50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-05T18:57:09.230 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:09.188+0000 7f230d6cf700 1 -- 172.21.15.46:0/2442836015 shutdown_connections 2023-07-05T18:57:09.230 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:09.188+0000 7f230d6cf700 1 -- 172.21.15.46:0/2442836015 wait complete. 2023-07-05T18:57:09.231 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-mds 2023-07-05T18:57:09.359 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:09.356+0000 7fdf8f494700 1 Processor -- start 2023-07-05T18:57:09.360 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:09.356+0000 7fdf8f494700 1 -- start start 2023-07-05T18:57:09.360 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:09.357+0000 7fdf8f494700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fdf88156c10 0x7fdf88071070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:57:09.360 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:09.357+0000 7fdf8f494700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fdf880cee10 0x7fdf8815ca00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:57:09.360 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:09.357+0000 7fdf8f494700 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdf8806a710 con 0x7fdf880715b0 2023-07-05T18:57:09.361 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:09.357+0000 7fdf8f494700 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdf88071a50 con 0x7fdf88156c10 2023-07-05T18:57:09.361 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:09.357+0000 7fdf8f494700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdf88160040 con 0x7fdf880cee10 2023-07-05T18:57:09.361 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:09.357+0000 7fdf8ca2f700 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7fdf880715b0 0x7fdf880ce700 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:58888/0 (socket says 172.21.15.46:58888) 2023-07-05T18:57:09.361 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:09.357+0000 7fdf8ca2f700 1 -- 172.21.15.46:0/316606317 learned_addr learned my addr 172.21.15.46:0/316606317 (peer_addr_for_me v1:172.21.15.46:0/0) 2023-07-05T18:57:09.361 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:09.358+0000 7fdf8d230700 1 --2- 172.21.15.46:0/316606317 >> v2:172.21.15.73:3300/0 conn(0x7fdf88156c10 0x7fdf88071070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:57:09.361 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:09.358+0000 7fdf8da31700 1 --2- 172.21.15.46:0/316606317 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fdf880cee10 0x7fdf8815ca00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:57:09.361 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:09.358+0000 7fdf7ffff700 1 -- 172.21.15.46:0/316606317 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1565702736 0 0) 0x7fdf8806a710 con 0x7fdf880715b0 2023-07-05T18:57:09.362 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:09.358+0000 7fdf7ffff700 1 -- 172.21.15.46:0/316606317 --> v1:172.21.15.46:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdf740035b0 con 0x7fdf880715b0 2023-07-05T18:57:09.364 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:09.358+0000 7fdf8d230700 1 -- 172.21.15.46:0/316606317 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fdf880cee10 msgr2=0x7fdf8815ca00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-05T18:57:09.365 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:09.358+0000 7fdf8d230700 1 --2- 172.21.15.46:0/316606317 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fdf880cee10 0x7fdf8815ca00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:57:09.365 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:09.358+0000 7fdf7ffff700 1 -- 172.21.15.46:0/316606317 <== mon.0 v1:172.21.15.46:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 847346650 0 0) 0x7fdf740035b0 con 0x7fdf880715b0 2023-07-05T18:57:09.365 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:09.358+0000 7fdf8d230700 1 -- 172.21.15.46:0/316606317 >> v1:172.21.15.46:6789/0 conn(0x7fdf880715b0 legacy=0x7fdf880ce700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:57:09.365 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:09.358+0000 7fdf8d230700 1 -- 172.21.15.46:0/316606317 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdf88069e00 con 0x7fdf88156c10 2023-07-05T18:57:09.365 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:09.358+0000 7fdf8d230700 1 --2- 172.21.15.46:0/316606317 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fdf88156c10 0x7fdf88071070 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fdf78009820 tx=0x7fdf78009b30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b8eafb4e32889b10 server_cookie=0 in_seq=0 out_seq=0 2023-07-05T18:57:09.365 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:09.358+0000 7fdf7ffff700 1 -- 172.21.15.46:0/316606317 <== mon.1 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf84001670 con 0x7fdf88156c10 2023-07-05T18:57:09.365 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:09.358+0000 7fdf7ffff700 1 -- 172.21.15.46:0/316606317 <== mon.1 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdf78005c30 con 0x7fdf88156c10 2023-07-05T18:57:09.366 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:09.358+0000 7fdf7ffff700 1 -- 172.21.15.46:0/316606317 <== mon.1 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf78004030 con 0x7fdf88156c10 2023-07-05T18:57:09.366 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:09.359+0000 7fdf8f494700 1 -- 172.21.15.46:0/316606317 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fdf88156c10 msgr2=0x7fdf88071070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:57:09.366 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:09.359+0000 7fdf8f494700 1 --2- 172.21.15.46:0/316606317 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fdf88156c10 0x7fdf88071070 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fdf78009820 tx=0x7fdf78009b30 comp rx=0 tx=0).stop 2023-07-05T18:57:09.366 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:09.359+0000 7fdf8f494700 1 -- 172.21.15.46:0/316606317 shutdown_connections 2023-07-05T18:57:09.366 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:09.359+0000 7fdf8f494700 1 --2- 172.21.15.46:0/316606317 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fdf880cee10 0x7fdf8815ca00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:57:09.366 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:09.359+0000 7fdf8f494700 1 --2- 172.21.15.46:0/316606317 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fdf88156c10 0x7fdf88071070 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:57:09.366 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:09.359+0000 7fdf8f494700 1 -- 172.21.15.46:0/316606317 >> 172.21.15.46:0/316606317 conn(0x7fdf880cf9a0 msgr2=0x7fdf880cfda0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-05T18:57:09.366 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:09.359+0000 7fdf8f494700 1 -- 172.21.15.46:0/316606317 shutdown_connections 2023-07-05T18:57:09.367 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:09.359+0000 7fdf8f494700 1 -- 172.21.15.46:0/316606317 wait complete. 2023-07-05T18:57:09.367 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:09.360+0000 7fdf8f494700 1 Processor -- start 2023-07-05T18:57:09.367 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:09.360+0000 7fdf8f494700 1 -- start start 2023-07-05T18:57:09.367 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:09.361+0000 7fdf8f494700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fdf880715b0 0x7fdf88156000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:57:09.367 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:09.361+0000 7fdf8f494700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fdf880cee10 0x7fdf880b53e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:57:09.367 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:09.361+0000 7fdf8f494700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fdf88156c10 0x7fdf880b3110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:57:09.367 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:09.361+0000 7fdf8f494700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf881486a0 con 0x7fdf88156c10 2023-07-05T18:57:09.368 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:09.361+0000 7fdf8f494700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf88147f20 con 0x7fdf880cee10 2023-07-05T18:57:09.368 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:09.361+0000 7fdf8f494700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdf881480b0 con 0x7fdf880715b0 2023-07-05T18:57:09.368 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:09.361+0000 7fdf8da31700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fdf88156c10 0x7fdf880b3110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:57:09.368 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:09.361+0000 7fdf8da31700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fdf88156c10 0x7fdf880b3110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:59626/0 (socket says 172.21.15.46:59626) 2023-07-05T18:57:09.368 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:09.361+0000 7fdf8da31700 1 -- 172.21.15.46:0/1405650850 learned_addr learned my addr 172.21.15.46:0/1405650850 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-07-05T18:57:09.368 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:09.361+0000 7fdf8ca2f700 1 --2- 172.21.15.46:0/1405650850 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fdf880cee10 0x7fdf880b53e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:57:09.368 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:09.361+0000 7fdf8da31700 1 -- 172.21.15.46:0/1405650850 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fdf880715b0 msgr2=0x7fdf88156000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:57:09.368 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:09.361+0000 7fdf8d230700 1 --2- 172.21.15.46:0/1405650850 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fdf880715b0 0x7fdf88156000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:57:09.369 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:09.361+0000 7fdf8da31700 1 --2- 172.21.15.46:0/1405650850 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fdf880715b0 0x7fdf88156000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:57:09.369 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:09.361+0000 7fdf8da31700 1 -- 172.21.15.46:0/1405650850 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fdf880cee10 msgr2=0x7fdf880b53e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:57:09.369 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:09.361+0000 7fdf8da31700 1 --2- 172.21.15.46:0/1405650850 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fdf880cee10 0x7fdf880b53e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:57:09.369 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:09.361+0000 7fdf8da31700 1 -- 172.21.15.46:0/1405650850 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdf78009430 con 0x7fdf88156c10 2023-07-05T18:57:09.369 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:09.361+0000 7fdf8ca2f700 1 --2- 172.21.15.46:0/1405650850 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fdf880cee10 0x7fdf880b53e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-05T18:57:09.369 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:09.361+0000 7fdf8da31700 1 --2- 172.21.15.46:0/1405650850 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fdf88156c10 0x7fdf880b3110 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7fdf8000efc0 tx=0x7fdf8000c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-05T18:57:09.369 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:09.362+0000 7fdf7dffb700 1 -- 172.21.15.46:0/1405650850 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf8000cd40 con 0x7fdf88156c10 2023-07-05T18:57:09.370 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:09.362+0000 7fdf7dffb700 1 -- 172.21.15.46:0/1405650850 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdf8000f040 con 0x7fdf88156c10 2023-07-05T18:57:09.370 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:09.362+0000 7fdf8f494700 1 -- 172.21.15.46:0/1405650850 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdf880b1ec0 con 0x7fdf88156c10 2023-07-05T18:57:09.370 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:09.362+0000 7fdf7dffb700 1 -- 172.21.15.46:0/1405650850 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf800146c0 con 0x7fdf88156c10 2023-07-05T18:57:09.370 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:09.362+0000 7fdf8f494700 1 -- 172.21.15.46:0/1405650850 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdf881482c0 con 0x7fdf88156c10 2023-07-05T18:57:09.370 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:09.363+0000 7fdf8f494700 1 -- 172.21.15.46:0/1405650850 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdf880672e0 con 0x7fdf88156c10 2023-07-05T18:57:09.371 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:09.363+0000 7fdf7dffb700 1 -- 172.21.15.46:0/1405650850 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fdf80014820 con 0x7fdf88156c10 2023-07-05T18:57:09.372 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:09.364+0000 7fdf7dffb700 1 --2- 172.21.15.46:0/1405650850 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7fdf6c06ace0 0x7fdf6c06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:57:09.372 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:09.364+0000 7fdf7dffb700 1 -- 172.21.15.46:0/1405650850 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 5210+0+0 (secure 0 0 0) 0x7fdf80089a90 con 0x7fdf88156c10 2023-07-05T18:57:09.372 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:09.364+0000 7fdf8d230700 1 --2- 172.21.15.46:0/1405650850 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7fdf6c06ace0 0x7fdf6c06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:57:09.372 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:09.364+0000 7fdf8d230700 1 --2- 172.21.15.46:0/1405650850 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7fdf6c06ace0 0x7fdf6c06d190 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fdf7800a010 tx=0x7fdf78008070 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-05T18:57:09.372 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:09.368+0000 7fdf7dffb700 1 -- 172.21.15.46:0/1405650850 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fdf80058920 con 0x7fdf88156c10 2023-07-05T18:57:09.651 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:09.649+0000 7fdf8f494700 1 -- 172.21.15.46:0/1405650850 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-mds"} v 0) v1 -- 0x7fdf88070c20 con 0x7fdf88156c10 2023-07-05T18:57:09.654 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:09.652+0000 7fdf7dffb700 1 -- 172.21.15.46:0/1405650850 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-mds"}]=0 v7) v1 ==== 90+0+0 (secure 0 0 0) 0x7fdf8000cea0 con 0x7fdf88156c10 2023-07-05T18:57:09.661 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:09.655+0000 7fdf8f494700 1 -- 172.21.15.46:0/1405650850 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7fdf6c06ace0 msgr2=0x7fdf6c06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:57:09.661 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:09.655+0000 7fdf8f494700 1 --2- 172.21.15.46:0/1405650850 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7fdf6c06ace0 0x7fdf6c06d190 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fdf7800a010 tx=0x7fdf78008070 comp rx=0 tx=0).stop 2023-07-05T18:57:09.661 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:09.655+0000 7fdf8f494700 1 -- 172.21.15.46:0/1405650850 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fdf88156c10 msgr2=0x7fdf880b3110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:57:09.662 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:09.655+0000 7fdf8f494700 1 --2- 172.21.15.46:0/1405650850 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fdf88156c10 0x7fdf880b3110 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7fdf8000efc0 tx=0x7fdf8000c3a0 comp rx=0 tx=0).stop 2023-07-05T18:57:09.662 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:09.655+0000 7fdf8f494700 1 -- 172.21.15.46:0/1405650850 shutdown_connections 2023-07-05T18:57:09.662 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:09.655+0000 7fdf8f494700 1 --2- 172.21.15.46:0/1405650850 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7fdf6c06ace0 0x7fdf6c06d190 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:57:09.664 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:09.655+0000 7fdf8f494700 1 --2- 172.21.15.46:0/1405650850 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fdf88156c10 0x7fdf880b3110 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:57:09.664 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:09.655+0000 7fdf8f494700 1 --2- 172.21.15.46:0/1405650850 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fdf880715b0 0x7fdf88156000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:57:09.665 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:09.655+0000 7fdf8f494700 1 --2- 172.21.15.46:0/1405650850 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fdf880cee10 0x7fdf880b53e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:57:09.665 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:09.655+0000 7fdf8f494700 1 -- 172.21.15.46:0/1405650850 >> 172.21.15.46:0/1405650850 conn(0x7fdf880cf9a0 msgr2=0x7fdf880ac860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-05T18:57:09.665 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:09.655+0000 7fdf8f494700 1 -- 172.21.15.46:0/1405650850 shutdown_connections 2023-07-05T18:57:09.665 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:09.655+0000 7fdf8f494700 1 -- 172.21.15.46:0/1405650850 wait complete. 2023-07-05T18:57:09.672 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-mgr 2023-07-05T18:57:09.800 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:09.798+0000 7f17b2cd7700 1 Processor -- start 2023-07-05T18:57:09.801 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:09.798+0000 7f17b2cd7700 1 -- start start 2023-07-05T18:57:09.803 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:09.799+0000 7f17b2cd7700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f17ac15c2f0 0x7f17ac0cd2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:57:09.803 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:09.799+0000 7f17b2cd7700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f17ac15c6c0 0x7f17ac06c760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:57:09.804 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:09.799+0000 7f17b2cd7700 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f17ac0cd8c0 con 0x7f17ac0b5ae0 2023-07-05T18:57:09.804 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:09.799+0000 7f17b2cd7700 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f17ac0d0990 con 0x7f17ac15c6c0 2023-07-05T18:57:09.804 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:09.799+0000 7f17b2cd7700 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f17ac0d0c70 con 0x7f17ac15c2f0 2023-07-05T18:57:09.804 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:09.799+0000 7f17abfff700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f17ac15c6c0 0x7f17ac06c760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:57:09.804 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:09.799+0000 7f17b1274700 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7f17ac0b5ae0 0x7f17ac0d1450 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:58906/0 (socket says 172.21.15.46:58906) 2023-07-05T18:57:09.804 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:09.799+0000 7f17b1274700 1 -- 172.21.15.46:0/2353870720 learned_addr learned my addr 172.21.15.46:0/2353870720 (peer_addr_for_me v1:172.21.15.46:0/0) 2023-07-05T18:57:09.805 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:09.800+0000 7f17b0a73700 1 --2- 172.21.15.46:0/2353870720 >> v2:172.21.15.73:3300/0 conn(0x7f17ac15c2f0 0x7f17ac0cd2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:57:09.805 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:09.800+0000 7f17abfff700 1 -- 172.21.15.46:0/2353870720 >> v2:172.21.15.73:3300/0 conn(0x7f17ac15c2f0 msgr2=0x7f17ac0cd2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-05T18:57:09.805 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:09.800+0000 7f17abfff700 1 --2- 172.21.15.46:0/2353870720 >> v2:172.21.15.73:3300/0 conn(0x7f17ac15c2f0 0x7f17ac0cd2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:57:09.805 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:09.800+0000 7f17abfff700 1 -- 172.21.15.46:0/2353870720 >> v1:172.21.15.46:6789/0 conn(0x7f17ac0b5ae0 legacy=0x7f17ac0d1450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:57:09.805 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:09.800+0000 7f17ab7fe700 1 -- 172.21.15.46:0/2353870720 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1635713143 0 0) 0x7f17ac0cd8c0 con 0x7f17ac0b5ae0 2023-07-05T18:57:09.805 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:09.800+0000 7f17abfff700 1 -- 172.21.15.46:0/2353870720 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f17ac0d0f50 con 0x7f17ac15c6c0 2023-07-05T18:57:09.806 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:09.800+0000 7f17abfff700 1 --2- 172.21.15.46:0/2353870720 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f17ac15c6c0 0x7f17ac06c760 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f17ac0cf670 tx=0x7f1798009b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=51e4087a5c427d82 server_cookie=0 in_seq=0 out_seq=0 2023-07-05T18:57:09.806 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:09.800+0000 7f17ab7fe700 1 -- 172.21.15.46:0/2353870720 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1798011830 con 0x7f17ac15c6c0 2023-07-05T18:57:09.806 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:09.800+0000 7f17ab7fe700 1 -- 172.21.15.46:0/2353870720 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1798011990 con 0x7f17ac15c6c0 2023-07-05T18:57:09.806 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:09.800+0000 7f17ab7fe700 1 -- 172.21.15.46:0/2353870720 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1798011d20 con 0x7f17ac15c6c0 2023-07-05T18:57:09.806 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:09.801+0000 7f17b2cd7700 1 -- 172.21.15.46:0/2353870720 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f17ac15c6c0 msgr2=0x7f17ac06c760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:57:09.807 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:09.801+0000 7f17b2cd7700 1 --2- 172.21.15.46:0/2353870720 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f17ac15c6c0 0x7f17ac06c760 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f17ac0cf670 tx=0x7f1798009b20 comp rx=0 tx=0).stop 2023-07-05T18:57:09.807 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:09.801+0000 7f17b2cd7700 1 -- 172.21.15.46:0/2353870720 shutdown_connections 2023-07-05T18:57:09.807 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:09.801+0000 7f17b2cd7700 1 --2- 172.21.15.46:0/2353870720 >> v2:172.21.15.73:3300/0 conn(0x7f17ac15c2f0 0x7f17ac0cd2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:57:09.807 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:09.801+0000 7f17b2cd7700 1 --2- 172.21.15.46:0/2353870720 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f17ac15c6c0 0x7f17ac06c760 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:57:09.807 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:09.801+0000 7f17b2cd7700 1 -- 172.21.15.46:0/2353870720 >> 172.21.15.46:0/2353870720 conn(0x7f17ac06afa0 msgr2=0x7f17ac0cf710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-05T18:57:09.807 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:09.801+0000 7f17b2cd7700 1 -- 172.21.15.46:0/2353870720 shutdown_connections 2023-07-05T18:57:09.807 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:09.801+0000 7f17b2cd7700 1 -- 172.21.15.46:0/2353870720 wait complete. 2023-07-05T18:57:09.810 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:09.802+0000 7f17b2cd7700 1 Processor -- start 2023-07-05T18:57:09.810 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:09.802+0000 7f17b2cd7700 1 -- start start 2023-07-05T18:57:09.810 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:09.803+0000 7f17b2cd7700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f17ac0b5ae0 0x7f17ac15b340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:57:09.810 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:09.803+0000 7f17b2cd7700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f17ac15c2f0 0x7f17ac0a9660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:57:09.810 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:09.803+0000 7f17b2cd7700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f17ac15c6c0 0x7f17ac0cc850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:57:09.810 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:09.803+0000 7f17b2cd7700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17ac0ca8a0 con 0x7f17ac15c2f0 2023-07-05T18:57:09.811 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:09.803+0000 7f17b2cd7700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17ac0b4c00 con 0x7f17ac0b5ae0 2023-07-05T18:57:09.811 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:09.803+0000 7f17b2cd7700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f17ac0cd480 con 0x7f17ac15c6c0 2023-07-05T18:57:09.811 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:09.803+0000 7f17abfff700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f17ac15c2f0 0x7f17ac0a9660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:57:09.811 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:09.803+0000 7f17abfff700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f17ac15c2f0 0x7f17ac0a9660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:59638/0 (socket says 172.21.15.46:59638) 2023-07-05T18:57:09.811 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:09.803+0000 7f17abfff700 1 -- 172.21.15.46:0/2652145789 learned_addr learned my addr 172.21.15.46:0/2652145789 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-07-05T18:57:09.811 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:09.803+0000 7f17b0a73700 1 --2- 172.21.15.46:0/2652145789 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f17ac0b5ae0 0x7f17ac15b340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:57:09.811 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:09.803+0000 7f17b1274700 1 --2- 172.21.15.46:0/2652145789 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f17ac15c6c0 0x7f17ac0cc850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:57:09.812 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:09.803+0000 7f17abfff700 1 -- 172.21.15.46:0/2652145789 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f17ac15c6c0 msgr2=0x7f17ac0cc850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:57:09.812 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:09.803+0000 7f17abfff700 1 --2- 172.21.15.46:0/2652145789 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f17ac15c6c0 0x7f17ac0cc850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:57:09.812 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:09.803+0000 7f17abfff700 1 -- 172.21.15.46:0/2652145789 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f17ac0b5ae0 msgr2=0x7f17ac15b340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:57:09.812 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:09.803+0000 7f17abfff700 1 --2- 172.21.15.46:0/2652145789 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f17ac0b5ae0 0x7f17ac15b340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:57:09.812 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:09.803+0000 7f17abfff700 1 -- 172.21.15.46:0/2652145789 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f17980094a0 con 0x7f17ac15c2f0 2023-07-05T18:57:09.813 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:09.803+0000 7f17b1274700 1 --2- 172.21.15.46:0/2652145789 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f17ac15c6c0 0x7f17ac0cc850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-05T18:57:09.813 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:09.804+0000 7f17abfff700 1 --2- 172.21.15.46:0/2652145789 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f17ac15c2f0 0x7f17ac0a9660 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f17980090b0 tx=0x7f1798004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-05T18:57:09.813 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:09.804+0000 7f17a97fa700 1 -- 172.21.15.46:0/2652145789 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17980036a0 con 0x7f17ac15c2f0 2023-07-05T18:57:09.813 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:09.804+0000 7f17a97fa700 1 -- 172.21.15.46:0/2652145789 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f179801f070 con 0x7f17ac15c2f0 2023-07-05T18:57:09.813 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:09.804+0000 7f17a97fa700 1 -- 172.21.15.46:0/2652145789 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1798003a00 con 0x7f17ac15c2f0 2023-07-05T18:57:09.813 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:09.804+0000 7f17b2cd7700 1 -- 172.21.15.46:0/2652145789 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f17ac15b880 con 0x7f17ac15c2f0 2023-07-05T18:57:09.813 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:09.804+0000 7f17b2cd7700 1 -- 172.21.15.46:0/2652145789 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f17ac0ca1e0 con 0x7f17ac15c2f0 2023-07-05T18:57:09.813 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:09.805+0000 7f17b2cd7700 1 -- 172.21.15.46:0/2652145789 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f17ac0ca9e0 con 0x7f17ac15c2f0 2023-07-05T18:57:09.814 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:09.805+0000 7f17a97fa700 1 -- 172.21.15.46:0/2652145789 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f1798003b60 con 0x7f17ac15c2f0 2023-07-05T18:57:09.814 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:09.805+0000 7f17a97fa700 1 --2- 172.21.15.46:0/2652145789 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7f179006ace0 0x7f179006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:57:09.814 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:09.806+0000 7f17a97fa700 1 -- 172.21.15.46:0/2652145789 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f1798021070 con 0x7f17ac15c2f0 2023-07-05T18:57:09.814 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:09.806+0000 7f17b0a73700 1 --2- 172.21.15.46:0/2652145789 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7f179006ace0 0x7f179006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:57:09.814 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:09.806+0000 7f17b0a73700 1 --2- 172.21.15.46:0/2652145789 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7f179006ace0 0x7f179006d190 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f17a0009be0 tx=0x7f17a0009210 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-05T18:57:09.814 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:09.810+0000 7f17a97fa700 1 -- 172.21.15.46:0/2652145789 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f17ac0ca9e0 con 0x7f17ac15c2f0 2023-07-05T18:57:10.093 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:10.091+0000 7f17b2cd7700 1 -- 172.21.15.46:0/2652145789 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-mgr"} v 0) v1 -- 0x7f17ac0ca9e0 con 0x7f17ac15c2f0 2023-07-05T18:57:10.097 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:10.094+0000 7f17a97fa700 1 -- 172.21.15.46:0/2652145789 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-mgr"}]=0 v8) v1 ==== 90+0+0 (secure 0 0 0) 0x7f17ac0ca9e0 con 0x7f17ac15c2f0 2023-07-05T18:57:10.099 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:10.096+0000 7f17b2cd7700 1 -- 172.21.15.46:0/2652145789 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7f179006ace0 msgr2=0x7f179006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:57:10.099 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:10.096+0000 7f17b2cd7700 1 --2- 172.21.15.46:0/2652145789 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7f179006ace0 0x7f179006d190 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f17a0009be0 tx=0x7f17a0009210 comp rx=0 tx=0).stop 2023-07-05T18:57:10.100 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:10.096+0000 7f17b2cd7700 1 -- 172.21.15.46:0/2652145789 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f17ac15c2f0 msgr2=0x7f17ac0a9660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:57:10.100 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:10.096+0000 7f17b2cd7700 1 --2- 172.21.15.46:0/2652145789 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f17ac15c2f0 0x7f17ac0a9660 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f17980090b0 tx=0x7f1798004750 comp rx=0 tx=0).stop 2023-07-05T18:57:10.101 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:10.096+0000 7f17b2cd7700 1 -- 172.21.15.46:0/2652145789 shutdown_connections 2023-07-05T18:57:10.102 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:10.096+0000 7f17b2cd7700 1 --2- 172.21.15.46:0/2652145789 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7f179006ace0 0x7f179006d190 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:57:10.102 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:10.096+0000 7f17b2cd7700 1 --2- 172.21.15.46:0/2652145789 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f17ac15c6c0 0x7f17ac0cc850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:57:10.103 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:10.096+0000 7f17b2cd7700 1 --2- 172.21.15.46:0/2652145789 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f17ac0b5ae0 0x7f17ac15b340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:57:10.103 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:10.096+0000 7f17b2cd7700 1 --2- 172.21.15.46:0/2652145789 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f17ac15c2f0 0x7f17ac0a9660 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:57:10.104 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:10.096+0000 7f17b2cd7700 1 -- 172.21.15.46:0/2652145789 >> 172.21.15.46:0/2652145789 conn(0x7f17ac06afa0 msgr2=0x7f17ac15fd90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-05T18:57:10.104 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:10.096+0000 7f17b2cd7700 1 -- 172.21.15.46:0/2652145789 shutdown_connections 2023-07-05T18:57:10.105 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:10.096+0000 7f17b2cd7700 1 -- 172.21.15.46:0/2652145789 wait complete. 2023-07-05T18:57:10.112 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-osd 2023-07-05T18:57:10.239 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:10.236+0000 7f0d66ea1700 1 Processor -- start 2023-07-05T18:57:10.239 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:10.237+0000 7f0d66ea1700 1 -- start start 2023-07-05T18:57:10.243 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:10.238+0000 7f0d66ea1700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f0d60142480 0x7f0d600b41d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:57:10.244 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:10.238+0000 7f0d66ea1700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f0d600b4710 0x7f0d6006d140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:57:10.244 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:10.238+0000 7f0d66ea1700 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0d6006c8d0 con 0x7f0d6013f4c0 2023-07-05T18:57:10.244 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:10.238+0000 7f0d66ea1700 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0d6006ce90 con 0x7f0d600b4710 2023-07-05T18:57:10.245 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:10.238+0000 7f0d66ea1700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0d6006cbb0 con 0x7f0d60142480 2023-07-05T18:57:10.245 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:10.238+0000 7f0d64c3d700 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7f0d6013f4c0 0x7f0d6015d6a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:58914/0 (socket says 172.21.15.46:58914) 2023-07-05T18:57:10.245 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:10.238+0000 7f0d64c3d700 1 -- 172.21.15.46:0/2661568455 learned_addr learned my addr 172.21.15.46:0/2661568455 (peer_addr_for_me v1:172.21.15.46:0/0) 2023-07-05T18:57:10.252 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:10.238+0000 7f0d6543e700 1 --2- 172.21.15.46:0/2661568455 >> v2:172.21.15.73:3300/0 conn(0x7f0d600b4710 0x7f0d6006d140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:57:10.253 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:10.238+0000 7f0d5ffff700 1 --2- 172.21.15.46:0/2661568455 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f0d60142480 0x7f0d600b41d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:57:10.253 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:10.238+0000 7f0d5f7fe700 1 -- 172.21.15.46:0/2661568455 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 393067052 0 0) 0x7f0d6006c8d0 con 0x7f0d6013f4c0 2023-07-05T18:57:10.253 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:10.238+0000 7f0d5f7fe700 1 -- 172.21.15.46:0/2661568455 --> v1:172.21.15.46:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0d500035b0 con 0x7f0d6013f4c0 2023-07-05T18:57:10.254 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:10.238+0000 7f0d5f7fe700 1 -- 172.21.15.46:0/2661568455 <== mon.0 v1:172.21.15.46:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2913050523 0 0) 0x7f0d500035b0 con 0x7f0d6013f4c0 2023-07-05T18:57:10.254 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:10.238+0000 7f0d6543e700 1 -- 172.21.15.46:0/2661568455 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f0d60142480 msgr2=0x7f0d600b41d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-05T18:57:10.254 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:10.238+0000 7f0d6543e700 1 --2- 172.21.15.46:0/2661568455 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f0d60142480 0x7f0d600b41d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:57:10.255 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:10.238+0000 7f0d6543e700 1 -- 172.21.15.46:0/2661568455 >> v1:172.21.15.46:6789/0 conn(0x7f0d6013f4c0 legacy=0x7f0d6015d6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:57:10.255 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:10.238+0000 7f0d6543e700 1 -- 172.21.15.46:0/2661568455 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d600b39d0 con 0x7f0d600b4710 2023-07-05T18:57:10.255 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:10.239+0000 7f0d6543e700 1 --2- 172.21.15.46:0/2661568455 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0d600b4710 0x7f0d6006d140 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f0d58009d90 tx=0x7f0d5800b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7de15eaeb69ab4f4 server_cookie=0 in_seq=0 out_seq=0 2023-07-05T18:57:10.255 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:10.239+0000 7f0d5f7fe700 1 -- 172.21.15.46:0/2661568455 <== mon.1 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d54001670 con 0x7f0d600b4710 2023-07-05T18:57:10.256 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:10.239+0000 7f0d5f7fe700 1 -- 172.21.15.46:0/2661568455 <== mon.1 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0d58003a20 con 0x7f0d600b4710 2023-07-05T18:57:10.257 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:10.239+0000 7f0d5f7fe700 1 -- 172.21.15.46:0/2661568455 <== mon.1 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d58003d90 con 0x7f0d600b4710 2023-07-05T18:57:10.257 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:10.239+0000 7f0d66ea1700 1 -- 172.21.15.46:0/2661568455 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0d600b4710 msgr2=0x7f0d6006d140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:57:10.257 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:10.239+0000 7f0d66ea1700 1 --2- 172.21.15.46:0/2661568455 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0d600b4710 0x7f0d6006d140 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f0d58009d90 tx=0x7f0d5800b330 comp rx=0 tx=0).stop 2023-07-05T18:57:10.258 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:10.239+0000 7f0d66ea1700 1 -- 172.21.15.46:0/2661568455 shutdown_connections 2023-07-05T18:57:10.258 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:10.239+0000 7f0d66ea1700 1 --2- 172.21.15.46:0/2661568455 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0d600b4710 0x7f0d6006d140 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:57:10.258 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:10.239+0000 7f0d66ea1700 1 --2- 172.21.15.46:0/2661568455 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f0d60142480 0x7f0d600b41d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:57:10.259 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:10.239+0000 7f0d66ea1700 1 -- 172.21.15.46:0/2661568455 >> 172.21.15.46:0/2661568455 conn(0x7f0d6006af10 msgr2=0x7f0d6006b2e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-05T18:57:10.259 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:10.239+0000 7f0d66ea1700 1 -- 172.21.15.46:0/2661568455 shutdown_connections 2023-07-05T18:57:10.259 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:10.239+0000 7f0d66ea1700 1 -- 172.21.15.46:0/2661568455 wait complete. 2023-07-05T18:57:10.260 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:10.241+0000 7f0d66ea1700 1 Processor -- start 2023-07-05T18:57:10.260 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:10.241+0000 7f0d66ea1700 1 -- start start 2023-07-05T18:57:10.264 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:10.242+0000 7f0d66ea1700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0d600b4710 0x7f0d60137340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:57:10.265 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:10.242+0000 7f0d66ea1700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0d6013f4c0 0x7f0d6015a090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:57:10.265 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:10.242+0000 7f0d66ea1700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f0d60142480 0x7f0d60139ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:57:10.265 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:10.242+0000 7f0d66ea1700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d6013af50 con 0x7f0d6013f4c0 2023-07-05T18:57:10.265 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:10.242+0000 7f0d66ea1700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d60159c70 con 0x7f0d600b4710 2023-07-05T18:57:10.266 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:10.242+0000 7f0d66ea1700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0d6013a990 con 0x7f0d60142480 2023-07-05T18:57:10.266 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:10.242+0000 7f0d5ffff700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0d6013f4c0 0x7f0d6015a090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:57:10.266 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:10.242+0000 7f0d5ffff700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0d6013f4c0 0x7f0d6015a090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:59650/0 (socket says 172.21.15.46:59650) 2023-07-05T18:57:10.266 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:10.242+0000 7f0d5ffff700 1 -- 172.21.15.46:0/1344438716 learned_addr learned my addr 172.21.15.46:0/1344438716 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-07-05T18:57:10.267 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:10.242+0000 7f0d64c3d700 1 --2- 172.21.15.46:0/1344438716 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0d600b4710 0x7f0d60137340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:57:10.267 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:10.242+0000 7f0d6543e700 1 --2- 172.21.15.46:0/1344438716 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f0d60142480 0x7f0d60139ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:57:10.268 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:10.243+0000 7f0d5ffff700 1 -- 172.21.15.46:0/1344438716 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f0d60142480 msgr2=0x7f0d60139ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:57:10.268 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:10.243+0000 7f0d5ffff700 1 --2- 172.21.15.46:0/1344438716 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f0d60142480 0x7f0d60139ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:57:10.268 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:10.243+0000 7f0d5ffff700 1 -- 172.21.15.46:0/1344438716 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0d600b4710 msgr2=0x7f0d60137340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:57:10.269 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:10.243+0000 7f0d5ffff700 1 --2- 172.21.15.46:0/1344438716 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0d600b4710 0x7f0d60137340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:57:10.269 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:10.243+0000 7f0d5ffff700 1 -- 172.21.15.46:0/1344438716 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d58009a70 con 0x7f0d6013f4c0 2023-07-05T18:57:10.270 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:10.243+0000 7f0d5ffff700 1 --2- 172.21.15.46:0/1344438716 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0d6013f4c0 0x7f0d6015a090 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f0d4c00e870 tx=0x7f0d4c00eb80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-05T18:57:10.270 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:10.243+0000 7f0d5d7fa700 1 -- 172.21.15.46:0/1344438716 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d4c009590 con 0x7f0d6013f4c0 2023-07-05T18:57:10.270 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:10.243+0000 7f0d66ea1700 1 -- 172.21.15.46:0/1344438716 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0d6013ac70 con 0x7f0d6013f4c0 2023-07-05T18:57:10.271 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:10.243+0000 7f0d5d7fa700 1 -- 172.21.15.46:0/1344438716 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0d4c013680 con 0x7f0d6013f4c0 2023-07-05T18:57:10.271 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:10.243+0000 7f0d5d7fa700 1 -- 172.21.15.46:0/1344438716 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d4c0139f0 con 0x7f0d6013f4c0 2023-07-05T18:57:10.271 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:10.243+0000 7f0d66ea1700 1 -- 172.21.15.46:0/1344438716 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0d6015d2b0 con 0x7f0d6013f4c0 2023-07-05T18:57:10.272 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:10.244+0000 7f0d66ea1700 1 -- 172.21.15.46:0/1344438716 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0d6006d600 con 0x7f0d6013f4c0 2023-07-05T18:57:10.272 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:10.245+0000 7f0d5d7fa700 1 -- 172.21.15.46:0/1344438716 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f0d4c013b50 con 0x7f0d6013f4c0 2023-07-05T18:57:10.273 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:10.245+0000 7f0d5d7fa700 1 --2- 172.21.15.46:0/1344438716 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7f0d4406ace0 0x7f0d4406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:57:10.273 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:10.245+0000 7f0d5d7fa700 1 -- 172.21.15.46:0/1344438716 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f0d4c088fc0 con 0x7f0d6013f4c0 2023-07-05T18:57:10.273 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:10.245+0000 7f0d64c3d700 1 --2- 172.21.15.46:0/1344438716 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7f0d4406ace0 0x7f0d4406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:57:10.274 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:10.246+0000 7f0d64c3d700 1 --2- 172.21.15.46:0/1344438716 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7f0d4406ace0 0x7f0d4406d190 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f0d54001eb0 tx=0x7f0d54001e40 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-05T18:57:10.274 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:10.249+0000 7f0d5d7fa700 1 -- 172.21.15.46:0/1344438716 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f0d4c0bb310 con 0x7f0d6013f4c0 2023-07-05T18:57:10.528 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:10.526+0000 7f0d66ea1700 1 -- 172.21.15.46:0/1344438716 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-osd"} v 0) v1 -- 0x7f0d600672e0 con 0x7f0d6013f4c0 2023-07-05T18:57:10.532 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:10.529+0000 7f0d5d7fa700 1 -- 172.21.15.46:0/1344438716 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-osd"}]=0 v9) v1 ==== 90+0+0 (secure 0 0 0) 0x7f0d4c057e60 con 0x7f0d6013f4c0 2023-07-05T18:57:10.534 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:10.531+0000 7f0d66ea1700 1 -- 172.21.15.46:0/1344438716 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7f0d4406ace0 msgr2=0x7f0d4406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:57:10.534 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:10.531+0000 7f0d66ea1700 1 --2- 172.21.15.46:0/1344438716 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7f0d4406ace0 0x7f0d4406d190 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f0d54001eb0 tx=0x7f0d54001e40 comp rx=0 tx=0).stop 2023-07-05T18:57:10.534 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:10.531+0000 7f0d66ea1700 1 -- 172.21.15.46:0/1344438716 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0d6013f4c0 msgr2=0x7f0d6015a090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:57:10.534 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:10.531+0000 7f0d66ea1700 1 --2- 172.21.15.46:0/1344438716 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0d6013f4c0 0x7f0d6015a090 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f0d4c00e870 tx=0x7f0d4c00eb80 comp rx=0 tx=0).stop 2023-07-05T18:57:10.534 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:10.531+0000 7f0d66ea1700 1 -- 172.21.15.46:0/1344438716 shutdown_connections 2023-07-05T18:57:10.534 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:10.531+0000 7f0d66ea1700 1 --2- 172.21.15.46:0/1344438716 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7f0d4406ace0 0x7f0d4406d190 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:57:10.534 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:10.532+0000 7f0d66ea1700 1 --2- 172.21.15.46:0/1344438716 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f0d60142480 0x7f0d60139ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:57:10.535 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:10.532+0000 7f0d66ea1700 1 --2- 172.21.15.46:0/1344438716 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0d600b4710 0x7f0d60137340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:57:10.536 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:10.532+0000 7f0d66ea1700 1 --2- 172.21.15.46:0/1344438716 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0d6013f4c0 0x7f0d6015a090 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:57:10.536 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:10.532+0000 7f0d66ea1700 1 -- 172.21.15.46:0/1344438716 >> 172.21.15.46:0/1344438716 conn(0x7f0d6006af10 msgr2=0x7f0d600b1690 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-05T18:57:10.537 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:10.532+0000 7f0d66ea1700 1 -- 172.21.15.46:0/1344438716 shutdown_connections 2023-07-05T18:57:10.537 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:10.532+0000 7f0d66ea1700 1 -- 172.21.15.46:0/1344438716 wait complete. 2023-07-05T18:57:10.548 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rbd 2023-07-05T18:57:10.675 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:10.673+0000 7ff7278eb700 1 Processor -- start 2023-07-05T18:57:10.675 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:10.673+0000 7ff7278eb700 1 -- start start 2023-07-05T18:57:10.677 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:10.674+0000 7ff7278eb700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7ff7200b1d50 0x7ff7200b54c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:57:10.677 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:10.674+0000 7ff7278eb700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7ff72015d710 0x7ff72006c7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:57:10.677 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:10.674+0000 7ff7278eb700 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff72015a1e0 con 0x7ff720159180 2023-07-05T18:57:10.678 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:10.674+0000 7ff7278eb700 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff72015a670 con 0x7ff72015d710 2023-07-05T18:57:10.678 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:10.674+0000 7ff7278eb700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff7200b5aa0 con 0x7ff7200b1d50 2023-07-05T18:57:10.678 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:10.674+0000 7ff725e88700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7ff72015d710 0x7ff72006c7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:57:10.678 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:10.674+0000 7ff725e88700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7ff72015d710 0x7ff72006c7e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:59660/0 (socket says 172.21.15.46:59660) 2023-07-05T18:57:10.678 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:10.674+0000 7ff725e88700 1 -- 172.21.15.46:0/3128753401 learned_addr learned my addr 172.21.15.46:0/3128753401 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-07-05T18:57:10.678 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:10.674+0000 7ff724e86700 1 --2- 172.21.15.46:0/3128753401 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7ff7200b1d50 0x7ff7200b54c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:57:10.680 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:10.674+0000 7ff725e88700 1 -- 172.21.15.46:0/3128753401 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7ff7200b1d50 msgr2=0x7ff7200b54c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-05T18:57:10.680 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:10.674+0000 7ff725e88700 1 --2- 172.21.15.46:0/3128753401 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7ff7200b1d50 0x7ff7200b54c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:57:10.680 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:10.674+0000 7ff725e88700 1 -- 172.21.15.46:0/3128753401 >> v1:172.21.15.73:6789/0 conn(0x7ff720159180 legacy=0x7ff7200b1640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-05T18:57:10.680 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:10.674+0000 7ff725e88700 1 -- 172.21.15.46:0/3128753401 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff7201598b0 con 0x7ff72015d710 2023-07-05T18:57:10.680 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:10.674+0000 7ff725e88700 1 --2- 172.21.15.46:0/3128753401 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff72015d710 0x7ff72006c7e0 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7ff71800d150 tx=0x7ff71800d460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b5943ff15995d7c1 server_cookie=0 in_seq=0 out_seq=0 2023-07-05T18:57:10.681 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:10.674+0000 7ff713fff700 1 -- 172.21.15.46:0/3128753401 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff718010070 con 0x7ff72015d710 2023-07-05T18:57:10.681 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:10.674+0000 7ff713fff700 1 -- 172.21.15.46:0/3128753401 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff71800dd80 con 0x7ff72015d710 2023-07-05T18:57:10.681 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:10.674+0000 7ff713fff700 1 -- 172.21.15.46:0/3128753401 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff71800b310 con 0x7ff72015d710 2023-07-05T18:57:10.681 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:10.675+0000 7ff7278eb700 1 -- 172.21.15.46:0/3128753401 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff72015d710 msgr2=0x7ff72006c7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:57:10.681 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:10.675+0000 7ff7278eb700 1 --2- 172.21.15.46:0/3128753401 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff72015d710 0x7ff72006c7e0 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7ff71800d150 tx=0x7ff71800d460 comp rx=0 tx=0).stop 2023-07-05T18:57:10.681 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:10.675+0000 7ff7278eb700 1 -- 172.21.15.46:0/3128753401 shutdown_connections 2023-07-05T18:57:10.681 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:10.675+0000 7ff7278eb700 1 --2- 172.21.15.46:0/3128753401 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff72015d710 0x7ff72006c7e0 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:57:10.682 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:10.675+0000 7ff7278eb700 1 --2- 172.21.15.46:0/3128753401 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7ff7200b1d50 0x7ff7200b54c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:57:10.682 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:10.675+0000 7ff7278eb700 1 -- 172.21.15.46:0/3128753401 >> 172.21.15.46:0/3128753401 conn(0x7ff7200cf9a0 msgr2=0x7ff7200cfda0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-05T18:57:10.682 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:10.675+0000 7ff7278eb700 1 -- 172.21.15.46:0/3128753401 shutdown_connections 2023-07-05T18:57:10.682 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:10.675+0000 7ff7278eb700 1 -- 172.21.15.46:0/3128753401 wait complete. 2023-07-05T18:57:10.684 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:10.676+0000 7ff7278eb700 1 Processor -- start 2023-07-05T18:57:10.684 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:10.676+0000 7ff7278eb700 1 -- start start 2023-07-05T18:57:10.685 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:10.677+0000 7ff7278eb700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7ff7200b1d50 0x7ff720157530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:57:10.685 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:10.677+0000 7ff7278eb700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff720159180 0x7ff7201f5850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:57:10.685 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:10.677+0000 7ff7278eb700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff72015d710 0x7ff7201f5d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:57:10.685 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:10.677+0000 7ff7278eb700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7200ad0a0 con 0x7ff72015d710 2023-07-05T18:57:10.685 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:10.677+0000 7ff7278eb700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff720157f90 con 0x7ff720159180 2023-07-05T18:57:10.686 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:10.677+0000 7ff7278eb700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff720158270 con 0x7ff7200b1d50 2023-07-05T18:57:10.686 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:10.677+0000 7ff725e88700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff72015d710 0x7ff7201f5d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:57:10.686 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:10.677+0000 7ff725e88700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff72015d710 0x7ff7201f5d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:59666/0 (socket says 172.21.15.46:59666) 2023-07-05T18:57:10.686 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:10.677+0000 7ff725e88700 1 -- 172.21.15.46:0/782961871 learned_addr learned my addr 172.21.15.46:0/782961871 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-07-05T18:57:10.686 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:10.677+0000 7ff725687700 1 --2- 172.21.15.46:0/782961871 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7ff7200b1d50 0x7ff720157530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:57:10.686 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:10.677+0000 7ff724e86700 1 --2- 172.21.15.46:0/782961871 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff720159180 0x7ff7201f5850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:57:10.686 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:10.677+0000 7ff725e88700 1 -- 172.21.15.46:0/782961871 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7ff7200b1d50 msgr2=0x7ff720157530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:57:10.687 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:10.677+0000 7ff725e88700 1 --2- 172.21.15.46:0/782961871 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7ff7200b1d50 0x7ff720157530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:57:10.687 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:10.677+0000 7ff725e88700 1 -- 172.21.15.46:0/782961871 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff720159180 msgr2=0x7ff7201f5850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:57:10.687 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:10.677+0000 7ff725e88700 1 --2- 172.21.15.46:0/782961871 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff720159180 0x7ff7201f5850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:57:10.687 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:10.677+0000 7ff725e88700 1 -- 172.21.15.46:0/782961871 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff71800bd40 con 0x7ff72015d710 2023-07-05T18:57:10.687 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:10.678+0000 7ff725e88700 1 --2- 172.21.15.46:0/782961871 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff72015d710 0x7ff7201f5d90 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7ff718017040 tx=0x7ff718004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-05T18:57:10.687 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:10.678+0000 7ff711ffb700 1 -- 172.21.15.46:0/782961871 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff718009a10 con 0x7ff72015d710 2023-07-05T18:57:10.687 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:10.678+0000 7ff711ffb700 1 -- 172.21.15.46:0/782961871 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff718009b70 con 0x7ff72015d710 2023-07-05T18:57:10.688 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:10.678+0000 7ff7278eb700 1 -- 172.21.15.46:0/782961871 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff720158550 con 0x7ff72015d710 2023-07-05T18:57:10.688 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:10.678+0000 7ff711ffb700 1 -- 172.21.15.46:0/782961871 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff718004030 con 0x7ff72015d710 2023-07-05T18:57:10.688 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:10.678+0000 7ff7278eb700 1 -- 172.21.15.46:0/782961871 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff720157a70 con 0x7ff72015d710 2023-07-05T18:57:10.688 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:10.679+0000 7ff7278eb700 1 -- 172.21.15.46:0/782961871 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff7200ad210 con 0x7ff72015d710 2023-07-05T18:57:10.688 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:10.679+0000 7ff711ffb700 1 -- 172.21.15.46:0/782961871 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7ff71801b070 con 0x7ff72015d710 2023-07-05T18:57:10.689 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:10.680+0000 7ff711ffb700 1 --2- 172.21.15.46:0/782961871 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7ff70406ace0 0x7ff70406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:57:10.689 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:10.680+0000 7ff711ffb700 1 -- 172.21.15.46:0/782961871 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 5210+0+0 (secure 0 0 0) 0x7ff71808a210 con 0x7ff72015d710 2023-07-05T18:57:10.689 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:10.680+0000 7ff725687700 1 --2- 172.21.15.46:0/782961871 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7ff70406ace0 0x7ff70406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:57:10.689 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:10.681+0000 7ff725687700 1 --2- 172.21.15.46:0/782961871 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7ff70406ace0 0x7ff70406d190 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7ff71c004f80 tx=0x7ff71c009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-05T18:57:10.690 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:10.684+0000 7ff711ffb700 1 -- 172.21.15.46:0/782961871 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7ff7200ad210 con 0x7ff72015d710 2023-07-05T18:57:10.971 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:10.969+0000 7ff7278eb700 1 -- 172.21.15.46:0/782961871 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rbd"} v 0) v1 -- 0x7ff7200ad1e0 con 0x7ff72015d710 2023-07-05T18:57:10.974 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:10.973+0000 7ff711ffb700 1 -- 172.21.15.46:0/782961871 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rbd"}]=0 v10) v1 ==== 90+0+0 (secure 0 0 0) 0x7ff718055610 con 0x7ff72015d710 2023-07-05T18:57:10.978 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:10.975+0000 7ff7278eb700 1 -- 172.21.15.46:0/782961871 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7ff70406ace0 msgr2=0x7ff70406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:57:10.978 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:10.975+0000 7ff7278eb700 1 --2- 172.21.15.46:0/782961871 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7ff70406ace0 0x7ff70406d190 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7ff71c004f80 tx=0x7ff71c009040 comp rx=0 tx=0).stop 2023-07-05T18:57:10.978 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:10.975+0000 7ff7278eb700 1 -- 172.21.15.46:0/782961871 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff72015d710 msgr2=0x7ff7201f5d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:57:10.978 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:10.975+0000 7ff7278eb700 1 --2- 172.21.15.46:0/782961871 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff72015d710 0x7ff7201f5d90 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7ff718017040 tx=0x7ff718004ad0 comp rx=0 tx=0).stop 2023-07-05T18:57:10.978 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:10.975+0000 7ff7278eb700 1 -- 172.21.15.46:0/782961871 shutdown_connections 2023-07-05T18:57:10.979 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:10.975+0000 7ff7278eb700 1 --2- 172.21.15.46:0/782961871 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7ff70406ace0 0x7ff70406d190 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:57:10.979 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:10.975+0000 7ff7278eb700 1 --2- 172.21.15.46:0/782961871 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff72015d710 0x7ff7201f5d90 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:57:10.979 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:10.975+0000 7ff7278eb700 1 --2- 172.21.15.46:0/782961871 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7ff7200b1d50 0x7ff720157530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:57:10.979 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:10.975+0000 7ff7278eb700 1 --2- 172.21.15.46:0/782961871 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff720159180 0x7ff7201f5850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:57:10.979 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:10.975+0000 7ff7278eb700 1 -- 172.21.15.46:0/782961871 >> 172.21.15.46:0/782961871 conn(0x7ff7200cf9a0 msgr2=0x7ff7200b4d60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-05T18:57:10.979 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:10.975+0000 7ff7278eb700 1 -- 172.21.15.46:0/782961871 shutdown_connections 2023-07-05T18:57:10.979 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:10.975+0000 7ff7278eb700 1 -- 172.21.15.46:0/782961871 wait complete. 2023-07-05T18:57:10.989 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rbd-mirror 2023-07-05T18:57:11.114 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:11.112+0000 7f9ba66be700 1 Processor -- start 2023-07-05T18:57:11.115 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:11.112+0000 7f9ba66be700 1 -- start start 2023-07-05T18:57:11.116 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:11.113+0000 7f9ba66be700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f9ba00b17b0 0x7f9ba015d800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:57:11.116 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:11.113+0000 7f9ba66be700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f9ba00b2b20 0x7f9ba00b1b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:57:11.117 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:11.113+0000 7f9ba66be700 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9ba015dd40 con 0x7f9ba006cec0 2023-07-05T18:57:11.117 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:11.113+0000 7f9ba66be700 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9ba00ce300 con 0x7f9ba00b2b20 2023-07-05T18:57:11.117 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:11.113+0000 7f9ba66be700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9ba00b20c0 con 0x7f9ba00b17b0 2023-07-05T18:57:11.117 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:11.114+0000 7f9b9f7fe700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f9ba00b2b20 0x7f9ba00b1b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:57:11.117 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:11.114+0000 7f9b9f7fe700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f9ba00b2b20 0x7f9ba00b1b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.46:59154/0 (socket says 172.21.15.46:59154) 2023-07-05T18:57:11.117 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:11.114+0000 7f9b9ffff700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f9ba00b17b0 0x7f9ba015d800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:57:11.117 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:11.114+0000 7f9b9f7fe700 1 -- 172.21.15.46:0/1440956948 learned_addr learned my addr 172.21.15.46:0/1440956948 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-07-05T18:57:11.118 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:11.114+0000 7f9ba4c5b700 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7f9ba006cec0 0x7f9ba006d340 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.46:44862/0 (socket says 172.21.15.46:44862) 2023-07-05T18:57:11.118 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:11.114+0000 7f9b9f7fe700 1 -- 172.21.15.46:0/1440956948 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f9ba00b17b0 msgr2=0x7f9ba015d800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-05T18:57:11.118 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:11.114+0000 7f9b9f7fe700 1 --2- 172.21.15.46:0/1440956948 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f9ba00b17b0 0x7f9ba015d800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:57:11.118 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:11.114+0000 7f9b9f7fe700 1 -- 172.21.15.46:0/1440956948 >> v1:172.21.15.73:6789/0 conn(0x7f9ba006cec0 legacy=0x7f9ba006d340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:57:11.118 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:11.114+0000 7f9b9f7fe700 1 -- 172.21.15.46:0/1440956948 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ba00cda60 con 0x7f9ba00b2b20 2023-07-05T18:57:11.118 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:11.114+0000 7f9b9f7fe700 1 --2- 172.21.15.46:0/1440956948 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9ba00b2b20 0x7f9ba00b1b80 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f9b9400bb90 tx=0x7f9b9400bea0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c2d4c990b4aa8d9b server_cookie=0 in_seq=0 out_seq=0 2023-07-05T18:57:11.118 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:11.114+0000 7f9b9effd700 1 -- 172.21.15.46:0/1440956948 <== mon.1 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b9400dd30 con 0x7f9ba00b2b20 2023-07-05T18:57:11.119 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:11.114+0000 7f9b9effd700 1 -- 172.21.15.46:0/1440956948 <== mon.1 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9b9400de90 con 0x7f9ba00b2b20 2023-07-05T18:57:11.119 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:11.114+0000 7f9b9effd700 1 -- 172.21.15.46:0/1440956948 <== mon.1 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b94010690 con 0x7f9ba00b2b20 2023-07-05T18:57:11.121 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:11.115+0000 7f9ba66be700 1 -- 172.21.15.46:0/1440956948 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9ba00b2b20 msgr2=0x7f9ba00b1b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:57:11.121 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:11.115+0000 7f9ba66be700 1 --2- 172.21.15.46:0/1440956948 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9ba00b2b20 0x7f9ba00b1b80 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f9b9400bb90 tx=0x7f9b9400bea0 comp rx=0 tx=0).stop 2023-07-05T18:57:11.121 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:11.115+0000 7f9ba66be700 1 -- 172.21.15.46:0/1440956948 shutdown_connections 2023-07-05T18:57:11.122 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:11.115+0000 7f9ba66be700 1 --2- 172.21.15.46:0/1440956948 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f9ba00b17b0 0x7f9ba015d800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:57:11.122 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:11.115+0000 7f9ba66be700 1 --2- 172.21.15.46:0/1440956948 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9ba00b2b20 0x7f9ba00b1b80 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:57:11.123 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:11.115+0000 7f9ba66be700 1 -- 172.21.15.46:0/1440956948 >> 172.21.15.46:0/1440956948 conn(0x7f9ba006af10 msgr2=0x7f9ba006b310 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-05T18:57:11.123 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:11.115+0000 7f9ba66be700 1 -- 172.21.15.46:0/1440956948 shutdown_connections 2023-07-05T18:57:11.123 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:11.115+0000 7f9ba66be700 1 -- 172.21.15.46:0/1440956948 wait complete. 2023-07-05T18:57:11.123 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:11.116+0000 7f9ba66be700 1 Processor -- start 2023-07-05T18:57:11.123 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:11.116+0000 7f9ba66be700 1 -- start start 2023-07-05T18:57:11.123 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:11.117+0000 7f9ba66be700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9ba006cec0 0x7f9ba01f6590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:57:11.123 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:11.117+0000 7f9ba66be700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f9ba00b17b0 0x7f9ba014b720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:57:11.123 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:11.117+0000 7f9ba66be700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9ba00b2b20 0x7f9ba00b2fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:57:11.124 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:11.117+0000 7f9ba66be700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ba01f6ad0 con 0x7f9ba00b2b20 2023-07-05T18:57:11.124 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:11.117+0000 7f9ba66be700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ba00ae660 con 0x7f9ba006cec0 2023-07-05T18:57:11.124 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:11.117+0000 7f9ba66be700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9ba00ae940 con 0x7f9ba00b17b0 2023-07-05T18:57:11.124 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:11.117+0000 7f9ba4c5b700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9ba00b2b20 0x7f9ba00b2fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:57:11.124 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:11.117+0000 7f9ba4c5b700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9ba00b2b20 0x7f9ba00b2fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:59680/0 (socket says 172.21.15.46:59680) 2023-07-05T18:57:11.124 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:11.117+0000 7f9ba4c5b700 1 -- 172.21.15.46:0/444757650 learned_addr learned my addr 172.21.15.46:0/444757650 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-07-05T18:57:11.125 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:11.117+0000 7f9b9ffff700 1 --2- 172.21.15.46:0/444757650 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9ba006cec0 0x7f9ba01f6590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:57:11.125 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:11.117+0000 7f9b9f7fe700 1 --2- 172.21.15.46:0/444757650 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f9ba00b17b0 0x7f9ba014b720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:57:11.125 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:11.118+0000 7f9ba4c5b700 1 -- 172.21.15.46:0/444757650 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f9ba00b17b0 msgr2=0x7f9ba014b720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:57:11.125 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:11.118+0000 7f9ba4c5b700 1 --2- 172.21.15.46:0/444757650 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f9ba00b17b0 0x7f9ba014b720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:57:11.125 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:11.118+0000 7f9ba4c5b700 1 -- 172.21.15.46:0/444757650 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9ba006cec0 msgr2=0x7f9ba01f6590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:57:11.125 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:11.118+0000 7f9ba4c5b700 1 --2- 172.21.15.46:0/444757650 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9ba006cec0 0x7f9ba01f6590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:57:11.125 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:11.118+0000 7f9ba4c5b700 1 -- 172.21.15.46:0/444757650 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9b9400b7f0 con 0x7f9ba00b2b20 2023-07-05T18:57:11.125 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:11.118+0000 7f9ba4c5b700 1 --2- 172.21.15.46:0/444757650 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9ba00b2b20 0x7f9ba00b2fc0 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f9b9800cbc0 tx=0x7f9b9800ced0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-05T18:57:11.126 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:11.118+0000 7f9b9cff9700 1 -- 172.21.15.46:0/444757650 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b9800aaa0 con 0x7f9ba00b2b20 2023-07-05T18:57:11.126 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:11.118+0000 7f9b9cff9700 1 -- 172.21.15.46:0/444757650 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9b9800ac00 con 0x7f9ba00b2b20 2023-07-05T18:57:11.126 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:11.118+0000 7f9ba66be700 1 -- 172.21.15.46:0/444757650 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9ba0153500 con 0x7f9ba00b2b20 2023-07-05T18:57:11.126 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:11.118+0000 7f9b9cff9700 1 -- 172.21.15.46:0/444757650 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b98007070 con 0x7f9ba00b2b20 2023-07-05T18:57:11.126 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:11.118+0000 7f9ba66be700 1 -- 172.21.15.46:0/444757650 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9ba014bc60 con 0x7f9ba00b2b20 2023-07-05T18:57:11.126 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:11.119+0000 7f9ba66be700 1 -- 172.21.15.46:0/444757650 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9ba0153a20 con 0x7f9ba00b2b20 2023-07-05T18:57:11.127 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:11.119+0000 7f9b9cff9700 1 -- 172.21.15.46:0/444757650 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f9b980071d0 con 0x7f9ba00b2b20 2023-07-05T18:57:11.127 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:11.120+0000 7f9b9cff9700 1 --2- 172.21.15.46:0/444757650 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7f9b8c06ace0 0x7f9b8c06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:57:11.127 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:11.120+0000 7f9b9cff9700 1 -- 172.21.15.46:0/444757650 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f9b98088d50 con 0x7f9ba00b2b20 2023-07-05T18:57:11.127 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:11.120+0000 7f9b9ffff700 1 --2- 172.21.15.46:0/444757650 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7f9b8c06ace0 0x7f9b8c06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:57:11.128 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:11.120+0000 7f9b9ffff700 1 --2- 172.21.15.46:0/444757650 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7f9b8c06ace0 0x7f9b8c06d190 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f9b90009be0 tx=0x7f9b90009210 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-05T18:57:11.128 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:11.124+0000 7f9b9cff9700 1 -- 172.21.15.46:0/444757650 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f9ba0153a20 con 0x7f9ba00b2b20 2023-07-05T18:57:11.406 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:11.403+0000 7f9ba66be700 1 -- 172.21.15.46:0/444757650 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rbd-mirror"} v 0) v1 -- 0x7f9ba0153a20 con 0x7f9ba00b2b20 2023-07-05T18:57:11.409 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:11.407+0000 7f9b9cff9700 1 -- 172.21.15.46:0/444757650 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rbd-mirror"}]=0 v11) v1 ==== 97+0+0 (secure 0 0 0) 0x7f9ba0153a20 con 0x7f9ba00b2b20 2023-07-05T18:57:11.411 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:11.409+0000 7f9ba66be700 1 -- 172.21.15.46:0/444757650 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7f9b8c06ace0 msgr2=0x7f9b8c06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:57:11.412 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:11.409+0000 7f9ba66be700 1 --2- 172.21.15.46:0/444757650 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7f9b8c06ace0 0x7f9b8c06d190 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f9b90009be0 tx=0x7f9b90009210 comp rx=0 tx=0).stop 2023-07-05T18:57:11.412 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:11.409+0000 7f9ba66be700 1 -- 172.21.15.46:0/444757650 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9ba00b2b20 msgr2=0x7f9ba00b2fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:57:11.413 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:11.409+0000 7f9ba66be700 1 --2- 172.21.15.46:0/444757650 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9ba00b2b20 0x7f9ba00b2fc0 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f9b9800cbc0 tx=0x7f9b9800ced0 comp rx=0 tx=0).stop 2023-07-05T18:57:11.413 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:11.409+0000 7f9ba66be700 1 -- 172.21.15.46:0/444757650 shutdown_connections 2023-07-05T18:57:11.413 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:11.409+0000 7f9ba66be700 1 --2- 172.21.15.46:0/444757650 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7f9b8c06ace0 0x7f9b8c06d190 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:57:11.413 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:11.409+0000 7f9ba66be700 1 --2- 172.21.15.46:0/444757650 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9ba00b2b20 0x7f9ba00b2fc0 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:57:11.413 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:11.409+0000 7f9ba66be700 1 --2- 172.21.15.46:0/444757650 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9ba006cec0 0x7f9ba01f6590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:57:11.413 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:11.409+0000 7f9ba66be700 1 --2- 172.21.15.46:0/444757650 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f9ba00b17b0 0x7f9ba014b720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:57:11.414 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:11.409+0000 7f9ba66be700 1 -- 172.21.15.46:0/444757650 >> 172.21.15.46:0/444757650 conn(0x7f9ba006af10 msgr2=0x7f9ba0156060 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-05T18:57:11.414 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:11.409+0000 7f9ba66be700 1 -- 172.21.15.46:0/444757650 shutdown_connections 2023-07-05T18:57:11.414 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:11.409+0000 7f9ba66be700 1 -- 172.21.15.46:0/444757650 wait complete. 2023-07-05T18:57:11.423 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rgw 2023-07-05T18:57:11.551 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:11.549+0000 7f56514b3700 1 Processor -- start 2023-07-05T18:57:11.551 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:11.549+0000 7f56514b3700 1 -- start start 2023-07-05T18:57:11.552 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:11.549+0000 7f56514b3700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f564c0ce600 0x7f564c15a810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:57:11.553 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:11.550+0000 7f56514b3700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f564c0ce9d0 0x7f564c15de60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:57:11.553 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:11.550+0000 7f56514b3700 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f564c15e760 con 0x7f564c0d1260 2023-07-05T18:57:11.553 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:11.550+0000 7f56514b3700 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f564c15ea40 con 0x7f564c0ce9d0 2023-07-05T18:57:11.553 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:11.550+0000 7f56514b3700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f564c15ed20 con 0x7f564c0ce600 2023-07-05T18:57:11.553 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:11.550+0000 7f564affd700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f564c0ce600 0x7f564c15a810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:57:11.553 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:11.550+0000 7f564a7fc700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f564c0ce9d0 0x7f564c15de60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:57:11.554 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:11.550+0000 7f564affd700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f564c0ce600 0x7f564c15a810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3301/0 says I am v2:172.21.15.46:43370/0 (socket says 172.21.15.46:43370) 2023-07-05T18:57:11.554 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:11.550+0000 7f564b7fe700 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7f564c0d1260 0x7f564c15bc40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.46:44876/0 (socket says 172.21.15.46:44876) 2023-07-05T18:57:11.554 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:11.550+0000 7f564a7fc700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f564c0ce9d0 0x7f564c15de60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.46:59170/0 (socket says 172.21.15.46:59170) 2023-07-05T18:57:11.554 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:11.550+0000 7f564affd700 1 -- 172.21.15.46:0/1065711809 learned_addr learned my addr 172.21.15.46:0/1065711809 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-07-05T18:57:11.555 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:11.550+0000 7f564a7fc700 1 -- 172.21.15.46:0/1065711809 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f564c0ce600 msgr2=0x7f564c15a810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-05T18:57:11.555 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:11.550+0000 7f564a7fc700 1 --2- 172.21.15.46:0/1065711809 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f564c0ce600 0x7f564c15a810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:57:11.555 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:11.550+0000 7f564a7fc700 1 -- 172.21.15.46:0/1065711809 >> v1:172.21.15.73:6789/0 conn(0x7f564c0d1260 legacy=0x7f564c15bc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:57:11.555 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:11.550+0000 7f564a7fc700 1 -- 172.21.15.46:0/1065711809 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f564c0d0a60 con 0x7f564c0ce9d0 2023-07-05T18:57:11.555 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:11.550+0000 7f5649ffb700 1 -- 172.21.15.46:0/1065711809 <== mon.1 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 382816335 0 0) 0x7f564c15e760 con 0x7f564c0d1260 2023-07-05T18:57:11.556 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:11.550+0000 7f564affd700 1 --2- 172.21.15.46:0/1065711809 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f564c0ce600 0x7f564c15a810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-05T18:57:11.556 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:11.551+0000 7f564a7fc700 1 --2- 172.21.15.46:0/1065711809 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f564c0ce9d0 0x7f564c15de60 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f563c009840 tx=0x7f563c009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=dca39e130132dd4d server_cookie=0 in_seq=0 out_seq=0 2023-07-05T18:57:11.556 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:11.551+0000 7f5649ffb700 1 -- 172.21.15.46:0/1065711809 <== mon.1 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f563c011830 con 0x7f564c0ce9d0 2023-07-05T18:57:11.557 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:11.551+0000 7f5649ffb700 1 -- 172.21.15.46:0/1065711809 <== mon.1 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f563c011990 con 0x7f564c0ce9d0 2023-07-05T18:57:11.557 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:11.551+0000 7f5649ffb700 1 -- 172.21.15.46:0/1065711809 <== mon.1 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f563c011d20 con 0x7f564c0ce9d0 2023-07-05T18:57:11.560 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:11.551+0000 7f56514b3700 1 -- 172.21.15.46:0/1065711809 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f564c0ce9d0 msgr2=0x7f564c15de60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:57:11.561 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:11.551+0000 7f56514b3700 1 --2- 172.21.15.46:0/1065711809 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f564c0ce9d0 0x7f564c15de60 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f563c009840 tx=0x7f563c009b50 comp rx=0 tx=0).stop 2023-07-05T18:57:11.561 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:11.551+0000 7f56514b3700 1 -- 172.21.15.46:0/1065711809 shutdown_connections 2023-07-05T18:57:11.561 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:11.551+0000 7f56514b3700 1 --2- 172.21.15.46:0/1065711809 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f564c0ce600 0x7f564c15a810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:57:11.561 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:11.551+0000 7f56514b3700 1 --2- 172.21.15.46:0/1065711809 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f564c0ce9d0 0x7f564c15de60 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:57:11.561 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:11.551+0000 7f56514b3700 1 -- 172.21.15.46:0/1065711809 >> 172.21.15.46:0/1065711809 conn(0x7f564c0999f0 msgr2=0x7f564c099df0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-05T18:57:11.561 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:11.551+0000 7f56514b3700 1 -- 172.21.15.46:0/1065711809 shutdown_connections 2023-07-05T18:57:11.562 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:11.551+0000 7f56514b3700 1 -- 172.21.15.46:0/1065711809 wait complete. 2023-07-05T18:57:11.562 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:11.553+0000 7f56514b3700 1 Processor -- start 2023-07-05T18:57:11.562 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:11.553+0000 7f56514b3700 1 -- start start 2023-07-05T18:57:11.563 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:11.553+0000 7f56514b3700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f564c0ce600 0x7f564c0b65b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:57:11.563 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:11.553+0000 7f56514b3700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f564c0ce9d0 0x7f564c0c4560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:57:11.563 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:11.553+0000 7f56514b3700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f564c0d1260 0x7f564c158c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:57:11.563 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:11.553+0000 7f56514b3700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f564c0c55e0 con 0x7f564c0d1260 2023-07-05T18:57:11.563 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:11.553+0000 7f56514b3700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f564c0b3860 con 0x7f564c0ce600 2023-07-05T18:57:11.563 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:11.553+0000 7f56514b3700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f564c0c4aa0 con 0x7f564c0ce9d0 2023-07-05T18:57:11.564 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:11.554+0000 7f564b7fe700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f564c0d1260 0x7f564c158c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:57:11.564 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:11.554+0000 7f564b7fe700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f564c0d1260 0x7f564c158c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:59694/0 (socket says 172.21.15.46:59694) 2023-07-05T18:57:11.564 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:11.554+0000 7f564affd700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f564c0ce600 0x7f564c0b65b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:57:11.564 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:11.554+0000 7f564b7fe700 1 -- 172.21.15.46:0/537823301 learned_addr learned my addr 172.21.15.46:0/537823301 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-07-05T18:57:11.569 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:11.554+0000 7f564a7fc700 1 --2- 172.21.15.46:0/537823301 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f564c0ce9d0 0x7f564c0c4560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:57:11.569 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:11.554+0000 7f564b7fe700 1 -- 172.21.15.46:0/537823301 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f564c0ce9d0 msgr2=0x7f564c0c4560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:57:11.569 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:11.554+0000 7f564b7fe700 1 --2- 172.21.15.46:0/537823301 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f564c0ce9d0 0x7f564c0c4560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:57:11.569 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:11.554+0000 7f564b7fe700 1 -- 172.21.15.46:0/537823301 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f564c0ce600 msgr2=0x7f564c0b65b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:57:11.569 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:11.554+0000 7f564b7fe700 1 --2- 172.21.15.46:0/537823301 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f564c0ce600 0x7f564c0b65b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:57:11.569 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:11.554+0000 7f564b7fe700 1 -- 172.21.15.46:0/537823301 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5640009550 con 0x7f564c0d1260 2023-07-05T18:57:11.570 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:11.554+0000 7f564affd700 1 --2- 172.21.15.46:0/537823301 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f564c0ce600 0x7f564c0b65b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-05T18:57:11.570 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:11.554+0000 7f564b7fe700 1 --2- 172.21.15.46:0/537823301 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f564c0d1260 0x7f564c158c00 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f5644002230 tx=0x7f564400cf50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-05T18:57:11.570 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:11.554+0000 7f56337fe700 1 -- 172.21.15.46:0/537823301 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f564400aac0 con 0x7f564c0d1260 2023-07-05T18:57:11.570 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:11.554+0000 7f56337fe700 1 -- 172.21.15.46:0/537823301 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f564400ac40 con 0x7f564c0d1260 2023-07-05T18:57:11.570 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:11.554+0000 7f56514b3700 1 -- 172.21.15.46:0/537823301 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f563c0094a0 con 0x7f564c0d1260 2023-07-05T18:57:11.570 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:11.554+0000 7f56337fe700 1 -- 172.21.15.46:0/537823301 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56440070d0 con 0x7f564c0d1260 2023-07-05T18:57:11.570 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:11.554+0000 7f56514b3700 1 -- 172.21.15.46:0/537823301 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f564c0c5300 con 0x7f564c0d1260 2023-07-05T18:57:11.570 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:11.555+0000 7f56514b3700 1 -- 172.21.15.46:0/537823301 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f564c04e1d0 con 0x7f564c0d1260 2023-07-05T18:57:11.571 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:11.556+0000 7f56337fe700 1 -- 172.21.15.46:0/537823301 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f5644007250 con 0x7f564c0d1260 2023-07-05T18:57:11.571 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:11.556+0000 7f56337fe700 1 --2- 172.21.15.46:0/537823301 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7f563806ace0 0x7f563806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:57:11.571 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:11.556+0000 7f56337fe700 1 -- 172.21.15.46:0/537823301 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f5644088c10 con 0x7f564c0d1260 2023-07-05T18:57:11.571 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:11.556+0000 7f564affd700 1 --2- 172.21.15.46:0/537823301 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7f563806ace0 0x7f563806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:57:11.571 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:11.557+0000 7f564affd700 1 --2- 172.21.15.46:0/537823301 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7f563806ace0 0x7f563806d190 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f5640006d30 tx=0x7f56400092c0 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-05T18:57:11.572 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:11.561+0000 7f56337fe700 1 -- 172.21.15.46:0/537823301 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f5644053f90 con 0x7f564c0d1260 2023-07-05T18:57:11.840 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:11.839+0000 7f56514b3700 1 -- 172.21.15.46:0/537823301 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rgw"} v 0) v1 -- 0x7f564c072370 con 0x7f564c0d1260 2023-07-05T18:57:11.845 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:11.842+0000 7f56337fe700 1 -- 172.21.15.46:0/537823301 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rgw"}]=0 v12) v1 ==== 90+0+0 (secure 0 0 0) 0x7f56440575b0 con 0x7f564c0d1260 2023-07-05T18:57:11.847 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:11.844+0000 7f56514b3700 1 -- 172.21.15.46:0/537823301 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7f563806ace0 msgr2=0x7f563806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:57:11.847 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:11.844+0000 7f56514b3700 1 --2- 172.21.15.46:0/537823301 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7f563806ace0 0x7f563806d190 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f5640006d30 tx=0x7f56400092c0 comp rx=0 tx=0).stop 2023-07-05T18:57:11.847 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:11.844+0000 7f56514b3700 1 -- 172.21.15.46:0/537823301 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f564c0d1260 msgr2=0x7f564c158c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:57:11.848 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:11.844+0000 7f56514b3700 1 --2- 172.21.15.46:0/537823301 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f564c0d1260 0x7f564c158c00 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f5644002230 tx=0x7f564400cf50 comp rx=0 tx=0).stop 2023-07-05T18:57:11.848 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:11.844+0000 7f56514b3700 1 -- 172.21.15.46:0/537823301 shutdown_connections 2023-07-05T18:57:11.849 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:11.844+0000 7f56514b3700 1 --2- 172.21.15.46:0/537823301 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7f563806ace0 0x7f563806d190 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:57:11.849 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:11.844+0000 7f56514b3700 1 --2- 172.21.15.46:0/537823301 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f564c0d1260 0x7f564c158c00 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:57:11.849 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:11.844+0000 7f56514b3700 1 --2- 172.21.15.46:0/537823301 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f564c0ce600 0x7f564c0b65b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:57:11.850 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:11.844+0000 7f56514b3700 1 --2- 172.21.15.46:0/537823301 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f564c0ce9d0 0x7f564c0c4560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:57:11.850 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:11.844+0000 7f56514b3700 1 -- 172.21.15.46:0/537823301 >> 172.21.15.46:0/537823301 conn(0x7f564c0999f0 msgr2=0x7f564c0b1230 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-05T18:57:11.850 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:11.844+0000 7f56514b3700 1 -- 172.21.15.46:0/537823301 shutdown_connections 2023-07-05T18:57:11.850 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:11.844+0000 7f56514b3700 1 -- 172.21.15.46:0/537823301 wait complete. 2023-07-05T18:57:11.859 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-05T18:57:11.984 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:11.982+0000 7fadce043700 1 Processor -- start 2023-07-05T18:57:11.985 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:11.982+0000 7fadce043700 1 -- start start 2023-07-05T18:57:11.987 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:11.983+0000 7fadce043700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fadc815d190 0x7fadc8152c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:57:11.987 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:11.983+0000 7fadce043700 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fadc806caf0 con 0x7fadc80aeed0 2023-07-05T18:57:11.987 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:11.983+0000 7fadce043700 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fadc815d9b0 con 0x7fadc806a510 2023-07-05T18:57:11.987 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:11.983+0000 7fadce043700 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fadc80b3130 con 0x7fadc815d190 2023-07-05T18:57:11.987 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:11.983+0000 7fadc7fff700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fadc815d190 0x7fadc8152c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:57:11.988 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:11.983+0000 7fadc7fff700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fadc815d190 0x7fadc8152c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:59702/0 (socket says 172.21.15.46:59702) 2023-07-05T18:57:11.988 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:11.983+0000 7fadc77fe700 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7fadc80aeed0 0x7fadc8069e00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:58970/0 (socket says 172.21.15.46:58970) 2023-07-05T18:57:11.988 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:11.983+0000 7fadc7fff700 1 -- 172.21.15.46:0/2463010451 learned_addr learned my addr 172.21.15.46:0/2463010451 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-07-05T18:57:11.989 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:11.983+0000 7fadc7fff700 1 -- 172.21.15.46:0/2463010451 >> v1:172.21.15.73:6789/0 conn(0x7fadc806a510 legacy=0x7fadc815ca80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:57:11.989 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:11.983+0000 7fadc7fff700 1 -- 172.21.15.46:0/2463010451 >> v1:172.21.15.46:6789/0 conn(0x7fadc80aeed0 legacy=0x7fadc8069e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:57:11.989 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:11.983+0000 7fadc7fff700 1 -- 172.21.15.46:0/2463010451 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fadc815d6d0 con 0x7fadc815d190 2023-07-05T18:57:11.989 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:11.983+0000 7fadc67fc700 1 -- 172.21.15.46:0/2463010451 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1109295035 0 0) 0x7fadc806caf0 con 0x7fadc80aeed0 2023-07-05T18:57:11.989 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:11.984+0000 7fadc7fff700 1 --2- 172.21.15.46:0/2463010451 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fadc815d190 0x7fadc8152c10 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7fadc0009e50 tx=0x7fadc000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=74347a2f71b35fac server_cookie=0 in_seq=0 out_seq=0 2023-07-05T18:57:11.989 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:11.984+0000 7fadc67fc700 1 -- 172.21.15.46:0/2463010451 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fadc000e070 con 0x7fadc815d190 2023-07-05T18:57:11.990 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:11.984+0000 7fadc67fc700 1 -- 172.21.15.46:0/2463010451 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fadc000b9c0 con 0x7fadc815d190 2023-07-05T18:57:11.991 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:11.984+0000 7fadc67fc700 1 -- 172.21.15.46:0/2463010451 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fadc000bd70 con 0x7fadc815d190 2023-07-05T18:57:11.991 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:11.984+0000 7fadce043700 1 -- 172.21.15.46:0/2463010451 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fadc815d190 msgr2=0x7fadc8152c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:57:11.991 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:11.984+0000 7fadce043700 1 --2- 172.21.15.46:0/2463010451 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fadc815d190 0x7fadc8152c10 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7fadc0009e50 tx=0x7fadc000b330 comp rx=0 tx=0).stop 2023-07-05T18:57:11.991 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:11.984+0000 7fadce043700 1 -- 172.21.15.46:0/2463010451 shutdown_connections 2023-07-05T18:57:11.991 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:11.984+0000 7fadce043700 1 --2- 172.21.15.46:0/2463010451 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fadc815d190 0x7fadc8152c10 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:57:11.991 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:11.984+0000 7fadce043700 1 -- 172.21.15.46:0/2463010451 >> 172.21.15.46:0/2463010451 conn(0x7fadc806af10 msgr2=0x7fadc806b2e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-05T18:57:11.991 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:11.984+0000 7fadce043700 1 -- 172.21.15.46:0/2463010451 shutdown_connections 2023-07-05T18:57:11.992 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:11.984+0000 7fadce043700 1 -- 172.21.15.46:0/2463010451 wait complete. 2023-07-05T18:57:11.994 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:11.986+0000 7fadce043700 1 Processor -- start 2023-07-05T18:57:11.994 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:11.986+0000 7fadce043700 1 -- start start 2023-07-05T18:57:11.995 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:11.986+0000 7fadce043700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fadc806a510 0x7fadc8152bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:57:11.995 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:11.986+0000 7fadce043700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fadc80aeed0 0x7fadc81598d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:57:11.995 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:11.986+0000 7fadce043700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fadc815d190 0x7fadc8159e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:57:11.995 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:11.986+0000 7fadce043700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fadc81578f0 con 0x7fadc80aeed0 2023-07-05T18:57:11.995 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:11.986+0000 7fadce043700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fadc80b1fa0 con 0x7fadc815d190 2023-07-05T18:57:11.995 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:11.986+0000 7fadce043700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fadc80b1cc0 con 0x7fadc806a510 2023-07-05T18:57:11.995 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:11.987+0000 7fadc6ffd700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fadc80aeed0 0x7fadc81598d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:57:11.996 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:11.987+0000 7fadc6ffd700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fadc80aeed0 0x7fadc81598d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:59706/0 (socket says 172.21.15.46:59706) 2023-07-05T18:57:11.996 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:11.987+0000 7fadc6ffd700 1 -- 172.21.15.46:0/3943062108 learned_addr learned my addr 172.21.15.46:0/3943062108 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-07-05T18:57:11.996 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:11.987+0000 7fadc77fe700 1 --2- 172.21.15.46:0/3943062108 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fadc806a510 0x7fadc8152bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:57:11.996 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:11.987+0000 7fadc6ffd700 1 -- 172.21.15.46:0/3943062108 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fadc806a510 msgr2=0x7fadc8152bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:57:11.996 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:11.987+0000 7fadc6ffd700 1 --2- 172.21.15.46:0/3943062108 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fadc806a510 0x7fadc8152bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:57:11.996 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:11.987+0000 7fadc6ffd700 1 -- 172.21.15.46:0/3943062108 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fadc815d190 msgr2=0x7fadc8159e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:57:11.996 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:11.987+0000 7fadc7fff700 1 --2- 172.21.15.46:0/3943062108 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fadc815d190 0x7fadc8159e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:57:11.996 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:11.987+0000 7fadc6ffd700 1 --2- 172.21.15.46:0/3943062108 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fadc815d190 0x7fadc8159e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:57:11.997 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:11.987+0000 7fadc6ffd700 1 -- 172.21.15.46:0/3943062108 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fadc0009b30 con 0x7fadc80aeed0 2023-07-05T18:57:11.997 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:11.987+0000 7fadc7fff700 1 --2- 172.21.15.46:0/3943062108 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fadc815d190 0x7fadc8159e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-05T18:57:11.997 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:11.987+0000 7fadc6ffd700 1 --2- 172.21.15.46:0/3943062108 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fadc80aeed0 0x7fadc81598d0 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7fadb000c420 tx=0x7fadb000c7e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-05T18:57:11.997 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:11.987+0000 7fadbffff700 1 -- 172.21.15.46:0/3943062108 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fadb00052d0 con 0x7fadc80aeed0 2023-07-05T18:57:11.997 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:11.987+0000 7fadbffff700 1 -- 172.21.15.46:0/3943062108 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fadb0005430 con 0x7fadc80aeed0 2023-07-05T18:57:11.997 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:11.987+0000 7fadce043700 1 -- 172.21.15.46:0/3943062108 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fadc8157230 con 0x7fadc80aeed0 2023-07-05T18:57:11.997 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:11.987+0000 7fadbffff700 1 -- 172.21.15.46:0/3943062108 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fadb00038c0 con 0x7fadc80aeed0 2023-07-05T18:57:11.998 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:11.987+0000 7fadce043700 1 -- 172.21.15.46:0/3943062108 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fadc8153100 con 0x7fadc80aeed0 2023-07-05T18:57:11.998 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:11.988+0000 7fadce043700 1 -- 172.21.15.46:0/3943062108 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fadc8157a30 con 0x7fadc80aeed0 2023-07-05T18:57:11.998 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:11.989+0000 7fadbffff700 1 -- 172.21.15.46:0/3943062108 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fadb0003a20 con 0x7fadc80aeed0 2023-07-05T18:57:11.998 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:11.989+0000 7fadbffff700 1 --2- 172.21.15.46:0/3943062108 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7fada806ace0 0x7fada806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:57:11.998 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:11.989+0000 7fadbffff700 1 -- 172.21.15.46:0/3943062108 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 5210+0+0 (secure 0 0 0) 0x7fadb00884d0 con 0x7fadc80aeed0 2023-07-05T18:57:11.998 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:11.989+0000 7fadc77fe700 1 --2- 172.21.15.46:0/3943062108 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7fada806ace0 0x7fada806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:57:11.998 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:11.990+0000 7fadc77fe700 1 --2- 172.21.15.46:0/3943062108 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7fada806ace0 0x7fada806d190 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7fadb8000f60 tx=0x7fadb8009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-05T18:57:11.999 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:11.994+0000 7fadbffff700 1 -- 172.21.15.46:0/3943062108 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fadc8157a30 con 0x7fadc80aeed0 2023-07-05T18:57:12.201 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:12.196+0000 7fadce043700 1 -- 172.21.15.46:0/3943062108 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fadc8157a30 con 0x7fadc80aeed0 2023-07-05T18:57:12.201 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:12.197+0000 7fadbffff700 1 -- 172.21.15.46:0/3943062108 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v31) v1 ==== 74+0+14521 (secure 0 0 0) 0x7fadc8157a30 con 0x7fadc80aeed0 2023-07-05T18:57:12.201 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T18:57:12.201 INFO:teuthology.orchestra.run.smithi046.stdout:{"epoch":31,"fsid":"042652d3-d80c-4ad8-9366-3e94f2a0a512","created":"2023-07-05T18:55:56.455710+0000","modified":"2023-07-05T18:57:08.739642+0000","last_up_change":"2023-07-05T18:56:06.594022+0000","last_in_change":"2023-07-05T18:55:58.879340+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-07-05T18:56:07.729620+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2023-07-05T18:56:08.128122+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"20009183-9a47-4392-8751-883f88d2bfb1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6813","nonce":4151971443},{"type":"v1","addr":"172.21.15.46:6815","nonce":4151971443}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6817","nonce":4151971443},{"type":"v1","addr":"172.21.15.46:6818","nonce":4151971443}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6822","nonce":4151971443},{"type":"v1","addr":"172.21.15.46:6823","nonce":4151971443}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6820","nonce":4151971443},{"type":"v1","addr":"172.21.15.46:6821","nonce":4151971443}]},"public_addr":"172.21.15.46:6815/4151971443","cluster_addr":"172.21.15.46:6818/4151971443","heartbeat_back_addr":"172.21.15.46:6823/4151971443","heartbeat_front_addr":"172.21.15.46:6821/4151971443","state":["exists","up"]},{"osd":1,"uuid":"91b4a7b0-e4e4-4888-a1fe-9edb0d68004c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6808","nonce":502575881},{"type":"v1","addr":"172.21.15.46:6809","nonce":502575881}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6810","nonce":502575881},{"type":"v1","addr":"172.21.15.46:6811","nonce":502575881}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6816","nonce":502575881},{"type":"v1","addr":"172.21.15.46:6819","nonce":502575881}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6812","nonce":502575881},{"type":"v1","addr":"172.21.15.46:6814","nonce":502575881}]},"public_addr":"172.21.15.46:6809/502575881","cluster_addr":"172.21.15.46:6811/502575881","heartbeat_back_addr":"172.21.15.46:6819/502575881","heartbeat_front_addr":"172.21.15.46:6814/502575881","state":["exists","up"]},{"osd":2,"uuid":"669ff744-1331-47c5-8579-0440731c889a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6800","nonce":2115251461},{"type":"v1","addr":"172.21.15.46:6801","nonce":2115251461}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6802","nonce":2115251461},{"type":"v1","addr":"172.21.15.46:6803","nonce":2115251461}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6806","nonce":2115251461},{"type":"v1","addr":"172.21.15.46:6807","nonce":2115251461}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6804","nonce":2115251461},{"type":"v1","addr":"172.21.15.46:6805","nonce":2115251461}]},"public_addr":"172.21.15.46:6801/2115251461","cluster_addr":"172.21.15.46:6803/2115251461","heartbeat_back_addr":"172.21.15.46:6807/2115251461","heartbeat_front_addr":"172.21.15.46:6805/2115251461","state":["exists","up"]},{"osd":3,"uuid":"34e1b86d-ffad-415d-861c-07a5f08068a6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6824","nonce":2981388766},{"type":"v1","addr":"172.21.15.46:6825","nonce":2981388766}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6826","nonce":2981388766},{"type":"v1","addr":"172.21.15.46:6827","nonce":2981388766}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6830","nonce":2981388766},{"type":"v1","addr":"172.21.15.46:6831","nonce":2981388766}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6828","nonce":2981388766},{"type":"v1","addr":"172.21.15.46:6829","nonce":2981388766}]},"public_addr":"172.21.15.46:6825/2981388766","cluster_addr":"172.21.15.46:6827/2981388766","heartbeat_back_addr":"172.21.15.46:6831/2981388766","heartbeat_front_addr":"172.21.15.46:6829/2981388766","state":["exists","up"]},{"osd":4,"uuid":"57ffcb91-c7dc-4a69-ae71-4d9622a14a05","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6800","nonce":2083655348},{"type":"v1","addr":"172.21.15.73:6801","nonce":2083655348}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6802","nonce":2083655348},{"type":"v1","addr":"172.21.15.73:6803","nonce":2083655348}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6806","nonce":2083655348},{"type":"v1","addr":"172.21.15.73:6807","nonce":2083655348}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6804","nonce":2083655348},{"type":"v1","addr":"172.21.15.73:6805","nonce":2083655348}]},"public_addr":"172.21.15.73:6801/2083655348","cluster_addr":"172.21.15.73:6803/2083655348","heartbeat_back_addr":"172.21.15.73:6807/2083655348","heartbeat_front_addr":"172.21.15.73:6805/2083655348","state":["exists","up"]},{"osd":5,"uuid":"665f41c9-ee20-49cf-bf0e-fbe0c03d3aed","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6824","nonce":2803788401},{"type":"v1","addr":"172.21.15.73:6825","nonce":2803788401}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6826","nonce":2803788401},{"type":"v1","addr":"172.21.15.73:6827","nonce":2803788401}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6830","nonce":2803788401},{"type":"v1","addr":"172.21.15.73:6831","nonce":2803788401}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6828","nonce":2803788401},{"type":"v1","addr":"172.21.15.73:6829","nonce":2803788401}]},"public_addr":"172.21.15.73:6825/2803788401","cluster_addr":"172.21.15.73:6827/2803788401","heartbeat_back_addr":"172.21.15.73:6831/2803788401","heartbeat_front_addr":"172.21.15.73:6829/2803788401","state":["exists","up"]},{"osd":6,"uuid":"5790c6cc-bd56-4ce4-9a7c-0f0c3b59215c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6808","nonce":974108383},{"type":"v1","addr":"172.21.15.73:6809","nonce":974108383}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6810","nonce":974108383},{"type":"v1","addr":"172.21.15.73:6811","nonce":974108383}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6815","nonce":974108383},{"type":"v1","addr":"172.21.15.73:6817","nonce":974108383}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6812","nonce":974108383},{"type":"v1","addr":"172.21.15.73:6813","nonce":974108383}]},"public_addr":"172.21.15.73:6809/974108383","cluster_addr":"172.21.15.73:6811/974108383","heartbeat_back_addr":"172.21.15.73:6817/974108383","heartbeat_front_addr":"172.21.15.73:6813/974108383","state":["exists","up"]},{"osd":7,"uuid":"b66f4d2e-147e-4c9b-97dd-cbd59d33802e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6814","nonce":3772673248},{"type":"v1","addr":"172.21.15.73:6816","nonce":3772673248}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6818","nonce":3772673248},{"type":"v1","addr":"172.21.15.73:6819","nonce":3772673248}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6822","nonce":3772673248},{"type":"v1","addr":"172.21.15.73:6823","nonce":3772673248}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6820","nonce":3772673248},{"type":"v1","addr":"172.21.15.73:6821","nonce":3772673248}]},"public_addr":"172.21.15.73:6816/3772673248","cluster_addr":"172.21.15.73:6819/3772673248","heartbeat_back_addr":"172.21.15.73:6823/3772673248","heartbeat_front_addr":"172.21.15.73:6821/3772673248","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-05T18:56:04.115334+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-05T18:56:04.071250+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-05T18:56:04.044387+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-05T18:56:04.085389+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-05T18:56:04.090726+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-05T18:56:04.074529+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-05T18:56:04.058841+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-05T18:56:04.043054+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-05T18:57:12.203 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:12.199+0000 7fadce043700 1 -- 172.21.15.46:0/3943062108 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7fada806ace0 msgr2=0x7fada806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:57:12.203 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:12.199+0000 7fadce043700 1 --2- 172.21.15.46:0/3943062108 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7fada806ace0 0x7fada806d190 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7fadb8000f60 tx=0x7fadb8009040 comp rx=0 tx=0).stop 2023-07-05T18:57:12.203 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:12.199+0000 7fadce043700 1 -- 172.21.15.46:0/3943062108 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fadc80aeed0 msgr2=0x7fadc81598d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:57:12.203 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:12.199+0000 7fadce043700 1 --2- 172.21.15.46:0/3943062108 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fadc80aeed0 0x7fadc81598d0 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7fadb000c420 tx=0x7fadb000c7e0 comp rx=0 tx=0).stop 2023-07-05T18:57:12.204 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:12.199+0000 7fadce043700 1 -- 172.21.15.46:0/3943062108 shutdown_connections 2023-07-05T18:57:12.204 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:12.199+0000 7fadce043700 1 --2- 172.21.15.46:0/3943062108 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7fada806ace0 0x7fada806d190 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:57:12.204 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:12.199+0000 7fadce043700 1 --2- 172.21.15.46:0/3943062108 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fadc815d190 0x7fadc8159e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:57:12.205 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:12.199+0000 7fadce043700 1 --2- 172.21.15.46:0/3943062108 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fadc806a510 0x7fadc8152bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:57:12.206 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:12.199+0000 7fadce043700 1 --2- 172.21.15.46:0/3943062108 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fadc80aeed0 0x7fadc81598d0 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:57:12.206 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:12.199+0000 7fadce043700 1 -- 172.21.15.46:0/3943062108 >> 172.21.15.46:0/3943062108 conn(0x7fadc806af10 msgr2=0x7fadc80b3a20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-05T18:57:12.206 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:12.199+0000 7fadce043700 1 -- 172.21.15.46:0/3943062108 shutdown_connections 2023-07-05T18:57:12.206 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:12.199+0000 7fadce043700 1 -- 172.21.15.46:0/3943062108 wait complete. 2023-07-05T18:57:12.214 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'rbd', 'create_time': '2023-07-05T18:56:07.729620+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': '.mgr', 'create_time': '2023-07-05T18:56:08.128122+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-07-05T18:57:12.215 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-07-05T18:57:12.347 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:12.341+0000 7fbb7941c700 1 Processor -- start 2023-07-05T18:57:12.347 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:12.341+0000 7fbb7941c700 1 -- start start 2023-07-05T18:57:12.347 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:12.342+0000 7fbb7941c700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fbb740afe50 0x7fbb740b1620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:57:12.348 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:12.342+0000 7fbb7941c700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fbb740b1b60 0x7fbb740d0b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:57:12.348 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:12.342+0000 7fbb7941c700 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbb7406ad80 con 0x7fbb740cecc0 2023-07-05T18:57:12.348 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:12.342+0000 7fbb7941c700 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbb740cf150 con 0x7fbb740afe50 2023-07-05T18:57:12.348 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:12.342+0000 7fbb7941c700 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbb740cf430 con 0x7fbb740b1b60 2023-07-05T18:57:12.348 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:12.342+0000 7fbb72ffd700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fbb740afe50 0x7fbb740b1620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:57:12.348 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:12.342+0000 7fbb737fe700 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7fbb740cecc0 0x7fbb741603e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:58986/0 (socket says 172.21.15.46:58986) 2023-07-05T18:57:12.349 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:12.342+0000 7fbb737fe700 1 -- 172.21.15.46:0/1322973142 learned_addr learned my addr 172.21.15.46:0/1322973142 (peer_addr_for_me v1:172.21.15.46:0/0) 2023-07-05T18:57:12.350 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:12.343+0000 7fbb727fc700 1 --2- 172.21.15.46:0/1322973142 >> v2:172.21.15.73:3300/0 conn(0x7fbb740b1b60 0x7fbb740d0b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:57:12.350 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:12.343+0000 7fbb72ffd700 1 -- 172.21.15.46:0/1322973142 >> v2:172.21.15.73:3300/0 conn(0x7fbb740b1b60 msgr2=0x7fbb740d0b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-05T18:57:12.351 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:12.343+0000 7fbb72ffd700 1 --2- 172.21.15.46:0/1322973142 >> v2:172.21.15.73:3300/0 conn(0x7fbb740b1b60 0x7fbb740d0b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:57:12.351 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:12.343+0000 7fbb72ffd700 1 -- 172.21.15.46:0/1322973142 >> v1:172.21.15.46:6789/0 conn(0x7fbb740cecc0 legacy=0x7fbb741603e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:57:12.351 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:12.343+0000 7fbb72ffd700 1 -- 172.21.15.46:0/1322973142 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbb7406b020 con 0x7fbb740afe50 2023-07-05T18:57:12.351 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:12.343+0000 7fbb71ffb700 1 -- 172.21.15.46:0/1322973142 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3147264211 0 0) 0x7fbb7406ad80 con 0x7fbb740cecc0 2023-07-05T18:57:12.351 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:12.343+0000 7fbb72ffd700 1 --2- 172.21.15.46:0/1322973142 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fbb740afe50 0x7fbb740b1620 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7fbb74071480 tx=0x7fbb68009b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8d1494344fcc10ef server_cookie=0 in_seq=0 out_seq=0 2023-07-05T18:57:12.352 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:12.343+0000 7fbb71ffb700 1 -- 172.21.15.46:0/1322973142 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb68011830 con 0x7fbb740afe50 2023-07-05T18:57:12.352 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:12.343+0000 7fbb71ffb700 1 -- 172.21.15.46:0/1322973142 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbb68011990 con 0x7fbb740afe50 2023-07-05T18:57:12.352 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:12.343+0000 7fbb71ffb700 1 -- 172.21.15.46:0/1322973142 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb68011d20 con 0x7fbb740afe50 2023-07-05T18:57:12.352 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:12.344+0000 7fbb7941c700 1 -- 172.21.15.46:0/1322973142 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fbb740afe50 msgr2=0x7fbb740b1620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:57:12.352 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:12.344+0000 7fbb7941c700 1 --2- 172.21.15.46:0/1322973142 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fbb740afe50 0x7fbb740b1620 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7fbb74071480 tx=0x7fbb68009b20 comp rx=0 tx=0).stop 2023-07-05T18:57:12.352 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:12.344+0000 7fbb7941c700 1 -- 172.21.15.46:0/1322973142 shutdown_connections 2023-07-05T18:57:12.352 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:12.344+0000 7fbb7941c700 1 --2- 172.21.15.46:0/1322973142 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fbb740afe50 0x7fbb740b1620 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:57:12.352 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:12.344+0000 7fbb7941c700 1 --2- 172.21.15.46:0/1322973142 >> v2:172.21.15.73:3300/0 conn(0x7fbb740b1b60 0x7fbb740d0b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:57:12.353 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:12.344+0000 7fbb7941c700 1 -- 172.21.15.46:0/1322973142 >> 172.21.15.46:0/1322973142 conn(0x7fbb740664b0 msgr2=0x7fbb74099e10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-05T18:57:12.353 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:12.344+0000 7fbb7941c700 1 -- 172.21.15.46:0/1322973142 shutdown_connections 2023-07-05T18:57:12.353 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:12.344+0000 7fbb7941c700 1 -- 172.21.15.46:0/1322973142 wait complete. 2023-07-05T18:57:12.353 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:12.345+0000 7fbb7941c700 1 Processor -- start 2023-07-05T18:57:12.353 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:12.345+0000 7fbb7941c700 1 -- start start 2023-07-05T18:57:12.356 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:12.346+0000 7fbb7941c700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fbb740afe50 0x7fbb741f7360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:57:12.357 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:12.346+0000 7fbb7941c700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fbb740cecc0 0x7fbb741f8f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:57:12.357 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:12.346+0000 7fbb7941c700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fbb740b4ec0 0x7fbb740b54e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:57:12.357 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:12.346+0000 7fbb7941c700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb741f71e0 con 0x7fbb740cecc0 2023-07-05T18:57:12.357 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:12.346+0000 7fbb7941c700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb740c4870 con 0x7fbb740afe50 2023-07-05T18:57:12.357 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:12.346+0000 7fbb7941c700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbb740c4b50 con 0x7fbb740b4ec0 2023-07-05T18:57:12.357 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:12.346+0000 7fbb727fc700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fbb740cecc0 0x7fbb741f8f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:57:12.357 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:12.346+0000 7fbb727fc700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fbb740cecc0 0x7fbb741f8f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:59716/0 (socket says 172.21.15.46:59716) 2023-07-05T18:57:12.358 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:12.346+0000 7fbb727fc700 1 -- 172.21.15.46:0/3517172202 learned_addr learned my addr 172.21.15.46:0/3517172202 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-07-05T18:57:12.358 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:12.346+0000 7fbb72ffd700 1 --2- 172.21.15.46:0/3517172202 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fbb740afe50 0x7fbb741f7360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:57:12.358 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:12.346+0000 7fbb727fc700 1 -- 172.21.15.46:0/3517172202 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fbb740b4ec0 msgr2=0x7fbb740b54e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:57:12.358 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:12.346+0000 7fbb727fc700 1 --2- 172.21.15.46:0/3517172202 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fbb740b4ec0 0x7fbb740b54e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:57:12.358 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:12.346+0000 7fbb727fc700 1 -- 172.21.15.46:0/3517172202 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fbb740afe50 msgr2=0x7fbb741f7360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:57:12.358 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:12.346+0000 7fbb727fc700 1 --2- 172.21.15.46:0/3517172202 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fbb740afe50 0x7fbb741f7360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:57:12.358 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:12.346+0000 7fbb727fc700 1 -- 172.21.15.46:0/3517172202 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbb680094a0 con 0x7fbb740cecc0 2023-07-05T18:57:12.359 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:12.346+0000 7fbb727fc700 1 --2- 172.21.15.46:0/3517172202 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fbb740cecc0 0x7fbb741f8f00 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7fbb6400e810 tx=0x7fbb6400ebd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-05T18:57:12.359 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:12.347+0000 7fbb5b7fe700 1 -- 172.21.15.46:0/3517172202 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb64013610 con 0x7fbb740cecc0 2023-07-05T18:57:12.359 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:12.347+0000 7fbb5b7fe700 1 -- 172.21.15.46:0/3517172202 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbb64013770 con 0x7fbb740cecc0 2023-07-05T18:57:12.359 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:12.347+0000 7fbb7941c700 1 -- 172.21.15.46:0/3517172202 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbb740c4e30 con 0x7fbb740cecc0 2023-07-05T18:57:12.359 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:12.347+0000 7fbb5b7fe700 1 -- 172.21.15.46:0/3517172202 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb64013b20 con 0x7fbb740cecc0 2023-07-05T18:57:12.359 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:12.347+0000 7fbb7941c700 1 -- 172.21.15.46:0/3517172202 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbb741f78a0 con 0x7fbb740cecc0 2023-07-05T18:57:12.359 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:12.348+0000 7fbb7941c700 1 -- 172.21.15.46:0/3517172202 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbb740c5350 con 0x7fbb740cecc0 2023-07-05T18:57:12.359 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:12.348+0000 7fbb5b7fe700 1 -- 172.21.15.46:0/3517172202 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fbb64013c80 con 0x7fbb740cecc0 2023-07-05T18:57:12.360 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:12.348+0000 7fbb5b7fe700 1 --2- 172.21.15.46:0/3517172202 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7fbb6006ace0 0x7fbb6006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:57:12.360 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:12.349+0000 7fbb5b7fe700 1 -- 172.21.15.46:0/3517172202 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 5210+0+0 (secure 0 0 0) 0x7fbb64088de0 con 0x7fbb740cecc0 2023-07-05T18:57:12.360 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:12.349+0000 7fbb72ffd700 1 --2- 172.21.15.46:0/3517172202 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7fbb6006ace0 0x7fbb6006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:57:12.360 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:12.349+0000 7fbb72ffd700 1 --2- 172.21.15.46:0/3517172202 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7fbb6006ace0 0x7fbb6006d190 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7fbb68000c00 tx=0x7fbb68008030 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-05T18:57:12.360 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:12.353+0000 7fbb5b7fe700 1 -- 172.21.15.46:0/3517172202 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fbb740c5350 con 0x7fbb740cecc0 2023-07-05T18:57:12.553 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:12.551+0000 7fbb7941c700 1 -- 172.21.15.46:0/3517172202 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fbb740c5350 con 0x7fbb740cecc0 2023-07-05T18:57:12.553 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:12.551+0000 7fbb5b7fe700 1 -- 172.21.15.46:0/3517172202 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v31) v1 ==== 92+0+10 (secure 0 0 0) 0x7fbb740c5350 con 0x7fbb740cecc0 2023-07-05T18:57:12.553 INFO:teuthology.orchestra.run.smithi046.stdout:pg_num: 8 2023-07-05T18:57:12.556 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:12.553+0000 7fbb7941c700 1 -- 172.21.15.46:0/3517172202 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7fbb6006ace0 msgr2=0x7fbb6006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:57:12.556 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:12.553+0000 7fbb7941c700 1 --2- 172.21.15.46:0/3517172202 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7fbb6006ace0 0x7fbb6006d190 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7fbb68000c00 tx=0x7fbb68008030 comp rx=0 tx=0).stop 2023-07-05T18:57:12.556 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:12.553+0000 7fbb7941c700 1 -- 172.21.15.46:0/3517172202 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fbb740cecc0 msgr2=0x7fbb741f8f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:57:12.556 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:12.553+0000 7fbb7941c700 1 --2- 172.21.15.46:0/3517172202 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fbb740cecc0 0x7fbb741f8f00 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7fbb6400e810 tx=0x7fbb6400ebd0 comp rx=0 tx=0).stop 2023-07-05T18:57:12.557 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:12.553+0000 7fbb7941c700 1 -- 172.21.15.46:0/3517172202 shutdown_connections 2023-07-05T18:57:12.557 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:12.553+0000 7fbb7941c700 1 --2- 172.21.15.46:0/3517172202 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7fbb6006ace0 0x7fbb6006d190 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:57:12.557 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:12.553+0000 7fbb7941c700 1 --2- 172.21.15.46:0/3517172202 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fbb740b4ec0 0x7fbb740b54e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:57:12.557 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:12.553+0000 7fbb7941c700 1 --2- 172.21.15.46:0/3517172202 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fbb740afe50 0x7fbb741f7360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:57:12.557 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:12.553+0000 7fbb7941c700 1 --2- 172.21.15.46:0/3517172202 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fbb740cecc0 0x7fbb741f8f00 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:57:12.557 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:12.553+0000 7fbb7941c700 1 -- 172.21.15.46:0/3517172202 >> 172.21.15.46:0/3517172202 conn(0x7fbb740664b0 msgr2=0x7fbb7406ca00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-05T18:57:12.557 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:12.553+0000 7fbb7941c700 1 -- 172.21.15.46:0/3517172202 shutdown_connections 2023-07-05T18:57:12.558 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:12.553+0000 7fbb7941c700 1 -- 172.21.15.46:0/3517172202 wait complete. 2023-07-05T18:57:12.568 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-07-05T18:57:12.699 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:12.694+0000 7f7a199bd700 1 Processor -- start 2023-07-05T18:57:12.700 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:12.694+0000 7f7a199bd700 1 -- start start 2023-07-05T18:57:12.701 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:12.695+0000 7f7a199bd700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f7a1415c2f0 0x7f7a140cd2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:57:12.701 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:12.695+0000 7f7a199bd700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f7a140b5ae0 0x7f7a140b5ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:57:12.701 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:12.695+0000 7f7a199bd700 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7a140cd8c0 con 0x7f7a1415c6c0 2023-07-05T18:57:12.701 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:12.695+0000 7f7a199bd700 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7a140d0990 con 0x7f7a1415c2f0 2023-07-05T18:57:12.701 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:12.695+0000 7f7a199bd700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7a140d0c70 con 0x7f7a140b5ae0 2023-07-05T18:57:12.702 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:12.695+0000 7f7a127fc700 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7f7a1415c6c0 0x7f7a1406c760 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:58996/0 (socket says 172.21.15.46:58996) 2023-07-05T18:57:12.702 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:12.695+0000 7f7a127fc700 1 -- 172.21.15.46:0/1509251517 learned_addr learned my addr 172.21.15.46:0/1509251517 (peer_addr_for_me v1:172.21.15.46:0/0) 2023-07-05T18:57:12.702 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:12.695+0000 7f7a137fe700 1 --2- 172.21.15.46:0/1509251517 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f7a140b5ae0 0x7f7a140b5ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:57:12.702 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:12.695+0000 7f7a12ffd700 1 --2- 172.21.15.46:0/1509251517 >> v2:172.21.15.73:3300/0 conn(0x7f7a1415c2f0 0x7f7a140cd2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:57:12.702 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:12.695+0000 7f7a11ffb700 1 -- 172.21.15.46:0/1509251517 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1775944347 0 0) 0x7f7a140cd8c0 con 0x7f7a1415c6c0 2023-07-05T18:57:12.702 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:12.695+0000 7f7a11ffb700 1 -- 172.21.15.46:0/1509251517 --> v1:172.21.15.46:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f79fc0035b0 con 0x7f7a1415c6c0 2023-07-05T18:57:12.702 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:12.696+0000 7f7a11ffb700 1 -- 172.21.15.46:0/1509251517 <== mon.0 v1:172.21.15.46:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2825572160 0 0) 0x7f79fc0035b0 con 0x7f7a1415c6c0 2023-07-05T18:57:12.703 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:12.696+0000 7f7a11ffb700 1 -- 172.21.15.46:0/1509251517 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f7a140b5ae0 msgr2=0x7f7a140b5ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-05T18:57:12.703 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:12.696+0000 7f7a11ffb700 1 --2- 172.21.15.46:0/1509251517 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f7a140b5ae0 0x7f7a140b5ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:57:12.703 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:12.696+0000 7f7a11ffb700 1 -- 172.21.15.46:0/1509251517 >> v2:172.21.15.73:3300/0 conn(0x7f7a1415c2f0 msgr2=0x7f7a140cd2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-05T18:57:12.703 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:12.696+0000 7f7a11ffb700 1 --2- 172.21.15.46:0/1509251517 >> v2:172.21.15.73:3300/0 conn(0x7f7a1415c2f0 0x7f7a140cd2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:57:12.703 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:12.696+0000 7f7a11ffb700 1 -- 172.21.15.46:0/1509251517 --> v1:172.21.15.46:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7a140d0f50 con 0x7f7a1415c6c0 2023-07-05T18:57:12.703 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:12.696+0000 7f7a11ffb700 1 -- 172.21.15.46:0/1509251517 <== mon.0 v1:172.21.15.46:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2195585215 0 0) 0x7f7a04001670 con 0x7f7a1415c6c0 2023-07-05T18:57:12.703 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:12.696+0000 7f7a11ffb700 1 -- 172.21.15.46:0/1509251517 >> v1:172.21.15.46:6789/0 conn(0x7f7a1415c6c0 legacy=0x7f7a1406c760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:57:12.703 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:12.696+0000 7f7a11ffb700 1 --2- 172.21.15.46:0/1509251517 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f79fc003a00 0x7f79fc003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:57:12.704 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:12.696+0000 7f7a11ffb700 1 --2- 172.21.15.46:0/1509251517 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f79fc004850 0x7f79fc004cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:57:12.704 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:12.696+0000 7f7a11ffb700 1 --2- 172.21.15.46:0/1509251517 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f7a140b5ae0 0x7f79fc005200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:57:12.704 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:12.696+0000 7f7a11ffb700 1 -- 172.21.15.46:0/1509251517 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a140d0990 con 0x7f79fc003a00 2023-07-05T18:57:12.704 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:12.696+0000 7f7a11ffb700 1 -- 172.21.15.46:0/1509251517 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a140d0c70 con 0x7f79fc004850 2023-07-05T18:57:12.704 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:12.696+0000 7f7a11ffb700 1 -- 172.21.15.46:0/1509251517 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f79fc00ba90 con 0x7f7a140b5ae0 2023-07-05T18:57:12.704 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:12.696+0000 7f7a12ffd700 1 --2- 172.21.15.46:0/1509251517 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f79fc003a00 0x7f79fc003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:57:12.704 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:12.696+0000 7f7a127fc700 1 --2- 172.21.15.46:0/1509251517 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f79fc004850 0x7f79fc004cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:57:12.704 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:12.696+0000 7f7a137fe700 1 --2- 172.21.15.46:0/1509251517 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f7a140b5ae0 0x7f79fc005200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:57:12.705 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:12.696+0000 7f7a12ffd700 1 -- 172.21.15.46:0/1509251517 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f7a140b5ae0 msgr2=0x7f79fc005200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-05T18:57:12.705 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:12.696+0000 7f7a12ffd700 1 --2- 172.21.15.46:0/1509251517 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f7a140b5ae0 0x7f79fc005200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:57:12.706 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:12.696+0000 7f7a12ffd700 1 -- 172.21.15.46:0/1509251517 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f79fc004850 msgr2=0x7f79fc004cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-05T18:57:12.706 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:12.696+0000 7f7a12ffd700 1 --2- 172.21.15.46:0/1509251517 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f79fc004850 0x7f79fc004cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:57:12.706 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:12.696+0000 7f7a12ffd700 1 -- 172.21.15.46:0/1509251517 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f79fc0035b0 con 0x7f79fc003a00 2023-07-05T18:57:12.706 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:12.696+0000 7f7a127fc700 1 --2- 172.21.15.46:0/1509251517 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f79fc004850 0x7f79fc004cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-05T18:57:12.706 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:12.696+0000 7f7a12ffd700 1 --2- 172.21.15.46:0/1509251517 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f79fc003a00 0x7f79fc003e10 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f7a08009b60 tx=0x7f79fc005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=df8ce2fcb6e489ee server_cookie=0 in_seq=0 out_seq=0 2023-07-05T18:57:12.706 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:12.697+0000 7f7a11ffb700 1 -- 172.21.15.46:0/1509251517 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a0800e6c0 con 0x7f79fc003a00 2023-07-05T18:57:12.707 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:12.697+0000 7f7a11ffb700 1 -- 172.21.15.46:0/1509251517 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7a0800e820 con 0x7f79fc003a00 2023-07-05T18:57:12.707 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:12.697+0000 7f7a11ffb700 1 -- 172.21.15.46:0/1509251517 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a0800eb90 con 0x7f79fc003a00 2023-07-05T18:57:12.707 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:12.697+0000 7f7a199bd700 1 -- 172.21.15.46:0/1509251517 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f79fc003a00 msgr2=0x7f79fc003e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:57:12.707 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:12.697+0000 7f7a199bd700 1 --2- 172.21.15.46:0/1509251517 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f79fc003a00 0x7f79fc003e10 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f7a08009b60 tx=0x7f79fc005880 comp rx=0 tx=0).stop 2023-07-05T18:57:12.707 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:12.697+0000 7f7a137fe700 1 -- 172.21.15.46:0/1509251517 reap_dead start 2023-07-05T18:57:12.707 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:12.697+0000 7f7a199bd700 1 -- 172.21.15.46:0/1509251517 shutdown_connections 2023-07-05T18:57:12.707 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:12.697+0000 7f7a199bd700 1 -- 172.21.15.46:0/1509251517 >> 172.21.15.46:0/1509251517 conn(0x7f7a1406afa0 msgr2=0x7f7a140cf710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-05T18:57:12.707 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:12.697+0000 7f7a199bd700 1 -- 172.21.15.46:0/1509251517 shutdown_connections 2023-07-05T18:57:12.708 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:12.697+0000 7f7a199bd700 1 -- 172.21.15.46:0/1509251517 wait complete. 2023-07-05T18:57:12.711 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:12.698+0000 7f7a199bd700 1 Processor -- start 2023-07-05T18:57:12.712 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:12.699+0000 7f7a199bd700 1 -- start start 2023-07-05T18:57:12.712 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:12.699+0000 7f7a199bd700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f79fc003a00 0x7f7a140cb080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:57:12.713 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:12.699+0000 7f7a199bd700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7a140cc890 0x7f7a140c5c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:57:12.713 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:12.699+0000 7f7a199bd700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f7a14145a00 0x7f7a1415e2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:57:12.713 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:12.699+0000 7f7a199bd700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a140cb5c0 con 0x7f7a140cc890 2023-07-05T18:57:12.713 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:12.699+0000 7f7a199bd700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a140cb7f0 con 0x7f79fc003a00 2023-07-05T18:57:12.713 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:12.699+0000 7f7a199bd700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7a140cbad0 con 0x7f7a14145a00 2023-07-05T18:57:12.713 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:12.700+0000 7f7a127fc700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7a140cc890 0x7f7a140c5c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:57:12.713 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:12.700+0000 7f7a127fc700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7a140cc890 0x7f7a140c5c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:59738/0 (socket says 172.21.15.46:59738) 2023-07-05T18:57:12.713 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:12.700+0000 7f7a127fc700 1 -- 172.21.15.46:0/4219793431 learned_addr learned my addr 172.21.15.46:0/4219793431 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-07-05T18:57:12.714 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:12.700+0000 7f7a12ffd700 1 --2- 172.21.15.46:0/4219793431 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f79fc003a00 0x7f7a140cb080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:57:12.714 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:12.700+0000 7f7a137fe700 1 --2- 172.21.15.46:0/4219793431 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f7a14145a00 0x7f7a1415e2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:57:12.714 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:12.700+0000 7f7a127fc700 1 -- 172.21.15.46:0/4219793431 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f7a14145a00 msgr2=0x7f7a1415e2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:57:12.714 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:12.700+0000 7f7a127fc700 1 --2- 172.21.15.46:0/4219793431 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f7a14145a00 0x7f7a1415e2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:57:12.714 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:12.700+0000 7f7a127fc700 1 -- 172.21.15.46:0/4219793431 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f79fc003a00 msgr2=0x7f7a140cb080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:57:12.714 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:12.700+0000 7f7a127fc700 1 --2- 172.21.15.46:0/4219793431 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f79fc003a00 0x7f7a140cb080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:57:12.714 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:12.700+0000 7f7a127fc700 1 -- 172.21.15.46:0/4219793431 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7a140cbdb0 con 0x7f7a140cc890 2023-07-05T18:57:12.715 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:12.700+0000 7f7a12ffd700 1 --2- 172.21.15.46:0/4219793431 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f79fc003a00 0x7f7a140cb080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-05T18:57:12.715 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:12.700+0000 7f7a127fc700 1 --2- 172.21.15.46:0/4219793431 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7a140cc890 0x7f7a140c5c80 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f7a0400e780 tx=0x7f7a0400eb40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-05T18:57:12.715 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:12.700+0000 7f79fbfff700 1 -- 172.21.15.46:0/4219793431 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a04012590 con 0x7f7a140cc890 2023-07-05T18:57:12.715 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:12.700+0000 7f79fbfff700 1 -- 172.21.15.46:0/4219793431 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7a04012710 con 0x7f7a140cc890 2023-07-05T18:57:12.715 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:12.700+0000 7f7a199bd700 1 -- 172.21.15.46:0/4219793431 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7a140cc090 con 0x7f7a140cc890 2023-07-05T18:57:12.715 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:12.700+0000 7f79fbfff700 1 -- 172.21.15.46:0/4219793431 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a04012ac0 con 0x7f7a140cc890 2023-07-05T18:57:12.715 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:12.700+0000 7f7a199bd700 1 -- 172.21.15.46:0/4219793431 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7a140c61c0 con 0x7f7a140cc890 2023-07-05T18:57:12.715 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:12.701+0000 7f7a199bd700 1 -- 172.21.15.46:0/4219793431 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7a1404e1d0 con 0x7f7a140cc890 2023-07-05T18:57:12.716 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:12.702+0000 7f79fbfff700 1 -- 172.21.15.46:0/4219793431 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f7a04012c20 con 0x7f7a140cc890 2023-07-05T18:57:12.716 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:12.702+0000 7f79fbfff700 1 --2- 172.21.15.46:0/4219793431 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7f7a0006ace0 0x7f7a0006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:57:12.717 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:12.702+0000 7f79fbfff700 1 -- 172.21.15.46:0/4219793431 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f7a04088e60 con 0x7f7a140cc890 2023-07-05T18:57:12.717 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:12.702+0000 7f7a12ffd700 1 --2- 172.21.15.46:0/4219793431 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7f7a0006ace0 0x7f7a0006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:57:12.717 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:12.703+0000 7f7a12ffd700 1 --2- 172.21.15.46:0/4219793431 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7f7a0006ace0 0x7f7a0006d190 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f7a080090b0 tx=0x7f7a08008030 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-05T18:57:12.717 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:12.707+0000 7f79fbfff700 1 -- 172.21.15.46:0/4219793431 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f7a04054270 con 0x7f7a140cc890 2023-07-05T18:57:12.904 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:12.902+0000 7f7a199bd700 1 -- 172.21.15.46:0/4219793431 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f7a140d0130 con 0x7f7a140cc890 2023-07-05T18:57:12.905 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:12.903+0000 7f79fbfff700 1 -- 172.21.15.46:0/4219793431 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v31) v1 ==== 93+0+10 (secure 0 0 0) 0x7f7a04012ed0 con 0x7f7a140cc890 2023-07-05T18:57:12.905 INFO:teuthology.orchestra.run.smithi046.stdout:pg_num: 1 2023-07-05T18:57:12.906 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:12.904+0000 7f7a199bd700 1 -- 172.21.15.46:0/4219793431 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7f7a0006ace0 msgr2=0x7f7a0006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:57:12.907 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:12.904+0000 7f7a199bd700 1 --2- 172.21.15.46:0/4219793431 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7f7a0006ace0 0x7f7a0006d190 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f7a080090b0 tx=0x7f7a08008030 comp rx=0 tx=0).stop 2023-07-05T18:57:12.907 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:12.904+0000 7f7a199bd700 1 -- 172.21.15.46:0/4219793431 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7a140cc890 msgr2=0x7f7a140c5c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:57:12.907 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:12.904+0000 7f7a199bd700 1 --2- 172.21.15.46:0/4219793431 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7a140cc890 0x7f7a140c5c80 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f7a0400e780 tx=0x7f7a0400eb40 comp rx=0 tx=0).stop 2023-07-05T18:57:12.907 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:12.904+0000 7f7a199bd700 1 -- 172.21.15.46:0/4219793431 shutdown_connections 2023-07-05T18:57:12.907 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:12.904+0000 7f7a199bd700 1 --2- 172.21.15.46:0/4219793431 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7f7a0006ace0 0x7f7a0006d190 secure :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f7a080090b0 tx=0x7f7a08008030 comp rx=0 tx=0).stop 2023-07-05T18:57:12.907 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:12.904+0000 7f7a199bd700 1 --2- 172.21.15.46:0/4219793431 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f7a14145a00 0x7f7a1415e2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:57:12.908 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:12.904+0000 7f7a199bd700 1 --2- 172.21.15.46:0/4219793431 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f79fc003a00 0x7f7a140cb080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:57:12.908 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:12.904+0000 7f7a199bd700 1 --2- 172.21.15.46:0/4219793431 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7a140cc890 0x7f7a140c5c80 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:57:12.908 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:12.904+0000 7f7a199bd700 1 -- 172.21.15.46:0/4219793431 >> 172.21.15.46:0/4219793431 conn(0x7f7a1406afa0 msgr2=0x7f7a140cd380 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-05T18:57:12.908 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:12.905+0000 7f7a199bd700 1 -- 172.21.15.46:0/4219793431 shutdown_connections 2023-07-05T18:57:12.908 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:12.905+0000 7f7a199bd700 1 -- 172.21.15.46:0/4219793431 wait complete. 2023-07-05T18:57:12.919 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-07-05T18:57:13.047 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:13.042+0000 7fb1ed49e700 1 Processor -- start 2023-07-05T18:57:13.048 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:13.042+0000 7fb1ed49e700 1 -- start start 2023-07-05T18:57:13.048 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:13.044+0000 7fb1ed49e700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fb1e80b54c0 0x7fb1e815d710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:57:13.048 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:13.044+0000 7fb1ed49e700 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb1e815a1e0 con 0x7fb1e8159180 2023-07-05T18:57:13.048 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:13.044+0000 7fb1ed49e700 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb1e815a670 con 0x7fb1e80b1d50 2023-07-05T18:57:13.048 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:13.044+0000 7fb1ed49e700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb1e815dc50 con 0x7fb1e80b54c0 2023-07-05T18:57:13.049 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:13.044+0000 7fb1e6ffd700 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7fb1e8159180 0x7fb1e80b1640 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:59016/0 (socket says 172.21.15.46:59016) 2023-07-05T18:57:13.049 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:13.044+0000 7fb1e6ffd700 1 -- 172.21.15.46:0/3471922932 learned_addr learned my addr 172.21.15.46:0/3471922932 (peer_addr_for_me v1:172.21.15.46:0/0) 2023-07-05T18:57:13.049 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:13.044+0000 7fb1e77fe700 1 --2- 172.21.15.46:0/3471922932 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fb1e80b54c0 0x7fb1e815d710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:57:13.049 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:13.044+0000 7fb1e5ffb700 1 -- 172.21.15.46:0/3471922932 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2311555873 0 0) 0x7fb1e815a1e0 con 0x7fb1e8159180 2023-07-05T18:57:13.049 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:13.044+0000 7fb1e5ffb700 1 -- 172.21.15.46:0/3471922932 --> v1:172.21.15.46:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb1d40035b0 con 0x7fb1e8159180 2023-07-05T18:57:13.049 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:13.044+0000 7fb1e5ffb700 1 -- 172.21.15.46:0/3471922932 <== mon.1 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 424558756 0 0) 0x7fb1e815a670 con 0x7fb1e80b1d50 2023-07-05T18:57:13.049 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:13.044+0000 7fb1e5ffb700 1 -- 172.21.15.46:0/3471922932 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb1e815a1e0 con 0x7fb1e80b1d50 2023-07-05T18:57:13.049 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:13.044+0000 7fb1e77fe700 1 -- 172.21.15.46:0/3471922932 >> v1:172.21.15.73:6789/0 conn(0x7fb1e80b1d50 legacy=0x7fb1e806c7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:57:13.050 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:13.044+0000 7fb1e77fe700 1 -- 172.21.15.46:0/3471922932 >> v1:172.21.15.46:6789/0 conn(0x7fb1e8159180 legacy=0x7fb1e80b1640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:57:13.050 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:13.044+0000 7fb1e77fe700 1 -- 172.21.15.46:0/3471922932 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb1e80b5aa0 con 0x7fb1e80b54c0 2023-07-05T18:57:13.050 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:13.045+0000 7fb1e77fe700 1 --2- 172.21.15.46:0/3471922932 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fb1e80b54c0 0x7fb1e815d710 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fb1e0009dc0 tx=0x7fb1e000b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5a06ac52f01dabef server_cookie=0 in_seq=0 out_seq=0 2023-07-05T18:57:13.051 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:13.045+0000 7fb1e5ffb700 1 -- 172.21.15.46:0/3471922932 <== mon.2 v2:172.21.15.73:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1e000e070 con 0x7fb1e80b54c0 2023-07-05T18:57:13.051 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:13.045+0000 7fb1e5ffb700 1 -- 172.21.15.46:0/3471922932 <== mon.2 v2:172.21.15.73:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb1e000bb20 con 0x7fb1e80b54c0 2023-07-05T18:57:13.051 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:13.045+0000 7fb1e5ffb700 1 -- 172.21.15.46:0/3471922932 <== mon.2 v2:172.21.15.73:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1e0012430 con 0x7fb1e80b54c0 2023-07-05T18:57:13.051 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:13.045+0000 7fb1ed49e700 1 -- 172.21.15.46:0/3471922932 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fb1e80b54c0 msgr2=0x7fb1e815d710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:57:13.051 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:13.045+0000 7fb1ed49e700 1 --2- 172.21.15.46:0/3471922932 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fb1e80b54c0 0x7fb1e815d710 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fb1e0009dc0 tx=0x7fb1e000b330 comp rx=0 tx=0).stop 2023-07-05T18:57:13.052 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:13.045+0000 7fb1ed49e700 1 -- 172.21.15.46:0/3471922932 shutdown_connections 2023-07-05T18:57:13.053 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:13.045+0000 7fb1ed49e700 1 --2- 172.21.15.46:0/3471922932 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fb1e80b54c0 0x7fb1e815d710 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:57:13.053 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:13.045+0000 7fb1ed49e700 1 -- 172.21.15.46:0/3471922932 >> 172.21.15.46:0/3471922932 conn(0x7fb1e80cf9a0 msgr2=0x7fb1e80cfda0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-05T18:57:13.053 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:13.045+0000 7fb1ed49e700 1 -- 172.21.15.46:0/3471922932 shutdown_connections 2023-07-05T18:57:13.053 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:13.045+0000 7fb1ed49e700 1 -- 172.21.15.46:0/3471922932 wait complete. 2023-07-05T18:57:13.055 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:13.047+0000 7fb1ed49e700 1 Processor -- start 2023-07-05T18:57:13.056 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:13.047+0000 7fb1ed49e700 1 -- start start 2023-07-05T18:57:13.056 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:13.047+0000 7fb1ed49e700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb1e80b1d50 0x7fb1e80a96c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:57:13.056 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:13.047+0000 7fb1ed49e700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb1e80b54c0 0x7fb1e80ce4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:57:13.056 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:13.047+0000 7fb1ed49e700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fb1e8159180 0x7fb1e80ce9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:57:13.057 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:13.047+0000 7fb1ed49e700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1e81f32c0 con 0x7fb1e80b1d50 2023-07-05T18:57:13.057 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:13.047+0000 7fb1ed49e700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1e81f35a0 con 0x7fb1e80b54c0 2023-07-05T18:57:13.058 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:13.047+0000 7fb1ed49e700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb1e81f3880 con 0x7fb1e8159180 2023-07-05T18:57:13.058 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:13.048+0000 7fb1e6ffd700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb1e80b1d50 0x7fb1e80a96c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:57:13.058 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:13.048+0000 7fb1e6ffd700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb1e80b1d50 0x7fb1e80a96c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:59750/0 (socket says 172.21.15.46:59750) 2023-07-05T18:57:13.058 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:13.048+0000 7fb1e6ffd700 1 -- 172.21.15.46:0/293244277 learned_addr learned my addr 172.21.15.46:0/293244277 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-07-05T18:57:13.058 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:13.048+0000 7fb1e77fe700 1 --2- 172.21.15.46:0/293244277 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fb1e8159180 0x7fb1e80ce9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:57:13.059 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:13.048+0000 7fb1e67fc700 1 --2- 172.21.15.46:0/293244277 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb1e80b54c0 0x7fb1e80ce4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:57:13.059 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:13.048+0000 7fb1e6ffd700 1 -- 172.21.15.46:0/293244277 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fb1e8159180 msgr2=0x7fb1e80ce9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:57:13.059 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:13.048+0000 7fb1e6ffd700 1 --2- 172.21.15.46:0/293244277 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fb1e8159180 0x7fb1e80ce9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:57:13.059 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:13.048+0000 7fb1e6ffd700 1 -- 172.21.15.46:0/293244277 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb1e80b54c0 msgr2=0x7fb1e80ce4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:57:13.059 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:13.048+0000 7fb1e6ffd700 1 --2- 172.21.15.46:0/293244277 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb1e80b54c0 0x7fb1e80ce4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:57:13.059 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:13.048+0000 7fb1e6ffd700 1 -- 172.21.15.46:0/293244277 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb1e0009a70 con 0x7fb1e80b1d50 2023-07-05T18:57:13.059 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:13.048+0000 7fb1e6ffd700 1 --2- 172.21.15.46:0/293244277 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb1e80b1d50 0x7fb1e80a96c0 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7fb1d800c4d0 tx=0x7fb1d800c7e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-05T18:57:13.060 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:13.048+0000 7fb1df7fe700 1 -- 172.21.15.46:0/293244277 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1d80074e0 con 0x7fb1e80b1d50 2023-07-05T18:57:13.060 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:13.048+0000 7fb1df7fe700 1 -- 172.21.15.46:0/293244277 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb1d8007640 con 0x7fb1e80b1d50 2023-07-05T18:57:13.060 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:13.048+0000 7fb1ed49e700 1 -- 172.21.15.46:0/293244277 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb1e81f3b60 con 0x7fb1e80b1d50 2023-07-05T18:57:13.060 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:13.048+0000 7fb1df7fe700 1 -- 172.21.15.46:0/293244277 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1d8005a30 con 0x7fb1e80b1d50 2023-07-05T18:57:13.060 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:13.048+0000 7fb1ed49e700 1 -- 172.21.15.46:0/293244277 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb1e80cc550 con 0x7fb1e80b1d50 2023-07-05T18:57:13.060 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:13.049+0000 7fb1ed49e700 1 -- 172.21.15.46:0/293244277 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb1e80672e0 con 0x7fb1e80b1d50 2023-07-05T18:57:13.060 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:13.050+0000 7fb1df7fe700 1 -- 172.21.15.46:0/293244277 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fb1d8005b90 con 0x7fb1e80b1d50 2023-07-05T18:57:13.061 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:13.050+0000 7fb1df7fe700 1 --2- 172.21.15.46:0/293244277 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7fb1c806ace0 0x7fb1c806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:57:13.061 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:13.050+0000 7fb1df7fe700 1 -- 172.21.15.46:0/293244277 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 5210+0+0 (secure 0 0 0) 0x7fb1d8088380 con 0x7fb1e80b1d50 2023-07-05T18:57:13.061 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:13.050+0000 7fb1e67fc700 1 --2- 172.21.15.46:0/293244277 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7fb1c806ace0 0x7fb1c806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:57:13.061 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:13.051+0000 7fb1e67fc700 1 --2- 172.21.15.46:0/293244277 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7fb1c806ace0 0x7fb1c806d190 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fb1d00011e0 tx=0x7fb1d0009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-05T18:57:13.061 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:13.054+0000 7fb1df7fe700 1 -- 172.21.15.46:0/293244277 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fb1d8053840 con 0x7fb1e80b1d50 2023-07-05T18:57:13.255 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:13.252+0000 7fb1ed49e700 1 -- 172.21.15.46:0/293244277 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7fb1e80a9070 con 0x7fb1e80b1d50 2023-07-05T18:57:13.255 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:13.253+0000 7fb1df7fe700 1 -- 172.21.15.46:0/293244277 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v31) v1 ==== 84+0+126 (secure 0 0 0) 0x7fb1d8056e60 con 0x7fb1e80b1d50 2023-07-05T18:57:13.256 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T18:57:13.256 INFO:teuthology.orchestra.run.smithi046.stdout:[ 2023-07-05T18:57:13.256 INFO:teuthology.orchestra.run.smithi046.stdout: { 2023-07-05T18:57:13.256 INFO:teuthology.orchestra.run.smithi046.stdout: "poolnum": 1, 2023-07-05T18:57:13.256 INFO:teuthology.orchestra.run.smithi046.stdout: "poolname": "rbd" 2023-07-05T18:57:13.257 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-07-05T18:57:13.257 INFO:teuthology.orchestra.run.smithi046.stdout: { 2023-07-05T18:57:13.257 INFO:teuthology.orchestra.run.smithi046.stdout: "poolnum": 2, 2023-07-05T18:57:13.257 INFO:teuthology.orchestra.run.smithi046.stdout: "poolname": ".mgr" 2023-07-05T18:57:13.257 INFO:teuthology.orchestra.run.smithi046.stdout: } 2023-07-05T18:57:13.257 INFO:teuthology.orchestra.run.smithi046.stdout:] 2023-07-05T18:57:13.258 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:13.255+0000 7fb1ed49e700 1 -- 172.21.15.46:0/293244277 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7fb1c806ace0 msgr2=0x7fb1c806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:57:13.258 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:13.255+0000 7fb1ed49e700 1 --2- 172.21.15.46:0/293244277 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7fb1c806ace0 0x7fb1c806d190 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fb1d00011e0 tx=0x7fb1d0009040 comp rx=0 tx=0).stop 2023-07-05T18:57:13.258 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:13.255+0000 7fb1ed49e700 1 -- 172.21.15.46:0/293244277 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb1e80b1d50 msgr2=0x7fb1e80a96c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:57:13.259 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:13.255+0000 7fb1ed49e700 1 --2- 172.21.15.46:0/293244277 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb1e80b1d50 0x7fb1e80a96c0 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7fb1d800c4d0 tx=0x7fb1d800c7e0 comp rx=0 tx=0).stop 2023-07-05T18:57:13.259 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:13.255+0000 7fb1ed49e700 1 -- 172.21.15.46:0/293244277 shutdown_connections 2023-07-05T18:57:13.259 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:13.255+0000 7fb1ed49e700 1 --2- 172.21.15.46:0/293244277 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7fb1c806ace0 0x7fb1c806d190 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:57:13.259 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:13.255+0000 7fb1ed49e700 1 --2- 172.21.15.46:0/293244277 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fb1e8159180 0x7fb1e80ce9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:57:13.259 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:13.255+0000 7fb1ed49e700 1 --2- 172.21.15.46:0/293244277 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb1e80b1d50 0x7fb1e80a96c0 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:57:13.259 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:13.255+0000 7fb1ed49e700 1 --2- 172.21.15.46:0/293244277 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb1e80b54c0 0x7fb1e80ce4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:57:13.259 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:13.255+0000 7fb1ed49e700 1 -- 172.21.15.46:0/293244277 >> 172.21.15.46:0/293244277 conn(0x7fb1e80cf9a0 msgr2=0x7fb1e806c9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-05T18:57:13.259 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:13.255+0000 7fb1ed49e700 1 -- 172.21.15.46:0/293244277 shutdown_connections 2023-07-05T18:57:13.260 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:13.255+0000 7fb1ed49e700 1 -- 172.21.15.46:0/293244277 wait complete. 2023-07-05T18:57:13.274 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-07-05T18:57:13.274 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-07-05T18:57:13.403 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:13.401+0000 7efe01f71700 1 Processor -- start 2023-07-05T18:57:13.403 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:13.401+0000 7efe01f71700 1 -- start start 2023-07-05T18:57:13.405 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:13.402+0000 7efe01f71700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7efdfc06cf20 0x7efdfc06ba50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:57:13.405 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:13.402+0000 7efe01f71700 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efdfc0cf440 con 0x7efdfc15c8d0 2023-07-05T18:57:13.405 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:13.402+0000 7efe01f71700 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efdfc06acd0 con 0x7efdfc06e7c0 2023-07-05T18:57:13.405 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:13.402+0000 7efe01f71700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efdfc06d540 con 0x7efdfc06cf20 2023-07-05T18:57:13.405 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:13.402+0000 7efdfb7fe700 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7efdfc15c8d0 0x7efdfc06e0b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:59030/0 (socket says 172.21.15.46:59030) 2023-07-05T18:57:13.406 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:13.402+0000 7efdfb7fe700 1 -- 172.21.15.46:0/10140234 learned_addr learned my addr 172.21.15.46:0/10140234 (peer_addr_for_me v1:172.21.15.46:0/0) 2023-07-05T18:57:13.406 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:13.402+0000 7efdfbfff700 1 --2- 172.21.15.46:0/10140234 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7efdfc06cf20 0x7efdfc06ba50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:57:13.406 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:13.403+0000 7efdfa7fc700 1 -- 172.21.15.46:0/10140234 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 177924489 0 0) 0x7efdec001110 con 0x7efdfc15c8d0 2023-07-05T18:57:13.406 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:13.403+0000 7efdfa7fc700 1 -- 172.21.15.46:0/10140234 --> v1:172.21.15.46:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7efde80035b0 con 0x7efdfc15c8d0 2023-07-05T18:57:13.406 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:13.403+0000 7efdfa7fc700 1 -- 172.21.15.46:0/10140234 <== mon.1 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2965454320 0 0) 0x7efdfc06acd0 con 0x7efdfc06e7c0 2023-07-05T18:57:13.407 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:13.403+0000 7efdfa7fc700 1 -- 172.21.15.46:0/10140234 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7efdec001110 con 0x7efdfc06e7c0 2023-07-05T18:57:13.407 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:13.403+0000 7efdfbfff700 1 -- 172.21.15.46:0/10140234 >> v1:172.21.15.73:6789/0 conn(0x7efdfc06e7c0 legacy=0x7efdfc06c810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:57:13.407 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:13.403+0000 7efdfbfff700 1 -- 172.21.15.46:0/10140234 >> v1:172.21.15.46:6789/0 conn(0x7efdfc15c8d0 legacy=0x7efdfc06e0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:57:13.407 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:13.403+0000 7efdfbfff700 1 -- 172.21.15.46:0/10140234 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efdfc06af70 con 0x7efdfc06cf20 2023-07-05T18:57:13.408 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:13.403+0000 7efdfbfff700 1 --2- 172.21.15.46:0/10140234 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7efdfc06cf20 0x7efdfc06ba50 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7efdf4009dc0 tx=0x7efdf400b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=bdf31e8c50eb8a25 server_cookie=0 in_seq=0 out_seq=0 2023-07-05T18:57:13.408 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:13.403+0000 7efdfa7fc700 1 -- 172.21.15.46:0/10140234 <== mon.2 v2:172.21.15.73:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efdf400e070 con 0x7efdfc06cf20 2023-07-05T18:57:13.408 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:13.403+0000 7efdfa7fc700 1 -- 172.21.15.46:0/10140234 <== mon.2 v2:172.21.15.73:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efdf400bb20 con 0x7efdfc06cf20 2023-07-05T18:57:13.408 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:13.403+0000 7efdfa7fc700 1 -- 172.21.15.46:0/10140234 <== mon.2 v2:172.21.15.73:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efdf4012430 con 0x7efdfc06cf20 2023-07-05T18:57:13.411 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:13.404+0000 7efe01f71700 1 -- 172.21.15.46:0/10140234 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7efdfc06cf20 msgr2=0x7efdfc06ba50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:57:13.411 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:13.404+0000 7efe01f71700 1 --2- 172.21.15.46:0/10140234 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7efdfc06cf20 0x7efdfc06ba50 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7efdf4009dc0 tx=0x7efdf400b330 comp rx=0 tx=0).stop 2023-07-05T18:57:13.412 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:13.404+0000 7efe01f71700 1 -- 172.21.15.46:0/10140234 shutdown_connections 2023-07-05T18:57:13.412 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:13.404+0000 7efe01f71700 1 --2- 172.21.15.46:0/10140234 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7efdfc06cf20 0x7efdfc06ba50 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:57:13.412 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:13.404+0000 7efe01f71700 1 -- 172.21.15.46:0/10140234 >> 172.21.15.46:0/10140234 conn(0x7efdfc0cf9e0 msgr2=0x7efdfc0cfde0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-05T18:57:13.412 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:13.404+0000 7efe01f71700 1 -- 172.21.15.46:0/10140234 shutdown_connections 2023-07-05T18:57:13.412 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:13.404+0000 7efe01f71700 1 -- 172.21.15.46:0/10140234 wait complete. 2023-07-05T18:57:13.412 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:13.405+0000 7efe01f71700 1 Processor -- start 2023-07-05T18:57:13.412 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:13.405+0000 7efe01f71700 1 -- start start 2023-07-05T18:57:13.413 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:13.406+0000 7efe01f71700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7efdfc06cf20 0x7efdfc0b28d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:57:13.413 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:13.406+0000 7efe01f71700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7efdfc06e7c0 0x7efdfc147510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:57:13.413 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:13.406+0000 7efe01f71700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7efdfc15c8d0 0x7efdfc1f4d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:57:13.413 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:13.406+0000 7efe01f71700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efdfc0b2fd0 con 0x7efdfc15c8d0 2023-07-05T18:57:13.413 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:13.406+0000 7efe01f71700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efdfc0c5e60 con 0x7efdfc06cf20 2023-07-05T18:57:13.413 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:13.406+0000 7efe01f71700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efdfc0c50a0 con 0x7efdfc06e7c0 2023-07-05T18:57:13.413 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:13.406+0000 7efdfbfff700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7efdfc15c8d0 0x7efdfc1f4d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:57:13.413 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:13.406+0000 7efdfbfff700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7efdfc15c8d0 0x7efdfc1f4d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:59766/0 (socket says 172.21.15.46:59766) 2023-07-05T18:57:13.414 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:13.406+0000 7efdfbfff700 1 -- 172.21.15.46:0/526286188 learned_addr learned my addr 172.21.15.46:0/526286188 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-07-05T18:57:13.414 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:13.406+0000 7efdfb7fe700 1 --2- 172.21.15.46:0/526286188 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7efdfc06cf20 0x7efdfc0b28d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:57:13.414 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:13.406+0000 7efdfaffd700 1 --2- 172.21.15.46:0/526286188 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7efdfc06e7c0 0x7efdfc147510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:57:13.414 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:13.406+0000 7efdfbfff700 1 -- 172.21.15.46:0/526286188 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7efdfc06e7c0 msgr2=0x7efdfc147510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:57:13.414 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:13.406+0000 7efdfbfff700 1 --2- 172.21.15.46:0/526286188 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7efdfc06e7c0 0x7efdfc147510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:57:13.414 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:13.406+0000 7efdfbfff700 1 -- 172.21.15.46:0/526286188 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7efdfc06cf20 msgr2=0x7efdfc0b28d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:57:13.414 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:13.406+0000 7efdfbfff700 1 --2- 172.21.15.46:0/526286188 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7efdfc06cf20 0x7efdfc0b28d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:57:13.414 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:13.406+0000 7efdfbfff700 1 -- 172.21.15.46:0/526286188 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efdf4009a70 con 0x7efdfc15c8d0 2023-07-05T18:57:13.415 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:13.406+0000 7efdfb7fe700 1 --2- 172.21.15.46:0/526286188 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7efdfc06cf20 0x7efdfc0b28d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-05T18:57:13.415 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:13.406+0000 7efdfaffd700 1 --2- 172.21.15.46:0/526286188 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7efdfc06e7c0 0x7efdfc147510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-05T18:57:13.415 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:13.407+0000 7efdfbfff700 1 --2- 172.21.15.46:0/526286188 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7efdfc15c8d0 0x7efdfc1f4d20 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7efdf400b370 tx=0x7efdf4004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-05T18:57:13.415 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:13.407+0000 7efdf3fff700 1 -- 172.21.15.46:0/526286188 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efdf401b810 con 0x7efdfc15c8d0 2023-07-05T18:57:13.415 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:13.407+0000 7efdf3fff700 1 -- 172.21.15.46:0/526286188 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efdf4020070 con 0x7efdfc15c8d0 2023-07-05T18:57:13.415 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:13.407+0000 7efe01f71700 1 -- 172.21.15.46:0/526286188 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efdfc0c5380 con 0x7efdfc15c8d0 2023-07-05T18:57:13.415 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:13.407+0000 7efdf3fff700 1 -- 172.21.15.46:0/526286188 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efdf401bbf0 con 0x7efdfc15c8d0 2023-07-05T18:57:13.415 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:13.407+0000 7efe01f71700 1 -- 172.21.15.46:0/526286188 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efdfc0c5940 con 0x7efdfc15c8d0 2023-07-05T18:57:13.416 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:13.408+0000 7efe01f71700 1 -- 172.21.15.46:0/526286188 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efdfc0672e0 con 0x7efdfc15c8d0 2023-07-05T18:57:13.416 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:13.408+0000 7efdf3fff700 1 -- 172.21.15.46:0/526286188 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7efdf401bd50 con 0x7efdfc15c8d0 2023-07-05T18:57:13.416 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:13.409+0000 7efdf3fff700 1 --2- 172.21.15.46:0/526286188 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7efddc06ace0 0x7efddc06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:57:13.416 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:13.409+0000 7efdf3fff700 1 -- 172.21.15.46:0/526286188 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 5210+0+0 (secure 0 0 0) 0x7efdf4022070 con 0x7efdfc15c8d0 2023-07-05T18:57:13.416 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:13.409+0000 7efdfb7fe700 1 --2- 172.21.15.46:0/526286188 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7efddc06ace0 0x7efddc06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:57:13.416 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:13.409+0000 7efdfb7fe700 1 --2- 172.21.15.46:0/526286188 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7efddc06ace0 0x7efddc06d190 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7efdec000f60 tx=0x7efdec009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-05T18:57:13.417 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:13.413+0000 7efdf3fff700 1 -- 172.21.15.46:0/526286188 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7efdf4056d80 con 0x7efdfc15c8d0 2023-07-05T18:57:13.611 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:13.609+0000 7efe01f71700 1 -- 172.21.15.46:0/526286188 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7efdfc0cdac0 con 0x7efdfc15c8d0 2023-07-05T18:57:13.851 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:13.849+0000 7efdf3fff700 1 -- 172.21.15.46:0/526286188 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v32) v1 ==== 138+0+0 (secure 0 0 0) 0x7efdf405a3a0 con 0x7efdfc15c8d0 2023-07-05T18:57:13.954 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:13.853+0000 7efe01f71700 1 -- 172.21.15.46:0/526286188 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7efddc06ace0 msgr2=0x7efddc06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:57:13.955 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:13.853+0000 7efe01f71700 1 --2- 172.21.15.46:0/526286188 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7efddc06ace0 0x7efddc06d190 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7efdec000f60 tx=0x7efdec009040 comp rx=0 tx=0).stop 2023-07-05T18:57:13.955 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:13.853+0000 7efe01f71700 1 -- 172.21.15.46:0/526286188 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7efdfc15c8d0 msgr2=0x7efdfc1f4d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:57:13.955 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:13.853+0000 7efe01f71700 1 --2- 172.21.15.46:0/526286188 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7efdfc15c8d0 0x7efdfc1f4d20 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7efdf400b370 tx=0x7efdf4004ad0 comp rx=0 tx=0).stop 2023-07-05T18:57:13.955 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:13.853+0000 7efe01f71700 1 -- 172.21.15.46:0/526286188 shutdown_connections 2023-07-05T18:57:13.955 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:13.853+0000 7efe01f71700 1 --2- 172.21.15.46:0/526286188 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7efddc06ace0 0x7efddc06d190 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:57:13.956 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:13.853+0000 7efe01f71700 1 --2- 172.21.15.46:0/526286188 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7efdfc15c8d0 0x7efdfc1f4d20 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:57:13.956 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:13.853+0000 7efe01f71700 1 --2- 172.21.15.46:0/526286188 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7efdfc06cf20 0x7efdfc0b28d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:57:13.956 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:13.853+0000 7efe01f71700 1 --2- 172.21.15.46:0/526286188 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7efdfc06e7c0 0x7efdfc147510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:57:13.956 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:13.854+0000 7efe01f71700 1 -- 172.21.15.46:0/526286188 >> 172.21.15.46:0/526286188 conn(0x7efdfc0cf9e0 msgr2=0x7efdfc0cabc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-05T18:57:13.957 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:13.854+0000 7efe01f71700 1 -- 172.21.15.46:0/526286188 shutdown_connections 2023-07-05T18:57:13.957 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:13.854+0000 7efe01f71700 1 -- 172.21.15.46:0/526286188 wait complete. 2023-07-05T18:57:13.957 INFO:teuthology.orchestra.run.smithi046.stderr:pool 'cephfs_metadata' created 2023-07-05T18:57:13.957 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-07-05T18:57:14.095 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:14.092+0000 7f37f5a35700 1 Processor -- start 2023-07-05T18:57:14.102 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:14.092+0000 7f37f5a35700 1 -- start start 2023-07-05T18:57:14.102 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:14.093+0000 7f37f5a35700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f37f015c650 0x7f37f00d08d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:57:14.103 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:14.093+0000 7f37f5a35700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f37f00b1d80 0x7f37f00d0e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:57:14.103 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:14.093+0000 7f37f5a35700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f37f00af9b0 0x7f37f00afe30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:57:14.103 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:14.093+0000 7f37f5a35700 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f37f008be50 con 0x7f37f015c650 2023-07-05T18:57:14.103 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:14.093+0000 7f37f5a35700 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f37f00b2620 con 0x7f37f00b1d80 2023-07-05T18:57:14.103 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:14.093+0000 7f37f5a35700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f37f00b1500 con 0x7f37f00af9b0 2023-07-05T18:57:14.103 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:14.093+0000 7f37eeffd700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f37f015c650 0x7f37f00d08d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:57:14.103 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:14.093+0000 7f37eeffd700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f37f015c650 0x7f37f00d08d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:59770/0 (socket says 172.21.15.46:59770) 2023-07-05T18:57:14.104 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:14.093+0000 7f37eeffd700 1 -- 172.21.15.46:0/790213613 learned_addr learned my addr 172.21.15.46:0/790213613 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-07-05T18:57:14.104 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:14.093+0000 7f37ee7fc700 1 --2- 172.21.15.46:0/790213613 >> v2:172.21.15.73:3300/0 conn(0x7f37f00b1d80 0x7f37f00d0e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:57:14.104 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:14.093+0000 7f37ef7fe700 1 --2- 172.21.15.46:0/790213613 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f37f00af9b0 0x7f37f00afe30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:57:14.104 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:14.093+0000 7f37eeffd700 1 -- 172.21.15.46:0/790213613 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f37f00af9b0 msgr2=0x7f37f00afe30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-05T18:57:14.104 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:14.093+0000 7f37eeffd700 1 --2- 172.21.15.46:0/790213613 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f37f00af9b0 0x7f37f00afe30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:57:14.104 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:14.093+0000 7f37eeffd700 1 -- 172.21.15.46:0/790213613 >> v2:172.21.15.73:3300/0 conn(0x7f37f00b1d80 msgr2=0x7f37f00d0e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-05T18:57:14.114 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:14.093+0000 7f37eeffd700 1 --2- 172.21.15.46:0/790213613 >> v2:172.21.15.73:3300/0 conn(0x7f37f00b1d80 0x7f37f00d0e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:57:14.114 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:14.093+0000 7f37eeffd700 1 -- 172.21.15.46:0/790213613 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f37f00b17e0 con 0x7f37f015c650 2023-07-05T18:57:14.114 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:14.094+0000 7f37eeffd700 1 --2- 172.21.15.46:0/790213613 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f37f015c650 0x7f37f00d08d0 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f37f008b9a0 tx=0x7f37e800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=31853732fbc1c3d6 server_cookie=0 in_seq=0 out_seq=0 2023-07-05T18:57:14.115 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:14.094+0000 7f37edffb700 1 -- 172.21.15.46:0/790213613 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37e800e070 con 0x7f37f015c650 2023-07-05T18:57:14.115 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:14.094+0000 7f37edffb700 1 -- 172.21.15.46:0/790213613 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f37e800b9c0 con 0x7f37f015c650 2023-07-05T18:57:14.115 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:14.094+0000 7f37edffb700 1 -- 172.21.15.46:0/790213613 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37e800bd70 con 0x7f37f015c650 2023-07-05T18:57:14.115 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:14.094+0000 7f37f5a35700 1 -- 172.21.15.46:0/790213613 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f37f015c650 msgr2=0x7f37f00d08d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:57:14.115 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:14.094+0000 7f37f5a35700 1 --2- 172.21.15.46:0/790213613 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f37f015c650 0x7f37f00d08d0 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f37f008b9a0 tx=0x7f37e800b330 comp rx=0 tx=0).stop 2023-07-05T18:57:14.115 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:14.094+0000 7f37f5a35700 1 -- 172.21.15.46:0/790213613 shutdown_connections 2023-07-05T18:57:14.116 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:14.094+0000 7f37f5a35700 1 --2- 172.21.15.46:0/790213613 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f37f00af9b0 0x7f37f00afe30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:57:14.116 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:14.094+0000 7f37f5a35700 1 --2- 172.21.15.46:0/790213613 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f37f015c650 0x7f37f00d08d0 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:57:14.116 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:14.094+0000 7f37f5a35700 1 --2- 172.21.15.46:0/790213613 >> v2:172.21.15.73:3300/0 conn(0x7f37f00b1d80 0x7f37f00d0e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:57:14.116 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:14.094+0000 7f37f5a35700 1 -- 172.21.15.46:0/790213613 >> 172.21.15.46:0/790213613 conn(0x7f37f009bfe0 msgr2=0x7f37f00d2d00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-05T18:57:14.116 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:14.094+0000 7f37f5a35700 1 -- 172.21.15.46:0/790213613 shutdown_connections 2023-07-05T18:57:14.117 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:14.095+0000 7f37f5a35700 1 -- 172.21.15.46:0/790213613 wait complete. 2023-07-05T18:57:14.117 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:14.096+0000 7f37f5a35700 1 Processor -- start 2023-07-05T18:57:14.117 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:14.096+0000 7f37f5a35700 1 -- start start 2023-07-05T18:57:14.117 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:14.097+0000 7f37f5a35700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f37f00af9b0 0x7f37f01f1900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:57:14.117 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:14.097+0000 7f37f5a35700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f37f00b1d80 0x7f37f00cf110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:57:14.117 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:14.097+0000 7f37f5a35700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f37f015c650 0x7f37f00cf650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:57:14.117 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:14.097+0000 7f37f5a35700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f37f00cfb90 con 0x7f37f015c650 2023-07-05T18:57:14.117 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:14.097+0000 7f37f5a35700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f37f0157c70 con 0x7f37f00af9b0 2023-07-05T18:57:14.118 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:14.097+0000 7f37f5a35700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f37f00b5b30 con 0x7f37f00b1d80 2023-07-05T18:57:14.118 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:14.097+0000 7f37ef7fe700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f37f015c650 0x7f37f00cf650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:57:14.118 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:14.097+0000 7f37ef7fe700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f37f015c650 0x7f37f00cf650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:59780/0 (socket says 172.21.15.46:59780) 2023-07-05T18:57:14.118 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:14.097+0000 7f37ef7fe700 1 -- 172.21.15.46:0/224965428 learned_addr learned my addr 172.21.15.46:0/224965428 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-07-05T18:57:14.118 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:14.097+0000 7f37ee7fc700 1 --2- 172.21.15.46:0/224965428 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f37f00b1d80 0x7f37f00cf110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:57:14.118 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:14.097+0000 7f37eeffd700 1 --2- 172.21.15.46:0/224965428 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f37f00af9b0 0x7f37f01f1900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:57:14.118 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:14.097+0000 7f37ef7fe700 1 -- 172.21.15.46:0/224965428 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f37f00b1d80 msgr2=0x7f37f00cf110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:57:14.119 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:14.097+0000 7f37ef7fe700 1 --2- 172.21.15.46:0/224965428 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f37f00b1d80 0x7f37f00cf110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:57:14.119 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:14.097+0000 7f37ef7fe700 1 -- 172.21.15.46:0/224965428 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f37f00af9b0 msgr2=0x7f37f01f1900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:57:14.119 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:14.097+0000 7f37ef7fe700 1 --2- 172.21.15.46:0/224965428 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f37f00af9b0 0x7f37f01f1900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:57:14.119 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:14.097+0000 7f37ef7fe700 1 -- 172.21.15.46:0/224965428 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f37e8009b30 con 0x7f37f015c650 2023-07-05T18:57:14.120 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:14.097+0000 7f37ee7fc700 1 --2- 172.21.15.46:0/224965428 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f37f00b1d80 0x7f37f00cf110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-05T18:57:14.120 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:14.097+0000 7f37eeffd700 1 --2- 172.21.15.46:0/224965428 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f37f00af9b0 0x7f37f01f1900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-05T18:57:14.120 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:14.097+0000 7f37ef7fe700 1 --2- 172.21.15.46:0/224965428 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f37f015c650 0x7f37f00cf650 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f37e000e810 tx=0x7f37e000ebd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-05T18:57:14.120 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:14.097+0000 7f37d7fff700 1 -- 172.21.15.46:0/224965428 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37e000c070 con 0x7f37f015c650 2023-07-05T18:57:14.120 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:14.098+0000 7f37d7fff700 1 -- 172.21.15.46:0/224965428 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f37e0013610 con 0x7f37f015c650 2023-07-05T18:57:14.121 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:14.098+0000 7f37f5a35700 1 -- 172.21.15.46:0/224965428 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f37f00b5e10 con 0x7f37f015c650 2023-07-05T18:57:14.121 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:14.098+0000 7f37d7fff700 1 -- 172.21.15.46:0/224965428 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37e00139c0 con 0x7f37f015c650 2023-07-05T18:57:14.121 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:14.098+0000 7f37f5a35700 1 -- 172.21.15.46:0/224965428 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f37f00b63d0 con 0x7f37f015c650 2023-07-05T18:57:14.121 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:14.098+0000 7f37f5a35700 1 -- 172.21.15.46:0/224965428 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f37f00b65f0 con 0x7f37f015c650 2023-07-05T18:57:14.121 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:14.099+0000 7f37d7fff700 1 -- 172.21.15.46:0/224965428 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f37e0013b20 con 0x7f37f015c650 2023-07-05T18:57:14.121 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:14.100+0000 7f37d7fff700 1 --2- 172.21.15.46:0/224965428 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7f37dc06ace0 0x7f37dc06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:57:14.121 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:14.100+0000 7f37d7fff700 1 -- 172.21.15.46:0/224965428 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5580+0+0 (secure 0 0 0) 0x7f37e0089640 con 0x7f37f015c650 2023-07-05T18:57:14.122 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:14.100+0000 7f37eeffd700 1 --2- 172.21.15.46:0/224965428 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7f37dc06ace0 0x7f37dc06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:57:14.122 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:14.100+0000 7f37eeffd700 1 --2- 172.21.15.46:0/224965428 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7f37dc06ace0 0x7f37dc06d190 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f37f01f53a0 tx=0x7f37e8009000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-05T18:57:14.123 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:14.104+0000 7f37d7fff700 1 -- 172.21.15.46:0/224965428 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f37e0058440 con 0x7f37f015c650 2023-07-05T18:57:14.304 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:14.302+0000 7f37f5a35700 1 -- 172.21.15.46:0/224965428 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f37f004e1d0 con 0x7f37f015c650 2023-07-05T18:57:14.858 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:14.856+0000 7f37d7fff700 1 -- 172.21.15.46:0/224965428 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v33) v1 ==== 170+0+0 (secure 0 0 0) 0x7f37e0057fd0 con 0x7f37f015c650 2023-07-05T18:57:14.869 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:14.860+0000 7f37f5a35700 1 -- 172.21.15.46:0/224965428 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7f37dc06ace0 msgr2=0x7f37dc06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:57:14.870 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:14.860+0000 7f37f5a35700 1 --2- 172.21.15.46:0/224965428 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7f37dc06ace0 0x7f37dc06d190 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f37f01f53a0 tx=0x7f37e8009000 comp rx=0 tx=0).stop 2023-07-05T18:57:14.870 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:14.860+0000 7f37f5a35700 1 -- 172.21.15.46:0/224965428 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f37f015c650 msgr2=0x7f37f00cf650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:57:14.870 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:14.860+0000 7f37f5a35700 1 --2- 172.21.15.46:0/224965428 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f37f015c650 0x7f37f00cf650 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f37e000e810 tx=0x7f37e000ebd0 comp rx=0 tx=0).stop 2023-07-05T18:57:14.870 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:14.861+0000 7f37f5a35700 1 -- 172.21.15.46:0/224965428 shutdown_connections 2023-07-05T18:57:14.870 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:14.861+0000 7f37f5a35700 1 --2- 172.21.15.46:0/224965428 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7f37dc06ace0 0x7f37dc06d190 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:57:14.871 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:14.861+0000 7f37f5a35700 1 --2- 172.21.15.46:0/224965428 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f37f015c650 0x7f37f00cf650 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:57:14.871 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:14.861+0000 7f37f5a35700 1 --2- 172.21.15.46:0/224965428 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f37f00af9b0 0x7f37f01f1900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:57:14.871 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:14.861+0000 7f37f5a35700 1 --2- 172.21.15.46:0/224965428 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f37f00b1d80 0x7f37f00cf110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:57:14.871 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:14.861+0000 7f37f5a35700 1 -- 172.21.15.46:0/224965428 >> 172.21.15.46:0/224965428 conn(0x7f37f009bfe0 msgr2=0x7f37f00d08b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-05T18:57:14.871 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:14.868+0000 7f37f5a35700 1 -- 172.21.15.46:0/224965428 shutdown_connections 2023-07-05T18:57:14.872 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:14.868+0000 7f37f5a35700 1 -- 172.21.15.46:0/224965428 wait complete. 2023-07-05T18:57:14.878 INFO:teuthology.orchestra.run.smithi046.stderr:pool 'cephfs_data' created 2023-07-05T18:57:14.889 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-07-05T18:57:15.021 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:15.019+0000 7f57a42f7700 1 Processor -- start 2023-07-05T18:57:15.021 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:15.019+0000 7f57a42f7700 1 -- start start 2023-07-05T18:57:15.023 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:15.020+0000 7f57a42f7700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f579c0cecc0 0x7f579c0d0b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:57:15.023 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:15.020+0000 7f57a42f7700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f579c0d1090 0x7f579c06b540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:57:15.023 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:15.020+0000 7f57a42f7700 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f579c06ad80 con 0x7f579c0afe50 2023-07-05T18:57:15.023 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:15.020+0000 7f57a42f7700 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f579c0d1510 con 0x7f579c0d1090 2023-07-05T18:57:15.023 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:15.020+0000 7f57a42f7700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f579c0b1d30 con 0x7f579c0cecc0 2023-07-05T18:57:15.024 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:15.020+0000 7f57a2093700 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7f579c0afe50 0x7f579c0b1620 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:59056/0 (socket says 172.21.15.46:59056) 2023-07-05T18:57:15.024 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:15.020+0000 7f57a2093700 1 -- 172.21.15.46:0/4136794116 learned_addr learned my addr 172.21.15.46:0/4136794116 (peer_addr_for_me v1:172.21.15.46:0/0) 2023-07-05T18:57:15.024 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:15.021+0000 7f57a2894700 1 --2- 172.21.15.46:0/4136794116 >> v2:172.21.15.73:3300/0 conn(0x7f579c0d1090 0x7f579c06b540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:57:15.025 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:15.021+0000 7f57a1892700 1 --2- 172.21.15.46:0/4136794116 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f579c0cecc0 0x7f579c0d0b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:57:15.025 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:15.021+0000 7f57a1091700 1 -- 172.21.15.46:0/4136794116 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1671024714 0 0) 0x7f579c06ad80 con 0x7f579c0afe50 2023-07-05T18:57:15.025 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:15.021+0000 7f57a1091700 1 -- 172.21.15.46:0/4136794116 --> v1:172.21.15.46:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f57880035b0 con 0x7f579c0afe50 2023-07-05T18:57:15.025 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:15.021+0000 7f57a1892700 1 -- 172.21.15.46:0/4136794116 >> v2:172.21.15.73:3300/0 conn(0x7f579c0d1090 msgr2=0x7f579c06b540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-05T18:57:15.026 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:15.021+0000 7f57a1892700 1 --2- 172.21.15.46:0/4136794116 >> v2:172.21.15.73:3300/0 conn(0x7f579c0d1090 0x7f579c06b540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:57:15.026 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:15.021+0000 7f57a1892700 1 -- 172.21.15.46:0/4136794116 >> v1:172.21.15.46:6789/0 conn(0x7f579c0afe50 legacy=0x7f579c0b1620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:57:15.026 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:15.021+0000 7f57a1892700 1 -- 172.21.15.46:0/4136794116 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f579c0cf150 con 0x7f579c0cecc0 2023-07-05T18:57:15.026 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:15.021+0000 7f57a2894700 1 --2- 172.21.15.46:0/4136794116 >> v2:172.21.15.73:3300/0 conn(0x7f579c0d1090 0x7f579c06b540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-05T18:57:15.026 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:15.021+0000 7f57a1892700 1 --2- 172.21.15.46:0/4136794116 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f579c0cecc0 0x7f579c0d0b50 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f5798009840 tx=0x7f5798009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f7b19705f9a189f1 server_cookie=0 in_seq=0 out_seq=0 2023-07-05T18:57:15.026 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:15.021+0000 7f57a1091700 1 -- 172.21.15.46:0/4136794116 <== mon.2 v2:172.21.15.73:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5798011830 con 0x7f579c0cecc0 2023-07-05T18:57:15.029 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:15.021+0000 7f57a1091700 1 -- 172.21.15.46:0/4136794116 <== mon.2 v2:172.21.15.73:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5798011990 con 0x7f579c0cecc0 2023-07-05T18:57:15.030 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:15.021+0000 7f57a1091700 1 -- 172.21.15.46:0/4136794116 <== mon.2 v2:172.21.15.73:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5798011d00 con 0x7f579c0cecc0 2023-07-05T18:57:15.030 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:15.022+0000 7f57a42f7700 1 -- 172.21.15.46:0/4136794116 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f579c0cecc0 msgr2=0x7f579c0d0b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:57:15.030 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:15.022+0000 7f57a42f7700 1 --2- 172.21.15.46:0/4136794116 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f579c0cecc0 0x7f579c0d0b50 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f5798009840 tx=0x7f5798009b50 comp rx=0 tx=0).stop 2023-07-05T18:57:15.030 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:15.022+0000 7f57a42f7700 1 -- 172.21.15.46:0/4136794116 shutdown_connections 2023-07-05T18:57:15.031 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:15.022+0000 7f57a42f7700 1 --2- 172.21.15.46:0/4136794116 >> v2:172.21.15.73:3300/0 conn(0x7f579c0d1090 0x7f579c06b540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:57:15.031 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:15.022+0000 7f57a42f7700 1 --2- 172.21.15.46:0/4136794116 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f579c0cecc0 0x7f579c0d0b50 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:57:15.031 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:15.022+0000 7f57a42f7700 1 -- 172.21.15.46:0/4136794116 >> 172.21.15.46:0/4136794116 conn(0x7f579c0664b0 msgr2=0x7f579c099e10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-05T18:57:15.031 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:15.022+0000 7f57a42f7700 1 -- 172.21.15.46:0/4136794116 shutdown_connections 2023-07-05T18:57:15.031 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:15.022+0000 7f57a42f7700 1 -- 172.21.15.46:0/4136794116 wait complete. 2023-07-05T18:57:15.031 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:15.023+0000 7f57a42f7700 1 Processor -- start 2023-07-05T18:57:15.032 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:15.023+0000 7f57a42f7700 1 -- start start 2023-07-05T18:57:15.032 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:15.024+0000 7f57a42f7700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f579c0afe50 0x7f579c1f5520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:57:15.032 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:15.024+0000 7f57a42f7700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f579c0cecc0 0x7f579c0cdd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:57:15.032 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:15.024+0000 7f57a42f7700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f579c0d1090 0x7f579c14f990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:57:15.032 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:15.024+0000 7f57a42f7700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f579c1f64a0 con 0x7f579c0cecc0 2023-07-05T18:57:15.032 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:15.024+0000 7f57a42f7700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f579c150480 con 0x7f579c0afe50 2023-07-05T18:57:15.032 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:15.024+0000 7f57a42f7700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f579c1f5c00 con 0x7f579c0d1090 2023-07-05T18:57:15.033 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:15.024+0000 7f57a1892700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f579c0cecc0 0x7f579c0cdd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:57:15.033 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:15.024+0000 7f57a1892700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f579c0cecc0 0x7f579c0cdd40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:59792/0 (socket says 172.21.15.46:59792) 2023-07-05T18:57:15.033 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:15.024+0000 7f57a1892700 1 -- 172.21.15.46:0/3881434520 learned_addr learned my addr 172.21.15.46:0/3881434520 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-07-05T18:57:15.033 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:15.024+0000 7f57a2093700 1 --2- 172.21.15.46:0/3881434520 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f579c0afe50 0x7f579c1f5520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:57:15.033 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:15.024+0000 7f57a2894700 1 --2- 172.21.15.46:0/3881434520 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f579c0d1090 0x7f579c14f990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:57:15.034 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:15.024+0000 7f57a1892700 1 -- 172.21.15.46:0/3881434520 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f579c0d1090 msgr2=0x7f579c14f990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:57:15.034 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:15.024+0000 7f57a1892700 1 --2- 172.21.15.46:0/3881434520 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f579c0d1090 0x7f579c14f990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:57:15.034 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:15.024+0000 7f57a1892700 1 -- 172.21.15.46:0/3881434520 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f579c0afe50 msgr2=0x7f579c1f5520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:57:15.034 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:15.024+0000 7f57a1892700 1 --2- 172.21.15.46:0/3881434520 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f579c0afe50 0x7f579c1f5520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:57:15.034 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:15.024+0000 7f57a1892700 1 -- 172.21.15.46:0/3881434520 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5794009a70 con 0x7f579c0cecc0 2023-07-05T18:57:15.034 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:15.024+0000 7f57a2894700 1 --2- 172.21.15.46:0/3881434520 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f579c0d1090 0x7f579c14f990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-05T18:57:15.034 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:15.025+0000 7f57a1892700 1 --2- 172.21.15.46:0/3881434520 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f579c0cecc0 0x7f579c0cdd40 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f5798000c00 tx=0x7f5798004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-05T18:57:15.035 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:15.025+0000 7f5792ffd700 1 -- 172.21.15.46:0/3881434520 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57980036a0 con 0x7f579c0cecc0 2023-07-05T18:57:15.035 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:15.025+0000 7f5792ffd700 1 -- 172.21.15.46:0/3881434520 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f579801f070 con 0x7f579c0cecc0 2023-07-05T18:57:15.035 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:15.025+0000 7f57a42f7700 1 -- 172.21.15.46:0/3881434520 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f57980094a0 con 0x7f579c0cecc0 2023-07-05T18:57:15.035 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:15.025+0000 7f5792ffd700 1 -- 172.21.15.46:0/3881434520 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5798003a00 con 0x7f579c0cecc0 2023-07-05T18:57:15.035 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:15.025+0000 7f57a42f7700 1 -- 172.21.15.46:0/3881434520 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f579c1f61c0 con 0x7f579c0cecc0 2023-07-05T18:57:15.035 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:15.026+0000 7f57a42f7700 1 -- 172.21.15.46:0/3881434520 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f579c0672e0 con 0x7f579c0cecc0 2023-07-05T18:57:15.035 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:15.026+0000 7f5792ffd700 1 -- 172.21.15.46:0/3881434520 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f5798003b60 con 0x7f579c0cecc0 2023-07-05T18:57:15.035 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:15.027+0000 7f5792ffd700 1 --2- 172.21.15.46:0/3881434520 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7f578006ace0 0x7f578006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:57:15.036 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:15.027+0000 7f5792ffd700 1 -- 172.21.15.46:0/3881434520 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 5962+0+0 (secure 0 0 0) 0x7f5798021070 con 0x7f579c0cecc0 2023-07-05T18:57:15.036 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:15.027+0000 7f57a2093700 1 --2- 172.21.15.46:0/3881434520 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7f578006ace0 0x7f578006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:57:15.036 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:15.028+0000 7f57a2093700 1 --2- 172.21.15.46:0/3881434520 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7f578006ace0 0x7f578006d190 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f578c005910 tx=0x7f578c009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-05T18:57:15.039 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:15.032+0000 7f5792ffd700 1 -- 172.21.15.46:0/3881434520 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f5798055e70 con 0x7f579c0cecc0 2023-07-05T18:57:15.279 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:15.277+0000 7f57a42f7700 1 -- 172.21.15.46:0/3881434520 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f579c0b1b10 con 0x7f579c0cecc0 2023-07-05T18:57:15.284 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:15.282+0000 7f5792ffd700 1 -- 172.21.15.46:0/3881434520 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 5 and data pool 6 v12) v1 ==== 172+0+0 (secure 0 0 0) 0x7f5798059490 con 0x7f579c0cecc0 2023-07-05T18:57:15.288 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:15.285+0000 7f57a42f7700 1 -- 172.21.15.46:0/3881434520 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7f578006ace0 msgr2=0x7f578006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:57:15.288 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:15.285+0000 7f57a42f7700 1 --2- 172.21.15.46:0/3881434520 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7f578006ace0 0x7f578006d190 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f578c005910 tx=0x7f578c009040 comp rx=0 tx=0).stop 2023-07-05T18:57:15.288 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:15.285+0000 7f57a42f7700 1 -- 172.21.15.46:0/3881434520 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f579c0cecc0 msgr2=0x7f579c0cdd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:57:15.288 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:15.285+0000 7f57a42f7700 1 --2- 172.21.15.46:0/3881434520 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f579c0cecc0 0x7f579c0cdd40 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f5798000c00 tx=0x7f5798004750 comp rx=0 tx=0).stop 2023-07-05T18:57:15.289 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:15.285+0000 7f57a42f7700 1 -- 172.21.15.46:0/3881434520 shutdown_connections 2023-07-05T18:57:15.289 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:15.285+0000 7f57a42f7700 1 --2- 172.21.15.46:0/3881434520 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7f578006ace0 0x7f578006d190 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:57:15.289 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:15.285+0000 7f57a42f7700 1 --2- 172.21.15.46:0/3881434520 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f579c0d1090 0x7f579c14f990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:57:15.289 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:15.285+0000 7f57a42f7700 1 --2- 172.21.15.46:0/3881434520 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f579c0afe50 0x7f579c1f5520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:57:15.289 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:15.285+0000 7f57a42f7700 1 --2- 172.21.15.46:0/3881434520 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f579c0cecc0 0x7f579c0cdd40 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:57:15.290 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:15.285+0000 7f57a42f7700 1 -- 172.21.15.46:0/3881434520 >> 172.21.15.46:0/3881434520 conn(0x7f579c0664b0 msgr2=0x7f579c06b540 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-05T18:57:15.290 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:15.286+0000 7f57a42f7700 1 -- 172.21.15.46:0/3881434520 shutdown_connections 2023-07-05T18:57:15.290 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:15.286+0000 7f57a42f7700 1 -- 172.21.15.46:0/3881434520 wait complete. 2023-07-05T18:57:15.291 INFO:teuthology.orchestra.run.smithi046.stderr:new fs with metadata pool 5 and data pool 6 2023-07-05T18:57:15.309 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-05T18:57:15.435 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:15.433+0000 7ff0f4bbc700 1 Processor -- start 2023-07-05T18:57:15.436 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:15.433+0000 7ff0f4bbc700 1 -- start start 2023-07-05T18:57:15.436 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:15.434+0000 7ff0f4bbc700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7ff0f006d8b0 0x7ff0f0070730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:57:15.437 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:15.434+0000 7ff0f4bbc700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7ff0f00b1ec0 0x7ff0f015cde0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:57:15.437 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:15.434+0000 7ff0f4bbc700 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff0f0070c70 con 0x7ff0f00aef90 2023-07-05T18:57:15.437 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:15.434+0000 7ff0f4bbc700 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff0f0160080 con 0x7ff0f006d8b0 2023-07-05T18:57:15.437 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:15.434+0000 7ff0f4bbc700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff0f0160360 con 0x7ff0f00b1ec0 2023-07-05T18:57:15.437 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:15.434+0000 7ff0edd9b700 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7ff0f00aef90 0x7ff0f00b17b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:59070/0 (socket says 172.21.15.46:59070) 2023-07-05T18:57:15.437 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:15.434+0000 7ff0edd9b700 1 -- 172.21.15.46:0/386887987 learned_addr learned my addr 172.21.15.46:0/386887987 (peer_addr_for_me v1:172.21.15.46:0/0) 2023-07-05T18:57:15.438 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:15.435+0000 7ff0eed9d700 1 --2- 172.21.15.46:0/386887987 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7ff0f00b1ec0 0x7ff0f015cde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:57:15.438 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:15.435+0000 7ff0ee59c700 1 --2- 172.21.15.46:0/386887987 >> v2:172.21.15.73:3300/0 conn(0x7ff0f006d8b0 0x7ff0f0070730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:57:15.447 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:15.435+0000 7ff0ed59a700 1 -- 172.21.15.46:0/386887987 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4282125535 0 0) 0x7ff0f0070c70 con 0x7ff0f00aef90 2023-07-05T18:57:15.447 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:15.435+0000 7ff0ed59a700 1 -- 172.21.15.46:0/386887987 --> v1:172.21.15.46:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff0d80035b0 con 0x7ff0f00aef90 2023-07-05T18:57:15.448 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:15.435+0000 7ff0ed59a700 1 -- 172.21.15.46:0/386887987 <== mon.0 v1:172.21.15.46:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3895093826 0 0) 0x7ff0d80035b0 con 0x7ff0f00aef90 2023-07-05T18:57:15.448 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:15.435+0000 7ff0ed59a700 1 -- 172.21.15.46:0/386887987 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7ff0f00b1ec0 msgr2=0x7ff0f015cde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-05T18:57:15.448 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:15.435+0000 7ff0ed59a700 1 --2- 172.21.15.46:0/386887987 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7ff0f00b1ec0 0x7ff0f015cde0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:57:15.448 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:15.435+0000 7ff0ed59a700 1 -- 172.21.15.46:0/386887987 >> v2:172.21.15.73:3300/0 conn(0x7ff0f006d8b0 msgr2=0x7ff0f0070730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-05T18:57:15.448 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:15.435+0000 7ff0ed59a700 1 --2- 172.21.15.46:0/386887987 >> v2:172.21.15.73:3300/0 conn(0x7ff0f006d8b0 0x7ff0f0070730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:57:15.448 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:15.435+0000 7ff0ed59a700 1 -- 172.21.15.46:0/386887987 --> v1:172.21.15.46:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff0f0160640 con 0x7ff0f00aef90 2023-07-05T18:57:15.449 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:15.435+0000 7ff0ed59a700 1 -- 172.21.15.46:0/386887987 <== mon.0 v1:172.21.15.46:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2195585215 0 0) 0x7ff0e4001670 con 0x7ff0f00aef90 2023-07-05T18:57:15.449 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:15.435+0000 7ff0ed59a700 1 -- 172.21.15.46:0/386887987 >> v1:172.21.15.46:6789/0 conn(0x7ff0f00aef90 legacy=0x7ff0f00b17b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:57:15.449 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:15.435+0000 7ff0ed59a700 1 --2- 172.21.15.46:0/386887987 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff0d8003a00 0x7ff0d8003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:57:15.449 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:15.435+0000 7ff0ed59a700 1 --2- 172.21.15.46:0/386887987 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7ff0f00b1ec0 0x7ff0d8004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:57:15.449 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:15.435+0000 7ff0ed59a700 1 --2- 172.21.15.46:0/386887987 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff0d8004d90 0x7ff0d8005200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:57:15.449 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:15.435+0000 7ff0ed59a700 1 -- 172.21.15.46:0/386887987 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0f0160080 con 0x7ff0d8004d90 2023-07-05T18:57:15.449 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:15.435+0000 7ff0ed59a700 1 -- 172.21.15.46:0/386887987 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0f0160360 con 0x7ff0d8003a00 2023-07-05T18:57:15.449 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:15.435+0000 7ff0ed59a700 1 -- 172.21.15.46:0/386887987 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff0d800ba10 con 0x7ff0f00b1ec0 2023-07-05T18:57:15.450 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:15.435+0000 7ff0edd9b700 1 --2- 172.21.15.46:0/386887987 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7ff0f00b1ec0 0x7ff0d8004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:57:15.450 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:15.435+0000 7ff0ee59c700 1 --2- 172.21.15.46:0/386887987 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff0d8003a00 0x7ff0d8003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:57:15.450 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:15.435+0000 7ff0eed9d700 1 --2- 172.21.15.46:0/386887987 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff0d8004d90 0x7ff0d8005200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:57:15.450 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:15.435+0000 7ff0edd9b700 1 -- 172.21.15.46:0/386887987 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff0d8003a00 msgr2=0x7ff0d8003e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-05T18:57:15.450 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:15.435+0000 7ff0edd9b700 1 --2- 172.21.15.46:0/386887987 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff0d8003a00 0x7ff0d8003e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:57:15.450 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:15.436+0000 7ff0edd9b700 1 -- 172.21.15.46:0/386887987 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff0d8004d90 msgr2=0x7ff0d8005200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-05T18:57:15.450 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:15.436+0000 7ff0edd9b700 1 --2- 172.21.15.46:0/386887987 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff0d8004d90 0x7ff0d8005200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:57:15.450 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:15.436+0000 7ff0edd9b700 1 -- 172.21.15.46:0/386887987 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff0d80035b0 con 0x7ff0f00b1ec0 2023-07-05T18:57:15.451 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:15.436+0000 7ff0ee59c700 1 --2- 172.21.15.46:0/386887987 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff0d8003a00 0x7ff0d8003e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-05T18:57:15.451 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:15.436+0000 7ff0eed9d700 1 --2- 172.21.15.46:0/386887987 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff0d8004d90 0x7ff0d8005200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-05T18:57:15.451 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:15.436+0000 7ff0edd9b700 1 --2- 172.21.15.46:0/386887987 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7ff0f00b1ec0 0x7ff0d8004850 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7ff0e400c370 tx=0x7ff0d8005880 comp rx=0 tx=0).ready entity=mon.2 client_cookie=daf1bb09fc999ff6 server_cookie=0 in_seq=0 out_seq=0 2023-07-05T18:57:15.451 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:15.436+0000 7ff0ed59a700 1 -- 172.21.15.46:0/386887987 <== mon.2 v2:172.21.15.73:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0e4007c60 con 0x7ff0f00b1ec0 2023-07-05T18:57:15.451 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:15.436+0000 7ff0ed59a700 1 -- 172.21.15.46:0/386887987 <== mon.2 v2:172.21.15.73:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff0e4005960 con 0x7ff0f00b1ec0 2023-07-05T18:57:15.451 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:15.436+0000 7ff0ed59a700 1 -- 172.21.15.46:0/386887987 <== mon.2 v2:172.21.15.73:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0e4005d10 con 0x7ff0f00b1ec0 2023-07-05T18:57:15.451 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:15.436+0000 7ff0f4bbc700 1 -- 172.21.15.46:0/386887987 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7ff0f00b1ec0 msgr2=0x7ff0d8004850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:57:15.452 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:15.436+0000 7ff0f4bbc700 1 --2- 172.21.15.46:0/386887987 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7ff0f00b1ec0 0x7ff0d8004850 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7ff0e400c370 tx=0x7ff0d8005880 comp rx=0 tx=0).stop 2023-07-05T18:57:15.452 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:15.436+0000 7ff0eed9d700 1 -- 172.21.15.46:0/386887987 reap_dead start 2023-07-05T18:57:15.452 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:15.436+0000 7ff0f4bbc700 1 -- 172.21.15.46:0/386887987 shutdown_connections 2023-07-05T18:57:15.452 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:15.436+0000 7ff0f4bbc700 1 -- 172.21.15.46:0/386887987 >> 172.21.15.46:0/386887987 conn(0x7ff0f006af10 msgr2=0x7ff0f006b2e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-05T18:57:15.452 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:15.436+0000 7ff0f4bbc700 1 -- 172.21.15.46:0/386887987 shutdown_connections 2023-07-05T18:57:15.452 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:15.436+0000 7ff0f4bbc700 1 -- 172.21.15.46:0/386887987 wait complete. 2023-07-05T18:57:15.452 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:15.438+0000 7ff0f4bbc700 1 Processor -- start 2023-07-05T18:57:15.453 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:15.438+0000 7ff0f4bbc700 1 -- start start 2023-07-05T18:57:15.453 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:15.439+0000 7ff0f4bbc700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff0f00b1ec0 0x7ff0f00b5280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:57:15.453 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:15.439+0000 7ff0f4bbc700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff0f01578b0 0x7ff0f0154380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:57:15.453 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:15.439+0000 7ff0f4bbc700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7ff0f015bee0 0x7ff0f01f4fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:57:15.453 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:15.439+0000 7ff0f4bbc700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0f01548c0 con 0x7ff0f00b1ec0 2023-07-05T18:57:15.454 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:15.439+0000 7ff0f4bbc700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0f00b4df0 con 0x7ff0f01578b0 2023-07-05T18:57:15.454 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:15.439+0000 7ff0f4bbc700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff0f00b47e0 con 0x7ff0f015bee0 2023-07-05T18:57:15.454 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:15.439+0000 7ff0ee59c700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff0f00b1ec0 0x7ff0f00b5280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:57:15.454 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:15.439+0000 7ff0ee59c700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff0f00b1ec0 0x7ff0f00b5280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:59810/0 (socket says 172.21.15.46:59810) 2023-07-05T18:57:15.454 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:15.439+0000 7ff0ee59c700 1 -- 172.21.15.46:0/1117362065 learned_addr learned my addr 172.21.15.46:0/1117362065 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-07-05T18:57:15.454 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:15.439+0000 7ff0eed9d700 1 --2- 172.21.15.46:0/1117362065 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7ff0f015bee0 0x7ff0f01f4fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:57:15.454 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:15.439+0000 7ff0edd9b700 1 --2- 172.21.15.46:0/1117362065 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff0f01578b0 0x7ff0f0154380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:57:15.454 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:15.439+0000 7ff0ee59c700 1 -- 172.21.15.46:0/1117362065 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7ff0f015bee0 msgr2=0x7ff0f01f4fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:57:15.455 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:15.439+0000 7ff0ee59c700 1 --2- 172.21.15.46:0/1117362065 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7ff0f015bee0 0x7ff0f01f4fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:57:15.455 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:15.439+0000 7ff0ee59c700 1 -- 172.21.15.46:0/1117362065 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff0f01578b0 msgr2=0x7ff0f0154380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:57:15.455 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:15.439+0000 7ff0ee59c700 1 --2- 172.21.15.46:0/1117362065 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff0f01578b0 0x7ff0f0154380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:57:15.455 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:15.439+0000 7ff0ee59c700 1 -- 172.21.15.46:0/1117362065 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff0f0157db0 con 0x7ff0f00b1ec0 2023-07-05T18:57:15.455 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:15.439+0000 7ff0ee59c700 1 --2- 172.21.15.46:0/1117362065 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff0f00b1ec0 0x7ff0f00b5280 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7ff0e0011cd0 tx=0x7ff0e000f520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-05T18:57:15.455 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:15.439+0000 7ff0deffd700 1 -- 172.21.15.46:0/1117362065 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0e0011e70 con 0x7ff0f00b1ec0 2023-07-05T18:57:15.455 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:15.439+0000 7ff0deffd700 1 -- 172.21.15.46:0/1117362065 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff0e000fce0 con 0x7ff0f00b1ec0 2023-07-05T18:57:15.456 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:15.439+0000 7ff0f4bbc700 1 -- 172.21.15.46:0/1117362065 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff0f00b4a80 con 0x7ff0f00b1ec0 2023-07-05T18:57:15.456 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:15.439+0000 7ff0deffd700 1 -- 172.21.15.46:0/1117362065 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0e0004240 con 0x7ff0f00b1ec0 2023-07-05T18:57:15.456 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:15.439+0000 7ff0f4bbc700 1 -- 172.21.15.46:0/1117362065 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff0f015c350 con 0x7ff0f00b1ec0 2023-07-05T18:57:15.456 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:15.440+0000 7ff0f4bbc700 1 -- 172.21.15.46:0/1117362065 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff0f00b50d0 con 0x7ff0f00b1ec0 2023-07-05T18:57:15.456 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:15.441+0000 7ff0deffd700 1 -- 172.21.15.46:0/1117362065 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7ff0e00043a0 con 0x7ff0f00b1ec0 2023-07-05T18:57:15.456 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:15.441+0000 7ff0deffd700 1 --2- 172.21.15.46:0/1117362065 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7ff0d006ace0 0x7ff0d006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:57:15.456 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:15.442+0000 7ff0deffd700 1 -- 172.21.15.46:0/1117362065 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 6062+0+0 (secure 0 0 0) 0x7ff0e0089a30 con 0x7ff0f00b1ec0 2023-07-05T18:57:15.456 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:15.442+0000 7ff0edd9b700 1 --2- 172.21.15.46:0/1117362065 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7ff0d006ace0 0x7ff0d006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:57:15.457 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:15.442+0000 7ff0edd9b700 1 --2- 172.21.15.46:0/1117362065 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7ff0d006ace0 0x7ff0d006d190 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7ff0f015fff0 tx=0x7ff0e400a000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-05T18:57:15.457 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:15.446+0000 7ff0deffd700 1 -- 172.21.15.46:0/1117362065 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7ff0e0054b70 con 0x7ff0f00b1ec0 2023-07-05T18:57:15.643 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:15.641+0000 7ff0f4bbc700 1 -- 172.21.15.46:0/1117362065 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ff0f00672e0 con 0x7ff0f00b1ec0 2023-07-05T18:57:15.644 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:15.642+0000 7ff0deffd700 1 -- 172.21.15.46:0/1117362065 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v34) v1 ==== 74+0+18246 (secure 0 0 0) 0x7ff0e0022020 con 0x7ff0f00b1ec0 2023-07-05T18:57:15.645 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T18:57:15.645 INFO:teuthology.orchestra.run.smithi046.stdout:{"epoch":34,"fsid":"042652d3-d80c-4ad8-9366-3e94f2a0a512","created":"2023-07-05T18:55:56.455710+0000","modified":"2023-07-05T18:57:15.279252+0000","last_up_change":"2023-07-05T18:56:06.594022+0000","last_in_change":"2023-07-05T18:55:58.879340+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-07-05T18:56:07.729620+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2023-07-05T18:56:08.128122+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2023-07-05T18:57:13.640396+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"34","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_data","create_time":"2023-07-05T18:57:14.333267+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"34","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"20009183-9a47-4392-8751-883f88d2bfb1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6813","nonce":4151971443},{"type":"v1","addr":"172.21.15.46:6815","nonce":4151971443}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6817","nonce":4151971443},{"type":"v1","addr":"172.21.15.46:6818","nonce":4151971443}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6822","nonce":4151971443},{"type":"v1","addr":"172.21.15.46:6823","nonce":4151971443}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6820","nonce":4151971443},{"type":"v1","addr":"172.21.15.46:6821","nonce":4151971443}]},"public_addr":"172.21.15.46:6815/4151971443","cluster_addr":"172.21.15.46:6818/4151971443","heartbeat_back_addr":"172.21.15.46:6823/4151971443","heartbeat_front_addr":"172.21.15.46:6821/4151971443","state":["exists","up"]},{"osd":1,"uuid":"91b4a7b0-e4e4-4888-a1fe-9edb0d68004c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6808","nonce":502575881},{"type":"v1","addr":"172.21.15.46:6809","nonce":502575881}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6810","nonce":502575881},{"type":"v1","addr":"172.21.15.46:6811","nonce":502575881}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6816","nonce":502575881},{"type":"v1","addr":"172.21.15.46:6819","nonce":502575881}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6812","nonce":502575881},{"type":"v1","addr":"172.21.15.46:6814","nonce":502575881}]},"public_addr":"172.21.15.46:6809/502575881","cluster_addr":"172.21.15.46:6811/502575881","heartbeat_back_addr":"172.21.15.46:6819/502575881","heartbeat_front_addr":"172.21.15.46:6814/502575881","state":["exists","up"]},{"osd":2,"uuid":"669ff744-1331-47c5-8579-0440731c889a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6800","nonce":2115251461},{"type":"v1","addr":"172.21.15.46:6801","nonce":2115251461}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6802","nonce":2115251461},{"type":"v1","addr":"172.21.15.46:6803","nonce":2115251461}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6806","nonce":2115251461},{"type":"v1","addr":"172.21.15.46:6807","nonce":2115251461}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6804","nonce":2115251461},{"type":"v1","addr":"172.21.15.46:6805","nonce":2115251461}]},"public_addr":"172.21.15.46:6801/2115251461","cluster_addr":"172.21.15.46:6803/2115251461","heartbeat_back_addr":"172.21.15.46:6807/2115251461","heartbeat_front_addr":"172.21.15.46:6805/2115251461","state":["exists","up"]},{"osd":3,"uuid":"34e1b86d-ffad-415d-861c-07a5f08068a6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6824","nonce":2981388766},{"type":"v1","addr":"172.21.15.46:6825","nonce":2981388766}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6826","nonce":2981388766},{"type":"v1","addr":"172.21.15.46:6827","nonce":2981388766}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6830","nonce":2981388766},{"type":"v1","addr":"172.21.15.46:6831","nonce":2981388766}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6828","nonce":2981388766},{"type":"v1","addr":"172.21.15.46:6829","nonce":2981388766}]},"public_addr":"172.21.15.46:6825/2981388766","cluster_addr":"172.21.15.46:6827/2981388766","heartbeat_back_addr":"172.21.15.46:6831/2981388766","heartbeat_front_addr":"172.21.15.46:6829/2981388766","state":["exists","up"]},{"osd":4,"uuid":"57ffcb91-c7dc-4a69-ae71-4d9622a14a05","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6800","nonce":2083655348},{"type":"v1","addr":"172.21.15.73:6801","nonce":2083655348}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6802","nonce":2083655348},{"type":"v1","addr":"172.21.15.73:6803","nonce":2083655348}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6806","nonce":2083655348},{"type":"v1","addr":"172.21.15.73:6807","nonce":2083655348}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6804","nonce":2083655348},{"type":"v1","addr":"172.21.15.73:6805","nonce":2083655348}]},"public_addr":"172.21.15.73:6801/2083655348","cluster_addr":"172.21.15.73:6803/2083655348","heartbeat_back_addr":"172.21.15.73:6807/2083655348","heartbeat_front_addr":"172.21.15.73:6805/2083655348","state":["exists","up"]},{"osd":5,"uuid":"665f41c9-ee20-49cf-bf0e-fbe0c03d3aed","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6824","nonce":2803788401},{"type":"v1","addr":"172.21.15.73:6825","nonce":2803788401}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6826","nonce":2803788401},{"type":"v1","addr":"172.21.15.73:6827","nonce":2803788401}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6830","nonce":2803788401},{"type":"v1","addr":"172.21.15.73:6831","nonce":2803788401}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6828","nonce":2803788401},{"type":"v1","addr":"172.21.15.73:6829","nonce":2803788401}]},"public_addr":"172.21.15.73:6825/2803788401","cluster_addr":"172.21.15.73:6827/2803788401","heartbeat_back_addr":"172.21.15.73:6831/2803788401","heartbeat_front_addr":"172.21.15.73:6829/2803788401","state":["exists","up"]},{"osd":6,"uuid":"5790c6cc-bd56-4ce4-9a7c-0f0c3b59215c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6808","nonce":974108383},{"type":"v1","addr":"172.21.15.73:6809","nonce":974108383}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6810","nonce":974108383},{"type":"v1","addr":"172.21.15.73:6811","nonce":974108383}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6815","nonce":974108383},{"type":"v1","addr":"172.21.15.73:6817","nonce":974108383}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6812","nonce":974108383},{"type":"v1","addr":"172.21.15.73:6813","nonce":974108383}]},"public_addr":"172.21.15.73:6809/974108383","cluster_addr":"172.21.15.73:6811/974108383","heartbeat_back_addr":"172.21.15.73:6817/974108383","heartbeat_front_addr":"172.21.15.73:6813/974108383","state":["exists","up"]},{"osd":7,"uuid":"b66f4d2e-147e-4c9b-97dd-cbd59d33802e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6814","nonce":3772673248},{"type":"v1","addr":"172.21.15.73:6816","nonce":3772673248}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6818","nonce":3772673248},{"type":"v1","addr":"172.21.15.73:6819","nonce":3772673248}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6822","nonce":3772673248},{"type":"v1","addr":"172.21.15.73:6823","nonce":3772673248}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6820","nonce":3772673248},{"type":"v1","addr":"172.21.15.73:6821","nonce":3772673248}]},"public_addr":"172.21.15.73:6816/3772673248","cluster_addr":"172.21.15.73:6819/3772673248","heartbeat_back_addr":"172.21.15.73:6823/3772673248","heartbeat_front_addr":"172.21.15.73:6821/3772673248","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-05T18:56:04.115334+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-05T18:56:04.071250+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-05T18:56:04.044387+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-05T18:56:04.085389+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-05T18:56:04.090726+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-05T18:56:04.074529+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-05T18:56:04.058841+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-05T18:56:04.043054+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-05T18:57:15.652 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:15.644+0000 7ff0f4bbc700 1 -- 172.21.15.46:0/1117362065 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7ff0d006ace0 msgr2=0x7ff0d006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:57:15.653 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:15.644+0000 7ff0f4bbc700 1 --2- 172.21.15.46:0/1117362065 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7ff0d006ace0 0x7ff0d006d190 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7ff0f015fff0 tx=0x7ff0e400a000 comp rx=0 tx=0).stop 2023-07-05T18:57:15.653 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:15.644+0000 7ff0f4bbc700 1 -- 172.21.15.46:0/1117362065 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff0f00b1ec0 msgr2=0x7ff0f00b5280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:57:15.653 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:15.644+0000 7ff0f4bbc700 1 --2- 172.21.15.46:0/1117362065 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff0f00b1ec0 0x7ff0f00b5280 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7ff0e0011cd0 tx=0x7ff0e000f520 comp rx=0 tx=0).stop 2023-07-05T18:57:15.653 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:15.644+0000 7ff0f4bbc700 1 -- 172.21.15.46:0/1117362065 shutdown_connections 2023-07-05T18:57:15.653 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:15.644+0000 7ff0f4bbc700 1 --2- 172.21.15.46:0/1117362065 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7ff0d006ace0 0x7ff0d006d190 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:57:15.653 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:15.644+0000 7ff0f4bbc700 1 --2- 172.21.15.46:0/1117362065 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7ff0f015bee0 0x7ff0f01f4fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:57:15.653 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:15.644+0000 7ff0f4bbc700 1 --2- 172.21.15.46:0/1117362065 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff0f00b1ec0 0x7ff0f00b5280 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:57:15.653 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:15.644+0000 7ff0f4bbc700 1 --2- 172.21.15.46:0/1117362065 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff0f01578b0 0x7ff0f0154380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:57:15.654 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:15.644+0000 7ff0f4bbc700 1 -- 172.21.15.46:0/1117362065 >> 172.21.15.46:0/1117362065 conn(0x7ff0f006af10 msgr2=0x7ff0f00b13e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-05T18:57:15.654 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:15.645+0000 7ff0f4bbc700 1 -- 172.21.15.46:0/1117362065 shutdown_connections 2023-07-05T18:57:15.654 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:15.645+0000 7ff0f4bbc700 1 -- 172.21.15.46:0/1117362065 wait complete. 2023-07-05T18:57:15.665 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-05T18:57:15.791 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:15.789+0000 7f895aef4700 1 Processor -- start 2023-07-05T18:57:15.791 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:15.789+0000 7f895aef4700 1 -- start start 2023-07-05T18:57:15.793 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:15.790+0000 7f895aef4700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f895413f4c0 0x7f895415d6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:57:15.793 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:15.790+0000 7f895aef4700 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f895415dbe0 con 0x7f8954142480 2023-07-05T18:57:15.793 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:15.790+0000 7f895aef4700 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f895406c8d0 con 0x7f895406d140 2023-07-05T18:57:15.794 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:15.790+0000 7f895aef4700 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f895406ce90 con 0x7f895413f4c0 2023-07-05T18:57:15.794 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:15.790+0000 7f8953fff700 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7f8954142480 0x7f89540b41d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:59092/0 (socket says 172.21.15.46:59092) 2023-07-05T18:57:15.795 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:15.790+0000 7f8953fff700 1 -- 172.21.15.46:0/1238313965 learned_addr learned my addr 172.21.15.46:0/1238313965 (peer_addr_for_me v1:172.21.15.46:0/0) 2023-07-05T18:57:15.795 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:15.790+0000 7f8958c90700 1 --2- 172.21.15.46:0/1238313965 >> v2:172.21.15.73:3300/0 conn(0x7f895413f4c0 0x7f895415d6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:57:15.795 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:15.791+0000 7f89537fe700 1 -- 172.21.15.46:0/1238313965 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3424178348 0 0) 0x7f895415dbe0 con 0x7f8954142480 2023-07-05T18:57:15.795 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:15.791+0000 7f89537fe700 1 -- 172.21.15.46:0/1238313965 --> v1:172.21.15.46:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f89440035b0 con 0x7f8954142480 2023-07-05T18:57:15.795 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:15.791+0000 7f8958c90700 1 -- 172.21.15.46:0/1238313965 >> v1:172.21.15.73:6789/0 conn(0x7f895406d140 legacy=0x7f895413fdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:57:15.795 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:15.791+0000 7f89537fe700 1 -- 172.21.15.46:0/1238313965 <== mon.0 v1:172.21.15.46:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3738326171 0 0) 0x7f89440035b0 con 0x7f8954142480 2023-07-05T18:57:15.796 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:15.791+0000 7f8958c90700 1 -- 172.21.15.46:0/1238313965 >> v1:172.21.15.46:6789/0 conn(0x7f8954142480 legacy=0x7f89540b41d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:57:15.796 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:15.791+0000 7f8958c90700 1 -- 172.21.15.46:0/1238313965 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f895406cbb0 con 0x7f895413f4c0 2023-07-05T18:57:15.796 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:15.791+0000 7f8958c90700 1 --2- 172.21.15.46:0/1238313965 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f895413f4c0 0x7f895415d6a0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f8948009840 tx=0x7f8948009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a9abaab1e3fb28af server_cookie=0 in_seq=0 out_seq=0 2023-07-05T18:57:15.796 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:15.791+0000 7f89537fe700 1 -- 172.21.15.46:0/1238313965 <== mon.1 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8940001670 con 0x7f895413f4c0 2023-07-05T18:57:15.797 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:15.791+0000 7f89537fe700 1 -- 172.21.15.46:0/1238313965 <== mon.1 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8948004030 con 0x7f895413f4c0 2023-07-05T18:57:15.797 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:15.791+0000 7f89537fe700 1 -- 172.21.15.46:0/1238313965 <== mon.1 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89480043c0 con 0x7f895413f4c0 2023-07-05T18:57:15.800 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:15.792+0000 7f895aef4700 1 -- 172.21.15.46:0/1238313965 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f895413f4c0 msgr2=0x7f895415d6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:57:15.801 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:15.792+0000 7f895aef4700 1 --2- 172.21.15.46:0/1238313965 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f895413f4c0 0x7f895415d6a0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f8948009840 tx=0x7f8948009b50 comp rx=0 tx=0).stop 2023-07-05T18:57:15.801 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:15.792+0000 7f895aef4700 1 -- 172.21.15.46:0/1238313965 shutdown_connections 2023-07-05T18:57:15.801 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:15.792+0000 7f895aef4700 1 --2- 172.21.15.46:0/1238313965 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f895413f4c0 0x7f895415d6a0 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:57:15.801 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:15.792+0000 7f895aef4700 1 -- 172.21.15.46:0/1238313965 >> 172.21.15.46:0/1238313965 conn(0x7f895406af10 msgr2=0x7f895406b2e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-05T18:57:15.801 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:15.792+0000 7f895aef4700 1 -- 172.21.15.46:0/1238313965 shutdown_connections 2023-07-05T18:57:15.801 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:15.792+0000 7f895aef4700 1 -- 172.21.15.46:0/1238313965 wait complete. 2023-07-05T18:57:15.802 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:15.793+0000 7f895aef4700 1 Processor -- start 2023-07-05T18:57:15.802 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:15.793+0000 7f895aef4700 1 -- start start 2023-07-05T18:57:15.802 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:15.794+0000 7f895aef4700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f895406d140 0x7f8954156a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:57:15.802 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:15.794+0000 7f895aef4700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f895413f4c0 0x7f895415d020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:57:15.802 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:15.794+0000 7f895aef4700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f8954142480 0x7f89541f0f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:57:15.802 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:15.794+0000 7f895aef4700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8954156f90 con 0x7f895406d140 2023-07-05T18:57:15.802 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:15.794+0000 7f895aef4700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f895415afe0 con 0x7f895413f4c0 2023-07-05T18:57:15.802 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:15.794+0000 7f895aef4700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f895415a3d0 con 0x7f8954142480 2023-07-05T18:57:15.803 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:15.794+0000 7f8958c90700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f895406d140 0x7f8954156a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:57:15.803 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:15.794+0000 7f8958c90700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f895406d140 0x7f8954156a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:59824/0 (socket says 172.21.15.46:59824) 2023-07-05T18:57:15.803 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:15.794+0000 7f8958c90700 1 -- 172.21.15.46:0/4227970466 learned_addr learned my addr 172.21.15.46:0/4227970466 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-07-05T18:57:15.803 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:15.794+0000 7f8953fff700 1 --2- 172.21.15.46:0/4227970466 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f895413f4c0 0x7f895415d020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:57:15.803 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:15.794+0000 7f8959491700 1 --2- 172.21.15.46:0/4227970466 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f8954142480 0x7f89541f0f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:57:15.803 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:15.794+0000 7f8958c90700 1 -- 172.21.15.46:0/4227970466 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f8954142480 msgr2=0x7f89541f0f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:57:15.803 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:15.794+0000 7f8958c90700 1 --2- 172.21.15.46:0/4227970466 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f8954142480 0x7f89541f0f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:57:15.803 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:15.794+0000 7f8958c90700 1 -- 172.21.15.46:0/4227970466 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f895413f4c0 msgr2=0x7f895415d020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:57:15.804 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:15.794+0000 7f8958c90700 1 --2- 172.21.15.46:0/4227970466 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f895413f4c0 0x7f895415d020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:57:15.804 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:15.794+0000 7f8958c90700 1 -- 172.21.15.46:0/4227970466 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f89480094a0 con 0x7f895406d140 2023-07-05T18:57:15.804 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:15.794+0000 7f8958c90700 1 --2- 172.21.15.46:0/4227970466 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f895406d140 0x7f8954156a50 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f894800a010 tx=0x7f8948004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-05T18:57:15.804 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:15.795+0000 7f89517fa700 1 -- 172.21.15.46:0/4227970466 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8948011830 con 0x7f895406d140 2023-07-05T18:57:15.804 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:15.795+0000 7f89517fa700 1 -- 172.21.15.46:0/4227970466 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f894801f070 con 0x7f895406d140 2023-07-05T18:57:15.804 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:15.795+0000 7f895aef4700 1 -- 172.21.15.46:0/4227970466 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f895415a6b0 con 0x7f895406d140 2023-07-05T18:57:15.804 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:15.795+0000 7f89517fa700 1 -- 172.21.15.46:0/4227970466 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8948011bd0 con 0x7f895406d140 2023-07-05T18:57:15.805 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:15.795+0000 7f895aef4700 1 -- 172.21.15.46:0/4227970466 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f895415ac70 con 0x7f895406d140 2023-07-05T18:57:15.805 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:15.795+0000 7f895aef4700 1 -- 172.21.15.46:0/4227970466 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f89540672e0 con 0x7f895406d140 2023-07-05T18:57:15.805 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:15.796+0000 7f89517fa700 1 -- 172.21.15.46:0/4227970466 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f8948011d30 con 0x7f895406d140 2023-07-05T18:57:15.805 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:15.796+0000 7f89517fa700 1 --2- 172.21.15.46:0/4227970466 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7f893806ace0 0x7f893806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:57:15.805 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:15.797+0000 7f89517fa700 1 -- 172.21.15.46:0/4227970466 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f8948021070 con 0x7f895406d140 2023-07-05T18:57:15.805 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:15.797+0000 7f8953fff700 1 --2- 172.21.15.46:0/4227970466 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7f893806ace0 0x7f893806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:57:15.805 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:15.797+0000 7f8953fff700 1 --2- 172.21.15.46:0/4227970466 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7f893806ace0 0x7f893806d190 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f8940001eb0 tx=0x7f8940001c60 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-05T18:57:15.806 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:15.801+0000 7f89517fa700 1 -- 172.21.15.46:0/4227970466 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f8948056020 con 0x7f895406d140 2023-07-05T18:57:16.003 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:16.000+0000 7f895aef4700 1 -- 172.21.15.46:0/4227970466 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f89540b4920 con 0x7f895406d140 2023-07-05T18:57:16.004 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:16.001+0000 7f89517fa700 1 -- 172.21.15.46:0/4227970466 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v34) v1 ==== 74+0+18246 (secure 0 0 0) 0x7f8948059640 con 0x7f895406d140 2023-07-05T18:57:16.005 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T18:57:16.005 INFO:teuthology.orchestra.run.smithi046.stdout:{"epoch":34,"fsid":"042652d3-d80c-4ad8-9366-3e94f2a0a512","created":"2023-07-05T18:55:56.455710+0000","modified":"2023-07-05T18:57:15.279252+0000","last_up_change":"2023-07-05T18:56:06.594022+0000","last_in_change":"2023-07-05T18:55:58.879340+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-07-05T18:56:07.729620+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2023-07-05T18:56:08.128122+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2023-07-05T18:57:13.640396+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"34","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_data","create_time":"2023-07-05T18:57:14.333267+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"34","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"20009183-9a47-4392-8751-883f88d2bfb1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6813","nonce":4151971443},{"type":"v1","addr":"172.21.15.46:6815","nonce":4151971443}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6817","nonce":4151971443},{"type":"v1","addr":"172.21.15.46:6818","nonce":4151971443}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6822","nonce":4151971443},{"type":"v1","addr":"172.21.15.46:6823","nonce":4151971443}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6820","nonce":4151971443},{"type":"v1","addr":"172.21.15.46:6821","nonce":4151971443}]},"public_addr":"172.21.15.46:6815/4151971443","cluster_addr":"172.21.15.46:6818/4151971443","heartbeat_back_addr":"172.21.15.46:6823/4151971443","heartbeat_front_addr":"172.21.15.46:6821/4151971443","state":["exists","up"]},{"osd":1,"uuid":"91b4a7b0-e4e4-4888-a1fe-9edb0d68004c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6808","nonce":502575881},{"type":"v1","addr":"172.21.15.46:6809","nonce":502575881}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6810","nonce":502575881},{"type":"v1","addr":"172.21.15.46:6811","nonce":502575881}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6816","nonce":502575881},{"type":"v1","addr":"172.21.15.46:6819","nonce":502575881}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6812","nonce":502575881},{"type":"v1","addr":"172.21.15.46:6814","nonce":502575881}]},"public_addr":"172.21.15.46:6809/502575881","cluster_addr":"172.21.15.46:6811/502575881","heartbeat_back_addr":"172.21.15.46:6819/502575881","heartbeat_front_addr":"172.21.15.46:6814/502575881","state":["exists","up"]},{"osd":2,"uuid":"669ff744-1331-47c5-8579-0440731c889a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6800","nonce":2115251461},{"type":"v1","addr":"172.21.15.46:6801","nonce":2115251461}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6802","nonce":2115251461},{"type":"v1","addr":"172.21.15.46:6803","nonce":2115251461}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6806","nonce":2115251461},{"type":"v1","addr":"172.21.15.46:6807","nonce":2115251461}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6804","nonce":2115251461},{"type":"v1","addr":"172.21.15.46:6805","nonce":2115251461}]},"public_addr":"172.21.15.46:6801/2115251461","cluster_addr":"172.21.15.46:6803/2115251461","heartbeat_back_addr":"172.21.15.46:6807/2115251461","heartbeat_front_addr":"172.21.15.46:6805/2115251461","state":["exists","up"]},{"osd":3,"uuid":"34e1b86d-ffad-415d-861c-07a5f08068a6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6824","nonce":2981388766},{"type":"v1","addr":"172.21.15.46:6825","nonce":2981388766}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6826","nonce":2981388766},{"type":"v1","addr":"172.21.15.46:6827","nonce":2981388766}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6830","nonce":2981388766},{"type":"v1","addr":"172.21.15.46:6831","nonce":2981388766}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6828","nonce":2981388766},{"type":"v1","addr":"172.21.15.46:6829","nonce":2981388766}]},"public_addr":"172.21.15.46:6825/2981388766","cluster_addr":"172.21.15.46:6827/2981388766","heartbeat_back_addr":"172.21.15.46:6831/2981388766","heartbeat_front_addr":"172.21.15.46:6829/2981388766","state":["exists","up"]},{"osd":4,"uuid":"57ffcb91-c7dc-4a69-ae71-4d9622a14a05","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6800","nonce":2083655348},{"type":"v1","addr":"172.21.15.73:6801","nonce":2083655348}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6802","nonce":2083655348},{"type":"v1","addr":"172.21.15.73:6803","nonce":2083655348}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6806","nonce":2083655348},{"type":"v1","addr":"172.21.15.73:6807","nonce":2083655348}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6804","nonce":2083655348},{"type":"v1","addr":"172.21.15.73:6805","nonce":2083655348}]},"public_addr":"172.21.15.73:6801/2083655348","cluster_addr":"172.21.15.73:6803/2083655348","heartbeat_back_addr":"172.21.15.73:6807/2083655348","heartbeat_front_addr":"172.21.15.73:6805/2083655348","state":["exists","up"]},{"osd":5,"uuid":"665f41c9-ee20-49cf-bf0e-fbe0c03d3aed","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6824","nonce":2803788401},{"type":"v1","addr":"172.21.15.73:6825","nonce":2803788401}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6826","nonce":2803788401},{"type":"v1","addr":"172.21.15.73:6827","nonce":2803788401}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6830","nonce":2803788401},{"type":"v1","addr":"172.21.15.73:6831","nonce":2803788401}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6828","nonce":2803788401},{"type":"v1","addr":"172.21.15.73:6829","nonce":2803788401}]},"public_addr":"172.21.15.73:6825/2803788401","cluster_addr":"172.21.15.73:6827/2803788401","heartbeat_back_addr":"172.21.15.73:6831/2803788401","heartbeat_front_addr":"172.21.15.73:6829/2803788401","state":["exists","up"]},{"osd":6,"uuid":"5790c6cc-bd56-4ce4-9a7c-0f0c3b59215c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6808","nonce":974108383},{"type":"v1","addr":"172.21.15.73:6809","nonce":974108383}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6810","nonce":974108383},{"type":"v1","addr":"172.21.15.73:6811","nonce":974108383}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6815","nonce":974108383},{"type":"v1","addr":"172.21.15.73:6817","nonce":974108383}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6812","nonce":974108383},{"type":"v1","addr":"172.21.15.73:6813","nonce":974108383}]},"public_addr":"172.21.15.73:6809/974108383","cluster_addr":"172.21.15.73:6811/974108383","heartbeat_back_addr":"172.21.15.73:6817/974108383","heartbeat_front_addr":"172.21.15.73:6813/974108383","state":["exists","up"]},{"osd":7,"uuid":"b66f4d2e-147e-4c9b-97dd-cbd59d33802e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6814","nonce":3772673248},{"type":"v1","addr":"172.21.15.73:6816","nonce":3772673248}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6818","nonce":3772673248},{"type":"v1","addr":"172.21.15.73:6819","nonce":3772673248}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6822","nonce":3772673248},{"type":"v1","addr":"172.21.15.73:6823","nonce":3772673248}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6820","nonce":3772673248},{"type":"v1","addr":"172.21.15.73:6821","nonce":3772673248}]},"public_addr":"172.21.15.73:6816/3772673248","cluster_addr":"172.21.15.73:6819/3772673248","heartbeat_back_addr":"172.21.15.73:6823/3772673248","heartbeat_front_addr":"172.21.15.73:6821/3772673248","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-05T18:56:04.115334+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-05T18:56:04.071250+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-05T18:56:04.044387+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-05T18:56:04.085389+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-05T18:56:04.090726+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-05T18:56:04.074529+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-05T18:56:04.058841+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-05T18:56:04.043054+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-05T18:57:16.009 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:16.003+0000 7f895aef4700 1 -- 172.21.15.46:0/4227970466 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7f893806ace0 msgr2=0x7f893806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:57:16.010 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:16.003+0000 7f895aef4700 1 --2- 172.21.15.46:0/4227970466 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7f893806ace0 0x7f893806d190 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f8940001eb0 tx=0x7f8940001c60 comp rx=0 tx=0).stop 2023-07-05T18:57:16.011 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:16.003+0000 7f895aef4700 1 -- 172.21.15.46:0/4227970466 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f895406d140 msgr2=0x7f8954156a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:57:16.011 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:16.003+0000 7f895aef4700 1 --2- 172.21.15.46:0/4227970466 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f895406d140 0x7f8954156a50 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f894800a010 tx=0x7f8948004750 comp rx=0 tx=0).stop 2023-07-05T18:57:16.011 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:16.004+0000 7f895aef4700 1 -- 172.21.15.46:0/4227970466 shutdown_connections 2023-07-05T18:57:16.012 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:16.004+0000 7f895aef4700 1 --2- 172.21.15.46:0/4227970466 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7f893806ace0 0x7f893806d190 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:57:16.012 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:16.004+0000 7f895aef4700 1 --2- 172.21.15.46:0/4227970466 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f8954142480 0x7f89541f0f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:57:16.012 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:16.004+0000 7f895aef4700 1 --2- 172.21.15.46:0/4227970466 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f895406d140 0x7f8954156a50 unknown :-1 s=CLOSED pgs=371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:57:16.012 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:16.004+0000 7f895aef4700 1 --2- 172.21.15.46:0/4227970466 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f895413f4c0 0x7f895415d020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:57:16.013 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:16.004+0000 7f895aef4700 1 -- 172.21.15.46:0/4227970466 >> 172.21.15.46:0/4227970466 conn(0x7f895406af10 msgr2=0x7f89541575c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-05T18:57:16.013 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:16.004+0000 7f895aef4700 1 -- 172.21.15.46:0/4227970466 shutdown_connections 2023-07-05T18:57:16.013 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:16.004+0000 7f895aef4700 1 -- 172.21.15.46:0/4227970466 wait complete. 2023-07-05T18:57:16.018 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-07-05T18:57:16.147 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:16.145+0000 7fdd0120e700 1 Processor -- start 2023-07-05T18:57:16.147 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:16.145+0000 7fdd0120e700 1 -- start start 2023-07-05T18:57:16.151 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:16.146+0000 7fdd0120e700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fdcfc0b1d50 0x7fdcfc0cf410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:57:16.151 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:16.146+0000 7fdd0120e700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fdcfc13f670 0x7fdcfc06c7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:57:16.152 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:16.146+0000 7fdd0120e700 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdcfc15ce00 con 0x7fdcfc13f2a0 2023-07-05T18:57:16.152 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:16.146+0000 7fdd0120e700 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdcfc15d0e0 con 0x7fdcfc13f670 2023-07-05T18:57:16.153 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:16.146+0000 7fdd0120e700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdcfc15d3c0 con 0x7fdcfc0b1d50 2023-07-05T18:57:16.154 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:16.146+0000 7fdcfb59e700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fdcfc13f670 0x7fdcfc06c7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:57:16.154 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:16.146+0000 7fdcfb59e700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fdcfc13f670 0x7fdcfc06c7e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:59836/0 (socket says 172.21.15.46:59836) 2023-07-05T18:57:16.154 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:16.146+0000 7fdcfb59e700 1 -- 172.21.15.46:0/2026078461 learned_addr learned my addr 172.21.15.46:0/2026078461 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-07-05T18:57:16.154 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:16.146+0000 7fdcfa59c700 1 --2- 172.21.15.46:0/2026078461 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fdcfc0b1d50 0x7fdcfc0cf410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:57:16.154 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:16.146+0000 7fdcfb59e700 1 -- 172.21.15.46:0/2026078461 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fdcfc0b1d50 msgr2=0x7fdcfc0cf410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-05T18:57:16.154 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:16.146+0000 7fdcfb59e700 1 --2- 172.21.15.46:0/2026078461 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fdcfc0b1d50 0x7fdcfc0cf410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:57:16.155 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:16.146+0000 7fdcfb59e700 1 -- 172.21.15.46:0/2026078461 >> v1:172.21.15.73:6789/0 conn(0x7fdcfc13f2a0 legacy=0x7fdcfc0b1640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:57:16.155 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:16.146+0000 7fdcfb59e700 1 -- 172.21.15.46:0/2026078461 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdcfc15d6a0 con 0x7fdcfc13f670 2023-07-05T18:57:16.155 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:16.146+0000 7fdcfa59c700 1 --2- 172.21.15.46:0/2026078461 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fdcfc0b1d50 0x7fdcfc0cf410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-05T18:57:16.155 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:16.146+0000 7fdcfb59e700 1 --2- 172.21.15.46:0/2026078461 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fdcfc13f670 0x7fdcfc06c7e0 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7fdcf400d150 tx=0x7fdcf400d460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e6f10f649c929f93 server_cookie=0 in_seq=0 out_seq=0 2023-07-05T18:57:16.155 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:16.147+0000 7fdcf9d9b700 1 -- 172.21.15.46:0/2026078461 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdcf4010070 con 0x7fdcfc13f670 2023-07-05T18:57:16.155 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:16.147+0000 7fdcf9d9b700 1 -- 172.21.15.46:0/2026078461 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdcf400ddc0 con 0x7fdcfc13f670 2023-07-05T18:57:16.156 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:16.147+0000 7fdcf9d9b700 1 -- 172.21.15.46:0/2026078461 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdcf400b310 con 0x7fdcfc13f670 2023-07-05T18:57:16.156 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:16.147+0000 7fdd0120e700 1 -- 172.21.15.46:0/2026078461 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fdcfc13f670 msgr2=0x7fdcfc06c7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:57:16.156 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:16.147+0000 7fdd0120e700 1 --2- 172.21.15.46:0/2026078461 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fdcfc13f670 0x7fdcfc06c7e0 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7fdcf400d150 tx=0x7fdcf400d460 comp rx=0 tx=0).stop 2023-07-05T18:57:16.156 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:16.147+0000 7fdd0120e700 1 -- 172.21.15.46:0/2026078461 shutdown_connections 2023-07-05T18:57:16.156 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:16.147+0000 7fdd0120e700 1 --2- 172.21.15.46:0/2026078461 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fdcfc13f670 0x7fdcfc06c7e0 unknown :-1 s=CLOSED pgs=372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:57:16.156 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:16.147+0000 7fdd0120e700 1 --2- 172.21.15.46:0/2026078461 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fdcfc0b1d50 0x7fdcfc0cf410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:57:16.156 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:16.147+0000 7fdd0120e700 1 -- 172.21.15.46:0/2026078461 >> 172.21.15.46:0/2026078461 conn(0x7fdcfc0cf980 msgr2=0x7fdcfc0cfd50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-05T18:57:16.156 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:16.147+0000 7fdd0120e700 1 -- 172.21.15.46:0/2026078461 shutdown_connections 2023-07-05T18:57:16.157 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:16.147+0000 7fdd0120e700 1 -- 172.21.15.46:0/2026078461 wait complete. 2023-07-05T18:57:16.157 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:16.149+0000 7fdd0120e700 1 Processor -- start 2023-07-05T18:57:16.157 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:16.149+0000 7fdd0120e700 1 -- start start 2023-07-05T18:57:16.159 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:16.150+0000 7fdd0120e700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fdcfc0b1d50 0x7fdcfc13df20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:57:16.159 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:16.150+0000 7fdd0120e700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fdcfc13f2a0 0x7fdcfc0b33c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:57:16.159 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:16.150+0000 7fdd0120e700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fdcfc13f670 0x7fdcfc1e3ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:57:16.160 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:16.150+0000 7fdd0120e700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdcfc155c20 con 0x7fdcfc0b1d50 2023-07-05T18:57:16.160 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:16.150+0000 7fdd0120e700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdcfc0b4980 con 0x7fdcfc13f670 2023-07-05T18:57:16.160 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:16.150+0000 7fdd0120e700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdcfc0b4f90 con 0x7fdcfc13f2a0 2023-07-05T18:57:16.160 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:16.150+0000 7fdcfad9d700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fdcfc0b1d50 0x7fdcfc13df20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:57:16.160 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:16.150+0000 7fdcfad9d700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fdcfc0b1d50 0x7fdcfc13df20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:59838/0 (socket says 172.21.15.46:59838) 2023-07-05T18:57:16.160 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:16.150+0000 7fdcfad9d700 1 -- 172.21.15.46:0/1728963620 learned_addr learned my addr 172.21.15.46:0/1728963620 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-07-05T18:57:16.161 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:16.150+0000 7fdcfa59c700 1 --2- 172.21.15.46:0/1728963620 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fdcfc13f2a0 0x7fdcfc0b33c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:57:16.161 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:16.150+0000 7fdcfb59e700 1 --2- 172.21.15.46:0/1728963620 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fdcfc13f670 0x7fdcfc1e3ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:57:16.161 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:16.151+0000 7fdcfad9d700 1 -- 172.21.15.46:0/1728963620 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fdcfc13f2a0 msgr2=0x7fdcfc0b33c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:57:16.162 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:16.151+0000 7fdcfad9d700 1 --2- 172.21.15.46:0/1728963620 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fdcfc13f2a0 0x7fdcfc0b33c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:57:16.162 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:16.151+0000 7fdcfad9d700 1 -- 172.21.15.46:0/1728963620 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fdcfc13f670 msgr2=0x7fdcfc1e3ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:57:16.162 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:16.151+0000 7fdcfad9d700 1 --2- 172.21.15.46:0/1728963620 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fdcfc13f670 0x7fdcfc1e3ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:57:16.162 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:16.151+0000 7fdcfad9d700 1 -- 172.21.15.46:0/1728963620 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdcf400bd40 con 0x7fdcfc0b1d50 2023-07-05T18:57:16.162 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:16.151+0000 7fdcfb59e700 1 --2- 172.21.15.46:0/1728963620 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fdcfc13f670 0x7fdcfc1e3ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-05T18:57:16.162 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:16.151+0000 7fdcfad9d700 1 --2- 172.21.15.46:0/1728963620 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fdcfc0b1d50 0x7fdcfc13df20 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7fdcec00c4e0 tx=0x7fdcec00c7f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-05T18:57:16.162 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:16.151+0000 7fdcf37fe700 1 -- 172.21.15.46:0/1728963620 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdcec0052d0 con 0x7fdcfc0b1d50 2023-07-05T18:57:16.162 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:16.151+0000 7fdcf37fe700 1 -- 172.21.15.46:0/1728963620 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdcec005430 con 0x7fdcfc0b1d50 2023-07-05T18:57:16.163 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:16.151+0000 7fdd0120e700 1 -- 172.21.15.46:0/1728963620 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdcfc13e460 con 0x7fdcfc0b1d50 2023-07-05T18:57:16.163 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:16.151+0000 7fdcf37fe700 1 -- 172.21.15.46:0/1728963620 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdcec0038c0 con 0x7fdcfc0b1d50 2023-07-05T18:57:16.163 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:16.151+0000 7fdd0120e700 1 -- 172.21.15.46:0/1728963620 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdcfc155560 con 0x7fdcfc0b1d50 2023-07-05T18:57:16.164 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:16.152+0000 7fdd0120e700 1 -- 172.21.15.46:0/1728963620 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdcfc06f180 con 0x7fdcfc0b1d50 2023-07-05T18:57:16.164 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:16.152+0000 7fdcf37fe700 1 -- 172.21.15.46:0/1728963620 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fdcec003a20 con 0x7fdcfc0b1d50 2023-07-05T18:57:16.164 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:16.153+0000 7fdcf37fe700 1 --2- 172.21.15.46:0/1728963620 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7fdcdc06ace0 0x7fdcdc06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:57:16.164 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:16.153+0000 7fdcf37fe700 1 -- 172.21.15.46:0/1728963620 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fdcec0887e0 con 0x7fdcfc0b1d50 2023-07-05T18:57:16.165 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:16.153+0000 7fdcfa59c700 1 --2- 172.21.15.46:0/1728963620 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7fdcdc06ace0 0x7fdcdc06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:57:16.165 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:16.154+0000 7fdcfa59c700 1 --2- 172.21.15.46:0/1728963620 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7fdcdc06ace0 0x7fdcdc06d190 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7fdcfc0b1b50 tx=0x7fdce4008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-05T18:57:16.165 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:16.158+0000 7fdcf37fe700 1 -- 172.21.15.46:0/1728963620 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fdcec053920 con 0x7fdcfc0b1d50 2023-07-05T18:57:16.404 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:16.402+0000 7fdd0120e700 1 -- 172.21.15.46:0/1728963620 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7fdcfc142080 con 0x7fdcfc0b1d50 2023-07-05T18:57:17.289 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:17.287+0000 7fdcf37fe700 1 -- 172.21.15.46:0/1728963620 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v14) v1 ==== 118+0+0 (secure 0 0 0) 0x7fdcec056f40 con 0x7fdcfc0b1d50 2023-07-05T18:57:17.298 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:17.290+0000 7fdd0120e700 1 -- 172.21.15.46:0/1728963620 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7fdcdc06ace0 msgr2=0x7fdcdc06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:57:17.298 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:17.290+0000 7fdd0120e700 1 --2- 172.21.15.46:0/1728963620 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7fdcdc06ace0 0x7fdcdc06d190 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7fdcfc0b1b50 tx=0x7fdce4008040 comp rx=0 tx=0).stop 2023-07-05T18:57:17.298 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:17.290+0000 7fdd0120e700 1 -- 172.21.15.46:0/1728963620 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fdcfc0b1d50 msgr2=0x7fdcfc13df20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:57:17.298 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:17.290+0000 7fdd0120e700 1 --2- 172.21.15.46:0/1728963620 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fdcfc0b1d50 0x7fdcfc13df20 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7fdcec00c4e0 tx=0x7fdcec00c7f0 comp rx=0 tx=0).stop 2023-07-05T18:57:17.299 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:17.291+0000 7fdd0120e700 1 -- 172.21.15.46:0/1728963620 shutdown_connections 2023-07-05T18:57:17.299 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:17.291+0000 7fdd0120e700 1 --2- 172.21.15.46:0/1728963620 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7fdcdc06ace0 0x7fdcdc06d190 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:57:17.299 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:17.291+0000 7fdd0120e700 1 --2- 172.21.15.46:0/1728963620 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fdcfc13f670 0x7fdcfc1e3ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:57:17.299 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:17.291+0000 7fdd0120e700 1 --2- 172.21.15.46:0/1728963620 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fdcfc0b1d50 0x7fdcfc13df20 unknown :-1 s=CLOSED pgs=373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:57:17.299 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:17.291+0000 7fdd0120e700 1 --2- 172.21.15.46:0/1728963620 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fdcfc13f2a0 0x7fdcfc0b33c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:57:17.299 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:17.291+0000 7fdd0120e700 1 -- 172.21.15.46:0/1728963620 >> 172.21.15.46:0/1728963620 conn(0x7fdcfc0cf980 msgr2=0x7fdcfc0cda60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-05T18:57:17.299 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:17.291+0000 7fdd0120e700 1 -- 172.21.15.46:0/1728963620 shutdown_connections 2023-07-05T18:57:17.300 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:17.291+0000 7fdd0120e700 1 -- 172.21.15.46:0/1728963620 wait complete. 2023-07-05T18:57:17.307 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2023-07-05T18:57:17.308 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-07-05T18:57:17.448 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:17.443+0000 7fbd29030700 1 Processor -- start 2023-07-05T18:57:17.449 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:17.443+0000 7fbd29030700 1 -- start start 2023-07-05T18:57:17.449 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:17.444+0000 7fbd29030700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fbd241594f0 0x7fbd240cd690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:57:17.449 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:17.444+0000 7fbd29030700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fbd240cdbd0 0x7fbd240b13f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:57:17.449 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:17.444+0000 7fbd29030700 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbd2415e040 con 0x7fbd240b1930 2023-07-05T18:57:17.449 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:17.444+0000 7fbd29030700 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbd240ce200 con 0x7fbd240cdbd0 2023-07-05T18:57:17.449 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:17.444+0000 7fbd29030700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbd2415dbb0 con 0x7fbd241594f0 2023-07-05T18:57:17.449 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:17.444+0000 7fbd2259c700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fbd240cdbd0 0x7fbd240b13f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:57:17.450 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:17.444+0000 7fbd2259c700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fbd240cdbd0 0x7fbd240b13f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:59846/0 (socket says 172.21.15.46:59846) 2023-07-05T18:57:17.450 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:17.444+0000 7fbd2259c700 1 -- 172.21.15.46:0/1934291804 learned_addr learned my addr 172.21.15.46:0/1934291804 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-07-05T18:57:17.450 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:17.444+0000 7fbd22d9d700 1 --2- 172.21.15.46:0/1934291804 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fbd241594f0 0x7fbd240cd690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:57:17.450 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:17.444+0000 7fbd2259c700 1 -- 172.21.15.46:0/1934291804 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fbd241594f0 msgr2=0x7fbd240cd690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-05T18:57:17.450 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:17.444+0000 7fbd2259c700 1 --2- 172.21.15.46:0/1934291804 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fbd241594f0 0x7fbd240cd690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:57:17.450 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:17.444+0000 7fbd2259c700 1 -- 172.21.15.46:0/1934291804 >> v1:172.21.15.73:6789/0 conn(0x7fbd240b1930 legacy=0x7fbd24070620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:57:17.450 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:17.444+0000 7fbd2259c700 1 -- 172.21.15.46:0/1934291804 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbd240b1d20 con 0x7fbd240cdbd0 2023-07-05T18:57:17.450 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:17.444+0000 7fbd22d9d700 1 --2- 172.21.15.46:0/1934291804 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fbd241594f0 0x7fbd240cd690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-05T18:57:17.451 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:17.445+0000 7fbd2259c700 1 --2- 172.21.15.46:0/1934291804 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fbd240cdbd0 0x7fbd240b13f0 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7fbd1400bb90 tx=0x7fbd1400bea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=164d87ed1ef7ea09 server_cookie=0 in_seq=0 out_seq=0 2023-07-05T18:57:17.451 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:17.445+0000 7fbd21d9b700 1 -- 172.21.15.46:0/1934291804 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd1400dd50 con 0x7fbd240cdbd0 2023-07-05T18:57:17.451 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:17.445+0000 7fbd21d9b700 1 -- 172.21.15.46:0/1934291804 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbd14010470 con 0x7fbd240cdbd0 2023-07-05T18:57:17.451 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:17.445+0000 7fbd21d9b700 1 -- 172.21.15.46:0/1934291804 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd14010800 con 0x7fbd240cdbd0 2023-07-05T18:57:17.451 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:17.445+0000 7fbd29030700 1 -- 172.21.15.46:0/1934291804 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fbd240cdbd0 msgr2=0x7fbd240b13f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:57:17.451 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:17.445+0000 7fbd29030700 1 --2- 172.21.15.46:0/1934291804 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fbd240cdbd0 0x7fbd240b13f0 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7fbd1400bb90 tx=0x7fbd1400bea0 comp rx=0 tx=0).stop 2023-07-05T18:57:17.451 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:17.445+0000 7fbd29030700 1 -- 172.21.15.46:0/1934291804 shutdown_connections 2023-07-05T18:57:17.451 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:17.445+0000 7fbd29030700 1 --2- 172.21.15.46:0/1934291804 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fbd241594f0 0x7fbd240cd690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:57:17.452 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:17.445+0000 7fbd29030700 1 --2- 172.21.15.46:0/1934291804 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fbd240cdbd0 0x7fbd240b13f0 unknown :-1 s=CLOSED pgs=374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:57:17.452 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:17.445+0000 7fbd29030700 1 -- 172.21.15.46:0/1934291804 >> 172.21.15.46:0/1934291804 conn(0x7fbd2406bba0 msgr2=0x7fbd240cc3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-05T18:57:17.452 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:17.445+0000 7fbd29030700 1 -- 172.21.15.46:0/1934291804 shutdown_connections 2023-07-05T18:57:17.452 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:17.445+0000 7fbd29030700 1 -- 172.21.15.46:0/1934291804 wait complete. 2023-07-05T18:57:17.455 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:17.447+0000 7fbd29030700 1 Processor -- start 2023-07-05T18:57:17.455 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:17.447+0000 7fbd29030700 1 -- start start 2023-07-05T18:57:17.455 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:17.448+0000 7fbd29030700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fbd240b1930 0x7fbd241497e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:57:17.455 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:17.448+0000 7fbd29030700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fbd240cdbd0 0x7fbd240b4070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:57:17.455 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:17.448+0000 7fbd29030700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fbd241594f0 0x7fbd240b4e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:57:17.455 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:17.448+0000 7fbd29030700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd240b45b0 con 0x7fbd240cdbd0 2023-07-05T18:57:17.456 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:17.448+0000 7fbd29030700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd241468e0 con 0x7fbd241594f0 2023-07-05T18:57:17.456 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:17.448+0000 7fbd29030700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbd240b53d0 con 0x7fbd240b1930 2023-07-05T18:57:17.456 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:17.448+0000 7fbd2259c700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fbd240cdbd0 0x7fbd240b4070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:57:17.457 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:17.448+0000 7fbd2259c700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fbd240cdbd0 0x7fbd240b4070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:59852/0 (socket says 172.21.15.46:59852) 2023-07-05T18:57:17.457 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:17.448+0000 7fbd2259c700 1 -- 172.21.15.46:0/578578100 learned_addr learned my addr 172.21.15.46:0/578578100 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-07-05T18:57:17.457 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:17.448+0000 7fbd22d9d700 1 --2- 172.21.15.46:0/578578100 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fbd240b1930 0x7fbd241497e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:57:17.457 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:17.448+0000 7fbd2259c700 1 -- 172.21.15.46:0/578578100 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fbd240b1930 msgr2=0x7fbd241497e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:57:17.457 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:17.448+0000 7fbd2359e700 1 --2- 172.21.15.46:0/578578100 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fbd241594f0 0x7fbd240b4e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:57:17.457 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:17.448+0000 7fbd2259c700 1 --2- 172.21.15.46:0/578578100 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fbd240b1930 0x7fbd241497e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:57:17.457 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:17.448+0000 7fbd2259c700 1 -- 172.21.15.46:0/578578100 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fbd241594f0 msgr2=0x7fbd240b4e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:57:17.458 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:17.448+0000 7fbd2259c700 1 --2- 172.21.15.46:0/578578100 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fbd241594f0 0x7fbd240b4e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:57:17.458 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:17.448+0000 7fbd2259c700 1 -- 172.21.15.46:0/578578100 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbd1400b7f0 con 0x7fbd240cdbd0 2023-07-05T18:57:17.458 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:17.448+0000 7fbd22d9d700 1 --2- 172.21.15.46:0/578578100 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fbd240b1930 0x7fbd241497e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-05T18:57:17.458 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:17.448+0000 7fbd2359e700 1 --2- 172.21.15.46:0/578578100 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fbd241594f0 0x7fbd240b4e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-05T18:57:17.458 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:17.448+0000 7fbd2259c700 1 --2- 172.21.15.46:0/578578100 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fbd240cdbd0 0x7fbd240b4070 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7fbd1400bee0 tx=0x7fbd14004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-05T18:57:17.458 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:17.448+0000 7fbd0b7fe700 1 -- 172.21.15.46:0/578578100 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd14003c30 con 0x7fbd240cdbd0 2023-07-05T18:57:17.458 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:17.448+0000 7fbd0b7fe700 1 -- 172.21.15.46:0/578578100 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbd14003d90 con 0x7fbd240cdbd0 2023-07-05T18:57:17.458 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:17.448+0000 7fbd29030700 1 -- 172.21.15.46:0/578578100 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbd240b5670 con 0x7fbd240cdbd0 2023-07-05T18:57:17.459 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:17.448+0000 7fbd0b7fe700 1 -- 172.21.15.46:0/578578100 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd14010820 con 0x7fbd240cdbd0 2023-07-05T18:57:17.459 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:17.448+0000 7fbd29030700 1 -- 172.21.15.46:0/578578100 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbd24146f80 con 0x7fbd240cdbd0 2023-07-05T18:57:17.459 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:17.449+0000 7fbd29030700 1 -- 172.21.15.46:0/578578100 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbd240672e0 con 0x7fbd240cdbd0 2023-07-05T18:57:17.459 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:17.450+0000 7fbd0b7fe700 1 -- 172.21.15.46:0/578578100 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fbd14019400 con 0x7fbd240cdbd0 2023-07-05T18:57:17.459 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:17.450+0000 7fbd0b7fe700 1 --2- 172.21.15.46:0/578578100 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7fbd1006ace0 0x7fbd1006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:57:17.459 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:17.450+0000 7fbd0b7fe700 1 -- 172.21.15.46:0/578578100 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fbd1408a620 con 0x7fbd240cdbd0 2023-07-05T18:57:17.459 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:17.450+0000 7fbd22d9d700 1 --2- 172.21.15.46:0/578578100 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7fbd1006ace0 0x7fbd1006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:57:17.459 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:17.451+0000 7fbd22d9d700 1 --2- 172.21.15.46:0/578578100 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7fbd1006ace0 0x7fbd1006d190 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7fbd180089b0 tx=0x7fbd18008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-05T18:57:17.460 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:17.455+0000 7fbd0b7fe700 1 -- 172.21.15.46:0/578578100 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fbd14055810 con 0x7fbd240cdbd0 2023-07-05T18:57:17.703 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:17.700+0000 7fbd29030700 1 -- 172.21.15.46:0/578578100 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7fbd240cd210 con 0x7fbd240cdbd0 2023-07-05T18:57:18.293 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:18.291+0000 7fbd0b7fe700 1 -- 172.21.15.46:0/578578100 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v15) v1 ==== 122+0+0 (secure 0 0 0) 0x7fbd14058e30 con 0x7fbd240cdbd0 2023-07-05T18:57:18.295 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:18.293+0000 7fbd29030700 1 -- 172.21.15.46:0/578578100 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7fbd1006ace0 msgr2=0x7fbd1006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:57:18.296 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:18.293+0000 7fbd29030700 1 --2- 172.21.15.46:0/578578100 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7fbd1006ace0 0x7fbd1006d190 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7fbd180089b0 tx=0x7fbd18008040 comp rx=0 tx=0).stop 2023-07-05T18:57:18.296 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:18.293+0000 7fbd29030700 1 -- 172.21.15.46:0/578578100 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fbd240cdbd0 msgr2=0x7fbd240b4070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:57:18.296 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:18.293+0000 7fbd29030700 1 --2- 172.21.15.46:0/578578100 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fbd240cdbd0 0x7fbd240b4070 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7fbd1400bee0 tx=0x7fbd14004750 comp rx=0 tx=0).stop 2023-07-05T18:57:18.296 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:18.294+0000 7fbd29030700 1 -- 172.21.15.46:0/578578100 shutdown_connections 2023-07-05T18:57:18.297 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:18.294+0000 7fbd29030700 1 --2- 172.21.15.46:0/578578100 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7fbd1006ace0 0x7fbd1006d190 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:57:18.297 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:18.294+0000 7fbd29030700 1 --2- 172.21.15.46:0/578578100 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fbd241594f0 0x7fbd240b4e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:57:18.297 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:18.294+0000 7fbd29030700 1 --2- 172.21.15.46:0/578578100 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fbd240b1930 0x7fbd241497e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:57:18.297 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:18.294+0000 7fbd29030700 1 --2- 172.21.15.46:0/578578100 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fbd240cdbd0 0x7fbd240b4070 unknown :-1 s=CLOSED pgs=375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:57:18.297 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:18.294+0000 7fbd29030700 1 -- 172.21.15.46:0/578578100 >> 172.21.15.46:0/578578100 conn(0x7fbd2406bba0 msgr2=0x7fbd240cf750 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-05T18:57:18.297 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:18.294+0000 7fbd29030700 1 -- 172.21.15.46:0/578578100 shutdown_connections 2023-07-05T18:57:18.298 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:18.294+0000 7fbd29030700 1 -- 172.21.15.46:0/578578100 wait complete. 2023-07-05T18:57:18.310 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2023-07-05T18:57:18.311 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-05T18:57:18.440 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:18.439+0000 7f234138d700 1 Processor -- start 2023-07-05T18:57:18.441 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:18.439+0000 7f234138d700 1 -- start start 2023-07-05T18:57:18.443 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:18.439+0000 7f234138d700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f233c0cd2e0 0x7f233c0d1450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:57:18.443 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:18.439+0000 7f234138d700 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f233c0cd8c0 con 0x7f233c15c6c0 2023-07-05T18:57:18.443 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:18.439+0000 7f234138d700 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f233c0d0990 con 0x7f233c15c2f0 2023-07-05T18:57:18.443 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:18.439+0000 7f234138d700 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f233c0d0c70 con 0x7f233c0cd2e0 2023-07-05T18:57:18.443 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:18.440+0000 7f233b7fe700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f233c0cd2e0 0x7f233c0d1450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:57:18.443 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:18.440+0000 7f233a7fc700 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7f233c15c6c0 0x7f233c0b5ae0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:59132/0 (socket says 172.21.15.46:59132) 2023-07-05T18:57:18.443 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:18.440+0000 7f233b7fe700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f233c0cd2e0 0x7f233c0d1450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:59862/0 (socket says 172.21.15.46:59862) 2023-07-05T18:57:18.444 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:18.440+0000 7f233a7fc700 1 -- 172.21.15.46:0/1637928401 learned_addr learned my addr 172.21.15.46:0/1637928401 (peer_addr_for_me v1:172.21.15.46:0/0) 2023-07-05T18:57:18.444 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:18.440+0000 7f233b7fe700 1 -- 172.21.15.46:0/1637928401 >> v1:172.21.15.73:6789/0 conn(0x7f233c15c2f0 legacy=0x7f233c06c760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-05T18:57:18.444 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:18.440+0000 7f233b7fe700 1 -- 172.21.15.46:0/1637928401 >> v1:172.21.15.46:6789/0 conn(0x7f233c15c6c0 legacy=0x7f233c0b5ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:57:18.444 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:18.440+0000 7f233b7fe700 1 -- 172.21.15.46:0/1637928401 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f233c0d0f50 con 0x7f233c0cd2e0 2023-07-05T18:57:18.444 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:18.440+0000 7f2339ffb700 1 -- 172.21.15.46:0/1637928401 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1790400490 0 0) 0x7f233c0cd8c0 con 0x7f233c15c6c0 2023-07-05T18:57:18.444 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:18.440+0000 7f233b7fe700 1 --2- 172.21.15.46:0/1637928401 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f233c0cd2e0 0x7f233c0d1450 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f2334009d90 tx=0x7f233400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cb58510ef9057c68 server_cookie=0 in_seq=0 out_seq=0 2023-07-05T18:57:18.444 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:18.440+0000 7f2339ffb700 1 -- 172.21.15.46:0/1637928401 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f233400e070 con 0x7f233c0cd2e0 2023-07-05T18:57:18.445 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:18.440+0000 7f2339ffb700 1 -- 172.21.15.46:0/1637928401 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f233400bb90 con 0x7f233c0cd2e0 2023-07-05T18:57:18.445 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:18.440+0000 7f2339ffb700 1 -- 172.21.15.46:0/1637928401 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2334003a20 con 0x7f233c0cd2e0 2023-07-05T18:57:18.445 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:18.441+0000 7f234138d700 1 -- 172.21.15.46:0/1637928401 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f233c0cd2e0 msgr2=0x7f233c0d1450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:57:18.445 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:18.441+0000 7f234138d700 1 --2- 172.21.15.46:0/1637928401 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f233c0cd2e0 0x7f233c0d1450 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f2334009d90 tx=0x7f233400b330 comp rx=0 tx=0).stop 2023-07-05T18:57:18.445 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:18.441+0000 7f234138d700 1 -- 172.21.15.46:0/1637928401 shutdown_connections 2023-07-05T18:57:18.445 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:18.441+0000 7f234138d700 1 --2- 172.21.15.46:0/1637928401 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f233c0cd2e0 0x7f233c0d1450 unknown :-1 s=CLOSED pgs=377 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:57:18.445 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:18.441+0000 7f234138d700 1 -- 172.21.15.46:0/1637928401 >> 172.21.15.46:0/1637928401 conn(0x7f233c06afa0 msgr2=0x7f233c0cf710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-05T18:57:18.446 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:18.441+0000 7f234138d700 1 -- 172.21.15.46:0/1637928401 shutdown_connections 2023-07-05T18:57:18.446 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:18.441+0000 7f234138d700 1 -- 172.21.15.46:0/1637928401 wait complete. 2023-07-05T18:57:18.449 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:18.442+0000 7f234138d700 1 Processor -- start 2023-07-05T18:57:18.450 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:18.442+0000 7f234138d700 1 -- start start 2023-07-05T18:57:18.450 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:18.443+0000 7f234138d700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f233c0cd2e0 0x7f233c0cc1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:57:18.450 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:18.443+0000 7f234138d700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f233c15c2f0 0x7f233c0a9f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:57:18.451 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:18.443+0000 7f234138d700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f233c15c6c0 0x7f233c0aa470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:57:18.451 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:18.443+0000 7f234138d700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f233c0c6b10 con 0x7f233c15c6c0 2023-07-05T18:57:18.451 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:18.443+0000 7f234138d700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f233c0c8420 con 0x7f233c0cd2e0 2023-07-05T18:57:18.451 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:18.443+0000 7f234138d700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f233c0ab0d0 con 0x7f233c15c2f0 2023-07-05T18:57:18.451 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:18.443+0000 7f233b7fe700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f233c15c6c0 0x7f233c0aa470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:57:18.452 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:18.443+0000 7f233b7fe700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f233c15c6c0 0x7f233c0aa470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:59868/0 (socket says 172.21.15.46:59868) 2023-07-05T18:57:18.452 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:18.443+0000 7f233b7fe700 1 -- 172.21.15.46:0/4087057847 learned_addr learned my addr 172.21.15.46:0/4087057847 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-07-05T18:57:18.452 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:18.443+0000 7f233affd700 1 --2- 172.21.15.46:0/4087057847 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f233c0cd2e0 0x7f233c0cc1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:57:18.452 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:18.443+0000 7f233b7fe700 1 -- 172.21.15.46:0/4087057847 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f233c15c2f0 msgr2=0x7f233c0a9f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:57:18.452 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:18.443+0000 7f233b7fe700 1 --2- 172.21.15.46:0/4087057847 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f233c15c2f0 0x7f233c0a9f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:57:18.452 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:18.443+0000 7f233b7fe700 1 -- 172.21.15.46:0/4087057847 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f233c0cd2e0 msgr2=0x7f233c0cc1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:57:18.452 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:18.443+0000 7f233b7fe700 1 --2- 172.21.15.46:0/4087057847 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f233c0cd2e0 0x7f233c0cc1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:57:18.452 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:18.443+0000 7f233b7fe700 1 -- 172.21.15.46:0/4087057847 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2334009a70 con 0x7f233c15c6c0 2023-07-05T18:57:18.453 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:18.443+0000 7f233affd700 1 --2- 172.21.15.46:0/4087057847 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f233c0cd2e0 0x7f233c0cc1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-05T18:57:18.453 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:18.444+0000 7f233b7fe700 1 --2- 172.21.15.46:0/4087057847 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f233c15c6c0 0x7f233c0aa470 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f233c06d010 tx=0x7f2334004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-05T18:57:18.453 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:18.444+0000 7f23237fe700 1 -- 172.21.15.46:0/4087057847 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2334012630 con 0x7f233c15c6c0 2023-07-05T18:57:18.456 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:18.444+0000 7f23237fe700 1 -- 172.21.15.46:0/4087057847 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2334012790 con 0x7f233c15c6c0 2023-07-05T18:57:18.456 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:18.444+0000 7f234138d700 1 -- 172.21.15.46:0/4087057847 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f233c0aab10 con 0x7f233c15c6c0 2023-07-05T18:57:18.456 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:18.444+0000 7f23237fe700 1 -- 172.21.15.46:0/4087057847 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2334012b40 con 0x7f233c15c6c0 2023-07-05T18:57:18.457 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:18.444+0000 7f234138d700 1 -- 172.21.15.46:0/4087057847 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f233c0c86c0 con 0x7f233c15c6c0 2023-07-05T18:57:18.457 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:18.445+0000 7f234138d700 1 -- 172.21.15.46:0/4087057847 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f233c0c8280 con 0x7f233c15c6c0 2023-07-05T18:57:18.457 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:18.445+0000 7f23237fe700 1 -- 172.21.15.46:0/4087057847 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f2334012ca0 con 0x7f233c15c6c0 2023-07-05T18:57:18.458 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:18.446+0000 7f23237fe700 1 --2- 172.21.15.46:0/4087057847 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7f232806ace0 0x7f232806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:57:18.458 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:18.446+0000 7f23237fe700 1 -- 172.21.15.46:0/4087057847 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f233408b910 con 0x7f233c15c6c0 2023-07-05T18:57:18.458 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:18.446+0000 7f233affd700 1 --2- 172.21.15.46:0/4087057847 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7f232806ace0 0x7f232806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:57:18.458 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:18.446+0000 7f233affd700 1 --2- 172.21.15.46:0/4087057847 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7f232806ace0 0x7f232806d190 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f233c1f5870 tx=0x7f232c009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-05T18:57:18.459 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:18.450+0000 7f23237fe700 1 -- 172.21.15.46:0/4087057847 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f233c0c8280 con 0x7f233c15c6c0 2023-07-05T18:57:18.544 INFO:tasks.ceph.mds.b.smithi073.stderr:2023-07-05T18:57:18.541+0000 7f1fed654700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-07-05T18:57:18.697 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:18.695+0000 7f234138d700 1 -- 172.21.15.46:0/4087057847 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f233c0c8280 con 0x7f233c15c6c0 2023-07-05T18:57:18.698 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:18.696+0000 7f23237fe700 1 -- 172.21.15.46:0/4087057847 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 15 v15) v1 ==== 94+0+4665 (secure 0 0 0) 0x7f233c0c8280 con 0x7f233c15c6c0 2023-07-05T18:57:18.698 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T18:57:18.698 INFO:teuthology.orchestra.run.smithi046.stdout:{"epoch":15,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4823,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.73:6837/1783526483","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6835","nonce":1783526483},{"type":"v1","addr":"172.21.15.73:6837","nonce":1783526483}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":4826,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.46:6834/1224451753","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6832","nonce":1224451753},{"type":"v1","addr":"172.21.15.46:6834","nonce":1224451753}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":4829,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.46:6835/549881285","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6833","nonce":549881285},{"type":"v1","addr":"172.21.15.46:6835","nonce":549881285}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":15,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-07-05T18:57:15.279563+0000","modified":"2023-07-05T18:57:18.286904+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5086},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5086":{"gid":5086,"name":"b","rank":0,"incarnation":12,"state":"up:active","state_seq":3,"addr":"172.21.15.73:6836/255434995","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6834","nonce":255434995},{"type":"v1","addr":"172.21.15.73:6836","nonce":255434995}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2023-07-05T18:57:18.700 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:18.698+0000 7f234138d700 1 -- 172.21.15.46:0/4087057847 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7f232806ace0 msgr2=0x7f232806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:57:18.700 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:18.698+0000 7f234138d700 1 --2- 172.21.15.46:0/4087057847 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7f232806ace0 0x7f232806d190 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f233c1f5870 tx=0x7f232c009040 comp rx=0 tx=0).stop 2023-07-05T18:57:18.701 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:18.698+0000 7f234138d700 1 -- 172.21.15.46:0/4087057847 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f233c15c6c0 msgr2=0x7f233c0aa470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:57:18.701 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:18.698+0000 7f234138d700 1 --2- 172.21.15.46:0/4087057847 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f233c15c6c0 0x7f233c0aa470 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f233c06d010 tx=0x7f2334004ad0 comp rx=0 tx=0).stop 2023-07-05T18:57:18.701 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:18.698+0000 7f234138d700 1 -- 172.21.15.46:0/4087057847 shutdown_connections 2023-07-05T18:57:18.701 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:18.698+0000 7f234138d700 1 --2- 172.21.15.46:0/4087057847 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7f232806ace0 0x7f232806d190 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:57:18.701 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:18.698+0000 7f234138d700 1 --2- 172.21.15.46:0/4087057847 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f233c15c6c0 0x7f233c0aa470 unknown :-1 s=CLOSED pgs=378 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:57:18.701 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:18.698+0000 7f234138d700 1 --2- 172.21.15.46:0/4087057847 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f233c0cd2e0 0x7f233c0cc1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:57:18.701 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:18.698+0000 7f234138d700 1 --2- 172.21.15.46:0/4087057847 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f233c15c2f0 0x7f233c0a9f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:57:18.702 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:18.698+0000 7f234138d700 1 -- 172.21.15.46:0/4087057847 >> 172.21.15.46:0/4087057847 conn(0x7f233c06afa0 msgr2=0x7f233c15ffa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-05T18:57:18.702 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:18.698+0000 7f234138d700 1 -- 172.21.15.46:0/4087057847 shutdown_connections 2023-07-05T18:57:18.702 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:18.698+0000 7f234138d700 1 -- 172.21.15.46:0/4087057847 wait complete. 2023-07-05T18:57:18.702 INFO:teuthology.orchestra.run.smithi046.stderr:dumped fsmap epoch 15 2023-07-05T18:57:18.712 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-05T18:57:18.838 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:18.835+0000 7fe828f31700 1 Processor -- start 2023-07-05T18:57:18.838 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:18.835+0000 7fe828f31700 1 -- start start 2023-07-05T18:57:18.838 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:18.836+0000 7fe828f31700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fe82415c6d0 0x7fe824071620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:57:18.838 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:18.836+0000 7fe828f31700 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe82406b650 con 0x7fe82415d900 2023-07-05T18:57:18.839 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:18.836+0000 7fe828f31700 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe82415ce20 con 0x7fe82406c5a0 2023-07-05T18:57:18.839 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:18.836+0000 7fe828f31700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe82415d100 con 0x7fe82415c6d0 2023-07-05T18:57:18.843 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:18.836+0000 7fe821d9b700 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7fe82415d900 0x7fe82406be90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:59144/0 (socket says 172.21.15.46:59144) 2023-07-05T18:57:18.843 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:18.836+0000 7fe821d9b700 1 -- 172.21.15.46:0/3658093685 learned_addr learned my addr 172.21.15.46:0/3658093685 (peer_addr_for_me v1:172.21.15.46:0/0) 2023-07-05T18:57:18.844 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:18.836+0000 7fe82259c700 1 --2- 172.21.15.46:0/3658093685 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fe82415c6d0 0x7fe824071620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:57:18.844 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:18.837+0000 7fe82159a700 1 -- 172.21.15.46:0/3658093685 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1251628437 0 0) 0x7fe82406b650 con 0x7fe82415d900 2023-07-05T18:57:18.844 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:18.837+0000 7fe82159a700 1 -- 172.21.15.46:0/3658093685 --> v1:172.21.15.46:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe80c0035b0 con 0x7fe82415d900 2023-07-05T18:57:18.844 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:18.837+0000 7fe82159a700 1 -- 172.21.15.46:0/3658093685 <== mon.1 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3950410978 0 0) 0x7fe82415ce20 con 0x7fe82406c5a0 2023-07-05T18:57:18.845 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:18.837+0000 7fe82159a700 1 -- 172.21.15.46:0/3658093685 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe82406b650 con 0x7fe82406c5a0 2023-07-05T18:57:18.845 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:18.837+0000 7fe82259c700 1 -- 172.21.15.46:0/3658093685 >> v1:172.21.15.73:6789/0 conn(0x7fe82406c5a0 legacy=0x7fe824069e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:57:18.845 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:18.837+0000 7fe82259c700 1 -- 172.21.15.46:0/3658093685 >> v1:172.21.15.46:6789/0 conn(0x7fe82415d900 legacy=0x7fe82406be90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:57:18.845 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:18.837+0000 7fe82259c700 1 -- 172.21.15.46:0/3658093685 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe82415d3e0 con 0x7fe82415c6d0 2023-07-05T18:57:18.845 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:18.837+0000 7fe82259c700 1 --2- 172.21.15.46:0/3658093685 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fe82415c6d0 0x7fe824071620 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fe818009870 tx=0x7fe818009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=37af8964ec0d229d server_cookie=0 in_seq=0 out_seq=0 2023-07-05T18:57:18.845 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:18.837+0000 7fe82159a700 1 -- 172.21.15.46:0/3658093685 <== mon.2 v2:172.21.15.73:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe818011830 con 0x7fe82415c6d0 2023-07-05T18:57:18.846 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:18.837+0000 7fe82159a700 1 -- 172.21.15.46:0/3658093685 <== mon.2 v2:172.21.15.73:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe818011990 con 0x7fe82415c6d0 2023-07-05T18:57:18.846 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:18.837+0000 7fe82159a700 1 -- 172.21.15.46:0/3658093685 <== mon.2 v2:172.21.15.73:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe818011d00 con 0x7fe82415c6d0 2023-07-05T18:57:18.846 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:18.838+0000 7fe828f31700 1 -- 172.21.15.46:0/3658093685 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fe82415c6d0 msgr2=0x7fe824071620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:57:18.846 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:18.838+0000 7fe828f31700 1 --2- 172.21.15.46:0/3658093685 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fe82415c6d0 0x7fe824071620 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fe818009870 tx=0x7fe818009b80 comp rx=0 tx=0).stop 2023-07-05T18:57:18.846 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:18.838+0000 7fe828f31700 1 -- 172.21.15.46:0/3658093685 shutdown_connections 2023-07-05T18:57:18.846 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:18.838+0000 7fe828f31700 1 --2- 172.21.15.46:0/3658093685 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fe82415c6d0 0x7fe824071620 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:57:18.846 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:18.838+0000 7fe828f31700 1 -- 172.21.15.46:0/3658093685 >> 172.21.15.46:0/3658093685 conn(0x7fe8240b0d50 msgr2=0x7fe8240b1150 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-05T18:57:18.847 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:18.838+0000 7fe828f31700 1 -- 172.21.15.46:0/3658093685 shutdown_connections 2023-07-05T18:57:18.847 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:18.838+0000 7fe828f31700 1 -- 172.21.15.46:0/3658093685 wait complete. 2023-07-05T18:57:18.848 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:18.839+0000 7fe828f31700 1 Processor -- start 2023-07-05T18:57:18.848 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:18.839+0000 7fe828f31700 1 -- start start 2023-07-05T18:57:18.848 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:18.840+0000 7fe828f31700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe82406c5a0 0x7fe82414a190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:57:18.849 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:18.840+0000 7fe828f31700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe82415c6d0 0x7fe8241606a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:57:18.849 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:18.840+0000 7fe828f31700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fe82415d900 0x7fe8240af5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:57:18.849 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:18.840+0000 7fe828f31700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe82414a6d0 con 0x7fe82406c5a0 2023-07-05T18:57:18.849 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:18.840+0000 7fe828f31700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe82415ee60 con 0x7fe82415c6d0 2023-07-05T18:57:18.852 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:18.840+0000 7fe828f31700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe82415e2e0 con 0x7fe82415d900 2023-07-05T18:57:18.852 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:18.840+0000 7fe82259c700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe82406c5a0 0x7fe82414a190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:57:18.852 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:18.840+0000 7fe82259c700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe82406c5a0 0x7fe82414a190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:59880/0 (socket says 172.21.15.46:59880) 2023-07-05T18:57:18.854 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:18.840+0000 7fe82259c700 1 -- 172.21.15.46:0/2496198157 learned_addr learned my addr 172.21.15.46:0/2496198157 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-07-05T18:57:18.854 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:18.840+0000 7fe822d9d700 1 --2- 172.21.15.46:0/2496198157 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fe82415d900 0x7fe8240af5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:57:18.854 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:18.840+0000 7fe821d9b700 1 --2- 172.21.15.46:0/2496198157 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe82415c6d0 0x7fe8241606a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:57:18.854 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:18.840+0000 7fe82259c700 1 -- 172.21.15.46:0/2496198157 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fe82415d900 msgr2=0x7fe8240af5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:57:18.854 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:18.840+0000 7fe82259c700 1 --2- 172.21.15.46:0/2496198157 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fe82415d900 0x7fe8240af5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:57:18.854 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:18.840+0000 7fe82259c700 1 -- 172.21.15.46:0/2496198157 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe82415c6d0 msgr2=0x7fe8241606a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:57:18.854 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:18.840+0000 7fe82259c700 1 --2- 172.21.15.46:0/2496198157 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe82415c6d0 0x7fe8241606a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:57:18.855 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:18.840+0000 7fe82259c700 1 -- 172.21.15.46:0/2496198157 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe8180094a0 con 0x7fe82406c5a0 2023-07-05T18:57:18.855 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:18.840+0000 7fe822d9d700 1 --2- 172.21.15.46:0/2496198157 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fe82415d900 0x7fe8240af5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-05T18:57:18.855 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:18.841+0000 7fe82259c700 1 --2- 172.21.15.46:0/2496198157 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe82406c5a0 0x7fe82414a190 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7fe8180097c0 tx=0x7fe818004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-05T18:57:18.855 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:18.841+0000 7fe812ffd700 1 -- 172.21.15.46:0/2496198157 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8180045d0 con 0x7fe82406c5a0 2023-07-05T18:57:18.855 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:18.841+0000 7fe812ffd700 1 -- 172.21.15.46:0/2496198157 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe81801f070 con 0x7fe82406c5a0 2023-07-05T18:57:18.855 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:18.841+0000 7fe828f31700 1 -- 172.21.15.46:0/2496198157 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe82415e5c0 con 0x7fe82406c5a0 2023-07-05T18:57:18.855 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:18.841+0000 7fe812ffd700 1 -- 172.21.15.46:0/2496198157 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8180038e0 con 0x7fe82406c5a0 2023-07-05T18:57:18.856 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:18.841+0000 7fe828f31700 1 -- 172.21.15.46:0/2496198157 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe82415eb80 con 0x7fe82406c5a0 2023-07-05T18:57:18.857 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:18.842+0000 7fe828f31700 1 -- 172.21.15.46:0/2496198157 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe824073690 con 0x7fe82406c5a0 2023-07-05T18:57:18.857 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:18.842+0000 7fe812ffd700 1 -- 172.21.15.46:0/2496198157 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fe818003a40 con 0x7fe82406c5a0 2023-07-05T18:57:18.857 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:18.843+0000 7fe812ffd700 1 --2- 172.21.15.46:0/2496198157 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7fe80406ace0 0x7fe80406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:57:18.857 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:18.843+0000 7fe812ffd700 1 -- 172.21.15.46:0/2496198157 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fe818021070 con 0x7fe82406c5a0 2023-07-05T18:57:18.857 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:18.843+0000 7fe821d9b700 1 --2- 172.21.15.46:0/2496198157 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7fe80406ace0 0x7fe80406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:57:18.858 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:18.844+0000 7fe821d9b700 1 --2- 172.21.15.46:0/2496198157 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7fe80406ace0 0x7fe80406d190 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fe814000f60 tx=0x7fe814009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-05T18:57:18.858 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:18.847+0000 7fe812ffd700 1 -- 172.21.15.46:0/2496198157 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fe824073690 con 0x7fe82406c5a0 2023-07-05T18:57:19.046 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:19.043+0000 7fe828f31700 1 -- 172.21.15.46:0/2496198157 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fe824073690 con 0x7fe82406c5a0 2023-07-05T18:57:19.047 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:19.044+0000 7fe812ffd700 1 -- 172.21.15.46:0/2496198157 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v35) v1 ==== 74+0+18233 (secure 0 0 0) 0x7fe824073690 con 0x7fe82406c5a0 2023-07-05T18:57:19.047 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T18:57:19.047 INFO:teuthology.orchestra.run.smithi046.stdout:{"epoch":35,"fsid":"042652d3-d80c-4ad8-9366-3e94f2a0a512","created":"2023-07-05T18:55:56.455710+0000","modified":"2023-07-05T18:57:16.281249+0000","last_up_change":"2023-07-05T18:56:06.594022+0000","last_in_change":"2023-07-05T18:55:58.879340+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-07-05T18:56:07.729620+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2023-07-05T18:56:08.128122+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2023-07-05T18:57:13.640396+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"34","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_data","create_time":"2023-07-05T18:57:14.333267+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"35","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"20009183-9a47-4392-8751-883f88d2bfb1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6813","nonce":4151971443},{"type":"v1","addr":"172.21.15.46:6815","nonce":4151971443}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6817","nonce":4151971443},{"type":"v1","addr":"172.21.15.46:6818","nonce":4151971443}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6822","nonce":4151971443},{"type":"v1","addr":"172.21.15.46:6823","nonce":4151971443}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6820","nonce":4151971443},{"type":"v1","addr":"172.21.15.46:6821","nonce":4151971443}]},"public_addr":"172.21.15.46:6815/4151971443","cluster_addr":"172.21.15.46:6818/4151971443","heartbeat_back_addr":"172.21.15.46:6823/4151971443","heartbeat_front_addr":"172.21.15.46:6821/4151971443","state":["exists","up"]},{"osd":1,"uuid":"91b4a7b0-e4e4-4888-a1fe-9edb0d68004c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6808","nonce":502575881},{"type":"v1","addr":"172.21.15.46:6809","nonce":502575881}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6810","nonce":502575881},{"type":"v1","addr":"172.21.15.46:6811","nonce":502575881}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6816","nonce":502575881},{"type":"v1","addr":"172.21.15.46:6819","nonce":502575881}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6812","nonce":502575881},{"type":"v1","addr":"172.21.15.46:6814","nonce":502575881}]},"public_addr":"172.21.15.46:6809/502575881","cluster_addr":"172.21.15.46:6811/502575881","heartbeat_back_addr":"172.21.15.46:6819/502575881","heartbeat_front_addr":"172.21.15.46:6814/502575881","state":["exists","up"]},{"osd":2,"uuid":"669ff744-1331-47c5-8579-0440731c889a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6800","nonce":2115251461},{"type":"v1","addr":"172.21.15.46:6801","nonce":2115251461}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6802","nonce":2115251461},{"type":"v1","addr":"172.21.15.46:6803","nonce":2115251461}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6806","nonce":2115251461},{"type":"v1","addr":"172.21.15.46:6807","nonce":2115251461}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6804","nonce":2115251461},{"type":"v1","addr":"172.21.15.46:6805","nonce":2115251461}]},"public_addr":"172.21.15.46:6801/2115251461","cluster_addr":"172.21.15.46:6803/2115251461","heartbeat_back_addr":"172.21.15.46:6807/2115251461","heartbeat_front_addr":"172.21.15.46:6805/2115251461","state":["exists","up"]},{"osd":3,"uuid":"34e1b86d-ffad-415d-861c-07a5f08068a6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6824","nonce":2981388766},{"type":"v1","addr":"172.21.15.46:6825","nonce":2981388766}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6826","nonce":2981388766},{"type":"v1","addr":"172.21.15.46:6827","nonce":2981388766}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6830","nonce":2981388766},{"type":"v1","addr":"172.21.15.46:6831","nonce":2981388766}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6828","nonce":2981388766},{"type":"v1","addr":"172.21.15.46:6829","nonce":2981388766}]},"public_addr":"172.21.15.46:6825/2981388766","cluster_addr":"172.21.15.46:6827/2981388766","heartbeat_back_addr":"172.21.15.46:6831/2981388766","heartbeat_front_addr":"172.21.15.46:6829/2981388766","state":["exists","up"]},{"osd":4,"uuid":"57ffcb91-c7dc-4a69-ae71-4d9622a14a05","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6800","nonce":2083655348},{"type":"v1","addr":"172.21.15.73:6801","nonce":2083655348}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6802","nonce":2083655348},{"type":"v1","addr":"172.21.15.73:6803","nonce":2083655348}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6806","nonce":2083655348},{"type":"v1","addr":"172.21.15.73:6807","nonce":2083655348}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6804","nonce":2083655348},{"type":"v1","addr":"172.21.15.73:6805","nonce":2083655348}]},"public_addr":"172.21.15.73:6801/2083655348","cluster_addr":"172.21.15.73:6803/2083655348","heartbeat_back_addr":"172.21.15.73:6807/2083655348","heartbeat_front_addr":"172.21.15.73:6805/2083655348","state":["exists","up"]},{"osd":5,"uuid":"665f41c9-ee20-49cf-bf0e-fbe0c03d3aed","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6824","nonce":2803788401},{"type":"v1","addr":"172.21.15.73:6825","nonce":2803788401}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6826","nonce":2803788401},{"type":"v1","addr":"172.21.15.73:6827","nonce":2803788401}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6830","nonce":2803788401},{"type":"v1","addr":"172.21.15.73:6831","nonce":2803788401}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6828","nonce":2803788401},{"type":"v1","addr":"172.21.15.73:6829","nonce":2803788401}]},"public_addr":"172.21.15.73:6825/2803788401","cluster_addr":"172.21.15.73:6827/2803788401","heartbeat_back_addr":"172.21.15.73:6831/2803788401","heartbeat_front_addr":"172.21.15.73:6829/2803788401","state":["exists","up"]},{"osd":6,"uuid":"5790c6cc-bd56-4ce4-9a7c-0f0c3b59215c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6808","nonce":974108383},{"type":"v1","addr":"172.21.15.73:6809","nonce":974108383}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6810","nonce":974108383},{"type":"v1","addr":"172.21.15.73:6811","nonce":974108383}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6815","nonce":974108383},{"type":"v1","addr":"172.21.15.73:6817","nonce":974108383}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6812","nonce":974108383},{"type":"v1","addr":"172.21.15.73:6813","nonce":974108383}]},"public_addr":"172.21.15.73:6809/974108383","cluster_addr":"172.21.15.73:6811/974108383","heartbeat_back_addr":"172.21.15.73:6817/974108383","heartbeat_front_addr":"172.21.15.73:6813/974108383","state":["exists","up"]},{"osd":7,"uuid":"b66f4d2e-147e-4c9b-97dd-cbd59d33802e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6814","nonce":3772673248},{"type":"v1","addr":"172.21.15.73:6816","nonce":3772673248}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6818","nonce":3772673248},{"type":"v1","addr":"172.21.15.73:6819","nonce":3772673248}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6822","nonce":3772673248},{"type":"v1","addr":"172.21.15.73:6823","nonce":3772673248}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6820","nonce":3772673248},{"type":"v1","addr":"172.21.15.73:6821","nonce":3772673248}]},"public_addr":"172.21.15.73:6816/3772673248","cluster_addr":"172.21.15.73:6819/3772673248","heartbeat_back_addr":"172.21.15.73:6823/3772673248","heartbeat_front_addr":"172.21.15.73:6821/3772673248","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-05T18:56:04.115334+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-05T18:56:04.071250+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-05T18:56:04.044387+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-05T18:56:04.085389+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-05T18:56:04.090726+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-05T18:56:04.074529+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-05T18:56:04.058841+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-05T18:56:04.043054+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-05T18:57:19.051 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:19.046+0000 7fe828f31700 1 -- 172.21.15.46:0/2496198157 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7fe80406ace0 msgr2=0x7fe80406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:57:19.052 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:19.046+0000 7fe828f31700 1 --2- 172.21.15.46:0/2496198157 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7fe80406ace0 0x7fe80406d190 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fe814000f60 tx=0x7fe814009040 comp rx=0 tx=0).stop 2023-07-05T18:57:19.052 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:19.046+0000 7fe828f31700 1 -- 172.21.15.46:0/2496198157 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe82406c5a0 msgr2=0x7fe82414a190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:57:19.052 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:19.046+0000 7fe828f31700 1 --2- 172.21.15.46:0/2496198157 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe82406c5a0 0x7fe82414a190 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7fe8180097c0 tx=0x7fe818004750 comp rx=0 tx=0).stop 2023-07-05T18:57:19.052 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:19.046+0000 7fe828f31700 1 -- 172.21.15.46:0/2496198157 shutdown_connections 2023-07-05T18:57:19.053 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:19.046+0000 7fe828f31700 1 --2- 172.21.15.46:0/2496198157 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7fe80406ace0 0x7fe80406d190 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:57:19.053 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:19.046+0000 7fe828f31700 1 --2- 172.21.15.46:0/2496198157 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fe82415d900 0x7fe8240af5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:57:19.053 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:19.046+0000 7fe828f31700 1 --2- 172.21.15.46:0/2496198157 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe82406c5a0 0x7fe82414a190 unknown :-1 s=CLOSED pgs=380 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:57:19.053 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:19.046+0000 7fe828f31700 1 --2- 172.21.15.46:0/2496198157 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe82415c6d0 0x7fe8241606a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:57:19.053 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:19.046+0000 7fe828f31700 1 -- 172.21.15.46:0/2496198157 >> 172.21.15.46:0/2496198157 conn(0x7fe8240b0d50 msgr2=0x7fe824071410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-05T18:57:19.053 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:19.047+0000 7fe828f31700 1 -- 172.21.15.46:0/2496198157 shutdown_connections 2023-07-05T18:57:19.053 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:19.047+0000 7fe828f31700 1 -- 172.21.15.46:0/2496198157 wait complete. 2023-07-05T18:57:19.063 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-07-05T18:57:19.063 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-07-05T18:57:19.190 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:19.188+0000 7f9eea8bd700 1 Processor -- start 2023-07-05T18:57:19.190 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:19.188+0000 7f9eea8bd700 1 -- start start 2023-07-05T18:57:19.192 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:19.188+0000 7f9eea8bd700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f9ee40afe70 0x7f9ee40cd7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:57:19.193 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:19.188+0000 7f9eea8bd700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f9ee40cb170 0x7f9ee40cb5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:57:19.193 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:19.188+0000 7f9eea8bd700 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9ee40cc8c0 con 0x7f9ee40cd410 2023-07-05T18:57:19.193 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:19.188+0000 7f9eea8bd700 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9ee40ce170 con 0x7f9ee40cb170 2023-07-05T18:57:19.193 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:19.188+0000 7f9eea8bd700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9ee40cc300 con 0x7f9ee40afe70 2023-07-05T18:57:19.193 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:19.189+0000 7f9ee8e5a700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f9ee40cb170 0x7f9ee40cb5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:57:19.193 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:19.189+0000 7f9ee8e5a700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f9ee40cb170 0x7f9ee40cb5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:59890/0 (socket says 172.21.15.46:59890) 2023-07-05T18:57:19.193 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:19.189+0000 7f9ee8e5a700 1 -- 172.21.15.46:0/3502654408 learned_addr learned my addr 172.21.15.46:0/3502654408 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-07-05T18:57:19.194 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:19.189+0000 7f9ee37fe700 1 --2- 172.21.15.46:0/3502654408 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f9ee40afe70 0x7f9ee40cd7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:57:19.194 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:19.189+0000 7f9ee8e5a700 1 -- 172.21.15.46:0/3502654408 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f9ee40afe70 msgr2=0x7f9ee40cd7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-05T18:57:19.196 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:19.189+0000 7f9ee8e5a700 1 --2- 172.21.15.46:0/3502654408 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f9ee40afe70 0x7f9ee40cd7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:57:19.198 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:19.189+0000 7f9ee8e5a700 1 -- 172.21.15.46:0/3502654408 >> v1:172.21.15.73:6789/0 conn(0x7f9ee40cd410 legacy=0x7f9ee40d1440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:57:19.199 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:19.189+0000 7f9ee8e5a700 1 -- 172.21.15.46:0/3502654408 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ee40cc5e0 con 0x7f9ee40cb170 2023-07-05T18:57:19.200 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:19.189+0000 7f9ee2ffd700 1 -- 172.21.15.46:0/3502654408 <== mon.1 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4267608809 0 0) 0x7f9ee40cc8c0 con 0x7f9ee40cd410 2023-07-05T18:57:19.202 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:19.189+0000 7f9ee8e5a700 1 --2- 172.21.15.46:0/3502654408 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9ee40cb170 0x7f9ee40cb5f0 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f9edc009e50 tx=0x7f9edc00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a8291c81257af9f8 server_cookie=0 in_seq=0 out_seq=0 2023-07-05T18:57:19.202 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:19.189+0000 7f9ee2ffd700 1 -- 172.21.15.46:0/3502654408 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9edc00e070 con 0x7f9ee40cb170 2023-07-05T18:57:19.202 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:19.189+0000 7f9ee2ffd700 1 -- 172.21.15.46:0/3502654408 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9edc00b910 con 0x7f9ee40cb170 2023-07-05T18:57:19.202 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:19.189+0000 7f9ee2ffd700 1 -- 172.21.15.46:0/3502654408 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9edc00bcc0 con 0x7f9ee40cb170 2023-07-05T18:57:19.203 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:19.190+0000 7f9eea8bd700 1 -- 172.21.15.46:0/3502654408 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9ee40cb170 msgr2=0x7f9ee40cb5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:57:19.204 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:19.190+0000 7f9eea8bd700 1 --2- 172.21.15.46:0/3502654408 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9ee40cb170 0x7f9ee40cb5f0 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f9edc009e50 tx=0x7f9edc00b330 comp rx=0 tx=0).stop 2023-07-05T18:57:19.204 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:19.190+0000 7f9eea8bd700 1 -- 172.21.15.46:0/3502654408 shutdown_connections 2023-07-05T18:57:19.206 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:19.190+0000 7f9eea8bd700 1 --2- 172.21.15.46:0/3502654408 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9ee40cb170 0x7f9ee40cb5f0 unknown :-1 s=CLOSED pgs=381 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:57:19.207 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:19.190+0000 7f9eea8bd700 1 --2- 172.21.15.46:0/3502654408 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f9ee40afe70 0x7f9ee40cd7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:57:19.207 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:19.190+0000 7f9eea8bd700 1 -- 172.21.15.46:0/3502654408 >> 172.21.15.46:0/3502654408 conn(0x7f9ee4099e00 msgr2=0x7f9ee40d0b20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-05T18:57:19.207 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:19.190+0000 7f9eea8bd700 1 -- 172.21.15.46:0/3502654408 shutdown_connections 2023-07-05T18:57:19.207 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:19.190+0000 7f9eea8bd700 1 -- 172.21.15.46:0/3502654408 wait complete. 2023-07-05T18:57:19.211 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:19.192+0000 7f9eea8bd700 1 Processor -- start 2023-07-05T18:57:19.211 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:19.192+0000 7f9eea8bd700 1 -- start start 2023-07-05T18:57:19.212 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:19.193+0000 7f9eea8bd700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f9ee40afe70 0x7f9ee40c9d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:57:19.212 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:19.193+0000 7f9eea8bd700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9ee40cb170 0x7f9ee40c7fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:57:19.212 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:19.193+0000 7f9eea8bd700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9ee40cd410 0x7f9ee406d7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:57:19.212 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:19.193+0000 7f9eea8bd700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ee40add30 con 0x7f9ee40cd410 2023-07-05T18:57:19.212 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:19.193+0000 7f9eea8bd700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ee40af400 con 0x7f9ee40cb170 2023-07-05T18:57:19.212 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:19.193+0000 7f9eea8bd700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9ee40ca330 con 0x7f9ee40afe70 2023-07-05T18:57:19.213 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:19.193+0000 7f9ee8e5a700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9ee40cd410 0x7f9ee406d7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:57:19.213 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:19.193+0000 7f9ee8e5a700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9ee40cd410 0x7f9ee406d7e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:59896/0 (socket says 172.21.15.46:59896) 2023-07-05T18:57:19.213 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:19.193+0000 7f9ee8e5a700 1 -- 172.21.15.46:0/2588697297 learned_addr learned my addr 172.21.15.46:0/2588697297 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-07-05T18:57:19.213 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:19.193+0000 7f9ee3fff700 1 --2- 172.21.15.46:0/2588697297 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f9ee40afe70 0x7f9ee40c9d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:57:19.213 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:19.193+0000 7f9ee37fe700 1 --2- 172.21.15.46:0/2588697297 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9ee40cb170 0x7f9ee40c7fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:57:19.213 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:19.193+0000 7f9ee8e5a700 1 -- 172.21.15.46:0/2588697297 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f9ee40afe70 msgr2=0x7f9ee40c9d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:57:19.213 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:19.193+0000 7f9ee8e5a700 1 --2- 172.21.15.46:0/2588697297 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f9ee40afe70 0x7f9ee40c9d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:57:19.213 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:19.193+0000 7f9ee8e5a700 1 -- 172.21.15.46:0/2588697297 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9ee40cb170 msgr2=0x7f9ee40c7fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:57:19.214 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:19.193+0000 7f9ee8e5a700 1 --2- 172.21.15.46:0/2588697297 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9ee40cb170 0x7f9ee40c7fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:57:19.214 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:19.193+0000 7f9ee8e5a700 1 -- 172.21.15.46:0/2588697297 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9edc009b30 con 0x7f9ee40cd410 2023-07-05T18:57:19.214 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:19.193+0000 7f9ee8e5a700 1 --2- 172.21.15.46:0/2588697297 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9ee40cd410 0x7f9ee406d7e0 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f9edc00b680 tx=0x7f9edc004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-05T18:57:19.214 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:19.193+0000 7f9ee0ff9700 1 -- 172.21.15.46:0/2588697297 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9edc0048b0 con 0x7f9ee40cd410 2023-07-05T18:57:19.214 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:19.194+0000 7f9ee0ff9700 1 -- 172.21.15.46:0/2588697297 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9edc0099b0 con 0x7f9ee40cd410 2023-07-05T18:57:19.214 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:19.194+0000 7f9eea8bd700 1 -- 172.21.15.46:0/2588697297 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9ee40ca610 con 0x7f9ee40cd410 2023-07-05T18:57:19.214 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:19.194+0000 7f9ee0ff9700 1 -- 172.21.15.46:0/2588697297 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9edc01c680 con 0x7f9ee40cd410 2023-07-05T18:57:19.215 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:19.194+0000 7f9eea8bd700 1 -- 172.21.15.46:0/2588697297 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9ee40ad950 con 0x7f9ee40cd410 2023-07-05T18:57:19.215 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:19.195+0000 7f9eea8bd700 1 -- 172.21.15.46:0/2588697297 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9ee40ade70 con 0x7f9ee40cd410 2023-07-05T18:57:19.215 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:19.195+0000 7f9ee0ff9700 1 -- 172.21.15.46:0/2588697297 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f9edc01c7e0 con 0x7f9ee40cd410 2023-07-05T18:57:19.215 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:19.195+0000 7f9ee0ff9700 1 --2- 172.21.15.46:0/2588697297 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7f9ed006ace0 0x7f9ed006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:57:19.215 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:19.195+0000 7f9ee0ff9700 1 -- 172.21.15.46:0/2588697297 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f9edc08aff0 con 0x7f9ee40cd410 2023-07-05T18:57:19.215 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:19.195+0000 7f9ee3fff700 1 --2- 172.21.15.46:0/2588697297 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7f9ed006ace0 0x7f9ed006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:57:19.215 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:19.196+0000 7f9ee3fff700 1 --2- 172.21.15.46:0/2588697297 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7f9ed006ace0 0x7f9ed006d190 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f9ed4000f60 tx=0x7f9ed4009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-05T18:57:19.215 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:19.200+0000 7f9ee0ff9700 1 -- 172.21.15.46:0/2588697297 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f9ee40ade70 con 0x7f9ee40cd410 2023-07-05T18:57:19.398 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:19.394+0000 7f9eea8bd700 1 -- 172.21.15.46:0/2588697297 --> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f9ee40cde00 con 0x7f9ed006ace0 2023-07-05T18:57:19.409 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:19.404+0000 7f9ee0ff9700 1 -- 172.21.15.46:0/2588697297 <== mgr.4099 v2:172.21.15.73:6832/3033361733 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+311693 (secure 0 0 0) 0x7f9ed40014e0 con 0x7f9ed006ace0 2023-07-05T18:57:19.411 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T18:57:19.430 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:19.407+0000 7f9eea8bd700 1 -- 172.21.15.46:0/2588697297 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7f9ed006ace0 msgr2=0x7f9ed006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:57:19.430 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:19.407+0000 7f9eea8bd700 1 --2- 172.21.15.46:0/2588697297 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7f9ed006ace0 0x7f9ed006d190 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f9ed4000f60 tx=0x7f9ed4009040 comp rx=0 tx=0).stop 2023-07-05T18:57:19.432 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:19.407+0000 7f9eea8bd700 1 -- 172.21.15.46:0/2588697297 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9ee40cd410 msgr2=0x7f9ee406d7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:57:19.433 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:19.407+0000 7f9eea8bd700 1 --2- 172.21.15.46:0/2588697297 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9ee40cd410 0x7f9ee406d7e0 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f9edc00b680 tx=0x7f9edc004ad0 comp rx=0 tx=0).stop 2023-07-05T18:57:19.433 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:19.407+0000 7f9eea8bd700 1 -- 172.21.15.46:0/2588697297 shutdown_connections 2023-07-05T18:57:19.433 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:19.407+0000 7f9eea8bd700 1 --2- 172.21.15.46:0/2588697297 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7f9ed006ace0 0x7f9ed006d190 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:57:19.433 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:19.407+0000 7f9eea8bd700 1 --2- 172.21.15.46:0/2588697297 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9ee40cd410 0x7f9ee406d7e0 unknown :-1 s=CLOSED pgs=382 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:57:19.434 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:19.407+0000 7f9eea8bd700 1 --2- 172.21.15.46:0/2588697297 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f9ee40afe70 0x7f9ee40c9d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:57:19.434 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:19.407+0000 7f9eea8bd700 1 --2- 172.21.15.46:0/2588697297 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9ee40cb170 0x7f9ee40c7fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:57:19.434 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:19.407+0000 7f9eea8bd700 1 -- 172.21.15.46:0/2588697297 >> 172.21.15.46:0/2588697297 conn(0x7f9ee4099e00 msgr2=0x7f9ee406e570 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-05T18:57:19.434 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:19.408+0000 7f9eea8bd700 1 -- 172.21.15.46:0/2588697297 shutdown_connections 2023-07-05T18:57:19.434 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:19.408+0000 7f9eea8bd700 1 -- 172.21.15.46:0/2588697297 wait complete. 2023-07-05T18:57:19.435 INFO:teuthology.orchestra.run.smithi046.stderr:dumped all 2023-07-05T18:57:19.435 INFO:teuthology.orchestra.run.smithi046.stdout:{"pg_ready":true,"pg_map":{"version":64,"stamp":"2023-07-05T18:57:18.086414+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":120,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219904,"kb_used_data":4288,"kb_used_omap":0,"kb_used_meta":215552,"kb_avail":754754816,"statfs":{"total":773094113280,"available":772868931584,"internally_reserved":0,"allocated":4390912,"data_stored":2483644,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":220725248},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":25,"apply_latency_ms":25,"commit_latency_ns":25000000,"apply_latency_ns":25000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2362,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.235338"},"pg_stats":[{"pgid":"6.3f","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-05T18:57:16.288533+0000","last_change":"2023-07-05T18:57:15.300762+0000","last_active":"2023-07-05T18:57:16.288533+0000","last_peered":"2023-07-05T18:57:16.288533+0000","last_clean":"2023-07-05T18:57:16.288533+0000","last_became_active":"2023-07-05T18:57:15.300504+0000","last_became_peered":"2023-07-05T18:57:15.300504+0000","last_unstale":"2023-07-05T18:57:16.288533+0000","last_undegraded":"2023-07-05T18:57:16.288533+0000","last_fullsized":"2023-07-05T18:57:16.288533+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T18:57:14.849454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T18:57:14.849454+0000","last_clean_scrub_stamp":"2023-07-05T18:57:14.849454+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T00:20:29.812942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3e","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-05T18:57:16.288410+0000","last_change":"2023-07-05T18:57:15.297206+0000","last_active":"2023-07-05T18:57:16.288410+0000","last_peered":"2023-07-05T18:57:16.288410+0000","last_clean":"2023-07-05T18:57:16.288410+0000","last_became_active":"2023-07-05T18:57:15.296976+0000","last_became_peered":"2023-07-05T18:57:15.296976+0000","last_unstale":"2023-07-05T18:57:16.288410+0000","last_undegraded":"2023-07-05T18:57:16.288410+0000","last_fullsized":"2023-07-05T18:57:16.288410+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T18:57:14.849454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T18:57:14.849454+0000","last_clean_scrub_stamp":"2023-07-05T18:57:14.849454+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-06T21:19:55.309242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3d","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-05T18:57:16.903055+0000","last_change":"2023-07-05T18:57:15.303956+0000","last_active":"2023-07-05T18:57:16.903055+0000","last_peered":"2023-07-05T18:57:16.903055+0000","last_clean":"2023-07-05T18:57:16.903055+0000","last_became_active":"2023-07-05T18:57:15.303688+0000","last_became_peered":"2023-07-05T18:57:15.303688+0000","last_unstale":"2023-07-05T18:57:16.903055+0000","last_undegraded":"2023-07-05T18:57:16.903055+0000","last_fullsized":"2023-07-05T18:57:16.903055+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T18:57:14.849454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T18:57:14.849454+0000","last_clean_scrub_stamp":"2023-07-05T18:57:14.849454+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T03:42:12.749735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.3c","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-05T18:57:16.902405+0000","last_change":"2023-07-05T18:57:15.306781+0000","last_active":"2023-07-05T18:57:16.902405+0000","last_peered":"2023-07-05T18:57:16.902405+0000","last_clean":"2023-07-05T18:57:16.902405+0000","last_became_active":"2023-07-05T18:57:15.306232+0000","last_became_peered":"2023-07-05T18:57:15.306232+0000","last_unstale":"2023-07-05T18:57:16.902405+0000","last_undegraded":"2023-07-05T18:57:16.902405+0000","last_fullsized":"2023-07-05T18:57:16.902405+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T18:57:14.849454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T18:57:14.849454+0000","last_clean_scrub_stamp":"2023-07-05T18:57:14.849454+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-06T20:37:16.358123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3b","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-05T18:57:16.902171+0000","last_change":"2023-07-05T18:57:15.305220+0000","last_active":"2023-07-05T18:57:16.902171+0000","last_peered":"2023-07-05T18:57:16.902171+0000","last_clean":"2023-07-05T18:57:16.902171+0000","last_became_active":"2023-07-05T18:57:15.304962+0000","last_became_peered":"2023-07-05T18:57:15.304962+0000","last_unstale":"2023-07-05T18:57:16.902171+0000","last_undegraded":"2023-07-05T18:57:16.902171+0000","last_fullsized":"2023-07-05T18:57:16.902171+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T18:57:14.849454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T18:57:14.849454+0000","last_clean_scrub_stamp":"2023-07-05T18:57:14.849454+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-06T21:19:45.289501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3a","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-05T18:57:16.902675+0000","last_change":"2023-07-05T18:57:15.289387+0000","last_active":"2023-07-05T18:57:16.902675+0000","last_peered":"2023-07-05T18:57:16.902675+0000","last_clean":"2023-07-05T18:57:16.902675+0000","last_became_active":"2023-07-05T18:57:15.289064+0000","last_became_peered":"2023-07-05T18:57:15.289064+0000","last_unstale":"2023-07-05T18:57:16.902675+0000","last_undegraded":"2023-07-05T18:57:16.902675+0000","last_fullsized":"2023-07-05T18:57:16.902675+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T18:57:14.849454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T18:57:14.849454+0000","last_clean_scrub_stamp":"2023-07-05T18:57:14.849454+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-06T23:36:28.798057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.39","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-05T18:57:16.288825+0000","last_change":"2023-07-05T18:57:15.313092+0000","last_active":"2023-07-05T18:57:16.288825+0000","last_peered":"2023-07-05T18:57:16.288825+0000","last_clean":"2023-07-05T18:57:16.288825+0000","last_became_active":"2023-07-05T18:57:15.312231+0000","last_became_peered":"2023-07-05T18:57:15.312231+0000","last_unstale":"2023-07-05T18:57:16.288825+0000","last_undegraded":"2023-07-05T18:57:16.288825+0000","last_fullsized":"2023-07-05T18:57:16.288825+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T18:57:14.849454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T18:57:14.849454+0000","last_clean_scrub_stamp":"2023-07-05T18:57:14.849454+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T02:57:02.950954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.38","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-05T18:57:16.287817+0000","last_change":"2023-07-05T18:57:15.306915+0000","last_active":"2023-07-05T18:57:16.287817+0000","last_peered":"2023-07-05T18:57:16.287817+0000","last_clean":"2023-07-05T18:57:16.287817+0000","last_became_active":"2023-07-05T18:57:15.306664+0000","last_became_peered":"2023-07-05T18:57:15.306664+0000","last_unstale":"2023-07-05T18:57:16.287817+0000","last_undegraded":"2023-07-05T18:57:16.287817+0000","last_fullsized":"2023-07-05T18:57:16.287817+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T18:57:14.849454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T18:57:14.849454+0000","last_clean_scrub_stamp":"2023-07-05T18:57:14.849454+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T00:27:47.371925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.37","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-05T18:57:16.903352+0000","last_change":"2023-07-05T18:57:15.304013+0000","last_active":"2023-07-05T18:57:16.903352+0000","last_peered":"2023-07-05T18:57:16.903352+0000","last_clean":"2023-07-05T18:57:16.903352+0000","last_became_active":"2023-07-05T18:57:15.303749+0000","last_became_peered":"2023-07-05T18:57:15.303749+0000","last_unstale":"2023-07-05T18:57:16.903352+0000","last_undegraded":"2023-07-05T18:57:16.903352+0000","last_fullsized":"2023-07-05T18:57:16.903352+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T18:57:14.849454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T18:57:14.849454+0000","last_clean_scrub_stamp":"2023-07-05T18:57:14.849454+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T04:15:09.189046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.36","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-05T18:57:16.289160+0000","last_change":"2023-07-05T18:57:15.314509+0000","last_active":"2023-07-05T18:57:16.289160+0000","last_peered":"2023-07-05T18:57:16.289160+0000","last_clean":"2023-07-05T18:57:16.289160+0000","last_became_active":"2023-07-05T18:57:15.313696+0000","last_became_peered":"2023-07-05T18:57:15.313696+0000","last_unstale":"2023-07-05T18:57:16.289160+0000","last_undegraded":"2023-07-05T18:57:16.289160+0000","last_fullsized":"2023-07-05T18:57:16.289160+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T18:57:14.849454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T18:57:14.849454+0000","last_clean_scrub_stamp":"2023-07-05T18:57:14.849454+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T00:16:15.859522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.35","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-05T18:57:16.289222+0000","last_change":"2023-07-05T18:57:15.312936+0000","last_active":"2023-07-05T18:57:16.289222+0000","last_peered":"2023-07-05T18:57:16.289222+0000","last_clean":"2023-07-05T18:57:16.289222+0000","last_became_active":"2023-07-05T18:57:15.312467+0000","last_became_peered":"2023-07-05T18:57:15.312467+0000","last_unstale":"2023-07-05T18:57:16.289222+0000","last_undegraded":"2023-07-05T18:57:16.289222+0000","last_fullsized":"2023-07-05T18:57:16.289222+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T18:57:14.849454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T18:57:14.849454+0000","last_clean_scrub_stamp":"2023-07-05T18:57:14.849454+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T03:43:56.949230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.34","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-05T18:57:16.902814+0000","last_change":"2023-07-05T18:57:15.300811+0000","last_active":"2023-07-05T18:57:16.902814+0000","last_peered":"2023-07-05T18:57:16.902814+0000","last_clean":"2023-07-05T18:57:16.902814+0000","last_became_active":"2023-07-05T18:57:15.300004+0000","last_became_peered":"2023-07-05T18:57:15.300004+0000","last_unstale":"2023-07-05T18:57:16.902814+0000","last_undegraded":"2023-07-05T18:57:16.902814+0000","last_fullsized":"2023-07-05T18:57:16.902814+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T18:57:14.849454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T18:57:14.849454+0000","last_clean_scrub_stamp":"2023-07-05T18:57:14.849454+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T03:12:43.303387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.33","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-05T18:57:16.288784+0000","last_change":"2023-07-05T18:57:15.313723+0000","last_active":"2023-07-05T18:57:16.288784+0000","last_peered":"2023-07-05T18:57:16.288784+0000","last_clean":"2023-07-05T18:57:16.288784+0000","last_became_active":"2023-07-05T18:57:15.313075+0000","last_became_peered":"2023-07-05T18:57:15.313075+0000","last_unstale":"2023-07-05T18:57:16.288784+0000","last_undegraded":"2023-07-05T18:57:16.288784+0000","last_fullsized":"2023-07-05T18:57:16.288784+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T18:57:14.849454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T18:57:14.849454+0000","last_clean_scrub_stamp":"2023-07-05T18:57:14.849454+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-06T23:41:48.799560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.32","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-05T18:57:16.902601+0000","last_change":"2023-07-05T18:57:15.304241+0000","last_active":"2023-07-05T18:57:16.902601+0000","last_peered":"2023-07-05T18:57:16.902601+0000","last_clean":"2023-07-05T18:57:16.902601+0000","last_became_active":"2023-07-05T18:57:15.303982+0000","last_became_peered":"2023-07-05T18:57:15.303982+0000","last_unstale":"2023-07-05T18:57:16.902601+0000","last_undegraded":"2023-07-05T18:57:16.902601+0000","last_fullsized":"2023-07-05T18:57:16.902601+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T18:57:14.849454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T18:57:14.849454+0000","last_clean_scrub_stamp":"2023-07-05T18:57:14.849454+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T02:09:52.155947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.31","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-05T18:57:16.288643+0000","last_change":"2023-07-05T18:57:15.313964+0000","last_active":"2023-07-05T18:57:16.288643+0000","last_peered":"2023-07-05T18:57:16.288643+0000","last_clean":"2023-07-05T18:57:16.288643+0000","last_became_active":"2023-07-05T18:57:15.313733+0000","last_became_peered":"2023-07-05T18:57:15.313733+0000","last_unstale":"2023-07-05T18:57:16.288643+0000","last_undegraded":"2023-07-05T18:57:16.288643+0000","last_fullsized":"2023-07-05T18:57:16.288643+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T18:57:14.849454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T18:57:14.849454+0000","last_clean_scrub_stamp":"2023-07-05T18:57:14.849454+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-06T21:39:30.995965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.30","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-05T18:57:16.901970+0000","last_change":"2023-07-05T18:57:15.308389+0000","last_active":"2023-07-05T18:57:16.901970+0000","last_peered":"2023-07-05T18:57:16.901970+0000","last_clean":"2023-07-05T18:57:16.901970+0000","last_became_active":"2023-07-05T18:57:15.307804+0000","last_became_peered":"2023-07-05T18:57:15.307804+0000","last_unstale":"2023-07-05T18:57:16.901970+0000","last_undegraded":"2023-07-05T18:57:16.901970+0000","last_fullsized":"2023-07-05T18:57:16.901970+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T18:57:14.849454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T18:57:14.849454+0000","last_clean_scrub_stamp":"2023-07-05T18:57:14.849454+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T01:50:19.446193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2f","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-05T18:57:16.902230+0000","last_change":"2023-07-05T18:57:15.304281+0000","last_active":"2023-07-05T18:57:16.902230+0000","last_peered":"2023-07-05T18:57:16.902230+0000","last_clean":"2023-07-05T18:57:16.902230+0000","last_became_active":"2023-07-05T18:57:15.304020+0000","last_became_peered":"2023-07-05T18:57:15.304020+0000","last_unstale":"2023-07-05T18:57:16.902230+0000","last_undegraded":"2023-07-05T18:57:16.902230+0000","last_fullsized":"2023-07-05T18:57:16.902230+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T18:57:14.849454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T18:57:14.849454+0000","last_clean_scrub_stamp":"2023-07-05T18:57:14.849454+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T02:31:28.861306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2e","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-05T18:57:16.287774+0000","last_change":"2023-07-05T18:57:15.306213+0000","last_active":"2023-07-05T18:57:16.287774+0000","last_peered":"2023-07-05T18:57:16.287774+0000","last_clean":"2023-07-05T18:57:16.287774+0000","last_became_active":"2023-07-05T18:57:15.305923+0000","last_became_peered":"2023-07-05T18:57:15.305923+0000","last_unstale":"2023-07-05T18:57:16.287774+0000","last_undegraded":"2023-07-05T18:57:16.287774+0000","last_fullsized":"2023-07-05T18:57:16.287774+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T18:57:14.849454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T18:57:14.849454+0000","last_clean_scrub_stamp":"2023-07-05T18:57:14.849454+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T03:17:09.797617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2d","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-05T18:57:16.903324+0000","last_change":"2023-07-05T18:57:15.303699+0000","last_active":"2023-07-05T18:57:16.903324+0000","last_peered":"2023-07-05T18:57:16.903324+0000","last_clean":"2023-07-05T18:57:16.903324+0000","last_became_active":"2023-07-05T18:57:15.303418+0000","last_became_peered":"2023-07-05T18:57:15.303418+0000","last_unstale":"2023-07-05T18:57:16.903324+0000","last_undegraded":"2023-07-05T18:57:16.903324+0000","last_fullsized":"2023-07-05T18:57:16.903324+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T18:57:14.849454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T18:57:14.849454+0000","last_clean_scrub_stamp":"2023-07-05T18:57:14.849454+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-06T21:07:13.517759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.2c","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-05T18:57:16.287378+0000","last_change":"2023-07-05T18:57:15.301493+0000","last_active":"2023-07-05T18:57:16.287378+0000","last_peered":"2023-07-05T18:57:16.287378+0000","last_clean":"2023-07-05T18:57:16.287378+0000","last_became_active":"2023-07-05T18:57:15.301234+0000","last_became_peered":"2023-07-05T18:57:15.301234+0000","last_unstale":"2023-07-05T18:57:16.287378+0000","last_undegraded":"2023-07-05T18:57:16.287378+0000","last_fullsized":"2023-07-05T18:57:16.287378+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T18:57:14.849454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T18:57:14.849454+0000","last_clean_scrub_stamp":"2023-07-05T18:57:14.849454+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T03:12:43.303387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2b","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-05T18:57:16.288959+0000","last_change":"2023-07-05T18:57:15.308944+0000","last_active":"2023-07-05T18:57:16.288959+0000","last_peered":"2023-07-05T18:57:16.288959+0000","last_clean":"2023-07-05T18:57:16.288959+0000","last_became_active":"2023-07-05T18:57:15.308725+0000","last_became_peered":"2023-07-05T18:57:15.308725+0000","last_unstale":"2023-07-05T18:57:16.288959+0000","last_undegraded":"2023-07-05T18:57:16.288959+0000","last_fullsized":"2023-07-05T18:57:16.288959+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T18:57:14.849454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T18:57:14.849454+0000","last_clean_scrub_stamp":"2023-07-05T18:57:14.849454+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T06:56:03.495003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.2a","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-05T18:57:16.902228+0000","last_change":"2023-07-05T18:57:15.305564+0000","last_active":"2023-07-05T18:57:16.902228+0000","last_peered":"2023-07-05T18:57:16.902228+0000","last_clean":"2023-07-05T18:57:16.902228+0000","last_became_active":"2023-07-05T18:57:15.305300+0000","last_became_peered":"2023-07-05T18:57:15.305300+0000","last_unstale":"2023-07-05T18:57:16.902228+0000","last_undegraded":"2023-07-05T18:57:16.902228+0000","last_fullsized":"2023-07-05T18:57:16.902228+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T18:57:14.849454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T18:57:14.849454+0000","last_clean_scrub_stamp":"2023-07-05T18:57:14.849454+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-06T23:17:24.615246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.29","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-05T18:57:16.901980+0000","last_change":"2023-07-05T18:57:15.303895+0000","last_active":"2023-07-05T18:57:16.901980+0000","last_peered":"2023-07-05T18:57:16.901980+0000","last_clean":"2023-07-05T18:57:16.901980+0000","last_became_active":"2023-07-05T18:57:15.303284+0000","last_became_peered":"2023-07-05T18:57:15.303284+0000","last_unstale":"2023-07-05T18:57:16.901980+0000","last_undegraded":"2023-07-05T18:57:16.901980+0000","last_fullsized":"2023-07-05T18:57:16.901980+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T18:57:14.849454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T18:57:14.849454+0000","last_clean_scrub_stamp":"2023-07-05T18:57:14.849454+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T06:45:55.925315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.28","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-05T18:57:16.902419+0000","last_change":"2023-07-05T18:57:15.304562+0000","last_active":"2023-07-05T18:57:16.902419+0000","last_peered":"2023-07-05T18:57:16.902419+0000","last_clean":"2023-07-05T18:57:16.902419+0000","last_became_active":"2023-07-05T18:57:15.304298+0000","last_became_peered":"2023-07-05T18:57:15.304298+0000","last_unstale":"2023-07-05T18:57:16.902419+0000","last_undegraded":"2023-07-05T18:57:16.902419+0000","last_fullsized":"2023-07-05T18:57:16.902419+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T18:57:14.849454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T18:57:14.849454+0000","last_clean_scrub_stamp":"2023-07-05T18:57:14.849454+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T02:02:50.091589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.27","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-05T18:57:16.287811+0000","last_change":"2023-07-05T18:57:15.297980+0000","last_active":"2023-07-05T18:57:16.287811+0000","last_peered":"2023-07-05T18:57:16.287811+0000","last_clean":"2023-07-05T18:57:16.287811+0000","last_became_active":"2023-07-05T18:57:15.297755+0000","last_became_peered":"2023-07-05T18:57:15.297755+0000","last_unstale":"2023-07-05T18:57:16.287811+0000","last_undegraded":"2023-07-05T18:57:16.287811+0000","last_fullsized":"2023-07-05T18:57:16.287811+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T18:57:14.849454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T18:57:14.849454+0000","last_clean_scrub_stamp":"2023-07-05T18:57:14.849454+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-06T23:13:44.165526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.26","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-05T18:57:16.902714+0000","last_change":"2023-07-05T18:57:15.303323+0000","last_active":"2023-07-05T18:57:16.902714+0000","last_peered":"2023-07-05T18:57:16.902714+0000","last_clean":"2023-07-05T18:57:16.902714+0000","last_became_active":"2023-07-05T18:57:15.303060+0000","last_became_peered":"2023-07-05T18:57:15.303060+0000","last_unstale":"2023-07-05T18:57:16.902714+0000","last_undegraded":"2023-07-05T18:57:16.902714+0000","last_fullsized":"2023-07-05T18:57:16.902714+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T18:57:14.849454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T18:57:14.849454+0000","last_clean_scrub_stamp":"2023-07-05T18:57:14.849454+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T02:18:53.288779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.25","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-05T18:57:16.287783+0000","last_change":"2023-07-05T18:57:15.299828+0000","last_active":"2023-07-05T18:57:16.287783+0000","last_peered":"2023-07-05T18:57:16.287783+0000","last_clean":"2023-07-05T18:57:16.287783+0000","last_became_active":"2023-07-05T18:57:15.299563+0000","last_became_peered":"2023-07-05T18:57:15.299563+0000","last_unstale":"2023-07-05T18:57:16.287783+0000","last_undegraded":"2023-07-05T18:57:16.287783+0000","last_fullsized":"2023-07-05T18:57:16.287783+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T18:57:14.849454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T18:57:14.849454+0000","last_clean_scrub_stamp":"2023-07-05T18:57:14.849454+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-06T23:16:45.043262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.24","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-05T18:57:16.289040+0000","last_change":"2023-07-05T18:57:15.312226+0000","last_active":"2023-07-05T18:57:16.289040+0000","last_peered":"2023-07-05T18:57:16.289040+0000","last_clean":"2023-07-05T18:57:16.289040+0000","last_became_active":"2023-07-05T18:57:15.311921+0000","last_became_peered":"2023-07-05T18:57:15.311921+0000","last_unstale":"2023-07-05T18:57:16.289040+0000","last_undegraded":"2023-07-05T18:57:16.289040+0000","last_fullsized":"2023-07-05T18:57:16.289040+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T18:57:14.849454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T18:57:14.849454+0000","last_clean_scrub_stamp":"2023-07-05T18:57:14.849454+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-06T20:22:18.509905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.23","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-05T18:57:16.287551+0000","last_change":"2023-07-05T18:57:15.289455+0000","last_active":"2023-07-05T18:57:16.287551+0000","last_peered":"2023-07-05T18:57:16.287551+0000","last_clean":"2023-07-05T18:57:16.287551+0000","last_became_active":"2023-07-05T18:57:15.289140+0000","last_became_peered":"2023-07-05T18:57:15.289140+0000","last_unstale":"2023-07-05T18:57:16.287551+0000","last_undegraded":"2023-07-05T18:57:16.287551+0000","last_fullsized":"2023-07-05T18:57:16.287551+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T18:57:14.849454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T18:57:14.849454+0000","last_clean_scrub_stamp":"2023-07-05T18:57:14.849454+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T05:42:15.537264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.22","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-05T18:57:16.287473+0000","last_change":"2023-07-05T18:57:15.296111+0000","last_active":"2023-07-05T18:57:16.287473+0000","last_peered":"2023-07-05T18:57:16.287473+0000","last_clean":"2023-07-05T18:57:16.287473+0000","last_became_active":"2023-07-05T18:57:15.295834+0000","last_became_peered":"2023-07-05T18:57:15.295834+0000","last_unstale":"2023-07-05T18:57:16.287473+0000","last_undegraded":"2023-07-05T18:57:16.287473+0000","last_fullsized":"2023-07-05T18:57:16.287473+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T18:57:14.849454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T18:57:14.849454+0000","last_clean_scrub_stamp":"2023-07-05T18:57:14.849454+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-06T23:18:29.316424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.21","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-05T18:57:16.902932+0000","last_change":"2023-07-05T18:57:15.303580+0000","last_active":"2023-07-05T18:57:16.902932+0000","last_peered":"2023-07-05T18:57:16.902932+0000","last_clean":"2023-07-05T18:57:16.902932+0000","last_became_active":"2023-07-05T18:57:15.302825+0000","last_became_peered":"2023-07-05T18:57:15.302825+0000","last_unstale":"2023-07-05T18:57:16.902932+0000","last_undegraded":"2023-07-05T18:57:16.902932+0000","last_fullsized":"2023-07-05T18:57:16.902932+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T18:57:14.849454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T18:57:14.849454+0000","last_clean_scrub_stamp":"2023-07-05T18:57:14.849454+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-06T23:55:03.547311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.20","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-05T18:57:16.901969+0000","last_change":"2023-07-05T18:57:15.299825+0000","last_active":"2023-07-05T18:57:16.901969+0000","last_peered":"2023-07-05T18:57:16.901969+0000","last_clean":"2023-07-05T18:57:16.901969+0000","last_became_active":"2023-07-05T18:57:15.299581+0000","last_became_peered":"2023-07-05T18:57:15.299581+0000","last_unstale":"2023-07-05T18:57:16.901969+0000","last_undegraded":"2023-07-05T18:57:16.901969+0000","last_fullsized":"2023-07-05T18:57:16.901969+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T18:57:14.849454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T18:57:14.849454+0000","last_clean_scrub_stamp":"2023-07-05T18:57:14.849454+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T05:12:10.750794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1c","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-05T18:57:16.902061+0000","last_change":"2023-07-05T18:57:15.313067+0000","last_active":"2023-07-05T18:57:16.902061+0000","last_peered":"2023-07-05T18:57:16.902061+0000","last_clean":"2023-07-05T18:57:16.902061+0000","last_became_active":"2023-07-05T18:57:15.312795+0000","last_became_peered":"2023-07-05T18:57:15.312795+0000","last_unstale":"2023-07-05T18:57:16.902061+0000","last_undegraded":"2023-07-05T18:57:16.902061+0000","last_fullsized":"2023-07-05T18:57:16.902061+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T18:57:14.849454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T18:57:14.849454+0000","last_clean_scrub_stamp":"2023-07-05T18:57:14.849454+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T06:11:33.913163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1f","version":"34'4","reported_seq":17,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-05T18:57:16.287849+0000","last_change":"2023-07-05T18:57:14.872801+0000","last_active":"2023-07-05T18:57:16.287849+0000","last_peered":"2023-07-05T18:57:16.287849+0000","last_clean":"2023-07-05T18:57:16.287849+0000","last_became_active":"2023-07-05T18:57:14.872521+0000","last_became_peered":"2023-07-05T18:57:14.872521+0000","last_unstale":"2023-07-05T18:57:16.287849+0000","last_undegraded":"2023-07-05T18:57:16.287849+0000","last_fullsized":"2023-07-05T18:57:16.287849+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T18:57:13.843710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T18:57:13.843710+0000","last_clean_scrub_stamp":"2023-07-05T18:57:13.843710+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T04:15:08.183301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-05T18:57:16.903035+0000","last_change":"2023-07-05T18:57:15.305499+0000","last_active":"2023-07-05T18:57:16.903035+0000","last_peered":"2023-07-05T18:57:16.903035+0000","last_clean":"2023-07-05T18:57:16.903035+0000","last_became_active":"2023-07-05T18:57:15.305243+0000","last_became_peered":"2023-07-05T18:57:15.305243+0000","last_unstale":"2023-07-05T18:57:16.903035+0000","last_undegraded":"2023-07-05T18:57:16.903035+0000","last_fullsized":"2023-07-05T18:57:16.903035+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T18:57:14.849454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T18:57:14.849454+0000","last_clean_scrub_stamp":"2023-07-05T18:57:14.849454+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T03:57:03.714848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1e","version":"34'1","reported_seq":14,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-05T18:57:16.903272+0000","last_change":"2023-07-05T18:57:14.871637+0000","last_active":"2023-07-05T18:57:16.903272+0000","last_peered":"2023-07-05T18:57:16.903272+0000","last_clean":"2023-07-05T18:57:16.903272+0000","last_became_active":"2023-07-05T18:57:14.871356+0000","last_became_peered":"2023-07-05T18:57:14.871356+0000","last_unstale":"2023-07-05T18:57:16.903272+0000","last_undegraded":"2023-07-05T18:57:16.903272+0000","last_fullsized":"2023-07-05T18:57:16.903272+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T18:57:13.843710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T18:57:13.843710+0000","last_clean_scrub_stamp":"2023-07-05T18:57:13.843710+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-06T23:16:44.037517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-05T18:57:16.902779+0000","last_change":"2023-07-05T18:57:15.306265+0000","last_active":"2023-07-05T18:57:16.902779+0000","last_peered":"2023-07-05T18:57:16.902779+0000","last_clean":"2023-07-05T18:57:16.902779+0000","last_became_active":"2023-07-05T18:57:15.304037+0000","last_became_peered":"2023-07-05T18:57:15.304037+0000","last_unstale":"2023-07-05T18:57:16.902779+0000","last_undegraded":"2023-07-05T18:57:16.902779+0000","last_fullsized":"2023-07-05T18:57:16.902779+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T18:57:14.849454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T18:57:14.849454+0000","last_clean_scrub_stamp":"2023-07-05T18:57:14.849454+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T00:16:39.980815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1d","version":"34'2","reported_seq":15,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-05T18:57:16.903180+0000","last_change":"2023-07-05T18:57:14.872649+0000","last_active":"2023-07-05T18:57:16.903180+0000","last_peered":"2023-07-05T18:57:16.903180+0000","last_clean":"2023-07-05T18:57:16.903180+0000","last_became_active":"2023-07-05T18:57:14.872348+0000","last_became_peered":"2023-07-05T18:57:14.872348+0000","last_unstale":"2023-07-05T18:57:16.903180+0000","last_undegraded":"2023-07-05T18:57:16.903180+0000","last_fullsized":"2023-07-05T18:57:16.903180+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T18:57:13.843710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T18:57:13.843710+0000","last_clean_scrub_stamp":"2023-07-05T18:57:13.843710+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-06T21:21:53.540891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-05T18:57:16.288437+0000","last_change":"2023-07-05T18:57:15.293488+0000","last_active":"2023-07-05T18:57:16.288437+0000","last_peered":"2023-07-05T18:57:16.288437+0000","last_clean":"2023-07-05T18:57:16.288437+0000","last_became_active":"2023-07-05T18:57:15.293150+0000","last_became_peered":"2023-07-05T18:57:15.293150+0000","last_unstale":"2023-07-05T18:57:16.288437+0000","last_undegraded":"2023-07-05T18:57:16.288437+0000","last_fullsized":"2023-07-05T18:57:16.288437+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T18:57:14.849454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T18:57:14.849454+0000","last_clean_scrub_stamp":"2023-07-05T18:57:14.849454+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T00:27:26.867027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1c","version":"34'2","reported_seq":15,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-05T18:57:16.902388+0000","last_change":"2023-07-05T18:57:14.871034+0000","last_active":"2023-07-05T18:57:16.902388+0000","last_peered":"2023-07-05T18:57:16.902388+0000","last_clean":"2023-07-05T18:57:16.902388+0000","last_became_active":"2023-07-05T18:57:14.870747+0000","last_became_peered":"2023-07-05T18:57:14.870747+0000","last_unstale":"2023-07-05T18:57:16.902388+0000","last_undegraded":"2023-07-05T18:57:16.902388+0000","last_fullsized":"2023-07-05T18:57:16.902388+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T18:57:13.843710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T18:57:13.843710+0000","last_clean_scrub_stamp":"2023-07-05T18:57:13.843710+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-06T23:06:04.685362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-05T18:57:16.902304+0000","last_change":"2023-07-05T18:57:15.303291+0000","last_active":"2023-07-05T18:57:16.902304+0000","last_peered":"2023-07-05T18:57:16.902304+0000","last_clean":"2023-07-05T18:57:16.902304+0000","last_became_active":"2023-07-05T18:57:15.303018+0000","last_became_peered":"2023-07-05T18:57:15.303018+0000","last_unstale":"2023-07-05T18:57:16.902304+0000","last_undegraded":"2023-07-05T18:57:16.902304+0000","last_fullsized":"2023-07-05T18:57:16.902304+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T18:57:14.849454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T18:57:14.849454+0000","last_clean_scrub_stamp":"2023-07-05T18:57:14.849454+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T03:13:42.345071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1b","version":"34'1","reported_seq":14,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-05T18:57:16.288864+0000","last_change":"2023-07-05T18:57:14.875155+0000","last_active":"2023-07-05T18:57:16.288864+0000","last_peered":"2023-07-05T18:57:16.288864+0000","last_clean":"2023-07-05T18:57:16.288864+0000","last_became_active":"2023-07-05T18:57:14.874878+0000","last_became_peered":"2023-07-05T18:57:14.874878+0000","last_unstale":"2023-07-05T18:57:16.288864+0000","last_undegraded":"2023-07-05T18:57:16.288864+0000","last_fullsized":"2023-07-05T18:57:16.288864+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T18:57:13.843710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T18:57:13.843710+0000","last_clean_scrub_stamp":"2023-07-05T18:57:13.843710+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-06T21:47:43.320275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-05T18:57:16.288638+0000","last_change":"2023-07-05T18:57:15.313975+0000","last_active":"2023-07-05T18:57:16.288638+0000","last_peered":"2023-07-05T18:57:16.288638+0000","last_clean":"2023-07-05T18:57:16.288638+0000","last_became_active":"2023-07-05T18:57:15.313680+0000","last_became_peered":"2023-07-05T18:57:15.313680+0000","last_unstale":"2023-07-05T18:57:16.288638+0000","last_undegraded":"2023-07-05T18:57:16.288638+0000","last_fullsized":"2023-07-05T18:57:16.288638+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T18:57:14.849454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T18:57:14.849454+0000","last_clean_scrub_stamp":"2023-07-05T18:57:14.849454+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T00:36:10.360647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"34'1","reported_seq":14,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-05T18:57:16.902508+0000","last_change":"2023-07-05T18:57:14.876845+0000","last_active":"2023-07-05T18:57:16.902508+0000","last_peered":"2023-07-05T18:57:16.902508+0000","last_clean":"2023-07-05T18:57:16.902508+0000","last_became_active":"2023-07-05T18:57:14.876604+0000","last_became_peered":"2023-07-05T18:57:14.876604+0000","last_unstale":"2023-07-05T18:57:16.902508+0000","last_undegraded":"2023-07-05T18:57:16.902508+0000","last_fullsized":"2023-07-05T18:57:16.902508+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T18:57:13.843710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T18:57:13.843710+0000","last_clean_scrub_stamp":"2023-07-05T18:57:13.843710+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-06T19:34:11.700460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-05T18:57:16.902386+0000","last_change":"2023-07-05T18:57:15.305517+0000","last_active":"2023-07-05T18:57:16.902386+0000","last_peered":"2023-07-05T18:57:16.902386+0000","last_clean":"2023-07-05T18:57:16.902386+0000","last_became_active":"2023-07-05T18:57:15.305073+0000","last_became_peered":"2023-07-05T18:57:15.305073+0000","last_unstale":"2023-07-05T18:57:16.902386+0000","last_undegraded":"2023-07-05T18:57:16.902386+0000","last_fullsized":"2023-07-05T18:57:16.902386+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T18:57:14.849454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T18:57:14.849454+0000","last_clean_scrub_stamp":"2023-07-05T18:57:14.849454+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-06T20:02:33.895529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":13,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-05T18:57:16.903069+0000","last_change":"2023-07-05T18:57:14.877951+0000","last_active":"2023-07-05T18:57:16.903069+0000","last_peered":"2023-07-05T18:57:16.903069+0000","last_clean":"2023-07-05T18:57:16.903069+0000","last_became_active":"2023-07-05T18:57:14.877620+0000","last_became_peered":"2023-07-05T18:57:14.877620+0000","last_unstale":"2023-07-05T18:57:16.903069+0000","last_undegraded":"2023-07-05T18:57:16.903069+0000","last_fullsized":"2023-07-05T18:57:16.903069+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T18:57:13.843710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T18:57:13.843710+0000","last_clean_scrub_stamp":"2023-07-05T18:57:13.843710+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T03:13:41.339326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-05T18:57:16.288240+0000","last_change":"2023-07-05T18:57:15.293938+0000","last_active":"2023-07-05T18:57:16.288240+0000","last_peered":"2023-07-05T18:57:16.288240+0000","last_clean":"2023-07-05T18:57:16.288240+0000","last_became_active":"2023-07-05T18:57:15.293511+0000","last_became_peered":"2023-07-05T18:57:15.293511+0000","last_unstale":"2023-07-05T18:57:16.288240+0000","last_undegraded":"2023-07-05T18:57:16.288240+0000","last_fullsized":"2023-07-05T18:57:16.288240+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T18:57:14.849454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T18:57:14.849454+0000","last_clean_scrub_stamp":"2023-07-05T18:57:14.849454+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T03:41:31.158289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":13,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-05T18:57:16.902055+0000","last_change":"2023-07-05T18:57:14.876452+0000","last_active":"2023-07-05T18:57:16.902055+0000","last_peered":"2023-07-05T18:57:16.902055+0000","last_clean":"2023-07-05T18:57:16.902055+0000","last_became_active":"2023-07-05T18:57:14.874813+0000","last_became_peered":"2023-07-05T18:57:14.874813+0000","last_unstale":"2023-07-05T18:57:16.902055+0000","last_undegraded":"2023-07-05T18:57:16.902055+0000","last_fullsized":"2023-07-05T18:57:16.902055+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T18:57:13.843710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T18:57:13.843710+0000","last_clean_scrub_stamp":"2023-07-05T18:57:13.843710+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-06T22:35:01.302791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-05T18:57:16.902507+0000","last_change":"2023-07-05T18:57:15.306201+0000","last_active":"2023-07-05T18:57:16.902507+0000","last_peered":"2023-07-05T18:57:16.902507+0000","last_clean":"2023-07-05T18:57:16.902507+0000","last_became_active":"2023-07-05T18:57:15.305895+0000","last_became_peered":"2023-07-05T18:57:15.305895+0000","last_unstale":"2023-07-05T18:57:16.902507+0000","last_undegraded":"2023-07-05T18:57:16.902507+0000","last_fullsized":"2023-07-05T18:57:16.902507+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T18:57:14.849454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T18:57:14.849454+0000","last_clean_scrub_stamp":"2023-07-05T18:57:14.849454+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T03:54:04.950016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":13,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-05T18:57:16.288515+0000","last_change":"2023-07-05T18:57:14.868383+0000","last_active":"2023-07-05T18:57:16.288515+0000","last_peered":"2023-07-05T18:57:16.288515+0000","last_clean":"2023-07-05T18:57:16.288515+0000","last_became_active":"2023-07-05T18:57:14.868095+0000","last_became_peered":"2023-07-05T18:57:14.868095+0000","last_unstale":"2023-07-05T18:57:16.288515+0000","last_undegraded":"2023-07-05T18:57:16.288515+0000","last_fullsized":"2023-07-05T18:57:16.288515+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T18:57:13.843710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T18:57:13.843710+0000","last_clean_scrub_stamp":"2023-07-05T18:57:13.843710+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T06:06:36.403273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-05T18:57:16.902363+0000","last_change":"2023-07-05T18:57:15.297117+0000","last_active":"2023-07-05T18:57:16.902363+0000","last_peered":"2023-07-05T18:57:16.902363+0000","last_clean":"2023-07-05T18:57:16.902363+0000","last_became_active":"2023-07-05T18:57:15.296759+0000","last_became_peered":"2023-07-05T18:57:15.296759+0000","last_unstale":"2023-07-05T18:57:16.902363+0000","last_undegraded":"2023-07-05T18:57:16.902363+0000","last_fullsized":"2023-07-05T18:57:16.902363+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T18:57:14.849454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T18:57:14.849454+0000","last_clean_scrub_stamp":"2023-07-05T18:57:14.849454+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-06T23:49:23.200877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":13,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-05T18:57:16.289291+0000","last_change":"2023-07-05T18:57:14.872652+0000","last_active":"2023-07-05T18:57:16.289291+0000","last_peered":"2023-07-05T18:57:16.289291+0000","last_clean":"2023-07-05T18:57:16.289291+0000","last_became_active":"2023-07-05T18:57:14.870760+0000","last_became_peered":"2023-07-05T18:57:14.870760+0000","last_unstale":"2023-07-05T18:57:16.289291+0000","last_undegraded":"2023-07-05T18:57:16.289291+0000","last_fullsized":"2023-07-05T18:57:16.289291+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T18:57:13.843710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T18:57:13.843710+0000","last_clean_scrub_stamp":"2023-07-05T18:57:13.843710+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T02:13:58.970021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-05T18:57:16.903037+0000","last_change":"2023-07-05T18:57:15.297404+0000","last_active":"2023-07-05T18:57:16.903037+0000","last_peered":"2023-07-05T18:57:16.903037+0000","last_clean":"2023-07-05T18:57:16.903037+0000","last_became_active":"2023-07-05T18:57:15.297149+0000","last_became_peered":"2023-07-05T18:57:15.297149+0000","last_unstale":"2023-07-05T18:57:16.903037+0000","last_undegraded":"2023-07-05T18:57:16.903037+0000","last_fullsized":"2023-07-05T18:57:16.903037+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T18:57:14.849454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T18:57:14.849454+0000","last_clean_scrub_stamp":"2023-07-05T18:57:14.849454+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T05:42:15.537264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.15","version":"34'3","reported_seq":16,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-05T18:57:16.289284+0000","last_change":"2023-07-05T18:57:14.873684+0000","last_active":"2023-07-05T18:57:16.289284+0000","last_peered":"2023-07-05T18:57:16.289284+0000","last_clean":"2023-07-05T18:57:16.289284+0000","last_became_active":"2023-07-05T18:57:14.872919+0000","last_became_peered":"2023-07-05T18:57:14.872919+0000","last_unstale":"2023-07-05T18:57:16.289284+0000","last_undegraded":"2023-07-05T18:57:16.289284+0000","last_fullsized":"2023-07-05T18:57:16.289284+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T18:57:13.843710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T18:57:13.843710+0000","last_clean_scrub_stamp":"2023-07-05T18:57:13.843710+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-06T22:17:11.488295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-05T18:57:16.902740+0000","last_change":"2023-07-05T18:57:15.300105+0000","last_active":"2023-07-05T18:57:16.902740+0000","last_peered":"2023-07-05T18:57:16.902740+0000","last_clean":"2023-07-05T18:57:16.902740+0000","last_became_active":"2023-07-05T18:57:15.299823+0000","last_became_peered":"2023-07-05T18:57:15.299823+0000","last_unstale":"2023-07-05T18:57:16.902740+0000","last_undegraded":"2023-07-05T18:57:16.902740+0000","last_fullsized":"2023-07-05T18:57:16.902740+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T18:57:14.849454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T18:57:14.849454+0000","last_clean_scrub_stamp":"2023-07-05T18:57:14.849454+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-06T19:39:44.667228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.14","version":"34'6","reported_seq":19,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-05T18:57:16.288027+0000","last_change":"2023-07-05T18:57:14.871063+0000","last_active":"2023-07-05T18:57:16.288027+0000","last_peered":"2023-07-05T18:57:16.288027+0000","last_clean":"2023-07-05T18:57:16.288027+0000","last_became_active":"2023-07-05T18:57:14.870829+0000","last_became_peered":"2023-07-05T18:57:14.870829+0000","last_unstale":"2023-07-05T18:57:16.288027+0000","last_undegraded":"2023-07-05T18:57:16.288027+0000","last_fullsized":"2023-07-05T18:57:16.288027+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T18:57:13.843710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T18:57:13.843710+0000","last_clean_scrub_stamp":"2023-07-05T18:57:13.843710+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-06T23:55:02.541567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-05T18:57:16.903319+0000","last_change":"2023-07-05T18:57:15.312709+0000","last_active":"2023-07-05T18:57:16.903319+0000","last_peered":"2023-07-05T18:57:16.903319+0000","last_clean":"2023-07-05T18:57:16.903319+0000","last_became_active":"2023-07-05T18:57:15.312424+0000","last_became_peered":"2023-07-05T18:57:15.312424+0000","last_unstale":"2023-07-05T18:57:16.903319+0000","last_undegraded":"2023-07-05T18:57:16.903319+0000","last_fullsized":"2023-07-05T18:57:16.903319+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T18:57:14.849454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T18:57:14.849454+0000","last_clean_scrub_stamp":"2023-07-05T18:57:14.849454+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-06T23:13:44.165526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.13","version":"34'2","reported_seq":15,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-05T18:57:16.288270+0000","last_change":"2023-07-05T18:57:14.867341+0000","last_active":"2023-07-05T18:57:16.288270+0000","last_peered":"2023-07-05T18:57:16.288270+0000","last_clean":"2023-07-05T18:57:16.288270+0000","last_became_active":"2023-07-05T18:57:14.867009+0000","last_became_peered":"2023-07-05T18:57:14.867009+0000","last_unstale":"2023-07-05T18:57:16.288270+0000","last_undegraded":"2023-07-05T18:57:16.288270+0000","last_fullsized":"2023-07-05T18:57:16.288270+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T18:57:13.843710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T18:57:13.843710+0000","last_clean_scrub_stamp":"2023-07-05T18:57:13.843710+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-06T19:49:23.267131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-05T18:57:16.287947+0000","last_change":"2023-07-05T18:57:15.294525+0000","last_active":"2023-07-05T18:57:16.287947+0000","last_peered":"2023-07-05T18:57:16.287947+0000","last_clean":"2023-07-05T18:57:16.287947+0000","last_became_active":"2023-07-05T18:57:15.294277+0000","last_became_peered":"2023-07-05T18:57:15.294277+0000","last_unstale":"2023-07-05T18:57:16.287947+0000","last_undegraded":"2023-07-05T18:57:16.287947+0000","last_fullsized":"2023-07-05T18:57:16.287947+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T18:57:14.849454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T18:57:14.849454+0000","last_clean_scrub_stamp":"2023-07-05T18:57:14.849454+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-06T20:06:27.731618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":13,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-05T18:57:16.902818+0000","last_change":"2023-07-05T18:57:14.871127+0000","last_active":"2023-07-05T18:57:16.902818+0000","last_peered":"2023-07-05T18:57:16.902818+0000","last_clean":"2023-07-05T18:57:16.902818+0000","last_became_active":"2023-07-05T18:57:14.870805+0000","last_became_peered":"2023-07-05T18:57:14.870805+0000","last_unstale":"2023-07-05T18:57:16.902818+0000","last_undegraded":"2023-07-05T18:57:16.902818+0000","last_fullsized":"2023-07-05T18:57:16.902818+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T18:57:13.843710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T18:57:13.843710+0000","last_clean_scrub_stamp":"2023-07-05T18:57:13.843710+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-06T21:35:56.375870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-05T18:57:16.902337+0000","last_change":"2023-07-05T18:57:15.303543+0000","last_active":"2023-07-05T18:57:16.902337+0000","last_peered":"2023-07-05T18:57:16.902337+0000","last_clean":"2023-07-05T18:57:16.902337+0000","last_became_active":"2023-07-05T18:57:15.302907+0000","last_became_peered":"2023-07-05T18:57:15.302907+0000","last_unstale":"2023-07-05T18:57:16.902337+0000","last_undegraded":"2023-07-05T18:57:16.902337+0000","last_fullsized":"2023-07-05T18:57:16.902337+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T18:57:14.849454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T18:57:14.849454+0000","last_clean_scrub_stamp":"2023-07-05T18:57:14.849454+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-06T19:47:23.141648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":13,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-05T18:57:16.287236+0000","last_change":"2023-07-05T18:57:14.865286+0000","last_active":"2023-07-05T18:57:16.287236+0000","last_peered":"2023-07-05T18:57:16.287236+0000","last_clean":"2023-07-05T18:57:16.287236+0000","last_became_active":"2023-07-05T18:57:14.864973+0000","last_became_peered":"2023-07-05T18:57:14.864973+0000","last_unstale":"2023-07-05T18:57:16.287236+0000","last_undegraded":"2023-07-05T18:57:16.287236+0000","last_fullsized":"2023-07-05T18:57:16.287236+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T18:57:13.843710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T18:57:13.843710+0000","last_clean_scrub_stamp":"2023-07-05T18:57:13.843710+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T01:59:44.906357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-05T18:57:16.288154+0000","last_change":"2023-07-05T18:57:15.294527+0000","last_active":"2023-07-05T18:57:16.288154+0000","last_peered":"2023-07-05T18:57:16.288154+0000","last_clean":"2023-07-05T18:57:16.288154+0000","last_became_active":"2023-07-05T18:57:15.294266+0000","last_became_peered":"2023-07-05T18:57:15.294266+0000","last_unstale":"2023-07-05T18:57:16.288154+0000","last_undegraded":"2023-07-05T18:57:16.288154+0000","last_fullsized":"2023-07-05T18:57:16.288154+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T18:57:14.849454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T18:57:14.849454+0000","last_clean_scrub_stamp":"2023-07-05T18:57:14.849454+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-06T19:50:35.627327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.10","version":"34'8","reported_seq":21,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-05T18:57:16.902137+0000","last_change":"2023-07-05T18:57:14.875807+0000","last_active":"2023-07-05T18:57:16.902137+0000","last_peered":"2023-07-05T18:57:16.902137+0000","last_clean":"2023-07-05T18:57:16.902137+0000","last_became_active":"2023-07-05T18:57:14.875478+0000","last_became_peered":"2023-07-05T18:57:14.875478+0000","last_unstale":"2023-07-05T18:57:16.902137+0000","last_undegraded":"2023-07-05T18:57:16.902137+0000","last_fullsized":"2023-07-05T18:57:16.902137+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T18:57:13.843710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T18:57:13.843710+0000","last_clean_scrub_stamp":"2023-07-05T18:57:13.843710+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T03:30:52.819851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-05T18:57:16.288000+0000","last_change":"2023-07-05T18:57:15.295969+0000","last_active":"2023-07-05T18:57:16.288000+0000","last_peered":"2023-07-05T18:57:16.288000+0000","last_clean":"2023-07-05T18:57:16.288000+0000","last_became_active":"2023-07-05T18:57:15.295680+0000","last_became_peered":"2023-07-05T18:57:15.295680+0000","last_unstale":"2023-07-05T18:57:16.288000+0000","last_undegraded":"2023-07-05T18:57:16.288000+0000","last_fullsized":"2023-07-05T18:57:16.288000+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T18:57:14.849454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T18:57:14.849454+0000","last_clean_scrub_stamp":"2023-07-05T18:57:14.849454+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T06:06:42.883138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"34'1","reported_seq":14,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-05T18:57:16.289419+0000","last_change":"2023-07-05T18:57:14.873803+0000","last_active":"2023-07-05T18:57:16.289419+0000","last_peered":"2023-07-05T18:57:16.289419+0000","last_clean":"2023-07-05T18:57:16.289419+0000","last_became_active":"2023-07-05T18:57:14.872369+0000","last_became_peered":"2023-07-05T18:57:14.872369+0000","last_unstale":"2023-07-05T18:57:16.289419+0000","last_undegraded":"2023-07-05T18:57:16.289419+0000","last_fullsized":"2023-07-05T18:57:16.289419+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T18:57:13.843710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T18:57:13.843710+0000","last_clean_scrub_stamp":"2023-07-05T18:57:13.843710+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-06T23:25:38.743247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-05T18:57:16.289157+0000","last_change":"2023-07-05T18:57:15.312760+0000","last_active":"2023-07-05T18:57:16.289157+0000","last_peered":"2023-07-05T18:57:16.289157+0000","last_clean":"2023-07-05T18:57:16.289157+0000","last_became_active":"2023-07-05T18:57:15.309414+0000","last_became_peered":"2023-07-05T18:57:15.309414+0000","last_unstale":"2023-07-05T18:57:16.289157+0000","last_undegraded":"2023-07-05T18:57:16.289157+0000","last_fullsized":"2023-07-05T18:57:16.289157+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T18:57:14.849454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T18:57:14.849454+0000","last_clean_scrub_stamp":"2023-07-05T18:57:14.849454+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-06T23:35:17.443605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.e","version":"34'2","reported_seq":15,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-05T18:57:16.903852+0000","last_change":"2023-07-05T18:57:14.878164+0000","last_active":"2023-07-05T18:57:16.903852+0000","last_peered":"2023-07-05T18:57:16.903852+0000","last_clean":"2023-07-05T18:57:16.903852+0000","last_became_active":"2023-07-05T18:57:14.877894+0000","last_became_peered":"2023-07-05T18:57:14.877894+0000","last_unstale":"2023-07-05T18:57:16.903852+0000","last_undegraded":"2023-07-05T18:57:16.903852+0000","last_fullsized":"2023-07-05T18:57:16.903852+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T18:57:13.843710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T18:57:13.843710+0000","last_clean_scrub_stamp":"2023-07-05T18:57:13.843710+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-06T20:29:51.953677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-05T18:57:16.902882+0000","last_change":"2023-07-05T18:57:15.296980+0000","last_active":"2023-07-05T18:57:16.902882+0000","last_peered":"2023-07-05T18:57:16.902882+0000","last_clean":"2023-07-05T18:57:16.902882+0000","last_became_active":"2023-07-05T18:57:15.296735+0000","last_became_peered":"2023-07-05T18:57:15.296735+0000","last_unstale":"2023-07-05T18:57:16.902882+0000","last_undegraded":"2023-07-05T18:57:16.902882+0000","last_fullsized":"2023-07-05T18:57:16.902882+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T18:57:14.849454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T18:57:14.849454+0000","last_clean_scrub_stamp":"2023-07-05T18:57:14.849454+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T00:36:40.610171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"34'1","reported_seq":14,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-05T18:57:16.903259+0000","last_change":"2023-07-05T18:57:14.875059+0000","last_active":"2023-07-05T18:57:16.903259+0000","last_peered":"2023-07-05T18:57:16.903259+0000","last_clean":"2023-07-05T18:57:16.903259+0000","last_became_active":"2023-07-05T18:57:14.874735+0000","last_became_peered":"2023-07-05T18:57:14.874735+0000","last_unstale":"2023-07-05T18:57:16.903259+0000","last_undegraded":"2023-07-05T18:57:16.903259+0000","last_fullsized":"2023-07-05T18:57:16.903259+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T18:57:13.843710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T18:57:13.843710+0000","last_clean_scrub_stamp":"2023-07-05T18:57:13.843710+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T03:00:51.566595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-05T18:57:16.902678+0000","last_change":"2023-07-05T18:57:15.303267+0000","last_active":"2023-07-05T18:57:16.902678+0000","last_peered":"2023-07-05T18:57:16.902678+0000","last_clean":"2023-07-05T18:57:16.902678+0000","last_became_active":"2023-07-05T18:57:15.302990+0000","last_became_peered":"2023-07-05T18:57:15.302990+0000","last_unstale":"2023-07-05T18:57:16.902678+0000","last_undegraded":"2023-07-05T18:57:16.902678+0000","last_fullsized":"2023-07-05T18:57:16.902678+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T18:57:14.849454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T18:57:14.849454+0000","last_clean_scrub_stamp":"2023-07-05T18:57:14.849454+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-06T22:01:40.742324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":13,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-05T18:57:16.902425+0000","last_change":"2023-07-05T18:57:14.872573+0000","last_active":"2023-07-05T18:57:16.902425+0000","last_peered":"2023-07-05T18:57:16.902425+0000","last_clean":"2023-07-05T18:57:16.902425+0000","last_became_active":"2023-07-05T18:57:14.872254+0000","last_became_peered":"2023-07-05T18:57:14.872254+0000","last_unstale":"2023-07-05T18:57:16.902425+0000","last_undegraded":"2023-07-05T18:57:16.902425+0000","last_fullsized":"2023-07-05T18:57:16.902425+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T18:57:13.843710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T18:57:13.843710+0000","last_clean_scrub_stamp":"2023-07-05T18:57:13.843710+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-06T21:25:45.377212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-05T18:57:16.901941+0000","last_change":"2023-07-05T18:57:15.303796+0000","last_active":"2023-07-05T18:57:16.901941+0000","last_peered":"2023-07-05T18:57:16.901941+0000","last_clean":"2023-07-05T18:57:16.901941+0000","last_became_active":"2023-07-05T18:57:15.303080+0000","last_became_peered":"2023-07-05T18:57:15.303080+0000","last_unstale":"2023-07-05T18:57:16.901941+0000","last_undegraded":"2023-07-05T18:57:16.901941+0000","last_fullsized":"2023-07-05T18:57:16.901941+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T18:57:14.849454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T18:57:14.849454+0000","last_clean_scrub_stamp":"2023-07-05T18:57:14.849454+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T02:19:32.422081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"34'2","reported_seq":15,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-05T18:57:16.902329+0000","last_change":"2023-07-05T18:57:14.872481+0000","last_active":"2023-07-05T18:57:16.902329+0000","last_peered":"2023-07-05T18:57:16.902329+0000","last_clean":"2023-07-05T18:57:16.902329+0000","last_became_active":"2023-07-05T18:57:14.872155+0000","last_became_peered":"2023-07-05T18:57:14.872155+0000","last_unstale":"2023-07-05T18:57:16.902329+0000","last_undegraded":"2023-07-05T18:57:16.902329+0000","last_fullsized":"2023-07-05T18:57:16.902329+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T18:57:13.843710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T18:57:13.843710+0000","last_clean_scrub_stamp":"2023-07-05T18:57:13.843710+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T06:42:22.419375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-05T18:57:16.902539+0000","last_change":"2023-07-05T18:57:15.300636+0000","last_active":"2023-07-05T18:57:16.902539+0000","last_peered":"2023-07-05T18:57:16.902539+0000","last_clean":"2023-07-05T18:57:16.902539+0000","last_became_active":"2023-07-05T18:57:15.300386+0000","last_became_peered":"2023-07-05T18:57:15.300386+0000","last_unstale":"2023-07-05T18:57:16.902539+0000","last_undegraded":"2023-07-05T18:57:16.902539+0000","last_fullsized":"2023-07-05T18:57:16.902539+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T18:57:14.849454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T18:57:14.849454+0000","last_clean_scrub_stamp":"2023-07-05T18:57:14.849454+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T01:59:45.912101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":13,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-05T18:57:16.903398+0000","last_change":"2023-07-05T18:57:14.875093+0000","last_active":"2023-07-05T18:57:16.903398+0000","last_peered":"2023-07-05T18:57:16.903398+0000","last_clean":"2023-07-05T18:57:16.903398+0000","last_became_active":"2023-07-05T18:57:14.874732+0000","last_became_peered":"2023-07-05T18:57:14.874732+0000","last_unstale":"2023-07-05T18:57:16.903398+0000","last_undegraded":"2023-07-05T18:57:16.903398+0000","last_fullsized":"2023-07-05T18:57:16.903398+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T18:57:13.843710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T18:57:13.843710+0000","last_clean_scrub_stamp":"2023-07-05T18:57:13.843710+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-06T20:43:32.142269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-05T18:57:16.288708+0000","last_change":"2023-07-05T18:57:15.314608+0000","last_active":"2023-07-05T18:57:16.288708+0000","last_peered":"2023-07-05T18:57:16.288708+0000","last_clean":"2023-07-05T18:57:16.288708+0000","last_became_active":"2023-07-05T18:57:15.314112+0000","last_became_peered":"2023-07-05T18:57:15.314112+0000","last_unstale":"2023-07-05T18:57:16.288708+0000","last_undegraded":"2023-07-05T18:57:16.288708+0000","last_fullsized":"2023-07-05T18:57:16.288708+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T18:57:14.849454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T18:57:14.849454+0000","last_clean_scrub_stamp":"2023-07-05T18:57:14.849454+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-06T23:18:05.690541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":13,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-05T18:57:16.902655+0000","last_change":"2023-07-05T18:57:14.877841+0000","last_active":"2023-07-05T18:57:16.902655+0000","last_peered":"2023-07-05T18:57:16.902655+0000","last_clean":"2023-07-05T18:57:16.902655+0000","last_became_active":"2023-07-05T18:57:14.877549+0000","last_became_peered":"2023-07-05T18:57:14.877549+0000","last_unstale":"2023-07-05T18:57:16.902655+0000","last_undegraded":"2023-07-05T18:57:16.902655+0000","last_fullsized":"2023-07-05T18:57:16.902655+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T18:57:13.843710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T18:57:13.843710+0000","last_clean_scrub_stamp":"2023-07-05T18:57:13.843710+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-06T20:06:26.725873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-05T18:57:16.288174+0000","last_change":"2023-07-05T18:57:15.297023+0000","last_active":"2023-07-05T18:57:16.288174+0000","last_peered":"2023-07-05T18:57:16.288174+0000","last_clean":"2023-07-05T18:57:16.288174+0000","last_became_active":"2023-07-05T18:57:15.296647+0000","last_became_peered":"2023-07-05T18:57:15.296647+0000","last_unstale":"2023-07-05T18:57:16.288174+0000","last_undegraded":"2023-07-05T18:57:16.288174+0000","last_fullsized":"2023-07-05T18:57:16.288174+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T18:57:14.849454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T18:57:14.849454+0000","last_clean_scrub_stamp":"2023-07-05T18:57:14.849454+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-06T19:54:51.648791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":13,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-05T18:57:16.902187+0000","last_change":"2023-07-05T18:57:14.872782+0000","last_active":"2023-07-05T18:57:16.902187+0000","last_peered":"2023-07-05T18:57:16.902187+0000","last_clean":"2023-07-05T18:57:16.902187+0000","last_became_active":"2023-07-05T18:57:14.872232+0000","last_became_peered":"2023-07-05T18:57:14.872232+0000","last_unstale":"2023-07-05T18:57:16.902187+0000","last_undegraded":"2023-07-05T18:57:16.902187+0000","last_fullsized":"2023-07-05T18:57:16.902187+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T18:57:13.843710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T18:57:13.843710+0000","last_clean_scrub_stamp":"2023-07-05T18:57:13.843710+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T06:21:50.233944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-05T18:57:16.902473+0000","last_change":"2023-07-05T18:57:15.304809+0000","last_active":"2023-07-05T18:57:16.902473+0000","last_peered":"2023-07-05T18:57:16.902473+0000","last_clean":"2023-07-05T18:57:16.902473+0000","last_became_active":"2023-07-05T18:57:15.304547+0000","last_became_peered":"2023-07-05T18:57:15.304547+0000","last_unstale":"2023-07-05T18:57:16.902473+0000","last_undegraded":"2023-07-05T18:57:16.902473+0000","last_fullsized":"2023-07-05T18:57:16.902473+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T18:57:14.849454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T18:57:14.849454+0000","last_clean_scrub_stamp":"2023-07-05T18:57:14.849454+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T04:42:25.968984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":13,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-05T18:57:16.902058+0000","last_change":"2023-07-05T18:57:14.868177+0000","last_active":"2023-07-05T18:57:16.902058+0000","last_peered":"2023-07-05T18:57:16.902058+0000","last_clean":"2023-07-05T18:57:16.902058+0000","last_became_active":"2023-07-05T18:57:14.867910+0000","last_became_peered":"2023-07-05T18:57:14.867910+0000","last_unstale":"2023-07-05T18:57:16.902058+0000","last_undegraded":"2023-07-05T18:57:16.902058+0000","last_fullsized":"2023-07-05T18:57:16.902058+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T18:57:13.843710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T18:57:13.843710+0000","last_clean_scrub_stamp":"2023-07-05T18:57:13.843710+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T00:40:15.317178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":43,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-05T18:57:16.902245+0000","last_change":"2023-07-05T18:56:09.622184+0000","last_active":"2023-07-05T18:57:16.902245+0000","last_peered":"2023-07-05T18:57:16.902245+0000","last_clean":"2023-07-05T18:57:16.902245+0000","last_became_active":"2023-07-05T18:56:09.621796+0000","last_became_peered":"2023-07-05T18:56:09.621796+0000","last_unstale":"2023-07-05T18:57:16.902245+0000","last_undegraded":"2023-07-05T18:57:16.902245+0000","last_fullsized":"2023-07-05T18:57:16.902245+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T18:56:08.603137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T18:56:08.603137+0000","last_clean_scrub_stamp":"2023-07-05T18:56:08.603137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T05:27:00.658957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-05T18:57:16.902748+0000","last_change":"2023-07-05T18:57:15.296916+0000","last_active":"2023-07-05T18:57:16.902748+0000","last_peered":"2023-07-05T18:57:16.902748+0000","last_clean":"2023-07-05T18:57:16.902748+0000","last_became_active":"2023-07-05T18:57:15.296598+0000","last_became_peered":"2023-07-05T18:57:15.296598+0000","last_unstale":"2023-07-05T18:57:16.902748+0000","last_undegraded":"2023-07-05T18:57:16.902748+0000","last_fullsized":"2023-07-05T18:57:16.902748+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T18:57:14.849454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T18:57:14.849454+0000","last_clean_scrub_stamp":"2023-07-05T18:57:14.849454+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T06:06:42.883138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":13,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-05T18:57:16.287874+0000","last_change":"2023-07-05T18:57:14.868436+0000","last_active":"2023-07-05T18:57:16.287874+0000","last_peered":"2023-07-05T18:57:16.287874+0000","last_clean":"2023-07-05T18:57:16.287874+0000","last_became_active":"2023-07-05T18:57:14.868144+0000","last_became_peered":"2023-07-05T18:57:14.868144+0000","last_unstale":"2023-07-05T18:57:16.287874+0000","last_undegraded":"2023-07-05T18:57:16.287874+0000","last_fullsized":"2023-07-05T18:57:16.287874+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T18:57:13.843710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T18:57:13.843710+0000","last_clean_scrub_stamp":"2023-07-05T18:57:13.843710+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-06T19:34:11.700460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":47,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-05T18:57:16.288044+0000","last_change":"2023-07-05T18:56:09.621596+0000","last_active":"2023-07-05T18:57:16.288044+0000","last_peered":"2023-07-05T18:57:16.288044+0000","last_clean":"2023-07-05T18:57:16.288044+0000","last_became_active":"2023-07-05T18:56:09.621315+0000","last_became_peered":"2023-07-05T18:56:09.621315+0000","last_unstale":"2023-07-05T18:57:16.288044+0000","last_undegraded":"2023-07-05T18:57:16.288044+0000","last_fullsized":"2023-07-05T18:57:16.288044+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T18:56:08.603137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T18:56:08.603137+0000","last_clean_scrub_stamp":"2023-07-05T18:56:08.603137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T00:49:55.435406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-05T18:57:16.902298+0000","last_change":"2023-07-05T18:57:15.312976+0000","last_active":"2023-07-05T18:57:16.902298+0000","last_peered":"2023-07-05T18:57:16.902298+0000","last_clean":"2023-07-05T18:57:16.902298+0000","last_became_active":"2023-07-05T18:57:15.312685+0000","last_became_peered":"2023-07-05T18:57:15.312685+0000","last_unstale":"2023-07-05T18:57:16.902298+0000","last_undegraded":"2023-07-05T18:57:16.902298+0000","last_fullsized":"2023-07-05T18:57:16.902298+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T18:57:14.849454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T18:57:14.849454+0000","last_clean_scrub_stamp":"2023-07-05T18:57:14.849454+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T00:22:30.408426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"34'2","reported_seq":15,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-05T18:57:16.289516+0000","last_change":"2023-07-05T18:57:14.870692+0000","last_active":"2023-07-05T18:57:16.289516+0000","last_peered":"2023-07-05T18:57:16.289516+0000","last_clean":"2023-07-05T18:57:16.289516+0000","last_became_active":"2023-07-05T18:57:14.870369+0000","last_became_peered":"2023-07-05T18:57:14.870369+0000","last_unstale":"2023-07-05T18:57:16.289516+0000","last_undegraded":"2023-07-05T18:57:16.289516+0000","last_fullsized":"2023-07-05T18:57:16.289516+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T18:57:13.843710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T18:57:13.843710+0000","last_clean_scrub_stamp":"2023-07-05T18:57:13.843710+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-06T22:30:26.465637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":43,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-05T18:57:16.902721+0000","last_change":"2023-07-05T18:56:09.617992+0000","last_active":"2023-07-05T18:57:16.902721+0000","last_peered":"2023-07-05T18:57:16.902721+0000","last_clean":"2023-07-05T18:57:16.902721+0000","last_became_active":"2023-07-05T18:56:09.617720+0000","last_became_peered":"2023-07-05T18:56:09.617720+0000","last_unstale":"2023-07-05T18:57:16.902721+0000","last_undegraded":"2023-07-05T18:57:16.902721+0000","last_fullsized":"2023-07-05T18:57:16.902721+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T18:56:08.603137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T18:56:08.603137+0000","last_clean_scrub_stamp":"2023-07-05T18:56:08.603137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T04:57:05.237675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"17'117","reported_seq":191,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-05T18:57:16.902380+0000","last_change":"2023-07-05T18:56:09.621746+0000","last_active":"2023-07-05T18:57:16.902380+0000","last_peered":"2023-07-05T18:57:16.902380+0000","last_clean":"2023-07-05T18:57:16.902380+0000","last_became_active":"2023-07-05T18:56:09.621421+0000","last_became_peered":"2023-07-05T18:56:09.621421+0000","last_unstale":"2023-07-05T18:57:16.902380+0000","last_undegraded":"2023-07-05T18:57:16.902380+0000","last_fullsized":"2023-07-05T18:57:16.902380+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T18:56:08.603137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T18:56:08.603137+0000","last_clean_scrub_stamp":"2023-07-05T18:56:08.603137+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T03:44:38.126068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-05T18:57:16.902466+0000","last_change":"2023-07-05T18:57:15.297302+0000","last_active":"2023-07-05T18:57:16.902466+0000","last_peered":"2023-07-05T18:57:16.902466+0000","last_clean":"2023-07-05T18:57:16.902466+0000","last_became_active":"2023-07-05T18:57:15.296988+0000","last_became_peered":"2023-07-05T18:57:15.296988+0000","last_unstale":"2023-07-05T18:57:16.902466+0000","last_undegraded":"2023-07-05T18:57:16.902466+0000","last_fullsized":"2023-07-05T18:57:16.902466+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T18:57:14.849454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T18:57:14.849454+0000","last_clean_scrub_stamp":"2023-07-05T18:57:14.849454+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T05:24:11.585127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":13,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-05T18:57:16.903073+0000","last_change":"2023-07-05T18:57:14.875225+0000","last_active":"2023-07-05T18:57:16.903073+0000","last_peered":"2023-07-05T18:57:16.903073+0000","last_clean":"2023-07-05T18:57:16.903073+0000","last_became_active":"2023-07-05T18:57:14.874813+0000","last_became_peered":"2023-07-05T18:57:14.874813+0000","last_unstale":"2023-07-05T18:57:16.903073+0000","last_undegraded":"2023-07-05T18:57:16.903073+0000","last_fullsized":"2023-07-05T18:57:16.903073+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T18:57:13.843710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T18:57:13.843710+0000","last_clean_scrub_stamp":"2023-07-05T18:57:13.843710+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-06T22:03:48.596854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":41,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-05T18:57:16.902381+0000","last_change":"2023-07-05T18:56:10.073940+0000","last_active":"2023-07-05T18:57:16.902381+0000","last_peered":"2023-07-05T18:57:16.902381+0000","last_clean":"2023-07-05T18:57:16.902381+0000","last_became_active":"2023-07-05T18:56:10.073617+0000","last_became_peered":"2023-07-05T18:56:10.073617+0000","last_unstale":"2023-07-05T18:57:16.902381+0000","last_undegraded":"2023-07-05T18:57:16.902381+0000","last_fullsized":"2023-07-05T18:57:16.902381+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T18:56:08.603137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T18:56:08.603137+0000","last_clean_scrub_stamp":"2023-07-05T18:56:08.603137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T00:26:41.125608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-05T18:57:16.289423+0000","last_change":"2023-07-05T18:57:15.309418+0000","last_active":"2023-07-05T18:57:16.289423+0000","last_peered":"2023-07-05T18:57:16.289423+0000","last_clean":"2023-07-05T18:57:16.289423+0000","last_became_active":"2023-07-05T18:57:15.307981+0000","last_became_peered":"2023-07-05T18:57:15.307981+0000","last_unstale":"2023-07-05T18:57:16.289423+0000","last_undegraded":"2023-07-05T18:57:16.289423+0000","last_fullsized":"2023-07-05T18:57:16.289423+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T18:57:14.849454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T18:57:14.849454+0000","last_clean_scrub_stamp":"2023-07-05T18:57:14.849454+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-06T19:17:01.359434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":13,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-05T18:57:16.902120+0000","last_change":"2023-07-05T18:57:14.875117+0000","last_active":"2023-07-05T18:57:16.902120+0000","last_peered":"2023-07-05T18:57:16.902120+0000","last_clean":"2023-07-05T18:57:16.902120+0000","last_became_active":"2023-07-05T18:57:14.874832+0000","last_became_peered":"2023-07-05T18:57:14.874832+0000","last_unstale":"2023-07-05T18:57:16.902120+0000","last_undegraded":"2023-07-05T18:57:16.902120+0000","last_fullsized":"2023-07-05T18:57:16.902120+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T18:57:13.843710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T18:57:13.843710+0000","last_clean_scrub_stamp":"2023-07-05T18:57:13.843710+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T01:04:32.104127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":41,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-05T18:57:16.902232+0000","last_change":"2023-07-05T18:56:10.073658+0000","last_active":"2023-07-05T18:57:16.902232+0000","last_peered":"2023-07-05T18:57:16.902232+0000","last_clean":"2023-07-05T18:57:16.902232+0000","last_became_active":"2023-07-05T18:56:10.073336+0000","last_became_peered":"2023-07-05T18:56:10.073336+0000","last_unstale":"2023-07-05T18:57:16.902232+0000","last_undegraded":"2023-07-05T18:57:16.902232+0000","last_fullsized":"2023-07-05T18:57:16.902232+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T18:56:08.603137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T18:56:08.603137+0000","last_clean_scrub_stamp":"2023-07-05T18:56:08.603137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T05:22:57.057362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-05T18:57:16.288425+0000","last_change":"2023-07-05T18:57:15.304874+0000","last_active":"2023-07-05T18:57:16.288425+0000","last_peered":"2023-07-05T18:57:16.288425+0000","last_clean":"2023-07-05T18:57:16.288425+0000","last_became_active":"2023-07-05T18:57:15.304585+0000","last_became_peered":"2023-07-05T18:57:15.304585+0000","last_unstale":"2023-07-05T18:57:16.288425+0000","last_undegraded":"2023-07-05T18:57:16.288425+0000","last_fullsized":"2023-07-05T18:57:16.288425+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T18:57:14.849454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T18:57:14.849454+0000","last_clean_scrub_stamp":"2023-07-05T18:57:14.849454+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-06T21:00:32.168356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":13,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-05T18:57:16.903130+0000","last_change":"2023-07-05T18:57:14.868208+0000","last_active":"2023-07-05T18:57:16.903130+0000","last_peered":"2023-07-05T18:57:16.903130+0000","last_clean":"2023-07-05T18:57:16.903130+0000","last_became_active":"2023-07-05T18:57:14.867910+0000","last_became_peered":"2023-07-05T18:57:14.867910+0000","last_unstale":"2023-07-05T18:57:16.903130+0000","last_undegraded":"2023-07-05T18:57:16.903130+0000","last_fullsized":"2023-07-05T18:57:16.903130+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T18:57:13.843710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T18:57:13.843710+0000","last_clean_scrub_stamp":"2023-07-05T18:57:13.843710+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T03:17:08.791872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":41,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-05T18:57:16.288767+0000","last_change":"2023-07-05T18:56:10.073693+0000","last_active":"2023-07-05T18:57:16.288767+0000","last_peered":"2023-07-05T18:57:16.288767+0000","last_clean":"2023-07-05T18:57:16.288767+0000","last_became_active":"2023-07-05T18:56:10.073356+0000","last_became_peered":"2023-07-05T18:56:10.073356+0000","last_unstale":"2023-07-05T18:57:16.288767+0000","last_undegraded":"2023-07-05T18:57:16.288767+0000","last_fullsized":"2023-07-05T18:57:16.288767+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T18:56:08.603137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T18:56:08.603137+0000","last_clean_scrub_stamp":"2023-07-05T18:56:08.603137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-06T20:40:01.347345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-05T18:57:16.902940+0000","last_change":"2023-07-05T18:57:15.299274+0000","last_active":"2023-07-05T18:57:16.902940+0000","last_peered":"2023-07-05T18:57:16.902940+0000","last_clean":"2023-07-05T18:57:16.902940+0000","last_became_active":"2023-07-05T18:57:15.298921+0000","last_became_peered":"2023-07-05T18:57:15.298921+0000","last_unstale":"2023-07-05T18:57:16.902940+0000","last_undegraded":"2023-07-05T18:57:16.902940+0000","last_fullsized":"2023-07-05T18:57:16.902940+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T18:57:14.849454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T18:57:14.849454+0000","last_clean_scrub_stamp":"2023-07-05T18:57:14.849454+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T02:38:57.649236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":13,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-05T18:57:16.287567+0000","last_change":"2023-07-05T18:57:14.866553+0000","last_active":"2023-07-05T18:57:16.287567+0000","last_peered":"2023-07-05T18:57:16.287567+0000","last_clean":"2023-07-05T18:57:16.287567+0000","last_became_active":"2023-07-05T18:57:14.866249+0000","last_became_peered":"2023-07-05T18:57:14.866249+0000","last_unstale":"2023-07-05T18:57:16.287567+0000","last_undegraded":"2023-07-05T18:57:16.287567+0000","last_fullsized":"2023-07-05T18:57:16.287567+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T18:57:13.843710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T18:57:13.843710+0000","last_clean_scrub_stamp":"2023-07-05T18:57:13.843710+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T03:42:11.743991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":43,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-05T18:57:16.287873+0000","last_change":"2023-07-05T18:56:10.073639+0000","last_active":"2023-07-05T18:57:16.287873+0000","last_peered":"2023-07-05T18:57:16.287873+0000","last_clean":"2023-07-05T18:57:16.287873+0000","last_became_active":"2023-07-05T18:56:10.073339+0000","last_became_peered":"2023-07-05T18:56:10.073339+0000","last_unstale":"2023-07-05T18:57:16.287873+0000","last_undegraded":"2023-07-05T18:57:16.287873+0000","last_fullsized":"2023-07-05T18:57:16.287873+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T18:56:08.603137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T18:56:08.603137+0000","last_clean_scrub_stamp":"2023-07-05T18:56:08.603137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T05:17:49.671863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-05T18:57:16.902503+0000","last_change":"2023-07-05T18:57:15.294526+0000","last_active":"2023-07-05T18:57:16.902503+0000","last_peered":"2023-07-05T18:57:16.902503+0000","last_clean":"2023-07-05T18:57:16.902503+0000","last_became_active":"2023-07-05T18:57:15.294262+0000","last_became_peered":"2023-07-05T18:57:15.294262+0000","last_unstale":"2023-07-05T18:57:16.902503+0000","last_undegraded":"2023-07-05T18:57:16.902503+0000","last_fullsized":"2023-07-05T18:57:16.902503+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T18:57:14.849454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T18:57:14.849454+0000","last_clean_scrub_stamp":"2023-07-05T18:57:14.849454+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-06T21:21:54.546636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":13,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-05T18:57:16.902958+0000","last_change":"2023-07-05T18:57:14.870468+0000","last_active":"2023-07-05T18:57:16.902958+0000","last_peered":"2023-07-05T18:57:16.902958+0000","last_clean":"2023-07-05T18:57:16.902958+0000","last_became_active":"2023-07-05T18:57:14.870132+0000","last_became_peered":"2023-07-05T18:57:14.870132+0000","last_unstale":"2023-07-05T18:57:16.902958+0000","last_undegraded":"2023-07-05T18:57:16.902958+0000","last_fullsized":"2023-07-05T18:57:16.902958+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T18:57:13.843710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T18:57:13.843710+0000","last_clean_scrub_stamp":"2023-07-05T18:57:13.843710+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-06T23:18:28.310679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":43,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-05T18:57:16.287900+0000","last_change":"2023-07-05T18:56:09.619299+0000","last_active":"2023-07-05T18:57:16.287900+0000","last_peered":"2023-07-05T18:57:16.287900+0000","last_clean":"2023-07-05T18:57:16.287900+0000","last_became_active":"2023-07-05T18:56:09.618958+0000","last_became_peered":"2023-07-05T18:56:09.618958+0000","last_unstale":"2023-07-05T18:57:16.287900+0000","last_undegraded":"2023-07-05T18:57:16.287900+0000","last_fullsized":"2023-07-05T18:57:16.287900+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T18:56:08.603137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T18:56:08.603137+0000","last_clean_scrub_stamp":"2023-07-05T18:56:08.603137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T04:32:57.046616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":6,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":8},{"poolid":2,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574865,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27924,"kb_used_data":972,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94343916,"statfs":{"total":96636764160,"available":96608169984,"internally_reserved":0,"allocated":995328,"data_stored":750237,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Jul 5 18:57:09 2023","interfaces":[{"interface":"back","average":{"1min":0.58199999999999996,"5min":0.58199999999999996,"15min":0.58199999999999996},"min":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":1.1870000000000001,"5min":1.1870000000000001,"15min":1.1870000000000001},"last":0.63},{"interface":"front","average":{"1min":0.63100000000000001,"5min":0.63100000000000001,"15min":0.63100000000000001},"min":{"1min":0.32700000000000001,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":1.266,"5min":1.266,"15min":1.266},"last":0.67700000000000005}]},{"osd":1,"last update":"Wed Jul 5 18:57:09 2023","interfaces":[{"interface":"back","average":{"1min":0.63700000000000001,"5min":0.63700000000000001,"15min":0.63700000000000001},"min":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":1.629,"5min":1.629,"15min":1.629},"last":0.52700000000000002},{"interface":"front","average":{"1min":1.208,"5min":1.208,"15min":1.208},"min":{"1min":0.33800000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":10.657999999999999,"5min":10.657999999999999,"15min":10.657999999999999},"last":0.70499999999999996}]},{"osd":2,"last update":"Wed Jul 5 18:57:09 2023","interfaces":[{"interface":"back","average":{"1min":0.63600000000000001,"5min":0.63600000000000001,"15min":0.63600000000000001},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":1.5429999999999999,"5min":1.5429999999999999,"15min":1.5429999999999999},"last":0.61299999999999999},{"interface":"front","average":{"1min":1.1579999999999999,"5min":1.1579999999999999,"15min":1.1579999999999999},"min":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":10.589,"5min":10.589,"15min":10.589},"last":0.57799999999999996}]},{"osd":3,"last update":"Wed Jul 5 18:57:09 2023","interfaces":[{"interface":"back","average":{"1min":0.68200000000000005,"5min":0.68200000000000005,"15min":0.68200000000000005},"min":{"1min":0.45100000000000001,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":1.5700000000000001,"5min":1.5700000000000001,"15min":1.5700000000000001},"last":0.58999999999999997},{"interface":"front","average":{"1min":1.2190000000000001,"5min":1.2190000000000001,"15min":1.2190000000000001},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":10.726000000000001,"5min":10.726000000000001,"15min":10.726000000000001},"last":0.66500000000000004}]},{"osd":4,"last update":"Wed Jul 5 18:57:09 2023","interfaces":[{"interface":"back","average":{"1min":0.55900000000000005,"5min":0.55900000000000005,"15min":0.55900000000000005},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.71599999999999997,"5min":0.71599999999999997,"15min":0.71599999999999997},"last":0.55700000000000005},{"interface":"front","average":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"min":{"1min":0.41799999999999998,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":0.65800000000000003,"5min":0.65800000000000003,"15min":0.65800000000000003},"last":0.44500000000000001}]},{"osd":5,"last update":"Wed Jul 5 18:57:09 2023","interfaces":[{"interface":"back","average":{"1min":0.55600000000000005,"5min":0.55600000000000005,"15min":0.55600000000000005},"min":{"1min":0.378,"5min":0.378,"15min":0.378},"max":{"1min":0.72599999999999998,"5min":0.72599999999999998,"15min":0.72599999999999998},"last":0.47099999999999997},{"interface":"front","average":{"1min":0.60199999999999998,"5min":0.60199999999999998,"15min":0.60199999999999998},"min":{"1min":0.47099999999999997,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":0.76100000000000001,"5min":0.76100000000000001,"15min":0.76100000000000001},"last":0.64100000000000001}]},{"osd":6,"last update":"Wed Jul 5 18:57:09 2023","interfaces":[{"interface":"back","average":{"1min":0.621,"5min":0.621,"15min":0.621},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.79800000000000004,"5min":0.79800000000000004,"15min":0.79800000000000004},"last":0.60099999999999998},{"interface":"front","average":{"1min":0.59999999999999998,"5min":0.59999999999999998,"15min":0.59999999999999998},"min":{"1min":0.45500000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":0.747,"5min":0.747,"15min":0.747},"last":0.54100000000000004}]}]},{"osd":6,"up_from":13,"seq":55834574867,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27344,"kb_used_data":392,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344496,"statfs":{"total":96636764160,"available":96608763904,"internally_reserved":0,"allocated":401408,"data_stored":165470,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Jul 5 18:57:07 2023","interfaces":[{"interface":"back","average":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"min":{"1min":0.32300000000000001,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":1.6200000000000001,"5min":1.6200000000000001,"15min":1.6200000000000001},"last":0.34699999999999998},{"interface":"front","average":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"min":{"1min":0.33400000000000002,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.71599999999999997,"5min":0.71599999999999997,"15min":0.71599999999999997},"last":0.49399999999999999}]},{"osd":1,"last update":"Wed Jul 5 18:57:07 2023","interfaces":[{"interface":"back","average":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"min":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":1.1299999999999999,"5min":1.1299999999999999,"15min":1.1299999999999999},"last":0.45400000000000001},{"interface":"front","average":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.55200000000000005},"min":{"1min":0.28899999999999998,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":1.464,"5min":1.464,"15min":1.464},"last":0.52600000000000002}]},{"osd":2,"last update":"Wed Jul 5 18:57:07 2023","interfaces":[{"interface":"back","average":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"min":{"1min":0.307,"5min":0.307,"15min":0.307},"max":{"1min":0.81399999999999995,"5min":0.81399999999999995,"15min":0.81399999999999995},"last":0.53800000000000003},{"interface":"front","average":{"1min":0.502,"5min":0.502,"15min":0.502},"min":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.69299999999999995,"5min":0.69299999999999995,"15min":0.69299999999999995},"last":0.51000000000000001}]},{"osd":3,"last update":"Wed Jul 5 18:57:07 2023","interfaces":[{"interface":"back","average":{"1min":0.99299999999999999,"5min":0.99299999999999999,"15min":0.99299999999999999},"min":{"1min":0.45600000000000002,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":6.181,"5min":6.181,"15min":6.181},"last":0.40600000000000003},{"interface":"front","average":{"1min":0.55400000000000005,"5min":0.55400000000000005,"15min":0.55400000000000005},"min":{"1min":0.34599999999999997,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.68000000000000005,"5min":0.68000000000000005,"15min":0.68000000000000005},"last":0.47099999999999997}]},{"osd":4,"last update":"Wed Jul 5 18:57:07 2023","interfaces":[{"interface":"back","average":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"min":{"1min":0.32000000000000001,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.74199999999999999,"5min":0.74199999999999999,"15min":0.74199999999999999},"last":0.55300000000000005},{"interface":"front","average":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"min":{"1min":0.30199999999999999,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.873,"5min":0.873,"15min":0.873},"last":0.56599999999999995}]},{"osd":5,"last update":"Wed Jul 5 18:57:07 2023","interfaces":[{"interface":"back","average":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.55200000000000005},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.77200000000000002,"5min":0.77200000000000002,"15min":0.77200000000000002},"last":0.57699999999999996},{"interface":"front","average":{"1min":0.56799999999999995,"5min":0.56799999999999995,"15min":0.56799999999999995},"min":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.754,"5min":0.754,"15min":0.754},"last":0.58799999999999997}]},{"osd":7,"last update":"Wed Jul 5 18:57:07 2023","interfaces":[{"interface":"back","average":{"1min":0.58399999999999996,"5min":0.58399999999999996,"15min":0.58399999999999996},"min":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.92000000000000004,"5min":0.92000000000000004,"15min":0.92000000000000004},"last":0.61399999999999999},{"interface":"front","average":{"1min":0.60899999999999999,"5min":0.60899999999999999,"15min":0.60899999999999999},"min":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.84299999999999997,"5min":0.84299999999999997,"15min":0.84299999999999997},"last":0.60399999999999998}]}]},{"osd":1,"up_from":13,"seq":55834574866,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27912,"kb_used_data":960,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94343928,"statfs":{"total":96636764160,"available":96608182272,"internally_reserved":0,"allocated":983040,"data_stored":748693,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Jul 5 18:57:07 2023","interfaces":[{"interface":"back","average":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"min":{"1min":0.25,"5min":0.25,"15min":0.25},"max":{"1min":0.49399999999999999,"5min":0.49399999999999999,"15min":0.49399999999999999},"last":0.22900000000000001},{"interface":"front","average":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"min":{"1min":0.28599999999999998,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"last":0.29399999999999998}]},{"osd":2,"last update":"Wed Jul 5 18:57:07 2023","interfaces":[{"interface":"back","average":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"min":{"1min":0.23699999999999999,"5min":0.23699999999999999,"15min":0.23699999999999999},"max":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"last":0.34699999999999998},{"interface":"front","average":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"min":{"1min":0.26400000000000001,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":0.60199999999999998,"5min":0.60199999999999998,"15min":0.60199999999999998},"last":0.38}]},{"osd":3,"last update":"Wed Jul 5 18:57:07 2023","interfaces":[{"interface":"back","average":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"min":{"1min":0.316,"5min":0.316,"15min":0.316},"max":{"1min":0.65700000000000003,"5min":0.65700000000000003,"15min":0.65700000000000003},"last":0.42299999999999999},{"interface":"front","average":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"min":{"1min":0.28899999999999998,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":0.439,"5min":0.439,"15min":0.439},"last":0.47299999999999998}]},{"osd":4,"last update":"Wed Jul 5 18:57:07 2023","interfaces":[{"interface":"back","average":{"1min":0.61099999999999999,"5min":0.61099999999999999,"15min":0.61099999999999999},"min":{"1min":0.44,"5min":0.44,"15min":0.44},"max":{"1min":0.82399999999999995,"5min":0.82399999999999995,"15min":0.82399999999999995},"last":0.61699999999999999},{"interface":"front","average":{"1min":0.65600000000000003,"5min":0.65600000000000003,"15min":0.65600000000000003},"min":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"max":{"1min":1.0289999999999999,"5min":1.0289999999999999,"15min":1.0289999999999999},"last":0.58299999999999996}]},{"osd":5,"last update":"Wed Jul 5 18:57:07 2023","interfaces":[{"interface":"back","average":{"1min":0.58499999999999996,"5min":0.58499999999999996,"15min":0.58499999999999996},"min":{"1min":0.45100000000000001,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":0.77400000000000002,"5min":0.77400000000000002,"15min":0.77400000000000002},"last":0.48799999999999999},{"interface":"front","average":{"1min":0.63800000000000001,"5min":0.63800000000000001,"15min":0.63800000000000001},"min":{"1min":0.50900000000000001,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":0.78100000000000003,"5min":0.78100000000000003,"15min":0.78100000000000003},"last":0.60499999999999998}]},{"osd":6,"last update":"Wed Jul 5 18:57:07 2023","interfaces":[{"interface":"back","average":{"1min":0.64700000000000002,"5min":0.64700000000000002,"15min":0.64700000000000002},"min":{"1min":0.45900000000000002,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":0.91900000000000004,"5min":0.91900000000000004,"15min":0.91900000000000004},"last":0.55000000000000004},{"interface":"front","average":{"1min":0.70599999999999996,"5min":0.70599999999999996,"15min":0.70599999999999996},"min":{"1min":0.442,"5min":0.442,"15min":0.442},"max":{"1min":1.2170000000000001,"5min":1.2170000000000001,"15min":1.2170000000000001},"last":0.53500000000000003}]},{"osd":7,"last update":"Wed Jul 5 18:57:07 2023","interfaces":[{"interface":"back","average":{"1min":0.66800000000000004,"5min":0.66800000000000004,"15min":0.66800000000000004},"min":{"1min":0.50900000000000001,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":0.91100000000000003,"5min":0.91100000000000003,"15min":0.91100000000000003},"last":0.50700000000000001},{"interface":"front","average":{"1min":0.65000000000000002,"5min":0.65000000000000002,"15min":0.65000000000000002},"min":{"1min":0.47199999999999998,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":0.871,"5min":0.871,"15min":0.871},"last":0.59399999999999997}]}]},{"osd":0,"up_from":13,"seq":55834574866,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27332,"kb_used_data":380,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344508,"statfs":{"total":96636764160,"available":96608776192,"internally_reserved":0,"allocated":389120,"data_stored":158269,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed Jul 5 18:57:06 2023","interfaces":[{"interface":"back","average":{"1min":0.371,"5min":0.371,"15min":0.371},"min":{"1min":0.22600000000000001,"5min":0.22600000000000001,"15min":0.22600000000000001},"max":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"last":0.32600000000000001},{"interface":"front","average":{"1min":0.41799999999999998,"5min":0.41799999999999998,"15min":0.41799999999999998},"min":{"1min":0.252,"5min":0.252,"15min":0.252},"max":{"1min":1.1619999999999999,"5min":1.1619999999999999,"15min":1.1619999999999999},"last":0.26300000000000001}]},{"osd":2,"last update":"Wed Jul 5 18:57:06 2023","interfaces":[{"interface":"back","average":{"1min":0.77100000000000002,"5min":0.77100000000000002,"15min":0.77100000000000002},"min":{"1min":0.29199999999999998,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":5.1050000000000004,"5min":5.1050000000000004,"15min":5.1050000000000004},"last":0.42299999999999999},{"interface":"front","average":{"1min":0.47999999999999998,"5min":0.47999999999999998,"15min":0.47999999999999998},"min":{"1min":0.26900000000000002,"5min":0.26900000000000002,"15min":0.26900000000000002},"max":{"1min":1.1930000000000001,"5min":1.1930000000000001,"15min":1.1930000000000001},"last":0.30299999999999999}]},{"osd":3,"last update":"Wed Jul 5 18:57:06 2023","interfaces":[{"interface":"back","average":{"1min":1.0700000000000001,"5min":1.0700000000000001,"15min":1.0700000000000001},"min":{"1min":0.26100000000000001,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":8.1359999999999992,"5min":8.1359999999999992,"15min":8.1359999999999992},"last":0.314},{"interface":"front","average":{"1min":0.94999999999999996,"5min":0.94999999999999996,"15min":0.94999999999999996},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":5.1349999999999998,"5min":5.1349999999999998,"15min":5.1349999999999998},"last":0.37}]},{"osd":4,"last update":"Wed Jul 5 18:57:06 2023","interfaces":[{"interface":"back","average":{"1min":0.61399999999999999,"5min":0.61399999999999999,"15min":0.61399999999999999},"min":{"1min":0.41899999999999998,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":1.1890000000000001,"5min":1.1890000000000001,"15min":1.1890000000000001},"last":0.48699999999999999},{"interface":"front","average":{"1min":1.0649999999999999,"5min":1.0649999999999999,"15min":1.0649999999999999},"min":{"1min":0.46700000000000003,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":8.0670000000000002,"5min":8.0670000000000002,"15min":8.0670000000000002},"last":0.47599999999999998}]},{"osd":5,"last update":"Wed Jul 5 18:57:06 2023","interfaces":[{"interface":"back","average":{"1min":0.94299999999999995,"5min":0.94299999999999995,"15min":0.94299999999999995},"min":{"1min":0.40400000000000003,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":5.032,"5min":5.032,"15min":5.032},"last":0.46300000000000002},{"interface":"front","average":{"1min":0.65300000000000002,"5min":0.65300000000000002,"15min":0.65300000000000002},"min":{"1min":0.44700000000000001,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":1.282,"5min":1.282,"15min":1.282},"last":0.41399999999999998}]},{"osd":6,"last update":"Wed Jul 5 18:57:06 2023","interfaces":[{"interface":"back","average":{"1min":1.052,"5min":1.052,"15min":1.052},"min":{"1min":0.44800000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":8.0069999999999997,"5min":8.0069999999999997,"15min":8.0069999999999997},"last":0.50900000000000001},{"interface":"front","average":{"1min":0.99199999999999999,"5min":0.99199999999999999,"15min":0.99199999999999999},"min":{"1min":0.49199999999999999,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":5.0700000000000003,"5min":5.0700000000000003,"15min":5.0700000000000003},"last":0.51800000000000002}]},{"osd":7,"last update":"Wed Jul 5 18:57:06 2023","interfaces":[{"interface":"back","average":{"1min":0.64900000000000002,"5min":0.64900000000000002,"15min":0.64900000000000002},"min":{"1min":0.44400000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":1.218,"5min":1.218,"15min":1.218},"last":0.45500000000000002},{"interface":"front","average":{"1min":1.034,"5min":1.034,"15min":1.034},"min":{"1min":0.39400000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":8.1039999999999992,"5min":8.1039999999999992,"15min":8.1039999999999992},"last":0.53000000000000003}]}]},{"osd":2,"up_from":13,"seq":55834574865,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27340,"kb_used_data":388,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344500,"statfs":{"total":96636764160,"available":96608768000,"internally_reserved":0,"allocated":397312,"data_stored":163997,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Jul 5 18:57:11 2023","interfaces":[{"interface":"back","average":{"1min":0.311,"5min":0.311,"15min":0.311},"min":{"1min":0.23200000000000001,"5min":0.23200000000000001,"15min":0.23200000000000001},"max":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"last":0.255},{"interface":"front","average":{"1min":0.32400000000000001,"5min":0.32400000000000001,"15min":0.32400000000000001},"min":{"1min":0.25,"5min":0.25,"15min":0.25},"max":{"1min":0.496,"5min":0.496,"15min":0.496},"last":0.38100000000000001}]},{"osd":1,"last update":"Wed Jul 5 18:57:11 2023","interfaces":[{"interface":"back","average":{"1min":0.32800000000000001,"5min":0.32800000000000001,"15min":0.32800000000000001},"min":{"1min":0.27000000000000002,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"last":0.36399999999999999},{"interface":"front","average":{"1min":0.38,"5min":0.38,"15min":0.38},"min":{"1min":0.32200000000000001,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.47999999999999998,"5min":0.47999999999999998,"15min":0.47999999999999998},"last":0.32600000000000001}]},{"osd":3,"last update":"Wed Jul 5 18:57:11 2023","interfaces":[{"interface":"back","average":{"1min":0.33500000000000002,"5min":0.33500000000000002,"15min":0.33500000000000002},"min":{"1min":0.28699999999999998,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"last":0.27300000000000002},{"interface":"front","average":{"1min":0.39400000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"min":{"1min":0.308,"5min":0.308,"15min":0.308},"max":{"1min":0.48299999999999998,"5min":0.48299999999999998,"15min":0.48299999999999998},"last":0.40100000000000002}]},{"osd":4,"last update":"Wed Jul 5 18:57:11 2023","interfaces":[{"interface":"back","average":{"1min":0.55900000000000005,"5min":0.55900000000000005,"15min":0.55900000000000005},"min":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.69599999999999995,"5min":0.69599999999999995,"15min":0.69599999999999995},"last":0.46700000000000003},{"interface":"front","average":{"1min":0.57799999999999996,"5min":0.57799999999999996,"15min":0.57799999999999996},"min":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":0.81799999999999995,"5min":0.81799999999999995,"15min":0.81799999999999995},"last":0.42099999999999999}]},{"osd":5,"last update":"Wed Jul 5 18:57:11 2023","interfaces":[{"interface":"back","average":{"1min":0.624,"5min":0.624,"15min":0.624},"min":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":0.77800000000000002,"5min":0.77800000000000002,"15min":0.77800000000000002},"last":0.498},{"interface":"front","average":{"1min":0.59499999999999997,"5min":0.59499999999999997,"15min":0.59499999999999997},"min":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":0.76500000000000001,"5min":0.76500000000000001,"15min":0.76500000000000001},"last":0.432}]},{"osd":6,"last update":"Wed Jul 5 18:57:11 2023","interfaces":[{"interface":"back","average":{"1min":0.61099999999999999,"5min":0.61099999999999999,"15min":0.61099999999999999},"min":{"1min":0.45900000000000002,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":0.748,"5min":0.748,"15min":0.748},"last":0.56000000000000005},{"interface":"front","average":{"1min":0.59999999999999998,"5min":0.59999999999999998,"15min":0.59999999999999998},"min":{"1min":0.498,"5min":0.498,"15min":0.498},"max":{"1min":0.73999999999999999,"5min":0.73999999999999999,"15min":0.73999999999999999},"last":0.47999999999999998}]},{"osd":7,"last update":"Wed Jul 5 18:57:11 2023","interfaces":[{"interface":"back","average":{"1min":0.59599999999999997,"5min":0.59599999999999997,"15min":0.59599999999999997},"min":{"1min":0.441,"5min":0.441,"15min":0.441},"max":{"1min":0.77500000000000002,"5min":0.77500000000000002,"15min":0.77500000000000002},"last":0.54100000000000004},{"interface":"front","average":{"1min":0.61699999999999999,"5min":0.61699999999999999,"15min":0.61699999999999999},"min":{"1min":0.45900000000000002,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":0.74399999999999999,"5min":0.74399999999999999,"15min":0.74399999999999999},"last":0.51400000000000001}]}]},{"osd":3,"up_from":13,"seq":55834574867,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27356,"kb_used_data":404,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344484,"statfs":{"total":96636764160,"available":96608751616,"internally_reserved":0,"allocated":413696,"data_stored":166486,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Jul 5 18:57:10 2023","interfaces":[{"interface":"back","average":{"1min":0.94499999999999995,"5min":0.94499999999999995,"15min":0.94499999999999995},"min":{"1min":0.20200000000000001,"5min":0.20200000000000001,"15min":0.20200000000000001},"max":{"1min":12.015000000000001,"5min":12.015000000000001,"15min":12.015000000000001},"last":0.27500000000000002},{"interface":"front","average":{"1min":0.98499999999999999,"5min":0.98499999999999999,"15min":0.98499999999999999},"min":{"1min":0.246,"5min":0.246,"15min":0.246},"max":{"1min":11.933,"5min":11.933,"15min":11.933},"last":0.23999999999999999}]},{"osd":1,"last update":"Wed Jul 5 18:57:10 2023","interfaces":[{"interface":"back","average":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"min":{"1min":0.23999999999999999,"5min":0.23999999999999999,"15min":0.23999999999999999},"max":{"1min":1.387,"5min":1.387,"15min":1.387},"last":0.25900000000000001},{"interface":"front","average":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"min":{"1min":0.29499999999999998,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":0.754,"5min":0.754,"15min":0.754},"last":0.34000000000000002}]},{"osd":2,"last update":"Wed Jul 5 18:57:10 2023","interfaces":[{"interface":"back","average":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"min":{"1min":0.28199999999999997,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":1.5069999999999999,"5min":1.5069999999999999,"15min":1.5069999999999999},"last":0.32000000000000001},{"interface":"front","average":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.40699999999999997},"min":{"1min":0.253,"5min":0.253,"15min":0.253},"max":{"1min":0.81000000000000005,"5min":0.81000000000000005,"15min":0.81000000000000005},"last":0.36899999999999999}]},{"osd":4,"last update":"Wed Jul 5 18:57:10 2023","interfaces":[{"interface":"back","average":{"1min":0.59999999999999998,"5min":0.59999999999999998,"15min":0.59999999999999998},"min":{"1min":0.443,"5min":0.443,"15min":0.443},"max":{"1min":0.83699999999999997,"5min":0.83699999999999997,"15min":0.83699999999999997},"last":0.42999999999999999},{"interface":"front","average":{"1min":0.65100000000000002,"5min":0.65100000000000002,"15min":0.65100000000000002},"min":{"1min":0.46000000000000002,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":0.96399999999999997,"5min":0.96399999999999997,"15min":0.96399999999999997},"last":0.55400000000000005}]},{"osd":5,"last update":"Wed Jul 5 18:57:10 2023","interfaces":[{"interface":"back","average":{"1min":0.63600000000000001,"5min":0.63600000000000001,"15min":0.63600000000000001},"min":{"1min":0.41099999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":0.93200000000000005,"5min":0.93200000000000005,"15min":0.93200000000000005},"last":0.45500000000000002},{"interface":"front","average":{"1min":0.64800000000000002,"5min":0.64800000000000002,"15min":0.64800000000000002},"min":{"1min":0.48399999999999999,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":1.4610000000000001,"5min":1.4610000000000001,"15min":1.4610000000000001},"last":0.53900000000000003}]},{"osd":6,"last update":"Wed Jul 5 18:57:10 2023","interfaces":[{"interface":"back","average":{"1min":0.63900000000000001,"5min":0.63900000000000001,"15min":0.63900000000000001},"min":{"1min":0.45000000000000001,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":1.484,"5min":1.484,"15min":1.484},"last":0.57899999999999996},{"interface":"front","average":{"1min":0.60799999999999998,"5min":0.60799999999999998,"15min":0.60799999999999998},"min":{"1min":0.42999999999999999,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":0.78600000000000003,"5min":0.78600000000000003,"15min":0.78600000000000003},"last":0.46400000000000002}]},{"osd":7,"last update":"Wed Jul 5 18:57:10 2023","interfaces":[{"interface":"back","average":{"1min":0.65400000000000003,"5min":0.65400000000000003,"15min":0.65400000000000003},"min":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.995,"5min":0.995,"15min":0.995},"last":0.50700000000000001},{"interface":"front","average":{"1min":0.67400000000000004,"5min":0.67400000000000004,"15min":0.67400000000000004},"min":{"1min":0.47899999999999998,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":1.4330000000000001,"5min":1.4330000000000001,"15min":1.4330000000000001},"last":0.47299999999999998}]}]},{"osd":4,"up_from":13,"seq":55834574867,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27348,"kb_used_data":396,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344492,"statfs":{"total":96636764160,"available":96608759808,"internally_reserved":0,"allocated":405504,"data_stored":165492,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Jul 5 18:57:08 2023","interfaces":[{"interface":"back","average":{"1min":0.51800000000000002,"5min":0.51800000000000002,"15min":0.51800000000000002},"min":{"1min":0.34399999999999997,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.79200000000000004,"5min":0.79200000000000004,"15min":0.79200000000000004},"last":1.208},{"interface":"front","average":{"1min":0.51300000000000001,"5min":0.51300000000000001,"15min":0.51300000000000001},"min":{"1min":0.32400000000000001,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.98099999999999998,"5min":0.98099999999999998,"15min":0.98099999999999998},"last":0.80100000000000005}]},{"osd":1,"last update":"Wed Jul 5 18:57:08 2023","interfaces":[{"interface":"back","average":{"1min":0.55000000000000004,"5min":0.55000000000000004,"15min":0.55000000000000004},"min":{"1min":0.373,"5min":0.373,"15min":0.373},"max":{"1min":0.76400000000000001,"5min":0.76400000000000001,"15min":0.76400000000000001},"last":0.74399999999999999},{"interface":"front","average":{"1min":0.50900000000000001,"5min":0.50900000000000001,"15min":0.50900000000000001},"min":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.89500000000000002,"5min":0.89500000000000002,"15min":0.89500000000000002},"last":0.28100000000000003}]},{"osd":2,"last update":"Wed Jul 5 18:57:08 2023","interfaces":[{"interface":"back","average":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"min":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.86099999999999999,"5min":0.86099999999999999,"15min":0.86099999999999999},"last":1.006},{"interface":"front","average":{"1min":0.58199999999999996,"5min":0.58199999999999996,"15min":0.58199999999999996},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.92900000000000005,"5min":0.92900000000000005,"15min":0.92900000000000005},"last":0.90300000000000002}]},{"osd":3,"last update":"Wed Jul 5 18:57:08 2023","interfaces":[{"interface":"back","average":{"1min":0.54000000000000004,"5min":0.54000000000000004,"15min":0.54000000000000004},"min":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.70099999999999996,"5min":0.70099999999999996,"15min":0.70099999999999996},"last":1.927},{"interface":"front","average":{"1min":0.61299999999999999,"5min":0.61299999999999999,"15min":0.61299999999999999},"min":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":0.88400000000000001,"5min":0.88400000000000001,"15min":0.88400000000000001},"last":1.0640000000000001}]},{"osd":5,"last update":"Wed Jul 5 18:57:08 2023","interfaces":[{"interface":"back","average":{"1min":0.56499999999999995,"5min":0.56499999999999995,"15min":0.56499999999999995},"min":{"1min":0.45400000000000001,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":0.77800000000000002,"5min":0.77800000000000002,"15min":0.77800000000000002},"last":0.83599999999999997},{"interface":"front","average":{"1min":0.53900000000000003,"5min":0.53900000000000003,"15min":0.53900000000000003},"min":{"1min":0.32200000000000001,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.81999999999999995,"5min":0.81999999999999995,"15min":0.81999999999999995},"last":1.883}]},{"osd":6,"last update":"Wed Jul 5 18:57:08 2023","interfaces":[{"interface":"back","average":{"1min":0.58499999999999996,"5min":0.58499999999999996,"15min":0.58499999999999996},"min":{"1min":0.372,"5min":0.372,"15min":0.372},"max":{"1min":0.83499999999999996,"5min":0.83499999999999996,"15min":0.83499999999999996},"last":1.7869999999999999},{"interface":"front","average":{"1min":0.626,"5min":0.626,"15min":0.626},"min":{"1min":0.49099999999999999,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":0.82099999999999995,"5min":0.82099999999999995,"15min":0.82099999999999995},"last":0.86799999999999999}]},{"osd":7,"last update":"Wed Jul 5 18:57:08 2023","interfaces":[{"interface":"back","average":{"1min":0.57499999999999996,"5min":0.57499999999999996,"15min":0.57499999999999996},"min":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.79100000000000004,"5min":0.79100000000000004,"15min":0.79100000000000004},"last":1.9650000000000001},{"interface":"front","average":{"1min":0.66300000000000003,"5min":0.66300000000000003,"15min":0.66300000000000003},"min":{"1min":0.53600000000000003,"5min":0.53600000000000003,"15min":0.53600000000000003},"max":{"1min":0.90700000000000003,"5min":0.90700000000000003,"15min":0.90700000000000003},"last":1.829}]}]},{"osd":5,"up_from":13,"seq":55834574866,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27348,"kb_used_data":396,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344492,"statfs":{"total":96636764160,"available":96608759808,"internally_reserved":0,"allocated":405504,"data_stored":165000,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Jul 5 18:57:07 2023","interfaces":[{"interface":"back","average":{"1min":0.48099999999999998,"5min":0.48099999999999998,"15min":0.48099999999999998},"min":{"1min":0.33200000000000002,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.73599999999999999,"5min":0.73599999999999999,"15min":0.73599999999999999},"last":0.97499999999999998},{"interface":"front","average":{"1min":0.51400000000000001,"5min":0.51400000000000001,"15min":0.51400000000000001},"min":{"1min":0.314,"5min":0.314,"15min":0.314},"max":{"1min":0.68999999999999995,"5min":0.68999999999999995,"15min":0.68999999999999995},"last":0.80200000000000005}]},{"osd":1,"last update":"Wed Jul 5 18:57:07 2023","interfaces":[{"interface":"back","average":{"1min":0.55300000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"min":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.82399999999999995,"5min":0.82399999999999995,"15min":0.82399999999999995},"last":0.879},{"interface":"front","average":{"1min":0.54200000000000004,"5min":0.54200000000000004,"15min":0.54200000000000004},"min":{"1min":0.439,"5min":0.439,"15min":0.439},"max":{"1min":0.70499999999999996,"5min":0.70499999999999996,"15min":0.70499999999999996},"last":0.92100000000000004}]},{"osd":2,"last update":"Wed Jul 5 18:57:07 2023","interfaces":[{"interface":"back","average":{"1min":0.56399999999999995,"5min":0.56399999999999995,"15min":0.56399999999999995},"min":{"1min":0.373,"5min":0.373,"15min":0.373},"max":{"1min":0.80600000000000005,"5min":0.80600000000000005,"15min":0.80600000000000005},"last":0.86199999999999999},{"interface":"front","average":{"1min":0.56599999999999995,"5min":0.56599999999999995,"15min":0.56599999999999995},"min":{"1min":0.38,"5min":0.38,"15min":0.38},"max":{"1min":0.79500000000000004,"5min":0.79500000000000004,"15min":0.79500000000000004},"last":0.77800000000000002}]},{"osd":3,"last update":"Wed Jul 5 18:57:07 2023","interfaces":[{"interface":"back","average":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.56299999999999994},"min":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.752,"5min":0.752,"15min":0.752},"last":0.94499999999999995},{"interface":"front","average":{"1min":0.622,"5min":0.622,"15min":0.622},"min":{"1min":0.42999999999999999,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":0.88600000000000001,"5min":0.88600000000000001,"15min":0.88600000000000001},"last":0.96199999999999997}]},{"osd":4,"last update":"Wed Jul 5 18:57:07 2023","interfaces":[{"interface":"back","average":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.50700000000000001},"min":{"1min":0.32000000000000001,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.69799999999999995,"5min":0.69799999999999995,"15min":0.69799999999999995},"last":0.72199999999999998},{"interface":"front","average":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.56000000000000005},"min":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.78200000000000003,"5min":0.78200000000000003,"15min":0.78200000000000003},"last":0.57199999999999995}]},{"osd":6,"last update":"Wed Jul 5 18:57:07 2023","interfaces":[{"interface":"back","average":{"1min":0.58899999999999997,"5min":0.58899999999999997,"15min":0.58899999999999997},"min":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.83999999999999997,"5min":0.83999999999999997,"15min":0.83999999999999997},"last":0.55800000000000005},{"interface":"front","average":{"1min":0.57299999999999995,"5min":0.57299999999999995,"15min":0.57299999999999995},"min":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.747,"5min":0.747,"15min":0.747},"last":0.84099999999999997}]},{"osd":7,"last update":"Wed Jul 5 18:57:07 2023","interfaces":[{"interface":"back","average":{"1min":0.63100000000000001,"5min":0.63100000000000001,"15min":0.63100000000000001},"min":{"1min":0.443,"5min":0.443,"15min":0.443},"max":{"1min":0.93500000000000005,"5min":0.93500000000000005,"15min":0.93500000000000005},"last":0.74399999999999999},{"interface":"front","average":{"1min":0.65100000000000002,"5min":0.65100000000000002,"15min":0.65100000000000002},"min":{"1min":0.41599999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":0.86299999999999999,"5min":0.86299999999999999,"15min":0.86299999999999999},"last":0.69199999999999995}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1598,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-07-05T18:57:19.449 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-07-05T18:57:19.578 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:19.575+0000 7f727a819700 1 Processor -- start 2023-07-05T18:57:19.578 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:19.576+0000 7f727a819700 1 -- start start 2023-07-05T18:57:19.583 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:19.576+0000 7f727a819700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f72740ce910 0x7f72740ccde0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:57:19.583 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:19.576+0000 7f727a819700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f72740cbc60 0x7f72740cece0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:57:19.583 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:19.576+0000 7f727a819700 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f72740cf220 con 0x7f72740cd410 2023-07-05T18:57:19.583 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:19.576+0000 7f727a819700 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f72740cc400 con 0x7f72740ce910 2023-07-05T18:57:19.584 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:19.576+0000 7f727a819700 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f72740cc6e0 con 0x7f72740cbc60 2023-07-05T18:57:19.584 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:19.577+0000 7f7273fff700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f72740ce910 0x7f72740ccde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:57:19.584 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:19.577+0000 7f7273fff700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f72740ce910 0x7f72740ccde0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:59900/0 (socket says 172.21.15.46:59900) 2023-07-05T18:57:19.584 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:19.577+0000 7f7273fff700 1 -- 172.21.15.46:0/1462556862 learned_addr learned my addr 172.21.15.46:0/1462556862 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-07-05T18:57:19.584 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:19.577+0000 7f72737fe700 1 --2- 172.21.15.46:0/1462556862 >> v2:172.21.15.73:3300/0 conn(0x7f72740cbc60 0x7f72740cece0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:57:19.584 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:19.577+0000 7f7273fff700 1 -- 172.21.15.46:0/1462556862 >> v2:172.21.15.73:3300/0 conn(0x7f72740cbc60 msgr2=0x7f72740cece0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-05T18:57:19.584 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:19.577+0000 7f7273fff700 1 --2- 172.21.15.46:0/1462556862 >> v2:172.21.15.73:3300/0 conn(0x7f72740cbc60 0x7f72740cece0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:57:19.585 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:19.577+0000 7f7273fff700 1 -- 172.21.15.46:0/1462556862 >> v1:172.21.15.73:6789/0 conn(0x7f72740cd410 legacy=0x7f72740cd870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:57:19.585 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:19.577+0000 7f7273fff700 1 -- 172.21.15.46:0/1462556862 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f727406acf0 con 0x7f72740ce910 2023-07-05T18:57:19.585 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:19.577+0000 7f7273fff700 1 --2- 172.21.15.46:0/1462556862 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f72740ce910 0x7f72740ccde0 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f7274068080 tx=0x7f725c009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=79f73b03c4abe082 server_cookie=0 in_seq=0 out_seq=0 2023-07-05T18:57:19.585 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:19.577+0000 7f7272ffd700 1 -- 172.21.15.46:0/1462556862 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f725c011830 con 0x7f72740ce910 2023-07-05T18:57:19.585 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:19.577+0000 7f7272ffd700 1 -- 172.21.15.46:0/1462556862 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f725c011990 con 0x7f72740ce910 2023-07-05T18:57:19.585 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:19.577+0000 7f7272ffd700 1 -- 172.21.15.46:0/1462556862 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f725c011d20 con 0x7f72740ce910 2023-07-05T18:57:19.585 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:19.578+0000 7f727a819700 1 -- 172.21.15.46:0/1462556862 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f72740ce910 msgr2=0x7f72740ccde0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:57:19.586 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:19.578+0000 7f727a819700 1 --2- 172.21.15.46:0/1462556862 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f72740ce910 0x7f72740ccde0 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f7274068080 tx=0x7f725c009bd0 comp rx=0 tx=0).stop 2023-07-05T18:57:19.586 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:19.578+0000 7f727a819700 1 -- 172.21.15.46:0/1462556862 shutdown_connections 2023-07-05T18:57:19.586 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:19.578+0000 7f727a819700 1 --2- 172.21.15.46:0/1462556862 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f72740ce910 0x7f72740ccde0 unknown :-1 s=CLOSED pgs=383 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:57:19.586 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:19.578+0000 7f727a819700 1 --2- 172.21.15.46:0/1462556862 >> v2:172.21.15.73:3300/0 conn(0x7f72740cbc60 0x7f72740cece0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:57:19.586 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:19.578+0000 7f727a819700 1 -- 172.21.15.46:0/1462556862 >> 172.21.15.46:0/1462556862 conn(0x7f7274099e00 msgr2=0x7f72740d0b30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-05T18:57:19.586 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:19.578+0000 7f727a819700 1 -- 172.21.15.46:0/1462556862 shutdown_connections 2023-07-05T18:57:19.586 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:19.578+0000 7f727a819700 1 -- 172.21.15.46:0/1462556862 wait complete. 2023-07-05T18:57:19.586 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:19.579+0000 7f727a819700 1 Processor -- start 2023-07-05T18:57:19.587 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:19.579+0000 7f727a819700 1 -- start start 2023-07-05T18:57:19.587 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:19.580+0000 7f727a819700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f72740cbc60 0x7f7274158530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:57:19.587 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:19.580+0000 7f727a819700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f72740cd410 0x7f72740b5d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:57:19.587 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:19.580+0000 7f727a819700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f72740ce910 0x7f72740b6280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:57:19.587 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:19.580+0000 7f727a819700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7274153b10 con 0x7f72740ce910 2023-07-05T18:57:19.587 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:19.580+0000 7f727a819700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72740c9900 con 0x7f72740cd410 2023-07-05T18:57:19.587 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:19.580+0000 7f727a819700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7274153db0 con 0x7f72740cbc60 2023-07-05T18:57:19.587 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:19.580+0000 7f7278db6700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f72740ce910 0x7f72740b6280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:57:19.588 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:19.580+0000 7f7278db6700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f72740ce910 0x7f72740b6280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:59910/0 (socket says 172.21.15.46:59910) 2023-07-05T18:57:19.588 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:19.580+0000 7f7278db6700 1 -- 172.21.15.46:0/824662783 learned_addr learned my addr 172.21.15.46:0/824662783 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-07-05T18:57:19.588 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:19.580+0000 7f72737fe700 1 --2- 172.21.15.46:0/824662783 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f72740cd410 0x7f72740b5d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:57:19.588 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:19.580+0000 7f7273fff700 1 --2- 172.21.15.46:0/824662783 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f72740cbc60 0x7f7274158530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:57:19.588 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:19.580+0000 7f7278db6700 1 -- 172.21.15.46:0/824662783 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f72740cbc60 msgr2=0x7f7274158530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:57:19.588 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:19.580+0000 7f7278db6700 1 --2- 172.21.15.46:0/824662783 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f72740cbc60 0x7f7274158530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:57:19.588 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:19.580+0000 7f7278db6700 1 -- 172.21.15.46:0/824662783 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f72740cd410 msgr2=0x7f72740b5d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:57:19.589 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:19.580+0000 7f7278db6700 1 --2- 172.21.15.46:0/824662783 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f72740cd410 0x7f72740b5d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:57:19.589 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:19.580+0000 7f7278db6700 1 -- 172.21.15.46:0/824662783 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f725c009550 con 0x7f72740ce910 2023-07-05T18:57:19.589 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:19.580+0000 7f72737fe700 1 --2- 172.21.15.46:0/824662783 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f72740cd410 0x7f72740b5d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-05T18:57:19.589 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:19.581+0000 7f7278db6700 1 --2- 172.21.15.46:0/824662783 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f72740ce910 0x7f72740b6280 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f726c00cc50 tx=0x7f726c00a340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-05T18:57:19.589 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:19.581+0000 7f7270ff9700 1 -- 172.21.15.46:0/824662783 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f726c00ad80 con 0x7f72740ce910 2023-07-05T18:57:19.589 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:19.581+0000 7f7270ff9700 1 -- 172.21.15.46:0/824662783 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f726c00ce50 con 0x7f72740ce910 2023-07-05T18:57:19.590 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:19.581+0000 7f727a819700 1 -- 172.21.15.46:0/824662783 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7274154090 con 0x7f72740ce910 2023-07-05T18:57:19.590 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:19.581+0000 7f7270ff9700 1 -- 172.21.15.46:0/824662783 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f726c003c40 con 0x7f72740ce910 2023-07-05T18:57:19.590 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:19.581+0000 7f727a819700 1 -- 172.21.15.46:0/824662783 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7274158a70 con 0x7f72740ce910 2023-07-05T18:57:19.591 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:19.582+0000 7f727a819700 1 -- 172.21.15.46:0/824662783 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f72741542d0 con 0x7f72740ce910 2023-07-05T18:57:19.591 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:19.583+0000 7f7270ff9700 1 -- 172.21.15.46:0/824662783 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f726c0050d0 con 0x7f72740ce910 2023-07-05T18:57:19.592 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:19.583+0000 7f7270ff9700 1 --2- 172.21.15.46:0/824662783 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7f725406ace0 0x7f725406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:57:19.592 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:19.583+0000 7f7270ff9700 1 -- 172.21.15.46:0/824662783 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f726c089fb0 con 0x7f72740ce910 2023-07-05T18:57:19.594 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:19.583+0000 7f7273fff700 1 --2- 172.21.15.46:0/824662783 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7f725406ace0 0x7f725406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:57:19.595 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:19.584+0000 7f7273fff700 1 --2- 172.21.15.46:0/824662783 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7f725406ace0 0x7f725406d190 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f725c009c10 tx=0x7f725c008030 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-05T18:57:19.595 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:19.587+0000 7f7270ff9700 1 -- 172.21.15.46:0/824662783 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f726c055140 con 0x7f72740ce910 2023-07-05T18:57:19.780 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:19.778+0000 7f727a819700 1 -- 172.21.15.46:0/824662783 --> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f727406b2b0 con 0x7f725406ace0 2023-07-05T18:57:19.789 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:19.787+0000 7f7270ff9700 1 -- 172.21.15.46:0/824662783 <== mgr.4099 v2:172.21.15.73:6832/3033361733 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+311693 (secure 0 0 0) 0x7f725c011b80 con 0x7f725406ace0 2023-07-05T18:57:19.800 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T18:57:19.805 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:19.790+0000 7f727a819700 1 -- 172.21.15.46:0/824662783 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7f725406ace0 msgr2=0x7f725406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:57:19.805 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:19.790+0000 7f727a819700 1 --2- 172.21.15.46:0/824662783 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7f725406ace0 0x7f725406d190 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f725c009c10 tx=0x7f725c008030 comp rx=0 tx=0).stop 2023-07-05T18:57:19.806 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:19.790+0000 7f727a819700 1 -- 172.21.15.46:0/824662783 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f72740ce910 msgr2=0x7f72740b6280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:57:19.807 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:19.790+0000 7f727a819700 1 --2- 172.21.15.46:0/824662783 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f72740ce910 0x7f72740b6280 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f726c00cc50 tx=0x7f726c00a340 comp rx=0 tx=0).stop 2023-07-05T18:57:19.807 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:19.790+0000 7f727a819700 1 -- 172.21.15.46:0/824662783 shutdown_connections 2023-07-05T18:57:19.807 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:19.790+0000 7f727a819700 1 --2- 172.21.15.46:0/824662783 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7f725406ace0 0x7f725406d190 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:57:19.808 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:19.790+0000 7f727a819700 1 --2- 172.21.15.46:0/824662783 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f72740ce910 0x7f72740b6280 unknown :-1 s=CLOSED pgs=384 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:57:19.808 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:19.790+0000 7f727a819700 1 --2- 172.21.15.46:0/824662783 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f72740cbc60 0x7f7274158530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:57:19.808 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:19.790+0000 7f727a819700 1 --2- 172.21.15.46:0/824662783 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f72740cd410 0x7f72740b5d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:57:19.808 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:19.790+0000 7f727a819700 1 -- 172.21.15.46:0/824662783 >> 172.21.15.46:0/824662783 conn(0x7f7274099e00 msgr2=0x7f72740b1af0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-05T18:57:19.809 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:19.790+0000 7f727a819700 1 -- 172.21.15.46:0/824662783 shutdown_connections 2023-07-05T18:57:19.809 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:19.790+0000 7f727a819700 1 -- 172.21.15.46:0/824662783 wait complete. 2023-07-05T18:57:19.810 INFO:teuthology.orchestra.run.smithi046.stderr:dumped all 2023-07-05T18:57:19.811 INFO:teuthology.orchestra.run.smithi046.stdout:{"pg_ready":true,"pg_map":{"version":64,"stamp":"2023-07-05T18:57:18.086414+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":120,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219904,"kb_used_data":4288,"kb_used_omap":0,"kb_used_meta":215552,"kb_avail":754754816,"statfs":{"total":773094113280,"available":772868931584,"internally_reserved":0,"allocated":4390912,"data_stored":2483644,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":220725248},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":25,"apply_latency_ms":25,"commit_latency_ns":25000000,"apply_latency_ns":25000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2362,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.235338"},"pg_stats":[{"pgid":"6.3f","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-05T18:57:16.288533+0000","last_change":"2023-07-05T18:57:15.300762+0000","last_active":"2023-07-05T18:57:16.288533+0000","last_peered":"2023-07-05T18:57:16.288533+0000","last_clean":"2023-07-05T18:57:16.288533+0000","last_became_active":"2023-07-05T18:57:15.300504+0000","last_became_peered":"2023-07-05T18:57:15.300504+0000","last_unstale":"2023-07-05T18:57:16.288533+0000","last_undegraded":"2023-07-05T18:57:16.288533+0000","last_fullsized":"2023-07-05T18:57:16.288533+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T18:57:14.849454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T18:57:14.849454+0000","last_clean_scrub_stamp":"2023-07-05T18:57:14.849454+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T00:20:29.812942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3e","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-05T18:57:16.288410+0000","last_change":"2023-07-05T18:57:15.297206+0000","last_active":"2023-07-05T18:57:16.288410+0000","last_peered":"2023-07-05T18:57:16.288410+0000","last_clean":"2023-07-05T18:57:16.288410+0000","last_became_active":"2023-07-05T18:57:15.296976+0000","last_became_peered":"2023-07-05T18:57:15.296976+0000","last_unstale":"2023-07-05T18:57:16.288410+0000","last_undegraded":"2023-07-05T18:57:16.288410+0000","last_fullsized":"2023-07-05T18:57:16.288410+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T18:57:14.849454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T18:57:14.849454+0000","last_clean_scrub_stamp":"2023-07-05T18:57:14.849454+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-06T21:19:55.309242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3d","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-05T18:57:16.903055+0000","last_change":"2023-07-05T18:57:15.303956+0000","last_active":"2023-07-05T18:57:16.903055+0000","last_peered":"2023-07-05T18:57:16.903055+0000","last_clean":"2023-07-05T18:57:16.903055+0000","last_became_active":"2023-07-05T18:57:15.303688+0000","last_became_peered":"2023-07-05T18:57:15.303688+0000","last_unstale":"2023-07-05T18:57:16.903055+0000","last_undegraded":"2023-07-05T18:57:16.903055+0000","last_fullsized":"2023-07-05T18:57:16.903055+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T18:57:14.849454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T18:57:14.849454+0000","last_clean_scrub_stamp":"2023-07-05T18:57:14.849454+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T03:42:12.749735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.3c","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-05T18:57:16.902405+0000","last_change":"2023-07-05T18:57:15.306781+0000","last_active":"2023-07-05T18:57:16.902405+0000","last_peered":"2023-07-05T18:57:16.902405+0000","last_clean":"2023-07-05T18:57:16.902405+0000","last_became_active":"2023-07-05T18:57:15.306232+0000","last_became_peered":"2023-07-05T18:57:15.306232+0000","last_unstale":"2023-07-05T18:57:16.902405+0000","last_undegraded":"2023-07-05T18:57:16.902405+0000","last_fullsized":"2023-07-05T18:57:16.902405+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T18:57:14.849454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T18:57:14.849454+0000","last_clean_scrub_stamp":"2023-07-05T18:57:14.849454+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-06T20:37:16.358123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3b","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-05T18:57:16.902171+0000","last_change":"2023-07-05T18:57:15.305220+0000","last_active":"2023-07-05T18:57:16.902171+0000","last_peered":"2023-07-05T18:57:16.902171+0000","last_clean":"2023-07-05T18:57:16.902171+0000","last_became_active":"2023-07-05T18:57:15.304962+0000","last_became_peered":"2023-07-05T18:57:15.304962+0000","last_unstale":"2023-07-05T18:57:16.902171+0000","last_undegraded":"2023-07-05T18:57:16.902171+0000","last_fullsized":"2023-07-05T18:57:16.902171+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T18:57:14.849454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T18:57:14.849454+0000","last_clean_scrub_stamp":"2023-07-05T18:57:14.849454+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-06T21:19:45.289501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3a","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-05T18:57:16.902675+0000","last_change":"2023-07-05T18:57:15.289387+0000","last_active":"2023-07-05T18:57:16.902675+0000","last_peered":"2023-07-05T18:57:16.902675+0000","last_clean":"2023-07-05T18:57:16.902675+0000","last_became_active":"2023-07-05T18:57:15.289064+0000","last_became_peered":"2023-07-05T18:57:15.289064+0000","last_unstale":"2023-07-05T18:57:16.902675+0000","last_undegraded":"2023-07-05T18:57:16.902675+0000","last_fullsized":"2023-07-05T18:57:16.902675+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T18:57:14.849454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T18:57:14.849454+0000","last_clean_scrub_stamp":"2023-07-05T18:57:14.849454+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-06T23:36:28.798057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.39","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-05T18:57:16.288825+0000","last_change":"2023-07-05T18:57:15.313092+0000","last_active":"2023-07-05T18:57:16.288825+0000","last_peered":"2023-07-05T18:57:16.288825+0000","last_clean":"2023-07-05T18:57:16.288825+0000","last_became_active":"2023-07-05T18:57:15.312231+0000","last_became_peered":"2023-07-05T18:57:15.312231+0000","last_unstale":"2023-07-05T18:57:16.288825+0000","last_undegraded":"2023-07-05T18:57:16.288825+0000","last_fullsized":"2023-07-05T18:57:16.288825+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T18:57:14.849454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T18:57:14.849454+0000","last_clean_scrub_stamp":"2023-07-05T18:57:14.849454+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T02:57:02.950954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.38","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-05T18:57:16.287817+0000","last_change":"2023-07-05T18:57:15.306915+0000","last_active":"2023-07-05T18:57:16.287817+0000","last_peered":"2023-07-05T18:57:16.287817+0000","last_clean":"2023-07-05T18:57:16.287817+0000","last_became_active":"2023-07-05T18:57:15.306664+0000","last_became_peered":"2023-07-05T18:57:15.306664+0000","last_unstale":"2023-07-05T18:57:16.287817+0000","last_undegraded":"2023-07-05T18:57:16.287817+0000","last_fullsized":"2023-07-05T18:57:16.287817+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T18:57:14.849454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T18:57:14.849454+0000","last_clean_scrub_stamp":"2023-07-05T18:57:14.849454+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T00:27:47.371925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.37","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-05T18:57:16.903352+0000","last_change":"2023-07-05T18:57:15.304013+0000","last_active":"2023-07-05T18:57:16.903352+0000","last_peered":"2023-07-05T18:57:16.903352+0000","last_clean":"2023-07-05T18:57:16.903352+0000","last_became_active":"2023-07-05T18:57:15.303749+0000","last_became_peered":"2023-07-05T18:57:15.303749+0000","last_unstale":"2023-07-05T18:57:16.903352+0000","last_undegraded":"2023-07-05T18:57:16.903352+0000","last_fullsized":"2023-07-05T18:57:16.903352+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T18:57:14.849454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T18:57:14.849454+0000","last_clean_scrub_stamp":"2023-07-05T18:57:14.849454+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T04:15:09.189046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.36","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-05T18:57:16.289160+0000","last_change":"2023-07-05T18:57:15.314509+0000","last_active":"2023-07-05T18:57:16.289160+0000","last_peered":"2023-07-05T18:57:16.289160+0000","last_clean":"2023-07-05T18:57:16.289160+0000","last_became_active":"2023-07-05T18:57:15.313696+0000","last_became_peered":"2023-07-05T18:57:15.313696+0000","last_unstale":"2023-07-05T18:57:16.289160+0000","last_undegraded":"2023-07-05T18:57:16.289160+0000","last_fullsized":"2023-07-05T18:57:16.289160+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T18:57:14.849454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T18:57:14.849454+0000","last_clean_scrub_stamp":"2023-07-05T18:57:14.849454+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T00:16:15.859522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.35","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-05T18:57:16.289222+0000","last_change":"2023-07-05T18:57:15.312936+0000","last_active":"2023-07-05T18:57:16.289222+0000","last_peered":"2023-07-05T18:57:16.289222+0000","last_clean":"2023-07-05T18:57:16.289222+0000","last_became_active":"2023-07-05T18:57:15.312467+0000","last_became_peered":"2023-07-05T18:57:15.312467+0000","last_unstale":"2023-07-05T18:57:16.289222+0000","last_undegraded":"2023-07-05T18:57:16.289222+0000","last_fullsized":"2023-07-05T18:57:16.289222+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T18:57:14.849454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T18:57:14.849454+0000","last_clean_scrub_stamp":"2023-07-05T18:57:14.849454+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T03:43:56.949230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.34","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-05T18:57:16.902814+0000","last_change":"2023-07-05T18:57:15.300811+0000","last_active":"2023-07-05T18:57:16.902814+0000","last_peered":"2023-07-05T18:57:16.902814+0000","last_clean":"2023-07-05T18:57:16.902814+0000","last_became_active":"2023-07-05T18:57:15.300004+0000","last_became_peered":"2023-07-05T18:57:15.300004+0000","last_unstale":"2023-07-05T18:57:16.902814+0000","last_undegraded":"2023-07-05T18:57:16.902814+0000","last_fullsized":"2023-07-05T18:57:16.902814+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T18:57:14.849454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T18:57:14.849454+0000","last_clean_scrub_stamp":"2023-07-05T18:57:14.849454+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T03:12:43.303387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.33","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-05T18:57:16.288784+0000","last_change":"2023-07-05T18:57:15.313723+0000","last_active":"2023-07-05T18:57:16.288784+0000","last_peered":"2023-07-05T18:57:16.288784+0000","last_clean":"2023-07-05T18:57:16.288784+0000","last_became_active":"2023-07-05T18:57:15.313075+0000","last_became_peered":"2023-07-05T18:57:15.313075+0000","last_unstale":"2023-07-05T18:57:16.288784+0000","last_undegraded":"2023-07-05T18:57:16.288784+0000","last_fullsized":"2023-07-05T18:57:16.288784+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T18:57:14.849454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T18:57:14.849454+0000","last_clean_scrub_stamp":"2023-07-05T18:57:14.849454+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-06T23:41:48.799560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.32","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-05T18:57:16.902601+0000","last_change":"2023-07-05T18:57:15.304241+0000","last_active":"2023-07-05T18:57:16.902601+0000","last_peered":"2023-07-05T18:57:16.902601+0000","last_clean":"2023-07-05T18:57:16.902601+0000","last_became_active":"2023-07-05T18:57:15.303982+0000","last_became_peered":"2023-07-05T18:57:15.303982+0000","last_unstale":"2023-07-05T18:57:16.902601+0000","last_undegraded":"2023-07-05T18:57:16.902601+0000","last_fullsized":"2023-07-05T18:57:16.902601+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T18:57:14.849454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T18:57:14.849454+0000","last_clean_scrub_stamp":"2023-07-05T18:57:14.849454+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T02:09:52.155947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.31","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-05T18:57:16.288643+0000","last_change":"2023-07-05T18:57:15.313964+0000","last_active":"2023-07-05T18:57:16.288643+0000","last_peered":"2023-07-05T18:57:16.288643+0000","last_clean":"2023-07-05T18:57:16.288643+0000","last_became_active":"2023-07-05T18:57:15.313733+0000","last_became_peered":"2023-07-05T18:57:15.313733+0000","last_unstale":"2023-07-05T18:57:16.288643+0000","last_undegraded":"2023-07-05T18:57:16.288643+0000","last_fullsized":"2023-07-05T18:57:16.288643+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T18:57:14.849454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T18:57:14.849454+0000","last_clean_scrub_stamp":"2023-07-05T18:57:14.849454+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-06T21:39:30.995965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.30","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-05T18:57:16.901970+0000","last_change":"2023-07-05T18:57:15.308389+0000","last_active":"2023-07-05T18:57:16.901970+0000","last_peered":"2023-07-05T18:57:16.901970+0000","last_clean":"2023-07-05T18:57:16.901970+0000","last_became_active":"2023-07-05T18:57:15.307804+0000","last_became_peered":"2023-07-05T18:57:15.307804+0000","last_unstale":"2023-07-05T18:57:16.901970+0000","last_undegraded":"2023-07-05T18:57:16.901970+0000","last_fullsized":"2023-07-05T18:57:16.901970+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T18:57:14.849454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T18:57:14.849454+0000","last_clean_scrub_stamp":"2023-07-05T18:57:14.849454+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T01:50:19.446193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2f","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-05T18:57:16.902230+0000","last_change":"2023-07-05T18:57:15.304281+0000","last_active":"2023-07-05T18:57:16.902230+0000","last_peered":"2023-07-05T18:57:16.902230+0000","last_clean":"2023-07-05T18:57:16.902230+0000","last_became_active":"2023-07-05T18:57:15.304020+0000","last_became_peered":"2023-07-05T18:57:15.304020+0000","last_unstale":"2023-07-05T18:57:16.902230+0000","last_undegraded":"2023-07-05T18:57:16.902230+0000","last_fullsized":"2023-07-05T18:57:16.902230+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T18:57:14.849454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T18:57:14.849454+0000","last_clean_scrub_stamp":"2023-07-05T18:57:14.849454+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T02:31:28.861306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2e","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-05T18:57:16.287774+0000","last_change":"2023-07-05T18:57:15.306213+0000","last_active":"2023-07-05T18:57:16.287774+0000","last_peered":"2023-07-05T18:57:16.287774+0000","last_clean":"2023-07-05T18:57:16.287774+0000","last_became_active":"2023-07-05T18:57:15.305923+0000","last_became_peered":"2023-07-05T18:57:15.305923+0000","last_unstale":"2023-07-05T18:57:16.287774+0000","last_undegraded":"2023-07-05T18:57:16.287774+0000","last_fullsized":"2023-07-05T18:57:16.287774+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T18:57:14.849454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T18:57:14.849454+0000","last_clean_scrub_stamp":"2023-07-05T18:57:14.849454+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T03:17:09.797617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2d","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-05T18:57:16.903324+0000","last_change":"2023-07-05T18:57:15.303699+0000","last_active":"2023-07-05T18:57:16.903324+0000","last_peered":"2023-07-05T18:57:16.903324+0000","last_clean":"2023-07-05T18:57:16.903324+0000","last_became_active":"2023-07-05T18:57:15.303418+0000","last_became_peered":"2023-07-05T18:57:15.303418+0000","last_unstale":"2023-07-05T18:57:16.903324+0000","last_undegraded":"2023-07-05T18:57:16.903324+0000","last_fullsized":"2023-07-05T18:57:16.903324+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T18:57:14.849454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T18:57:14.849454+0000","last_clean_scrub_stamp":"2023-07-05T18:57:14.849454+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-06T21:07:13.517759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.2c","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-05T18:57:16.287378+0000","last_change":"2023-07-05T18:57:15.301493+0000","last_active":"2023-07-05T18:57:16.287378+0000","last_peered":"2023-07-05T18:57:16.287378+0000","last_clean":"2023-07-05T18:57:16.287378+0000","last_became_active":"2023-07-05T18:57:15.301234+0000","last_became_peered":"2023-07-05T18:57:15.301234+0000","last_unstale":"2023-07-05T18:57:16.287378+0000","last_undegraded":"2023-07-05T18:57:16.287378+0000","last_fullsized":"2023-07-05T18:57:16.287378+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T18:57:14.849454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T18:57:14.849454+0000","last_clean_scrub_stamp":"2023-07-05T18:57:14.849454+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T03:12:43.303387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2b","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-05T18:57:16.288959+0000","last_change":"2023-07-05T18:57:15.308944+0000","last_active":"2023-07-05T18:57:16.288959+0000","last_peered":"2023-07-05T18:57:16.288959+0000","last_clean":"2023-07-05T18:57:16.288959+0000","last_became_active":"2023-07-05T18:57:15.308725+0000","last_became_peered":"2023-07-05T18:57:15.308725+0000","last_unstale":"2023-07-05T18:57:16.288959+0000","last_undegraded":"2023-07-05T18:57:16.288959+0000","last_fullsized":"2023-07-05T18:57:16.288959+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T18:57:14.849454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T18:57:14.849454+0000","last_clean_scrub_stamp":"2023-07-05T18:57:14.849454+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T06:56:03.495003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.2a","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-05T18:57:16.902228+0000","last_change":"2023-07-05T18:57:15.305564+0000","last_active":"2023-07-05T18:57:16.902228+0000","last_peered":"2023-07-05T18:57:16.902228+0000","last_clean":"2023-07-05T18:57:16.902228+0000","last_became_active":"2023-07-05T18:57:15.305300+0000","last_became_peered":"2023-07-05T18:57:15.305300+0000","last_unstale":"2023-07-05T18:57:16.902228+0000","last_undegraded":"2023-07-05T18:57:16.902228+0000","last_fullsized":"2023-07-05T18:57:16.902228+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T18:57:14.849454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T18:57:14.849454+0000","last_clean_scrub_stamp":"2023-07-05T18:57:14.849454+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-06T23:17:24.615246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.29","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-05T18:57:16.901980+0000","last_change":"2023-07-05T18:57:15.303895+0000","last_active":"2023-07-05T18:57:16.901980+0000","last_peered":"2023-07-05T18:57:16.901980+0000","last_clean":"2023-07-05T18:57:16.901980+0000","last_became_active":"2023-07-05T18:57:15.303284+0000","last_became_peered":"2023-07-05T18:57:15.303284+0000","last_unstale":"2023-07-05T18:57:16.901980+0000","last_undegraded":"2023-07-05T18:57:16.901980+0000","last_fullsized":"2023-07-05T18:57:16.901980+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T18:57:14.849454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T18:57:14.849454+0000","last_clean_scrub_stamp":"2023-07-05T18:57:14.849454+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T06:45:55.925315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.28","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-05T18:57:16.902419+0000","last_change":"2023-07-05T18:57:15.304562+0000","last_active":"2023-07-05T18:57:16.902419+0000","last_peered":"2023-07-05T18:57:16.902419+0000","last_clean":"2023-07-05T18:57:16.902419+0000","last_became_active":"2023-07-05T18:57:15.304298+0000","last_became_peered":"2023-07-05T18:57:15.304298+0000","last_unstale":"2023-07-05T18:57:16.902419+0000","last_undegraded":"2023-07-05T18:57:16.902419+0000","last_fullsized":"2023-07-05T18:57:16.902419+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T18:57:14.849454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T18:57:14.849454+0000","last_clean_scrub_stamp":"2023-07-05T18:57:14.849454+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T02:02:50.091589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.27","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-05T18:57:16.287811+0000","last_change":"2023-07-05T18:57:15.297980+0000","last_active":"2023-07-05T18:57:16.287811+0000","last_peered":"2023-07-05T18:57:16.287811+0000","last_clean":"2023-07-05T18:57:16.287811+0000","last_became_active":"2023-07-05T18:57:15.297755+0000","last_became_peered":"2023-07-05T18:57:15.297755+0000","last_unstale":"2023-07-05T18:57:16.287811+0000","last_undegraded":"2023-07-05T18:57:16.287811+0000","last_fullsized":"2023-07-05T18:57:16.287811+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T18:57:14.849454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T18:57:14.849454+0000","last_clean_scrub_stamp":"2023-07-05T18:57:14.849454+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-06T23:13:44.165526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.26","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-05T18:57:16.902714+0000","last_change":"2023-07-05T18:57:15.303323+0000","last_active":"2023-07-05T18:57:16.902714+0000","last_peered":"2023-07-05T18:57:16.902714+0000","last_clean":"2023-07-05T18:57:16.902714+0000","last_became_active":"2023-07-05T18:57:15.303060+0000","last_became_peered":"2023-07-05T18:57:15.303060+0000","last_unstale":"2023-07-05T18:57:16.902714+0000","last_undegraded":"2023-07-05T18:57:16.902714+0000","last_fullsized":"2023-07-05T18:57:16.902714+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T18:57:14.849454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T18:57:14.849454+0000","last_clean_scrub_stamp":"2023-07-05T18:57:14.849454+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T02:18:53.288779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.25","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-05T18:57:16.287783+0000","last_change":"2023-07-05T18:57:15.299828+0000","last_active":"2023-07-05T18:57:16.287783+0000","last_peered":"2023-07-05T18:57:16.287783+0000","last_clean":"2023-07-05T18:57:16.287783+0000","last_became_active":"2023-07-05T18:57:15.299563+0000","last_became_peered":"2023-07-05T18:57:15.299563+0000","last_unstale":"2023-07-05T18:57:16.287783+0000","last_undegraded":"2023-07-05T18:57:16.287783+0000","last_fullsized":"2023-07-05T18:57:16.287783+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T18:57:14.849454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T18:57:14.849454+0000","last_clean_scrub_stamp":"2023-07-05T18:57:14.849454+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-06T23:16:45.043262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.24","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-05T18:57:16.289040+0000","last_change":"2023-07-05T18:57:15.312226+0000","last_active":"2023-07-05T18:57:16.289040+0000","last_peered":"2023-07-05T18:57:16.289040+0000","last_clean":"2023-07-05T18:57:16.289040+0000","last_became_active":"2023-07-05T18:57:15.311921+0000","last_became_peered":"2023-07-05T18:57:15.311921+0000","last_unstale":"2023-07-05T18:57:16.289040+0000","last_undegraded":"2023-07-05T18:57:16.289040+0000","last_fullsized":"2023-07-05T18:57:16.289040+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T18:57:14.849454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T18:57:14.849454+0000","last_clean_scrub_stamp":"2023-07-05T18:57:14.849454+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-06T20:22:18.509905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.23","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-05T18:57:16.287551+0000","last_change":"2023-07-05T18:57:15.289455+0000","last_active":"2023-07-05T18:57:16.287551+0000","last_peered":"2023-07-05T18:57:16.287551+0000","last_clean":"2023-07-05T18:57:16.287551+0000","last_became_active":"2023-07-05T18:57:15.289140+0000","last_became_peered":"2023-07-05T18:57:15.289140+0000","last_unstale":"2023-07-05T18:57:16.287551+0000","last_undegraded":"2023-07-05T18:57:16.287551+0000","last_fullsized":"2023-07-05T18:57:16.287551+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T18:57:14.849454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T18:57:14.849454+0000","last_clean_scrub_stamp":"2023-07-05T18:57:14.849454+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T05:42:15.537264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.22","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-05T18:57:16.287473+0000","last_change":"2023-07-05T18:57:15.296111+0000","last_active":"2023-07-05T18:57:16.287473+0000","last_peered":"2023-07-05T18:57:16.287473+0000","last_clean":"2023-07-05T18:57:16.287473+0000","last_became_active":"2023-07-05T18:57:15.295834+0000","last_became_peered":"2023-07-05T18:57:15.295834+0000","last_unstale":"2023-07-05T18:57:16.287473+0000","last_undegraded":"2023-07-05T18:57:16.287473+0000","last_fullsized":"2023-07-05T18:57:16.287473+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T18:57:14.849454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T18:57:14.849454+0000","last_clean_scrub_stamp":"2023-07-05T18:57:14.849454+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-06T23:18:29.316424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.21","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-05T18:57:16.902932+0000","last_change":"2023-07-05T18:57:15.303580+0000","last_active":"2023-07-05T18:57:16.902932+0000","last_peered":"2023-07-05T18:57:16.902932+0000","last_clean":"2023-07-05T18:57:16.902932+0000","last_became_active":"2023-07-05T18:57:15.302825+0000","last_became_peered":"2023-07-05T18:57:15.302825+0000","last_unstale":"2023-07-05T18:57:16.902932+0000","last_undegraded":"2023-07-05T18:57:16.902932+0000","last_fullsized":"2023-07-05T18:57:16.902932+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T18:57:14.849454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T18:57:14.849454+0000","last_clean_scrub_stamp":"2023-07-05T18:57:14.849454+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-06T23:55:03.547311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.20","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-05T18:57:16.901969+0000","last_change":"2023-07-05T18:57:15.299825+0000","last_active":"2023-07-05T18:57:16.901969+0000","last_peered":"2023-07-05T18:57:16.901969+0000","last_clean":"2023-07-05T18:57:16.901969+0000","last_became_active":"2023-07-05T18:57:15.299581+0000","last_became_peered":"2023-07-05T18:57:15.299581+0000","last_unstale":"2023-07-05T18:57:16.901969+0000","last_undegraded":"2023-07-05T18:57:16.901969+0000","last_fullsized":"2023-07-05T18:57:16.901969+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T18:57:14.849454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T18:57:14.849454+0000","last_clean_scrub_stamp":"2023-07-05T18:57:14.849454+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T05:12:10.750794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1c","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-05T18:57:16.902061+0000","last_change":"2023-07-05T18:57:15.313067+0000","last_active":"2023-07-05T18:57:16.902061+0000","last_peered":"2023-07-05T18:57:16.902061+0000","last_clean":"2023-07-05T18:57:16.902061+0000","last_became_active":"2023-07-05T18:57:15.312795+0000","last_became_peered":"2023-07-05T18:57:15.312795+0000","last_unstale":"2023-07-05T18:57:16.902061+0000","last_undegraded":"2023-07-05T18:57:16.902061+0000","last_fullsized":"2023-07-05T18:57:16.902061+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T18:57:14.849454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T18:57:14.849454+0000","last_clean_scrub_stamp":"2023-07-05T18:57:14.849454+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T06:11:33.913163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1f","version":"34'4","reported_seq":17,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-05T18:57:16.287849+0000","last_change":"2023-07-05T18:57:14.872801+0000","last_active":"2023-07-05T18:57:16.287849+0000","last_peered":"2023-07-05T18:57:16.287849+0000","last_clean":"2023-07-05T18:57:16.287849+0000","last_became_active":"2023-07-05T18:57:14.872521+0000","last_became_peered":"2023-07-05T18:57:14.872521+0000","last_unstale":"2023-07-05T18:57:16.287849+0000","last_undegraded":"2023-07-05T18:57:16.287849+0000","last_fullsized":"2023-07-05T18:57:16.287849+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T18:57:13.843710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T18:57:13.843710+0000","last_clean_scrub_stamp":"2023-07-05T18:57:13.843710+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T04:15:08.183301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-05T18:57:16.903035+0000","last_change":"2023-07-05T18:57:15.305499+0000","last_active":"2023-07-05T18:57:16.903035+0000","last_peered":"2023-07-05T18:57:16.903035+0000","last_clean":"2023-07-05T18:57:16.903035+0000","last_became_active":"2023-07-05T18:57:15.305243+0000","last_became_peered":"2023-07-05T18:57:15.305243+0000","last_unstale":"2023-07-05T18:57:16.903035+0000","last_undegraded":"2023-07-05T18:57:16.903035+0000","last_fullsized":"2023-07-05T18:57:16.903035+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T18:57:14.849454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T18:57:14.849454+0000","last_clean_scrub_stamp":"2023-07-05T18:57:14.849454+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T03:57:03.714848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1e","version":"34'1","reported_seq":14,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-05T18:57:16.903272+0000","last_change":"2023-07-05T18:57:14.871637+0000","last_active":"2023-07-05T18:57:16.903272+0000","last_peered":"2023-07-05T18:57:16.903272+0000","last_clean":"2023-07-05T18:57:16.903272+0000","last_became_active":"2023-07-05T18:57:14.871356+0000","last_became_peered":"2023-07-05T18:57:14.871356+0000","last_unstale":"2023-07-05T18:57:16.903272+0000","last_undegraded":"2023-07-05T18:57:16.903272+0000","last_fullsized":"2023-07-05T18:57:16.903272+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T18:57:13.843710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T18:57:13.843710+0000","last_clean_scrub_stamp":"2023-07-05T18:57:13.843710+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-06T23:16:44.037517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-05T18:57:16.902779+0000","last_change":"2023-07-05T18:57:15.306265+0000","last_active":"2023-07-05T18:57:16.902779+0000","last_peered":"2023-07-05T18:57:16.902779+0000","last_clean":"2023-07-05T18:57:16.902779+0000","last_became_active":"2023-07-05T18:57:15.304037+0000","last_became_peered":"2023-07-05T18:57:15.304037+0000","last_unstale":"2023-07-05T18:57:16.902779+0000","last_undegraded":"2023-07-05T18:57:16.902779+0000","last_fullsized":"2023-07-05T18:57:16.902779+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T18:57:14.849454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T18:57:14.849454+0000","last_clean_scrub_stamp":"2023-07-05T18:57:14.849454+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T00:16:39.980815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1d","version":"34'2","reported_seq":15,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-05T18:57:16.903180+0000","last_change":"2023-07-05T18:57:14.872649+0000","last_active":"2023-07-05T18:57:16.903180+0000","last_peered":"2023-07-05T18:57:16.903180+0000","last_clean":"2023-07-05T18:57:16.903180+0000","last_became_active":"2023-07-05T18:57:14.872348+0000","last_became_peered":"2023-07-05T18:57:14.872348+0000","last_unstale":"2023-07-05T18:57:16.903180+0000","last_undegraded":"2023-07-05T18:57:16.903180+0000","last_fullsized":"2023-07-05T18:57:16.903180+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T18:57:13.843710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T18:57:13.843710+0000","last_clean_scrub_stamp":"2023-07-05T18:57:13.843710+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-06T21:21:53.540891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-05T18:57:16.288437+0000","last_change":"2023-07-05T18:57:15.293488+0000","last_active":"2023-07-05T18:57:16.288437+0000","last_peered":"2023-07-05T18:57:16.288437+0000","last_clean":"2023-07-05T18:57:16.288437+0000","last_became_active":"2023-07-05T18:57:15.293150+0000","last_became_peered":"2023-07-05T18:57:15.293150+0000","last_unstale":"2023-07-05T18:57:16.288437+0000","last_undegraded":"2023-07-05T18:57:16.288437+0000","last_fullsized":"2023-07-05T18:57:16.288437+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T18:57:14.849454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T18:57:14.849454+0000","last_clean_scrub_stamp":"2023-07-05T18:57:14.849454+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T00:27:26.867027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1c","version":"34'2","reported_seq":15,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-05T18:57:16.902388+0000","last_change":"2023-07-05T18:57:14.871034+0000","last_active":"2023-07-05T18:57:16.902388+0000","last_peered":"2023-07-05T18:57:16.902388+0000","last_clean":"2023-07-05T18:57:16.902388+0000","last_became_active":"2023-07-05T18:57:14.870747+0000","last_became_peered":"2023-07-05T18:57:14.870747+0000","last_unstale":"2023-07-05T18:57:16.902388+0000","last_undegraded":"2023-07-05T18:57:16.902388+0000","last_fullsized":"2023-07-05T18:57:16.902388+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T18:57:13.843710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T18:57:13.843710+0000","last_clean_scrub_stamp":"2023-07-05T18:57:13.843710+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-06T23:06:04.685362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-05T18:57:16.902304+0000","last_change":"2023-07-05T18:57:15.303291+0000","last_active":"2023-07-05T18:57:16.902304+0000","last_peered":"2023-07-05T18:57:16.902304+0000","last_clean":"2023-07-05T18:57:16.902304+0000","last_became_active":"2023-07-05T18:57:15.303018+0000","last_became_peered":"2023-07-05T18:57:15.303018+0000","last_unstale":"2023-07-05T18:57:16.902304+0000","last_undegraded":"2023-07-05T18:57:16.902304+0000","last_fullsized":"2023-07-05T18:57:16.902304+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T18:57:14.849454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T18:57:14.849454+0000","last_clean_scrub_stamp":"2023-07-05T18:57:14.849454+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T03:13:42.345071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1b","version":"34'1","reported_seq":14,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-05T18:57:16.288864+0000","last_change":"2023-07-05T18:57:14.875155+0000","last_active":"2023-07-05T18:57:16.288864+0000","last_peered":"2023-07-05T18:57:16.288864+0000","last_clean":"2023-07-05T18:57:16.288864+0000","last_became_active":"2023-07-05T18:57:14.874878+0000","last_became_peered":"2023-07-05T18:57:14.874878+0000","last_unstale":"2023-07-05T18:57:16.288864+0000","last_undegraded":"2023-07-05T18:57:16.288864+0000","last_fullsized":"2023-07-05T18:57:16.288864+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T18:57:13.843710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T18:57:13.843710+0000","last_clean_scrub_stamp":"2023-07-05T18:57:13.843710+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-06T21:47:43.320275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-05T18:57:16.288638+0000","last_change":"2023-07-05T18:57:15.313975+0000","last_active":"2023-07-05T18:57:16.288638+0000","last_peered":"2023-07-05T18:57:16.288638+0000","last_clean":"2023-07-05T18:57:16.288638+0000","last_became_active":"2023-07-05T18:57:15.313680+0000","last_became_peered":"2023-07-05T18:57:15.313680+0000","last_unstale":"2023-07-05T18:57:16.288638+0000","last_undegraded":"2023-07-05T18:57:16.288638+0000","last_fullsized":"2023-07-05T18:57:16.288638+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T18:57:14.849454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T18:57:14.849454+0000","last_clean_scrub_stamp":"2023-07-05T18:57:14.849454+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T00:36:10.360647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"34'1","reported_seq":14,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-05T18:57:16.902508+0000","last_change":"2023-07-05T18:57:14.876845+0000","last_active":"2023-07-05T18:57:16.902508+0000","last_peered":"2023-07-05T18:57:16.902508+0000","last_clean":"2023-07-05T18:57:16.902508+0000","last_became_active":"2023-07-05T18:57:14.876604+0000","last_became_peered":"2023-07-05T18:57:14.876604+0000","last_unstale":"2023-07-05T18:57:16.902508+0000","last_undegraded":"2023-07-05T18:57:16.902508+0000","last_fullsized":"2023-07-05T18:57:16.902508+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T18:57:13.843710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T18:57:13.843710+0000","last_clean_scrub_stamp":"2023-07-05T18:57:13.843710+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-06T19:34:11.700460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-05T18:57:16.902386+0000","last_change":"2023-07-05T18:57:15.305517+0000","last_active":"2023-07-05T18:57:16.902386+0000","last_peered":"2023-07-05T18:57:16.902386+0000","last_clean":"2023-07-05T18:57:16.902386+0000","last_became_active":"2023-07-05T18:57:15.305073+0000","last_became_peered":"2023-07-05T18:57:15.305073+0000","last_unstale":"2023-07-05T18:57:16.902386+0000","last_undegraded":"2023-07-05T18:57:16.902386+0000","last_fullsized":"2023-07-05T18:57:16.902386+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T18:57:14.849454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T18:57:14.849454+0000","last_clean_scrub_stamp":"2023-07-05T18:57:14.849454+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-06T20:02:33.895529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":13,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-05T18:57:16.903069+0000","last_change":"2023-07-05T18:57:14.877951+0000","last_active":"2023-07-05T18:57:16.903069+0000","last_peered":"2023-07-05T18:57:16.903069+0000","last_clean":"2023-07-05T18:57:16.903069+0000","last_became_active":"2023-07-05T18:57:14.877620+0000","last_became_peered":"2023-07-05T18:57:14.877620+0000","last_unstale":"2023-07-05T18:57:16.903069+0000","last_undegraded":"2023-07-05T18:57:16.903069+0000","last_fullsized":"2023-07-05T18:57:16.903069+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T18:57:13.843710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T18:57:13.843710+0000","last_clean_scrub_stamp":"2023-07-05T18:57:13.843710+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T03:13:41.339326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-05T18:57:16.288240+0000","last_change":"2023-07-05T18:57:15.293938+0000","last_active":"2023-07-05T18:57:16.288240+0000","last_peered":"2023-07-05T18:57:16.288240+0000","last_clean":"2023-07-05T18:57:16.288240+0000","last_became_active":"2023-07-05T18:57:15.293511+0000","last_became_peered":"2023-07-05T18:57:15.293511+0000","last_unstale":"2023-07-05T18:57:16.288240+0000","last_undegraded":"2023-07-05T18:57:16.288240+0000","last_fullsized":"2023-07-05T18:57:16.288240+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T18:57:14.849454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T18:57:14.849454+0000","last_clean_scrub_stamp":"2023-07-05T18:57:14.849454+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T03:41:31.158289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":13,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-05T18:57:16.902055+0000","last_change":"2023-07-05T18:57:14.876452+0000","last_active":"2023-07-05T18:57:16.902055+0000","last_peered":"2023-07-05T18:57:16.902055+0000","last_clean":"2023-07-05T18:57:16.902055+0000","last_became_active":"2023-07-05T18:57:14.874813+0000","last_became_peered":"2023-07-05T18:57:14.874813+0000","last_unstale":"2023-07-05T18:57:16.902055+0000","last_undegraded":"2023-07-05T18:57:16.902055+0000","last_fullsized":"2023-07-05T18:57:16.902055+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T18:57:13.843710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T18:57:13.843710+0000","last_clean_scrub_stamp":"2023-07-05T18:57:13.843710+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-06T22:35:01.302791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-05T18:57:16.902507+0000","last_change":"2023-07-05T18:57:15.306201+0000","last_active":"2023-07-05T18:57:16.902507+0000","last_peered":"2023-07-05T18:57:16.902507+0000","last_clean":"2023-07-05T18:57:16.902507+0000","last_became_active":"2023-07-05T18:57:15.305895+0000","last_became_peered":"2023-07-05T18:57:15.305895+0000","last_unstale":"2023-07-05T18:57:16.902507+0000","last_undegraded":"2023-07-05T18:57:16.902507+0000","last_fullsized":"2023-07-05T18:57:16.902507+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T18:57:14.849454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T18:57:14.849454+0000","last_clean_scrub_stamp":"2023-07-05T18:57:14.849454+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T03:54:04.950016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":13,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-05T18:57:16.288515+0000","last_change":"2023-07-05T18:57:14.868383+0000","last_active":"2023-07-05T18:57:16.288515+0000","last_peered":"2023-07-05T18:57:16.288515+0000","last_clean":"2023-07-05T18:57:16.288515+0000","last_became_active":"2023-07-05T18:57:14.868095+0000","last_became_peered":"2023-07-05T18:57:14.868095+0000","last_unstale":"2023-07-05T18:57:16.288515+0000","last_undegraded":"2023-07-05T18:57:16.288515+0000","last_fullsized":"2023-07-05T18:57:16.288515+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T18:57:13.843710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T18:57:13.843710+0000","last_clean_scrub_stamp":"2023-07-05T18:57:13.843710+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T06:06:36.403273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-05T18:57:16.902363+0000","last_change":"2023-07-05T18:57:15.297117+0000","last_active":"2023-07-05T18:57:16.902363+0000","last_peered":"2023-07-05T18:57:16.902363+0000","last_clean":"2023-07-05T18:57:16.902363+0000","last_became_active":"2023-07-05T18:57:15.296759+0000","last_became_peered":"2023-07-05T18:57:15.296759+0000","last_unstale":"2023-07-05T18:57:16.902363+0000","last_undegraded":"2023-07-05T18:57:16.902363+0000","last_fullsized":"2023-07-05T18:57:16.902363+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T18:57:14.849454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T18:57:14.849454+0000","last_clean_scrub_stamp":"2023-07-05T18:57:14.849454+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-06T23:49:23.200877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":13,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-05T18:57:16.289291+0000","last_change":"2023-07-05T18:57:14.872652+0000","last_active":"2023-07-05T18:57:16.289291+0000","last_peered":"2023-07-05T18:57:16.289291+0000","last_clean":"2023-07-05T18:57:16.289291+0000","last_became_active":"2023-07-05T18:57:14.870760+0000","last_became_peered":"2023-07-05T18:57:14.870760+0000","last_unstale":"2023-07-05T18:57:16.289291+0000","last_undegraded":"2023-07-05T18:57:16.289291+0000","last_fullsized":"2023-07-05T18:57:16.289291+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T18:57:13.843710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T18:57:13.843710+0000","last_clean_scrub_stamp":"2023-07-05T18:57:13.843710+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T02:13:58.970021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-05T18:57:16.903037+0000","last_change":"2023-07-05T18:57:15.297404+0000","last_active":"2023-07-05T18:57:16.903037+0000","last_peered":"2023-07-05T18:57:16.903037+0000","last_clean":"2023-07-05T18:57:16.903037+0000","last_became_active":"2023-07-05T18:57:15.297149+0000","last_became_peered":"2023-07-05T18:57:15.297149+0000","last_unstale":"2023-07-05T18:57:16.903037+0000","last_undegraded":"2023-07-05T18:57:16.903037+0000","last_fullsized":"2023-07-05T18:57:16.903037+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T18:57:14.849454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T18:57:14.849454+0000","last_clean_scrub_stamp":"2023-07-05T18:57:14.849454+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T05:42:15.537264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.15","version":"34'3","reported_seq":16,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-05T18:57:16.289284+0000","last_change":"2023-07-05T18:57:14.873684+0000","last_active":"2023-07-05T18:57:16.289284+0000","last_peered":"2023-07-05T18:57:16.289284+0000","last_clean":"2023-07-05T18:57:16.289284+0000","last_became_active":"2023-07-05T18:57:14.872919+0000","last_became_peered":"2023-07-05T18:57:14.872919+0000","last_unstale":"2023-07-05T18:57:16.289284+0000","last_undegraded":"2023-07-05T18:57:16.289284+0000","last_fullsized":"2023-07-05T18:57:16.289284+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T18:57:13.843710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T18:57:13.843710+0000","last_clean_scrub_stamp":"2023-07-05T18:57:13.843710+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-06T22:17:11.488295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-05T18:57:16.902740+0000","last_change":"2023-07-05T18:57:15.300105+0000","last_active":"2023-07-05T18:57:16.902740+0000","last_peered":"2023-07-05T18:57:16.902740+0000","last_clean":"2023-07-05T18:57:16.902740+0000","last_became_active":"2023-07-05T18:57:15.299823+0000","last_became_peered":"2023-07-05T18:57:15.299823+0000","last_unstale":"2023-07-05T18:57:16.902740+0000","last_undegraded":"2023-07-05T18:57:16.902740+0000","last_fullsized":"2023-07-05T18:57:16.902740+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T18:57:14.849454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T18:57:14.849454+0000","last_clean_scrub_stamp":"2023-07-05T18:57:14.849454+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-06T19:39:44.667228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.14","version":"34'6","reported_seq":19,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-05T18:57:16.288027+0000","last_change":"2023-07-05T18:57:14.871063+0000","last_active":"2023-07-05T18:57:16.288027+0000","last_peered":"2023-07-05T18:57:16.288027+0000","last_clean":"2023-07-05T18:57:16.288027+0000","last_became_active":"2023-07-05T18:57:14.870829+0000","last_became_peered":"2023-07-05T18:57:14.870829+0000","last_unstale":"2023-07-05T18:57:16.288027+0000","last_undegraded":"2023-07-05T18:57:16.288027+0000","last_fullsized":"2023-07-05T18:57:16.288027+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T18:57:13.843710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T18:57:13.843710+0000","last_clean_scrub_stamp":"2023-07-05T18:57:13.843710+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-06T23:55:02.541567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-05T18:57:16.903319+0000","last_change":"2023-07-05T18:57:15.312709+0000","last_active":"2023-07-05T18:57:16.903319+0000","last_peered":"2023-07-05T18:57:16.903319+0000","last_clean":"2023-07-05T18:57:16.903319+0000","last_became_active":"2023-07-05T18:57:15.312424+0000","last_became_peered":"2023-07-05T18:57:15.312424+0000","last_unstale":"2023-07-05T18:57:16.903319+0000","last_undegraded":"2023-07-05T18:57:16.903319+0000","last_fullsized":"2023-07-05T18:57:16.903319+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T18:57:14.849454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T18:57:14.849454+0000","last_clean_scrub_stamp":"2023-07-05T18:57:14.849454+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-06T23:13:44.165526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.13","version":"34'2","reported_seq":15,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-05T18:57:16.288270+0000","last_change":"2023-07-05T18:57:14.867341+0000","last_active":"2023-07-05T18:57:16.288270+0000","last_peered":"2023-07-05T18:57:16.288270+0000","last_clean":"2023-07-05T18:57:16.288270+0000","last_became_active":"2023-07-05T18:57:14.867009+0000","last_became_peered":"2023-07-05T18:57:14.867009+0000","last_unstale":"2023-07-05T18:57:16.288270+0000","last_undegraded":"2023-07-05T18:57:16.288270+0000","last_fullsized":"2023-07-05T18:57:16.288270+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T18:57:13.843710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T18:57:13.843710+0000","last_clean_scrub_stamp":"2023-07-05T18:57:13.843710+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-06T19:49:23.267131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-05T18:57:16.287947+0000","last_change":"2023-07-05T18:57:15.294525+0000","last_active":"2023-07-05T18:57:16.287947+0000","last_peered":"2023-07-05T18:57:16.287947+0000","last_clean":"2023-07-05T18:57:16.287947+0000","last_became_active":"2023-07-05T18:57:15.294277+0000","last_became_peered":"2023-07-05T18:57:15.294277+0000","last_unstale":"2023-07-05T18:57:16.287947+0000","last_undegraded":"2023-07-05T18:57:16.287947+0000","last_fullsized":"2023-07-05T18:57:16.287947+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T18:57:14.849454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T18:57:14.849454+0000","last_clean_scrub_stamp":"2023-07-05T18:57:14.849454+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-06T20:06:27.731618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":13,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-05T18:57:16.902818+0000","last_change":"2023-07-05T18:57:14.871127+0000","last_active":"2023-07-05T18:57:16.902818+0000","last_peered":"2023-07-05T18:57:16.902818+0000","last_clean":"2023-07-05T18:57:16.902818+0000","last_became_active":"2023-07-05T18:57:14.870805+0000","last_became_peered":"2023-07-05T18:57:14.870805+0000","last_unstale":"2023-07-05T18:57:16.902818+0000","last_undegraded":"2023-07-05T18:57:16.902818+0000","last_fullsized":"2023-07-05T18:57:16.902818+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T18:57:13.843710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T18:57:13.843710+0000","last_clean_scrub_stamp":"2023-07-05T18:57:13.843710+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-06T21:35:56.375870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-05T18:57:16.902337+0000","last_change":"2023-07-05T18:57:15.303543+0000","last_active":"2023-07-05T18:57:16.902337+0000","last_peered":"2023-07-05T18:57:16.902337+0000","last_clean":"2023-07-05T18:57:16.902337+0000","last_became_active":"2023-07-05T18:57:15.302907+0000","last_became_peered":"2023-07-05T18:57:15.302907+0000","last_unstale":"2023-07-05T18:57:16.902337+0000","last_undegraded":"2023-07-05T18:57:16.902337+0000","last_fullsized":"2023-07-05T18:57:16.902337+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T18:57:14.849454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T18:57:14.849454+0000","last_clean_scrub_stamp":"2023-07-05T18:57:14.849454+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-06T19:47:23.141648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":13,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-05T18:57:16.287236+0000","last_change":"2023-07-05T18:57:14.865286+0000","last_active":"2023-07-05T18:57:16.287236+0000","last_peered":"2023-07-05T18:57:16.287236+0000","last_clean":"2023-07-05T18:57:16.287236+0000","last_became_active":"2023-07-05T18:57:14.864973+0000","last_became_peered":"2023-07-05T18:57:14.864973+0000","last_unstale":"2023-07-05T18:57:16.287236+0000","last_undegraded":"2023-07-05T18:57:16.287236+0000","last_fullsized":"2023-07-05T18:57:16.287236+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T18:57:13.843710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T18:57:13.843710+0000","last_clean_scrub_stamp":"2023-07-05T18:57:13.843710+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T01:59:44.906357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-05T18:57:16.288154+0000","last_change":"2023-07-05T18:57:15.294527+0000","last_active":"2023-07-05T18:57:16.288154+0000","last_peered":"2023-07-05T18:57:16.288154+0000","last_clean":"2023-07-05T18:57:16.288154+0000","last_became_active":"2023-07-05T18:57:15.294266+0000","last_became_peered":"2023-07-05T18:57:15.294266+0000","last_unstale":"2023-07-05T18:57:16.288154+0000","last_undegraded":"2023-07-05T18:57:16.288154+0000","last_fullsized":"2023-07-05T18:57:16.288154+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T18:57:14.849454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T18:57:14.849454+0000","last_clean_scrub_stamp":"2023-07-05T18:57:14.849454+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-06T19:50:35.627327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.10","version":"34'8","reported_seq":21,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-05T18:57:16.902137+0000","last_change":"2023-07-05T18:57:14.875807+0000","last_active":"2023-07-05T18:57:16.902137+0000","last_peered":"2023-07-05T18:57:16.902137+0000","last_clean":"2023-07-05T18:57:16.902137+0000","last_became_active":"2023-07-05T18:57:14.875478+0000","last_became_peered":"2023-07-05T18:57:14.875478+0000","last_unstale":"2023-07-05T18:57:16.902137+0000","last_undegraded":"2023-07-05T18:57:16.902137+0000","last_fullsized":"2023-07-05T18:57:16.902137+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T18:57:13.843710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T18:57:13.843710+0000","last_clean_scrub_stamp":"2023-07-05T18:57:13.843710+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T03:30:52.819851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-05T18:57:16.288000+0000","last_change":"2023-07-05T18:57:15.295969+0000","last_active":"2023-07-05T18:57:16.288000+0000","last_peered":"2023-07-05T18:57:16.288000+0000","last_clean":"2023-07-05T18:57:16.288000+0000","last_became_active":"2023-07-05T18:57:15.295680+0000","last_became_peered":"2023-07-05T18:57:15.295680+0000","last_unstale":"2023-07-05T18:57:16.288000+0000","last_undegraded":"2023-07-05T18:57:16.288000+0000","last_fullsized":"2023-07-05T18:57:16.288000+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T18:57:14.849454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T18:57:14.849454+0000","last_clean_scrub_stamp":"2023-07-05T18:57:14.849454+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T06:06:42.883138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"34'1","reported_seq":14,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-05T18:57:16.289419+0000","last_change":"2023-07-05T18:57:14.873803+0000","last_active":"2023-07-05T18:57:16.289419+0000","last_peered":"2023-07-05T18:57:16.289419+0000","last_clean":"2023-07-05T18:57:16.289419+0000","last_became_active":"2023-07-05T18:57:14.872369+0000","last_became_peered":"2023-07-05T18:57:14.872369+0000","last_unstale":"2023-07-05T18:57:16.289419+0000","last_undegraded":"2023-07-05T18:57:16.289419+0000","last_fullsized":"2023-07-05T18:57:16.289419+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T18:57:13.843710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T18:57:13.843710+0000","last_clean_scrub_stamp":"2023-07-05T18:57:13.843710+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-06T23:25:38.743247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-05T18:57:16.289157+0000","last_change":"2023-07-05T18:57:15.312760+0000","last_active":"2023-07-05T18:57:16.289157+0000","last_peered":"2023-07-05T18:57:16.289157+0000","last_clean":"2023-07-05T18:57:16.289157+0000","last_became_active":"2023-07-05T18:57:15.309414+0000","last_became_peered":"2023-07-05T18:57:15.309414+0000","last_unstale":"2023-07-05T18:57:16.289157+0000","last_undegraded":"2023-07-05T18:57:16.289157+0000","last_fullsized":"2023-07-05T18:57:16.289157+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T18:57:14.849454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T18:57:14.849454+0000","last_clean_scrub_stamp":"2023-07-05T18:57:14.849454+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-06T23:35:17.443605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.e","version":"34'2","reported_seq":15,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-05T18:57:16.903852+0000","last_change":"2023-07-05T18:57:14.878164+0000","last_active":"2023-07-05T18:57:16.903852+0000","last_peered":"2023-07-05T18:57:16.903852+0000","last_clean":"2023-07-05T18:57:16.903852+0000","last_became_active":"2023-07-05T18:57:14.877894+0000","last_became_peered":"2023-07-05T18:57:14.877894+0000","last_unstale":"2023-07-05T18:57:16.903852+0000","last_undegraded":"2023-07-05T18:57:16.903852+0000","last_fullsized":"2023-07-05T18:57:16.903852+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T18:57:13.843710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T18:57:13.843710+0000","last_clean_scrub_stamp":"2023-07-05T18:57:13.843710+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-06T20:29:51.953677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-05T18:57:16.902882+0000","last_change":"2023-07-05T18:57:15.296980+0000","last_active":"2023-07-05T18:57:16.902882+0000","last_peered":"2023-07-05T18:57:16.902882+0000","last_clean":"2023-07-05T18:57:16.902882+0000","last_became_active":"2023-07-05T18:57:15.296735+0000","last_became_peered":"2023-07-05T18:57:15.296735+0000","last_unstale":"2023-07-05T18:57:16.902882+0000","last_undegraded":"2023-07-05T18:57:16.902882+0000","last_fullsized":"2023-07-05T18:57:16.902882+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T18:57:14.849454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T18:57:14.849454+0000","last_clean_scrub_stamp":"2023-07-05T18:57:14.849454+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T00:36:40.610171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"34'1","reported_seq":14,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-05T18:57:16.903259+0000","last_change":"2023-07-05T18:57:14.875059+0000","last_active":"2023-07-05T18:57:16.903259+0000","last_peered":"2023-07-05T18:57:16.903259+0000","last_clean":"2023-07-05T18:57:16.903259+0000","last_became_active":"2023-07-05T18:57:14.874735+0000","last_became_peered":"2023-07-05T18:57:14.874735+0000","last_unstale":"2023-07-05T18:57:16.903259+0000","last_undegraded":"2023-07-05T18:57:16.903259+0000","last_fullsized":"2023-07-05T18:57:16.903259+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T18:57:13.843710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T18:57:13.843710+0000","last_clean_scrub_stamp":"2023-07-05T18:57:13.843710+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T03:00:51.566595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-05T18:57:16.902678+0000","last_change":"2023-07-05T18:57:15.303267+0000","last_active":"2023-07-05T18:57:16.902678+0000","last_peered":"2023-07-05T18:57:16.902678+0000","last_clean":"2023-07-05T18:57:16.902678+0000","last_became_active":"2023-07-05T18:57:15.302990+0000","last_became_peered":"2023-07-05T18:57:15.302990+0000","last_unstale":"2023-07-05T18:57:16.902678+0000","last_undegraded":"2023-07-05T18:57:16.902678+0000","last_fullsized":"2023-07-05T18:57:16.902678+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T18:57:14.849454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T18:57:14.849454+0000","last_clean_scrub_stamp":"2023-07-05T18:57:14.849454+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-06T22:01:40.742324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":13,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-05T18:57:16.902425+0000","last_change":"2023-07-05T18:57:14.872573+0000","last_active":"2023-07-05T18:57:16.902425+0000","last_peered":"2023-07-05T18:57:16.902425+0000","last_clean":"2023-07-05T18:57:16.902425+0000","last_became_active":"2023-07-05T18:57:14.872254+0000","last_became_peered":"2023-07-05T18:57:14.872254+0000","last_unstale":"2023-07-05T18:57:16.902425+0000","last_undegraded":"2023-07-05T18:57:16.902425+0000","last_fullsized":"2023-07-05T18:57:16.902425+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T18:57:13.843710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T18:57:13.843710+0000","last_clean_scrub_stamp":"2023-07-05T18:57:13.843710+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-06T21:25:45.377212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-05T18:57:16.901941+0000","last_change":"2023-07-05T18:57:15.303796+0000","last_active":"2023-07-05T18:57:16.901941+0000","last_peered":"2023-07-05T18:57:16.901941+0000","last_clean":"2023-07-05T18:57:16.901941+0000","last_became_active":"2023-07-05T18:57:15.303080+0000","last_became_peered":"2023-07-05T18:57:15.303080+0000","last_unstale":"2023-07-05T18:57:16.901941+0000","last_undegraded":"2023-07-05T18:57:16.901941+0000","last_fullsized":"2023-07-05T18:57:16.901941+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T18:57:14.849454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T18:57:14.849454+0000","last_clean_scrub_stamp":"2023-07-05T18:57:14.849454+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T02:19:32.422081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"34'2","reported_seq":15,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-05T18:57:16.902329+0000","last_change":"2023-07-05T18:57:14.872481+0000","last_active":"2023-07-05T18:57:16.902329+0000","last_peered":"2023-07-05T18:57:16.902329+0000","last_clean":"2023-07-05T18:57:16.902329+0000","last_became_active":"2023-07-05T18:57:14.872155+0000","last_became_peered":"2023-07-05T18:57:14.872155+0000","last_unstale":"2023-07-05T18:57:16.902329+0000","last_undegraded":"2023-07-05T18:57:16.902329+0000","last_fullsized":"2023-07-05T18:57:16.902329+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T18:57:13.843710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T18:57:13.843710+0000","last_clean_scrub_stamp":"2023-07-05T18:57:13.843710+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T06:42:22.419375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-05T18:57:16.902539+0000","last_change":"2023-07-05T18:57:15.300636+0000","last_active":"2023-07-05T18:57:16.902539+0000","last_peered":"2023-07-05T18:57:16.902539+0000","last_clean":"2023-07-05T18:57:16.902539+0000","last_became_active":"2023-07-05T18:57:15.300386+0000","last_became_peered":"2023-07-05T18:57:15.300386+0000","last_unstale":"2023-07-05T18:57:16.902539+0000","last_undegraded":"2023-07-05T18:57:16.902539+0000","last_fullsized":"2023-07-05T18:57:16.902539+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T18:57:14.849454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T18:57:14.849454+0000","last_clean_scrub_stamp":"2023-07-05T18:57:14.849454+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T01:59:45.912101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":13,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-05T18:57:16.903398+0000","last_change":"2023-07-05T18:57:14.875093+0000","last_active":"2023-07-05T18:57:16.903398+0000","last_peered":"2023-07-05T18:57:16.903398+0000","last_clean":"2023-07-05T18:57:16.903398+0000","last_became_active":"2023-07-05T18:57:14.874732+0000","last_became_peered":"2023-07-05T18:57:14.874732+0000","last_unstale":"2023-07-05T18:57:16.903398+0000","last_undegraded":"2023-07-05T18:57:16.903398+0000","last_fullsized":"2023-07-05T18:57:16.903398+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T18:57:13.843710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T18:57:13.843710+0000","last_clean_scrub_stamp":"2023-07-05T18:57:13.843710+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-06T20:43:32.142269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-05T18:57:16.288708+0000","last_change":"2023-07-05T18:57:15.314608+0000","last_active":"2023-07-05T18:57:16.288708+0000","last_peered":"2023-07-05T18:57:16.288708+0000","last_clean":"2023-07-05T18:57:16.288708+0000","last_became_active":"2023-07-05T18:57:15.314112+0000","last_became_peered":"2023-07-05T18:57:15.314112+0000","last_unstale":"2023-07-05T18:57:16.288708+0000","last_undegraded":"2023-07-05T18:57:16.288708+0000","last_fullsized":"2023-07-05T18:57:16.288708+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T18:57:14.849454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T18:57:14.849454+0000","last_clean_scrub_stamp":"2023-07-05T18:57:14.849454+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-06T23:18:05.690541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":13,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-05T18:57:16.902655+0000","last_change":"2023-07-05T18:57:14.877841+0000","last_active":"2023-07-05T18:57:16.902655+0000","last_peered":"2023-07-05T18:57:16.902655+0000","last_clean":"2023-07-05T18:57:16.902655+0000","last_became_active":"2023-07-05T18:57:14.877549+0000","last_became_peered":"2023-07-05T18:57:14.877549+0000","last_unstale":"2023-07-05T18:57:16.902655+0000","last_undegraded":"2023-07-05T18:57:16.902655+0000","last_fullsized":"2023-07-05T18:57:16.902655+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T18:57:13.843710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T18:57:13.843710+0000","last_clean_scrub_stamp":"2023-07-05T18:57:13.843710+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-06T20:06:26.725873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-05T18:57:16.288174+0000","last_change":"2023-07-05T18:57:15.297023+0000","last_active":"2023-07-05T18:57:16.288174+0000","last_peered":"2023-07-05T18:57:16.288174+0000","last_clean":"2023-07-05T18:57:16.288174+0000","last_became_active":"2023-07-05T18:57:15.296647+0000","last_became_peered":"2023-07-05T18:57:15.296647+0000","last_unstale":"2023-07-05T18:57:16.288174+0000","last_undegraded":"2023-07-05T18:57:16.288174+0000","last_fullsized":"2023-07-05T18:57:16.288174+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T18:57:14.849454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T18:57:14.849454+0000","last_clean_scrub_stamp":"2023-07-05T18:57:14.849454+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-06T19:54:51.648791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":13,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-05T18:57:16.902187+0000","last_change":"2023-07-05T18:57:14.872782+0000","last_active":"2023-07-05T18:57:16.902187+0000","last_peered":"2023-07-05T18:57:16.902187+0000","last_clean":"2023-07-05T18:57:16.902187+0000","last_became_active":"2023-07-05T18:57:14.872232+0000","last_became_peered":"2023-07-05T18:57:14.872232+0000","last_unstale":"2023-07-05T18:57:16.902187+0000","last_undegraded":"2023-07-05T18:57:16.902187+0000","last_fullsized":"2023-07-05T18:57:16.902187+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T18:57:13.843710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T18:57:13.843710+0000","last_clean_scrub_stamp":"2023-07-05T18:57:13.843710+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T06:21:50.233944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-05T18:57:16.902473+0000","last_change":"2023-07-05T18:57:15.304809+0000","last_active":"2023-07-05T18:57:16.902473+0000","last_peered":"2023-07-05T18:57:16.902473+0000","last_clean":"2023-07-05T18:57:16.902473+0000","last_became_active":"2023-07-05T18:57:15.304547+0000","last_became_peered":"2023-07-05T18:57:15.304547+0000","last_unstale":"2023-07-05T18:57:16.902473+0000","last_undegraded":"2023-07-05T18:57:16.902473+0000","last_fullsized":"2023-07-05T18:57:16.902473+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T18:57:14.849454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T18:57:14.849454+0000","last_clean_scrub_stamp":"2023-07-05T18:57:14.849454+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T04:42:25.968984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":13,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-05T18:57:16.902058+0000","last_change":"2023-07-05T18:57:14.868177+0000","last_active":"2023-07-05T18:57:16.902058+0000","last_peered":"2023-07-05T18:57:16.902058+0000","last_clean":"2023-07-05T18:57:16.902058+0000","last_became_active":"2023-07-05T18:57:14.867910+0000","last_became_peered":"2023-07-05T18:57:14.867910+0000","last_unstale":"2023-07-05T18:57:16.902058+0000","last_undegraded":"2023-07-05T18:57:16.902058+0000","last_fullsized":"2023-07-05T18:57:16.902058+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T18:57:13.843710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T18:57:13.843710+0000","last_clean_scrub_stamp":"2023-07-05T18:57:13.843710+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T00:40:15.317178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":43,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-05T18:57:16.902245+0000","last_change":"2023-07-05T18:56:09.622184+0000","last_active":"2023-07-05T18:57:16.902245+0000","last_peered":"2023-07-05T18:57:16.902245+0000","last_clean":"2023-07-05T18:57:16.902245+0000","last_became_active":"2023-07-05T18:56:09.621796+0000","last_became_peered":"2023-07-05T18:56:09.621796+0000","last_unstale":"2023-07-05T18:57:16.902245+0000","last_undegraded":"2023-07-05T18:57:16.902245+0000","last_fullsized":"2023-07-05T18:57:16.902245+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T18:56:08.603137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T18:56:08.603137+0000","last_clean_scrub_stamp":"2023-07-05T18:56:08.603137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T05:27:00.658957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-05T18:57:16.902748+0000","last_change":"2023-07-05T18:57:15.296916+0000","last_active":"2023-07-05T18:57:16.902748+0000","last_peered":"2023-07-05T18:57:16.902748+0000","last_clean":"2023-07-05T18:57:16.902748+0000","last_became_active":"2023-07-05T18:57:15.296598+0000","last_became_peered":"2023-07-05T18:57:15.296598+0000","last_unstale":"2023-07-05T18:57:16.902748+0000","last_undegraded":"2023-07-05T18:57:16.902748+0000","last_fullsized":"2023-07-05T18:57:16.902748+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T18:57:14.849454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T18:57:14.849454+0000","last_clean_scrub_stamp":"2023-07-05T18:57:14.849454+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T06:06:42.883138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":13,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-05T18:57:16.287874+0000","last_change":"2023-07-05T18:57:14.868436+0000","last_active":"2023-07-05T18:57:16.287874+0000","last_peered":"2023-07-05T18:57:16.287874+0000","last_clean":"2023-07-05T18:57:16.287874+0000","last_became_active":"2023-07-05T18:57:14.868144+0000","last_became_peered":"2023-07-05T18:57:14.868144+0000","last_unstale":"2023-07-05T18:57:16.287874+0000","last_undegraded":"2023-07-05T18:57:16.287874+0000","last_fullsized":"2023-07-05T18:57:16.287874+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T18:57:13.843710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T18:57:13.843710+0000","last_clean_scrub_stamp":"2023-07-05T18:57:13.843710+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-06T19:34:11.700460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":47,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-05T18:57:16.288044+0000","last_change":"2023-07-05T18:56:09.621596+0000","last_active":"2023-07-05T18:57:16.288044+0000","last_peered":"2023-07-05T18:57:16.288044+0000","last_clean":"2023-07-05T18:57:16.288044+0000","last_became_active":"2023-07-05T18:56:09.621315+0000","last_became_peered":"2023-07-05T18:56:09.621315+0000","last_unstale":"2023-07-05T18:57:16.288044+0000","last_undegraded":"2023-07-05T18:57:16.288044+0000","last_fullsized":"2023-07-05T18:57:16.288044+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T18:56:08.603137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T18:56:08.603137+0000","last_clean_scrub_stamp":"2023-07-05T18:56:08.603137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T00:49:55.435406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-05T18:57:16.902298+0000","last_change":"2023-07-05T18:57:15.312976+0000","last_active":"2023-07-05T18:57:16.902298+0000","last_peered":"2023-07-05T18:57:16.902298+0000","last_clean":"2023-07-05T18:57:16.902298+0000","last_became_active":"2023-07-05T18:57:15.312685+0000","last_became_peered":"2023-07-05T18:57:15.312685+0000","last_unstale":"2023-07-05T18:57:16.902298+0000","last_undegraded":"2023-07-05T18:57:16.902298+0000","last_fullsized":"2023-07-05T18:57:16.902298+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T18:57:14.849454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T18:57:14.849454+0000","last_clean_scrub_stamp":"2023-07-05T18:57:14.849454+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T00:22:30.408426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"34'2","reported_seq":15,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-05T18:57:16.289516+0000","last_change":"2023-07-05T18:57:14.870692+0000","last_active":"2023-07-05T18:57:16.289516+0000","last_peered":"2023-07-05T18:57:16.289516+0000","last_clean":"2023-07-05T18:57:16.289516+0000","last_became_active":"2023-07-05T18:57:14.870369+0000","last_became_peered":"2023-07-05T18:57:14.870369+0000","last_unstale":"2023-07-05T18:57:16.289516+0000","last_undegraded":"2023-07-05T18:57:16.289516+0000","last_fullsized":"2023-07-05T18:57:16.289516+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T18:57:13.843710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T18:57:13.843710+0000","last_clean_scrub_stamp":"2023-07-05T18:57:13.843710+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-06T22:30:26.465637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":43,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-05T18:57:16.902721+0000","last_change":"2023-07-05T18:56:09.617992+0000","last_active":"2023-07-05T18:57:16.902721+0000","last_peered":"2023-07-05T18:57:16.902721+0000","last_clean":"2023-07-05T18:57:16.902721+0000","last_became_active":"2023-07-05T18:56:09.617720+0000","last_became_peered":"2023-07-05T18:56:09.617720+0000","last_unstale":"2023-07-05T18:57:16.902721+0000","last_undegraded":"2023-07-05T18:57:16.902721+0000","last_fullsized":"2023-07-05T18:57:16.902721+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T18:56:08.603137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T18:56:08.603137+0000","last_clean_scrub_stamp":"2023-07-05T18:56:08.603137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T04:57:05.237675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"17'117","reported_seq":191,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-05T18:57:16.902380+0000","last_change":"2023-07-05T18:56:09.621746+0000","last_active":"2023-07-05T18:57:16.902380+0000","last_peered":"2023-07-05T18:57:16.902380+0000","last_clean":"2023-07-05T18:57:16.902380+0000","last_became_active":"2023-07-05T18:56:09.621421+0000","last_became_peered":"2023-07-05T18:56:09.621421+0000","last_unstale":"2023-07-05T18:57:16.902380+0000","last_undegraded":"2023-07-05T18:57:16.902380+0000","last_fullsized":"2023-07-05T18:57:16.902380+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T18:56:08.603137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T18:56:08.603137+0000","last_clean_scrub_stamp":"2023-07-05T18:56:08.603137+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T03:44:38.126068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-05T18:57:16.902466+0000","last_change":"2023-07-05T18:57:15.297302+0000","last_active":"2023-07-05T18:57:16.902466+0000","last_peered":"2023-07-05T18:57:16.902466+0000","last_clean":"2023-07-05T18:57:16.902466+0000","last_became_active":"2023-07-05T18:57:15.296988+0000","last_became_peered":"2023-07-05T18:57:15.296988+0000","last_unstale":"2023-07-05T18:57:16.902466+0000","last_undegraded":"2023-07-05T18:57:16.902466+0000","last_fullsized":"2023-07-05T18:57:16.902466+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T18:57:14.849454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T18:57:14.849454+0000","last_clean_scrub_stamp":"2023-07-05T18:57:14.849454+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T05:24:11.585127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":13,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-05T18:57:16.903073+0000","last_change":"2023-07-05T18:57:14.875225+0000","last_active":"2023-07-05T18:57:16.903073+0000","last_peered":"2023-07-05T18:57:16.903073+0000","last_clean":"2023-07-05T18:57:16.903073+0000","last_became_active":"2023-07-05T18:57:14.874813+0000","last_became_peered":"2023-07-05T18:57:14.874813+0000","last_unstale":"2023-07-05T18:57:16.903073+0000","last_undegraded":"2023-07-05T18:57:16.903073+0000","last_fullsized":"2023-07-05T18:57:16.903073+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T18:57:13.843710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T18:57:13.843710+0000","last_clean_scrub_stamp":"2023-07-05T18:57:13.843710+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-06T22:03:48.596854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":41,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-05T18:57:16.902381+0000","last_change":"2023-07-05T18:56:10.073940+0000","last_active":"2023-07-05T18:57:16.902381+0000","last_peered":"2023-07-05T18:57:16.902381+0000","last_clean":"2023-07-05T18:57:16.902381+0000","last_became_active":"2023-07-05T18:56:10.073617+0000","last_became_peered":"2023-07-05T18:56:10.073617+0000","last_unstale":"2023-07-05T18:57:16.902381+0000","last_undegraded":"2023-07-05T18:57:16.902381+0000","last_fullsized":"2023-07-05T18:57:16.902381+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T18:56:08.603137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T18:56:08.603137+0000","last_clean_scrub_stamp":"2023-07-05T18:56:08.603137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T00:26:41.125608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-05T18:57:16.289423+0000","last_change":"2023-07-05T18:57:15.309418+0000","last_active":"2023-07-05T18:57:16.289423+0000","last_peered":"2023-07-05T18:57:16.289423+0000","last_clean":"2023-07-05T18:57:16.289423+0000","last_became_active":"2023-07-05T18:57:15.307981+0000","last_became_peered":"2023-07-05T18:57:15.307981+0000","last_unstale":"2023-07-05T18:57:16.289423+0000","last_undegraded":"2023-07-05T18:57:16.289423+0000","last_fullsized":"2023-07-05T18:57:16.289423+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T18:57:14.849454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T18:57:14.849454+0000","last_clean_scrub_stamp":"2023-07-05T18:57:14.849454+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-06T19:17:01.359434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":13,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-05T18:57:16.902120+0000","last_change":"2023-07-05T18:57:14.875117+0000","last_active":"2023-07-05T18:57:16.902120+0000","last_peered":"2023-07-05T18:57:16.902120+0000","last_clean":"2023-07-05T18:57:16.902120+0000","last_became_active":"2023-07-05T18:57:14.874832+0000","last_became_peered":"2023-07-05T18:57:14.874832+0000","last_unstale":"2023-07-05T18:57:16.902120+0000","last_undegraded":"2023-07-05T18:57:16.902120+0000","last_fullsized":"2023-07-05T18:57:16.902120+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T18:57:13.843710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T18:57:13.843710+0000","last_clean_scrub_stamp":"2023-07-05T18:57:13.843710+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T01:04:32.104127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":41,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-05T18:57:16.902232+0000","last_change":"2023-07-05T18:56:10.073658+0000","last_active":"2023-07-05T18:57:16.902232+0000","last_peered":"2023-07-05T18:57:16.902232+0000","last_clean":"2023-07-05T18:57:16.902232+0000","last_became_active":"2023-07-05T18:56:10.073336+0000","last_became_peered":"2023-07-05T18:56:10.073336+0000","last_unstale":"2023-07-05T18:57:16.902232+0000","last_undegraded":"2023-07-05T18:57:16.902232+0000","last_fullsized":"2023-07-05T18:57:16.902232+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T18:56:08.603137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T18:56:08.603137+0000","last_clean_scrub_stamp":"2023-07-05T18:56:08.603137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T05:22:57.057362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-05T18:57:16.288425+0000","last_change":"2023-07-05T18:57:15.304874+0000","last_active":"2023-07-05T18:57:16.288425+0000","last_peered":"2023-07-05T18:57:16.288425+0000","last_clean":"2023-07-05T18:57:16.288425+0000","last_became_active":"2023-07-05T18:57:15.304585+0000","last_became_peered":"2023-07-05T18:57:15.304585+0000","last_unstale":"2023-07-05T18:57:16.288425+0000","last_undegraded":"2023-07-05T18:57:16.288425+0000","last_fullsized":"2023-07-05T18:57:16.288425+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T18:57:14.849454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T18:57:14.849454+0000","last_clean_scrub_stamp":"2023-07-05T18:57:14.849454+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-06T21:00:32.168356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":13,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-05T18:57:16.903130+0000","last_change":"2023-07-05T18:57:14.868208+0000","last_active":"2023-07-05T18:57:16.903130+0000","last_peered":"2023-07-05T18:57:16.903130+0000","last_clean":"2023-07-05T18:57:16.903130+0000","last_became_active":"2023-07-05T18:57:14.867910+0000","last_became_peered":"2023-07-05T18:57:14.867910+0000","last_unstale":"2023-07-05T18:57:16.903130+0000","last_undegraded":"2023-07-05T18:57:16.903130+0000","last_fullsized":"2023-07-05T18:57:16.903130+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T18:57:13.843710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T18:57:13.843710+0000","last_clean_scrub_stamp":"2023-07-05T18:57:13.843710+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T03:17:08.791872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":41,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-05T18:57:16.288767+0000","last_change":"2023-07-05T18:56:10.073693+0000","last_active":"2023-07-05T18:57:16.288767+0000","last_peered":"2023-07-05T18:57:16.288767+0000","last_clean":"2023-07-05T18:57:16.288767+0000","last_became_active":"2023-07-05T18:56:10.073356+0000","last_became_peered":"2023-07-05T18:56:10.073356+0000","last_unstale":"2023-07-05T18:57:16.288767+0000","last_undegraded":"2023-07-05T18:57:16.288767+0000","last_fullsized":"2023-07-05T18:57:16.288767+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T18:56:08.603137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T18:56:08.603137+0000","last_clean_scrub_stamp":"2023-07-05T18:56:08.603137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-06T20:40:01.347345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-05T18:57:16.902940+0000","last_change":"2023-07-05T18:57:15.299274+0000","last_active":"2023-07-05T18:57:16.902940+0000","last_peered":"2023-07-05T18:57:16.902940+0000","last_clean":"2023-07-05T18:57:16.902940+0000","last_became_active":"2023-07-05T18:57:15.298921+0000","last_became_peered":"2023-07-05T18:57:15.298921+0000","last_unstale":"2023-07-05T18:57:16.902940+0000","last_undegraded":"2023-07-05T18:57:16.902940+0000","last_fullsized":"2023-07-05T18:57:16.902940+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T18:57:14.849454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T18:57:14.849454+0000","last_clean_scrub_stamp":"2023-07-05T18:57:14.849454+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T02:38:57.649236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":13,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-05T18:57:16.287567+0000","last_change":"2023-07-05T18:57:14.866553+0000","last_active":"2023-07-05T18:57:16.287567+0000","last_peered":"2023-07-05T18:57:16.287567+0000","last_clean":"2023-07-05T18:57:16.287567+0000","last_became_active":"2023-07-05T18:57:14.866249+0000","last_became_peered":"2023-07-05T18:57:14.866249+0000","last_unstale":"2023-07-05T18:57:16.287567+0000","last_undegraded":"2023-07-05T18:57:16.287567+0000","last_fullsized":"2023-07-05T18:57:16.287567+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T18:57:13.843710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T18:57:13.843710+0000","last_clean_scrub_stamp":"2023-07-05T18:57:13.843710+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T03:42:11.743991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":43,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-05T18:57:16.287873+0000","last_change":"2023-07-05T18:56:10.073639+0000","last_active":"2023-07-05T18:57:16.287873+0000","last_peered":"2023-07-05T18:57:16.287873+0000","last_clean":"2023-07-05T18:57:16.287873+0000","last_became_active":"2023-07-05T18:56:10.073339+0000","last_became_peered":"2023-07-05T18:56:10.073339+0000","last_unstale":"2023-07-05T18:57:16.287873+0000","last_undegraded":"2023-07-05T18:57:16.287873+0000","last_fullsized":"2023-07-05T18:57:16.287873+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T18:56:08.603137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T18:56:08.603137+0000","last_clean_scrub_stamp":"2023-07-05T18:56:08.603137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T05:17:49.671863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-05T18:57:16.902503+0000","last_change":"2023-07-05T18:57:15.294526+0000","last_active":"2023-07-05T18:57:16.902503+0000","last_peered":"2023-07-05T18:57:16.902503+0000","last_clean":"2023-07-05T18:57:16.902503+0000","last_became_active":"2023-07-05T18:57:15.294262+0000","last_became_peered":"2023-07-05T18:57:15.294262+0000","last_unstale":"2023-07-05T18:57:16.902503+0000","last_undegraded":"2023-07-05T18:57:16.902503+0000","last_fullsized":"2023-07-05T18:57:16.902503+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T18:57:14.849454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T18:57:14.849454+0000","last_clean_scrub_stamp":"2023-07-05T18:57:14.849454+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-06T21:21:54.546636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":13,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-05T18:57:16.902958+0000","last_change":"2023-07-05T18:57:14.870468+0000","last_active":"2023-07-05T18:57:16.902958+0000","last_peered":"2023-07-05T18:57:16.902958+0000","last_clean":"2023-07-05T18:57:16.902958+0000","last_became_active":"2023-07-05T18:57:14.870132+0000","last_became_peered":"2023-07-05T18:57:14.870132+0000","last_unstale":"2023-07-05T18:57:16.902958+0000","last_undegraded":"2023-07-05T18:57:16.902958+0000","last_fullsized":"2023-07-05T18:57:16.902958+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T18:57:13.843710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T18:57:13.843710+0000","last_clean_scrub_stamp":"2023-07-05T18:57:13.843710+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-06T23:18:28.310679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":43,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-05T18:57:16.287900+0000","last_change":"2023-07-05T18:56:09.619299+0000","last_active":"2023-07-05T18:57:16.287900+0000","last_peered":"2023-07-05T18:57:16.287900+0000","last_clean":"2023-07-05T18:57:16.287900+0000","last_became_active":"2023-07-05T18:56:09.618958+0000","last_became_peered":"2023-07-05T18:56:09.618958+0000","last_unstale":"2023-07-05T18:57:16.287900+0000","last_undegraded":"2023-07-05T18:57:16.287900+0000","last_fullsized":"2023-07-05T18:57:16.287900+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T18:56:08.603137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T18:56:08.603137+0000","last_clean_scrub_stamp":"2023-07-05T18:56:08.603137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T04:32:57.046616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":6,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":8},{"poolid":2,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574865,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27924,"kb_used_data":972,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94343916,"statfs":{"total":96636764160,"available":96608169984,"internally_reserved":0,"allocated":995328,"data_stored":750237,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Jul 5 18:57:09 2023","interfaces":[{"interface":"back","average":{"1min":0.58199999999999996,"5min":0.58199999999999996,"15min":0.58199999999999996},"min":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":1.1870000000000001,"5min":1.1870000000000001,"15min":1.1870000000000001},"last":0.63},{"interface":"front","average":{"1min":0.63100000000000001,"5min":0.63100000000000001,"15min":0.63100000000000001},"min":{"1min":0.32700000000000001,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":1.266,"5min":1.266,"15min":1.266},"last":0.67700000000000005}]},{"osd":1,"last update":"Wed Jul 5 18:57:09 2023","interfaces":[{"interface":"back","average":{"1min":0.63700000000000001,"5min":0.63700000000000001,"15min":0.63700000000000001},"min":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":1.629,"5min":1.629,"15min":1.629},"last":0.52700000000000002},{"interface":"front","average":{"1min":1.208,"5min":1.208,"15min":1.208},"min":{"1min":0.33800000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":10.657999999999999,"5min":10.657999999999999,"15min":10.657999999999999},"last":0.70499999999999996}]},{"osd":2,"last update":"Wed Jul 5 18:57:09 2023","interfaces":[{"interface":"back","average":{"1min":0.63600000000000001,"5min":0.63600000000000001,"15min":0.63600000000000001},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":1.5429999999999999,"5min":1.5429999999999999,"15min":1.5429999999999999},"last":0.61299999999999999},{"interface":"front","average":{"1min":1.1579999999999999,"5min":1.1579999999999999,"15min":1.1579999999999999},"min":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":10.589,"5min":10.589,"15min":10.589},"last":0.57799999999999996}]},{"osd":3,"last update":"Wed Jul 5 18:57:09 2023","interfaces":[{"interface":"back","average":{"1min":0.68200000000000005,"5min":0.68200000000000005,"15min":0.68200000000000005},"min":{"1min":0.45100000000000001,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":1.5700000000000001,"5min":1.5700000000000001,"15min":1.5700000000000001},"last":0.58999999999999997},{"interface":"front","average":{"1min":1.2190000000000001,"5min":1.2190000000000001,"15min":1.2190000000000001},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":10.726000000000001,"5min":10.726000000000001,"15min":10.726000000000001},"last":0.66500000000000004}]},{"osd":4,"last update":"Wed Jul 5 18:57:09 2023","interfaces":[{"interface":"back","average":{"1min":0.55900000000000005,"5min":0.55900000000000005,"15min":0.55900000000000005},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.71599999999999997,"5min":0.71599999999999997,"15min":0.71599999999999997},"last":0.55700000000000005},{"interface":"front","average":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"min":{"1min":0.41799999999999998,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":0.65800000000000003,"5min":0.65800000000000003,"15min":0.65800000000000003},"last":0.44500000000000001}]},{"osd":5,"last update":"Wed Jul 5 18:57:09 2023","interfaces":[{"interface":"back","average":{"1min":0.55600000000000005,"5min":0.55600000000000005,"15min":0.55600000000000005},"min":{"1min":0.378,"5min":0.378,"15min":0.378},"max":{"1min":0.72599999999999998,"5min":0.72599999999999998,"15min":0.72599999999999998},"last":0.47099999999999997},{"interface":"front","average":{"1min":0.60199999999999998,"5min":0.60199999999999998,"15min":0.60199999999999998},"min":{"1min":0.47099999999999997,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":0.76100000000000001,"5min":0.76100000000000001,"15min":0.76100000000000001},"last":0.64100000000000001}]},{"osd":6,"last update":"Wed Jul 5 18:57:09 2023","interfaces":[{"interface":"back","average":{"1min":0.621,"5min":0.621,"15min":0.621},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.79800000000000004,"5min":0.79800000000000004,"15min":0.79800000000000004},"last":0.60099999999999998},{"interface":"front","average":{"1min":0.59999999999999998,"5min":0.59999999999999998,"15min":0.59999999999999998},"min":{"1min":0.45500000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":0.747,"5min":0.747,"15min":0.747},"last":0.54100000000000004}]}]},{"osd":6,"up_from":13,"seq":55834574867,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27344,"kb_used_data":392,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344496,"statfs":{"total":96636764160,"available":96608763904,"internally_reserved":0,"allocated":401408,"data_stored":165470,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Jul 5 18:57:07 2023","interfaces":[{"interface":"back","average":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"min":{"1min":0.32300000000000001,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":1.6200000000000001,"5min":1.6200000000000001,"15min":1.6200000000000001},"last":0.34699999999999998},{"interface":"front","average":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"min":{"1min":0.33400000000000002,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.71599999999999997,"5min":0.71599999999999997,"15min":0.71599999999999997},"last":0.49399999999999999}]},{"osd":1,"last update":"Wed Jul 5 18:57:07 2023","interfaces":[{"interface":"back","average":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"min":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":1.1299999999999999,"5min":1.1299999999999999,"15min":1.1299999999999999},"last":0.45400000000000001},{"interface":"front","average":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.55200000000000005},"min":{"1min":0.28899999999999998,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":1.464,"5min":1.464,"15min":1.464},"last":0.52600000000000002}]},{"osd":2,"last update":"Wed Jul 5 18:57:07 2023","interfaces":[{"interface":"back","average":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"min":{"1min":0.307,"5min":0.307,"15min":0.307},"max":{"1min":0.81399999999999995,"5min":0.81399999999999995,"15min":0.81399999999999995},"last":0.53800000000000003},{"interface":"front","average":{"1min":0.502,"5min":0.502,"15min":0.502},"min":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.69299999999999995,"5min":0.69299999999999995,"15min":0.69299999999999995},"last":0.51000000000000001}]},{"osd":3,"last update":"Wed Jul 5 18:57:07 2023","interfaces":[{"interface":"back","average":{"1min":0.99299999999999999,"5min":0.99299999999999999,"15min":0.99299999999999999},"min":{"1min":0.45600000000000002,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":6.181,"5min":6.181,"15min":6.181},"last":0.40600000000000003},{"interface":"front","average":{"1min":0.55400000000000005,"5min":0.55400000000000005,"15min":0.55400000000000005},"min":{"1min":0.34599999999999997,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.68000000000000005,"5min":0.68000000000000005,"15min":0.68000000000000005},"last":0.47099999999999997}]},{"osd":4,"last update":"Wed Jul 5 18:57:07 2023","interfaces":[{"interface":"back","average":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"min":{"1min":0.32000000000000001,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.74199999999999999,"5min":0.74199999999999999,"15min":0.74199999999999999},"last":0.55300000000000005},{"interface":"front","average":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"min":{"1min":0.30199999999999999,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.873,"5min":0.873,"15min":0.873},"last":0.56599999999999995}]},{"osd":5,"last update":"Wed Jul 5 18:57:07 2023","interfaces":[{"interface":"back","average":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.55200000000000005},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.77200000000000002,"5min":0.77200000000000002,"15min":0.77200000000000002},"last":0.57699999999999996},{"interface":"front","average":{"1min":0.56799999999999995,"5min":0.56799999999999995,"15min":0.56799999999999995},"min":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.754,"5min":0.754,"15min":0.754},"last":0.58799999999999997}]},{"osd":7,"last update":"Wed Jul 5 18:57:07 2023","interfaces":[{"interface":"back","average":{"1min":0.58399999999999996,"5min":0.58399999999999996,"15min":0.58399999999999996},"min":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.92000000000000004,"5min":0.92000000000000004,"15min":0.92000000000000004},"last":0.61399999999999999},{"interface":"front","average":{"1min":0.60899999999999999,"5min":0.60899999999999999,"15min":0.60899999999999999},"min":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.84299999999999997,"5min":0.84299999999999997,"15min":0.84299999999999997},"last":0.60399999999999998}]}]},{"osd":1,"up_from":13,"seq":55834574866,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27912,"kb_used_data":960,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94343928,"statfs":{"total":96636764160,"available":96608182272,"internally_reserved":0,"allocated":983040,"data_stored":748693,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Jul 5 18:57:07 2023","interfaces":[{"interface":"back","average":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"min":{"1min":0.25,"5min":0.25,"15min":0.25},"max":{"1min":0.49399999999999999,"5min":0.49399999999999999,"15min":0.49399999999999999},"last":0.22900000000000001},{"interface":"front","average":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"min":{"1min":0.28599999999999998,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"last":0.29399999999999998}]},{"osd":2,"last update":"Wed Jul 5 18:57:07 2023","interfaces":[{"interface":"back","average":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"min":{"1min":0.23699999999999999,"5min":0.23699999999999999,"15min":0.23699999999999999},"max":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"last":0.34699999999999998},{"interface":"front","average":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"min":{"1min":0.26400000000000001,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":0.60199999999999998,"5min":0.60199999999999998,"15min":0.60199999999999998},"last":0.38}]},{"osd":3,"last update":"Wed Jul 5 18:57:07 2023","interfaces":[{"interface":"back","average":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"min":{"1min":0.316,"5min":0.316,"15min":0.316},"max":{"1min":0.65700000000000003,"5min":0.65700000000000003,"15min":0.65700000000000003},"last":0.42299999999999999},{"interface":"front","average":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"min":{"1min":0.28899999999999998,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":0.439,"5min":0.439,"15min":0.439},"last":0.47299999999999998}]},{"osd":4,"last update":"Wed Jul 5 18:57:07 2023","interfaces":[{"interface":"back","average":{"1min":0.61099999999999999,"5min":0.61099999999999999,"15min":0.61099999999999999},"min":{"1min":0.44,"5min":0.44,"15min":0.44},"max":{"1min":0.82399999999999995,"5min":0.82399999999999995,"15min":0.82399999999999995},"last":0.61699999999999999},{"interface":"front","average":{"1min":0.65600000000000003,"5min":0.65600000000000003,"15min":0.65600000000000003},"min":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"max":{"1min":1.0289999999999999,"5min":1.0289999999999999,"15min":1.0289999999999999},"last":0.58299999999999996}]},{"osd":5,"last update":"Wed Jul 5 18:57:07 2023","interfaces":[{"interface":"back","average":{"1min":0.58499999999999996,"5min":0.58499999999999996,"15min":0.58499999999999996},"min":{"1min":0.45100000000000001,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":0.77400000000000002,"5min":0.77400000000000002,"15min":0.77400000000000002},"last":0.48799999999999999},{"interface":"front","average":{"1min":0.63800000000000001,"5min":0.63800000000000001,"15min":0.63800000000000001},"min":{"1min":0.50900000000000001,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":0.78100000000000003,"5min":0.78100000000000003,"15min":0.78100000000000003},"last":0.60499999999999998}]},{"osd":6,"last update":"Wed Jul 5 18:57:07 2023","interfaces":[{"interface":"back","average":{"1min":0.64700000000000002,"5min":0.64700000000000002,"15min":0.64700000000000002},"min":{"1min":0.45900000000000002,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":0.91900000000000004,"5min":0.91900000000000004,"15min":0.91900000000000004},"last":0.55000000000000004},{"interface":"front","average":{"1min":0.70599999999999996,"5min":0.70599999999999996,"15min":0.70599999999999996},"min":{"1min":0.442,"5min":0.442,"15min":0.442},"max":{"1min":1.2170000000000001,"5min":1.2170000000000001,"15min":1.2170000000000001},"last":0.53500000000000003}]},{"osd":7,"last update":"Wed Jul 5 18:57:07 2023","interfaces":[{"interface":"back","average":{"1min":0.66800000000000004,"5min":0.66800000000000004,"15min":0.66800000000000004},"min":{"1min":0.50900000000000001,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":0.91100000000000003,"5min":0.91100000000000003,"15min":0.91100000000000003},"last":0.50700000000000001},{"interface":"front","average":{"1min":0.65000000000000002,"5min":0.65000000000000002,"15min":0.65000000000000002},"min":{"1min":0.47199999999999998,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":0.871,"5min":0.871,"15min":0.871},"last":0.59399999999999997}]}]},{"osd":0,"up_from":13,"seq":55834574866,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27332,"kb_used_data":380,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344508,"statfs":{"total":96636764160,"available":96608776192,"internally_reserved":0,"allocated":389120,"data_stored":158269,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed Jul 5 18:57:06 2023","interfaces":[{"interface":"back","average":{"1min":0.371,"5min":0.371,"15min":0.371},"min":{"1min":0.22600000000000001,"5min":0.22600000000000001,"15min":0.22600000000000001},"max":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"last":0.32600000000000001},{"interface":"front","average":{"1min":0.41799999999999998,"5min":0.41799999999999998,"15min":0.41799999999999998},"min":{"1min":0.252,"5min":0.252,"15min":0.252},"max":{"1min":1.1619999999999999,"5min":1.1619999999999999,"15min":1.1619999999999999},"last":0.26300000000000001}]},{"osd":2,"last update":"Wed Jul 5 18:57:06 2023","interfaces":[{"interface":"back","average":{"1min":0.77100000000000002,"5min":0.77100000000000002,"15min":0.77100000000000002},"min":{"1min":0.29199999999999998,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":5.1050000000000004,"5min":5.1050000000000004,"15min":5.1050000000000004},"last":0.42299999999999999},{"interface":"front","average":{"1min":0.47999999999999998,"5min":0.47999999999999998,"15min":0.47999999999999998},"min":{"1min":0.26900000000000002,"5min":0.26900000000000002,"15min":0.26900000000000002},"max":{"1min":1.1930000000000001,"5min":1.1930000000000001,"15min":1.1930000000000001},"last":0.30299999999999999}]},{"osd":3,"last update":"Wed Jul 5 18:57:06 2023","interfaces":[{"interface":"back","average":{"1min":1.0700000000000001,"5min":1.0700000000000001,"15min":1.0700000000000001},"min":{"1min":0.26100000000000001,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":8.1359999999999992,"5min":8.1359999999999992,"15min":8.1359999999999992},"last":0.314},{"interface":"front","average":{"1min":0.94999999999999996,"5min":0.94999999999999996,"15min":0.94999999999999996},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":5.1349999999999998,"5min":5.1349999999999998,"15min":5.1349999999999998},"last":0.37}]},{"osd":4,"last update":"Wed Jul 5 18:57:06 2023","interfaces":[{"interface":"back","average":{"1min":0.61399999999999999,"5min":0.61399999999999999,"15min":0.61399999999999999},"min":{"1min":0.41899999999999998,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":1.1890000000000001,"5min":1.1890000000000001,"15min":1.1890000000000001},"last":0.48699999999999999},{"interface":"front","average":{"1min":1.0649999999999999,"5min":1.0649999999999999,"15min":1.0649999999999999},"min":{"1min":0.46700000000000003,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":8.0670000000000002,"5min":8.0670000000000002,"15min":8.0670000000000002},"last":0.47599999999999998}]},{"osd":5,"last update":"Wed Jul 5 18:57:06 2023","interfaces":[{"interface":"back","average":{"1min":0.94299999999999995,"5min":0.94299999999999995,"15min":0.94299999999999995},"min":{"1min":0.40400000000000003,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":5.032,"5min":5.032,"15min":5.032},"last":0.46300000000000002},{"interface":"front","average":{"1min":0.65300000000000002,"5min":0.65300000000000002,"15min":0.65300000000000002},"min":{"1min":0.44700000000000001,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":1.282,"5min":1.282,"15min":1.282},"last":0.41399999999999998}]},{"osd":6,"last update":"Wed Jul 5 18:57:06 2023","interfaces":[{"interface":"back","average":{"1min":1.052,"5min":1.052,"15min":1.052},"min":{"1min":0.44800000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":8.0069999999999997,"5min":8.0069999999999997,"15min":8.0069999999999997},"last":0.50900000000000001},{"interface":"front","average":{"1min":0.99199999999999999,"5min":0.99199999999999999,"15min":0.99199999999999999},"min":{"1min":0.49199999999999999,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":5.0700000000000003,"5min":5.0700000000000003,"15min":5.0700000000000003},"last":0.51800000000000002}]},{"osd":7,"last update":"Wed Jul 5 18:57:06 2023","interfaces":[{"interface":"back","average":{"1min":0.64900000000000002,"5min":0.64900000000000002,"15min":0.64900000000000002},"min":{"1min":0.44400000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":1.218,"5min":1.218,"15min":1.218},"last":0.45500000000000002},{"interface":"front","average":{"1min":1.034,"5min":1.034,"15min":1.034},"min":{"1min":0.39400000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":8.1039999999999992,"5min":8.1039999999999992,"15min":8.1039999999999992},"last":0.53000000000000003}]}]},{"osd":2,"up_from":13,"seq":55834574865,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27340,"kb_used_data":388,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344500,"statfs":{"total":96636764160,"available":96608768000,"internally_reserved":0,"allocated":397312,"data_stored":163997,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Jul 5 18:57:11 2023","interfaces":[{"interface":"back","average":{"1min":0.311,"5min":0.311,"15min":0.311},"min":{"1min":0.23200000000000001,"5min":0.23200000000000001,"15min":0.23200000000000001},"max":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"last":0.255},{"interface":"front","average":{"1min":0.32400000000000001,"5min":0.32400000000000001,"15min":0.32400000000000001},"min":{"1min":0.25,"5min":0.25,"15min":0.25},"max":{"1min":0.496,"5min":0.496,"15min":0.496},"last":0.38100000000000001}]},{"osd":1,"last update":"Wed Jul 5 18:57:11 2023","interfaces":[{"interface":"back","average":{"1min":0.32800000000000001,"5min":0.32800000000000001,"15min":0.32800000000000001},"min":{"1min":0.27000000000000002,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"last":0.36399999999999999},{"interface":"front","average":{"1min":0.38,"5min":0.38,"15min":0.38},"min":{"1min":0.32200000000000001,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.47999999999999998,"5min":0.47999999999999998,"15min":0.47999999999999998},"last":0.32600000000000001}]},{"osd":3,"last update":"Wed Jul 5 18:57:11 2023","interfaces":[{"interface":"back","average":{"1min":0.33500000000000002,"5min":0.33500000000000002,"15min":0.33500000000000002},"min":{"1min":0.28699999999999998,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"last":0.27300000000000002},{"interface":"front","average":{"1min":0.39400000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"min":{"1min":0.308,"5min":0.308,"15min":0.308},"max":{"1min":0.48299999999999998,"5min":0.48299999999999998,"15min":0.48299999999999998},"last":0.40100000000000002}]},{"osd":4,"last update":"Wed Jul 5 18:57:11 2023","interfaces":[{"interface":"back","average":{"1min":0.55900000000000005,"5min":0.55900000000000005,"15min":0.55900000000000005},"min":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.69599999999999995,"5min":0.69599999999999995,"15min":0.69599999999999995},"last":0.46700000000000003},{"interface":"front","average":{"1min":0.57799999999999996,"5min":0.57799999999999996,"15min":0.57799999999999996},"min":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":0.81799999999999995,"5min":0.81799999999999995,"15min":0.81799999999999995},"last":0.42099999999999999}]},{"osd":5,"last update":"Wed Jul 5 18:57:11 2023","interfaces":[{"interface":"back","average":{"1min":0.624,"5min":0.624,"15min":0.624},"min":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":0.77800000000000002,"5min":0.77800000000000002,"15min":0.77800000000000002},"last":0.498},{"interface":"front","average":{"1min":0.59499999999999997,"5min":0.59499999999999997,"15min":0.59499999999999997},"min":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":0.76500000000000001,"5min":0.76500000000000001,"15min":0.76500000000000001},"last":0.432}]},{"osd":6,"last update":"Wed Jul 5 18:57:11 2023","interfaces":[{"interface":"back","average":{"1min":0.61099999999999999,"5min":0.61099999999999999,"15min":0.61099999999999999},"min":{"1min":0.45900000000000002,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":0.748,"5min":0.748,"15min":0.748},"last":0.56000000000000005},{"interface":"front","average":{"1min":0.59999999999999998,"5min":0.59999999999999998,"15min":0.59999999999999998},"min":{"1min":0.498,"5min":0.498,"15min":0.498},"max":{"1min":0.73999999999999999,"5min":0.73999999999999999,"15min":0.73999999999999999},"last":0.47999999999999998}]},{"osd":7,"last update":"Wed Jul 5 18:57:11 2023","interfaces":[{"interface":"back","average":{"1min":0.59599999999999997,"5min":0.59599999999999997,"15min":0.59599999999999997},"min":{"1min":0.441,"5min":0.441,"15min":0.441},"max":{"1min":0.77500000000000002,"5min":0.77500000000000002,"15min":0.77500000000000002},"last":0.54100000000000004},{"interface":"front","average":{"1min":0.61699999999999999,"5min":0.61699999999999999,"15min":0.61699999999999999},"min":{"1min":0.45900000000000002,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":0.74399999999999999,"5min":0.74399999999999999,"15min":0.74399999999999999},"last":0.51400000000000001}]}]},{"osd":3,"up_from":13,"seq":55834574867,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27356,"kb_used_data":404,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344484,"statfs":{"total":96636764160,"available":96608751616,"internally_reserved":0,"allocated":413696,"data_stored":166486,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Jul 5 18:57:10 2023","interfaces":[{"interface":"back","average":{"1min":0.94499999999999995,"5min":0.94499999999999995,"15min":0.94499999999999995},"min":{"1min":0.20200000000000001,"5min":0.20200000000000001,"15min":0.20200000000000001},"max":{"1min":12.015000000000001,"5min":12.015000000000001,"15min":12.015000000000001},"last":0.27500000000000002},{"interface":"front","average":{"1min":0.98499999999999999,"5min":0.98499999999999999,"15min":0.98499999999999999},"min":{"1min":0.246,"5min":0.246,"15min":0.246},"max":{"1min":11.933,"5min":11.933,"15min":11.933},"last":0.23999999999999999}]},{"osd":1,"last update":"Wed Jul 5 18:57:10 2023","interfaces":[{"interface":"back","average":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"min":{"1min":0.23999999999999999,"5min":0.23999999999999999,"15min":0.23999999999999999},"max":{"1min":1.387,"5min":1.387,"15min":1.387},"last":0.25900000000000001},{"interface":"front","average":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"min":{"1min":0.29499999999999998,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":0.754,"5min":0.754,"15min":0.754},"last":0.34000000000000002}]},{"osd":2,"last update":"Wed Jul 5 18:57:10 2023","interfaces":[{"interface":"back","average":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"min":{"1min":0.28199999999999997,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":1.5069999999999999,"5min":1.5069999999999999,"15min":1.5069999999999999},"last":0.32000000000000001},{"interface":"front","average":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.40699999999999997},"min":{"1min":0.253,"5min":0.253,"15min":0.253},"max":{"1min":0.81000000000000005,"5min":0.81000000000000005,"15min":0.81000000000000005},"last":0.36899999999999999}]},{"osd":4,"last update":"Wed Jul 5 18:57:10 2023","interfaces":[{"interface":"back","average":{"1min":0.59999999999999998,"5min":0.59999999999999998,"15min":0.59999999999999998},"min":{"1min":0.443,"5min":0.443,"15min":0.443},"max":{"1min":0.83699999999999997,"5min":0.83699999999999997,"15min":0.83699999999999997},"last":0.42999999999999999},{"interface":"front","average":{"1min":0.65100000000000002,"5min":0.65100000000000002,"15min":0.65100000000000002},"min":{"1min":0.46000000000000002,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":0.96399999999999997,"5min":0.96399999999999997,"15min":0.96399999999999997},"last":0.55400000000000005}]},{"osd":5,"last update":"Wed Jul 5 18:57:10 2023","interfaces":[{"interface":"back","average":{"1min":0.63600000000000001,"5min":0.63600000000000001,"15min":0.63600000000000001},"min":{"1min":0.41099999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":0.93200000000000005,"5min":0.93200000000000005,"15min":0.93200000000000005},"last":0.45500000000000002},{"interface":"front","average":{"1min":0.64800000000000002,"5min":0.64800000000000002,"15min":0.64800000000000002},"min":{"1min":0.48399999999999999,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":1.4610000000000001,"5min":1.4610000000000001,"15min":1.4610000000000001},"last":0.53900000000000003}]},{"osd":6,"last update":"Wed Jul 5 18:57:10 2023","interfaces":[{"interface":"back","average":{"1min":0.63900000000000001,"5min":0.63900000000000001,"15min":0.63900000000000001},"min":{"1min":0.45000000000000001,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":1.484,"5min":1.484,"15min":1.484},"last":0.57899999999999996},{"interface":"front","average":{"1min":0.60799999999999998,"5min":0.60799999999999998,"15min":0.60799999999999998},"min":{"1min":0.42999999999999999,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":0.78600000000000003,"5min":0.78600000000000003,"15min":0.78600000000000003},"last":0.46400000000000002}]},{"osd":7,"last update":"Wed Jul 5 18:57:10 2023","interfaces":[{"interface":"back","average":{"1min":0.65400000000000003,"5min":0.65400000000000003,"15min":0.65400000000000003},"min":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.995,"5min":0.995,"15min":0.995},"last":0.50700000000000001},{"interface":"front","average":{"1min":0.67400000000000004,"5min":0.67400000000000004,"15min":0.67400000000000004},"min":{"1min":0.47899999999999998,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":1.4330000000000001,"5min":1.4330000000000001,"15min":1.4330000000000001},"last":0.47299999999999998}]}]},{"osd":4,"up_from":13,"seq":55834574867,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27348,"kb_used_data":396,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344492,"statfs":{"total":96636764160,"available":96608759808,"internally_reserved":0,"allocated":405504,"data_stored":165492,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Jul 5 18:57:08 2023","interfaces":[{"interface":"back","average":{"1min":0.51800000000000002,"5min":0.51800000000000002,"15min":0.51800000000000002},"min":{"1min":0.34399999999999997,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.79200000000000004,"5min":0.79200000000000004,"15min":0.79200000000000004},"last":1.208},{"interface":"front","average":{"1min":0.51300000000000001,"5min":0.51300000000000001,"15min":0.51300000000000001},"min":{"1min":0.32400000000000001,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.98099999999999998,"5min":0.98099999999999998,"15min":0.98099999999999998},"last":0.80100000000000005}]},{"osd":1,"last update":"Wed Jul 5 18:57:08 2023","interfaces":[{"interface":"back","average":{"1min":0.55000000000000004,"5min":0.55000000000000004,"15min":0.55000000000000004},"min":{"1min":0.373,"5min":0.373,"15min":0.373},"max":{"1min":0.76400000000000001,"5min":0.76400000000000001,"15min":0.76400000000000001},"last":0.74399999999999999},{"interface":"front","average":{"1min":0.50900000000000001,"5min":0.50900000000000001,"15min":0.50900000000000001},"min":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.89500000000000002,"5min":0.89500000000000002,"15min":0.89500000000000002},"last":0.28100000000000003}]},{"osd":2,"last update":"Wed Jul 5 18:57:08 2023","interfaces":[{"interface":"back","average":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"min":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.86099999999999999,"5min":0.86099999999999999,"15min":0.86099999999999999},"last":1.006},{"interface":"front","average":{"1min":0.58199999999999996,"5min":0.58199999999999996,"15min":0.58199999999999996},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.92900000000000005,"5min":0.92900000000000005,"15min":0.92900000000000005},"last":0.90300000000000002}]},{"osd":3,"last update":"Wed Jul 5 18:57:08 2023","interfaces":[{"interface":"back","average":{"1min":0.54000000000000004,"5min":0.54000000000000004,"15min":0.54000000000000004},"min":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.70099999999999996,"5min":0.70099999999999996,"15min":0.70099999999999996},"last":1.927},{"interface":"front","average":{"1min":0.61299999999999999,"5min":0.61299999999999999,"15min":0.61299999999999999},"min":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":0.88400000000000001,"5min":0.88400000000000001,"15min":0.88400000000000001},"last":1.0640000000000001}]},{"osd":5,"last update":"Wed Jul 5 18:57:08 2023","interfaces":[{"interface":"back","average":{"1min":0.56499999999999995,"5min":0.56499999999999995,"15min":0.56499999999999995},"min":{"1min":0.45400000000000001,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":0.77800000000000002,"5min":0.77800000000000002,"15min":0.77800000000000002},"last":0.83599999999999997},{"interface":"front","average":{"1min":0.53900000000000003,"5min":0.53900000000000003,"15min":0.53900000000000003},"min":{"1min":0.32200000000000001,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.81999999999999995,"5min":0.81999999999999995,"15min":0.81999999999999995},"last":1.883}]},{"osd":6,"last update":"Wed Jul 5 18:57:08 2023","interfaces":[{"interface":"back","average":{"1min":0.58499999999999996,"5min":0.58499999999999996,"15min":0.58499999999999996},"min":{"1min":0.372,"5min":0.372,"15min":0.372},"max":{"1min":0.83499999999999996,"5min":0.83499999999999996,"15min":0.83499999999999996},"last":1.7869999999999999},{"interface":"front","average":{"1min":0.626,"5min":0.626,"15min":0.626},"min":{"1min":0.49099999999999999,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":0.82099999999999995,"5min":0.82099999999999995,"15min":0.82099999999999995},"last":0.86799999999999999}]},{"osd":7,"last update":"Wed Jul 5 18:57:08 2023","interfaces":[{"interface":"back","average":{"1min":0.57499999999999996,"5min":0.57499999999999996,"15min":0.57499999999999996},"min":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.79100000000000004,"5min":0.79100000000000004,"15min":0.79100000000000004},"last":1.9650000000000001},{"interface":"front","average":{"1min":0.66300000000000003,"5min":0.66300000000000003,"15min":0.66300000000000003},"min":{"1min":0.53600000000000003,"5min":0.53600000000000003,"15min":0.53600000000000003},"max":{"1min":0.90700000000000003,"5min":0.90700000000000003,"15min":0.90700000000000003},"last":1.829}]}]},{"osd":5,"up_from":13,"seq":55834574866,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27348,"kb_used_data":396,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344492,"statfs":{"total":96636764160,"available":96608759808,"internally_reserved":0,"allocated":405504,"data_stored":165000,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Jul 5 18:57:07 2023","interfaces":[{"interface":"back","average":{"1min":0.48099999999999998,"5min":0.48099999999999998,"15min":0.48099999999999998},"min":{"1min":0.33200000000000002,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.73599999999999999,"5min":0.73599999999999999,"15min":0.73599999999999999},"last":0.97499999999999998},{"interface":"front","average":{"1min":0.51400000000000001,"5min":0.51400000000000001,"15min":0.51400000000000001},"min":{"1min":0.314,"5min":0.314,"15min":0.314},"max":{"1min":0.68999999999999995,"5min":0.68999999999999995,"15min":0.68999999999999995},"last":0.80200000000000005}]},{"osd":1,"last update":"Wed Jul 5 18:57:07 2023","interfaces":[{"interface":"back","average":{"1min":0.55300000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"min":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.82399999999999995,"5min":0.82399999999999995,"15min":0.82399999999999995},"last":0.879},{"interface":"front","average":{"1min":0.54200000000000004,"5min":0.54200000000000004,"15min":0.54200000000000004},"min":{"1min":0.439,"5min":0.439,"15min":0.439},"max":{"1min":0.70499999999999996,"5min":0.70499999999999996,"15min":0.70499999999999996},"last":0.92100000000000004}]},{"osd":2,"last update":"Wed Jul 5 18:57:07 2023","interfaces":[{"interface":"back","average":{"1min":0.56399999999999995,"5min":0.56399999999999995,"15min":0.56399999999999995},"min":{"1min":0.373,"5min":0.373,"15min":0.373},"max":{"1min":0.80600000000000005,"5min":0.80600000000000005,"15min":0.80600000000000005},"last":0.86199999999999999},{"interface":"front","average":{"1min":0.56599999999999995,"5min":0.56599999999999995,"15min":0.56599999999999995},"min":{"1min":0.38,"5min":0.38,"15min":0.38},"max":{"1min":0.79500000000000004,"5min":0.79500000000000004,"15min":0.79500000000000004},"last":0.77800000000000002}]},{"osd":3,"last update":"Wed Jul 5 18:57:07 2023","interfaces":[{"interface":"back","average":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.56299999999999994},"min":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.752,"5min":0.752,"15min":0.752},"last":0.94499999999999995},{"interface":"front","average":{"1min":0.622,"5min":0.622,"15min":0.622},"min":{"1min":0.42999999999999999,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":0.88600000000000001,"5min":0.88600000000000001,"15min":0.88600000000000001},"last":0.96199999999999997}]},{"osd":4,"last update":"Wed Jul 5 18:57:07 2023","interfaces":[{"interface":"back","average":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.50700000000000001},"min":{"1min":0.32000000000000001,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.69799999999999995,"5min":0.69799999999999995,"15min":0.69799999999999995},"last":0.72199999999999998},{"interface":"front","average":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.56000000000000005},"min":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.78200000000000003,"5min":0.78200000000000003,"15min":0.78200000000000003},"last":0.57199999999999995}]},{"osd":6,"last update":"Wed Jul 5 18:57:07 2023","interfaces":[{"interface":"back","average":{"1min":0.58899999999999997,"5min":0.58899999999999997,"15min":0.58899999999999997},"min":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.83999999999999997,"5min":0.83999999999999997,"15min":0.83999999999999997},"last":0.55800000000000005},{"interface":"front","average":{"1min":0.57299999999999995,"5min":0.57299999999999995,"15min":0.57299999999999995},"min":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.747,"5min":0.747,"15min":0.747},"last":0.84099999999999997}]},{"osd":7,"last update":"Wed Jul 5 18:57:07 2023","interfaces":[{"interface":"back","average":{"1min":0.63100000000000001,"5min":0.63100000000000001,"15min":0.63100000000000001},"min":{"1min":0.443,"5min":0.443,"15min":0.443},"max":{"1min":0.93500000000000005,"5min":0.93500000000000005,"15min":0.93500000000000005},"last":0.74399999999999999},{"interface":"front","average":{"1min":0.65100000000000002,"5min":0.65100000000000002,"15min":0.65100000000000002},"min":{"1min":0.41599999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":0.86299999999999999,"5min":0.86299999999999999,"15min":0.86299999999999999},"last":0.69199999999999995}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1598,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-07-05T18:57:19.826 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-07-05T18:57:19.828 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2023-07-05T18:57:19.979 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:19.977+0000 7fc84f99b700 1 Processor -- start 2023-07-05T18:57:19.979 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:19.977+0000 7fc84f99b700 1 -- start start 2023-07-05T18:57:19.982 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:19.978+0000 7fc84f99b700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fc8480cf010 0x7fc8480cb950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:57:19.982 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:19.978+0000 7fc84f99b700 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc8480cb4c0 con 0x7fc8480d1310 2023-07-05T18:57:19.982 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:19.978+0000 7fc84f99b700 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc8480cdc90 con 0x7fc8480cd2d0 2023-07-05T18:57:19.982 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:19.978+0000 7fc84f99b700 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc84815cb30 con 0x7fc8480cf010 2023-07-05T18:57:19.986 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:19.978+0000 7fc84d737700 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7fc8480d1310 0x7fc8480ad700 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:59186/0 (socket says 172.21.15.46:59186) 2023-07-05T18:57:19.986 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:19.978+0000 7fc84d737700 1 -- 172.21.15.46:0/242015275 learned_addr learned my addr 172.21.15.46:0/242015275 (peer_addr_for_me v1:172.21.15.46:0/0) 2023-07-05T18:57:19.986 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:19.978+0000 7fc84df38700 1 --2- 172.21.15.46:0/242015275 >> v2:172.21.15.73:3300/0 conn(0x7fc8480cf010 0x7fc8480cb950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:57:19.986 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:19.978+0000 7fc83bfff700 1 -- 172.21.15.46:0/242015275 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 37984021 0 0) 0x7fc8480cb4c0 con 0x7fc8480d1310 2023-07-05T18:57:19.986 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:19.978+0000 7fc83bfff700 1 -- 172.21.15.46:0/242015275 --> v1:172.21.15.46:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc8340035b0 con 0x7fc8480d1310 2023-07-05T18:57:19.986 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:19.978+0000 7fc83bfff700 1 -- 172.21.15.46:0/242015275 <== mon.0 v1:172.21.15.46:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3455709601 0 0) 0x7fc8340035b0 con 0x7fc8480d1310 2023-07-05T18:57:19.987 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:19.978+0000 7fc83bfff700 1 -- 172.21.15.46:0/242015275 >> v2:172.21.15.73:3300/0 conn(0x7fc8480cf010 msgr2=0x7fc8480cb950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-05T18:57:19.987 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:19.978+0000 7fc83bfff700 1 --2- 172.21.15.46:0/242015275 >> v2:172.21.15.73:3300/0 conn(0x7fc8480cf010 0x7fc8480cb950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:57:19.987 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:19.978+0000 7fc83bfff700 1 -- 172.21.15.46:0/242015275 >> v1:172.21.15.73:6789/0 conn(0x7fc8480cd2d0 legacy=0x7fc8480ce900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:57:19.987 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:19.978+0000 7fc83bfff700 1 -- 172.21.15.46:0/242015275 --> v1:172.21.15.46:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc8480cdf70 con 0x7fc8480d1310 2023-07-05T18:57:19.987 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:19.978+0000 7fc83bfff700 1 -- 172.21.15.46:0/242015275 <== mon.0 v1:172.21.15.46:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2195585215 0 0) 0x7fc83c001670 con 0x7fc8480d1310 2023-07-05T18:57:19.987 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:19.978+0000 7fc83bfff700 1 -- 172.21.15.46:0/242015275 >> v1:172.21.15.46:6789/0 conn(0x7fc8480d1310 legacy=0x7fc8480ad700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:57:19.987 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:19.978+0000 7fc83bfff700 1 --2- 172.21.15.46:0/242015275 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fc834003a00 0x7fc834003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:57:19.987 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:19.978+0000 7fc83bfff700 1 --2- 172.21.15.46:0/242015275 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc834004850 0x7fc834004cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:57:19.988 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:19.978+0000 7fc83bfff700 1 --2- 172.21.15.46:0/242015275 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc834005200 0x7fc83400ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:57:19.988 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:19.978+0000 7fc83bfff700 1 -- 172.21.15.46:0/242015275 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc83400c0e0 con 0x7fc834005200 2023-07-05T18:57:19.989 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:19.978+0000 7fc83bfff700 1 -- 172.21.15.46:0/242015275 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc83400c250 con 0x7fc834004850 2023-07-05T18:57:19.989 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:19.978+0000 7fc83bfff700 1 -- 172.21.15.46:0/242015275 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc83400c410 con 0x7fc834003a00 2023-07-05T18:57:19.990 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:19.979+0000 7fc84df38700 1 --2- 172.21.15.46:0/242015275 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc834005200 0x7fc83400ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:57:19.990 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:19.979+0000 7fc84cf36700 1 --2- 172.21.15.46:0/242015275 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc834004850 0x7fc834004cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:57:19.990 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:19.979+0000 7fc84d737700 1 --2- 172.21.15.46:0/242015275 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fc834003a00 0x7fc834003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:57:19.990 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:19.979+0000 7fc84df38700 1 -- 172.21.15.46:0/242015275 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fc834003a00 msgr2=0x7fc834003e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-05T18:57:19.990 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:19.979+0000 7fc84df38700 1 --2- 172.21.15.46:0/242015275 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fc834003a00 0x7fc834003e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:57:19.991 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:19.979+0000 7fc84df38700 1 -- 172.21.15.46:0/242015275 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc834004850 msgr2=0x7fc834004cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-05T18:57:19.991 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:19.979+0000 7fc84df38700 1 --2- 172.21.15.46:0/242015275 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc834004850 0x7fc834004cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:57:19.991 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:19.979+0000 7fc84df38700 1 -- 172.21.15.46:0/242015275 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc8340035b0 con 0x7fc834005200 2023-07-05T18:57:19.991 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:19.979+0000 7fc84df38700 1 -- 172.21.15.46:0/242015275 reap_dead start 2023-07-05T18:57:19.991 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:19.979+0000 7fc84df38700 1 --2- 172.21.15.46:0/242015275 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc834005200 0x7fc83400ba10 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7fc840009fc0 tx=0x7fc834005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d0952c3020bebc51 server_cookie=0 in_seq=0 out_seq=0 2023-07-05T18:57:19.991 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:19.979+0000 7fc83bfff700 1 -- 172.21.15.46:0/242015275 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc840003a20 con 0x7fc834005200 2023-07-05T18:57:19.991 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:19.979+0000 7fc83bfff700 1 -- 172.21.15.46:0/242015275 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc84000f040 con 0x7fc834005200 2023-07-05T18:57:19.992 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:19.979+0000 7fc83bfff700 1 -- 172.21.15.46:0/242015275 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc840003de0 con 0x7fc834005200 2023-07-05T18:57:19.992 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:19.980+0000 7fc84f99b700 1 -- 172.21.15.46:0/242015275 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc834005200 msgr2=0x7fc83400ba10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:57:19.995 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:19.980+0000 7fc84f99b700 1 --2- 172.21.15.46:0/242015275 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc834005200 0x7fc83400ba10 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7fc840009fc0 tx=0x7fc834005880 comp rx=0 tx=0).stop 2023-07-05T18:57:19.995 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:19.980+0000 7fc84f99b700 1 -- 172.21.15.46:0/242015275 shutdown_connections 2023-07-05T18:57:19.996 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:19.980+0000 7fc84f99b700 1 --2- 172.21.15.46:0/242015275 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc834005200 0x7fc83400ba10 unknown :-1 s=CLOSED pgs=386 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:57:19.996 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:19.980+0000 7fc84f99b700 1 -- 172.21.15.46:0/242015275 >> 172.21.15.46:0/242015275 conn(0x7fc8480664b0 msgr2=0x7fc848099e10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-05T18:57:19.998 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:19.980+0000 7fc84f99b700 1 -- 172.21.15.46:0/242015275 shutdown_connections 2023-07-05T18:57:19.999 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:19.980+0000 7fc84f99b700 1 -- 172.21.15.46:0/242015275 wait complete. 2023-07-05T18:57:20.001 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:19.981+0000 7fc84f99b700 1 Processor -- start 2023-07-05T18:57:20.001 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:19.981+0000 7fc84f99b700 1 -- start start 2023-07-05T18:57:20.001 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:19.982+0000 7fc84f99b700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fc834005200 0x7fc84806af50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:57:20.001 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:19.982+0000 7fc84f99b700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc84814faf0 0x7fc84814ff60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:57:20.001 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:19.982+0000 7fc84f99b700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc8480c9a00 0x7fc8480c9e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:57:20.002 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:19.982+0000 7fc84f99b700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8480c4630 con 0x7fc8480c9a00 2023-07-05T18:57:20.002 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:19.982+0000 7fc84f99b700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8481504a0 con 0x7fc84814faf0 2023-07-05T18:57:20.002 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:19.982+0000 7fc84f99b700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc8480c4880 con 0x7fc834005200 2023-07-05T18:57:20.002 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:19.982+0000 7fc84df38700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc8480c9a00 0x7fc8480c9e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:57:20.002 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:19.982+0000 7fc84df38700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc8480c9a00 0x7fc8480c9e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:59930/0 (socket says 172.21.15.46:59930) 2023-07-05T18:57:20.002 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:19.982+0000 7fc84df38700 1 -- 172.21.15.46:0/566978774 learned_addr learned my addr 172.21.15.46:0/566978774 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-07-05T18:57:20.002 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:19.982+0000 7fc84d737700 1 --2- 172.21.15.46:0/566978774 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fc834005200 0x7fc84806af50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:57:20.002 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:19.982+0000 7fc84cf36700 1 --2- 172.21.15.46:0/566978774 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc84814faf0 0x7fc84814ff60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:57:20.003 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:19.982+0000 7fc84df38700 1 -- 172.21.15.46:0/566978774 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fc834005200 msgr2=0x7fc84806af50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:57:20.003 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:19.982+0000 7fc84df38700 1 --2- 172.21.15.46:0/566978774 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fc834005200 0x7fc84806af50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:57:20.003 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:19.982+0000 7fc84df38700 1 -- 172.21.15.46:0/566978774 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc84814faf0 msgr2=0x7fc84814ff60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:57:20.005 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:19.982+0000 7fc84df38700 1 --2- 172.21.15.46:0/566978774 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc84814faf0 0x7fc84814ff60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:57:20.005 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:19.982+0000 7fc84df38700 1 -- 172.21.15.46:0/566978774 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc8480c4b60 con 0x7fc8480c9a00 2023-07-05T18:57:20.005 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:19.982+0000 7fc84df38700 1 --2- 172.21.15.46:0/566978774 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc8480c9a00 0x7fc8480c9e50 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7fc84806d0f0 tx=0x7fc840009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-05T18:57:20.005 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:19.983+0000 7fc839ffb700 1 -- 172.21.15.46:0/566978774 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc840003e10 con 0x7fc8480c9a00 2023-07-05T18:57:20.005 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:19.983+0000 7fc839ffb700 1 -- 172.21.15.46:0/566978774 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc840004230 con 0x7fc8480c9a00 2023-07-05T18:57:20.005 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:19.983+0000 7fc84f99b700 1 -- 172.21.15.46:0/566978774 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc8480c4e40 con 0x7fc8480c9a00 2023-07-05T18:57:20.006 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:19.983+0000 7fc839ffb700 1 -- 172.21.15.46:0/566978774 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8400043e0 con 0x7fc8480c9a00 2023-07-05T18:57:20.006 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:19.983+0000 7fc84f99b700 1 -- 172.21.15.46:0/566978774 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc8480ca390 con 0x7fc8480c9a00 2023-07-05T18:57:20.006 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:19.984+0000 7fc84f99b700 1 -- 172.21.15.46:0/566978774 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc8480c5360 con 0x7fc8480c9a00 2023-07-05T18:57:20.006 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:19.984+0000 7fc839ffb700 1 -- 172.21.15.46:0/566978774 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fc840004540 con 0x7fc8480c9a00 2023-07-05T18:57:20.006 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:19.985+0000 7fc839ffb700 1 --2- 172.21.15.46:0/566978774 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7fc82c06ace0 0x7fc82c06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:57:20.006 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:19.985+0000 7fc839ffb700 1 -- 172.21.15.46:0/566978774 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fc84008aae0 con 0x7fc8480c9a00 2023-07-05T18:57:20.006 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:19.985+0000 7fc84d737700 1 --2- 172.21.15.46:0/566978774 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7fc82c06ace0 0x7fc82c06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:57:20.007 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:19.985+0000 7fc84d737700 1 --2- 172.21.15.46:0/566978774 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7fc82c06ace0 0x7fc82c06d190 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7fc83c000c00 tx=0x7fc83c000ed0 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-05T18:57:20.007 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:19.989+0000 7fc839ffb700 1 -- 172.21.15.46:0/566978774 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fc8480c5360 con 0x7fc8480c9a00 2023-07-05T18:57:20.275 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:20.270+0000 7fc84f99b700 1 -- 172.21.15.46:0/566978774 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7fc8480672e0 con 0x7fc8480c9a00 2023-07-05T18:57:20.275 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:20.273+0000 7fc839ffb700 1 -- 172.21.15.46:0/566978774 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v13) v1 ==== 190+0+0 (secure 0 0 0) 0x7fc840059630 con 0x7fc8480c9a00 2023-07-05T18:57:20.278 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:20.275+0000 7fc84f99b700 1 -- 172.21.15.46:0/566978774 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7fc82c06ace0 msgr2=0x7fc82c06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:57:20.278 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:20.275+0000 7fc84f99b700 1 --2- 172.21.15.46:0/566978774 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7fc82c06ace0 0x7fc82c06d190 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7fc83c000c00 tx=0x7fc83c000ed0 comp rx=0 tx=0).stop 2023-07-05T18:57:20.278 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:20.275+0000 7fc84f99b700 1 -- 172.21.15.46:0/566978774 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc8480c9a00 msgr2=0x7fc8480c9e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:57:20.278 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:20.275+0000 7fc84f99b700 1 --2- 172.21.15.46:0/566978774 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc8480c9a00 0x7fc8480c9e50 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7fc84806d0f0 tx=0x7fc840009750 comp rx=0 tx=0).stop 2023-07-05T18:57:20.278 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:20.275+0000 7fc84f99b700 1 -- 172.21.15.46:0/566978774 shutdown_connections 2023-07-05T18:57:20.279 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:20.275+0000 7fc84f99b700 1 --2- 172.21.15.46:0/566978774 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7fc82c06ace0 0x7fc82c06d190 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:57:20.279 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:20.275+0000 7fc84f99b700 1 --2- 172.21.15.46:0/566978774 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc8480c9a00 0x7fc8480c9e50 unknown :-1 s=CLOSED pgs=387 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:57:20.279 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:20.275+0000 7fc84f99b700 1 --2- 172.21.15.46:0/566978774 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fc834005200 0x7fc84806af50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:57:20.279 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:20.275+0000 7fc84f99b700 1 --2- 172.21.15.46:0/566978774 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc84814faf0 0x7fc84814ff60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:57:20.279 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:20.275+0000 7fc84f99b700 1 -- 172.21.15.46:0/566978774 >> 172.21.15.46:0/566978774 conn(0x7fc8480664b0 msgr2=0x7fc84806d800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-05T18:57:20.279 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:20.275+0000 7fc84f99b700 1 -- 172.21.15.46:0/566978774 shutdown_connections 2023-07-05T18:57:20.279 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:20.275+0000 7fc84f99b700 1 -- 172.21.15.46:0/566978774 wait complete. 2023-07-05T18:57:20.280 INFO:teuthology.orchestra.run.smithi046.stderr:updated caps for client.0 2023-07-05T18:57:20.293 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-05T18:57:20.421 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:20.416+0000 7fe635595700 1 Processor -- start 2023-07-05T18:57:20.421 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:20.416+0000 7fe635595700 1 -- start start 2023-07-05T18:57:20.421 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:20.417+0000 7fe635595700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fe63015c2f0 0x7fe6300cd2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:57:20.421 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:20.417+0000 7fe635595700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fe63015c6c0 0x7fe63006c760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:57:20.422 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:20.417+0000 7fe635595700 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe6300cd8c0 con 0x7fe6300b5ae0 2023-07-05T18:57:20.422 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:20.417+0000 7fe635595700 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe6300d0990 con 0x7fe63015c6c0 2023-07-05T18:57:20.422 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:20.417+0000 7fe635595700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe6300d0c70 con 0x7fe63015c2f0 2023-07-05T18:57:20.422 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:20.417+0000 7fe62e7fc700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fe63015c6c0 0x7fe63006c760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:57:20.422 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:20.417+0000 7fe62f7fe700 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7fe6300b5ae0 0x7fe6300d1450 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:59210/0 (socket says 172.21.15.46:59210) 2023-07-05T18:57:20.422 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:20.417+0000 7fe62f7fe700 1 -- 172.21.15.46:0/366190160 learned_addr learned my addr 172.21.15.46:0/366190160 (peer_addr_for_me v1:172.21.15.46:0/0) 2023-07-05T18:57:20.422 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:20.417+0000 7fe62e7fc700 1 --2- 172.21.15.46:0/366190160 >> v2:172.21.15.46:3300/0 conn(0x7fe63015c6c0 0x7fe63006c760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:59934/0 (socket says 172.21.15.46:59934) 2023-07-05T18:57:20.423 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:20.417+0000 7fe62e7fc700 1 -- 172.21.15.46:0/366190160 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fe63015c2f0 msgr2=0x7fe6300cd2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-05T18:57:20.423 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:20.417+0000 7fe62effd700 1 --2- 172.21.15.46:0/366190160 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fe63015c2f0 0x7fe6300cd2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:57:20.423 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:20.417+0000 7fe62e7fc700 1 --2- 172.21.15.46:0/366190160 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fe63015c2f0 0x7fe6300cd2e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:57:20.423 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:20.417+0000 7fe62e7fc700 1 -- 172.21.15.46:0/366190160 >> v1:172.21.15.46:6789/0 conn(0x7fe6300b5ae0 legacy=0x7fe6300d1450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:57:20.423 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:20.417+0000 7fe62e7fc700 1 -- 172.21.15.46:0/366190160 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe6300d0f50 con 0x7fe63015c6c0 2023-07-05T18:57:20.423 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:20.417+0000 7fe62dffb700 1 -- 172.21.15.46:0/366190160 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1750378782 0 0) 0x7fe6300cd8c0 con 0x7fe6300b5ae0 2023-07-05T18:57:20.423 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:20.417+0000 7fe62e7fc700 1 --2- 172.21.15.46:0/366190160 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe63015c6c0 0x7fe63006c760 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7fe618009840 tx=0x7fe618009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=22b6bab78a5e8673 server_cookie=0 in_seq=0 out_seq=0 2023-07-05T18:57:20.423 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:20.418+0000 7fe62dffb700 1 -- 172.21.15.46:0/366190160 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe618011830 con 0x7fe63015c6c0 2023-07-05T18:57:20.424 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:20.418+0000 7fe62dffb700 1 -- 172.21.15.46:0/366190160 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe618011990 con 0x7fe63015c6c0 2023-07-05T18:57:20.424 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:20.418+0000 7fe62dffb700 1 -- 172.21.15.46:0/366190160 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe618011d20 con 0x7fe63015c6c0 2023-07-05T18:57:20.424 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:20.418+0000 7fe635595700 1 -- 172.21.15.46:0/366190160 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe63015c6c0 msgr2=0x7fe63006c760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:57:20.424 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:20.418+0000 7fe635595700 1 --2- 172.21.15.46:0/366190160 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe63015c6c0 0x7fe63006c760 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7fe618009840 tx=0x7fe618009b50 comp rx=0 tx=0).stop 2023-07-05T18:57:20.424 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:20.418+0000 7fe635595700 1 -- 172.21.15.46:0/366190160 shutdown_connections 2023-07-05T18:57:20.424 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:20.418+0000 7fe635595700 1 --2- 172.21.15.46:0/366190160 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fe63015c2f0 0x7fe6300cd2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:57:20.424 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:20.418+0000 7fe635595700 1 --2- 172.21.15.46:0/366190160 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe63015c6c0 0x7fe63006c760 unknown :-1 s=CLOSED pgs=389 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:57:20.426 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:20.418+0000 7fe635595700 1 -- 172.21.15.46:0/366190160 >> 172.21.15.46:0/366190160 conn(0x7fe63006afa0 msgr2=0x7fe6300cf710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-05T18:57:20.426 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:20.418+0000 7fe635595700 1 -- 172.21.15.46:0/366190160 shutdown_connections 2023-07-05T18:57:20.426 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:20.418+0000 7fe635595700 1 -- 172.21.15.46:0/366190160 wait complete. 2023-07-05T18:57:20.431 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:20.420+0000 7fe635595700 1 Processor -- start 2023-07-05T18:57:20.432 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:20.420+0000 7fe635595700 1 -- start start 2023-07-05T18:57:20.432 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:20.421+0000 7fe635595700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe6300b5ae0 0x7fe6300a9d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:57:20.432 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:20.421+0000 7fe635595700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fe63015c2f0 0x7fe6300b5f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:57:20.433 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:20.421+0000 7fe635595700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe63015c6c0 0x7fe6300b6440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:57:20.433 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:20.421+0000 7fe635595700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe630149e70 con 0x7fe63015c6c0 2023-07-05T18:57:20.433 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:20.421+0000 7fe635595700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe63014d040 con 0x7fe6300b5ae0 2023-07-05T18:57:20.434 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:20.421+0000 7fe635595700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe6301f53d0 con 0x7fe63015c2f0 2023-07-05T18:57:20.435 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:20.421+0000 7fe62f7fe700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe63015c6c0 0x7fe6300b6440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:57:20.435 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:20.421+0000 7fe62f7fe700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe63015c6c0 0x7fe6300b6440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:59944/0 (socket says 172.21.15.46:59944) 2023-07-05T18:57:20.435 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:20.421+0000 7fe62f7fe700 1 -- 172.21.15.46:0/591411743 learned_addr learned my addr 172.21.15.46:0/591411743 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-07-05T18:57:20.435 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:20.421+0000 7fe62effd700 1 --2- 172.21.15.46:0/591411743 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe6300b5ae0 0x7fe6300a9d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:57:20.436 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:20.421+0000 7fe62e7fc700 1 --2- 172.21.15.46:0/591411743 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fe63015c2f0 0x7fe6300b5f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:57:20.436 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:20.421+0000 7fe62f7fe700 1 -- 172.21.15.46:0/591411743 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fe63015c2f0 msgr2=0x7fe6300b5f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:57:20.436 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:20.421+0000 7fe62f7fe700 1 --2- 172.21.15.46:0/591411743 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fe63015c2f0 0x7fe6300b5f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:57:20.436 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:20.421+0000 7fe62f7fe700 1 -- 172.21.15.46:0/591411743 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe6300b5ae0 msgr2=0x7fe6300a9d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:57:20.436 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:20.421+0000 7fe62f7fe700 1 --2- 172.21.15.46:0/591411743 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe6300b5ae0 0x7fe6300a9d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:57:20.436 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:20.421+0000 7fe62f7fe700 1 -- 172.21.15.46:0/591411743 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe6180094a0 con 0x7fe63015c6c0 2023-07-05T18:57:20.436 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:20.421+0000 7fe62e7fc700 1 --2- 172.21.15.46:0/591411743 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fe63015c2f0 0x7fe6300b5f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-05T18:57:20.437 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:20.422+0000 7fe62f7fe700 1 --2- 172.21.15.46:0/591411743 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe63015c6c0 0x7fe6300b6440 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7fe6280011e0 tx=0x7fe62800c800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-05T18:57:20.437 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:20.422+0000 7fe6277fe700 1 -- 172.21.15.46:0/591411743 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe628004c80 con 0x7fe63015c6c0 2023-07-05T18:57:20.437 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:20.422+0000 7fe6277fe700 1 -- 172.21.15.46:0/591411743 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe628004de0 con 0x7fe63015c6c0 2023-07-05T18:57:20.437 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:20.422+0000 7fe635595700 1 -- 172.21.15.46:0/591411743 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe6301f56b0 con 0x7fe63015c6c0 2023-07-05T18:57:20.437 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:20.422+0000 7fe6277fe700 1 -- 172.21.15.46:0/591411743 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6280072d0 con 0x7fe63015c6c0 2023-07-05T18:57:20.437 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:20.422+0000 7fe635595700 1 -- 172.21.15.46:0/591411743 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe6301f5c70 con 0x7fe63015c6c0 2023-07-05T18:57:20.437 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:20.423+0000 7fe635595700 1 -- 172.21.15.46:0/591411743 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe6301f5e90 con 0x7fe63015c6c0 2023-07-05T18:57:20.437 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:20.423+0000 7fe6277fe700 1 -- 172.21.15.46:0/591411743 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fe628007430 con 0x7fe63015c6c0 2023-07-05T18:57:20.438 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:20.424+0000 7fe6277fe700 1 --2- 172.21.15.46:0/591411743 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7fe61006ace0 0x7fe61006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:57:20.438 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:20.424+0000 7fe6277fe700 1 -- 172.21.15.46:0/591411743 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fe628089080 con 0x7fe63015c6c0 2023-07-05T18:57:20.438 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:20.424+0000 7fe62effd700 1 --2- 172.21.15.46:0/591411743 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7fe61006ace0 0x7fe61006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:57:20.438 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:20.424+0000 7fe62effd700 1 --2- 172.21.15.46:0/591411743 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7fe61006ace0 0x7fe61006d190 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7fe62000f510 tx=0x7fe6200077b0 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-05T18:57:20.438 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:20.428+0000 7fe6277fe700 1 -- 172.21.15.46:0/591411743 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fe6280541c0 con 0x7fe63015c6c0 2023-07-05T18:57:20.674 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:20.671+0000 7fe635595700 1 -- 172.21.15.46:0/591411743 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fe63004e1d0 con 0x7fe63015c6c0 2023-07-05T18:57:20.674 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:20.672+0000 7fe6277fe700 1 -- 172.21.15.46:0/591411743 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 15 v15) v1 ==== 94+0+4665 (secure 0 0 0) 0x7fe6280577e0 con 0x7fe63015c6c0 2023-07-05T18:57:20.675 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T18:57:20.675 INFO:teuthology.orchestra.run.smithi046.stdout:{"epoch":15,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4823,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.73:6837/1783526483","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6835","nonce":1783526483},{"type":"v1","addr":"172.21.15.73:6837","nonce":1783526483}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":4826,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.46:6834/1224451753","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6832","nonce":1224451753},{"type":"v1","addr":"172.21.15.46:6834","nonce":1224451753}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":4829,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.46:6835/549881285","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6833","nonce":549881285},{"type":"v1","addr":"172.21.15.46:6835","nonce":549881285}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":15,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-07-05T18:57:15.279563+0000","modified":"2023-07-05T18:57:18.286904+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5086},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5086":{"gid":5086,"name":"b","rank":0,"incarnation":12,"state":"up:active","state_seq":3,"addr":"172.21.15.73:6836/255434995","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6834","nonce":255434995},{"type":"v1","addr":"172.21.15.73:6836","nonce":255434995}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2023-07-05T18:57:20.677 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:20.674+0000 7fe635595700 1 -- 172.21.15.46:0/591411743 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7fe61006ace0 msgr2=0x7fe61006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:57:20.677 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:20.674+0000 7fe635595700 1 --2- 172.21.15.46:0/591411743 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7fe61006ace0 0x7fe61006d190 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7fe62000f510 tx=0x7fe6200077b0 comp rx=0 tx=0).stop 2023-07-05T18:57:20.678 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:20.674+0000 7fe635595700 1 -- 172.21.15.46:0/591411743 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe63015c6c0 msgr2=0x7fe6300b6440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:57:20.678 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:20.674+0000 7fe635595700 1 --2- 172.21.15.46:0/591411743 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe63015c6c0 0x7fe6300b6440 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7fe6280011e0 tx=0x7fe62800c800 comp rx=0 tx=0).stop 2023-07-05T18:57:20.678 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:20.674+0000 7fe635595700 1 -- 172.21.15.46:0/591411743 shutdown_connections 2023-07-05T18:57:20.679 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:20.674+0000 7fe635595700 1 --2- 172.21.15.46:0/591411743 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7fe61006ace0 0x7fe61006d190 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:57:20.679 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:20.674+0000 7fe635595700 1 --2- 172.21.15.46:0/591411743 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe63015c6c0 0x7fe6300b6440 unknown :-1 s=CLOSED pgs=390 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:57:20.679 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:20.674+0000 7fe635595700 1 --2- 172.21.15.46:0/591411743 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe6300b5ae0 0x7fe6300a9d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:57:20.680 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:20.674+0000 7fe635595700 1 --2- 172.21.15.46:0/591411743 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fe63015c2f0 0x7fe6300b5f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:57:20.680 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:20.674+0000 7fe635595700 1 -- 172.21.15.46:0/591411743 >> 172.21.15.46:0/591411743 conn(0x7fe63006afa0 msgr2=0x7fe6300b4ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-05T18:57:20.680 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:20.674+0000 7fe635595700 1 -- 172.21.15.46:0/591411743 shutdown_connections 2023-07-05T18:57:20.681 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:20.674+0000 7fe635595700 1 -- 172.21.15.46:0/591411743 wait complete. 2023-07-05T18:57:20.681 INFO:teuthology.orchestra.run.smithi046.stderr:dumped fsmap epoch 15 2023-07-05T18:57:21.096 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 15, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-07-05T18:57:15.279563+0000', 'modified': '2023-07-05T18:57:18.286904+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 5086}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_5086': {'gid': 5086, 'name': 'b', 'rank': 0, 'incarnation': 12, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.73:6836/255434995', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.73:6834', 'nonce': 255434995}, {'type': 'v1', 'addr': '172.21.15.73:6836', 'nonce': 255434995}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [6], 'metadata_pool': 5, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2023-07-05T18:57:21.096 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-07-05T18:57:21.097 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.b status 2023-07-05T18:57:21.227 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:21.225+0000 7f2d1f4d1700 1 Processor -- start 2023-07-05T18:57:21.228 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:21.226+0000 7f2d1f4d1700 1 -- start start 2023-07-05T18:57:21.236 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:21.226+0000 7f2d1f4d1700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f2d18142480 0x7f2d180b41d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:57:21.236 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:21.226+0000 7f2d1f4d1700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f2d180b4710 0x7f2d1806d140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:57:21.237 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:21.226+0000 7f2d1f4d1700 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2d1806c8d0 con 0x7f2d1813f4c0 2023-07-05T18:57:21.237 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:21.226+0000 7f2d1f4d1700 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2d1806ce90 con 0x7f2d18142480 2023-07-05T18:57:21.237 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:21.226+0000 7f2d1f4d1700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2d1806cbb0 con 0x7f2d180b4710 2023-07-05T18:57:21.237 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:21.226+0000 7f2d1d26d700 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7f2d1813f4c0 0x7f2d1815d6a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:59220/0 (socket says 172.21.15.46:59220) 2023-07-05T18:57:21.237 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:21.227+0000 7f2d1d26d700 1 -- 172.21.15.46:0/2247708441 learned_addr learned my addr 172.21.15.46:0/2247708441 (peer_addr_for_me v1:172.21.15.46:0/0) 2023-07-05T18:57:21.238 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:21.227+0000 7f2d1da6e700 1 --2- 172.21.15.46:0/2247708441 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f2d180b4710 0x7f2d1806d140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:57:21.238 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:21.227+0000 7f2d1ca6c700 1 --2- 172.21.15.46:0/2247708441 >> v2:172.21.15.73:3300/0 conn(0x7f2d18142480 0x7f2d180b41d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:57:21.238 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:21.227+0000 7f2d0ffff700 1 -- 172.21.15.46:0/2247708441 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3329946552 0 0) 0x7f2d1806c8d0 con 0x7f2d1813f4c0 2023-07-05T18:57:21.239 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:21.227+0000 7f2d0ffff700 1 -- 172.21.15.46:0/2247708441 --> v1:172.21.15.46:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2d040035b0 con 0x7f2d1813f4c0 2023-07-05T18:57:21.239 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:21.227+0000 7f2d1da6e700 1 -- 172.21.15.46:0/2247708441 >> v2:172.21.15.73:3300/0 conn(0x7f2d18142480 msgr2=0x7f2d180b41d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-05T18:57:21.239 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:21.227+0000 7f2d1da6e700 1 --2- 172.21.15.46:0/2247708441 >> v2:172.21.15.73:3300/0 conn(0x7f2d18142480 0x7f2d180b41d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:57:21.239 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:21.227+0000 7f2d1da6e700 1 -- 172.21.15.46:0/2247708441 >> v1:172.21.15.46:6789/0 conn(0x7f2d1813f4c0 legacy=0x7f2d1815d6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:57:21.240 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:21.227+0000 7f2d1da6e700 1 -- 172.21.15.46:0/2247708441 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2d180b39d0 con 0x7f2d180b4710 2023-07-05T18:57:21.240 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:21.227+0000 7f2d1ca6c700 1 --2- 172.21.15.46:0/2247708441 >> v2:172.21.15.73:3300/0 conn(0x7f2d18142480 0x7f2d180b41d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-05T18:57:21.241 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:21.227+0000 7f2d1da6e700 1 --2- 172.21.15.46:0/2247708441 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f2d180b4710 0x7f2d1806d140 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f2d10009d90 tx=0x7f2d1000b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b97f4319be227efb server_cookie=0 in_seq=0 out_seq=0 2023-07-05T18:57:21.242 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:21.227+0000 7f2d0ffff700 1 -- 172.21.15.46:0/2247708441 <== mon.2 v2:172.21.15.73:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d1000e070 con 0x7f2d180b4710 2023-07-05T18:57:21.242 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:21.227+0000 7f2d0ffff700 1 -- 172.21.15.46:0/2247708441 <== mon.2 v2:172.21.15.73:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2d1000bb20 con 0x7f2d180b4710 2023-07-05T18:57:21.242 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:21.227+0000 7f2d0ffff700 1 -- 172.21.15.46:0/2247708441 <== mon.2 v2:172.21.15.73:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d10012430 con 0x7f2d180b4710 2023-07-05T18:57:21.243 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:21.228+0000 7f2d1f4d1700 1 -- 172.21.15.46:0/2247708441 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f2d180b4710 msgr2=0x7f2d1806d140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:57:21.244 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:21.228+0000 7f2d1f4d1700 1 --2- 172.21.15.46:0/2247708441 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f2d180b4710 0x7f2d1806d140 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f2d10009d90 tx=0x7f2d1000b330 comp rx=0 tx=0).stop 2023-07-05T18:57:21.244 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:21.228+0000 7f2d1f4d1700 1 -- 172.21.15.46:0/2247708441 shutdown_connections 2023-07-05T18:57:21.245 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:21.228+0000 7f2d1f4d1700 1 --2- 172.21.15.46:0/2247708441 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f2d180b4710 0x7f2d1806d140 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:57:21.245 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:21.228+0000 7f2d1f4d1700 1 --2- 172.21.15.46:0/2247708441 >> v2:172.21.15.73:3300/0 conn(0x7f2d18142480 0x7f2d180b41d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:57:21.245 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:21.228+0000 7f2d1f4d1700 1 -- 172.21.15.46:0/2247708441 >> 172.21.15.46:0/2247708441 conn(0x7f2d1806af10 msgr2=0x7f2d1806b2e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-05T18:57:21.245 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:21.228+0000 7f2d1f4d1700 1 -- 172.21.15.46:0/2247708441 shutdown_connections 2023-07-05T18:57:21.245 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:21.228+0000 7f2d1f4d1700 1 -- 172.21.15.46:0/2247708441 wait complete. 2023-07-05T18:57:21.245 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:21.230+0000 7f2d1f4d1700 1 Processor -- start 2023-07-05T18:57:21.245 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:21.230+0000 7f2d1f4d1700 1 -- start start 2023-07-05T18:57:21.246 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:21.231+0000 7f2d1f4d1700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2d180b4710 0x7f2d1813a930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:57:21.246 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:21.231+0000 7f2d1f4d1700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2d1813f4c0 0x7f2d18157220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:57:21.246 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:21.231+0000 7f2d1f4d1700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f2d18142480 0x7f2d18151180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:57:21.246 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:21.231+0000 7f2d1f4d1700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d18156180 con 0x7f2d1813f4c0 2023-07-05T18:57:21.246 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:21.231+0000 7f2d1f4d1700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d18156460 con 0x7f2d180b4710 2023-07-05T18:57:21.246 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:21.231+0000 7f2d1f4d1700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2d18156740 con 0x7f2d18142480 2023-07-05T18:57:21.246 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:21.231+0000 7f2d1ca6c700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2d1813f4c0 0x7f2d18157220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:57:21.246 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:21.231+0000 7f2d1ca6c700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2d1813f4c0 0x7f2d18157220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:59956/0 (socket says 172.21.15.46:59956) 2023-07-05T18:57:21.247 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:21.231+0000 7f2d1ca6c700 1 -- 172.21.15.46:0/3337295427 learned_addr learned my addr 172.21.15.46:0/3337295427 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-07-05T18:57:21.247 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:21.231+0000 7f2d1d26d700 1 --2- 172.21.15.46:0/3337295427 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2d180b4710 0x7f2d1813a930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:57:21.247 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:21.231+0000 7f2d1da6e700 1 --2- 172.21.15.46:0/3337295427 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f2d18142480 0x7f2d18151180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:57:21.247 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:21.231+0000 7f2d1ca6c700 1 -- 172.21.15.46:0/3337295427 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f2d18142480 msgr2=0x7f2d18151180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:57:21.247 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:21.231+0000 7f2d1ca6c700 1 --2- 172.21.15.46:0/3337295427 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f2d18142480 0x7f2d18151180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:57:21.247 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:21.231+0000 7f2d1ca6c700 1 -- 172.21.15.46:0/3337295427 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2d180b4710 msgr2=0x7f2d1813a930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:57:21.248 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:21.231+0000 7f2d1ca6c700 1 --2- 172.21.15.46:0/3337295427 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2d180b4710 0x7f2d1813a930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:57:21.248 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:21.231+0000 7f2d1ca6c700 1 -- 172.21.15.46:0/3337295427 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2d140094a0 con 0x7f2d1813f4c0 2023-07-05T18:57:21.248 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:21.231+0000 7f2d1da6e700 1 --2- 172.21.15.46:0/3337295427 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f2d18142480 0x7f2d18151180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-05T18:57:21.248 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:21.231+0000 7f2d1ca6c700 1 --2- 172.21.15.46:0/3337295427 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2d1813f4c0 0x7f2d18157220 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f2d1400ebe0 tx=0x7f2d14009e20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-05T18:57:21.248 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:21.231+0000 7f2d0dffb700 1 -- 172.21.15.46:0/3337295427 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d1400c8b0 con 0x7f2d1813f4c0 2023-07-05T18:57:21.248 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:21.231+0000 7f2d0dffb700 1 -- 172.21.15.46:0/3337295427 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2d1400ca10 con 0x7f2d1813f4c0 2023-07-05T18:57:21.248 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:21.231+0000 7f2d1f4d1700 1 -- 172.21.15.46:0/3337295427 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2d10009a70 con 0x7f2d1813f4c0 2023-07-05T18:57:21.249 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:21.232+0000 7f2d0dffb700 1 -- 172.21.15.46:0/3337295427 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d1400cda0 con 0x7f2d1813f4c0 2023-07-05T18:57:21.249 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:21.232+0000 7f2d1f4d1700 1 -- 172.21.15.46:0/3337295427 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2d18156d00 con 0x7f2d1813f4c0 2023-07-05T18:57:21.249 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:21.234+0000 7f2d0dffb700 1 -- 172.21.15.46:0/3337295427 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f2d14013470 con 0x7f2d1813f4c0 2023-07-05T18:57:21.249 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:21.234+0000 7f2d0dffb700 1 --2- 172.21.15.46:0/3337295427 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7f2cfc06ace0 0x7f2cfc06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:57:21.249 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:21.234+0000 7f2d0dffb700 1 -- 172.21.15.46:0/3337295427 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f2d14089970 con 0x7f2d1813f4c0 2023-07-05T18:57:21.249 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:21.234+0000 7f2d1d26d700 1 --2- 172.21.15.46:0/3337295427 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7f2cfc06ace0 0x7f2cfc06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:57:21.254 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:21.235+0000 7f2d1d26d700 1 --2- 172.21.15.46:0/3337295427 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7f2cfc06ace0 0x7f2cfc06d190 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f2d080011e0 tx=0x7f2d08009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-05T18:57:21.255 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:21.236+0000 7f2d2b656b80 1 Processor -- start 2023-07-05T18:57:21.255 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:21.236+0000 7f2d2b656b80 1 -- start start 2023-07-05T18:57:21.255 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:21.237+0000 7f2d2b656b80 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x5627a80c2f50 0x5627a80c3320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:57:21.255 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:21.237+0000 7f2d2b656b80 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5627a80ead80 0x5627a80e9820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:57:21.255 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:21.237+0000 7f2d2b656b80 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5627a80c0740 0x5627a80ed440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:57:21.256 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:21.237+0000 7f2d2b656b80 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x5627a7fc7c60 con 0x5627a80ead80 2023-07-05T18:57:21.256 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:21.237+0000 7f2d2b656b80 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x5627a801a9f0 con 0x5627a80c0740 2023-07-05T18:57:21.256 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:21.237+0000 7f2d2b656b80 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x5627a8013e80 con 0x5627a80c2f50 2023-07-05T18:57:21.256 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:21.237+0000 7f2d1ca6c700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5627a80ead80 0x5627a80e9820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:57:21.256 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:21.237+0000 7f2d1ca6c700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5627a80ead80 0x5627a80e9820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:59964/0 (socket says 172.21.15.46:59964) 2023-07-05T18:57:21.256 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:21.237+0000 7f2d1ca6c700 1 -- 172.21.15.46:0/242278282 learned_addr learned my addr 172.21.15.46:0/242278282 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-07-05T18:57:21.256 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:21.237+0000 7f2d1d26d700 1 --2- 172.21.15.46:0/242278282 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x5627a80c2f50 0x5627a80c3320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:57:21.257 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:21.237+0000 7f2d1da6e700 1 --2- 172.21.15.46:0/242278282 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5627a80c0740 0x5627a80ed440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:57:21.257 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:21.237+0000 7f2d1ca6c700 1 -- 172.21.15.46:0/242278282 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x5627a80c2f50 msgr2=0x5627a80c3320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-05T18:57:21.257 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:21.237+0000 7f2d1ca6c700 1 --2- 172.21.15.46:0/242278282 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x5627a80c2f50 0x5627a80c3320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:57:21.257 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:21.237+0000 7f2d1ca6c700 1 -- 172.21.15.46:0/242278282 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5627a80c0740 msgr2=0x5627a80ed440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-05T18:57:21.257 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:21.238+0000 7f2d1ca6c700 1 --2- 172.21.15.46:0/242278282 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5627a80c0740 0x5627a80ed440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:57:21.257 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:21.238+0000 7f2d1ca6c700 1 -- 172.21.15.46:0/242278282 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5627a7e955e0 con 0x5627a80ead80 2023-07-05T18:57:21.257 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:21.238+0000 7f2d1ca6c700 1 --2- 172.21.15.46:0/242278282 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5627a80ead80 0x5627a80e9820 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7f2d14087d60 tx=0x7f2d14058040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c3db100336878341 server_cookie=0 in_seq=0 out_seq=0 2023-07-05T18:57:21.257 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:21.238+0000 7f2d02ffd700 1 -- 172.21.15.46:0/242278282 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d14060a30 con 0x5627a80ead80 2023-07-05T18:57:21.258 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:21.238+0000 7f2d02ffd700 1 -- 172.21.15.46:0/242278282 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2d14056a80 con 0x5627a80ead80 2023-07-05T18:57:21.258 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:21.238+0000 7f2d02ffd700 1 -- 172.21.15.46:0/242278282 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d14057df0 con 0x5627a80ead80 2023-07-05T18:57:21.258 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:21.238+0000 7f2d2b656b80 1 -- 172.21.15.46:0/242278282 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5627a80ead80 msgr2=0x5627a80e9820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:57:21.258 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:21.238+0000 7f2d2b656b80 1 --2- 172.21.15.46:0/242278282 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5627a80ead80 0x5627a80e9820 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7f2d14087d60 tx=0x7f2d14058040 comp rx=0 tx=0).stop 2023-07-05T18:57:21.258 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:21.239+0000 7f2d2b656b80 1 -- 172.21.15.46:0/242278282 shutdown_connections 2023-07-05T18:57:21.258 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:21.239+0000 7f2d2b656b80 1 --2- 172.21.15.46:0/242278282 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5627a80c0740 0x5627a80ed440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:57:21.258 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:21.239+0000 7f2d2b656b80 1 --2- 172.21.15.46:0/242278282 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x5627a80c2f50 0x5627a80c3320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:57:21.258 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:21.239+0000 7f2d2b656b80 1 --2- 172.21.15.46:0/242278282 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5627a80ead80 0x5627a80e9820 unknown :-1 s=CLOSED pgs=393 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:57:21.259 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:21.239+0000 7f2d2b656b80 1 -- 172.21.15.46:0/242278282 >> 172.21.15.46:0/242278282 conn(0x5627a80b7fc0 msgr2=0x5627a81081a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-05T18:57:21.259 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:21.239+0000 7f2d2b656b80 1 -- 172.21.15.46:0/242278282 shutdown_connections 2023-07-05T18:57:21.259 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:21.239+0000 7f2d2b656b80 1 -- 172.21.15.46:0/242278282 wait complete. 2023-07-05T18:57:21.259 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:21.239+0000 7f2d2b656b80 1 -- start start 2023-07-05T18:57:21.259 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:21.239+0000 7f2d2b656b80 1 Processor -- start 2023-07-05T18:57:21.259 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:21.240+0000 7f2d2b656b80 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x5627a80c0740 0x5627a8106c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:57:21.259 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:21.240+0000 7f2d2b656b80 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5627a80c2f50 0x5627a8102660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:57:21.260 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:21.240+0000 7f2d2b656b80 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5627a80ead80 0x5627a810bdc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:57:21.260 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:21.240+0000 7f2d2b656b80 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x5627a7fb3a70 con 0x5627a80c2f50 2023-07-05T18:57:21.260 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:21.240+0000 7f2d2b656b80 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x5627a7fb3770 con 0x5627a80ead80 2023-07-05T18:57:21.260 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:21.240+0000 7f2d2b656b80 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x5627a7e978d0 con 0x5627a80c0740 2023-07-05T18:57:21.260 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:21.240+0000 7f2d2b656b80 10 client.0 _ll_register_callbacks cb 0x5627a7fb9210 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-05T18:57:21.260 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:21.240+0000 7f2d1ca6c700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5627a80c2f50 0x5627a8102660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:57:21.260 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:21.240+0000 7f2d1ca6c700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5627a80c2f50 0x5627a8102660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:59970/0 (socket says 172.21.15.46:59970) 2023-07-05T18:57:21.261 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:21.240+0000 7f2d1ca6c700 1 -- 172.21.15.46:0/1188508749 learned_addr learned my addr 172.21.15.46:0/1188508749 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-07-05T18:57:21.261 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:21.240+0000 7f2d1da6e700 1 --2- 172.21.15.46:0/1188508749 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5627a80ead80 0x5627a810bdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:57:21.261 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:21.240+0000 7f2d1d26d700 1 --2- 172.21.15.46:0/1188508749 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x5627a80c0740 0x5627a8106c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:57:21.261 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:21.241+0000 7f2d1ca6c700 1 -- 172.21.15.46:0/1188508749 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x5627a80c0740 msgr2=0x5627a8106c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-05T18:57:21.261 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:21.241+0000 7f2d1ca6c700 1 --2- 172.21.15.46:0/1188508749 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x5627a80c0740 0x5627a8106c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:57:21.261 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:21.241+0000 7f2d1ca6c700 1 -- 172.21.15.46:0/1188508749 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5627a80ead80 msgr2=0x5627a810bdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-05T18:57:21.261 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:21.241+0000 7f2d1ca6c700 1 --2- 172.21.15.46:0/1188508749 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5627a80ead80 0x5627a810bdc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:57:21.261 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:21.241+0000 7f2d1ca6c700 1 -- 172.21.15.46:0/1188508749 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2d14089040 con 0x5627a80c2f50 2023-07-05T18:57:21.262 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:21.241+0000 7f2d1ca6c700 1 --2- 172.21.15.46:0/1188508749 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5627a80c2f50 0x5627a8102660 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f2d1400ebb0 tx=0x7f2d14004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f9ddbec232ba7e29 server_cookie=0 in_seq=0 out_seq=0 2023-07-05T18:57:21.262 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:21.241+0000 7f2cf7fff700 10 client.0 ms_handle_connect on v2:172.21.15.46:3300/0 2023-07-05T18:57:21.262 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:21.241+0000 7f2cf7fff700 1 -- 172.21.15.46:0/1188508749 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d14060a30 con 0x5627a80c2f50 2023-07-05T18:57:21.262 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:21.241+0000 7f2cf7fff700 1 -- 172.21.15.46:0/1188508749 <== mon.0 v2:172.21.15.46:3300/0 2 ==== osd_map(35..35 src has 1..35) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f2d140605a0 con 0x5627a80c2f50 2023-07-05T18:57:21.262 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:21.241+0000 7f2d2b656b80 1 -- 172.21.15.46:0/1188508749 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5627a80b5780 con 0x5627a80c2f50 2023-07-05T18:57:21.263 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:21.241+0000 7f2cf7fff700 1 -- 172.21.15.46:0/1188508749 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_get_version_reply(handle=1 version=15) v2 ==== 24+0+0 (secure 0 0 0) 0x7f2d14060760 con 0x5627a80c2f50 2023-07-05T18:57:21.263 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:21.241+0000 7f2d2b656b80 10 client.5319 fetch_fsmap learned FSMap version 15 2023-07-05T18:57:21.263 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:21.241+0000 7f2d2b656b80 1 -- 172.21.15.46:0/1188508749 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,fsmap=15,monmap=2+}) v3 -- 0x5627a7e41d90 con 0x5627a80c2f50 2023-07-05T18:57:21.263 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:21.241+0000 7f2cf7fff700 1 -- 172.21.15.46:0/1188508749 <== mon.0 v2:172.21.15.46:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x5627a80b5780 con 0x5627a80c2f50 2023-07-05T18:57:21.263 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:21.241+0000 7f2cf7fff700 1 -- 172.21.15.46:0/1188508749 <== mon.0 v2:172.21.15.46:3300/0 5 ==== fsmap(e 15) v1 ==== 3114+0+0 (secure 0 0 0) 0x7f2d1405c170 con 0x5627a80c2f50 2023-07-05T18:57:21.264 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:21.241+0000 7f2d2b656b80 10 client.5319 fetch_fsmap finished waiting for FSMap version 15 2023-07-05T18:57:21.264 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:21.241+0000 7f2d2b656b80 10 client.5319 resolve_mds: resolved name 'b' to daemon mds.b 2023-07-05T18:57:21.264 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:21.241+0000 7f2d2b656b80 20 client.5319 populate_metadata read hostname 'smithi046' 2023-07-05T18:57:21.264 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:21.241+0000 7f2d2b656b80 1 --2- 172.21.15.46:0/1188508749 >> [v2:172.21.15.73:6834/255434995,v1:172.21.15.73:6836/255434995] conn(0x5627a80e3b40 0x5627a8101750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:57:21.264 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:21.241+0000 7f2d2b656b80 4 client.5319 mds_command: new command op to 5086 tid=0[{"prefix": "get_command_descriptions"}] 2023-07-05T18:57:21.265 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:21.241+0000 7f2d2b656b80 1 -- 172.21.15.46:0/1188508749 --> [v2:172.21.15.73:6834/255434995,v1:172.21.15.73:6836/255434995] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5627a800ce60 con 0x5627a80e3b40 2023-07-05T18:57:21.265 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:21.242+0000 7f2d1d26d700 1 --2- 172.21.15.46:0/1188508749 >> [v2:172.21.15.73:6834/255434995,v1:172.21.15.73:6836/255434995] conn(0x5627a80e3b40 0x5627a8101750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:57:21.265 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:21.242+0000 7f2cf7fff700 10 client.5319 ms_handle_connect on v2:172.21.15.73:6834/255434995 2023-07-05T18:57:21.265 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:21.242+0000 7f2d1d26d700 1 --2- 172.21.15.46:0/1188508749 >> [v2:172.21.15.73:6834/255434995,v1:172.21.15.73:6836/255434995] conn(0x5627a80e3b40 0x5627a8101750 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=aa8e65382af7a653 server_cookie=29d5788a54642419 in_seq=0 out_seq=0 2023-07-05T18:57:21.265 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:21.243+0000 7f2cf7fff700 1 -- 172.21.15.46:0/1188508749 <== mds.0 v2:172.21.15.73:6834/255434995 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18291 (crc 0 0 0) 0x5627a800ce60 con 0x5627a80e3b40 2023-07-05T18:57:21.266 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:21.243+0000 7f2cf7fff700 10 client.5319 handle_command_reply: tid=0 2023-07-05T18:57:21.266 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:21.243+0000 7f2d2b656b80 1 client.5319 shutdown 2023-07-05T18:57:21.266 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:21.243+0000 7f2d2b656b80 1 -- 172.21.15.46:0/1188508749 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5627a80c2f50 msgr2=0x5627a8102660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:57:21.266 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:21.243+0000 7f2d2b656b80 1 --2- 172.21.15.46:0/1188508749 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5627a80c2f50 0x5627a8102660 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f2d1400ebb0 tx=0x7f2d14004750 comp rx=0 tx=0).stop 2023-07-05T18:57:21.266 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:21.243+0000 7f2d2b656b80 1 -- 172.21.15.46:0/1188508749 shutdown_connections 2023-07-05T18:57:21.266 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:21.243+0000 7f2d2b656b80 1 --2- 172.21.15.46:0/1188508749 >> [v2:172.21.15.73:6834/255434995,v1:172.21.15.73:6836/255434995] conn(0x5627a80e3b40 0x5627a8101750 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:57:21.266 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:21.243+0000 7f2d2b656b80 1 --2- 172.21.15.46:0/1188508749 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5627a80ead80 0x5627a810bdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:57:21.266 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:21.243+0000 7f2d2b656b80 1 --2- 172.21.15.46:0/1188508749 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x5627a80c0740 0x5627a8106c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:57:21.267 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:21.243+0000 7f2d2b656b80 1 --2- 172.21.15.46:0/1188508749 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5627a80c2f50 0x5627a8102660 unknown :-1 s=CLOSED pgs=394 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:57:21.267 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:21.243+0000 7f2d2b656b80 1 -- 172.21.15.46:0/1188508749 >> 172.21.15.46:0/1188508749 conn(0x5627a80b7fc0 msgr2=0x5627a8108bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-05T18:57:21.267 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:21.243+0000 7f2cf7fff700 0 client.5319 ms_handle_reset on v2:172.21.15.73:6834/255434995 2023-07-05T18:57:21.267 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:21.243+0000 7f2d2b656b80 1 -- 172.21.15.46:0/1188508749 shutdown_connections 2023-07-05T18:57:21.267 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:21.243+0000 7f2d2b656b80 1 -- 172.21.15.46:0/1188508749 wait complete. 2023-07-05T18:57:21.267 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:21.243+0000 7f2d2b656b80 20 client.5319 trim_cache size 0 max 16384 2023-07-05T18:57:21.273 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:21.261+0000 7f2d2b656b80 1 Processor -- start 2023-07-05T18:57:21.273 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:21.261+0000 7f2d2b656b80 1 -- start start 2023-07-05T18:57:21.273 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:21.262+0000 7f2d2b656b80 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5627a80c0740 0x5627a80becf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:57:21.273 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:21.262+0000 7f2d2b656b80 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5627a80c2f50 0x5627a80bbf90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:57:21.273 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:21.262+0000 7f2d2b656b80 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x5627a80ead80 0x5627a81086e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:57:21.274 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:21.262+0000 7f2d2b656b80 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x5627a8105b30 con 0x5627a80c0740 2023-07-05T18:57:21.274 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:21.262+0000 7f2d2b656b80 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x5627a810bda0 con 0x5627a80c2f50 2023-07-05T18:57:21.274 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:21.262+0000 7f2d2b656b80 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x5627a80e9070 con 0x5627a80ead80 2023-07-05T18:57:21.274 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:21.262+0000 7f2d1d26d700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5627a80c0740 0x5627a80becf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:57:21.275 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:21.262+0000 7f2d1d26d700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5627a80c0740 0x5627a80becf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:59976/0 (socket says 172.21.15.46:59976) 2023-07-05T18:57:21.275 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:21.262+0000 7f2d1d26d700 1 -- 172.21.15.46:0/852318415 learned_addr learned my addr 172.21.15.46:0/852318415 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-07-05T18:57:21.275 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:21.262+0000 7f2d1d26d700 1 -- 172.21.15.46:0/852318415 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x5627a80ead80 msgr2=0x5627a81086e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-05T18:57:21.275 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:21.262+0000 7f2d1d26d700 1 --2- 172.21.15.46:0/852318415 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x5627a80ead80 0x5627a81086e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:57:21.275 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:21.262+0000 7f2d1d26d700 1 -- 172.21.15.46:0/852318415 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5627a80c2f50 msgr2=0x5627a80bbf90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-05T18:57:21.275 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:21.262+0000 7f2d1d26d700 1 --2- 172.21.15.46:0/852318415 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5627a80c2f50 0x5627a80bbf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:57:21.275 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:21.262+0000 7f2d1d26d700 1 -- 172.21.15.46:0/852318415 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5627a7e2ac10 con 0x5627a80c0740 2023-07-05T18:57:21.276 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:21.262+0000 7f2d1d26d700 1 --2- 172.21.15.46:0/852318415 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5627a80c0740 0x5627a80becf0 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f2d08007ed0 tx=0x7f2d08012000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=56347734442bb1b3 server_cookie=0 in_seq=0 out_seq=0 2023-07-05T18:57:21.276 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:21.263+0000 7f2d037fe700 1 -- 172.21.15.46:0/852318415 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d08026ae0 con 0x5627a80c0740 2023-07-05T18:57:21.276 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:21.263+0000 7f2d037fe700 1 -- 172.21.15.46:0/852318415 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2d08026c40 con 0x5627a80c0740 2023-07-05T18:57:21.276 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:21.263+0000 7f2d037fe700 1 -- 172.21.15.46:0/852318415 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d08026df0 con 0x5627a80c0740 2023-07-05T18:57:21.276 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:21.263+0000 7f2d2b656b80 1 -- 172.21.15.46:0/852318415 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5627a80c0740 msgr2=0x5627a80becf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:57:21.276 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:21.263+0000 7f2d2b656b80 1 --2- 172.21.15.46:0/852318415 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5627a80c0740 0x5627a80becf0 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f2d08007ed0 tx=0x7f2d08012000 comp rx=0 tx=0).stop 2023-07-05T18:57:21.276 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:21.263+0000 7f2d2b656b80 1 -- 172.21.15.46:0/852318415 shutdown_connections 2023-07-05T18:57:21.276 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:21.263+0000 7f2d2b656b80 1 --2- 172.21.15.46:0/852318415 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x5627a80ead80 0x5627a81086e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:57:21.277 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:21.263+0000 7f2d2b656b80 1 --2- 172.21.15.46:0/852318415 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5627a80c0740 0x5627a80becf0 unknown :-1 s=CLOSED pgs=395 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:57:21.277 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:21.263+0000 7f2d2b656b80 1 --2- 172.21.15.46:0/852318415 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5627a80c2f50 0x5627a80bbf90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:57:21.277 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:21.263+0000 7f2d2b656b80 1 -- 172.21.15.46:0/852318415 >> 172.21.15.46:0/852318415 conn(0x5627a80b7fc0 msgr2=0x5627a8101750 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-05T18:57:21.277 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:21.263+0000 7f2d2b656b80 1 -- 172.21.15.46:0/852318415 shutdown_connections 2023-07-05T18:57:21.277 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:21.263+0000 7f2d2b656b80 1 -- 172.21.15.46:0/852318415 wait complete. 2023-07-05T18:57:21.277 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:21.264+0000 7f2d2b656b80 1 -- start start 2023-07-05T18:57:21.278 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:21.264+0000 7f2d2b656b80 1 Processor -- start 2023-07-05T18:57:21.278 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:21.265+0000 7f2d2b656b80 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5627a80c0740 0x5627a80becf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:57:21.278 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:21.265+0000 7f2d2b656b80 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x5627a80c2f50 0x5627a80fdb30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:57:21.278 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:21.265+0000 7f2d2b656b80 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5627a80ead80 0x5627a80fe070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:57:21.279 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:21.265+0000 7f2d2b656b80 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x5627a80e84f0 con 0x5627a80c0740 2023-07-05T18:57:21.279 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:21.265+0000 7f2d2b656b80 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x5627a80e48e0 con 0x5627a80ead80 2023-07-05T18:57:21.279 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:21.265+0000 7f2d2b656b80 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x5627a81090a0 con 0x5627a80c2f50 2023-07-05T18:57:21.279 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:21.265+0000 7f2d2b656b80 10 client.0 _ll_register_callbacks cb 0x5627a7fb9210 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-05T18:57:21.279 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:21.265+0000 7f2d1d26d700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5627a80c0740 0x5627a80becf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:57:21.279 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:21.265+0000 7f2d1d26d700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5627a80c0740 0x5627a80becf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:59982/0 (socket says 172.21.15.46:59982) 2023-07-05T18:57:21.280 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:21.265+0000 7f2d1d26d700 1 -- 172.21.15.46:0/3819057316 learned_addr learned my addr 172.21.15.46:0/3819057316 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-07-05T18:57:21.280 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:21.265+0000 7f2d1da6e700 1 --2- 172.21.15.46:0/3819057316 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5627a80ead80 0x5627a80fe070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:57:21.280 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:21.265+0000 7f2d1ca6c700 1 --2- 172.21.15.46:0/3819057316 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x5627a80c2f50 0x5627a80fdb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:57:21.280 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:21.266+0000 7f2d1d26d700 1 -- 172.21.15.46:0/3819057316 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x5627a80c2f50 msgr2=0x5627a80fdb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-05T18:57:21.280 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:21.266+0000 7f2d1d26d700 1 --2- 172.21.15.46:0/3819057316 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x5627a80c2f50 0x5627a80fdb30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:57:21.280 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:21.266+0000 7f2d1d26d700 1 -- 172.21.15.46:0/3819057316 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5627a80ead80 msgr2=0x5627a80fe070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-05T18:57:21.281 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:21.266+0000 7f2d1d26d700 1 --2- 172.21.15.46:0/3819057316 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5627a80ead80 0x5627a80fe070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:57:21.281 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:21.266+0000 7f2d1d26d700 1 -- 172.21.15.46:0/3819057316 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2d0800f040 con 0x5627a80c0740 2023-07-05T18:57:21.281 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:21.266+0000 7f2d1da6e700 1 --2- 172.21.15.46:0/3819057316 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5627a80ead80 0x5627a80fe070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-05T18:57:21.281 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:21.266+0000 7f2d1d26d700 1 --2- 172.21.15.46:0/3819057316 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5627a80c0740 0x5627a80becf0 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x5627a8105c70 tx=0x7f2d08000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1aa8a37500647bd1 server_cookie=0 in_seq=0 out_seq=0 2023-07-05T18:57:21.281 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:21.266+0000 7f2cf7fff700 10 client.0 ms_handle_connect on v2:172.21.15.46:3300/0 2023-07-05T18:57:21.282 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:21.266+0000 7f2cf7fff700 1 -- 172.21.15.46:0/3819057316 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d08026ae0 con 0x5627a80c0740 2023-07-05T18:57:21.282 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:21.266+0000 7f2cf7fff700 1 -- 172.21.15.46:0/3819057316 <== mon.0 v2:172.21.15.46:3300/0 2 ==== osd_map(35..35 src has 1..35) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f2d08024630 con 0x5627a80c0740 2023-07-05T18:57:21.282 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:21.266+0000 7f2d2b656b80 1 -- 172.21.15.46:0/3819057316 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f2d14056a80 con 0x5627a80c0740 2023-07-05T18:57:21.282 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:21.266+0000 7f2cf7fff700 1 -- 172.21.15.46:0/3819057316 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_get_version_reply(handle=1 version=15) v2 ==== 24+0+0 (secure 0 0 0) 0x7f2d080247f0 con 0x5627a80c0740 2023-07-05T18:57:21.282 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:21.266+0000 7f2d2b656b80 10 client.5325 fetch_fsmap learned FSMap version 15 2023-07-05T18:57:21.282 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:21.266+0000 7f2d2b656b80 1 -- 172.21.15.46:0/3819057316 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,fsmap=15,monmap=2+}) v3 -- 0x5627a7e68200 con 0x5627a80c0740 2023-07-05T18:57:21.283 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:21.266+0000 7f2cf7fff700 1 -- 172.21.15.46:0/3819057316 <== mon.0 v2:172.21.15.46:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2d14056a80 con 0x5627a80c0740 2023-07-05T18:57:21.283 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:21.266+0000 7f2cf7fff700 1 -- 172.21.15.46:0/3819057316 <== mon.0 v2:172.21.15.46:3300/0 5 ==== fsmap(e 15) v1 ==== 3114+0+0 (secure 0 0 0) 0x7f2d0802d020 con 0x5627a80c0740 2023-07-05T18:57:21.283 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:21.266+0000 7f2d2b656b80 10 client.5325 fetch_fsmap finished waiting for FSMap version 15 2023-07-05T18:57:21.283 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:21.266+0000 7f2d2b656b80 10 client.5325 resolve_mds: resolved name 'b' to daemon mds.b 2023-07-05T18:57:21.283 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:21.266+0000 7f2d2b656b80 20 client.5325 populate_metadata read hostname 'smithi046' 2023-07-05T18:57:21.283 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:21.266+0000 7f2d2b656b80 1 --2- 172.21.15.46:0/3819057316 >> [v2:172.21.15.73:6834/255434995,v1:172.21.15.73:6836/255434995] conn(0x5627a80e3be0 0x5627a80e3fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:57:21.283 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:21.266+0000 7f2d2b656b80 4 client.5325 mds_command: new command op to 5086 tid=0[{"prefix": "status"}] 2023-07-05T18:57:21.283 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:21.266+0000 7f2d2b656b80 1 -- 172.21.15.46:0/3819057316 --> [v2:172.21.15.73:6834/255434995,v1:172.21.15.73:6836/255434995] -- command(tid 0: {"prefix": "status"}) v1 -- 0x5627a7fcf000 con 0x5627a80e3be0 2023-07-05T18:57:21.284 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:21.267+0000 7f2d1ca6c700 1 --2- 172.21.15.46:0/3819057316 >> [v2:172.21.15.73:6834/255434995,v1:172.21.15.73:6836/255434995] conn(0x5627a80e3be0 0x5627a80e3fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:57:21.284 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:21.267+0000 7f2cf7fff700 10 client.5325 ms_handle_connect on v2:172.21.15.73:6834/255434995 2023-07-05T18:57:21.284 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:21.267+0000 7f2d1ca6c700 1 --2- 172.21.15.46:0/3819057316 >> [v2:172.21.15.73:6834/255434995,v1:172.21.15.73:6836/255434995] conn(0x5627a80e3be0 0x5627a80e3fb0 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=66e9f30c770158ec server_cookie=ec773b4a5dd207ba in_seq=0 out_seq=0 2023-07-05T18:57:21.284 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:21.267+0000 7f2cf7fff700 1 -- 172.21.15.46:0/3819057316 <== mds.0 v2:172.21.15.73:6834/255434995 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+331 (crc 0 0 0) 0x5627a7fcf000 con 0x5627a80e3be0 2023-07-05T18:57:21.285 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:21.267+0000 7f2cf7fff700 10 client.5325 handle_command_reply: tid=0 2023-07-05T18:57:21.285 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:21.267+0000 7f2d2b656b80 1 client.5325 shutdown 2023-07-05T18:57:21.285 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:21.267+0000 7f2d2b656b80 1 -- 172.21.15.46:0/3819057316 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5627a80c0740 msgr2=0x5627a80becf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:57:21.285 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:21.267+0000 7f2d2b656b80 1 --2- 172.21.15.46:0/3819057316 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5627a80c0740 0x5627a80becf0 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x5627a8105c70 tx=0x7f2d08000ed0 comp rx=0 tx=0).stop 2023-07-05T18:57:21.285 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:21.268+0000 7f2d2b656b80 1 -- 172.21.15.46:0/3819057316 shutdown_connections 2023-07-05T18:57:21.285 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:21.268+0000 7f2d2b656b80 1 --2- 172.21.15.46:0/3819057316 >> [v2:172.21.15.73:6834/255434995,v1:172.21.15.73:6836/255434995] conn(0x5627a80e3be0 0x5627a80e3fb0 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:57:21.285 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:21.268+0000 7f2d2b656b80 1 --2- 172.21.15.46:0/3819057316 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5627a80ead80 0x5627a80fe070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:57:21.285 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:21.268+0000 7f2cf7fff700 0 client.5325 ms_handle_reset on v2:172.21.15.73:6834/255434995 2023-07-05T18:57:21.286 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:21.268+0000 7f2d2b656b80 1 --2- 172.21.15.46:0/3819057316 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5627a80c0740 0x5627a80becf0 unknown :-1 s=CLOSED pgs=396 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:57:21.286 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:21.268+0000 7f2d2b656b80 1 --2- 172.21.15.46:0/3819057316 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x5627a80c2f50 0x5627a80fdb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:57:21.286 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:21.268+0000 7f2d2b656b80 1 -- 172.21.15.46:0/3819057316 >> 172.21.15.46:0/3819057316 conn(0x5627a80b7fc0 msgr2=0x5627a8108680 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-05T18:57:21.286 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:21.268+0000 7f2d2b656b80 1 -- 172.21.15.46:0/3819057316 shutdown_connections 2023-07-05T18:57:21.286 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:21.268+0000 7f2d2b656b80 1 -- 172.21.15.46:0/3819057316 wait complete. 2023-07-05T18:57:21.287 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:21.268+0000 7f2d2b656b80 20 client.5325 trim_cache size 0 max 16384 2023-07-05T18:57:21.287 INFO:teuthology.orchestra.run.smithi046.stdout:{ 2023-07-05T18:57:21.287 INFO:teuthology.orchestra.run.smithi046.stdout: "cluster_fsid": "042652d3-d80c-4ad8-9366-3e94f2a0a512", 2023-07-05T18:57:21.287 INFO:teuthology.orchestra.run.smithi046.stdout: "whoami": 0, 2023-07-05T18:57:21.287 INFO:teuthology.orchestra.run.smithi046.stdout: "id": 5086, 2023-07-05T18:57:21.288 INFO:teuthology.orchestra.run.smithi046.stdout: "want_state": "up:active", 2023-07-05T18:57:21.288 INFO:teuthology.orchestra.run.smithi046.stdout: "state": "up:active", 2023-07-05T18:57:21.288 INFO:teuthology.orchestra.run.smithi046.stdout: "fs_name": "cephfs", 2023-07-05T18:57:21.288 INFO:teuthology.orchestra.run.smithi046.stdout: "rank_uptime": 5.9861961629999998, 2023-07-05T18:57:21.288 INFO:teuthology.orchestra.run.smithi046.stdout: "mdsmap_epoch": 15, 2023-07-05T18:57:21.288 INFO:teuthology.orchestra.run.smithi046.stdout: "osdmap_epoch": 35, 2023-07-05T18:57:21.288 INFO:teuthology.orchestra.run.smithi046.stdout: "osdmap_epoch_barrier": 35, 2023-07-05T18:57:21.289 INFO:teuthology.orchestra.run.smithi046.stdout: "uptime": 13.569111320999999 2023-07-05T18:57:21.289 INFO:teuthology.orchestra.run.smithi046.stdout:} 2023-07-05T18:57:21.290 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:21.268+0000 7f2d1f4d1700 1 -- 172.21.15.46:0/3337295427 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7f2cfc06ace0 msgr2=0x7f2cfc06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:57:21.290 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:21.268+0000 7f2d1f4d1700 1 --2- 172.21.15.46:0/3337295427 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7f2cfc06ace0 0x7f2cfc06d190 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f2d080011e0 tx=0x7f2d08009040 comp rx=0 tx=0).stop 2023-07-05T18:57:21.290 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:21.268+0000 7f2d1f4d1700 1 -- 172.21.15.46:0/3337295427 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2d1813f4c0 msgr2=0x7f2d18157220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:57:21.290 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:21.268+0000 7f2d1f4d1700 1 --2- 172.21.15.46:0/3337295427 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2d1813f4c0 0x7f2d18157220 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f2d1400ebe0 tx=0x7f2d14009e20 comp rx=0 tx=0).stop 2023-07-05T18:57:21.290 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:21.268+0000 7f2d1f4d1700 1 -- 172.21.15.46:0/3337295427 shutdown_connections 2023-07-05T18:57:21.291 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:21.268+0000 7f2d1f4d1700 1 --2- 172.21.15.46:0/3337295427 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7f2cfc06ace0 0x7f2cfc06d190 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:57:21.291 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:21.268+0000 7f2d1f4d1700 1 --2- 172.21.15.46:0/3337295427 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f2d18142480 0x7f2d18151180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:57:21.291 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:21.268+0000 7f2d1f4d1700 1 --2- 172.21.15.46:0/3337295427 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2d180b4710 0x7f2d1813a930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:57:21.291 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:21.268+0000 7f2d1f4d1700 1 --2- 172.21.15.46:0/3337295427 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2d1813f4c0 0x7f2d18157220 unknown :-1 s=CLOSED pgs=392 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:57:21.291 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:21.268+0000 7f2d1f4d1700 1 -- 172.21.15.46:0/3337295427 >> 172.21.15.46:0/3337295427 conn(0x7f2d1806af10 msgr2=0x7f2d18070e80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-05T18:57:21.291 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:21.268+0000 7f2d1f4d1700 1 -- 172.21.15.46:0/3337295427 shutdown_connections 2023-07-05T18:57:21.291 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:21.268+0000 7f2d1f4d1700 1 -- 172.21.15.46:0/3337295427 wait complete. 2023-07-05T18:57:21.292 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-07-05T18:57:21.423 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:21.421+0000 7f6b7ca44700 1 Processor -- start 2023-07-05T18:57:21.423 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:21.421+0000 7f6b7ca44700 1 -- start start 2023-07-05T18:57:21.425 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:21.422+0000 7f6b7ca44700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f6b7815c2f0 0x7f6b780cd2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:57:21.425 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:21.422+0000 7f6b7ca44700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f6b780b5ae0 0x7f6b780b5ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:57:21.425 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:21.422+0000 7f6b7ca44700 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6b780cd8c0 con 0x7f6b7815c6c0 2023-07-05T18:57:21.425 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:21.422+0000 7f6b7ca44700 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6b780d0990 con 0x7f6b7815c2f0 2023-07-05T18:57:21.425 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:21.422+0000 7f6b7ca44700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6b780d0c70 con 0x7f6b780b5ae0 2023-07-05T18:57:21.426 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:21.422+0000 7f6b7659c700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f6b7815c2f0 0x7f6b780cd2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:57:21.426 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:21.422+0000 7f6b7659c700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f6b7815c2f0 0x7f6b780cd2e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:59990/0 (socket says 172.21.15.46:59990) 2023-07-05T18:57:21.426 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:21.422+0000 7f6b7659c700 1 -- 172.21.15.46:0/784218120 learned_addr learned my addr 172.21.15.46:0/784218120 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-07-05T18:57:21.426 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:21.422+0000 7f6b76d9d700 1 --2- 172.21.15.46:0/784218120 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f6b780b5ae0 0x7f6b780b5ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:57:21.426 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:21.423+0000 7f6b7659c700 1 -- 172.21.15.46:0/784218120 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f6b780b5ae0 msgr2=0x7f6b780b5ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-05T18:57:21.427 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:21.423+0000 7f6b7659c700 1 --2- 172.21.15.46:0/784218120 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f6b780b5ae0 0x7f6b780b5ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:57:21.427 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:21.423+0000 7f6b7659c700 1 -- 172.21.15.46:0/784218120 >> v1:172.21.15.73:6789/0 conn(0x7f6b7815c6c0 legacy=0x7f6b7806c760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:57:21.427 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:21.423+0000 7f6b7659c700 1 -- 172.21.15.46:0/784218120 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6b780d0f50 con 0x7f6b7815c2f0 2023-07-05T18:57:21.428 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:21.423+0000 7f6b7659c700 1 --2- 172.21.15.46:0/784218120 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6b7815c2f0 0x7f6b780cd2e0 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f6b68009e50 tx=0x7f6b6800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e9796af19ed63fee server_cookie=0 in_seq=0 out_seq=0 2023-07-05T18:57:21.428 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:21.423+0000 7f6b7559a700 1 -- 172.21.15.46:0/784218120 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b6800e070 con 0x7f6b7815c2f0 2023-07-05T18:57:21.428 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:21.423+0000 7f6b7559a700 1 -- 172.21.15.46:0/784218120 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6b6800b910 con 0x7f6b7815c2f0 2023-07-05T18:57:21.428 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:21.423+0000 7f6b7559a700 1 -- 172.21.15.46:0/784218120 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b6800bcc0 con 0x7f6b7815c2f0 2023-07-05T18:57:21.430 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:21.423+0000 7f6b7ca44700 1 -- 172.21.15.46:0/784218120 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6b7815c2f0 msgr2=0x7f6b780cd2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:57:21.430 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:21.423+0000 7f6b7ca44700 1 --2- 172.21.15.46:0/784218120 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6b7815c2f0 0x7f6b780cd2e0 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f6b68009e50 tx=0x7f6b6800b330 comp rx=0 tx=0).stop 2023-07-05T18:57:21.430 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:21.423+0000 7f6b7ca44700 1 -- 172.21.15.46:0/784218120 shutdown_connections 2023-07-05T18:57:21.431 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:21.423+0000 7f6b7ca44700 1 --2- 172.21.15.46:0/784218120 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f6b780b5ae0 0x7f6b780b5ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:57:21.431 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:21.424+0000 7f6b7ca44700 1 --2- 172.21.15.46:0/784218120 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6b7815c2f0 0x7f6b780cd2e0 unknown :-1 s=CLOSED pgs=397 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:57:21.431 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:21.424+0000 7f6b7ca44700 1 -- 172.21.15.46:0/784218120 >> 172.21.15.46:0/784218120 conn(0x7f6b7806afa0 msgr2=0x7f6b780cf710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-05T18:57:21.431 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:21.424+0000 7f6b7ca44700 1 -- 172.21.15.46:0/784218120 shutdown_connections 2023-07-05T18:57:21.431 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:21.424+0000 7f6b7ca44700 1 -- 172.21.15.46:0/784218120 wait complete. 2023-07-05T18:57:21.431 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:21.425+0000 7f6b7ca44700 1 Processor -- start 2023-07-05T18:57:21.431 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:21.425+0000 7f6b7ca44700 1 -- start start 2023-07-05T18:57:21.432 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:21.426+0000 7f6b7ca44700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6b780b5ae0 0x7f6b781f5f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:57:21.432 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:21.426+0000 7f6b7ca44700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6b7815c2f0 0x7f6b780c7ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:57:21.432 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:21.426+0000 7f6b7ca44700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f6b7815c6c0 0x7f6b780c8400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:57:21.432 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:21.426+0000 7f6b7ca44700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b780cb8f0 con 0x7f6b7815c2f0 2023-07-05T18:57:21.432 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:21.426+0000 7f6b7ca44700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b780c7220 con 0x7f6b780b5ae0 2023-07-05T18:57:21.432 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:21.426+0000 7f6b7ca44700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6b781f6490 con 0x7f6b7815c6c0 2023-07-05T18:57:21.432 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:21.426+0000 7f6b75d9b700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6b7815c2f0 0x7f6b780c7ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:57:21.433 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:21.426+0000 7f6b75d9b700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6b7815c2f0 0x7f6b780c7ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:59998/0 (socket says 172.21.15.46:59998) 2023-07-05T18:57:21.433 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:21.426+0000 7f6b7659c700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6b780b5ae0 0x7f6b781f5f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:57:21.433 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:21.426+0000 7f6b75d9b700 1 -- 172.21.15.46:0/882431192 learned_addr learned my addr 172.21.15.46:0/882431192 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-07-05T18:57:21.433 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:21.427+0000 7f6b76d9d700 1 --2- 172.21.15.46:0/882431192 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f6b7815c6c0 0x7f6b780c8400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:57:21.433 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:21.427+0000 7f6b75d9b700 1 -- 172.21.15.46:0/882431192 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f6b7815c6c0 msgr2=0x7f6b780c8400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:57:21.433 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:21.427+0000 7f6b75d9b700 1 --2- 172.21.15.46:0/882431192 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f6b7815c6c0 0x7f6b780c8400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:57:21.433 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:21.427+0000 7f6b75d9b700 1 -- 172.21.15.46:0/882431192 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6b780b5ae0 msgr2=0x7f6b781f5f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:57:21.433 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:21.427+0000 7f6b75d9b700 1 --2- 172.21.15.46:0/882431192 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6b780b5ae0 0x7f6b781f5f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:57:21.434 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:21.427+0000 7f6b75d9b700 1 -- 172.21.15.46:0/882431192 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6b68009b30 con 0x7f6b7815c2f0 2023-07-05T18:57:21.434 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:21.427+0000 7f6b75d9b700 1 --2- 172.21.15.46:0/882431192 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6b7815c2f0 0x7f6b780c7ec0 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7f6b6000c450 tx=0x7f6b6000c760 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-05T18:57:21.434 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:21.427+0000 7f6b6effd700 1 -- 172.21.15.46:0/882431192 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b600052d0 con 0x7f6b7815c2f0 2023-07-05T18:57:21.434 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:21.427+0000 7f6b6effd700 1 -- 172.21.15.46:0/882431192 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6b60005430 con 0x7f6b7815c2f0 2023-07-05T18:57:21.434 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:21.427+0000 7f6b6effd700 1 -- 172.21.15.46:0/882431192 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b600038c0 con 0x7f6b7815c2f0 2023-07-05T18:57:21.434 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:21.427+0000 7f6b7ca44700 1 -- 172.21.15.46:0/882431192 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6b781f2f10 con 0x7f6b7815c2f0 2023-07-05T18:57:21.434 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:21.427+0000 7f6b7ca44700 1 -- 172.21.15.46:0/882431192 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6b780c6bd0 con 0x7f6b7815c2f0 2023-07-05T18:57:21.435 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:21.428+0000 7f6b7ca44700 1 -- 172.21.15.46:0/882431192 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6b7804e1d0 con 0x7f6b7815c2f0 2023-07-05T18:57:21.435 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:21.429+0000 7f6b6effd700 1 -- 172.21.15.46:0/882431192 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f6b60003a20 con 0x7f6b7815c2f0 2023-07-05T18:57:21.436 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:21.429+0000 7f6b6effd700 1 --2- 172.21.15.46:0/882431192 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7f6b5806ace0 0x7f6b5806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:57:21.436 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:21.429+0000 7f6b6effd700 1 -- 172.21.15.46:0/882431192 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f6b600886d0 con 0x7f6b7815c2f0 2023-07-05T18:57:21.436 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:21.429+0000 7f6b7659c700 1 --2- 172.21.15.46:0/882431192 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7f6b5806ace0 0x7f6b5806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:57:21.436 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:21.430+0000 7f6b7659c700 1 --2- 172.21.15.46:0/882431192 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7f6b5806ace0 0x7f6b5806d190 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f6b6800b370 tx=0x7f6b68009000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-05T18:57:21.436 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:21.434+0000 7f6b6effd700 1 -- 172.21.15.46:0/882431192 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f6b60053810 con 0x7f6b7815c2f0 2023-07-05T18:57:21.518 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-05T18:57:21.523 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-05T18:57:21.681 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:21.678+0000 7f6b7ca44700 1 -- 172.21.15.46:0/882431192 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f6b780d0130 con 0x7f6b7815c2f0 2023-07-05T18:57:21.682 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:21.679+0000 7f6b6effd700 1 -- 172.21.15.46:0/882431192 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v15) v1 ==== 53+0+73 (secure 0 0 0) 0x7f6b60056e30 con 0x7f6b7815c2f0 2023-07-05T18:57:21.682 INFO:teuthology.orchestra.run.smithi046.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-07-05T18:57:21.683 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:21.681+0000 7f6b7ca44700 1 -- 172.21.15.46:0/882431192 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7f6b5806ace0 msgr2=0x7f6b5806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:57:21.683 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:21.681+0000 7f6b7ca44700 1 --2- 172.21.15.46:0/882431192 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7f6b5806ace0 0x7f6b5806d190 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f6b6800b370 tx=0x7f6b68009000 comp rx=0 tx=0).stop 2023-07-05T18:57:21.683 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:21.681+0000 7f6b7ca44700 1 -- 172.21.15.46:0/882431192 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6b7815c2f0 msgr2=0x7f6b780c7ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:57:21.684 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:21.681+0000 7f6b7ca44700 1 --2- 172.21.15.46:0/882431192 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6b7815c2f0 0x7f6b780c7ec0 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7f6b6000c450 tx=0x7f6b6000c760 comp rx=0 tx=0).stop 2023-07-05T18:57:21.684 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:21.681+0000 7f6b7ca44700 1 -- 172.21.15.46:0/882431192 shutdown_connections 2023-07-05T18:57:21.684 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:21.681+0000 7f6b7ca44700 1 --2- 172.21.15.46:0/882431192 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7f6b5806ace0 0x7f6b5806d190 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:57:21.684 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:21.681+0000 7f6b7ca44700 1 --2- 172.21.15.46:0/882431192 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f6b7815c6c0 0x7f6b780c8400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:57:21.685 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:21.681+0000 7f6b7ca44700 1 --2- 172.21.15.46:0/882431192 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6b780b5ae0 0x7f6b781f5f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:57:21.685 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:21.681+0000 7f6b7ca44700 1 --2- 172.21.15.46:0/882431192 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6b7815c2f0 0x7f6b780c7ec0 unknown :-1 s=CLOSED pgs=398 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:57:21.685 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:21.681+0000 7f6b7ca44700 1 -- 172.21.15.46:0/882431192 >> 172.21.15.46:0/882431192 conn(0x7f6b7806afa0 msgr2=0x7f6b780d21f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-05T18:57:21.685 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:21.681+0000 7f6b7ca44700 1 -- 172.21.15.46:0/882431192 shutdown_connections 2023-07-05T18:57:21.685 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:21.681+0000 7f6b7ca44700 1 -- 172.21.15.46:0/882431192 wait complete. 2023-07-05T18:57:21.695 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-07-05T18:57:21.696 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-07-05T18:57:21.696 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi046.front.sepia.ceph.com 2023-07-05T18:57:21.697 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-07-05T18:57:21.697 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-07-05T18:57:21.697 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-07-05T18:57:21.697 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-07-05T18:57:21.698 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-07-05T18:57:21.698 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-07-05T18:57:21.698 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-05T18:57:21.699 DEBUG:teuthology.orchestra.run.smithi046:> ip addr 2023-07-05T18:57:21.724 INFO:teuthology.orchestra.run.smithi046.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-07-05T18:57:21.724 INFO:teuthology.orchestra.run.smithi046.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-07-05T18:57:21.725 INFO:teuthology.orchestra.run.smithi046.stdout: inet 127.0.0.1/8 scope host lo 2023-07-05T18:57:21.725 INFO:teuthology.orchestra.run.smithi046.stdout: valid_lft forever preferred_lft forever 2023-07-05T18:57:21.725 INFO:teuthology.orchestra.run.smithi046.stdout: inet6 ::1/128 scope host 2023-07-05T18:57:21.725 INFO:teuthology.orchestra.run.smithi046.stdout: valid_lft forever preferred_lft forever 2023-07-05T18:57:21.725 INFO:teuthology.orchestra.run.smithi046.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-07-05T18:57:21.725 INFO:teuthology.orchestra.run.smithi046.stdout: link/ether 0c:c4:7a:6b:f6:10 brd ff:ff:ff:ff:ff:ff 2023-07-05T18:57:21.725 INFO:teuthology.orchestra.run.smithi046.stdout:3: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2023-07-05T18:57:21.726 INFO:teuthology.orchestra.run.smithi046.stdout: link/ether 0c:c4:7a:bd:15:f8 brd ff:ff:ff:ff:ff:ff 2023-07-05T18:57:21.726 INFO:teuthology.orchestra.run.smithi046.stdout: inet 172.21.15.46/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2023-07-05T18:57:21.726 INFO:teuthology.orchestra.run.smithi046.stdout: valid_lft 42376sec preferred_lft 42376sec 2023-07-05T18:57:21.726 INFO:teuthology.orchestra.run.smithi046.stdout: inet6 fe80::ec4:7aff:febd:15f8/64 scope link 2023-07-05T18:57:21.726 INFO:teuthology.orchestra.run.smithi046.stdout: valid_lft forever preferred_lft forever 2023-07-05T18:57:21.726 INFO:teuthology.orchestra.run.smithi046.stdout:4: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-07-05T18:57:21.726 INFO:teuthology.orchestra.run.smithi046.stdout: link/ether 0c:c4:7a:6b:f6:11 brd ff:ff:ff:ff:ff:ff 2023-07-05T18:57:21.727 INFO:teuthology.orchestra.run.smithi046.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-07-05T18:57:21.727 INFO:teuthology.orchestra.run.smithi046.stdout: link/ether 0c:c4:7a:bd:15:f9 brd ff:ff:ff:ff:ff:ff 2023-07-05T18:57:21.727 INFO:teuthology.orchestra.run.smithi046.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-07-05T18:57:21.727 INFO:teuthology.orchestra.run.smithi046.stdout: link/ether 22:01:f2:63:4d:4e brd ff:ff:ff:ff:ff:ff 2023-07-05T18:57:21.727 INFO:teuthology.orchestra.run.smithi046.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-07-05T18:57:21.727 INFO:teuthology.orchestra.run.smithi046.stdout: valid_lft forever preferred_lft forever 2023-07-05T18:57:21.727 INFO:teuthology.orchestra.run.smithi046.stdout: inet6 fe80::208b:beff:fe32:f830/64 scope link 2023-07-05T18:57:21.727 INFO:teuthology.orchestra.run.smithi046.stdout: valid_lft forever preferred_lft forever 2023-07-05T18:57:21.728 INFO:teuthology.orchestra.run.smithi046.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-07-05T18:57:21.728 INFO:teuthology.orchestra.run.smithi046.stdout: link/ether 22:01:f2:63:4d:4e brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-07-05T18:57:21.728 INFO:teuthology.orchestra.run.smithi046.stdout: inet6 fe80::2001:f2ff:fe63:4d4e/64 scope link 2023-07-05T18:57:21.729 INFO:teuthology.orchestra.run.smithi046.stdout: valid_lft forever preferred_lft forever 2023-07-05T18:57:21.729 INFO:teuthology.orchestra.run.smithi046.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-07-05T18:57:21.729 INFO:teuthology.orchestra.run.smithi046.stdout: link/ether 72:77:0c:78:a7:20 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2023-07-05T18:57:21.729 INFO:teuthology.orchestra.run.smithi046.stdout: inet6 fe80::7077:cff:fe78:a720/64 scope link 2023-07-05T18:57:21.730 INFO:teuthology.orchestra.run.smithi046.stdout: valid_lft forever preferred_lft forever 2023-07-05T18:57:21.730 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-05T18:57:21.730 DEBUG:teuthology.orchestra.run.smithi046:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-07-05T18:57:21.798 INFO:teuthology.orchestra.run.smithi046.stdout:1 2023-07-05T18:57:21.800 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-05T18:57:21.801 DEBUG:teuthology.orchestra.run.smithi046:> route 2023-07-05T18:57:21.862 INFO:teuthology.orchestra.run.smithi046.stdout:Kernel IP routing table 2023-07-05T18:57:21.862 INFO:teuthology.orchestra.run.smithi046.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-07-05T18:57:21.862 INFO:teuthology.orchestra.run.smithi046.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2023-07-05T18:57:21.863 INFO:teuthology.orchestra.run.smithi046.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2023-07-05T18:57:21.863 INFO:teuthology.orchestra.run.smithi046.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-07-05T18:57:21.863 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-05T18:57:21.863 DEBUG:teuthology.orchestra.run.smithi046:> (cd / && exec bash -c ' 2023-07-05T18:57:21.864 DEBUG:teuthology.orchestra.run.smithi046:> set -e 2023-07-05T18:57:21.865 DEBUG:teuthology.orchestra.run.smithi046:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2023-07-05T18:57:21.866 DEBUG:teuthology.orchestra.run.smithi046:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2023-07-05T18:57:21.866 DEBUG:teuthology.orchestra.run.smithi046:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2023-07-05T18:57:21.866 DEBUG:teuthology.orchestra.run.smithi046:> ') 2023-07-05T18:57:21.972 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-05T18:57:21.972 DEBUG:teuthology.orchestra.run.smithi046:> ip netns list 2023-07-05T18:57:21.990 INFO:teuthology.orchestra.run.smithi046.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-07-05T18:57:21.991 INFO:teuthology.orchestra.run.smithi046.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-07-05T18:57:21.991 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-07-05T18:57:21.998 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-05T18:57:21.998 DEBUG:teuthology.orchestra.run.smithi046:> sudo ip link set brx.0 up 2023-07-05T18:57:22.064 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-07-05T18:57:22.064 DEBUG:teuthology.orchestra.run.smithi046:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-07-05T18:57:22.118 INFO:teuthology.orchestra.run.smithi046.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-07-05T18:57:22.119 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-07-05T18:57:22.122 DEBUG:teuthology.orchestra.run.smithi046:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-07-05T18:57:22.175 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2023-07-05T18:57:22.176 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-05T18:57:22.176 DEBUG:teuthology.orchestra.run.smithi046:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-07-05T18:57:22.263 INFO:teuthology.orchestra.run.smithi046.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-07-05T18:57:22.264 INFO:teuthology.orchestra.run.smithi046.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2023-07-05T18:57:22.264 INFO:teuthology.orchestra.run.smithi046.stdout:invalid new device string format 2023-07-05T18:57:22.273 INFO:teuthology.orchestra.run.smithi046.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-07-05T18:57:22.273 INFO:teuthology.orchestra.run.smithi046.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2023-07-05T18:57:22.273 INFO:teuthology.orchestra.run.smithi046.stdout:invalid new device string format 2023-07-05T18:57:22.274 INFO:teuthology.orchestra.run.smithi046.stdout:mount.ceph: resolved to: "172.21.15.46:3300,172.21.15.73:3300,172.21.15.73:3301" 2023-07-05T18:57:22.274 INFO:teuthology.orchestra.run.smithi046.stdout:mount.ceph: switching to using v1 address with old syntax 2023-07-05T18:57:22.345 INFO:teuthology.orchestra.run.smithi046.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-07-05T18:57:22.345 INFO:teuthology.orchestra.run.smithi046.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2023-07-05T18:57:22.345 INFO:teuthology.orchestra.run.smithi046.stdout:invalid new device string format 2023-07-05T18:57:22.346 INFO:teuthology.orchestra.run.smithi046.stdout:mount.ceph: resolved to: "172.21.15.46:3300,172.21.15.73:3300,172.21.15.73:3301" 2023-07-05T18:57:22.346 INFO:teuthology.orchestra.run.smithi046.stdout:mount.ceph: switching to using v1 address with old syntax 2023-07-05T18:57:22.346 INFO:teuthology.orchestra.run.smithi046.stdout:mount.ceph: resolved to: "172.21.15.46:6789,172.21.15.73:6789,172.21.15.73:6790" 2023-07-05T18:57:22.346 INFO:teuthology.orchestra.run.smithi046.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.46:6789,172.21.15.73:6789,172.21.15.73:6790:/ 2023-07-05T18:57:22.346 INFO:teuthology.orchestra.run.smithi046.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,key=0,fsid=042652d3-d80c-4ad8-9366-3e94f2a0a512" will pass to kernel 2023-07-05T18:57:22.350 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-07-05T18:57:22.353 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-05T18:57:22.353 DEBUG:teuthology.orchestra.run.smithi046:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-07-05T18:57:22.393 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-05T18:57:22.394 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-07-05T18:57:22.486 INFO:teuthology.orchestra.run.smithi046.stdout:client5245 2023-07-05T18:57:22.487 DEBUG:teuthology.orchestra.run.smithi046:> set -ex 2023-07-05T18:57:22.487 DEBUG:teuthology.orchestra.run.smithi046:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-05T18:57:22.509 DEBUG:teuthology.orchestra.run.smithi046:> mktemp -d --suffix=xfstests-dev 2023-07-05T18:57:22.568 INFO:teuthology.orchestra.run.smithi046.stdout:/tmp/tmp.rlt8E1h3iVxfstests-dev 2023-07-05T18:57:22.569 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-05T18:57:22.570 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec sudo chmod a+rx /tmp/tmp.rlt8E1h3iVxfstests-dev) 2023-07-05T18:57:22.641 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-05T18:57:22.641 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec git clone https://git.ceph.com/xfstests-dev.git --depth 1 /tmp/tmp.rlt8E1h3iVxfstests-dev) 2023-07-05T18:57:22.704 INFO:teuthology.orchestra.run.smithi046.stderr:Cloning into '/tmp/tmp.rlt8E1h3iVxfstests-dev'... 2023-07-05T18:57:23.346 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-05T18:57:23.347 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir test) 2023-07-05T18:57:23.408 DEBUG:teuthology.orchestra.run.smithi046:> mktemp -d --suffix=test 2023-07-05T18:57:23.465 INFO:teuthology.orchestra.run.smithi046.stdout:/tmp/tmp.3cPGfI4dtCtest 2023-07-05T18:57:23.465 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-05T18:57:23.465 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir scratch) 2023-07-05T18:57:23.524 DEBUG:teuthology.orchestra.run.smithi046:> mktemp -d --suffix=scratch 2023-07-05T18:57:23.580 INFO:teuthology.orchestra.run.smithi046.stdout:/tmp/tmp.KrMG67MsYpscratch 2023-07-05T18:57:23.581 INFO:tasks.cephfs.xfstests_dev:distro and version detected is "rhel" and "8.6". 2023-07-05T18:57:23.581 DEBUG:teuthology.orchestra.run.smithi046:> sudo yum install -y acl attr automake bc dbench dump e2fsprogs fio gawk gcc indent libtool lvm2 make psmisc quota sed xfsdump xfsprogs libacl-devel libattr-devel libaio-devel libuuid-devel xfsprogs-devel python2 sqlite xfsprogs-qa-devel 2023-07-05T18:57:24.003 INFO:teuthology.orchestra.run.smithi046.stdout:Updating Subscription Management repositories. 2023-07-05T18:57:25.595 INFO:teuthology.orchestra.run.smithi046.stdout:Last metadata expiration check: 0:04:07 ago on Wed 05 Jul 2023 06:53:18 PM UTC. 2023-07-05T18:57:27.015 INFO:teuthology.orchestra.run.smithi046.stdout:Package acl-2.2.53-1.el8.x86_64 is already installed. 2023-07-05T18:57:27.016 INFO:teuthology.orchestra.run.smithi046.stdout:Package attr-2.4.48-3.el8.x86_64 is already installed. 2023-07-05T18:57:27.020 INFO:teuthology.orchestra.run.smithi046.stdout:Package automake-1.16.1-7.el8.noarch is already installed. 2023-07-05T18:57:27.021 INFO:teuthology.orchestra.run.smithi046.stdout:Package bc-1.07.1-5.el8.x86_64 is already installed. 2023-07-05T18:57:27.021 INFO:teuthology.orchestra.run.smithi046.stdout:Package dbench-4.0-20.el8.x86_64 is already installed. 2023-07-05T18:57:27.022 INFO:teuthology.orchestra.run.smithi046.stdout:Package e2fsprogs-1.45.6-4.el8.x86_64 is already installed. 2023-07-05T18:57:27.024 INFO:teuthology.orchestra.run.smithi046.stdout:Package gawk-4.2.1-4.el8.x86_64 is already installed. 2023-07-05T18:57:27.031 INFO:teuthology.orchestra.run.smithi046.stdout:Package gcc-8.5.0-10.1.el8_6.x86_64 is already installed. 2023-07-05T18:57:27.031 INFO:teuthology.orchestra.run.smithi046.stdout:Package libtool-2.4.6-25.el8.x86_64 is already installed. 2023-07-05T18:57:27.031 INFO:teuthology.orchestra.run.smithi046.stdout:Package lvm2-8:2.03.14-3.el8_6.2.x86_64 is already installed. 2023-07-05T18:57:27.032 INFO:teuthology.orchestra.run.smithi046.stdout:Package make-1:4.2.1-11.el8.x86_64 is already installed. 2023-07-05T18:57:27.032 INFO:teuthology.orchestra.run.smithi046.stdout:Package psmisc-23.1-5.el8.x86_64 is already installed. 2023-07-05T18:57:27.032 INFO:teuthology.orchestra.run.smithi046.stdout:Package quota-1:4.04-14.el8.x86_64 is already installed. 2023-07-05T18:57:27.034 INFO:teuthology.orchestra.run.smithi046.stdout:Package sed-4.5-5.el8.x86_64 is already installed. 2023-07-05T18:57:27.035 INFO:teuthology.orchestra.run.smithi046.stdout:Package xfsdump-3.1.8-4.el8.x86_64 is already installed. 2023-07-05T18:57:27.036 INFO:teuthology.orchestra.run.smithi046.stdout:Package xfsprogs-5.0.0-10.el8.x86_64 is already installed. 2023-07-05T18:57:27.036 INFO:teuthology.orchestra.run.smithi046.stdout:Package libacl-devel-2.2.53-1.el8.x86_64 is already installed. 2023-07-05T18:57:27.038 INFO:teuthology.orchestra.run.smithi046.stdout:Package libattr-devel-2.4.48-3.el8.x86_64 is already installed. 2023-07-05T18:57:27.042 INFO:teuthology.orchestra.run.smithi046.stdout:Package libaio-devel-0.3.112-1.el8.x86_64 is already installed. 2023-07-05T18:57:27.042 INFO:teuthology.orchestra.run.smithi046.stdout:Package libuuid-devel-2.32.1-35.el8.x86_64 is already installed. 2023-07-05T18:57:27.042 INFO:teuthology.orchestra.run.smithi046.stdout:Package xfsprogs-devel-5.0.0-10.el8.x86_64 is already installed. 2023-07-05T18:57:27.044 INFO:teuthology.orchestra.run.smithi046.stdout:Package sqlite-3.26.0-15.el8.x86_64 is already installed. 2023-07-05T18:57:27.048 INFO:teuthology.orchestra.run.smithi046.stdout:Package xfsprogs-5.0.0-10.el8.x86_64 is already installed. 2023-07-05T18:57:27.172 INFO:teuthology.orchestra.run.smithi046.stdout:Dependencies resolved. 2023-07-05T18:57:27.177 INFO:teuthology.orchestra.run.smithi046.stdout:==================================================================================================================== 2023-07-05T18:57:27.177 INFO:teuthology.orchestra.run.smithi046.stdout: Package Arch Version Repository Size 2023-07-05T18:57:27.177 INFO:teuthology.orchestra.run.smithi046.stdout:==================================================================================================================== 2023-07-05T18:57:27.177 INFO:teuthology.orchestra.run.smithi046.stdout:Installing: 2023-07-05T18:57:27.177 INFO:teuthology.orchestra.run.smithi046.stdout: dump x86_64 1:0.4-0.36.b46.el8 rhel-8-for-x86_64-baseos-rpms 164 k 2023-07-05T18:57:27.177 INFO:teuthology.orchestra.run.smithi046.stdout: fio x86_64 3.19-3.el8 rhel-8-for-x86_64-appstream-rpms 538 k 2023-07-05T18:57:27.178 INFO:teuthology.orchestra.run.smithi046.stdout: indent x86_64 2.2.13-2.el8 epel 187 k 2023-07-05T18:57:27.178 INFO:teuthology.orchestra.run.smithi046.stdout: python2 x86_64 2.7.18-10.module+el8.6.0+14191+7fdd52cd rhel-8-for-x86_64-appstream-rpms 110 k 2023-07-05T18:57:27.178 INFO:teuthology.orchestra.run.smithi046.stdout:Upgrading: 2023-07-05T18:57:27.178 INFO:teuthology.orchestra.run.smithi046.stdout: sqlite x86_64 3.26.0-16.el8_6 rhel-8-for-x86_64-baseos-rpms 668 k 2023-07-05T18:57:27.178 INFO:teuthology.orchestra.run.smithi046.stdout: sqlite-libs x86_64 3.26.0-16.el8_6 rhel-8-for-x86_64-baseos-rpms 581 k 2023-07-05T18:57:27.178 INFO:teuthology.orchestra.run.smithi046.stdout:Installing dependencies: 2023-07-05T18:57:27.178 INFO:teuthology.orchestra.run.smithi046.stdout: daxctl-libs x86_64 71.1-3.el8 rhel-8-for-x86_64-baseos-rpms 42 k 2023-07-05T18:57:27.179 INFO:teuthology.orchestra.run.smithi046.stdout: libpmemblk x86_64 1.6.1-1.el8 rhel-8-for-x86_64-appstream-rpms 92 k 2023-07-05T18:57:27.179 INFO:teuthology.orchestra.run.smithi046.stdout: ndctl-libs x86_64 71.1-3.el8 rhel-8-for-x86_64-baseos-rpms 79 k 2023-07-05T18:57:27.180 INFO:teuthology.orchestra.run.smithi046.stdout: python2-libs x86_64 2.7.18-10.module+el8.6.0+14191+7fdd52cd rhel-8-for-x86_64-appstream-rpms 6.0 M 2023-07-05T18:57:27.180 INFO:teuthology.orchestra.run.smithi046.stdout: python2-pip-wheel noarch 9.0.3-19.module+el8.6.0+13001+ad200bd9 rhel-8-for-x86_64-appstream-rpms 892 k 2023-07-05T18:57:27.180 INFO:teuthology.orchestra.run.smithi046.stdout: python2-setuptools-wheel noarch 39.0.1-13.module+el8.4.0+9442+27d0e81c rhel-8-for-x86_64-appstream-rpms 287 k 2023-07-05T18:57:27.181 INFO:teuthology.orchestra.run.smithi046.stdout: python2-wheel-wheel noarch 1:0.31.1-3.module+el8.5.0+12203+77770ab7 rhel-8-for-x86_64-appstream-rpms 45 k 2023-07-05T18:57:27.181 INFO:teuthology.orchestra.run.smithi046.stdout: rmt x86_64 2:1.5.3-13.el8 rhel-8-for-x86_64-baseos-rpms 51 k 2023-07-05T18:57:27.181 INFO:teuthology.orchestra.run.smithi046.stdout:Installing weak dependencies: 2023-07-05T18:57:27.181 INFO:teuthology.orchestra.run.smithi046.stdout: python2-pip noarch 9.0.3-19.module+el8.6.0+13001+ad200bd9 rhel-8-for-x86_64-appstream-rpms 1.6 M 2023-07-05T18:57:27.181 INFO:teuthology.orchestra.run.smithi046.stdout: python2-setuptools noarch 39.0.1-13.module+el8.4.0+9442+27d0e81c rhel-8-for-x86_64-appstream-rpms 642 k 2023-07-05T18:57:27.181 INFO:teuthology.orchestra.run.smithi046.stdout:Enabling module streams: 2023-07-05T18:57:27.181 INFO:teuthology.orchestra.run.smithi046.stdout: python27 2.7 2023-07-05T18:57:27.182 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T18:57:27.182 INFO:teuthology.orchestra.run.smithi046.stdout:Transaction Summary 2023-07-05T18:57:27.182 INFO:teuthology.orchestra.run.smithi046.stdout:==================================================================================================================== 2023-07-05T18:57:27.182 INFO:teuthology.orchestra.run.smithi046.stdout:Install 14 Packages 2023-07-05T18:57:27.182 INFO:teuthology.orchestra.run.smithi046.stdout:Upgrade 2 Packages 2023-07-05T18:57:27.182 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T18:57:27.182 INFO:teuthology.orchestra.run.smithi046.stdout:Total download size: 12 M 2023-07-05T18:57:27.183 INFO:teuthology.orchestra.run.smithi046.stdout:Downloading Packages: 2023-07-05T18:57:27.373 INFO:teuthology.orchestra.run.smithi046.stdout:(1/16): indent-2.2.13-2.el8.x86_64.rpm 1.1 MB/s | 187 kB 00:00 2023-07-05T18:57:27.431 INFO:teuthology.orchestra.run.smithi046.stdout:(2/16): rmt-1.5.3-13.el8.x86_64.rpm 232 kB/s | 51 kB 00:00 2023-07-05T18:57:27.474 INFO:teuthology.orchestra.run.smithi046.stdout:(3/16): dump-0.4-0.36.b46.el8.x86_64.rpm 621 kB/s | 164 kB 00:00 2023-07-05T18:57:27.682 INFO:teuthology.orchestra.run.smithi046.stdout:(4/16): ndctl-libs-71.1-3.el8.x86_64.rpm 314 kB/s | 79 kB 00:00 2023-07-05T18:57:27.699 INFO:teuthology.orchestra.run.smithi046.stdout:(5/16): daxctl-libs-71.1-3.el8.x86_64.rpm 128 kB/s | 42 kB 00:00 2023-07-05T18:57:27.732 INFO:teuthology.orchestra.run.smithi046.stdout:(6/16): python2-setuptools-wheel-39.0.1-13.modu 1.1 MB/s | 287 kB 00:00 2023-07-05T18:57:27.866 INFO:teuthology.orchestra.run.smithi046.stdout:(7/16): python2-setuptools-39.0.1-13.module+el8 3.4 MB/s | 642 kB 00:00 2023-07-05T18:57:27.916 INFO:teuthology.orchestra.run.smithi046.stdout:(8/16): python2-wheel-wheel-0.31.1-3.module+el8 205 kB/s | 45 kB 00:00 2023-07-05T18:57:27.986 INFO:teuthology.orchestra.run.smithi046.stdout:(9/16): fio-3.19-3.el8.x86_64.rpm 2.1 MB/s | 538 kB 00:00 2023-07-05T18:57:28.091 INFO:teuthology.orchestra.run.smithi046.stdout:(10/16): python2-2.7.18-10.module+el8.6.0+14191 628 kB/s | 110 kB 00:00 2023-07-05T18:57:28.117 INFO:teuthology.orchestra.run.smithi046.stdout:(11/16): libpmemblk-1.6.1-1.el8.x86_64.rpm 366 kB/s | 92 kB 00:00 2023-07-05T18:57:28.242 INFO:teuthology.orchestra.run.smithi046.stdout:(12/16): python2-libs-2.7.18-10.module+el8.6.0+ 23 MB/s | 6.0 MB 00:00 2023-07-05T18:57:28.342 INFO:teuthology.orchestra.run.smithi046.stdout:(13/16): python2-pip-9.0.3-19.module+el8.6.0+13 6.5 MB/s | 1.6 MB 00:00 2023-07-05T18:57:28.418 INFO:teuthology.orchestra.run.smithi046.stdout:(14/16): python2-pip-wheel-9.0.3-19.module+el8. 2.9 MB/s | 892 kB 00:00 2023-07-05T18:57:28.593 INFO:teuthology.orchestra.run.smithi046.stdout:(15/16): sqlite-3.26.0-16.el8_6.x86_64.rpm 1.9 MB/s | 668 kB 00:00 2023-07-05T18:57:28.661 INFO:teuthology.orchestra.run.smithi046.stdout:(16/16): sqlite-libs-3.26.0-16.el8_6.x86_64.rpm 1.8 MB/s | 581 kB 00:00 2023-07-05T18:57:28.662 INFO:teuthology.orchestra.run.smithi046.stdout:-------------------------------------------------------------------------------- 2023-07-05T18:57:28.662 INFO:teuthology.orchestra.run.smithi046.stdout:Total 8.0 MB/s | 12 MB 00:01 2023-07-05T18:57:28.881 INFO:teuthology.orchestra.run.smithi046.stdout:Running transaction check 2023-07-05T18:57:28.937 INFO:teuthology.orchestra.run.smithi046.stdout:Transaction check succeeded. 2023-07-05T18:57:28.937 INFO:teuthology.orchestra.run.smithi046.stdout:Running transaction test 2023-07-05T18:57:29.133 INFO:teuthology.orchestra.run.smithi046.stdout:Transaction test succeeded. 2023-07-05T18:57:29.138 INFO:teuthology.orchestra.run.smithi046.stdout:Running transaction 2023-07-05T18:57:29.835 INFO:teuthology.orchestra.run.smithi046.stdout: Preparing : 1/1 2023-07-05T18:57:30.050 INFO:teuthology.orchestra.run.smithi046.stdout: Upgrading : sqlite-libs-3.26.0-16.el8_6.x86_64 1/18 2023-07-05T18:57:30.159 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : daxctl-libs-71.1-3.el8.x86_64 2/18 2023-07-05T18:57:30.230 INFO:teuthology.orchestra.run.smithi046.stdout: Running scriptlet: daxctl-libs-71.1-3.el8.x86_64 2/18 2023-07-05T18:57:30.433 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : ndctl-libs-71.1-3.el8.x86_64 3/18 2023-07-05T18:57:30.497 INFO:teuthology.orchestra.run.smithi046.stdout: Running scriptlet: ndctl-libs-71.1-3.el8.x86_64 3/18 2023-07-05T18:57:30.650 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : libpmemblk-1.6.1-1.el8.x86_64 4/18 2023-07-05T18:57:30.735 INFO:teuthology.orchestra.run.smithi046.stdout: Running scriptlet: libpmemblk-1.6.1-1.el8.x86_64 4/18 2023-07-05T18:57:30.846 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python2-pip-wheel-9.0.3-19.module+el8.6.0+13001+ad 5/18 2023-07-05T18:57:31.102 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python2-setuptools-wheel-39.0.1-13.module+el8.4.0+ 6/18 2023-07-05T18:57:31.732 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python2-setuptools-39.0.1-13.module+el8.4.0+9442+2 7/18 2023-07-05T18:57:31.966 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python2-pip-9.0.3-19.module+el8.6.0+13001+ad200bd9 8/18 2023-07-05T18:57:32.133 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python2-2.7.18-10.module+el8.6.0+14191+7fdd52cd.x8 9/18 2023-07-05T18:57:33.353 INFO:teuthology.orchestra.run.smithi046.stdout: Running scriptlet: python2-2.7.18-10.module+el8.6.0+14191+7fdd52cd.x8 9/18 2023-07-05T18:57:33.631 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python2-libs-2.7.18-10.module+el8.6.0+14191+7fdd52 10/18 2023-07-05T18:57:33.792 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : rmt-2:1.5.3-13.el8.x86_64 11/18 2023-07-05T18:57:34.072 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : dump-1:0.4-0.36.b46.el8.x86_64 12/18 2023-07-05T18:57:34.324 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : fio-3.19-3.el8.x86_64 13/18 2023-07-05T18:57:34.520 INFO:teuthology.orchestra.run.smithi046.stdout: Upgrading : sqlite-3.26.0-16.el8_6.x86_64 14/18 2023-07-05T18:57:34.688 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python2-wheel-wheel-1:0.31.1-3.module+el8.5.0+1220 15/18 2023-07-05T18:57:34.842 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : indent-2.2.13-2.el8.x86_64 16/18 2023-07-05T18:57:34.966 INFO:teuthology.orchestra.run.smithi046.stdout: Cleanup : sqlite-3.26.0-15.el8.x86_64 17/18 2023-07-05T18:57:35.125 INFO:teuthology.orchestra.run.smithi046.stdout: Cleanup : sqlite-libs-3.26.0-15.el8.x86_64 18/18 2023-07-05T18:57:35.415 INFO:teuthology.orchestra.run.smithi046.stdout: Running scriptlet: sqlite-libs-3.26.0-15.el8.x86_64 18/18 2023-07-05T18:57:35.415 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : indent-2.2.13-2.el8.x86_64 1/18 2023-07-05T18:57:35.415 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : dump-1:0.4-0.36.b46.el8.x86_64 2/18 2023-07-05T18:57:35.415 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : rmt-2:1.5.3-13.el8.x86_64 3/18 2023-07-05T18:57:35.416 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : daxctl-libs-71.1-3.el8.x86_64 4/18 2023-07-05T18:57:35.416 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : ndctl-libs-71.1-3.el8.x86_64 5/18 2023-07-05T18:57:35.416 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python2-setuptools-wheel-39.0.1-13.module+el8.4.0+ 6/18 2023-07-05T18:57:35.416 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python2-setuptools-39.0.1-13.module+el8.4.0+9442+2 7/18 2023-07-05T18:57:35.416 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python2-wheel-wheel-1:0.31.1-3.module+el8.5.0+1220 8/18 2023-07-05T18:57:35.416 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : fio-3.19-3.el8.x86_64 9/18 2023-07-05T18:57:35.416 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : libpmemblk-1.6.1-1.el8.x86_64 10/18 2023-07-05T18:57:35.417 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python2-2.7.18-10.module+el8.6.0+14191+7fdd52cd.x8 11/18 2023-07-05T18:57:35.417 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python2-libs-2.7.18-10.module+el8.6.0+14191+7fdd52 12/18 2023-07-05T18:57:35.417 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python2-pip-9.0.3-19.module+el8.6.0+13001+ad200bd9 13/18 2023-07-05T18:57:35.417 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python2-pip-wheel-9.0.3-19.module+el8.6.0+13001+ad 14/18 2023-07-05T18:57:35.417 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : sqlite-3.26.0-16.el8_6.x86_64 15/18 2023-07-05T18:57:35.418 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : sqlite-3.26.0-15.el8.x86_64 16/18 2023-07-05T18:57:35.418 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : sqlite-libs-3.26.0-16.el8_6.x86_64 17/18 2023-07-05T18:57:36.682 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : sqlite-libs-3.26.0-15.el8.x86_64 18/18 2023-07-05T18:57:36.682 INFO:teuthology.orchestra.run.smithi046.stdout:Last metadata expiration check: 0:04:18 ago on Wed 05 Jul 2023 06:53:18 PM UTC. 2023-07-05T18:57:46.021 INFO:teuthology.orchestra.run.smithi046.stdout:Installed products updated. 2023-07-05T18:57:46.227 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T18:57:46.228 INFO:teuthology.orchestra.run.smithi046.stdout:Upgraded: 2023-07-05T18:57:46.228 INFO:teuthology.orchestra.run.smithi046.stdout: sqlite-3.26.0-16.el8_6.x86_64 sqlite-libs-3.26.0-16.el8_6.x86_64 2023-07-05T18:57:46.228 INFO:teuthology.orchestra.run.smithi046.stdout:Installed: 2023-07-05T18:57:46.228 INFO:teuthology.orchestra.run.smithi046.stdout: daxctl-libs-71.1-3.el8.x86_64 2023-07-05T18:57:46.228 INFO:teuthology.orchestra.run.smithi046.stdout: dump-1:0.4-0.36.b46.el8.x86_64 2023-07-05T18:57:46.228 INFO:teuthology.orchestra.run.smithi046.stdout: fio-3.19-3.el8.x86_64 2023-07-05T18:57:46.229 INFO:teuthology.orchestra.run.smithi046.stdout: indent-2.2.13-2.el8.x86_64 2023-07-05T18:57:46.229 INFO:teuthology.orchestra.run.smithi046.stdout: libpmemblk-1.6.1-1.el8.x86_64 2023-07-05T18:57:46.229 INFO:teuthology.orchestra.run.smithi046.stdout: ndctl-libs-71.1-3.el8.x86_64 2023-07-05T18:57:46.229 INFO:teuthology.orchestra.run.smithi046.stdout: python2-2.7.18-10.module+el8.6.0+14191+7fdd52cd.x86_64 2023-07-05T18:57:46.229 INFO:teuthology.orchestra.run.smithi046.stdout: python2-libs-2.7.18-10.module+el8.6.0+14191+7fdd52cd.x86_64 2023-07-05T18:57:46.229 INFO:teuthology.orchestra.run.smithi046.stdout: python2-pip-9.0.3-19.module+el8.6.0+13001+ad200bd9.noarch 2023-07-05T18:57:46.229 INFO:teuthology.orchestra.run.smithi046.stdout: python2-pip-wheel-9.0.3-19.module+el8.6.0+13001+ad200bd9.noarch 2023-07-05T18:57:46.230 INFO:teuthology.orchestra.run.smithi046.stdout: python2-setuptools-39.0.1-13.module+el8.4.0+9442+27d0e81c.noarch 2023-07-05T18:57:46.230 INFO:teuthology.orchestra.run.smithi046.stdout: python2-setuptools-wheel-39.0.1-13.module+el8.4.0+9442+27d0e81c.noarch 2023-07-05T18:57:46.230 INFO:teuthology.orchestra.run.smithi046.stdout: python2-wheel-wheel-1:0.31.1-3.module+el8.5.0+12203+77770ab7.noarch 2023-07-05T18:57:46.230 INFO:teuthology.orchestra.run.smithi046.stdout: rmt-2:1.5.3-13.el8.x86_64 2023-07-05T18:57:46.230 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T18:57:46.230 INFO:teuthology.orchestra.run.smithi046.stdout:Complete! 2023-07-05T18:57:46.398 DEBUG:teuthology.orchestra.run.smithi046:> sudo useradd -m fsgqa 2023-07-05T18:57:46.429 INFO:teuthology.orchestra.run.smithi046.stderr:useradd: user 'fsgqa' already exists 2023-07-05T18:57:46.430 DEBUG:teuthology.orchestra.run:got remote process result: 9 2023-07-05T18:57:46.431 DEBUG:teuthology.orchestra.run.smithi046:> sudo groupadd fsgqa 2023-07-05T18:57:46.498 INFO:teuthology.orchestra.run.smithi046.stderr:groupadd: group 'fsgqa' already exists 2023-07-05T18:57:46.499 DEBUG:teuthology.orchestra.run:got remote process result: 9 2023-07-05T18:57:46.500 DEBUG:teuthology.orchestra.run.smithi046:> sudo useradd fsgqa2 2023-07-05T18:57:47.550 DEBUG:teuthology.orchestra.run.smithi046:> sudo useradd 123456-fsgqa 2023-07-05T18:57:48.360 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json mon dump 2023-07-05T18:57:48.504 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:48.502+0000 7f76368a4700 1 Processor -- start 2023-07-05T18:57:48.504 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:48.502+0000 7f76368a4700 1 -- start start 2023-07-05T18:57:48.505 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:48.503+0000 7f76368a4700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f76300ce2d0 0x7f763015de90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:57:48.506 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:48.503+0000 7f76368a4700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f7630071090 0x7f763006a270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:57:48.506 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:48.503+0000 7f76368a4700 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f76300cd580 con 0x7f7630069e00 2023-07-05T18:57:48.506 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:48.503+0000 7f76368a4700 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f76300cc760 con 0x7f7630071090 2023-07-05T18:57:48.506 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:48.503+0000 7f76368a4700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f763006a7b0 con 0x7f76300ce2d0 2023-07-05T18:57:48.506 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:48.503+0000 7f7634e41700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f7630071090 0x7f763006a270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:57:48.506 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:48.503+0000 7f762ffff700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f76300ce2d0 0x7f763015de90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:57:48.506 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:48.503+0000 7f7634e41700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f7630071090 0x7f763006a270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.46:59512/0 (socket says 172.21.15.46:59512) 2023-07-05T18:57:48.507 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:48.503+0000 7f762f7fe700 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7f7630069e00 0x7f7630070980 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.46:45216/0 (socket says 172.21.15.46:45216) 2023-07-05T18:57:48.507 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:48.503+0000 7f7634e41700 1 -- 172.21.15.46:0/3989242761 learned_addr learned my addr 172.21.15.46:0/3989242761 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-07-05T18:57:48.507 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:48.504+0000 7f7634e41700 1 -- 172.21.15.46:0/3989242761 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f76300ce2d0 msgr2=0x7f763015de90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-05T18:57:48.507 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:48.504+0000 7f7634e41700 1 --2- 172.21.15.46:0/3989242761 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f76300ce2d0 0x7f763015de90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:57:48.507 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:48.504+0000 7f7634e41700 1 -- 172.21.15.46:0/3989242761 >> v1:172.21.15.73:6789/0 conn(0x7f7630069e00 legacy=0x7f7630070980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:57:48.508 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:48.504+0000 7f7634e41700 1 -- 172.21.15.46:0/3989242761 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f76300cc970 con 0x7f7630071090 2023-07-05T18:57:48.510 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:48.504+0000 7f7634e41700 1 --2- 172.21.15.46:0/3989242761 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7630071090 0x7f763006a270 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f7628009e50 tx=0x7f762800b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a690da41459111d5 server_cookie=0 in_seq=0 out_seq=0 2023-07-05T18:57:48.510 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:48.504+0000 7f762effd700 1 -- 172.21.15.46:0/3989242761 <== mon.1 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f762800e070 con 0x7f7630071090 2023-07-05T18:57:48.510 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:48.504+0000 7f762effd700 1 -- 172.21.15.46:0/3989242761 <== mon.1 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f762800b910 con 0x7f7630071090 2023-07-05T18:57:48.511 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:48.504+0000 7f762effd700 1 -- 172.21.15.46:0/3989242761 <== mon.1 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f762800bcc0 con 0x7f7630071090 2023-07-05T18:57:48.511 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:48.505+0000 7f76368a4700 1 -- 172.21.15.46:0/3989242761 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7630071090 msgr2=0x7f763006a270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:57:48.511 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:48.505+0000 7f76368a4700 1 --2- 172.21.15.46:0/3989242761 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7630071090 0x7f763006a270 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f7628009e50 tx=0x7f762800b330 comp rx=0 tx=0).stop 2023-07-05T18:57:48.511 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:48.505+0000 7f76368a4700 1 -- 172.21.15.46:0/3989242761 shutdown_connections 2023-07-05T18:57:48.512 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:48.505+0000 7f76368a4700 1 --2- 172.21.15.46:0/3989242761 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f76300ce2d0 0x7f763015de90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:57:48.512 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:48.505+0000 7f76368a4700 1 --2- 172.21.15.46:0/3989242761 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7630071090 0x7f763006a270 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:57:48.512 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:48.505+0000 7f76368a4700 1 -- 172.21.15.46:0/3989242761 >> 172.21.15.46:0/3989242761 conn(0x7f76300b0fc0 msgr2=0x7f76300ce860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-05T18:57:48.512 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:48.505+0000 7f76368a4700 1 -- 172.21.15.46:0/3989242761 shutdown_connections 2023-07-05T18:57:48.512 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:48.505+0000 7f76368a4700 1 -- 172.21.15.46:0/3989242761 wait complete. 2023-07-05T18:57:48.512 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:48.506+0000 7f76368a4700 1 Processor -- start 2023-07-05T18:57:48.513 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:48.506+0000 7f76368a4700 1 -- start start 2023-07-05T18:57:48.513 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:48.507+0000 7f76368a4700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7630069e00 0x7f76301e4d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:57:48.513 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:48.507+0000 7f76368a4700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7630071090 0x7f76300acae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:57:48.513 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:48.507+0000 7f76368a4700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f76300ce2d0 0x7f763014e380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:57:48.513 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:48.507+0000 7f76368a4700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76301e52a0 con 0x7f7630069e00 2023-07-05T18:57:48.513 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:48.507+0000 7f76368a4700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76301f61b0 con 0x7f7630071090 2023-07-05T18:57:48.513 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:48.507+0000 7f76368a4700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f76301f6490 con 0x7f76300ce2d0 2023-07-05T18:57:48.513 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:48.507+0000 7f762ffff700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7630069e00 0x7f76301e4d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:57:48.514 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:48.507+0000 7f762ffff700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7630069e00 0x7f76301e4d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:60032/0 (socket says 172.21.15.46:60032) 2023-07-05T18:57:48.514 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:48.507+0000 7f762ffff700 1 -- 172.21.15.46:0/3639483047 learned_addr learned my addr 172.21.15.46:0/3639483047 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-07-05T18:57:48.514 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:48.507+0000 7f762f7fe700 1 --2- 172.21.15.46:0/3639483047 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7630071090 0x7f76300acae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:57:48.514 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:48.507+0000 7f7634e41700 1 --2- 172.21.15.46:0/3639483047 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f76300ce2d0 0x7f763014e380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:57:48.514 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:48.507+0000 7f762ffff700 1 -- 172.21.15.46:0/3639483047 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f76300ce2d0 msgr2=0x7f763014e380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:57:48.514 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:48.507+0000 7f762ffff700 1 --2- 172.21.15.46:0/3639483047 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f76300ce2d0 0x7f763014e380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:57:48.514 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:48.507+0000 7f762ffff700 1 -- 172.21.15.46:0/3639483047 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7630071090 msgr2=0x7f76300acae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:57:48.515 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:48.507+0000 7f762ffff700 1 --2- 172.21.15.46:0/3639483047 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7630071090 0x7f76300acae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:57:48.515 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:48.507+0000 7f762ffff700 1 -- 172.21.15.46:0/3639483047 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7628009b30 con 0x7f7630069e00 2023-07-05T18:57:48.515 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:48.507+0000 7f762f7fe700 1 --2- 172.21.15.46:0/3639483047 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7630071090 0x7f76300acae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-05T18:57:48.515 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:48.508+0000 7f762ffff700 1 --2- 172.21.15.46:0/3639483047 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7630069e00 0x7f76301e4d60 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7f762000e870 tx=0x7f762000ec30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-05T18:57:48.515 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:48.508+0000 7f762cff9700 1 -- 172.21.15.46:0/3639483047 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7620009590 con 0x7f7630069e00 2023-07-05T18:57:48.515 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:48.508+0000 7f76368a4700 1 -- 172.21.15.46:0/3639483047 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f76301f6770 con 0x7f7630069e00 2023-07-05T18:57:48.515 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:48.508+0000 7f762cff9700 1 -- 172.21.15.46:0/3639483047 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f762000ee70 con 0x7f7630069e00 2023-07-05T18:57:48.515 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:48.508+0000 7f762cff9700 1 -- 172.21.15.46:0/3639483047 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f762000ca50 con 0x7f7630069e00 2023-07-05T18:57:48.516 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:48.508+0000 7f76368a4700 1 -- 172.21.15.46:0/3639483047 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f76301f6b00 con 0x7f7630069e00 2023-07-05T18:57:48.517 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:48.509+0000 7f76368a4700 1 -- 172.21.15.46:0/3639483047 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f76301f6900 con 0x7f7630069e00 2023-07-05T18:57:48.517 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:48.509+0000 7f762cff9700 1 -- 172.21.15.46:0/3639483047 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f762000cbb0 con 0x7f7630069e00 2023-07-05T18:57:48.517 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:48.510+0000 7f762cff9700 1 --2- 172.21.15.46:0/3639483047 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7f761c06ace0 0x7f761c06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:57:48.517 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:48.510+0000 7f762cff9700 1 -- 172.21.15.46:0/3639483047 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f76200894a0 con 0x7f7630069e00 2023-07-05T18:57:48.518 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:48.510+0000 7f762f7fe700 1 --2- 172.21.15.46:0/3639483047 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7f761c06ace0 0x7f761c06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:57:48.518 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:48.510+0000 7f762f7fe700 1 --2- 172.21.15.46:0/3639483047 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7f761c06ace0 0x7f761c06d190 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f7630152a90 tx=0x7f7624007df0 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-05T18:57:48.518 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:48.514+0000 7f762cff9700 1 -- 172.21.15.46:0/3639483047 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f7620057fd0 con 0x7f7630069e00 2023-07-05T18:57:48.812 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:48.806+0000 7f76368a4700 1 -- 172.21.15.46:0/3639483047 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7f76301f5f40 con 0x7f7630069e00 2023-07-05T18:57:48.812 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:48.807+0000 7f762cff9700 1 -- 172.21.15.46:0/3639483047 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+1268 (secure 0 0 0) 0x7f7620021510 con 0x7f7630069e00 2023-07-05T18:57:48.813 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T18:57:48.813 INFO:teuthology.orchestra.run.smithi046.stdout:{"epoch":1,"fsid":"042652d3-d80c-4ad8-9366-3e94f2a0a512","modified":"2023-07-05T18:55:23.304543Z","created":"2023-07-05T18:55:23.304543Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:3300","nonce":0},{"type":"v1","addr":"172.21.15.46:6789","nonce":0}]},"addr":"172.21.15.46:6789/0","public_addr":"172.21.15.46:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:3300","nonce":0},{"type":"v1","addr":"172.21.15.73:6789","nonce":0}]},"addr":"172.21.15.73:6789/0","public_addr":"172.21.15.73:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:3301","nonce":0},{"type":"v1","addr":"172.21.15.73:6790","nonce":0}]},"addr":"172.21.15.73:6790/0","public_addr":"172.21.15.73:6790/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0,1,2]} 2023-07-05T18:57:48.813 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:48.809+0000 7f76368a4700 1 -- 172.21.15.46:0/3639483047 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7f761c06ace0 msgr2=0x7f761c06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:57:48.814 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:48.809+0000 7f76368a4700 1 --2- 172.21.15.46:0/3639483047 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7f761c06ace0 0x7f761c06d190 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f7630152a90 tx=0x7f7624007df0 comp rx=0 tx=0).stop 2023-07-05T18:57:48.814 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:48.809+0000 7f76368a4700 1 -- 172.21.15.46:0/3639483047 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7630069e00 msgr2=0x7f76301e4d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:57:48.814 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:48.809+0000 7f76368a4700 1 --2- 172.21.15.46:0/3639483047 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7630069e00 0x7f76301e4d60 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7f762000e870 tx=0x7f762000ec30 comp rx=0 tx=0).stop 2023-07-05T18:57:48.814 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:48.809+0000 7f76368a4700 1 -- 172.21.15.46:0/3639483047 shutdown_connections 2023-07-05T18:57:48.814 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:48.809+0000 7f76368a4700 1 --2- 172.21.15.46:0/3639483047 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7f761c06ace0 0x7f761c06d190 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:57:48.814 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:48.809+0000 7f76368a4700 1 --2- 172.21.15.46:0/3639483047 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f76300ce2d0 0x7f763014e380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:57:48.815 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:48.809+0000 7f76368a4700 1 --2- 172.21.15.46:0/3639483047 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7630069e00 0x7f76301e4d60 unknown :-1 s=CLOSED pgs=399 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:57:48.815 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:48.809+0000 7f76368a4700 1 --2- 172.21.15.46:0/3639483047 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7630071090 0x7f76300acae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:57:48.815 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:48.809+0000 7f76368a4700 1 -- 172.21.15.46:0/3639483047 >> 172.21.15.46:0/3639483047 conn(0x7f76300b0fc0 msgr2=0x7f76300cb1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-05T18:57:48.815 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:48.809+0000 7f76368a4700 1 -- 172.21.15.46:0/3639483047 shutdown_connections 2023-07-05T18:57:48.815 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:48.809+0000 7f76368a4700 1 -- 172.21.15.46:0/3639483047 wait complete. 2023-07-05T18:57:48.815 INFO:teuthology.orchestra.run.smithi046.stderr:dumped monmap epoch 1 2023-07-05T18:57:48.825 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth get-or-create client.admin 2023-07-05T18:57:48.977 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:48.975+0000 7f593293f700 1 Processor -- start 2023-07-05T18:57:48.978 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:48.975+0000 7f593293f700 1 -- start start 2023-07-05T18:57:48.986 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:48.976+0000 7f593293f700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f592c0cede0 0x7f592c0b1ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:57:48.987 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:48.976+0000 7f593293f700 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f592c0ada20 con 0x7f592c15a610 2023-07-05T18:57:48.987 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:48.976+0000 7f593293f700 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f592c0add00 con 0x7f592c0aeac0 2023-07-05T18:57:48.987 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:48.976+0000 7f593293f700 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f592c0b2410 con 0x7f592c0cede0 2023-07-05T18:57:48.987 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:48.976+0000 7f592bfff700 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7f592c15a610 0x7f592c0ce6d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:59312/0 (socket says 172.21.15.46:59312) 2023-07-05T18:57:48.987 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:48.976+0000 7f592bfff700 1 -- 172.21.15.46:0/2370716607 learned_addr learned my addr 172.21.15.46:0/2370716607 (peer_addr_for_me v1:172.21.15.46:0/0) 2023-07-05T18:57:48.987 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:48.977+0000 7f592b7fe700 1 --2- 172.21.15.46:0/2370716607 >> v2:172.21.15.73:3300/0 conn(0x7f592c0cede0 0x7f592c0b1ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:57:48.987 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:48.977+0000 7f592affd700 1 -- 172.21.15.46:0/2370716607 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3498557990 0 0) 0x7f592c0ada20 con 0x7f592c15a610 2023-07-05T18:57:48.988 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:48.977+0000 7f592affd700 1 -- 172.21.15.46:0/2370716607 --> v1:172.21.15.46:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f59140035b0 con 0x7f592c15a610 2023-07-05T18:57:48.988 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:48.977+0000 7f592affd700 1 -- 172.21.15.46:0/2370716607 <== mon.0 v1:172.21.15.46:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 71036621 0 0) 0x7f59140035b0 con 0x7f592c15a610 2023-07-05T18:57:48.995 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:48.977+0000 7f592affd700 1 -- 172.21.15.46:0/2370716607 >> v2:172.21.15.73:3300/0 conn(0x7f592c0cede0 msgr2=0x7f592c0b1ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-05T18:57:49.003 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:48.977+0000 7f592affd700 1 --2- 172.21.15.46:0/2370716607 >> v2:172.21.15.73:3300/0 conn(0x7f592c0cede0 0x7f592c0b1ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:57:49.003 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:48.977+0000 7f592affd700 1 -- 172.21.15.46:0/2370716607 >> v1:172.21.15.73:6789/0 conn(0x7f592c0aeac0 legacy=0x7f592c0aeee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:57:49.004 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:48.977+0000 7f592affd700 1 -- 172.21.15.46:0/2370716607 --> v1:172.21.15.46:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f592c0adfe0 con 0x7f592c15a610 2023-07-05T18:57:49.004 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:48.977+0000 7f592affd700 1 -- 172.21.15.46:0/2370716607 <== mon.0 v1:172.21.15.46:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2195585215 0 0) 0x7f591c005120 con 0x7f592c15a610 2023-07-05T18:57:49.004 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:48.977+0000 7f592affd700 1 -- 172.21.15.46:0/2370716607 >> v1:172.21.15.46:6789/0 conn(0x7f592c15a610 legacy=0x7f592c0ce6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:57:49.004 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:48.977+0000 7f592affd700 1 --2- 172.21.15.46:0/2370716607 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f5914003a00 0x7f5914003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:57:49.004 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:48.977+0000 7f592affd700 1 --2- 172.21.15.46:0/2370716607 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5914004850 0x7f5914004cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:57:49.004 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:48.977+0000 7f592affd700 1 --2- 172.21.15.46:0/2370716607 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5914005200 0x7f591400ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:57:49.004 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:48.977+0000 7f592affd700 1 -- 172.21.15.46:0/2370716607 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f592c0b2410 con 0x7f5914004850 2023-07-05T18:57:49.005 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:48.977+0000 7f592affd700 1 -- 172.21.15.46:0/2370716607 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f591400c080 con 0x7f5914005200 2023-07-05T18:57:49.005 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:48.977+0000 7f592affd700 1 -- 172.21.15.46:0/2370716607 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f591400c240 con 0x7f5914003a00 2023-07-05T18:57:49.005 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:48.977+0000 7f592b7fe700 1 --2- 172.21.15.46:0/2370716607 >> v2:172.21.15.73:3300/0 conn(0x7f592c0cede0 0x7f592c0b1ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-05T18:57:49.005 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:48.977+0000 7f592b7fe700 1 --2- 172.21.15.46:0/2370716607 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5914004850 0x7f5914004cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:57:49.005 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:48.977+0000 7f592bfff700 1 --2- 172.21.15.46:0/2370716607 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f5914003a00 0x7f5914003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:57:49.005 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:48.977+0000 7f5930edc700 1 --2- 172.21.15.46:0/2370716607 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5914005200 0x7f591400ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:57:49.005 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:48.977+0000 7f592b7fe700 1 -- 172.21.15.46:0/2370716607 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f5914003a00 msgr2=0x7f5914003e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-05T18:57:49.005 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:48.977+0000 7f592b7fe700 1 --2- 172.21.15.46:0/2370716607 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f5914003a00 0x7f5914003e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:57:49.006 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:48.977+0000 7f592b7fe700 1 -- 172.21.15.46:0/2370716607 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5914005200 msgr2=0x7f591400ba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-05T18:57:49.006 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:48.977+0000 7f592b7fe700 1 --2- 172.21.15.46:0/2370716607 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5914005200 0x7f591400ba10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:57:49.006 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:48.977+0000 7f592b7fe700 1 -- 172.21.15.46:0/2370716607 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f59140035b0 con 0x7f5914004850 2023-07-05T18:57:49.006 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:48.977+0000 7f592bfff700 1 --2- 172.21.15.46:0/2370716607 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f5914003a00 0x7f5914003e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-05T18:57:49.006 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:48.977+0000 7f5930edc700 1 --2- 172.21.15.46:0/2370716607 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5914005200 0x7f591400ba10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-05T18:57:49.006 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:48.977+0000 7f5930edc700 1 -- 172.21.15.46:0/2370716607 reap_dead start 2023-07-05T18:57:49.006 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:48.978+0000 7f592b7fe700 1 --2- 172.21.15.46:0/2370716607 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5914004850 0x7f5914004cc0 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f5920009ce0 tx=0x7f5914005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2bc2f63cea5d14d2 server_cookie=0 in_seq=0 out_seq=0 2023-07-05T18:57:49.007 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:48.978+0000 7f592affd700 1 -- 172.21.15.46:0/2370716607 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5920004030 con 0x7f5914004850 2023-07-05T18:57:49.007 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:48.978+0000 7f592affd700 1 -- 172.21.15.46:0/2370716607 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5920004190 con 0x7f5914004850 2023-07-05T18:57:49.007 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:48.978+0000 7f592affd700 1 -- 172.21.15.46:0/2370716607 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5920004520 con 0x7f5914004850 2023-07-05T18:57:49.007 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:48.978+0000 7f593293f700 1 -- 172.21.15.46:0/2370716607 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5914004850 msgr2=0x7f5914004cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:57:49.007 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:48.978+0000 7f593293f700 1 --2- 172.21.15.46:0/2370716607 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5914004850 0x7f5914004cc0 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f5920009ce0 tx=0x7f5914005880 comp rx=0 tx=0).stop 2023-07-05T18:57:49.007 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:48.978+0000 7f593293f700 1 -- 172.21.15.46:0/2370716607 shutdown_connections 2023-07-05T18:57:49.007 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:48.978+0000 7f593293f700 1 --2- 172.21.15.46:0/2370716607 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5914004850 0x7f5914004cc0 unknown :-1 s=CLOSED pgs=401 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:57:49.016 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:48.978+0000 7f593293f700 1 -- 172.21.15.46:0/2370716607 >> 172.21.15.46:0/2370716607 conn(0x7f592c099e00 msgr2=0x7f592c0d0b00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-05T18:57:49.016 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:48.978+0000 7f593293f700 1 -- 172.21.15.46:0/2370716607 shutdown_connections 2023-07-05T18:57:49.018 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:48.978+0000 7f593293f700 1 -- 172.21.15.46:0/2370716607 wait complete. 2023-07-05T18:57:49.018 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:48.980+0000 7f593293f700 1 Processor -- start 2023-07-05T18:57:49.019 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:48.980+0000 7f593293f700 1 -- start start 2023-07-05T18:57:49.022 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:48.980+0000 7f593293f700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f5914004850 0x7f592c0c4560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:57:49.022 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:48.980+0000 7f593293f700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f592c14ded0 0x7f592c1f16f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:57:49.022 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:48.981+0000 7f593293f700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f592c0b5b00 0x7f592c0b5f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:57:49.022 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:48.981+0000 7f593293f700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f592c0b64b0 con 0x7f592c0b5b00 2023-07-05T18:57:49.023 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:48.981+0000 7f593293f700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f592c1f5c50 con 0x7f592c14ded0 2023-07-05T18:57:49.023 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:48.981+0000 7f593293f700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f592c06cf20 con 0x7f5914004850 2023-07-05T18:57:49.023 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:48.981+0000 7f5930edc700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f592c0b5b00 0x7f592c0b5f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:57:49.024 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:48.981+0000 7f5930edc700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f592c0b5b00 0x7f592c0b5f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:60056/0 (socket says 172.21.15.46:60056) 2023-07-05T18:57:49.024 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:48.981+0000 7f5930edc700 1 -- 172.21.15.46:0/759548696 learned_addr learned my addr 172.21.15.46:0/759548696 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-07-05T18:57:49.024 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:48.981+0000 7f592b7fe700 1 --2- 172.21.15.46:0/759548696 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f592c14ded0 0x7f592c1f16f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:57:49.025 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:48.981+0000 7f592bfff700 1 --2- 172.21.15.46:0/759548696 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f5914004850 0x7f592c0c4560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:57:49.025 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:48.981+0000 7f5930edc700 1 -- 172.21.15.46:0/759548696 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f5914004850 msgr2=0x7f592c0c4560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:57:49.025 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:48.981+0000 7f5930edc700 1 --2- 172.21.15.46:0/759548696 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f5914004850 0x7f592c0c4560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:57:49.026 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:48.981+0000 7f5930edc700 1 -- 172.21.15.46:0/759548696 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f592c14ded0 msgr2=0x7f592c1f16f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:57:49.026 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:48.981+0000 7f5930edc700 1 --2- 172.21.15.46:0/759548696 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f592c14ded0 0x7f592c1f16f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:57:49.027 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:48.981+0000 7f5930edc700 1 -- 172.21.15.46:0/759548696 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f592c1f5320 con 0x7f592c0b5b00 2023-07-05T18:57:49.027 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:48.981+0000 7f592b7fe700 1 --2- 172.21.15.46:0/759548696 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f592c14ded0 0x7f592c1f16f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-05T18:57:49.043 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:48.981+0000 7f592bfff700 1 --2- 172.21.15.46:0/759548696 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f5914004850 0x7f592c0c4560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-05T18:57:49.044 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:48.981+0000 7f5930edc700 1 --2- 172.21.15.46:0/759548696 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f592c0b5b00 0x7f592c0b5f70 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f592c067180 tx=0x7f592400ee00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-05T18:57:49.044 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:48.981+0000 7f5928ff9700 1 -- 172.21.15.46:0/759548696 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5924003c10 con 0x7f592c0b5b00 2023-07-05T18:57:49.046 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:48.981+0000 7f5928ff9700 1 -- 172.21.15.46:0/759548696 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5924003d70 con 0x7f592c0b5b00 2023-07-05T18:57:49.046 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:48.981+0000 7f593293f700 1 -- 172.21.15.46:0/759548696 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f592c1f5600 con 0x7f592c0b5b00 2023-07-05T18:57:49.046 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:48.981+0000 7f5928ff9700 1 -- 172.21.15.46:0/759548696 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59240052d0 con 0x7f592c0b5b00 2023-07-05T18:57:49.046 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:48.981+0000 7f593293f700 1 -- 172.21.15.46:0/759548696 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f592c1f60e0 con 0x7f592c0b5b00 2023-07-05T18:57:49.047 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:48.983+0000 7f593293f700 1 -- 172.21.15.46:0/759548696 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f592c0672e0 con 0x7f592c0b5b00 2023-07-05T18:57:49.047 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:48.983+0000 7f5928ff9700 1 -- 172.21.15.46:0/759548696 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f5924005430 con 0x7f592c0b5b00 2023-07-05T18:57:49.047 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:48.983+0000 7f5928ff9700 1 --2- 172.21.15.46:0/759548696 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7f591806ace0 0x7f591806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T18:57:49.047 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:48.983+0000 7f5928ff9700 1 -- 172.21.15.46:0/759548696 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f59240894f0 con 0x7f592c0b5b00 2023-07-05T18:57:49.047 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:48.984+0000 7f592bfff700 1 --2- 172.21.15.46:0/759548696 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7f591806ace0 0x7f591806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T18:57:49.047 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:48.984+0000 7f592bfff700 1 --2- 172.21.15.46:0/759548696 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7f591806ace0 0x7f591806d190 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f591c005740 tx=0x7f591c009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-05T18:57:49.048 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:48.988+0000 7f5928ff9700 1 -- 172.21.15.46:0/759548696 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f59240545a0 con 0x7f592c0b5b00 2023-07-05T18:57:49.290 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:49.287+0000 7f593293f700 1 -- 172.21.15.46:0/759548696 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "auth get-or-create", "entity": "client.admin"} v 0) v1 -- 0x7f592c0672e0 con 0x7f592c0b5b00 2023-07-05T18:57:49.290 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:49.287+0000 7f5928ff9700 1 -- 172.21.15.46:0/759548696 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "auth get-or-create", "entity": "client.admin"}]=0 v13) v1 ==== 92+0+63 (secure 0 0 0) 0x7f5924057bc0 con 0x7f592c0b5b00 2023-07-05T18:57:49.293 INFO:teuthology.orchestra.run.smithi046.stdout:[client.admin] 2023-07-05T18:57:49.293 INFO:teuthology.orchestra.run.smithi046.stdout: key = AQCbvKVkpp1TIhAAvJTELoeH8wkIFqjtppg17w== 2023-07-05T18:57:49.295 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:49.289+0000 7f593293f700 1 -- 172.21.15.46:0/759548696 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7f591806ace0 msgr2=0x7f591806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:57:49.295 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:49.289+0000 7f593293f700 1 --2- 172.21.15.46:0/759548696 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7f591806ace0 0x7f591806d190 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f591c005740 tx=0x7f591c009040 comp rx=0 tx=0).stop 2023-07-05T18:57:49.296 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:49.289+0000 7f593293f700 1 -- 172.21.15.46:0/759548696 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f592c0b5b00 msgr2=0x7f592c0b5f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T18:57:49.299 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:49.289+0000 7f593293f700 1 --2- 172.21.15.46:0/759548696 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f592c0b5b00 0x7f592c0b5f70 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f592c067180 tx=0x7f592400ee00 comp rx=0 tx=0).stop 2023-07-05T18:57:49.299 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:49.289+0000 7f593293f700 1 -- 172.21.15.46:0/759548696 shutdown_connections 2023-07-05T18:57:49.299 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:49.289+0000 7f593293f700 1 --2- 172.21.15.46:0/759548696 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7f591806ace0 0x7f591806d190 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:57:49.300 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:49.289+0000 7f593293f700 1 --2- 172.21.15.46:0/759548696 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f592c0b5b00 0x7f592c0b5f70 unknown :-1 s=CLOSED pgs=402 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:57:49.300 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:49.289+0000 7f593293f700 1 --2- 172.21.15.46:0/759548696 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f5914004850 0x7f592c0c4560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:57:49.300 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:49.289+0000 7f593293f700 1 --2- 172.21.15.46:0/759548696 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f592c14ded0 0x7f592c1f16f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T18:57:49.300 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:49.289+0000 7f593293f700 1 -- 172.21.15.46:0/759548696 >> 172.21.15.46:0/759548696 conn(0x7f592c099e00 msgr2=0x7f592c0b0ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-05T18:57:49.301 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:49.290+0000 7f593293f700 1 -- 172.21.15.46:0/759548696 shutdown_connections 2023-07-05T18:57:49.301 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-05T18:57:49.290+0000 7f593293f700 1 -- 172.21.15.46:0/759548696 wait complete. 2023-07-05T18:57:49.305 DEBUG:teuthology.orchestra.run.smithi046:> set -ex 2023-07-05T18:57:49.305 DEBUG:teuthology.orchestra.run.smithi046:> sudo dd of=/tmp/tmp.rlt8E1h3iVxfstests-dev/local.config 2023-07-05T18:57:49.347 INFO:tasks.cephfs.xfstests_dev:local.config's contents - export FSTYP=ceph export TEST_DEV=172.21.15.46:6789:/test export TEST_DIR=/tmp/tmp.3cPGfI4dtCtest export SCRATCH_DEV=172.21.15.46:6789:/scratch export SCRATCH_MNT=/tmp/tmp.KrMG67MsYpscratch export CEPHFS_MOUNT_OPTIONS="-o name=admin,secret=AQCbvKVkpp1TIhAAvJTELoeH8wkIFqjtppg17w==" 2023-07-05T18:57:49.347 DEBUG:teuthology.orchestra.run.smithi046:> set -ex 2023-07-05T18:57:49.348 DEBUG:teuthology.orchestra.run.smithi046:> sudo dd of=/tmp/tmp.rlt8E1h3iVxfstests-dev/ceph.exclude 2023-07-05T18:57:49.414 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.rlt8E1h3iVxfstests-dev && exec sudo make) 2023-07-05T18:57:49.498 INFO:teuthology.orchestra.run.smithi046.stdout:libtoolize -cfi 2023-07-05T18:57:49.816 INFO:teuthology.orchestra.run.smithi046.stdout:libtoolize: putting auxiliary files in '.'. 2023-07-05T18:57:49.816 INFO:teuthology.orchestra.run.smithi046.stdout:libtoolize: copying file './config.guess' 2023-07-05T18:57:49.819 INFO:teuthology.orchestra.run.smithi046.stdout:libtoolize: copying file './config.sub' 2023-07-05T18:57:49.823 INFO:teuthology.orchestra.run.smithi046.stdout:libtoolize: copying file './install-sh' 2023-07-05T18:57:49.827 INFO:teuthology.orchestra.run.smithi046.stdout:libtoolize: copying file './ltmain.sh' 2023-07-05T18:57:49.848 INFO:teuthology.orchestra.run.smithi046.stdout:libtoolize: putting macros in AC_CONFIG_MACRO_DIRS, 'm4'. 2023-07-05T18:57:49.849 INFO:teuthology.orchestra.run.smithi046.stdout:libtoolize: copying file 'm4/libtool.m4' 2023-07-05T18:57:49.852 INFO:teuthology.orchestra.run.smithi046.stdout:libtoolize: copying file 'm4/ltoptions.m4' 2023-07-05T18:57:49.857 INFO:teuthology.orchestra.run.smithi046.stdout:libtoolize: copying file 'm4/ltsugar.m4' 2023-07-05T18:57:49.862 INFO:teuthology.orchestra.run.smithi046.stdout:libtoolize: copying file 'm4/ltversion.m4' 2023-07-05T18:57:49.866 INFO:teuthology.orchestra.run.smithi046.stdout:libtoolize: copying file 'm4/lt~obsolete.m4' 2023-07-05T18:57:49.872 INFO:teuthology.orchestra.run.smithi046.stdout:libtoolize: Consider adding '-I m4' to ACLOCAL_AMFLAGS in Makefile.am. 2023-07-05T18:57:49.875 INFO:teuthology.orchestra.run.smithi046.stdout:cp include/install-sh . 2023-07-05T18:57:49.875 INFO:teuthology.orchestra.run.smithi046.stdout:aclocal -I m4 2023-07-05T18:57:51.059 INFO:teuthology.orchestra.run.smithi046.stdout:autoheader 2023-07-05T18:57:51.372 INFO:teuthology.orchestra.run.smithi046.stdout:autoconf 2023-07-05T18:57:51.538 INFO:teuthology.orchestra.run.smithi046.stdout:./configure \ 2023-07-05T18:57:51.538 INFO:teuthology.orchestra.run.smithi046.stdout: --libexecdir=/usr/lib \ 2023-07-05T18:57:51.539 INFO:teuthology.orchestra.run.smithi046.stdout: --exec_prefix=/var/lib 2023-07-05T18:57:51.580 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-05T18:57:51.584 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-05T18:57:51.978 INFO:teuthology.orchestra.run.smithi046.stdout:checking build system type... x86_64-pc-linux-gnu 2023-07-05T18:57:51.978 INFO:teuthology.orchestra.run.smithi046.stdout:checking host system type... x86_64-pc-linux-gnu 2023-07-05T18:57:51.979 INFO:teuthology.orchestra.run.smithi046.stdout:checking how to print strings... printf 2023-07-05T18:57:51.979 INFO:teuthology.orchestra.run.smithi046.stdout:checking for gcc... gcc 2023-07-05T18:57:52.081 INFO:teuthology.orchestra.run.smithi046.stdout:checking whether the C compiler works... yes 2023-07-05T18:57:52.081 INFO:teuthology.orchestra.run.smithi046.stdout:checking for C compiler default output file name... a.out 2023-07-05T18:57:52.110 INFO:teuthology.orchestra.run.smithi046.stdout:checking for suffix of executables... 2023-07-05T18:57:52.154 INFO:teuthology.orchestra.run.smithi046.stdout:checking whether we are cross compiling... no 2023-07-05T18:57:52.171 INFO:teuthology.orchestra.run.smithi046.stdout:checking for suffix of object files... o 2023-07-05T18:57:52.187 INFO:teuthology.orchestra.run.smithi046.stdout:checking whether we are using the GNU C compiler... yes 2023-07-05T18:57:52.205 INFO:teuthology.orchestra.run.smithi046.stdout:checking whether gcc accepts -g... yes 2023-07-05T18:57:52.232 INFO:teuthology.orchestra.run.smithi046.stdout:checking for gcc option to accept ISO C89... none needed 2023-07-05T18:57:52.236 INFO:teuthology.orchestra.run.smithi046.stdout:checking for a sed that does not truncate output... /bin/sed 2023-07-05T18:57:52.237 INFO:teuthology.orchestra.run.smithi046.stdout:checking for grep that handles long lines and -e... /bin/grep 2023-07-05T18:57:52.237 INFO:teuthology.orchestra.run.smithi046.stdout:checking for egrep... /bin/grep -E 2023-07-05T18:57:52.239 INFO:teuthology.orchestra.run.smithi046.stdout:checking for fgrep... /bin/grep -F 2023-07-05T18:57:52.243 INFO:teuthology.orchestra.run.smithi046.stdout:checking for ld used by gcc... /bin/ld 2023-07-05T18:57:52.243 INFO:teuthology.orchestra.run.smithi046.stdout:checking if the linker (/bin/ld) is GNU ld... yes 2023-07-05T18:57:52.251 INFO:teuthology.orchestra.run.smithi046.stdout:checking for BSD- or MS-compatible name lister (nm)... /bin/nm -B 2023-07-05T18:57:52.273 INFO:teuthology.orchestra.run.smithi046.stdout:checking the name lister (/bin/nm -B) interface... BSD nm 2023-07-05T18:57:52.273 INFO:teuthology.orchestra.run.smithi046.stdout:checking whether ln -s works... yes 2023-07-05T18:57:52.274 INFO:teuthology.orchestra.run.smithi046.stdout:checking the maximum length of command line arguments... 1572864 2023-07-05T18:57:52.276 INFO:teuthology.orchestra.run.smithi046.stdout:checking how to convert x86_64-pc-linux-gnu file names to x86_64-pc-linux-gnu format... func_convert_file_noop 2023-07-05T18:57:52.277 INFO:teuthology.orchestra.run.smithi046.stdout:checking how to convert x86_64-pc-linux-gnu file names to toolchain format... func_convert_file_noop 2023-07-05T18:57:52.277 INFO:teuthology.orchestra.run.smithi046.stdout:checking for /bin/ld option to reload object files... -r 2023-07-05T18:57:52.277 INFO:teuthology.orchestra.run.smithi046.stdout:checking for objdump... objdump 2023-07-05T18:57:52.277 INFO:teuthology.orchestra.run.smithi046.stdout:checking how to recognize dependent libraries... pass_all 2023-07-05T18:57:52.278 INFO:teuthology.orchestra.run.smithi046.stdout:checking for dlltool... no 2023-07-05T18:57:52.278 INFO:teuthology.orchestra.run.smithi046.stdout:checking how to associate runtime and link libraries... printf %s\n 2023-07-05T18:57:52.279 INFO:teuthology.orchestra.run.smithi046.stdout:checking for ar... ar 2023-07-05T18:57:52.300 INFO:teuthology.orchestra.run.smithi046.stdout:checking for archiver @FILE support... @ 2023-07-05T18:57:52.300 INFO:teuthology.orchestra.run.smithi046.stdout:checking for strip... strip 2023-07-05T18:57:52.301 INFO:teuthology.orchestra.run.smithi046.stdout:checking for ranlib... ranlib 2023-07-05T18:57:52.301 INFO:teuthology.orchestra.run.smithi046.stdout:checking for gawk... gawk 2023-07-05T18:57:52.353 INFO:teuthology.orchestra.run.smithi046.stdout:checking command to parse /bin/nm -B output from gcc object... ok 2023-07-05T18:57:52.355 INFO:teuthology.orchestra.run.smithi046.stdout:checking for sysroot... no 2023-07-05T18:57:52.357 INFO:teuthology.orchestra.run.smithi046.stdout:checking for a working dd... /bin/dd 2023-07-05T18:57:52.360 INFO:teuthology.orchestra.run.smithi046.stdout:checking how to truncate binary pipes... /bin/dd bs=4096 count=1 2023-07-05T18:57:52.373 INFO:teuthology.orchestra.run.smithi046.stdout:checking for mt... no 2023-07-05T18:57:52.374 INFO:teuthology.orchestra.run.smithi046.stdout:checking if : is a manifest tool... no 2023-07-05T18:57:52.401 INFO:teuthology.orchestra.run.smithi046.stdout:checking how to run the C preprocessor... gcc -E 2023-07-05T18:57:52.554 INFO:teuthology.orchestra.run.smithi046.stdout:checking for ANSI C header files... yes 2023-07-05T18:57:52.571 INFO:teuthology.orchestra.run.smithi046.stdout:checking for sys/types.h... yes 2023-07-05T18:57:52.595 INFO:teuthology.orchestra.run.smithi046.stdout:checking for sys/stat.h... yes 2023-07-05T18:57:52.620 INFO:teuthology.orchestra.run.smithi046.stdout:checking for stdlib.h... yes 2023-07-05T18:57:52.643 INFO:teuthology.orchestra.run.smithi046.stdout:checking for string.h... yes 2023-07-05T18:57:52.668 INFO:teuthology.orchestra.run.smithi046.stdout:checking for memory.h... yes 2023-07-05T18:57:52.693 INFO:teuthology.orchestra.run.smithi046.stdout:checking for strings.h... yes 2023-07-05T18:57:52.720 INFO:teuthology.orchestra.run.smithi046.stdout:checking for inttypes.h... yes 2023-07-05T18:57:52.746 INFO:teuthology.orchestra.run.smithi046.stdout:checking for stdint.h... yes 2023-07-05T18:57:52.775 INFO:teuthology.orchestra.run.smithi046.stdout:checking for unistd.h... yes 2023-07-05T18:57:52.801 INFO:teuthology.orchestra.run.smithi046.stdout:checking for dlfcn.h... yes 2023-07-05T18:57:52.813 INFO:teuthology.orchestra.run.smithi046.stdout:checking for objdir... .libs 2023-07-05T18:57:52.873 INFO:teuthology.orchestra.run.smithi046.stdout:checking if gcc supports -fno-rtti -fno-exceptions... no 2023-07-05T18:57:52.873 INFO:teuthology.orchestra.run.smithi046.stdout:checking for gcc option to produce PIC... -fPIC -DPIC 2023-07-05T18:57:52.886 INFO:teuthology.orchestra.run.smithi046.stdout:checking if gcc PIC flag -fPIC -DPIC works... yes 2023-07-05T18:57:52.905 INFO:teuthology.orchestra.run.smithi046.stdout:checking if gcc static flag -static works... no 2023-07-05T18:57:52.926 INFO:teuthology.orchestra.run.smithi046.stdout:checking if gcc supports -c -o file.o... yes 2023-07-05T18:57:52.926 INFO:teuthology.orchestra.run.smithi046.stdout:checking if gcc supports -c -o file.o... (cached) yes 2023-07-05T18:57:52.932 INFO:teuthology.orchestra.run.smithi046.stdout:checking whether the gcc linker (/bin/ld -m elf_x86_64) supports shared libraries... yes 2023-07-05T18:57:52.958 INFO:teuthology.orchestra.run.smithi046.stdout:checking whether -lc should be explicitly linked in... no 2023-07-05T18:57:53.001 INFO:teuthology.orchestra.run.smithi046.stdout:checking dynamic linker characteristics... GNU/Linux ld.so 2023-07-05T18:57:53.001 INFO:teuthology.orchestra.run.smithi046.stdout:checking how to hardcode library paths into programs... immediate 2023-07-05T18:57:53.004 INFO:teuthology.orchestra.run.smithi046.stdout:checking whether stripping libraries is possible... yes 2023-07-05T18:57:53.004 INFO:teuthology.orchestra.run.smithi046.stdout:checking if libtool supports shared libraries... yes 2023-07-05T18:57:53.004 INFO:teuthology.orchestra.run.smithi046.stdout:checking whether to build shared libraries... yes 2023-07-05T18:57:53.005 INFO:teuthology.orchestra.run.smithi046.stdout:checking whether to build static libraries... yes 2023-07-05T18:57:53.008 INFO:teuthology.orchestra.run.smithi046.stdout:checking for gcc... (cached) gcc 2023-07-05T18:57:53.024 INFO:teuthology.orchestra.run.smithi046.stdout:checking whether we are using the GNU C compiler... (cached) yes 2023-07-05T18:57:53.024 INFO:teuthology.orchestra.run.smithi046.stdout:checking whether gcc accepts -g... (cached) yes 2023-07-05T18:57:53.024 INFO:teuthology.orchestra.run.smithi046.stdout:checking for gcc option to accept ISO C89... (cached) none needed 2023-07-05T18:57:53.024 INFO:teuthology.orchestra.run.smithi046.stdout:checking for gmake... /usr/bin/gmake 2023-07-05T18:57:53.025 INFO:teuthology.orchestra.run.smithi046.stderr:./configure: line 12070: test: $(SHELL): binary operator expected 2023-07-05T18:57:53.026 INFO:teuthology.orchestra.run.smithi046.stdout:checking for tar... /bin/tar 2023-07-05T18:57:53.026 INFO:teuthology.orchestra.run.smithi046.stdout:checking for gzip... /bin/gzip 2023-07-05T18:57:53.032 INFO:teuthology.orchestra.run.smithi046.stdout:checking whether gcc -MM is supported... yes 2023-07-05T18:57:53.039 INFO:teuthology.orchestra.run.smithi046.stdout:checking for sort... /bin/sort 2023-07-05T18:57:53.039 INFO:teuthology.orchestra.run.smithi046.stdout:checking whether ln -s works... yes 2023-07-05T18:57:53.039 INFO:teuthology.orchestra.run.smithi046.stdout:checking for rpm... /bin/rpm 2023-07-05T18:57:53.039 INFO:teuthology.orchestra.run.smithi046.stdout:checking for rpmbuild... no 2023-07-05T18:57:53.062 INFO:teuthology.orchestra.run.smithi046.stdout:checking assert.h usability... yes 2023-07-05T18:57:53.069 INFO:teuthology.orchestra.run.smithi046.stdout:checking assert.h presence... yes 2023-07-05T18:57:53.070 INFO:teuthology.orchestra.run.smithi046.stdout:checking for assert.h... yes 2023-07-05T18:57:53.097 INFO:teuthology.orchestra.run.smithi046.stdout:checking bstring.h usability... no 2023-07-05T18:57:53.106 INFO:teuthology.orchestra.run.smithi046.stdout:checking bstring.h presence... no 2023-07-05T18:57:53.107 INFO:teuthology.orchestra.run.smithi046.stdout:checking for bstring.h... no 2023-07-05T18:57:53.131 INFO:teuthology.orchestra.run.smithi046.stdout:checking libgen.h usability... yes 2023-07-05T18:57:53.139 INFO:teuthology.orchestra.run.smithi046.stdout:checking libgen.h presence... yes 2023-07-05T18:57:53.139 INFO:teuthology.orchestra.run.smithi046.stdout:checking for libgen.h... yes 2023-07-05T18:57:53.166 INFO:teuthology.orchestra.run.smithi046.stdout:checking dirent.h usability... yes 2023-07-05T18:57:53.174 INFO:teuthology.orchestra.run.smithi046.stdout:checking dirent.h presence... yes 2023-07-05T18:57:53.174 INFO:teuthology.orchestra.run.smithi046.stdout:checking for dirent.h... yes 2023-07-05T18:57:53.229 INFO:teuthology.orchestra.run.smithi046.stdout:checking errno.h usability... yes 2023-07-05T18:57:53.236 INFO:teuthology.orchestra.run.smithi046.stdout:checking errno.h presence... yes 2023-07-05T18:57:53.237 INFO:teuthology.orchestra.run.smithi046.stdout:checking for errno.h... yes 2023-07-05T18:57:53.264 INFO:teuthology.orchestra.run.smithi046.stdout:checking malloc.h usability... yes 2023-07-05T18:57:53.273 INFO:teuthology.orchestra.run.smithi046.stdout:checking malloc.h presence... yes 2023-07-05T18:57:53.273 INFO:teuthology.orchestra.run.smithi046.stdout:checking for malloc.h... yes 2023-07-05T18:57:53.299 INFO:teuthology.orchestra.run.smithi046.stdout:checking uuid.h usability... no 2023-07-05T18:57:53.313 INFO:teuthology.orchestra.run.smithi046.stdout:checking uuid.h presence... no 2023-07-05T18:57:53.314 INFO:teuthology.orchestra.run.smithi046.stdout:checking for uuid.h... no 2023-07-05T18:57:53.335 INFO:teuthology.orchestra.run.smithi046.stdout:checking uuid/uuid.h usability... yes 2023-07-05T18:57:53.344 INFO:teuthology.orchestra.run.smithi046.stdout:checking uuid/uuid.h presence... yes 2023-07-05T18:57:53.345 INFO:teuthology.orchestra.run.smithi046.stdout:checking for uuid/uuid.h... yes 2023-07-05T18:57:53.371 INFO:teuthology.orchestra.run.smithi046.stdout:checking sys/uuid.h usability... no 2023-07-05T18:57:53.380 INFO:teuthology.orchestra.run.smithi046.stdout:checking sys/uuid.h presence... no 2023-07-05T18:57:53.381 INFO:teuthology.orchestra.run.smithi046.stdout:checking for sys/uuid.h... no 2023-07-05T18:57:53.411 INFO:teuthology.orchestra.run.smithi046.stdout:checking sys/file.h usability... yes 2023-07-05T18:57:53.420 INFO:teuthology.orchestra.run.smithi046.stdout:checking sys/file.h presence... yes 2023-07-05T18:57:53.420 INFO:teuthology.orchestra.run.smithi046.stdout:checking for sys/file.h... yes 2023-07-05T18:57:53.457 INFO:teuthology.orchestra.run.smithi046.stdout:checking sys/fcntl.h usability... yes 2023-07-05T18:57:53.464 INFO:teuthology.orchestra.run.smithi046.stdout:checking sys/fcntl.h presence... yes 2023-07-05T18:57:53.465 INFO:teuthology.orchestra.run.smithi046.stdout:checking for sys/fcntl.h... yes 2023-07-05T18:57:53.492 INFO:teuthology.orchestra.run.smithi046.stdout:checking sys/syssgi.h usability... no 2023-07-05T18:57:53.502 INFO:teuthology.orchestra.run.smithi046.stdout:checking sys/syssgi.h presence... no 2023-07-05T18:57:53.502 INFO:teuthology.orchestra.run.smithi046.stdout:checking for sys/syssgi.h... no 2023-07-05T18:57:53.575 INFO:teuthology.orchestra.run.smithi046.stdout:checking sys/param.h usability... yes 2023-07-05T18:57:53.585 INFO:teuthology.orchestra.run.smithi046.stdout:checking sys/param.h presence... yes 2023-07-05T18:57:53.586 INFO:teuthology.orchestra.run.smithi046.stdout:checking for sys/param.h... yes 2023-07-05T18:57:53.597 INFO:teuthology.orchestra.run.smithi046.stdout:checking for sys/stat.h... (cached) yes 2023-07-05T18:57:53.618 INFO:teuthology.orchestra.run.smithi046.stdout:checking sys/statvfs.h usability... yes 2023-07-05T18:57:53.625 INFO:teuthology.orchestra.run.smithi046.stdout:checking sys/statvfs.h presence... yes 2023-07-05T18:57:53.626 INFO:teuthology.orchestra.run.smithi046.stdout:checking for sys/statvfs.h... yes 2023-07-05T18:57:53.654 INFO:teuthology.orchestra.run.smithi046.stdout:checking sys/time.h usability... yes 2023-07-05T18:57:53.661 INFO:teuthology.orchestra.run.smithi046.stdout:checking sys/time.h presence... yes 2023-07-05T18:57:53.661 INFO:teuthology.orchestra.run.smithi046.stdout:checking for sys/time.h... yes 2023-07-05T18:57:53.690 INFO:teuthology.orchestra.run.smithi046.stdout:checking sys/ioctl.h usability... yes 2023-07-05T18:57:53.697 INFO:teuthology.orchestra.run.smithi046.stdout:checking sys/ioctl.h presence... yes 2023-07-05T18:57:53.698 INFO:teuthology.orchestra.run.smithi046.stdout:checking for sys/ioctl.h... yes 2023-07-05T18:57:53.728 INFO:teuthology.orchestra.run.smithi046.stdout:checking sys/wait.h usability... yes 2023-07-05T18:57:53.737 INFO:teuthology.orchestra.run.smithi046.stdout:checking sys/wait.h presence... yes 2023-07-05T18:57:53.737 INFO:teuthology.orchestra.run.smithi046.stdout:checking for sys/wait.h... yes 2023-07-05T18:57:53.744 INFO:teuthology.orchestra.run.smithi046.stdout:checking for sys/types.h... (cached) yes 2023-07-05T18:57:53.749 INFO:teuthology.orchestra.run.smithi046.stdout:checking for strings.h... (cached) yes 2023-07-05T18:57:53.775 INFO:teuthology.orchestra.run.smithi046.stdout:checking err.h usability... yes 2023-07-05T18:57:53.780 INFO:teuthology.orchestra.run.smithi046.stdout:checking err.h presence... yes 2023-07-05T18:57:53.781 INFO:teuthology.orchestra.run.smithi046.stdout:checking for err.h... yes 2023-07-05T18:57:53.816 INFO:teuthology.orchestra.run.smithi046.stdout:checking linux/falloc.h usability... yes 2023-07-05T18:57:53.822 INFO:teuthology.orchestra.run.smithi046.stdout:checking linux/falloc.h presence... yes 2023-07-05T18:57:53.823 INFO:teuthology.orchestra.run.smithi046.stdout:checking for linux/falloc.h... yes 2023-07-05T18:57:53.850 INFO:teuthology.orchestra.run.smithi046.stdout:checking sys/fs/xfs_fsops.h usability... no 2023-07-05T18:57:53.858 INFO:teuthology.orchestra.run.smithi046.stdout:checking sys/fs/xfs_fsops.h presence... no 2023-07-05T18:57:53.858 INFO:teuthology.orchestra.run.smithi046.stdout:checking for sys/fs/xfs_fsops.h... no 2023-07-05T18:57:53.881 INFO:teuthology.orchestra.run.smithi046.stdout:checking sys/fs/xfs_itable.h usability... no 2023-07-05T18:57:53.892 INFO:teuthology.orchestra.run.smithi046.stdout:checking sys/fs/xfs_itable.h presence... no 2023-07-05T18:57:53.893 INFO:teuthology.orchestra.run.smithi046.stdout:checking for sys/fs/xfs_itable.h... no 2023-07-05T18:57:53.919 INFO:teuthology.orchestra.run.smithi046.stdout:checking xfs/platform_defs.h usability... no 2023-07-05T18:57:53.927 INFO:teuthology.orchestra.run.smithi046.stdout:checking xfs/platform_defs.h presence... no 2023-07-05T18:57:53.927 INFO:teuthology.orchestra.run.smithi046.stdout:checking for xfs/platform_defs.h... no 2023-07-05T18:57:53.949 INFO:teuthology.orchestra.run.smithi046.stdout:checking btrfs/ioctl.h usability... no 2023-07-05T18:57:53.959 INFO:teuthology.orchestra.run.smithi046.stdout:checking btrfs/ioctl.h presence... no 2023-07-05T18:57:53.959 INFO:teuthology.orchestra.run.smithi046.stdout:checking for btrfs/ioctl.h... no 2023-07-05T18:57:53.981 INFO:teuthology.orchestra.run.smithi046.stdout:checking cifs/ioctl.h usability... no 2023-07-05T18:57:53.990 INFO:teuthology.orchestra.run.smithi046.stdout:checking cifs/ioctl.h presence... no 2023-07-05T18:57:53.991 INFO:teuthology.orchestra.run.smithi046.stdout:checking for cifs/ioctl.h... no 2023-07-05T18:57:54.016 INFO:teuthology.orchestra.run.smithi046.stdout:checking sys/mman.h usability... yes 2023-07-05T18:57:54.025 INFO:teuthology.orchestra.run.smithi046.stdout:checking sys/mman.h presence... yes 2023-07-05T18:57:54.026 INFO:teuthology.orchestra.run.smithi046.stdout:checking for sys/mman.h... yes 2023-07-05T18:57:54.039 INFO:teuthology.orchestra.run.smithi046.stdout:checking for xfs/xfs_log_format.h... no 2023-07-05T18:57:54.074 INFO:teuthology.orchestra.run.smithi046.stdout:checking for uuid_compare... no 2023-07-05T18:57:54.105 INFO:teuthology.orchestra.run.smithi046.stdout:checking for uuid_compare in -luuid... yes 2023-07-05T18:57:54.148 INFO:teuthology.orchestra.run.smithi046.stdout:checking for xfs/xfs.h... yes 2023-07-05T18:57:54.163 INFO:teuthology.orchestra.run.smithi046.stdout:checking for xfs/libxfs.h... no 2023-07-05T18:57:54.177 INFO:teuthology.orchestra.run.smithi046.stdout:checking whether xlog_assign_lsn is declared... no 2023-07-05T18:57:54.205 INFO:teuthology.orchestra.run.smithi046.stdout:checking for xfs/xqm.h... yes 2023-07-05T18:57:54.251 INFO:teuthology.orchestra.run.smithi046.stdout:checking xfsctl from xfs/xfs.h... ok 2023-07-05T18:57:54.274 INFO:teuthology.orchestra.run.smithi046.stdout:checking xfs/handle.h usability... yes 2023-07-05T18:57:54.281 INFO:teuthology.orchestra.run.smithi046.stdout:checking xfs/handle.h presence... yes 2023-07-05T18:57:54.281 INFO:teuthology.orchestra.run.smithi046.stdout:checking for xfs/handle.h... yes 2023-07-05T18:57:54.335 INFO:teuthology.orchestra.run.smithi046.stdout:checking for attr_list_by_handle in -lhandle... yes 2023-07-05T18:57:54.369 INFO:teuthology.orchestra.run.smithi046.stdout:checking sys/acl.h usability... yes 2023-07-05T18:57:54.377 INFO:teuthology.orchestra.run.smithi046.stdout:checking sys/acl.h presence... yes 2023-07-05T18:57:54.377 INFO:teuthology.orchestra.run.smithi046.stdout:checking for sys/acl.h... yes 2023-07-05T18:57:54.410 INFO:teuthology.orchestra.run.smithi046.stdout:checking acl/libacl.h usability... yes 2023-07-05T18:57:54.418 INFO:teuthology.orchestra.run.smithi046.stdout:checking acl/libacl.h presence... yes 2023-07-05T18:57:54.419 INFO:teuthology.orchestra.run.smithi046.stdout:checking for acl/libacl.h... yes 2023-07-05T18:57:54.450 INFO:teuthology.orchestra.run.smithi046.stdout:checking for acl_init in -lacl... yes 2023-07-05T18:57:54.473 INFO:teuthology.orchestra.run.smithi046.stdout:checking gdbm-ndbm.h usability... no 2023-07-05T18:57:54.484 INFO:teuthology.orchestra.run.smithi046.stdout:checking gdbm-ndbm.h presence... no 2023-07-05T18:57:54.485 INFO:teuthology.orchestra.run.smithi046.stdout:checking for gdbm-ndbm.h... no 2023-07-05T18:57:54.504 INFO:teuthology.orchestra.run.smithi046.stdout:checking gdbm/ndbm.h usability... no 2023-07-05T18:57:54.514 INFO:teuthology.orchestra.run.smithi046.stdout:checking gdbm/ndbm.h presence... no 2023-07-05T18:57:54.514 INFO:teuthology.orchestra.run.smithi046.stdout:checking for gdbm/ndbm.h... no 2023-07-05T18:57:54.537 INFO:teuthology.orchestra.run.smithi046.stdout:checking ndbm.h usability... no 2023-07-05T18:57:54.547 INFO:teuthology.orchestra.run.smithi046.stdout:checking ndbm.h presence... no 2023-07-05T18:57:54.547 INFO:teuthology.orchestra.run.smithi046.stdout:checking for ndbm.h... no 2023-07-05T18:57:54.571 INFO:teuthology.orchestra.run.smithi046.stdout:checking libaio.h usability... yes 2023-07-05T18:57:54.582 INFO:teuthology.orchestra.run.smithi046.stdout:checking libaio.h presence... yes 2023-07-05T18:57:54.582 INFO:teuthology.orchestra.run.smithi046.stdout:checking for libaio.h... yes 2023-07-05T18:57:54.603 INFO:teuthology.orchestra.run.smithi046.stdout:checking liburing.h usability... no 2023-07-05T18:57:54.613 INFO:teuthology.orchestra.run.smithi046.stdout:checking liburing.h presence... no 2023-07-05T18:57:54.613 INFO:teuthology.orchestra.run.smithi046.stdout:checking for liburing.h... no 2023-07-05T18:57:54.634 INFO:teuthology.orchestra.run.smithi046.stdout:checking sys/capability.h usability... no 2023-07-05T18:57:54.644 INFO:teuthology.orchestra.run.smithi046.stdout:checking sys/capability.h presence... no 2023-07-05T18:57:54.644 INFO:teuthology.orchestra.run.smithi046.stdout:checking for sys/capability.h... no 2023-07-05T18:57:54.668 INFO:teuthology.orchestra.run.smithi046.stdout:checking linux/fiemap.h usability... yes 2023-07-05T18:57:54.675 INFO:teuthology.orchestra.run.smithi046.stdout:checking linux/fiemap.h presence... yes 2023-07-05T18:57:54.675 INFO:teuthology.orchestra.run.smithi046.stdout:checking for linux/fiemap.h... yes 2023-07-05T18:57:54.707 INFO:teuthology.orchestra.run.smithi046.stdout:checking for fallocate... yes 2023-07-05T18:57:54.740 INFO:teuthology.orchestra.run.smithi046.stdout:checking for open_by_handle_at... yes 2023-07-05T18:57:54.764 INFO:teuthology.orchestra.run.smithi046.stdout:checking sys/prctl.h usability... yes 2023-07-05T18:57:54.772 INFO:teuthology.orchestra.run.smithi046.stdout:checking sys/prctl.h presence... yes 2023-07-05T18:57:54.773 INFO:teuthology.orchestra.run.smithi046.stdout:checking for sys/prctl.h... yes 2023-07-05T18:57:54.797 INFO:teuthology.orchestra.run.smithi046.stdout:checking linux/fs.h usability... yes 2023-07-05T18:57:54.804 INFO:teuthology.orchestra.run.smithi046.stdout:checking linux/fs.h presence... yes 2023-07-05T18:57:54.804 INFO:teuthology.orchestra.run.smithi046.stdout:checking for linux/fs.h... yes 2023-07-05T18:57:54.825 INFO:teuthology.orchestra.run.smithi046.stdout:checking btrfsutil.h usability... no 2023-07-05T18:57:54.839 INFO:teuthology.orchestra.run.smithi046.stdout:checking btrfsutil.h presence... no 2023-07-05T18:57:54.840 INFO:teuthology.orchestra.run.smithi046.stdout:checking for btrfsutil.h... no 2023-07-05T18:57:54.875 INFO:teuthology.orchestra.run.smithi046.stdout:checking for copy_file_range... yes 2023-07-05T18:57:54.910 INFO:teuthology.orchestra.run.smithi046.stdout:checking for SEEK_DATA... yes 2023-07-05T18:57:54.957 INFO:teuthology.orchestra.run.smithi046.stdout:checking for BMV_OF_SHARED... yes 2023-07-05T18:57:54.998 INFO:teuthology.orchestra.run.smithi046.stdout:checking for nftw... yes 2023-07-05T18:57:55.040 INFO:teuthology.orchestra.run.smithi046.stdout:checking for RLIMIT_NOFILE... yes 2023-07-05T18:57:55.058 INFO:teuthology.orchestra.run.smithi046.stdout:checking for FIEXCHANGE_RANGE... no 2023-07-05T18:57:55.092 INFO:teuthology.orchestra.run.smithi046.stdout:checking for renameat2... yes 2023-07-05T18:57:55.123 INFO:teuthology.orchestra.run.smithi046.stdout:checking for reallocarray... yes 2023-07-05T18:57:55.137 INFO:teuthology.orchestra.run.smithi046.stdout:checking for struct mount_attr... no 2023-07-05T18:57:55.171 INFO:teuthology.orchestra.run.smithi046.stdout:checking for struct btrfs_qgroup_limit... yes 2023-07-05T18:57:55.208 INFO:teuthology.orchestra.run.smithi046.stdout:checking for struct btrfs_qgroup_inherit... yes 2023-07-05T18:57:55.241 INFO:teuthology.orchestra.run.smithi046.stdout:checking for struct btrfs_ioctl_vol_args... yes 2023-07-05T18:57:55.276 INFO:teuthology.orchestra.run.smithi046.stdout:checking for struct btrfs_ioctl_vol_args_v2... yes 2023-07-05T18:57:55.312 INFO:teuthology.orchestra.run.smithi046.stdout:checking for struct btrfs_ioctl_ino_lookup_args... yes 2023-07-05T18:57:55.346 INFO:teuthology.orchestra.run.smithi046.stdout:checking for struct btrfs_ioctl_ino_lookup_user_args... yes 2023-07-05T18:57:55.381 INFO:teuthology.orchestra.run.smithi046.stdout:checking for struct btrfs_ioctl_get_subvol_rootref_args... yes 2023-07-05T18:57:55.407 INFO:teuthology.orchestra.run.smithi046.stdout:checking linux/btrfs.h usability... yes 2023-07-05T18:57:55.415 INFO:teuthology.orchestra.run.smithi046.stdout:checking linux/btrfs.h presence... yes 2023-07-05T18:57:55.415 INFO:teuthology.orchestra.run.smithi046.stdout:checking for linux/btrfs.h... yes 2023-07-05T18:57:55.444 INFO:teuthology.orchestra.run.smithi046.stdout:checking linux/btrfs_tree.h usability... yes 2023-07-05T18:57:55.458 INFO:teuthology.orchestra.run.smithi046.stdout:checking linux/btrfs_tree.h presence... yes 2023-07-05T18:57:55.458 INFO:teuthology.orchestra.run.smithi046.stdout:checking for linux/btrfs_tree.h... yes 2023-07-05T18:57:55.483 INFO:teuthology.orchestra.run.smithi046.stdout:checking for struct btrfs_ioctl_vol_args_v2.subvolid... no 2023-07-05T18:57:55.499 INFO:teuthology.orchestra.run.smithi046.stdout:configure: creating ./config.status 2023-07-05T18:57:55.808 INFO:teuthology.orchestra.run.smithi046.stdout:config.status: creating include/builddefs 2023-07-05T18:57:55.816 INFO:teuthology.orchestra.run.smithi046.stdout:config.status: creating include/config.h 2023-07-05T18:57:55.822 INFO:teuthology.orchestra.run.smithi046.stdout:config.status: executing libtool commands 2023-07-05T18:57:55.860 INFO:teuthology.orchestra.run.smithi046.stdout:Building include 2023-07-05T18:57:55.863 INFO:teuthology.orchestra.run.smithi046.stdout:Building lib 2023-07-05T18:57:55.866 INFO:teuthology.orchestra.run.smithi046.stdout: [LTDEP] 2023-07-05T18:57:55.981 INFO:teuthology.orchestra.run.smithi046.stdout: [CC] dataascii.lo 2023-07-05T18:57:56.096 INFO:teuthology.orchestra.run.smithi046.stdout: [CC] databin.lo 2023-07-05T18:57:56.241 INFO:teuthology.orchestra.run.smithi046.stdout: [CC] datapid.lo 2023-07-05T18:57:56.337 INFO:teuthology.orchestra.run.smithi046.stdout: [CC] file_lock.lo 2023-07-05T18:57:56.480 INFO:teuthology.orchestra.run.smithi046.stdout: [CC] forker.lo 2023-07-05T18:57:56.614 INFO:teuthology.orchestra.run.smithi046.stdout: [CC] pattern.lo 2023-07-05T18:57:56.723 INFO:teuthology.orchestra.run.smithi046.stdout: [CC] open_flags.lo 2023-07-05T18:57:56.861 INFO:teuthology.orchestra.run.smithi046.stdout: [CC] random_range.lo 2023-07-05T18:57:57.074 INFO:teuthology.orchestra.run.smithi046.stdout: [CC] string_to_tokens.lo 2023-07-05T18:57:57.175 INFO:teuthology.orchestra.run.smithi046.stdout: [CC] str_to_bytes.lo 2023-07-05T18:57:57.300 INFO:teuthology.orchestra.run.smithi046.stdout: [CC] tlibio.lo 2023-07-05T18:57:57.523 INFO:teuthology.orchestra.run.smithi046.stdout: [CC] write_log.lo 2023-07-05T18:57:57.750 INFO:teuthology.orchestra.run.smithi046.stdout: [CC] random.lo 2023-07-05T18:57:57.859 INFO:teuthology.orchestra.run.smithi046.stdout: [LD] 2023-07-05T18:57:57.931 INFO:teuthology.orchestra.run.smithi046.stdout:Building ltp 2023-07-05T18:57:57.935 INFO:teuthology.orchestra.run.smithi046.stdout: [DEP] 2023-07-05T18:57:58.044 INFO:teuthology.orchestra.run.smithi046.stdout: [CC] doio 2023-07-05T18:57:58.662 INFO:teuthology.orchestra.run.smithi046.stdout: [CC] fsstress 2023-07-05T18:57:59.905 INFO:teuthology.orchestra.run.smithi046.stdout: [CC] fsx 2023-07-05T18:58:00.719 INFO:teuthology.orchestra.run.smithi046.stdout: [CC] growfiles 2023-07-05T18:58:01.195 INFO:teuthology.orchestra.run.smithi046.stdout: [CC] iogen 2023-07-05T18:58:01.528 INFO:teuthology.orchestra.run.smithi046.stdout: [CC] aio-stress 2023-07-05T18:58:01.920 INFO:teuthology.orchestra.run.smithi046.stdout:Building src 2023-07-05T18:58:01.926 INFO:teuthology.orchestra.run.smithi046.stdout: [DEP] 2023-07-05T18:58:03.272 INFO:teuthology.orchestra.run.smithi046.stdout: [DEP] 2023-07-05T18:58:03.298 INFO:teuthology.orchestra.run.smithi046.stdout: [DEP] 2023-07-05T18:58:03.307 INFO:teuthology.orchestra.run.smithi046.stdout: [DEP] 2023-07-05T18:58:03.499 INFO:teuthology.orchestra.run.smithi046.stdout: [DEP] 2023-07-05T18:58:03.520 INFO:teuthology.orchestra.run.smithi046.stdout: [CC] dirstress 2023-07-05T18:58:03.745 INFO:teuthology.orchestra.run.smithi046.stdout: [CC] fill 2023-07-05T18:58:03.889 INFO:teuthology.orchestra.run.smithi046.stdout: [CC] fill2 2023-07-05T18:58:04.105 INFO:teuthology.orchestra.run.smithi046.stdout: [CC] getpagesize 2023-07-05T18:58:04.229 INFO:teuthology.orchestra.run.smithi046.stdout: [CC] holes 2023-07-05T18:58:04.416 INFO:teuthology.orchestra.run.smithi046.stdout: [CC] lstat64 2023-07-05T18:58:04.589 INFO:teuthology.orchestra.run.smithi046.stdout: [CC] nametest 2023-07-05T18:58:04.813 INFO:teuthology.orchestra.run.smithi046.stdout: [CC] permname 2023-07-05T18:58:04.994 INFO:teuthology.orchestra.run.smithi046.stdout: [CC] randholes 2023-07-05T18:58:05.228 INFO:teuthology.orchestra.run.smithi046.stdout: [CC] runas 2023-07-05T18:58:05.392 INFO:teuthology.orchestra.run.smithi046.stdout: [CC] truncfile 2023-07-05T18:58:05.562 INFO:teuthology.orchestra.run.smithi046.stdout: [CC] usemem 2023-07-05T18:58:05.702 INFO:teuthology.orchestra.run.smithi046.stdout: [CC] mmapcat 2023-07-05T18:58:05.842 INFO:teuthology.orchestra.run.smithi046.stdout: [CC] append_reader 2023-07-05T18:58:05.989 INFO:teuthology.orchestra.run.smithi046.stdout: [CC] append_writer 2023-07-05T18:58:06.129 INFO:teuthology.orchestra.run.smithi046.stdout: [CC] dirperf 2023-07-05T18:58:06.332 INFO:teuthology.orchestra.run.smithi046.stdout: [CC] metaperf 2023-07-05T18:58:06.571 INFO:teuthology.orchestra.run.smithi046.stdout: [CC] devzero 2023-07-05T18:58:06.734 INFO:teuthology.orchestra.run.smithi046.stdout: [CC] feature 2023-07-05T18:58:06.933 INFO:teuthology.orchestra.run.smithi046.stdout: [CC] alloc 2023-07-05T18:58:07.131 INFO:teuthology.orchestra.run.smithi046.stdout: [CC] fault 2023-07-05T18:58:07.285 INFO:teuthology.orchestra.run.smithi046.stdout: [CC] fstest 2023-07-05T18:58:07.506 INFO:teuthology.orchestra.run.smithi046.stdout: [CC] t_access_root 2023-07-05T18:58:07.654 INFO:teuthology.orchestra.run.smithi046.stdout: [CC] godown 2023-07-05T18:58:07.810 INFO:teuthology.orchestra.run.smithi046.stdout: [CC] resvtest 2023-07-05T18:58:07.984 INFO:teuthology.orchestra.run.smithi046.stdout: [CC] writemod 2023-07-05T18:58:08.132 INFO:teuthology.orchestra.run.smithi046.stdout: [CC] writev_on_pagefault 2023-07-05T18:58:08.272 INFO:teuthology.orchestra.run.smithi046.stdout: [CC] makeextents 2023-07-05T18:58:08.439 INFO:teuthology.orchestra.run.smithi046.stdout: [CC] itrash 2023-07-05T18:58:08.587 INFO:teuthology.orchestra.run.smithi046.stdout: [CC] rename 2023-07-05T18:58:08.717 INFO:teuthology.orchestra.run.smithi046.stdout: [CC] multi_open_unlink 2023-07-05T18:58:08.873 INFO:teuthology.orchestra.run.smithi046.stdout: [CC] unwritten_sync 2023-07-05T18:58:09.045 INFO:teuthology.orchestra.run.smithi046.stdout: [CC] genhashnames 2023-07-05T18:58:09.217 INFO:teuthology.orchestra.run.smithi046.stdout: [CC] t_holes 2023-07-05T18:58:09.358 INFO:teuthology.orchestra.run.smithi046.stdout: [CC] t_mmap_writev 2023-07-05T18:58:09.501 INFO:teuthology.orchestra.run.smithi046.stdout: [CC] t_truncate_cmtime 2023-07-05T18:58:09.647 INFO:teuthology.orchestra.run.smithi046.stdout: [CC] dirhash_collide 2023-07-05T18:58:09.822 INFO:teuthology.orchestra.run.smithi046.stdout: [CC] t_rename_overwrite 2023-07-05T18:58:09.952 INFO:teuthology.orchestra.run.smithi046.stdout: [CC] holetest 2023-07-05T18:58:10.154 INFO:teuthology.orchestra.run.smithi046.stdout: [CC] t_truncate_self 2023-07-05T18:58:10.288 INFO:teuthology.orchestra.run.smithi046.stdout: [CC] af_unix 2023-07-05T18:58:10.436 INFO:teuthology.orchestra.run.smithi046.stdout: [CC] t_mmap_stale_pmd 2023-07-05T18:58:10.575 INFO:teuthology.orchestra.run.smithi046.stdout: [CC] t_mmap_cow_race 2023-07-05T18:58:10.729 INFO:teuthology.orchestra.run.smithi046.stdout: [CC] t_mmap_fallocate 2023-07-05T18:58:10.873 INFO:teuthology.orchestra.run.smithi046.stdout: [CC] fsync-err 2023-07-05T18:58:11.047 INFO:teuthology.orchestra.run.smithi046.stdout: [CC] t_mmap_write_ro 2023-07-05T18:58:11.190 INFO:teuthology.orchestra.run.smithi046.stdout: [CC] t_ext4_dax_journal_corruption 2023-07-05T18:58:11.343 INFO:teuthology.orchestra.run.smithi046.stdout: [CC] t_ext4_dax_inline_corruption 2023-07-05T18:58:11.489 INFO:teuthology.orchestra.run.smithi046.stdout: [CC] t_ofd_locks 2023-07-05T18:58:11.679 INFO:teuthology.orchestra.run.smithi046.stdout: [CC] t_mmap_collision 2023-07-05T18:58:11.864 INFO:teuthology.orchestra.run.smithi046.stdout: [CC] mmap-write-concurrent 2023-07-05T18:58:12.024 INFO:teuthology.orchestra.run.smithi046.stdout: [CC] t_get_file_time 2023-07-05T18:58:12.164 INFO:teuthology.orchestra.run.smithi046.stdout: [CC] t_create_short_dirs 2023-07-05T18:58:12.320 INFO:teuthology.orchestra.run.smithi046.stdout: [CC] t_create_long_dirs 2023-07-05T18:58:12.475 INFO:teuthology.orchestra.run.smithi046.stdout: [CC] t_enospc 2023-07-05T18:58:12.649 INFO:teuthology.orchestra.run.smithi046.stdout: [CC] t_mmap_writev_overlap 2023-07-05T18:58:12.808 INFO:teuthology.orchestra.run.smithi046.stdout: [CC] checkpoint_journal 2023-07-05T18:58:12.954 INFO:teuthology.orchestra.run.smithi046.stdout: [CC] mmap-rw-fault 2023-07-05T18:58:13.124 INFO:teuthology.orchestra.run.smithi046.stdout: [CC] allocstale 2023-07-05T18:58:13.284 INFO:teuthology.orchestra.run.smithi046.stdout: [CC] t_mmap_cow_memory_failure 2023-07-05T18:58:13.441 INFO:teuthology.orchestra.run.smithi046.stdout: [CC] fake-dump-rootino 2023-07-05T18:58:13.584 INFO:teuthology.orchestra.run.smithi046.stdout: [CC] dio-buf-fault 2023-07-05T18:58:13.731 INFO:teuthology.orchestra.run.smithi046.stdout: [CC] xfsctl 2023-07-05T18:58:13.913 INFO:teuthology.orchestra.run.smithi046.stdout: [CC] bstat 2023-07-05T18:58:14.098 INFO:teuthology.orchestra.run.smithi046.stdout: [CC] t_mtab 2023-07-05T18:58:14.270 INFO:teuthology.orchestra.run.smithi046.stdout: [CC] getdevicesize 2023-07-05T18:58:14.416 INFO:teuthology.orchestra.run.smithi046.stdout: [CC] preallo_rw_pattern_reader 2023-07-05T18:58:14.566 INFO:teuthology.orchestra.run.smithi046.stdout: [CC] preallo_rw_pattern_writer 2023-07-05T18:58:14.715 INFO:teuthology.orchestra.run.smithi046.stdout: [CC] ftrunc 2023-07-05T18:58:14.857 INFO:teuthology.orchestra.run.smithi046.stdout: [CC] trunc 2023-07-05T18:58:15.008 INFO:teuthology.orchestra.run.smithi046.stdout: [CC] fs_perms 2023-07-05T18:58:15.162 INFO:teuthology.orchestra.run.smithi046.stdout: [CC] testx 2023-07-05T18:58:15.287 INFO:teuthology.orchestra.run.smithi046.stdout: [CC] looptest 2023-07-05T18:58:15.468 INFO:teuthology.orchestra.run.smithi046.stdout: [CC] locktest 2023-07-05T18:58:15.755 INFO:teuthology.orchestra.run.smithi046.stdout: [CC] unwritten_mmap 2023-07-05T18:58:15.909 INFO:teuthology.orchestra.run.smithi046.stdout: [CC] bulkstat_unlink_test 2023-07-05T18:58:16.097 INFO:teuthology.orchestra.run.smithi046.stdout: [CC] deduperace 2023-07-05T18:58:16.281 INFO:teuthology.orchestra.run.smithi046.stdout: [CC] bulkstat_unlink_test_modified 2023-07-05T18:58:16.467 INFO:teuthology.orchestra.run.smithi046.stdout: [CC] t_dir_offset 2023-07-05T18:58:16.608 INFO:teuthology.orchestra.run.smithi046.stdout: [CC] t_futimens 2023-07-05T18:58:16.739 INFO:teuthology.orchestra.run.smithi046.stdout: [CC] t_immutable 2023-07-05T18:58:17.307 INFO:teuthology.orchestra.run.smithi046.stdout: [CC] stale_handle 2023-07-05T18:58:17.469 INFO:teuthology.orchestra.run.smithi046.stdout: [CC] pwrite_mmap_blocked 2023-07-05T18:58:17.610 INFO:teuthology.orchestra.run.smithi046.stdout: [CC] t_dir_offset2 2023-07-05T18:58:17.791 INFO:teuthology.orchestra.run.smithi046.stdout: [CC] seek_sanity_test 2023-07-05T18:58:18.181 INFO:teuthology.orchestra.run.smithi046.stdout: [CC] seek_copy_test 2023-07-05T18:58:18.346 INFO:teuthology.orchestra.run.smithi046.stdout: [CC] t_readdir_1 2023-07-05T18:58:18.493 INFO:teuthology.orchestra.run.smithi046.stdout: [CC] t_readdir_2 2023-07-05T18:58:18.629 INFO:teuthology.orchestra.run.smithi046.stdout: [CC] fsync-tester 2023-07-05T18:58:18.862 INFO:teuthology.orchestra.run.smithi046.stdout: [CC] nsexec 2023-07-05T18:58:19.030 INFO:teuthology.orchestra.run.smithi046.stdout: [CC] cloner 2023-07-05T18:58:19.197 INFO:teuthology.orchestra.run.smithi046.stdout: [CC] renameat2 2023-07-05T18:58:19.359 INFO:teuthology.orchestra.run.smithi046.stdout: [CC] t_getcwd 2023-07-05T18:58:19.504 INFO:teuthology.orchestra.run.smithi046.stdout: [CC] e4compact 2023-07-05T18:58:19.813 INFO:teuthology.orchestra.run.smithi046.stdout: [CC] test-nextquota 2023-07-05T18:58:19.970 INFO:teuthology.orchestra.run.smithi046.stdout: [CC] punch-alternating 2023-07-05T18:58:20.133 INFO:teuthology.orchestra.run.smithi046.stdout: [CC] attr-list-by-handle-cursor-test 2023-07-05T18:58:20.289 INFO:teuthology.orchestra.run.smithi046.stdout: [CC] listxattr 2023-07-05T18:58:20.426 INFO:teuthology.orchestra.run.smithi046.stdout: [CC] dio-interleaved 2023-07-05T18:58:20.576 INFO:teuthology.orchestra.run.smithi046.stdout: [CC] t_dir_type 2023-07-05T18:58:20.725 INFO:teuthology.orchestra.run.smithi046.stdout: [CC] dio-invalidate-cache 2023-07-05T18:58:20.915 INFO:teuthology.orchestra.run.smithi046.stdout: [CC] stat_test 2023-07-05T18:58:21.192 INFO:teuthology.orchestra.run.smithi046.stdout: [CC] t_encrypted_d_revalidate 2023-07-05T18:58:21.350 INFO:teuthology.orchestra.run.smithi046.stdout: [CC] attr_replace_test 2023-07-05T18:58:21.503 INFO:teuthology.orchestra.run.smithi046.stdout: [CC] swapon 2023-07-05T18:58:21.642 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-05T18:58:21.652 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-05T18:58:21.658 INFO:teuthology.orchestra.run.smithi046.stdout: [CC] mkswap 2023-07-05T18:58:21.810 INFO:teuthology.orchestra.run.smithi046.stdout: [CC] t_attr_corruption 2023-07-05T18:58:21.952 INFO:teuthology.orchestra.run.smithi046.stdout: [CC] t_open_tmpfiles 2023-07-05T18:58:22.125 INFO:teuthology.orchestra.run.smithi046.stdout: [CC] fscrypt-crypt-util 2023-07-05T18:58:22.723 INFO:teuthology.orchestra.run.smithi046.stdout: [CC] bulkstat_null_ocount 2023-07-05T18:58:22.871 INFO:teuthology.orchestra.run.smithi046.stdout: [CC] splice-test 2023-07-05T18:58:23.063 INFO:teuthology.orchestra.run.smithi046.stdout: [CC] chprojid_fail 2023-07-05T18:58:23.200 INFO:teuthology.orchestra.run.smithi046.stdout: [CC] detached_mounts_propagation 2023-07-05T18:58:23.369 INFO:teuthology.orchestra.run.smithi046.stdout: [CC] ext4_resize 2023-07-05T18:58:23.513 INFO:teuthology.orchestra.run.smithi046.stdout: [CC] t_readdir_3 2023-07-05T18:58:23.692 INFO:teuthology.orchestra.run.smithi046.stdout: [CC] splice2pipe 2023-07-05T18:58:23.847 INFO:teuthology.orchestra.run.smithi046.stdout: [CC] uuid_ioctl 2023-07-05T18:58:23.993 INFO:teuthology.orchestra.run.smithi046.stdout: [CC] fiemap-tester 2023-07-05T18:58:24.244 INFO:teuthology.orchestra.run.smithi046.stdout: [CC] t_stripealign 2023-07-05T18:58:24.390 INFO:teuthology.orchestra.run.smithi046.stdout: [CC] open_by_handle 2023-07-05T18:58:24.628 INFO:teuthology.orchestra.run.smithi046.stdout: [CC] t_mmap_dio 2023-07-05T18:58:24.782 INFO:teuthology.orchestra.run.smithi046.stdout: [CC] xfsfind 2023-07-05T18:58:24.966 INFO:teuthology.orchestra.run.smithi046.stdout: [CC] fssum 2023-07-05T18:58:25.369 INFO:teuthology.orchestra.run.smithi046.stdout:Building log-writes 2023-07-05T18:58:25.375 INFO:teuthology.orchestra.run.smithi046.stdout: [CC] replay-log 2023-07-05T18:58:25.665 INFO:teuthology.orchestra.run.smithi046.stdout:Building perf 2023-07-05T18:58:25.668 INFO:teuthology.orchestra.run.smithi046.stdout:Building aio-dio-regress 2023-07-05T18:58:25.674 INFO:teuthology.orchestra.run.smithi046.stdout: [CC] aio-dio-append-write-fallocate-race 2023-07-05T18:58:25.840 INFO:teuthology.orchestra.run.smithi046.stdout: [CC] aio-dio-fcntl-race 2023-07-05T18:58:25.995 INFO:teuthology.orchestra.run.smithi046.stdout: [CC] aio-dio-subblock-eof-read 2023-07-05T18:58:26.141 INFO:teuthology.orchestra.run.smithi046.stdout: [CC] aio-dio-append-write-read-race 2023-07-05T18:58:26.303 INFO:teuthology.orchestra.run.smithi046.stdout: [CC] aio-dio-invalidate-readahead 2023-07-05T18:58:26.463 INFO:teuthology.orchestra.run.smithi046.stdout: [CC] aio-dio-write-verify 2023-07-05T18:58:26.647 INFO:teuthology.orchestra.run.smithi046.stdout: [CC] aio-free-ring-with-bogus-nr-pages 2023-07-05T18:58:26.776 INFO:teuthology.orchestra.run.smithi046.stdout: [CC] aio-last-ref-held-by-io 2023-07-05T18:58:26.945 INFO:teuthology.orchestra.run.smithi046.stdout: [CC] aio-dio-cycle-write 2023-07-05T18:58:27.121 INFO:teuthology.orchestra.run.smithi046.stdout: [CC] aio-dio-extend-stat 2023-07-05T18:58:27.280 INFO:teuthology.orchestra.run.smithi046.stdout: [CC] aio-io-setup-with-nonwritable-context-pointer 2023-07-05T18:58:27.412 INFO:teuthology.orchestra.run.smithi046.stdout: [CC] aio-dio-hole-filling-race 2023-07-05T18:58:27.566 INFO:teuthology.orchestra.run.smithi046.stdout: [CC] aio-dio-invalidate-failure 2023-07-05T18:58:27.709 INFO:teuthology.orchestra.run.smithi046.stdout: [CC] aiodio_sparse2 2023-07-05T18:58:27.914 INFO:teuthology.orchestra.run.smithi046.stdout: [CC] aiocp 2023-07-05T18:58:28.133 INFO:teuthology.orchestra.run.smithi046.stdout: [CC] aio-dio-cow-race 2023-07-05T18:58:28.278 INFO:teuthology.orchestra.run.smithi046.stdout: [CC] aio-dio-eof-race 2023-07-05T18:58:28.454 INFO:teuthology.orchestra.run.smithi046.stdout:Building vfs 2023-07-05T18:58:28.466 INFO:teuthology.orchestra.run.smithi046.stdout: [CC] vfstest 2023-07-05T18:58:30.213 INFO:teuthology.orchestra.run.smithi046.stdout: [CC] mount-idmapped 2023-07-05T18:58:30.557 INFO:teuthology.orchestra.run.smithi046.stdout:Building m4 2023-07-05T18:58:30.558 INFO:teuthology.orchestra.run.smithi046.stdout:Building common 2023-07-05T18:58:30.562 INFO:teuthology.orchestra.run.smithi046.stdout:Building tests 2023-07-05T18:58:30.589 INFO:teuthology.orchestra.run.smithi046.stdout:Building perf 2023-07-05T18:58:30.589 INFO:teuthology.orchestra.run.smithi046.stdout: [GROUP] /tmp/tmp.rlt8E1h3iVxfstests-dev/tests/perf/group.list 2023-07-05T18:58:30.589 INFO:teuthology.orchestra.run.smithi046.stdout:Building ext4 2023-07-05T18:58:30.589 INFO:teuthology.orchestra.run.smithi046.stdout: [GROUP] /tmp/tmp.rlt8E1h3iVxfstests-dev/tests/ext4/group.list 2023-07-05T18:58:30.630 INFO:teuthology.orchestra.run.smithi046.stdout:Building ocfs2 2023-07-05T18:58:30.630 INFO:teuthology.orchestra.run.smithi046.stdout: [GROUP] /tmp/tmp.rlt8E1h3iVxfstests-dev/tests/ocfs2/group.list 2023-07-05T18:58:30.640 INFO:teuthology.orchestra.run.smithi046.stdout:Building overlay 2023-07-05T18:58:30.647 INFO:teuthology.orchestra.run.smithi046.stdout: [GROUP] /tmp/tmp.rlt8E1h3iVxfstests-dev/tests/overlay/group.list 2023-07-05T18:58:30.680 INFO:teuthology.orchestra.run.smithi046.stdout:Building cifs 2023-07-05T18:58:30.684 INFO:teuthology.orchestra.run.smithi046.stdout: [GROUP] /tmp/tmp.rlt8E1h3iVxfstests-dev/tests/cifs/group.list 2023-07-05T18:58:30.696 INFO:teuthology.orchestra.run.smithi046.stdout:Building generic 2023-07-05T18:58:30.702 INFO:teuthology.orchestra.run.smithi046.stdout: [GROUP] /tmp/tmp.rlt8E1h3iVxfstests-dev/tests/generic/group.list 2023-07-05T18:58:30.795 INFO:teuthology.orchestra.run.smithi046.stdout:Building shared 2023-07-05T18:58:30.798 INFO:teuthology.orchestra.run.smithi046.stdout: [GROUP] /tmp/tmp.rlt8E1h3iVxfstests-dev/tests/shared/group.list 2023-07-05T18:58:30.818 INFO:teuthology.orchestra.run.smithi046.stdout:Building nfs 2023-07-05T18:58:30.819 INFO:teuthology.orchestra.run.smithi046.stdout: [GROUP] /tmp/tmp.rlt8E1h3iVxfstests-dev/tests/nfs/group.list 2023-07-05T18:58:30.832 INFO:teuthology.orchestra.run.smithi046.stdout:Building f2fs 2023-07-05T18:58:30.837 INFO:teuthology.orchestra.run.smithi046.stdout: [GROUP] /tmp/tmp.rlt8E1h3iVxfstests-dev/tests/f2fs/group.list 2023-07-05T18:58:30.854 INFO:teuthology.orchestra.run.smithi046.stdout:Building udf 2023-07-05T18:58:30.860 INFO:teuthology.orchestra.run.smithi046.stdout: [GROUP] /tmp/tmp.rlt8E1h3iVxfstests-dev/tests/udf/group.list 2023-07-05T18:58:30.868 INFO:teuthology.orchestra.run.smithi046.stdout:Building ceph 2023-07-05T18:58:30.873 INFO:teuthology.orchestra.run.smithi046.stdout: [GROUP] /tmp/tmp.rlt8E1h3iVxfstests-dev/tests/ceph/group.list 2023-07-05T18:58:30.886 INFO:teuthology.orchestra.run.smithi046.stdout:Building xfs 2023-07-05T18:58:30.895 INFO:teuthology.orchestra.run.smithi046.stdout: [GROUP] /tmp/tmp.rlt8E1h3iVxfstests-dev/tests/xfs/group.list 2023-07-05T18:58:30.989 INFO:teuthology.orchestra.run.smithi046.stdout:Building btrfs 2023-07-05T18:58:30.991 INFO:teuthology.orchestra.run.smithi046.stdout: [GROUP] /tmp/tmp.rlt8E1h3iVxfstests-dev/tests/btrfs/group.list 2023-07-05T18:58:31.046 INFO:teuthology.orchestra.run.smithi046.stdout:Building tmpfs 2023-07-05T18:58:31.052 INFO:teuthology.orchestra.run.smithi046.stdout: [GROUP] /tmp/tmp.rlt8E1h3iVxfstests-dev/tests/tmpfs/group.list 2023-07-05T18:58:31.063 INFO:teuthology.orchestra.run.smithi046.stdout:Building selftest 2023-07-05T18:58:31.068 INFO:teuthology.orchestra.run.smithi046.stdout: [GROUP] /tmp/tmp.rlt8E1h3iVxfstests-dev/tests/selftest/group.list 2023-07-05T18:58:31.084 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.rlt8E1h3iVxfstests-dev && exec sudo make install) 2023-07-05T18:58:31.125 INFO:teuthology.orchestra.run.smithi046.stdout:Building include 2023-07-05T18:58:31.127 INFO:teuthology.orchestra.run.smithi046.stdout:Building lib 2023-07-05T18:58:31.136 INFO:teuthology.orchestra.run.smithi046.stdout:Building ltp 2023-07-05T18:58:31.136 INFO:teuthology.orchestra.run.smithi046.stdout:Building src 2023-07-05T18:58:31.168 INFO:teuthology.orchestra.run.smithi046.stdout:Building log-writes 2023-07-05T18:58:31.172 INFO:teuthology.orchestra.run.smithi046.stdout:Building perf 2023-07-05T18:58:31.175 INFO:teuthology.orchestra.run.smithi046.stdout:Building aio-dio-regress 2023-07-05T18:58:31.180 INFO:teuthology.orchestra.run.smithi046.stdout:Building vfs 2023-07-05T18:58:31.182 INFO:teuthology.orchestra.run.smithi046.stdout:Building m4 2023-07-05T18:58:31.187 INFO:teuthology.orchestra.run.smithi046.stdout:Building common 2023-07-05T18:58:31.194 INFO:teuthology.orchestra.run.smithi046.stdout:Building tests 2023-07-05T18:58:31.195 INFO:teuthology.orchestra.run.smithi046.stdout:Building perf 2023-07-05T18:58:31.203 INFO:teuthology.orchestra.run.smithi046.stdout: [GROUP] /tmp/tmp.rlt8E1h3iVxfstests-dev/tests/perf/group.list 2023-07-05T18:58:31.218 INFO:teuthology.orchestra.run.smithi046.stdout:Building ext4 2023-07-05T18:58:31.218 INFO:teuthology.orchestra.run.smithi046.stdout: [GROUP] /tmp/tmp.rlt8E1h3iVxfstests-dev/tests/ext4/group.list 2023-07-05T18:58:31.256 INFO:teuthology.orchestra.run.smithi046.stdout:Building ocfs2 2023-07-05T18:58:31.257 INFO:teuthology.orchestra.run.smithi046.stdout: [GROUP] /tmp/tmp.rlt8E1h3iVxfstests-dev/tests/ocfs2/group.list 2023-07-05T18:58:31.269 INFO:teuthology.orchestra.run.smithi046.stdout:Building overlay 2023-07-05T18:58:31.274 INFO:teuthology.orchestra.run.smithi046.stdout: [GROUP] /tmp/tmp.rlt8E1h3iVxfstests-dev/tests/overlay/group.list 2023-07-05T18:58:31.308 INFO:teuthology.orchestra.run.smithi046.stdout:Building cifs 2023-07-05T18:58:31.313 INFO:teuthology.orchestra.run.smithi046.stdout: [GROUP] /tmp/tmp.rlt8E1h3iVxfstests-dev/tests/cifs/group.list 2023-07-05T18:58:31.324 INFO:teuthology.orchestra.run.smithi046.stdout:Building generic 2023-07-05T18:58:31.330 INFO:teuthology.orchestra.run.smithi046.stdout: [GROUP] /tmp/tmp.rlt8E1h3iVxfstests-dev/tests/generic/group.list 2023-07-05T18:58:31.422 INFO:teuthology.orchestra.run.smithi046.stdout:Building shared 2023-07-05T18:58:31.426 INFO:teuthology.orchestra.run.smithi046.stdout: [GROUP] /tmp/tmp.rlt8E1h3iVxfstests-dev/tests/shared/group.list 2023-07-05T18:58:31.442 INFO:teuthology.orchestra.run.smithi046.stdout:Building nfs 2023-07-05T18:58:31.447 INFO:teuthology.orchestra.run.smithi046.stdout: [GROUP] /tmp/tmp.rlt8E1h3iVxfstests-dev/tests/nfs/group.list 2023-07-05T18:58:31.460 INFO:teuthology.orchestra.run.smithi046.stdout:Building f2fs 2023-07-05T18:58:31.466 INFO:teuthology.orchestra.run.smithi046.stdout: [GROUP] /tmp/tmp.rlt8E1h3iVxfstests-dev/tests/f2fs/group.list 2023-07-05T18:58:31.480 INFO:teuthology.orchestra.run.smithi046.stdout:Building udf 2023-07-05T18:58:31.485 INFO:teuthology.orchestra.run.smithi046.stdout: [GROUP] /tmp/tmp.rlt8E1h3iVxfstests-dev/tests/udf/group.list 2023-07-05T18:58:31.496 INFO:teuthology.orchestra.run.smithi046.stdout:Building ceph 2023-07-05T18:58:31.501 INFO:teuthology.orchestra.run.smithi046.stdout: [GROUP] /tmp/tmp.rlt8E1h3iVxfstests-dev/tests/ceph/group.list 2023-07-05T18:58:31.517 INFO:teuthology.orchestra.run.smithi046.stdout:Building xfs 2023-07-05T18:58:31.520 INFO:teuthology.orchestra.run.smithi046.stdout: [GROUP] /tmp/tmp.rlt8E1h3iVxfstests-dev/tests/xfs/group.list 2023-07-05T18:58:31.620 INFO:teuthology.orchestra.run.smithi046.stdout:Building btrfs 2023-07-05T18:58:31.620 INFO:teuthology.orchestra.run.smithi046.stdout: [GROUP] /tmp/tmp.rlt8E1h3iVxfstests-dev/tests/btrfs/group.list 2023-07-05T18:58:31.675 INFO:teuthology.orchestra.run.smithi046.stdout:Building tmpfs 2023-07-05T18:58:31.676 INFO:teuthology.orchestra.run.smithi046.stdout: [GROUP] /tmp/tmp.rlt8E1h3iVxfstests-dev/tests/tmpfs/group.list 2023-07-05T18:58:31.690 INFO:teuthology.orchestra.run.smithi046.stdout:Building selftest 2023-07-05T18:58:31.694 INFO:teuthology.orchestra.run.smithi046.stdout: [GROUP] /tmp/tmp.rlt8E1h3iVxfstests-dev/tests/selftest/group.list 2023-07-05T18:58:31.706 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/gmake --no-print-directory Q=@ -C include install 2023-07-05T18:58:31.707 INFO:teuthology.orchestra.run.smithi046.stdout:gmake[1]: Nothing to be done for 'install'. 2023-07-05T18:58:31.707 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/gmake --no-print-directory Q=@ -C lib install 2023-07-05T18:58:31.709 INFO:teuthology.orchestra.run.smithi046.stdout:gmake[1]: Nothing to be done for 'install'. 2023-07-05T18:58:31.710 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/gmake --no-print-directory Q=@ -C ltp install 2023-07-05T18:58:31.713 INFO:teuthology.orchestra.run.smithi046.stdout:../install-sh -o root -g root -m 755 -d /var/lib/xfstests/ltp 2023-07-05T18:58:31.721 INFO:teuthology.orchestra.run.smithi046.stdout:/bin/sh ../libtool --quiet --mode=install ../install-sh -o root -g root -m 755 doio fsstress fsx growfiles iogen aio-stress /var/lib/xfstests/ltp 2023-07-05T18:58:31.800 INFO:teuthology.orchestra.run.smithi046.stdout:../install-sh -o root -g root -m 755 rwtest.sh /var/lib/xfstests/ltp 2023-07-05T18:58:31.812 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/gmake --no-print-directory Q=@ -C src install 2023-07-05T18:58:31.825 INFO:teuthology.orchestra.run.smithi046.stdout:Building log-writes 2023-07-05T18:58:31.828 INFO:teuthology.orchestra.run.smithi046.stdout:Building perf 2023-07-05T18:58:31.831 INFO:teuthology.orchestra.run.smithi046.stdout:Building aio-dio-regress 2023-07-05T18:58:31.836 INFO:teuthology.orchestra.run.smithi046.stdout:Building vfs 2023-07-05T18:58:31.840 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/gmake -C log-writes install 2023-07-05T18:58:31.840 INFO:teuthology.orchestra.run.smithi046.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/src/log-writes 2023-07-05T18:58:31.849 INFO:teuthology.orchestra.run.smithi046.stdout:../../install-sh -o root -g root -m 755 replay-log /var/lib/xfstests/src/log-writes 2023-07-05T18:58:31.861 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/gmake -C perf install 2023-07-05T18:58:31.869 INFO:teuthology.orchestra.run.smithi046.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/src/perf 2023-07-05T18:58:31.869 INFO:teuthology.orchestra.run.smithi046.stdout:../../install-sh -o root -g root -m 755 ResultData.py fio-insert-and-compare.py FioResultDecoder.py FioCompare.py generate-schema.py fio-results.sql /var/lib/xfstests/src/perf 2023-07-05T18:58:31.892 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/gmake -C aio-dio-regress install 2023-07-05T18:58:31.898 INFO:teuthology.orchestra.run.smithi046.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/src/aio-dio-regress 2023-07-05T18:58:31.907 INFO:teuthology.orchestra.run.smithi046.stdout:../../install-sh -o root -g root -m 755 aio-dio-append-write-fallocate-race aio-dio-fcntl-race aio-dio-subblock-eof-read aio-dio-append-write-read-race aio-dio-invalidate-readahead aio-dio-write-verify aio-free-ring-with-bogus-nr-pages aio-last-ref-held-by-io aio-dio-cycle-write aio-dio-extend-stat aio-io-setup-with-nonwritable-context-pointer aio-dio-hole-filling-race aio-dio-invalidate-failure aiodio_sparse2 aiocp aio-dio-cow-race aio-dio-eof-race /var/lib/xfstests/src/aio-dio-regress 2023-07-05T18:58:31.958 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/gmake -C vfs install 2023-07-05T18:58:31.959 INFO:teuthology.orchestra.run.smithi046.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/src/vfs 2023-07-05T18:58:31.973 INFO:teuthology.orchestra.run.smithi046.stdout:../../install-sh -o root -g root -m 755 vfstest mount-idmapped /var/lib/xfstests/src/vfs 2023-07-05T18:58:31.981 INFO:teuthology.orchestra.run.smithi046.stdout:../install-sh -o root -g root -m 755 -d /var/lib/xfstests/src 2023-07-05T18:58:31.988 INFO:teuthology.orchestra.run.smithi046.stdout:/bin/sh ../libtool --quiet --mode=install ../install-sh -o root -g root -m 755 dirstress fill fill2 getpagesize holes lstat64 nametest permname randholes runas truncfile usemem mmapcat append_reader append_writer dirperf metaperf devzero feature alloc fault fstest t_access_root godown resvtest writemod writev_on_pagefault makeextents itrash rename multi_open_unlink unwritten_sync genhashnames t_holes t_mmap_writev t_truncate_cmtime dirhash_collide t_rename_overwrite holetest t_truncate_self af_unix t_mmap_stale_pmd t_mmap_cow_race t_mmap_fallocate fsync-err t_mmap_write_ro t_ext4_dax_journal_corruption t_ext4_dax_inline_corruption t_ofd_locks t_mmap_collision mmap-write-concurrent t_get_file_time t_create_short_dirs t_create_long_dirs t_enospc t_mmap_writev_overlap checkpoint_journal mmap-rw-fault allocstale t_mmap_cow_memory_failure fake-dump-rootino dio-buf-fault xfsctl bstat t_mtab getdevicesize preallo_rw_pattern_reader preallo_rw_pattern_writer ftrunc trunc fs_perms testx looptest locktest unwritten_mmap bulkstat_unlink_test deduperace bulkstat_unlink_test_modified t_dir_offset t_futimens t_immutable stale_handle pwrite_mmap_blocked t_dir_offset2 seek_sanity_test seek_copy_test t_readdir_1 t_readdir_2 fsync-tester nsexec cloner renameat2 t_getcwd e4compact test-nextquota punch-alternating attr-list-by-handle-cursor-test listxattr dio-interleaved t_dir_type dio-invalidate-cache stat_test t_encrypted_d_revalidate attr_replace_test swapon mkswap t_attr_corruption t_open_tmpfiles fscrypt-crypt-util bulkstat_null_ocount splice-test chprojid_fail detached_mounts_propagation ext4_resize t_readdir_3 splice2pipe uuid_ioctl fiemap-tester t_stripealign open_by_handle t_mmap_dio xfsfind fssum /var/lib/xfstests/src 2023-07-05T18:58:33.215 INFO:teuthology.orchestra.run.smithi046.stdout:/bin/sh ../libtool --quiet --mode=install ../install-sh -o root -g root -m 755 dmerror fill2attr fill2fs fill2fs_check scaleread.sh btrfs_crc32c_forged_name.py popdir.pl popattr.py /var/lib/xfstests/src 2023-07-05T18:58:33.311 INFO:teuthology.orchestra.run.smithi046.stdout:/bin/sh ../libtool --quiet --mode=install ../install-sh -o root -g root -m 644 dumpfile /var/lib/xfstests/src 2023-07-05T18:58:33.346 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/gmake --no-print-directory Q=@ -C m4 install 2023-07-05T18:58:33.346 INFO:teuthology.orchestra.run.smithi046.stdout:gmake[1]: Nothing to be done for 'install'. 2023-07-05T18:58:33.346 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/gmake --no-print-directory Q=@ -C common install 2023-07-05T18:58:33.346 INFO:teuthology.orchestra.run.smithi046.stdout:../install-sh -o root -g root -m 755 -d /var/lib/xfstests/common 2023-07-05T18:58:33.359 INFO:teuthology.orchestra.run.smithi046.stdout:../install-sh -o root -g root -m 644 * /var/lib/xfstests/common 2023-07-05T18:58:33.490 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/gmake --no-print-directory Q=@ -C tests install 2023-07-05T18:58:33.491 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.rlt8E1h3iVxfstests-dev/tests/btrfs/ install 2023-07-05T18:58:33.495 INFO:teuthology.orchestra.run.smithi046.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/btrfs 2023-07-05T18:58:33.504 INFO:teuthology.orchestra.run.smithi046.stdout:../../install-sh -o root -g root -m 755 001 002 003 004 005 006 007 008 009 010 011 012 013 014 015 016 017 018 019 020 021 022 023 024 025 026 027 028 029 030 031 032 033 034 035 036 037 038 039 040 041 042 043 044 045 046 047 048 049 050 051 052 053 054 055 056 057 058 059 060 061 062 063 064 065 066 067 068 069 070 071 072 073 074 075 076 077 078 079 080 081 082 083 084 085 086 087 088 089 090 091 092 093 094 095 096 097 098 099 100 101 102 103 104 105 106 107 108 109 110 111 112 113 114 115 116 117 118 119 120 121 122 123 124 125 126 127 128 129 130 131 132 133 134 135 136 137 138 139 140 141 142 143 144 145 146 147 148 149 150 151 152 153 154 155 156 157 158 159 160 161 162 163 164 165 166 167 168 169 170 171 172 173 174 175 176 177 178 179 180 181 182 183 184 185 186 187 188 189 190 191 192 193 194 195 196 197 198 199 200 201 202 203 204 205 206 207 208 209 210 211 212 213 214 215 216 217 218 219 220 221 222 223 224 225 226 227 228 229 230 231 232 233 234 235 236 237 238 239 240 241 242 243 244 245 246 247 248 249 250 251 252 253 254 255 256 257 258 259 260 261 262 263 264 265 266 267 268 269 270 271 272 273 274 275 276 277 278 279 280 281 282 283 284 285 286 287 290 291 299 /var/lib/xfstests/tests/btrfs 2023-07-05T18:58:34.323 INFO:teuthology.orchestra.run.smithi046.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/btrfs 2023-07-05T18:58:34.332 INFO:teuthology.orchestra.run.smithi046.stdout:../../install-sh -o root -g root -m 644 057.out 175.out 186.out 240.out 069.out 092.out 077.out 140.out 265.out 236.out 108.out 204.out 177.out 194.out 234.out 249.out 109.out 033.out 082.out 252.out 270.out 040.out 176.out 202.out 137.out 034.out 125.out 014.out 165.out 181.out 152.out 142.out 264.out 192.out 148.out 282.out 267.out 052.out 228.out 183.out 094.out 273.out 251.out 110.out 043.out 209.out 151.out 206.out 195.out 274.out 215.out 115.out 015.out 250.out 191.out 281.out 046.out 051.out 244.out 219.out 119.out 019.out 128.out 232.out 248.out 162.out 147.out 197.out 196.out 242.out 004.out 189.out 220.out 120.out 020.out 102.out 263.out 171.out 261.out 045.out 217.out 117.out 017.out 072.out 068.out 048.out 062.out 038.out 084.out 129.out 233.out 066.out 029.out 229.out 103.out 254.out 111.out 011.out 243.out 275.out 134.out 170.out 260.out 157.out 143.out 133.out 286.out 161.out 246.out 216.out 116.out 016.out 155.out 118.out 287.out 067.out 010.out 238.out 138.out 095.out 184.out 160.out 190.out 291.out 081.out 024.out 071.out 061.out 047.out 200.out 100.out 025.out 139.out 258.out 185.out 269.out 208.out 039.out 222.out 035.out 169.out 098.out 290.out 080.out 070.out 060.out 207.out 106.out 009.out 167.out 003.out 211.out 158.out 085.out 146.out 188.out 104.out 089.out 086.out 279.out 225.out 174.out 156.out 135.out 257.out 124.out 172.out 058.out 262.out 036.out 042.out 193.out 097.out 271.out 283.out 083.out 199.out 099.out 278.out 053.out 164.out 239.out 241.out 002.out 178.out 141.out 214.out 114.out 074.out 056.out 012.out 041.out 223.out 150.out 123.out 179.out 144.out 032.out 277.out 205.out 136.out 005.out 096.out 198.out 008.out 280.out 050.out 105.out 027.out 187.out 091.out 153.out 088.out 285.out 044.out 201.out 101.out 001.out 266.out 237.out 065.out 231.out 227.out 075.out 131.out 213.out 113.out 013.out 031.out 182.out 272.out 078.out 173.out 259.out 210.out 132.out 037.out 093.out 235.out 127.out 230.out 166.out 130.out 023.out 073.out 030.out 203.out 063.out 055.out 245.out 145.out 159.out 122.out 076.out 022.out 006.out 284.out 299.out 224.out 154.out 276.out 149.out 064.out 218.out 018.out 168.out 007.out 079.out 054.out 059.out 049.out 226.out 163.out 126.out 121.out 026.out 180.out 268.out 253.out 255.out 090.out 221.out 087.out 212.out 112.out 256.out 021.out 247.out 028.out 107.out /var/lib/xfstests/tests/btrfs 2023-07-05T18:58:35.159 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.rlt8E1h3iVxfstests-dev/tests/ceph/ install 2023-07-05T18:58:35.160 INFO:teuthology.orchestra.run.smithi046.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/ceph 2023-07-05T18:58:35.170 INFO:teuthology.orchestra.run.smithi046.stdout:../../install-sh -o root -g root -m 755 001 002 003 004 005 /var/lib/xfstests/tests/ceph 2023-07-05T18:58:35.189 INFO:teuthology.orchestra.run.smithi046.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/ceph 2023-07-05T18:58:35.204 INFO:teuthology.orchestra.run.smithi046.stdout:../../install-sh -o root -g root -m 644 003.out 005.out 001.out 004.out 002.out /var/lib/xfstests/tests/ceph 2023-07-05T18:58:35.218 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.rlt8E1h3iVxfstests-dev/tests/cifs/ install 2023-07-05T18:58:35.220 INFO:teuthology.orchestra.run.smithi046.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/cifs 2023-07-05T18:58:35.229 INFO:teuthology.orchestra.run.smithi046.stdout:../../install-sh -o root -g root -m 755 001 /var/lib/xfstests/tests/cifs 2023-07-05T18:58:35.242 INFO:teuthology.orchestra.run.smithi046.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/cifs 2023-07-05T18:58:35.249 INFO:teuthology.orchestra.run.smithi046.stdout:../../install-sh -o root -g root -m 644 001.out /var/lib/xfstests/tests/cifs 2023-07-05T18:58:35.256 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.rlt8E1h3iVxfstests-dev/tests/ext4/ install 2023-07-05T18:58:35.260 INFO:teuthology.orchestra.run.smithi046.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/ext4 2023-07-05T18:58:35.267 INFO:teuthology.orchestra.run.smithi046.stdout:../../install-sh -o root -g root -m 755 001 002 003 004 005 006 007 008 009 010 011 012 013 014 015 016 017 018 019 020 021 022 023 024 025 026 027 028 029 030 031 032 033 034 035 036 037 038 039 040 041 042 043 044 045 046 047 048 049 050 051 052 053 054 055 056 057 058 059 271 301 302 303 304 305 306 307 308 /var/lib/xfstests/tests/ext4 2023-07-05T18:58:35.471 INFO:teuthology.orchestra.run.smithi046.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/ext4 2023-07-05T18:58:35.473 INFO:teuthology.orchestra.run.smithi046.stdout:../../install-sh -o root -g root -m 644 001.out.nodelalloc 001.out.default 001.out.nozero 001.cfg 032.out 039.out 305.out 005.out 008.out 035.out 036.out 308.out 050.out 040.out 306.out 007.out 021.out 046.out 012.out 009.out 033.out 045.out 034.out 056.out 047.out 018.out 023.out 302.out 020.out 002.out 014.out 024.out 013.out 031.out 015.out 304.out 004.out 048.out 038.out 052.out 303.out 029.out 011.out 027.out 042.out 044.out 055.out 030.out 058.out 003.out 017.out 043.out 053.out 016.out 059.out 037.out 301.out 010.out 022.out 006.out 057.out 025.out 026.out 271.out 051.out 041.out 307.out 019.out 028.out 054.out 049.out /var/lib/xfstests/tests/ext4 2023-07-05T18:58:35.680 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.rlt8E1h3iVxfstests-dev/tests/f2fs/ install 2023-07-05T18:58:35.681 INFO:teuthology.orchestra.run.smithi046.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/f2fs 2023-07-05T18:58:35.691 INFO:teuthology.orchestra.run.smithi046.stdout:../../install-sh -o root -g root -m 755 001 002 /var/lib/xfstests/tests/f2fs 2023-07-05T18:58:35.702 INFO:teuthology.orchestra.run.smithi046.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/f2fs 2023-07-05T18:58:35.712 INFO:teuthology.orchestra.run.smithi046.stdout:../../install-sh -o root -g root -m 644 001.out 002.out /var/lib/xfstests/tests/f2fs 2023-07-05T18:58:35.724 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.rlt8E1h3iVxfstests-dev/tests/generic/ install 2023-07-05T18:58:35.728 INFO:teuthology.orchestra.run.smithi046.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/generic 2023-07-05T18:58:35.741 INFO:teuthology.orchestra.run.smithi046.stdout:../../install-sh -o root -g root -m 755 001 002 003 004 005 006 007 008 009 010 011 012 013 014 015 016 017 018 019 020 021 022 023 024 025 026 027 028 029 030 031 032 033 034 035 036 037 038 039 040 041 042 043 044 045 046 047 048 049 050 051 052 053 054 055 056 057 058 059 060 061 062 063 064 065 066 067 068 069 070 071 072 073 074 075 076 077 078 079 080 081 082 083 084 085 086 087 088 089 090 091 092 093 094 095 096 097 098 099 100 101 102 103 104 105 106 107 108 109 110 111 112 113 114 115 116 117 118 119 120 121 122 123 124 125 126 127 128 129 130 131 132 133 134 135 136 137 138 139 140 141 142 143 144 145 146 147 148 149 150 151 152 153 154 155 156 157 158 159 160 161 162 163 164 165 166 167 168 169 170 171 172 173 174 175 176 177 178 179 180 181 182 183 184 185 186 187 188 189 190 191 192 193 194 195 196 197 198 199 200 201 202 203 204 205 206 207 208 209 210 211 212 213 214 215 216 217 218 219 220 221 222 223 224 225 226 227 228 229 230 231 232 233 234 235 236 237 238 239 240 241 242 243 244 245 246 247 248 249 250 251 252 253 254 255 256 257 258 259 260 261 262 263 264 265 266 267 268 269 270 271 272 273 274 275 276 277 278 279 280 281 282 283 284 285 286 287 288 289 290 291 292 293 294 295 296 297 298 299 300 301 302 303 304 305 306 307 308 309 310 311 312 313 314 315 316 317 318 319 320 321 322 323 324 325 326 327 328 329 330 331 332 333 334 335 336 337 338 339 340 341 342 343 344 345 346 347 348 349 350 351 352 353 354 355 356 357 358 359 360 361 362 363 364 365 366 367 368 369 370 371 372 373 374 375 376 377 378 379 380 381 382 383 384 385 386 387 388 389 390 391 392 393 394 395 396 397 398 399 400 401 402 403 404 405 406 407 408 409 410 411 412 413 414 415 416 417 418 419 420 421 422 423 424 425 426 427 428 429 430 431 432 433 434 435 436 437 438 439 440 441 442 443 444 445 446 447 448 449 450 451 452 453 454 455 456 457 458 459 460 461 462 463 464 465 466 467 468 469 470 471 472 473 474 475 476 477 478 479 480 481 482 483 484 485 486 487 488 489 490 491 492 493 494 495 496 497 498 499 500 501 502 503 504 505 506 507 508 509 510 511 512 513 514 515 516 517 518 519 520 521 522 523 524 525 526 527 528 529 530 531 532 533 534 535 536 537 538 539 540 541 542 543 544 545 546 547 548 549 550 551 552 553 554 555 556 557 558 559 560 561 562 563 564 565 566 567 568 569 570 571 572 573 574 575 576 577 578 579 580 581 582 583 584 585 586 587 588 589 590 591 592 593 594 595 596 597 598 599 600 601 602 603 604 605 606 607 608 609 610 611 612 613 614 615 616 617 618 619 620 621 622 623 624 625 626 627 628 629 630 631 632 633 634 635 636 637 638 639 640 641 642 643 644 645 646 647 648 649 650 651 652 653 654 655 656 657 658 659 660 661 662 663 664 665 666 667 668 669 670 671 672 673 674 675 676 677 678 679 680 681 682 683 684 685 686 687 688 689 690 691 692 693 694 695 696 697 698 699 700 701 702 703 704 705 706 707 708 709 710 711 712 713 714 715 716 717 718 719 720 721 722 723 724 725 726 727 728 /var/lib/xfstests/tests/generic 2023-07-05T18:58:37.799 INFO:teuthology.orchestra.run.smithi046.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/generic 2023-07-05T18:58:37.806 INFO:teuthology.orchestra.run.smithi046.stdout:../../install-sh -o root -g root -m 644 050.out.xfsquota 035.out.nfs 035.out.default 050.out.nojournal 050.out.default 050.cfg 035.cfg 208.out 433.out 670.out 040.out 104.out 575.out 537.out 683.out 497.out 337.out 702.out 460.out 149.out 088.out 366.out 202.out 137.out 034.out 110.out 389.out 403.out 593.out 571.out 243.out 592.out 282.out 472.out 468.out 628.out 528.out 607.out 428.out 659.out 407.out 228.out 128.out 171.out 028.out 620.out 273.out 474.out 492.out 609.out 707.out 693.out 595.out 506.out 268.out 632.out 532.out 591.out 281.out 471.out 619.out 519.out 013.out 419.out 319.out 177.out 523.out 119.out 019.out 727.out 372.out 686.out 312.out 718.out 143.out 716.out 161.out 516.out 518.out 538.out 655.out 216.out 116.out 016.out 155.out 338.out 238.out 500.out 138.out 189.out 263.out 277.out 181.out 160.out 483.out 274.out 722.out 061.out 239.out 457.out 333.out 258.out 362.out 379.out 691.out 039.out 173.out 498.out 665.out 098.out 711.out 290.out 480.out 706.out 060.out 406.out 306.out 106.out 642.out 447.out 217.out 120.out 191.out 411.out 357.out 481.out 211.out 158.out 014.out 182.out 370.out 188.out 030.out 099.out 585.out 724.out 721.out 624.out 524.out 174.out 156.out 324.out 224.out 313.out 355.out 124.out 382.out 672.out 278.out 063.out 058.out 384.out 296.out 042.out 193.out 271.out 465.out 473.out 335.out 247.out 509.out 568.out 441.out 440.out 475.out 548.out 356.out 341.out 094.out 241.out 600.out 089.out 714.out 614.out 514.out 414.out 314.out 416.out 214.out 381.out 056.out 041.out 057.out 340.out 358.out 572.out 586.out 521.out 240.out 549.out 095.out 633.out 434.out 140.out 708.out 533.out 508.out 408.out 308.out 476.out 087.out 199.out 458.out 233.out 639.out 443.out 540.out 397.out 053.out 279.out 276.out 448.out 164.out 376.out 589.out 587.out 339.out 294.out 352.out 484.out 489.out 139.out 317.out 399.out 220.out 552.out 695.out 017.out 677.out 097.out 175.out 315.out 295.out 580.out 075.out 186.out 452.out 679.out 292.out 252.out 077.out 167.out 688.out 206.out 348.out 394.out 651.out 184.out 466.out 697.out 495.out 725.out 109.out 482.out 625.out 283.out 525.out 488.out 496.out 325.out 551.out 225.out 322.out 636.out 125.out 715.out 192.out 544.out 515.out 650.out 152.out 658.out 563.out 393.out 578.out 015.out 392.out 682.out 684.out 550.out 052.out 652.out 534.out 351.out 583.out 451.out 450.out 463.out 251.out 267.out 176.out 069.out 644.out 065.out 487.out 615.out 395.out 676.out 415.out 344.out 215.out 115.out 444.out 027.out 250.out 391.out 674.out 464.out 705.out 536.out 577.out 439.out 244.out 336.out 144.out 505.out 405.out 342.out 205.out 136.out 598.out 363.out 036.out 198.out 723.out 008.out 390.out 680.out 605.out 305.out 105.out 005.out 367.out 291.out 719.out 323.out 685.out 562.out 570.out 388.out 527.out 237.out 151.out 227.out 163.out 332.out 661.out 582.out 232.out 478.out 584.out 462.out 597.out 412.out 132.out 179.out 037.out 293.out 499.out 638.out 353.out 020.out 660.out 561.out 141.out 076.out 668.out 044.out 648.out 387.out 594.out 438.out 265.out 289.out 574.out 006.out 690.out 284.out 567.out 299.out 456.out 461.out 477.out 307.out 647.out 493.out 107.out 007.out 380.out 526.out 479.out 426.out 150.out 326.out 082.out 226.out 413.out 126.out 025.out 121.out 026.out 021.out 485.out 694.out 347.out 275.out 090.out 361.out 564.out 302.out 432.out 002.out 558.out 162.out 147.out 288.out 197.out 033.out 396.out 051.out 350.out 547.out 047.out 024.out 360.out 543.out 261.out 045.out 692.out 255.out 726.out 378.out 346.out 048.out 062.out 626.out 529.out 231.out 343.out 662.out 425.out 329.out 165.out 334.out 103.out 003.out 129.out 423.out 371.out 234.out 183.out 671.out 645.out 673.out 190.out 486.out 223.out 123.out 262.out 669.out 023.out 459.out 616.out 032.out 266.out 146.out 398.out 728.out 696.out 427.out 590.out 280.out 470.out 455.out 187.out 091.out 046.out 374.out 631.out 328.out 260.out 654.out 359.out 531.out 649.out 301.out 101.out 635.out 623.out 385.out 331.out 556.out 713.out 613.out 513.out 622.out 131.out 213.out 634.out 031.out 565.out 630.out 675.out 272.out 530.out 510.out 627.out 573.out 576.out 430.out 310.out 569.out 454.out 259.out 210.out 449.out 327.out 330.out 067.out 093.out 604.out 287.out 127.out 699.out 166.out 130.out 219.out 073.out 603.out 503.out 303.out 203.out 354.out 157.out 386.out 349.out 055.out 245.out 709.out 522.out 422.out 222.out 159.out 539.out 249.out 122.out 689.out 022.out 681.out 424.out 321.out 066.out 490.out 435.out 375.out 134.out 154.out 566.out 618.out 501.out 418.out 318.out 542.out 218.out 118.out 018.out 377.out 172.out 168.out 079.out 469.out 054.out 059.out 049.out 442.out 657.out 621.out 180.out 270.out 253.out 421.out 712.out 612.out 667.out 512.out 494.out 221.out 212.out 112.out 256.out 012.out 029.out 195.out 554.out 148.out 185.out 596.out 720.out 248.out 196.out 520.out 242.out 420.out 285.out 320.out 629.out 230.out 602.out 502.out 402.out 102.out 717.out 617.out 517.out 429.out 417.out 365.out 092.out 117.out 664.out 072.out 068.out 229.out 038.out 084.out 369.out 611.out 511.out 311.out 368.out 637.out 111.out 011.out 257.out 194.out 170.out 606.out 133.out 286.out 043.out 437.out 545.out 559.out 710.out 610.out 687.out 410.out 701.out 601.out 401.out 201.out 010.out 001.out 096.out 114.out 113.out 074.out 581.out 145.out 641.out 491.out 081.out 071.out 083.out 653.out 700.out 064.out 400.out 300.out 200.out 100.out 646.out 541.out 445.out 269.out 546.out 656.out 698.out 553.out 178.out 298.out 446.out 080.out 070.out 608.out 507.out 409.out 309.out 209.out 108.out 009.out 643.out 004.out 557.out 453.out 666.out 236.out 078.out 364.out 555.out 383.out 085.out 704.out 588.out 504.out 404.out 304.out 204.out 535.out 345.out 246.out 467.out 086.out 254.out 207.out 142.out 235.out 436.out 703.out 135.out 264.out 431.out 678.out 373.out 316.out 169.out 640.out 579.out 297.out 153.out 560.out 663.out 599.out /var/lib/xfstests/tests/generic 2023-07-05T18:58:39.904 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.rlt8E1h3iVxfstests-dev/tests/nfs/ install 2023-07-05T18:58:39.905 INFO:teuthology.orchestra.run.smithi046.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/nfs 2023-07-05T18:58:39.914 INFO:teuthology.orchestra.run.smithi046.stdout:../../install-sh -o root -g root -m 755 001 /var/lib/xfstests/tests/nfs 2023-07-05T18:58:39.924 INFO:teuthology.orchestra.run.smithi046.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/nfs 2023-07-05T18:58:39.932 INFO:teuthology.orchestra.run.smithi046.stdout:../../install-sh -o root -g root -m 644 001.out /var/lib/xfstests/tests/nfs 2023-07-05T18:58:39.941 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.rlt8E1h3iVxfstests-dev/tests/ocfs2/ install 2023-07-05T18:58:39.943 INFO:teuthology.orchestra.run.smithi046.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/ocfs2 2023-07-05T18:58:39.952 INFO:teuthology.orchestra.run.smithi046.stdout:../../install-sh -o root -g root -m 755 001 /var/lib/xfstests/tests/ocfs2 2023-07-05T18:58:39.961 INFO:teuthology.orchestra.run.smithi046.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/ocfs2 2023-07-05T18:58:39.969 INFO:teuthology.orchestra.run.smithi046.stdout:../../install-sh -o root -g root -m 644 001.out /var/lib/xfstests/tests/ocfs2 2023-07-05T18:58:39.978 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.rlt8E1h3iVxfstests-dev/tests/overlay/ install 2023-07-05T18:58:39.980 INFO:teuthology.orchestra.run.smithi046.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/overlay 2023-07-05T18:58:39.989 INFO:teuthology.orchestra.run.smithi046.stdout:../../install-sh -o root -g root -m 755 001 002 003 004 005 006 007 008 009 010 011 012 013 014 015 016 017 018 019 020 021 022 023 024 025 026 027 028 029 030 031 032 033 034 035 036 037 038 039 040 041 042 043 044 045 046 047 048 049 050 051 052 053 054 055 056 057 058 059 060 061 062 063 064 065 066 067 068 069 070 071 072 073 074 075 076 077 078 100 101 102 103 104 105 106 107 108 109 110 111 112 113 114 115 116 117 /var/lib/xfstests/tests/overlay 2023-07-05T18:58:40.264 INFO:teuthology.orchestra.run.smithi046.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/overlay 2023-07-05T18:58:40.274 INFO:teuthology.orchestra.run.smithi046.stdout:../../install-sh -o root -g root -m 644 019.out 034.out 018.out 024.out 077.out 069.out 020.out 102.out 014.out 013.out 031.out 015.out 117.out 017.out 072.out 068.out 063.out 048.out 062.out 038.out 026.out 042.out 052.out 110.out 067.out 029.out 111.out 055.out 112.out 073.out 078.out 030.out 058.out 003.out 045.out 023.out 043.out 053.out 109.out 036.out 116.out 016.out 065.out 010.out 001.out 022.out 106.out 007.out 006.out 115.out 057.out 113.out 114.out 074.out 046.out 071.out 061.out 025.out 051.out 011.out 041.out 047.out 100.out 064.out 107.out 104.out 028.out 076.out 054.out 059.out 008.out 049.out 032.out 039.out 021.out 005.out 002.out 035.out 108.out 070.out 060.out 050.out 027.out 105.out 009.out 004.out 037.out 044.out 012.out 101.out 103.out 033.out 066.out 040.out 056.out 075.out /var/lib/xfstests/tests/overlay 2023-07-05T18:58:40.550 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.rlt8E1h3iVxfstests-dev/tests/perf/ install 2023-07-05T18:58:40.550 INFO:teuthology.orchestra.run.smithi046.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/perf 2023-07-05T18:58:40.559 INFO:teuthology.orchestra.run.smithi046.stdout:../../install-sh -o root -g root -m 755 001 /var/lib/xfstests/tests/perf 2023-07-05T18:58:40.568 INFO:teuthology.orchestra.run.smithi046.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/perf 2023-07-05T18:58:40.580 INFO:teuthology.orchestra.run.smithi046.stdout:../../install-sh -o root -g root -m 644 001.out /var/lib/xfstests/tests/perf 2023-07-05T18:58:40.588 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.rlt8E1h3iVxfstests-dev/tests/selftest/ install 2023-07-05T18:58:40.592 INFO:teuthology.orchestra.run.smithi046.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/selftest 2023-07-05T18:58:40.599 INFO:teuthology.orchestra.run.smithi046.stdout:../../install-sh -o root -g root -m 755 001 002 003 004 005 006 /var/lib/xfstests/tests/selftest 2023-07-05T18:58:40.619 INFO:teuthology.orchestra.run.smithi046.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/selftest 2023-07-05T18:58:40.628 INFO:teuthology.orchestra.run.smithi046.stdout:../../install-sh -o root -g root -m 644 006.out 003.out 005.out 001.out 004.out 002.out /var/lib/xfstests/tests/selftest 2023-07-05T18:58:40.651 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.rlt8E1h3iVxfstests-dev/tests/shared/ install 2023-07-05T18:58:40.653 INFO:teuthology.orchestra.run.smithi046.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/shared 2023-07-05T18:58:40.666 INFO:teuthology.orchestra.run.smithi046.stdout:../../install-sh -o root -g root -m 755 002 032 298 /var/lib/xfstests/tests/shared 2023-07-05T18:58:40.677 INFO:teuthology.orchestra.run.smithi046.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/shared 2023-07-05T18:58:40.685 INFO:teuthology.orchestra.run.smithi046.stdout:../../install-sh -o root -g root -m 644 032.out 298.out 002.out /var/lib/xfstests/tests/shared 2023-07-05T18:58:40.700 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.rlt8E1h3iVxfstests-dev/tests/tmpfs/ install 2023-07-05T18:58:40.702 INFO:teuthology.orchestra.run.smithi046.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/tmpfs 2023-07-05T18:58:40.710 INFO:teuthology.orchestra.run.smithi046.stdout:../../install-sh -o root -g root -m 755 001 /var/lib/xfstests/tests/tmpfs 2023-07-05T18:58:40.720 INFO:teuthology.orchestra.run.smithi046.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/tmpfs 2023-07-05T18:58:40.728 INFO:teuthology.orchestra.run.smithi046.stdout:../../install-sh -o root -g root -m 644 001.out /var/lib/xfstests/tests/tmpfs 2023-07-05T18:58:40.739 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.rlt8E1h3iVxfstests-dev/tests/udf/ install 2023-07-05T18:58:40.739 INFO:teuthology.orchestra.run.smithi046.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/udf 2023-07-05T18:58:40.748 INFO:teuthology.orchestra.run.smithi046.stdout:../../install-sh -o root -g root -m 755 102 /var/lib/xfstests/tests/udf 2023-07-05T18:58:40.759 INFO:teuthology.orchestra.run.smithi046.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/udf 2023-07-05T18:58:40.765 INFO:teuthology.orchestra.run.smithi046.stdout:../../install-sh -o root -g root -m 644 102.out /var/lib/xfstests/tests/udf 2023-07-05T18:58:40.774 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.rlt8E1h3iVxfstests-dev/tests/xfs/ install 2023-07-05T18:58:40.778 INFO:teuthology.orchestra.run.smithi046.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/xfs 2023-07-05T18:58:40.787 INFO:teuthology.orchestra.run.smithi046.stdout:../../install-sh -o root -g root -m 755 001 002 003 004 005 006 007 008 009 010 011 012 013 014 015 016 017 018 019 020 021 022 023 024 025 026 027 028 029 030 031 032 033 034 035 036 037 038 039 040 041 042 043 044 045 046 047 048 049 050 051 052 053 054 055 056 057 058 059 060 061 062 063 064 065 066 067 068 069 070 071 072 073 074 075 076 077 078 079 080 081 082 083 084 085 086 087 088 089 090 091 092 093 094 095 096 097 098 099 100 101 102 103 104 105 106 107 108 109 110 111 112 113 114 115 116 117 118 119 120 121 122 123 124 125 126 127 128 129 130 131 132 133 134 135 136 137 138 139 140 141 142 143 144 145 146 147 148 149 150 151 152 153 154 155 156 157 158 159 160 161 162 163 164 165 166 167 168 169 170 171 172 173 174 175 176 177 178 179 180 181 182 183 184 185 186 187 188 189 190 191 192 193 194 195 196 197 198 199 200 201 202 203 204 205 206 207 208 209 210 211 212 213 214 215 216 217 218 219 220 221 222 223 224 225 226 227 228 229 230 231 232 233 234 235 236 237 238 239 240 241 242 243 244 245 246 247 248 249 250 251 252 253 254 255 256 257 258 259 260 261 262 263 264 265 266 267 268 269 270 271 272 273 274 275 276 277 278 279 280 281 282 283 284 285 286 287 288 289 290 291 292 293 294 295 296 297 298 299 300 301 302 303 304 305 306 307 308 309 310 311 312 313 314 315 316 317 318 319 320 321 322 323 324 325 326 327 328 329 330 331 332 333 334 335 336 337 338 339 340 341 342 343 344 345 346 347 348 349 350 351 352 353 354 355 356 357 358 359 360 361 362 363 364 365 366 367 368 369 370 371 372 373 374 375 376 377 378 379 380 381 382 383 384 385 386 387 388 389 390 391 392 393 394 395 396 397 398 399 400 401 402 403 404 405 406 407 408 409 410 411 412 413 414 415 416 417 418 419 420 421 422 423 424 425 426 427 428 429 430 431 432 433 434 435 436 437 438 439 440 441 442 443 444 445 446 447 448 449 450 451 452 453 454 455 456 457 458 459 460 461 462 463 464 465 466 467 468 469 470 471 472 473 474 475 476 477 478 479 480 481 482 483 484 485 486 487 488 489 490 491 492 493 494 495 496 497 498 499 500 501 502 503 504 505 506 507 508 509 510 511 512 513 514 515 516 517 518 519 520 521 522 523 524 525 526 527 528 529 530 531 532 533 534 535 536 537 538 539 540 541 542 543 544 545 546 547 548 549 550 551 552 553 554 555 556 557 558 559 560 561 562 563 564 565 566 567 568 570 571 572 573 574 575 576 577 578 579 580 581 582 583 584 585 586 587 588 589 590 591 592 593 594 595 708 709 710 711 712 713 714 715 716 717 718 719 720 721 722 723 724 725 726 727 728 729 730 731 732 733 734 735 736 737 738 739 740 741 742 743 744 745 746 747 748 749 750 751 752 753 754 755 756 757 758 759 760 761 762 763 764 765 766 767 768 769 770 771 772 773 774 775 776 777 778 779 780 781 782 783 784 785 786 787 788 789 790 791 792 793 794 795 796 797 798 799 800 /var/lib/xfstests/tests/xfs 2023-07-05T18:58:42.746 INFO:teuthology.orchestra.run.smithi046.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/xfs 2023-07-05T18:58:42.757 INFO:teuthology.orchestra.run.smithi046.stdout:../../install-sh -o root -g root -m 644 096.out.internal 033.out.crc 096.out.external 033.out.default 071.out.64 216.out.classic 216.out.64mblog 071.out.32 216.cfg 033.cfg 040.out 304.out 349.out 457.out 537.out 295.out 497.out 337.out 385.out 082.out 270.out 460.out 149.out 759.out 502.out 088.out 366.out 202.out 137.out 746.out 110.out 468.out 018.out 593.out 571.out 567.out 592.out 282.out 267.out 728.out 178.out 799.out 528.out 769.out 428.out 507.out 407.out 228.out 128.out 171.out 183.out 247.out 273.out 474.out 109.out 595.out 506.out 732.out 268.out 035.out 113.out 532.out 591.out 281.out 471.out 723.out 519.out 319.out 467.out 523.out 119.out 775.out 727.out 372.out 503.out 526.out 329.out 165.out 229.out 103.out 129.out 371.out 234.out 738.out 078.out 718.out 143.out 716.out 161.out 516.out 416.out 116.out 043.out 155.out 338.out 067.out 238.out 500.out 138.out 189.out 263.out 277.out 181.out 160.out 483.out 274.out 722.out 061.out 239.out 047.out 772.out 258.out 379.out 322.out 039.out 173.out 222.out 742.out 098.out 426.out 290.out 480.out 060.out 406.out 306.out 141.out 106.out 006.out 167.out 191.out 017.out 542.out 211.out 783.out 485.out 442.out 099.out 177.out 174.out 156.out 771.out 324.out 224.out 313.out 124.out 758.out 278.out 058.out 741.out 384.out 773.out 042.out 193.out 392.out 768.out 399.out 473.out 770.out 709.out 755.out 364.out 209.out 441.out 440.out 157.out 740.out 356.out 197.out 341.out 187.out 094.out 241.out 501.out 089.out 540.out 365.out 514.out 414.out 314.out 214.out 381.out 056.out 041.out 340.out 793.out 358.out 572.out 568.out 586.out 240.out 549.out 092.out 439.out 434.out 140.out 708.out 265.out 508.out 408.out 308.out 208.out 737.out 204.out 535.out 104.out 733.out 544.out 059.out 249.out 335.out 142.out 235.out 575.out 253.out 715.out 533.out 264.out 431.out 784.out 433.out 316.out 169.out 579.out 297.out 393.out 333.out 476.out 087.out 199.out 739.out 068.out 233.out 752.out 736.out 443.out 086.out 053.out 749.out 279.out 276.out 711.out 164.out 589.out 587.out 339.out 577.out 294.out 352.out 458.out 498.out 489.out 139.out 774.out 790.out 552.out 781.out 357.out 065.out 186.out 452.out 069.out 252.out 585.out 751.out 724.out 206.out 190.out 794.out 348.out 184.out 435.out 466.out 248.out 725.out 785.out 482.out 750.out 525.out 496.out 325.out 176.out 225.out 125.out 789.out 192.out 296.out 152.out 563.out 246.out 551.out 436.out 792.out 075.out 472.out 578.out 463.out 550.out 052.out 534.out 351.out 430.out 583.out 305.out 451.out 425.out 450.out 744.out 251.out 444.out 487.out 762.out 465.out 395.out 515.out 415.out 389.out 315.out 215.out 115.out 015.out 027.out 250.out 344.out 046.out 051.out 536.out 254.out 030.out 244.out 336.out 028.out 150.out 144.out 505.out 342.out 136.out 005.out 036.out 198.out 008.out 390.out 405.out 588.out 205.out 105.out 367.out 291.out 437.out 719.out 323.out 363.out 562.out 382.out 570.out 388.out 527.out 158.out 766.out 019.out 237.out 151.out 760.out 227.out 163.out 332.out 796.out 232.out 478.out 584.out 462.out 220.out 412.out 132.out 179.out 037.out 293.out 492.out 499.out 112.out 748.out 020.out 786.out 063.out 561.out 076.out 044.out 014.out 362.out 387.out 594.out 438.out 721.out 289.out 574.out 284.out 548.out 299.out 419.out 521.out 581.out 461.out 477.out 307.out 726.out 107.out 007.out 448.out 262.out 380.out 093.out 479.out 547.out 326.out 226.out 345.out 126.out 025.out 121.out 447.out 761.out 580.out 013.out 347.out 275.out 090.out 361.out 564.out 788.out 066.out 455.out 432.out 747.out 558.out 162.out 147.out 288.out 050.out 396.out 576.out 350.out 354.out 298.out 301.out 360.out 543.out 261.out 734.out 045.out 292.out 255.out 729.out 378.out 346.out 048.out 062.out 529.out 231.out 343.out 486.out 223.out 123.out 023.out 459.out 032.out 798.out 146.out 398.out 168.out 427.out 590.out 280.out 470.out 484.out 491.out 767.out 016.out 488.out 731.out 782.out 374.out 285.out 127.out 328.out 260.out 359.out 531.out 376.out 101.out 266.out 331.out 791.out 743.out 556.out 713.out 024.out 513.out 131.out 213.out 730.out 095.out 031.out 565.out 182.out 272.out 530.out 754.out 573.out 454.out 259.out 449.out 327.out 330.out 777.out 493.out 010.out 287.out 230.out 166.out 130.out 219.out 073.out 370.out 135.out 303.out 203.out 003.out 355.out 386.out 560.out 055.out 245.out 243.out 522.out 787.out 745.out 422.out 394.out 159.out 539.out 524.out 122.out 022.out 424.out 779.out 490.out 795.out 353.out 423.out 134.out 154.out 764.out 271.out 518.out 418.out 318.out 077.out 218.out 118.out 757.out 377.out 172.out 034.out 079.out 469.out 054.out 049.out 765.out 021.out 002.out 456.out 180.out 421.out 712.out 403.out 321.out 057.out 512.out 494.out 221.out 312.out 212.out 538.out 256.out 012.out 195.out 283.out 554.out 397.out 185.out 373.out 720.out 481.out 196.out 520.out 242.out 026.out 420.out 188.out 320.out 555.out 120.out 153.out 402.out 302.out 102.out 717.out 517.out 429.out 417.out 317.out 217.out 117.out 475.out 072.out 778.out 097.out 038.out 084.out 369.out 511.out 148.out 411.out 029.out 311.out 368.out 111.out 011.out 257.out 194.out 170.out 133.out 286.out 756.out 175.out 545.out 714.out 559.out 710.out 510.out 413.out 410.out 310.out 210.out 401.out 201.out 001.out 495.out 114.out 753.out 074.out 145.out 797.out 464.out 091.out 081.out 083.out 800.out 064.out 400.out 300.out 200.out 100.out 375.out 541.out 445.out 269.out 546.out 780.out 553.out 763.out 446.out 080.out 070.out 509.out 409.out 309.out 207.out 108.out 009.out 391.out 004.out 557.out 453.out 236.out 566.out 582.out 735.out 383.out 085.out 334.out 504.out 404.out 776.out /var/lib/xfstests/tests/xfs 2023-07-05T18:58:44.737 INFO:teuthology.orchestra.run.smithi046.stdout:../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests 2023-07-05T18:58:44.744 INFO:teuthology.orchestra.run.smithi046.stdout:./install-sh -o root -g root -m 755 -d /var/lib/xfstests 2023-07-05T18:58:44.757 INFO:teuthology.orchestra.run.smithi046.stdout:./install-sh -o root -g root -m 755 check /var/lib/xfstests 2023-07-05T18:58:44.763 INFO:teuthology.orchestra.run.smithi046.stdout:./install-sh -o root -g root -m 644 randomize.awk /var/lib/xfstests 2023-07-05T18:58:44.778 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-05T18:58:44.779 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.rlt8E1h3iVxfstests-dev && exec ls tests/generic) 2023-07-05T18:58:44.839 INFO:teuthology.orchestra.run.smithi046.stdout:001 2023-07-05T18:58:44.839 INFO:teuthology.orchestra.run.smithi046.stdout:001.out 2023-07-05T18:58:44.840 INFO:teuthology.orchestra.run.smithi046.stdout:002 2023-07-05T18:58:44.843 INFO:teuthology.orchestra.run.smithi046.stdout:002.out 2023-07-05T18:58:44.844 INFO:teuthology.orchestra.run.smithi046.stdout:003 2023-07-05T18:58:44.844 INFO:teuthology.orchestra.run.smithi046.stdout:003.out 2023-07-05T18:58:44.844 INFO:teuthology.orchestra.run.smithi046.stdout:004 2023-07-05T18:58:44.845 INFO:teuthology.orchestra.run.smithi046.stdout:004.out 2023-07-05T18:58:44.845 INFO:teuthology.orchestra.run.smithi046.stdout:005 2023-07-05T18:58:44.845 INFO:teuthology.orchestra.run.smithi046.stdout:005.out 2023-07-05T18:58:44.845 INFO:teuthology.orchestra.run.smithi046.stdout:006 2023-07-05T18:58:44.845 INFO:teuthology.orchestra.run.smithi046.stdout:006.out 2023-07-05T18:58:44.846 INFO:teuthology.orchestra.run.smithi046.stdout:007 2023-07-05T18:58:44.846 INFO:teuthology.orchestra.run.smithi046.stdout:007.out 2023-07-05T18:58:44.846 INFO:teuthology.orchestra.run.smithi046.stdout:008 2023-07-05T18:58:44.846 INFO:teuthology.orchestra.run.smithi046.stdout:008.out 2023-07-05T18:58:44.850 INFO:teuthology.orchestra.run.smithi046.stdout:009 2023-07-05T18:58:44.850 INFO:teuthology.orchestra.run.smithi046.stdout:009.out 2023-07-05T18:58:44.850 INFO:teuthology.orchestra.run.smithi046.stdout:010 2023-07-05T18:58:44.850 INFO:teuthology.orchestra.run.smithi046.stdout:010.out 2023-07-05T18:58:44.851 INFO:teuthology.orchestra.run.smithi046.stdout:011 2023-07-05T18:58:44.851 INFO:teuthology.orchestra.run.smithi046.stdout:011.out 2023-07-05T18:58:44.851 INFO:teuthology.orchestra.run.smithi046.stdout:012 2023-07-05T18:58:44.851 INFO:teuthology.orchestra.run.smithi046.stdout:012.out 2023-07-05T18:58:44.851 INFO:teuthology.orchestra.run.smithi046.stdout:013 2023-07-05T18:58:44.852 INFO:teuthology.orchestra.run.smithi046.stdout:013.out 2023-07-05T18:58:44.852 INFO:teuthology.orchestra.run.smithi046.stdout:014 2023-07-05T18:58:44.852 INFO:teuthology.orchestra.run.smithi046.stdout:014.out 2023-07-05T18:58:44.852 INFO:teuthology.orchestra.run.smithi046.stdout:015 2023-07-05T18:58:44.852 INFO:teuthology.orchestra.run.smithi046.stdout:015.out 2023-07-05T18:58:44.852 INFO:teuthology.orchestra.run.smithi046.stdout:016 2023-07-05T18:58:44.852 INFO:teuthology.orchestra.run.smithi046.stdout:016.out 2023-07-05T18:58:44.853 INFO:teuthology.orchestra.run.smithi046.stdout:017 2023-07-05T18:58:44.853 INFO:teuthology.orchestra.run.smithi046.stdout:017.out 2023-07-05T18:58:44.853 INFO:teuthology.orchestra.run.smithi046.stdout:018 2023-07-05T18:58:44.853 INFO:teuthology.orchestra.run.smithi046.stdout:018.out 2023-07-05T18:58:44.853 INFO:teuthology.orchestra.run.smithi046.stdout:019 2023-07-05T18:58:44.853 INFO:teuthology.orchestra.run.smithi046.stdout:019.out 2023-07-05T18:58:44.853 INFO:teuthology.orchestra.run.smithi046.stdout:020 2023-07-05T18:58:44.853 INFO:teuthology.orchestra.run.smithi046.stdout:020.out 2023-07-05T18:58:44.854 INFO:teuthology.orchestra.run.smithi046.stdout:021 2023-07-05T18:58:44.854 INFO:teuthology.orchestra.run.smithi046.stdout:021.out 2023-07-05T18:58:44.854 INFO:teuthology.orchestra.run.smithi046.stdout:022 2023-07-05T18:58:44.854 INFO:teuthology.orchestra.run.smithi046.stdout:022.out 2023-07-05T18:58:44.854 INFO:teuthology.orchestra.run.smithi046.stdout:023 2023-07-05T18:58:44.854 INFO:teuthology.orchestra.run.smithi046.stdout:023.out 2023-07-05T18:58:44.854 INFO:teuthology.orchestra.run.smithi046.stdout:024 2023-07-05T18:58:44.855 INFO:teuthology.orchestra.run.smithi046.stdout:024.out 2023-07-05T18:58:44.855 INFO:teuthology.orchestra.run.smithi046.stdout:025 2023-07-05T18:58:44.855 INFO:teuthology.orchestra.run.smithi046.stdout:025.out 2023-07-05T18:58:44.855 INFO:teuthology.orchestra.run.smithi046.stdout:026 2023-07-05T18:58:44.855 INFO:teuthology.orchestra.run.smithi046.stdout:026.out 2023-07-05T18:58:44.855 INFO:teuthology.orchestra.run.smithi046.stdout:027 2023-07-05T18:58:44.855 INFO:teuthology.orchestra.run.smithi046.stdout:027.out 2023-07-05T18:58:44.855 INFO:teuthology.orchestra.run.smithi046.stdout:028 2023-07-05T18:58:44.856 INFO:teuthology.orchestra.run.smithi046.stdout:028.out 2023-07-05T18:58:44.856 INFO:teuthology.orchestra.run.smithi046.stdout:029 2023-07-05T18:58:44.856 INFO:teuthology.orchestra.run.smithi046.stdout:029.out 2023-07-05T18:58:44.862 INFO:teuthology.orchestra.run.smithi046.stdout:030 2023-07-05T18:58:44.862 INFO:teuthology.orchestra.run.smithi046.stdout:030.out 2023-07-05T18:58:44.862 INFO:teuthology.orchestra.run.smithi046.stdout:031 2023-07-05T18:58:44.862 INFO:teuthology.orchestra.run.smithi046.stdout:031.out 2023-07-05T18:58:44.862 INFO:teuthology.orchestra.run.smithi046.stdout:032 2023-07-05T18:58:44.862 INFO:teuthology.orchestra.run.smithi046.stdout:032.out 2023-07-05T18:58:44.863 INFO:teuthology.orchestra.run.smithi046.stdout:033 2023-07-05T18:58:44.863 INFO:teuthology.orchestra.run.smithi046.stdout:033.out 2023-07-05T18:58:44.863 INFO:teuthology.orchestra.run.smithi046.stdout:034 2023-07-05T18:58:44.863 INFO:teuthology.orchestra.run.smithi046.stdout:034.out 2023-07-05T18:58:44.863 INFO:teuthology.orchestra.run.smithi046.stdout:035 2023-07-05T18:58:44.863 INFO:teuthology.orchestra.run.smithi046.stdout:035.cfg 2023-07-05T18:58:44.863 INFO:teuthology.orchestra.run.smithi046.stdout:035.out.default 2023-07-05T18:58:44.863 INFO:teuthology.orchestra.run.smithi046.stdout:035.out.nfs 2023-07-05T18:58:44.864 INFO:teuthology.orchestra.run.smithi046.stdout:036 2023-07-05T18:58:44.864 INFO:teuthology.orchestra.run.smithi046.stdout:036.out 2023-07-05T18:58:44.865 INFO:teuthology.orchestra.run.smithi046.stdout:037 2023-07-05T18:58:44.865 INFO:teuthology.orchestra.run.smithi046.stdout:037.out 2023-07-05T18:58:44.865 INFO:teuthology.orchestra.run.smithi046.stdout:038 2023-07-05T18:58:44.865 INFO:teuthology.orchestra.run.smithi046.stdout:038.out 2023-07-05T18:58:44.865 INFO:teuthology.orchestra.run.smithi046.stdout:039 2023-07-05T18:58:44.865 INFO:teuthology.orchestra.run.smithi046.stdout:039.out 2023-07-05T18:58:44.865 INFO:teuthology.orchestra.run.smithi046.stdout:040 2023-07-05T18:58:44.866 INFO:teuthology.orchestra.run.smithi046.stdout:040.out 2023-07-05T18:58:44.866 INFO:teuthology.orchestra.run.smithi046.stdout:041 2023-07-05T18:58:44.866 INFO:teuthology.orchestra.run.smithi046.stdout:041.out 2023-07-05T18:58:44.866 INFO:teuthology.orchestra.run.smithi046.stdout:042 2023-07-05T18:58:44.866 INFO:teuthology.orchestra.run.smithi046.stdout:042.out 2023-07-05T18:58:44.866 INFO:teuthology.orchestra.run.smithi046.stdout:043 2023-07-05T18:58:44.867 INFO:teuthology.orchestra.run.smithi046.stdout:043.out 2023-07-05T18:58:44.867 INFO:teuthology.orchestra.run.smithi046.stdout:044 2023-07-05T18:58:44.867 INFO:teuthology.orchestra.run.smithi046.stdout:044.out 2023-07-05T18:58:44.867 INFO:teuthology.orchestra.run.smithi046.stdout:045 2023-07-05T18:58:44.867 INFO:teuthology.orchestra.run.smithi046.stdout:045.out 2023-07-05T18:58:44.867 INFO:teuthology.orchestra.run.smithi046.stdout:046 2023-07-05T18:58:44.868 INFO:teuthology.orchestra.run.smithi046.stdout:046.out 2023-07-05T18:58:44.868 INFO:teuthology.orchestra.run.smithi046.stdout:047 2023-07-05T18:58:44.868 INFO:teuthology.orchestra.run.smithi046.stdout:047.out 2023-07-05T18:58:44.868 INFO:teuthology.orchestra.run.smithi046.stdout:048 2023-07-05T18:58:44.868 INFO:teuthology.orchestra.run.smithi046.stdout:048.out 2023-07-05T18:58:44.869 INFO:teuthology.orchestra.run.smithi046.stdout:049 2023-07-05T18:58:44.869 INFO:teuthology.orchestra.run.smithi046.stdout:049.out 2023-07-05T18:58:44.869 INFO:teuthology.orchestra.run.smithi046.stdout:050 2023-07-05T18:58:44.869 INFO:teuthology.orchestra.run.smithi046.stdout:050.cfg 2023-07-05T18:58:44.869 INFO:teuthology.orchestra.run.smithi046.stdout:050.out.default 2023-07-05T18:58:44.869 INFO:teuthology.orchestra.run.smithi046.stdout:050.out.nojournal 2023-07-05T18:58:44.869 INFO:teuthology.orchestra.run.smithi046.stdout:050.out.xfsquota 2023-07-05T18:58:44.870 INFO:teuthology.orchestra.run.smithi046.stdout:051 2023-07-05T18:58:44.870 INFO:teuthology.orchestra.run.smithi046.stdout:051.out 2023-07-05T18:58:44.870 INFO:teuthology.orchestra.run.smithi046.stdout:052 2023-07-05T18:58:44.870 INFO:teuthology.orchestra.run.smithi046.stdout:052.out 2023-07-05T18:58:44.870 INFO:teuthology.orchestra.run.smithi046.stdout:053 2023-07-05T18:58:44.870 INFO:teuthology.orchestra.run.smithi046.stdout:053.out 2023-07-05T18:58:44.870 INFO:teuthology.orchestra.run.smithi046.stdout:054 2023-07-05T18:58:44.870 INFO:teuthology.orchestra.run.smithi046.stdout:054.out 2023-07-05T18:58:44.871 INFO:teuthology.orchestra.run.smithi046.stdout:055 2023-07-05T18:58:44.871 INFO:teuthology.orchestra.run.smithi046.stdout:055.out 2023-07-05T18:58:44.871 INFO:teuthology.orchestra.run.smithi046.stdout:056 2023-07-05T18:58:44.871 INFO:teuthology.orchestra.run.smithi046.stdout:056.out 2023-07-05T18:58:44.871 INFO:teuthology.orchestra.run.smithi046.stdout:057 2023-07-05T18:58:44.871 INFO:teuthology.orchestra.run.smithi046.stdout:057.out 2023-07-05T18:58:44.871 INFO:teuthology.orchestra.run.smithi046.stdout:058 2023-07-05T18:58:44.872 INFO:teuthology.orchestra.run.smithi046.stdout:058.out 2023-07-05T18:58:44.872 INFO:teuthology.orchestra.run.smithi046.stdout:059 2023-07-05T18:58:44.872 INFO:teuthology.orchestra.run.smithi046.stdout:059.out 2023-07-05T18:58:44.872 INFO:teuthology.orchestra.run.smithi046.stdout:060 2023-07-05T18:58:44.873 INFO:teuthology.orchestra.run.smithi046.stdout:060.out 2023-07-05T18:58:44.873 INFO:teuthology.orchestra.run.smithi046.stdout:061 2023-07-05T18:58:44.873 INFO:teuthology.orchestra.run.smithi046.stdout:061.out 2023-07-05T18:58:44.873 INFO:teuthology.orchestra.run.smithi046.stdout:062 2023-07-05T18:58:44.873 INFO:teuthology.orchestra.run.smithi046.stdout:062.out 2023-07-05T18:58:44.873 INFO:teuthology.orchestra.run.smithi046.stdout:063 2023-07-05T18:58:44.873 INFO:teuthology.orchestra.run.smithi046.stdout:063.out 2023-07-05T18:58:44.874 INFO:teuthology.orchestra.run.smithi046.stdout:064 2023-07-05T18:58:44.874 INFO:teuthology.orchestra.run.smithi046.stdout:064.out 2023-07-05T18:58:44.874 INFO:teuthology.orchestra.run.smithi046.stdout:065 2023-07-05T18:58:44.874 INFO:teuthology.orchestra.run.smithi046.stdout:065.out 2023-07-05T18:58:44.874 INFO:teuthology.orchestra.run.smithi046.stdout:066 2023-07-05T18:58:44.874 INFO:teuthology.orchestra.run.smithi046.stdout:066.out 2023-07-05T18:58:44.875 INFO:teuthology.orchestra.run.smithi046.stdout:067 2023-07-05T18:58:44.875 INFO:teuthology.orchestra.run.smithi046.stdout:067.out 2023-07-05T18:58:44.875 INFO:teuthology.orchestra.run.smithi046.stdout:068 2023-07-05T18:58:44.875 INFO:teuthology.orchestra.run.smithi046.stdout:068.out 2023-07-05T18:58:44.875 INFO:teuthology.orchestra.run.smithi046.stdout:069 2023-07-05T18:58:44.876 INFO:teuthology.orchestra.run.smithi046.stdout:069.out 2023-07-05T18:58:44.876 INFO:teuthology.orchestra.run.smithi046.stdout:070 2023-07-05T18:58:44.878 INFO:teuthology.orchestra.run.smithi046.stdout:070.out 2023-07-05T18:58:44.878 INFO:teuthology.orchestra.run.smithi046.stdout:071 2023-07-05T18:58:44.878 INFO:teuthology.orchestra.run.smithi046.stdout:071.out 2023-07-05T18:58:44.879 INFO:teuthology.orchestra.run.smithi046.stdout:072 2023-07-05T18:58:44.879 INFO:teuthology.orchestra.run.smithi046.stdout:072.out 2023-07-05T18:58:44.879 INFO:teuthology.orchestra.run.smithi046.stdout:073 2023-07-05T18:58:44.879 INFO:teuthology.orchestra.run.smithi046.stdout:073.out 2023-07-05T18:58:44.879 INFO:teuthology.orchestra.run.smithi046.stdout:074 2023-07-05T18:58:44.881 INFO:teuthology.orchestra.run.smithi046.stdout:074.out 2023-07-05T18:58:44.882 INFO:teuthology.orchestra.run.smithi046.stdout:075 2023-07-05T18:58:44.882 INFO:teuthology.orchestra.run.smithi046.stdout:075.out 2023-07-05T18:58:44.882 INFO:teuthology.orchestra.run.smithi046.stdout:076 2023-07-05T18:58:44.882 INFO:teuthology.orchestra.run.smithi046.stdout:076.out 2023-07-05T18:58:44.882 INFO:teuthology.orchestra.run.smithi046.stdout:077 2023-07-05T18:58:44.882 INFO:teuthology.orchestra.run.smithi046.stdout:077.out 2023-07-05T18:58:44.883 INFO:teuthology.orchestra.run.smithi046.stdout:078 2023-07-05T18:58:44.883 INFO:teuthology.orchestra.run.smithi046.stdout:078.out 2023-07-05T18:58:44.883 INFO:teuthology.orchestra.run.smithi046.stdout:079 2023-07-05T18:58:44.883 INFO:teuthology.orchestra.run.smithi046.stdout:079.out 2023-07-05T18:58:44.883 INFO:teuthology.orchestra.run.smithi046.stdout:080 2023-07-05T18:58:44.883 INFO:teuthology.orchestra.run.smithi046.stdout:080.out 2023-07-05T18:58:44.883 INFO:teuthology.orchestra.run.smithi046.stdout:081 2023-07-05T18:58:44.884 INFO:teuthology.orchestra.run.smithi046.stdout:081.out 2023-07-05T18:58:44.884 INFO:teuthology.orchestra.run.smithi046.stdout:082 2023-07-05T18:58:44.884 INFO:teuthology.orchestra.run.smithi046.stdout:082.out 2023-07-05T18:58:44.884 INFO:teuthology.orchestra.run.smithi046.stdout:083 2023-07-05T18:58:44.884 INFO:teuthology.orchestra.run.smithi046.stdout:083.out 2023-07-05T18:58:44.884 INFO:teuthology.orchestra.run.smithi046.stdout:084 2023-07-05T18:58:44.885 INFO:teuthology.orchestra.run.smithi046.stdout:084.out 2023-07-05T18:58:44.885 INFO:teuthology.orchestra.run.smithi046.stdout:085 2023-07-05T18:58:44.885 INFO:teuthology.orchestra.run.smithi046.stdout:085.out 2023-07-05T18:58:44.885 INFO:teuthology.orchestra.run.smithi046.stdout:086 2023-07-05T18:58:44.885 INFO:teuthology.orchestra.run.smithi046.stdout:086.out 2023-07-05T18:58:44.885 INFO:teuthology.orchestra.run.smithi046.stdout:087 2023-07-05T18:58:44.885 INFO:teuthology.orchestra.run.smithi046.stdout:087.out 2023-07-05T18:58:44.886 INFO:teuthology.orchestra.run.smithi046.stdout:088 2023-07-05T18:58:44.886 INFO:teuthology.orchestra.run.smithi046.stdout:088.out 2023-07-05T18:58:44.886 INFO:teuthology.orchestra.run.smithi046.stdout:089 2023-07-05T18:58:44.886 INFO:teuthology.orchestra.run.smithi046.stdout:089.out 2023-07-05T18:58:44.886 INFO:teuthology.orchestra.run.smithi046.stdout:090 2023-07-05T18:58:44.886 INFO:teuthology.orchestra.run.smithi046.stdout:090.out 2023-07-05T18:58:44.886 INFO:teuthology.orchestra.run.smithi046.stdout:091 2023-07-05T18:58:44.887 INFO:teuthology.orchestra.run.smithi046.stdout:091.out 2023-07-05T18:58:44.887 INFO:teuthology.orchestra.run.smithi046.stdout:092 2023-07-05T18:58:44.888 INFO:teuthology.orchestra.run.smithi046.stdout:092.out 2023-07-05T18:58:44.889 INFO:teuthology.orchestra.run.smithi046.stdout:093 2023-07-05T18:58:44.889 INFO:teuthology.orchestra.run.smithi046.stdout:093.out 2023-07-05T18:58:44.889 INFO:teuthology.orchestra.run.smithi046.stdout:094 2023-07-05T18:58:44.889 INFO:teuthology.orchestra.run.smithi046.stdout:094.out 2023-07-05T18:58:44.889 INFO:teuthology.orchestra.run.smithi046.stdout:095 2023-07-05T18:58:44.898 INFO:teuthology.orchestra.run.smithi046.stdout:095.out 2023-07-05T18:58:44.898 INFO:teuthology.orchestra.run.smithi046.stdout:096 2023-07-05T18:58:44.898 INFO:teuthology.orchestra.run.smithi046.stdout:096.out 2023-07-05T18:58:44.898 INFO:teuthology.orchestra.run.smithi046.stdout:097 2023-07-05T18:58:44.899 INFO:teuthology.orchestra.run.smithi046.stdout:097.out 2023-07-05T18:58:44.899 INFO:teuthology.orchestra.run.smithi046.stdout:098 2023-07-05T18:58:44.899 INFO:teuthology.orchestra.run.smithi046.stdout:098.out 2023-07-05T18:58:44.899 INFO:teuthology.orchestra.run.smithi046.stdout:099 2023-07-05T18:58:44.899 INFO:teuthology.orchestra.run.smithi046.stdout:099.out 2023-07-05T18:58:44.899 INFO:teuthology.orchestra.run.smithi046.stdout:100 2023-07-05T18:58:44.900 INFO:teuthology.orchestra.run.smithi046.stdout:100.out 2023-07-05T18:58:44.900 INFO:teuthology.orchestra.run.smithi046.stdout:101 2023-07-05T18:58:44.900 INFO:teuthology.orchestra.run.smithi046.stdout:101.out 2023-07-05T18:58:44.900 INFO:teuthology.orchestra.run.smithi046.stdout:102 2023-07-05T18:58:44.900 INFO:teuthology.orchestra.run.smithi046.stdout:102.out 2023-07-05T18:58:44.900 INFO:teuthology.orchestra.run.smithi046.stdout:103 2023-07-05T18:58:44.900 INFO:teuthology.orchestra.run.smithi046.stdout:103.out 2023-07-05T18:58:44.901 INFO:teuthology.orchestra.run.smithi046.stdout:104 2023-07-05T18:58:44.901 INFO:teuthology.orchestra.run.smithi046.stdout:104.out 2023-07-05T18:58:44.901 INFO:teuthology.orchestra.run.smithi046.stdout:105 2023-07-05T18:58:44.901 INFO:teuthology.orchestra.run.smithi046.stdout:105.out 2023-07-05T18:58:44.901 INFO:teuthology.orchestra.run.smithi046.stdout:106 2023-07-05T18:58:44.901 INFO:teuthology.orchestra.run.smithi046.stdout:106.out 2023-07-05T18:58:44.901 INFO:teuthology.orchestra.run.smithi046.stdout:107 2023-07-05T18:58:44.901 INFO:teuthology.orchestra.run.smithi046.stdout:107.out 2023-07-05T18:58:44.902 INFO:teuthology.orchestra.run.smithi046.stdout:108 2023-07-05T18:58:44.902 INFO:teuthology.orchestra.run.smithi046.stdout:108.out 2023-07-05T18:58:44.902 INFO:teuthology.orchestra.run.smithi046.stdout:109 2023-07-05T18:58:44.902 INFO:teuthology.orchestra.run.smithi046.stdout:109.out 2023-07-05T18:58:44.902 INFO:teuthology.orchestra.run.smithi046.stdout:110 2023-07-05T18:58:44.902 INFO:teuthology.orchestra.run.smithi046.stdout:110.out 2023-07-05T18:58:44.902 INFO:teuthology.orchestra.run.smithi046.stdout:111 2023-07-05T18:58:44.903 INFO:teuthology.orchestra.run.smithi046.stdout:111.out 2023-07-05T18:58:44.903 INFO:teuthology.orchestra.run.smithi046.stdout:112 2023-07-05T18:58:44.903 INFO:teuthology.orchestra.run.smithi046.stdout:112.out 2023-07-05T18:58:44.903 INFO:teuthology.orchestra.run.smithi046.stdout:113 2023-07-05T18:58:44.903 INFO:teuthology.orchestra.run.smithi046.stdout:113.out 2023-07-05T18:58:44.903 INFO:teuthology.orchestra.run.smithi046.stdout:114 2023-07-05T18:58:44.903 INFO:teuthology.orchestra.run.smithi046.stdout:114.out 2023-07-05T18:58:44.904 INFO:teuthology.orchestra.run.smithi046.stdout:115 2023-07-05T18:58:44.904 INFO:teuthology.orchestra.run.smithi046.stdout:115.out 2023-07-05T18:58:44.904 INFO:teuthology.orchestra.run.smithi046.stdout:116 2023-07-05T18:58:44.904 INFO:teuthology.orchestra.run.smithi046.stdout:116.out 2023-07-05T18:58:44.904 INFO:teuthology.orchestra.run.smithi046.stdout:117 2023-07-05T18:58:44.904 INFO:teuthology.orchestra.run.smithi046.stdout:117.out 2023-07-05T18:58:44.904 INFO:teuthology.orchestra.run.smithi046.stdout:118 2023-07-05T18:58:44.905 INFO:teuthology.orchestra.run.smithi046.stdout:118.out 2023-07-05T18:58:44.905 INFO:teuthology.orchestra.run.smithi046.stdout:119 2023-07-05T18:58:44.905 INFO:teuthology.orchestra.run.smithi046.stdout:119.out 2023-07-05T18:58:44.905 INFO:teuthology.orchestra.run.smithi046.stdout:120 2023-07-05T18:58:44.906 INFO:teuthology.orchestra.run.smithi046.stdout:120.out 2023-07-05T18:58:44.906 INFO:teuthology.orchestra.run.smithi046.stdout:121 2023-07-05T18:58:44.912 INFO:teuthology.orchestra.run.smithi046.stdout:121.out 2023-07-05T18:58:44.912 INFO:teuthology.orchestra.run.smithi046.stdout:122 2023-07-05T18:58:44.912 INFO:teuthology.orchestra.run.smithi046.stdout:122.out 2023-07-05T18:58:44.912 INFO:teuthology.orchestra.run.smithi046.stdout:123 2023-07-05T18:58:44.912 INFO:teuthology.orchestra.run.smithi046.stdout:123.out 2023-07-05T18:58:44.913 INFO:teuthology.orchestra.run.smithi046.stdout:124 2023-07-05T18:58:44.913 INFO:teuthology.orchestra.run.smithi046.stdout:124.out 2023-07-05T18:58:44.913 INFO:teuthology.orchestra.run.smithi046.stdout:125 2023-07-05T18:58:44.913 INFO:teuthology.orchestra.run.smithi046.stdout:125.out 2023-07-05T18:58:44.913 INFO:teuthology.orchestra.run.smithi046.stdout:126 2023-07-05T18:58:44.913 INFO:teuthology.orchestra.run.smithi046.stdout:126.out 2023-07-05T18:58:44.913 INFO:teuthology.orchestra.run.smithi046.stdout:127 2023-07-05T18:58:44.914 INFO:teuthology.orchestra.run.smithi046.stdout:127.out 2023-07-05T18:58:44.914 INFO:teuthology.orchestra.run.smithi046.stdout:128 2023-07-05T18:58:44.914 INFO:teuthology.orchestra.run.smithi046.stdout:128.out 2023-07-05T18:58:44.914 INFO:teuthology.orchestra.run.smithi046.stdout:129 2023-07-05T18:58:44.914 INFO:teuthology.orchestra.run.smithi046.stdout:129.out 2023-07-05T18:58:44.914 INFO:teuthology.orchestra.run.smithi046.stdout:130 2023-07-05T18:58:44.914 INFO:teuthology.orchestra.run.smithi046.stdout:130.out 2023-07-05T18:58:44.914 INFO:teuthology.orchestra.run.smithi046.stdout:131 2023-07-05T18:58:44.915 INFO:teuthology.orchestra.run.smithi046.stdout:131.out 2023-07-05T18:58:44.915 INFO:teuthology.orchestra.run.smithi046.stdout:132 2023-07-05T18:58:44.915 INFO:teuthology.orchestra.run.smithi046.stdout:132.out 2023-07-05T18:58:44.915 INFO:teuthology.orchestra.run.smithi046.stdout:133 2023-07-05T18:58:44.915 INFO:teuthology.orchestra.run.smithi046.stdout:133.out 2023-07-05T18:58:44.915 INFO:teuthology.orchestra.run.smithi046.stdout:134 2023-07-05T18:58:44.915 INFO:teuthology.orchestra.run.smithi046.stdout:134.out 2023-07-05T18:58:44.916 INFO:teuthology.orchestra.run.smithi046.stdout:135 2023-07-05T18:58:44.916 INFO:teuthology.orchestra.run.smithi046.stdout:135.out 2023-07-05T18:58:44.916 INFO:teuthology.orchestra.run.smithi046.stdout:136 2023-07-05T18:58:44.921 INFO:teuthology.orchestra.run.smithi046.stdout:136.out 2023-07-05T18:58:44.921 INFO:teuthology.orchestra.run.smithi046.stdout:137 2023-07-05T18:58:44.921 INFO:teuthology.orchestra.run.smithi046.stdout:137.out 2023-07-05T18:58:44.921 INFO:teuthology.orchestra.run.smithi046.stdout:138 2023-07-05T18:58:44.921 INFO:teuthology.orchestra.run.smithi046.stdout:138.out 2023-07-05T18:58:44.921 INFO:teuthology.orchestra.run.smithi046.stdout:139 2023-07-05T18:58:44.922 INFO:teuthology.orchestra.run.smithi046.stdout:139.out 2023-07-05T18:58:44.922 INFO:teuthology.orchestra.run.smithi046.stdout:140 2023-07-05T18:58:44.922 INFO:teuthology.orchestra.run.smithi046.stdout:140.out 2023-07-05T18:58:44.922 INFO:teuthology.orchestra.run.smithi046.stdout:141 2023-07-05T18:58:44.922 INFO:teuthology.orchestra.run.smithi046.stdout:141.out 2023-07-05T18:58:44.922 INFO:teuthology.orchestra.run.smithi046.stdout:142 2023-07-05T18:58:44.922 INFO:teuthology.orchestra.run.smithi046.stdout:142.out 2023-07-05T18:58:44.923 INFO:teuthology.orchestra.run.smithi046.stdout:143 2023-07-05T18:58:44.923 INFO:teuthology.orchestra.run.smithi046.stdout:143.out 2023-07-05T18:58:44.923 INFO:teuthology.orchestra.run.smithi046.stdout:144 2023-07-05T18:58:44.923 INFO:teuthology.orchestra.run.smithi046.stdout:144.out 2023-07-05T18:58:44.923 INFO:teuthology.orchestra.run.smithi046.stdout:145 2023-07-05T18:58:44.923 INFO:teuthology.orchestra.run.smithi046.stdout:145.out 2023-07-05T18:58:44.923 INFO:teuthology.orchestra.run.smithi046.stdout:146 2023-07-05T18:58:44.924 INFO:teuthology.orchestra.run.smithi046.stdout:146.out 2023-07-05T18:58:44.924 INFO:teuthology.orchestra.run.smithi046.stdout:147 2023-07-05T18:58:44.924 INFO:teuthology.orchestra.run.smithi046.stdout:147.out 2023-07-05T18:58:44.924 INFO:teuthology.orchestra.run.smithi046.stdout:148 2023-07-05T18:58:44.924 INFO:teuthology.orchestra.run.smithi046.stdout:148.out 2023-07-05T18:58:44.925 INFO:teuthology.orchestra.run.smithi046.stdout:149 2023-07-05T18:58:44.925 INFO:teuthology.orchestra.run.smithi046.stdout:149.out 2023-07-05T18:58:44.925 INFO:teuthology.orchestra.run.smithi046.stdout:150 2023-07-05T18:58:44.926 INFO:teuthology.orchestra.run.smithi046.stdout:150.out 2023-07-05T18:58:44.926 INFO:teuthology.orchestra.run.smithi046.stdout:151 2023-07-05T18:58:44.926 INFO:teuthology.orchestra.run.smithi046.stdout:151.out 2023-07-05T18:58:44.931 INFO:teuthology.orchestra.run.smithi046.stdout:152 2023-07-05T18:58:44.931 INFO:teuthology.orchestra.run.smithi046.stdout:152.out 2023-07-05T18:58:44.931 INFO:teuthology.orchestra.run.smithi046.stdout:153 2023-07-05T18:58:44.932 INFO:teuthology.orchestra.run.smithi046.stdout:153.out 2023-07-05T18:58:44.932 INFO:teuthology.orchestra.run.smithi046.stdout:154 2023-07-05T18:58:44.932 INFO:teuthology.orchestra.run.smithi046.stdout:154.out 2023-07-05T18:58:44.932 INFO:teuthology.orchestra.run.smithi046.stdout:155 2023-07-05T18:58:44.932 INFO:teuthology.orchestra.run.smithi046.stdout:155.out 2023-07-05T18:58:44.932 INFO:teuthology.orchestra.run.smithi046.stdout:156 2023-07-05T18:58:44.932 INFO:teuthology.orchestra.run.smithi046.stdout:156.out 2023-07-05T18:58:44.933 INFO:teuthology.orchestra.run.smithi046.stdout:157 2023-07-05T18:58:44.933 INFO:teuthology.orchestra.run.smithi046.stdout:157.out 2023-07-05T18:58:44.933 INFO:teuthology.orchestra.run.smithi046.stdout:158 2023-07-05T18:58:44.933 INFO:teuthology.orchestra.run.smithi046.stdout:158.out 2023-07-05T18:58:44.933 INFO:teuthology.orchestra.run.smithi046.stdout:159 2023-07-05T18:58:44.933 INFO:teuthology.orchestra.run.smithi046.stdout:159.out 2023-07-05T18:58:44.933 INFO:teuthology.orchestra.run.smithi046.stdout:160 2023-07-05T18:58:44.934 INFO:teuthology.orchestra.run.smithi046.stdout:160.out 2023-07-05T18:58:44.934 INFO:teuthology.orchestra.run.smithi046.stdout:161 2023-07-05T18:58:44.934 INFO:teuthology.orchestra.run.smithi046.stdout:161.out 2023-07-05T18:58:44.934 INFO:teuthology.orchestra.run.smithi046.stdout:162 2023-07-05T18:58:44.934 INFO:teuthology.orchestra.run.smithi046.stdout:162.out 2023-07-05T18:58:44.934 INFO:teuthology.orchestra.run.smithi046.stdout:163 2023-07-05T18:58:44.937 INFO:teuthology.orchestra.run.smithi046.stdout:163.out 2023-07-05T18:58:44.938 INFO:teuthology.orchestra.run.smithi046.stdout:164 2023-07-05T18:58:44.938 INFO:teuthology.orchestra.run.smithi046.stdout:164.out 2023-07-05T18:58:44.939 INFO:teuthology.orchestra.run.smithi046.stdout:165 2023-07-05T18:58:44.939 INFO:teuthology.orchestra.run.smithi046.stdout:165.out 2023-07-05T18:58:44.940 INFO:teuthology.orchestra.run.smithi046.stdout:166 2023-07-05T18:58:44.940 INFO:teuthology.orchestra.run.smithi046.stdout:166.out 2023-07-05T18:58:44.940 INFO:teuthology.orchestra.run.smithi046.stdout:167 2023-07-05T18:58:44.940 INFO:teuthology.orchestra.run.smithi046.stdout:167.out 2023-07-05T18:58:44.941 INFO:teuthology.orchestra.run.smithi046.stdout:168 2023-07-05T18:58:44.949 INFO:teuthology.orchestra.run.smithi046.stdout:168.out 2023-07-05T18:58:44.950 INFO:teuthology.orchestra.run.smithi046.stdout:169 2023-07-05T18:58:44.951 INFO:teuthology.orchestra.run.smithi046.stdout:169.out 2023-07-05T18:58:44.951 INFO:teuthology.orchestra.run.smithi046.stdout:170 2023-07-05T18:58:44.951 INFO:teuthology.orchestra.run.smithi046.stdout:170.out 2023-07-05T18:58:44.961 INFO:teuthology.orchestra.run.smithi046.stdout:171 2023-07-05T18:58:44.962 INFO:teuthology.orchestra.run.smithi046.stdout:171.out 2023-07-05T18:58:44.962 INFO:teuthology.orchestra.run.smithi046.stdout:172 2023-07-05T18:58:44.963 INFO:teuthology.orchestra.run.smithi046.stdout:172.out 2023-07-05T18:58:44.963 INFO:teuthology.orchestra.run.smithi046.stdout:173 2023-07-05T18:58:44.963 INFO:teuthology.orchestra.run.smithi046.stdout:173.out 2023-07-05T18:58:44.963 INFO:teuthology.orchestra.run.smithi046.stdout:174 2023-07-05T18:58:44.964 INFO:teuthology.orchestra.run.smithi046.stdout:174.out 2023-07-05T18:58:44.964 INFO:teuthology.orchestra.run.smithi046.stdout:175 2023-07-05T18:58:44.964 INFO:teuthology.orchestra.run.smithi046.stdout:175.out 2023-07-05T18:58:44.965 INFO:teuthology.orchestra.run.smithi046.stdout:176 2023-07-05T18:58:44.965 INFO:teuthology.orchestra.run.smithi046.stdout:176.out 2023-07-05T18:58:44.965 INFO:teuthology.orchestra.run.smithi046.stdout:177 2023-07-05T18:58:44.966 INFO:teuthology.orchestra.run.smithi046.stdout:177.out 2023-07-05T18:58:44.966 INFO:teuthology.orchestra.run.smithi046.stdout:178 2023-07-05T18:58:44.966 INFO:teuthology.orchestra.run.smithi046.stdout:178.out 2023-07-05T18:58:44.967 INFO:teuthology.orchestra.run.smithi046.stdout:179 2023-07-05T18:58:44.967 INFO:teuthology.orchestra.run.smithi046.stdout:179.out 2023-07-05T18:58:44.967 INFO:teuthology.orchestra.run.smithi046.stdout:180 2023-07-05T18:58:44.967 INFO:teuthology.orchestra.run.smithi046.stdout:180.out 2023-07-05T18:58:44.972 INFO:teuthology.orchestra.run.smithi046.stdout:181 2023-07-05T18:58:44.973 INFO:teuthology.orchestra.run.smithi046.stdout:181.out 2023-07-05T18:58:44.973 INFO:teuthology.orchestra.run.smithi046.stdout:182 2023-07-05T18:58:44.973 INFO:teuthology.orchestra.run.smithi046.stdout:182.out 2023-07-05T18:58:44.973 INFO:teuthology.orchestra.run.smithi046.stdout:183 2023-07-05T18:58:44.973 INFO:teuthology.orchestra.run.smithi046.stdout:183.out 2023-07-05T18:58:44.973 INFO:teuthology.orchestra.run.smithi046.stdout:184 2023-07-05T18:58:44.973 INFO:teuthology.orchestra.run.smithi046.stdout:184.out 2023-07-05T18:58:44.974 INFO:teuthology.orchestra.run.smithi046.stdout:185 2023-07-05T18:58:44.974 INFO:teuthology.orchestra.run.smithi046.stdout:185.out 2023-07-05T18:58:44.974 INFO:teuthology.orchestra.run.smithi046.stdout:186 2023-07-05T18:58:44.974 INFO:teuthology.orchestra.run.smithi046.stdout:186.out 2023-07-05T18:58:44.974 INFO:teuthology.orchestra.run.smithi046.stdout:187 2023-07-05T18:58:44.974 INFO:teuthology.orchestra.run.smithi046.stdout:187.out 2023-07-05T18:58:44.974 INFO:teuthology.orchestra.run.smithi046.stdout:188 2023-07-05T18:58:44.974 INFO:teuthology.orchestra.run.smithi046.stdout:188.out 2023-07-05T18:58:44.975 INFO:teuthology.orchestra.run.smithi046.stdout:189 2023-07-05T18:58:44.975 INFO:teuthology.orchestra.run.smithi046.stdout:189.out 2023-07-05T18:58:44.975 INFO:teuthology.orchestra.run.smithi046.stdout:190 2023-07-05T18:58:44.975 INFO:teuthology.orchestra.run.smithi046.stdout:190.out 2023-07-05T18:58:44.975 INFO:teuthology.orchestra.run.smithi046.stdout:191 2023-07-05T18:58:44.975 INFO:teuthology.orchestra.run.smithi046.stdout:191.out 2023-07-05T18:58:44.975 INFO:teuthology.orchestra.run.smithi046.stdout:192 2023-07-05T18:58:44.976 INFO:teuthology.orchestra.run.smithi046.stdout:192.out 2023-07-05T18:58:44.976 INFO:teuthology.orchestra.run.smithi046.stdout:193 2023-07-05T18:58:44.980 INFO:teuthology.orchestra.run.smithi046.stdout:193.out 2023-07-05T18:58:44.980 INFO:teuthology.orchestra.run.smithi046.stdout:194 2023-07-05T18:58:44.980 INFO:teuthology.orchestra.run.smithi046.stdout:194.out 2023-07-05T18:58:44.981 INFO:teuthology.orchestra.run.smithi046.stdout:195 2023-07-05T18:58:44.981 INFO:teuthology.orchestra.run.smithi046.stdout:195.out 2023-07-05T18:58:44.981 INFO:teuthology.orchestra.run.smithi046.stdout:196 2023-07-05T18:58:44.981 INFO:teuthology.orchestra.run.smithi046.stdout:196.out 2023-07-05T18:58:44.981 INFO:teuthology.orchestra.run.smithi046.stdout:197 2023-07-05T18:58:44.981 INFO:teuthology.orchestra.run.smithi046.stdout:197.out 2023-07-05T18:58:44.981 INFO:teuthology.orchestra.run.smithi046.stdout:198 2023-07-05T18:58:44.981 INFO:teuthology.orchestra.run.smithi046.stdout:198.out 2023-07-05T18:58:44.982 INFO:teuthology.orchestra.run.smithi046.stdout:199 2023-07-05T18:58:44.982 INFO:teuthology.orchestra.run.smithi046.stdout:199.out 2023-07-05T18:58:44.982 INFO:teuthology.orchestra.run.smithi046.stdout:200 2023-07-05T18:58:44.982 INFO:teuthology.orchestra.run.smithi046.stdout:200.out 2023-07-05T18:58:44.982 INFO:teuthology.orchestra.run.smithi046.stdout:201 2023-07-05T18:58:44.982 INFO:teuthology.orchestra.run.smithi046.stdout:201.out 2023-07-05T18:58:44.982 INFO:teuthology.orchestra.run.smithi046.stdout:202 2023-07-05T18:58:44.985 INFO:teuthology.orchestra.run.smithi046.stdout:202.out 2023-07-05T18:58:44.985 INFO:teuthology.orchestra.run.smithi046.stdout:203 2023-07-05T18:58:44.985 INFO:teuthology.orchestra.run.smithi046.stdout:203.out 2023-07-05T18:58:44.985 INFO:teuthology.orchestra.run.smithi046.stdout:204 2023-07-05T18:58:44.986 INFO:teuthology.orchestra.run.smithi046.stdout:204.out 2023-07-05T18:58:44.986 INFO:teuthology.orchestra.run.smithi046.stdout:205 2023-07-05T18:58:44.986 INFO:teuthology.orchestra.run.smithi046.stdout:205.out 2023-07-05T18:58:44.986 INFO:teuthology.orchestra.run.smithi046.stdout:206 2023-07-05T18:58:44.986 INFO:teuthology.orchestra.run.smithi046.stdout:206.out 2023-07-05T18:58:44.986 INFO:teuthology.orchestra.run.smithi046.stdout:207 2023-07-05T18:58:44.986 INFO:teuthology.orchestra.run.smithi046.stdout:207.out 2023-07-05T18:58:44.987 INFO:teuthology.orchestra.run.smithi046.stdout:208 2023-07-05T18:58:44.987 INFO:teuthology.orchestra.run.smithi046.stdout:208.out 2023-07-05T18:58:44.987 INFO:teuthology.orchestra.run.smithi046.stdout:209 2023-07-05T18:58:44.987 INFO:teuthology.orchestra.run.smithi046.stdout:209.out 2023-07-05T18:58:44.987 INFO:teuthology.orchestra.run.smithi046.stdout:210 2023-07-05T18:58:44.987 INFO:teuthology.orchestra.run.smithi046.stdout:210.out 2023-07-05T18:58:44.987 INFO:teuthology.orchestra.run.smithi046.stdout:211 2023-07-05T18:58:44.987 INFO:teuthology.orchestra.run.smithi046.stdout:211.out 2023-07-05T18:58:44.988 INFO:teuthology.orchestra.run.smithi046.stdout:212 2023-07-05T18:58:44.988 INFO:teuthology.orchestra.run.smithi046.stdout:212.out 2023-07-05T18:58:44.988 INFO:teuthology.orchestra.run.smithi046.stdout:213 2023-07-05T18:58:44.989 INFO:teuthology.orchestra.run.smithi046.stdout:213.out 2023-07-05T18:58:44.989 INFO:teuthology.orchestra.run.smithi046.stdout:214 2023-07-05T18:58:44.989 INFO:teuthology.orchestra.run.smithi046.stdout:214.out 2023-07-05T18:58:44.989 INFO:teuthology.orchestra.run.smithi046.stdout:215 2023-07-05T18:58:44.991 INFO:teuthology.orchestra.run.smithi046.stdout:215.out 2023-07-05T18:58:44.991 INFO:teuthology.orchestra.run.smithi046.stdout:216 2023-07-05T18:58:44.991 INFO:teuthology.orchestra.run.smithi046.stdout:216.out 2023-07-05T18:58:44.992 INFO:teuthology.orchestra.run.smithi046.stdout:217 2023-07-05T18:58:44.992 INFO:teuthology.orchestra.run.smithi046.stdout:217.out 2023-07-05T18:58:44.992 INFO:teuthology.orchestra.run.smithi046.stdout:218 2023-07-05T18:58:44.992 INFO:teuthology.orchestra.run.smithi046.stdout:218.out 2023-07-05T18:58:44.993 INFO:teuthology.orchestra.run.smithi046.stdout:219 2023-07-05T18:58:44.993 INFO:teuthology.orchestra.run.smithi046.stdout:219.out 2023-07-05T18:58:44.993 INFO:teuthology.orchestra.run.smithi046.stdout:220 2023-07-05T18:58:44.993 INFO:teuthology.orchestra.run.smithi046.stdout:220.out 2023-07-05T18:58:44.993 INFO:teuthology.orchestra.run.smithi046.stdout:221 2023-07-05T18:58:44.993 INFO:teuthology.orchestra.run.smithi046.stdout:221.out 2023-07-05T18:58:44.993 INFO:teuthology.orchestra.run.smithi046.stdout:222 2023-07-05T18:58:44.993 INFO:teuthology.orchestra.run.smithi046.stdout:222.out 2023-07-05T18:58:44.994 INFO:teuthology.orchestra.run.smithi046.stdout:223 2023-07-05T18:58:44.994 INFO:teuthology.orchestra.run.smithi046.stdout:223.out 2023-07-05T18:58:44.994 INFO:teuthology.orchestra.run.smithi046.stdout:224 2023-07-05T18:58:44.994 INFO:teuthology.orchestra.run.smithi046.stdout:224.out 2023-07-05T18:58:44.995 INFO:teuthology.orchestra.run.smithi046.stdout:225 2023-07-05T18:58:44.995 INFO:teuthology.orchestra.run.smithi046.stdout:225.out 2023-07-05T18:58:44.995 INFO:teuthology.orchestra.run.smithi046.stdout:226 2023-07-05T18:58:44.995 INFO:teuthology.orchestra.run.smithi046.stdout:226.out 2023-07-05T18:58:44.995 INFO:teuthology.orchestra.run.smithi046.stdout:227 2023-07-05T18:58:44.995 INFO:teuthology.orchestra.run.smithi046.stdout:227.out 2023-07-05T18:58:44.996 INFO:teuthology.orchestra.run.smithi046.stdout:228 2023-07-05T18:58:44.996 INFO:teuthology.orchestra.run.smithi046.stdout:228.out 2023-07-05T18:58:44.996 INFO:teuthology.orchestra.run.smithi046.stdout:229 2023-07-05T18:58:44.996 INFO:teuthology.orchestra.run.smithi046.stdout:229.out 2023-07-05T18:58:44.996 INFO:teuthology.orchestra.run.smithi046.stdout:230 2023-07-05T18:58:44.996 INFO:teuthology.orchestra.run.smithi046.stdout:230.out 2023-07-05T18:58:44.997 INFO:teuthology.orchestra.run.smithi046.stdout:231 2023-07-05T18:58:44.997 INFO:teuthology.orchestra.run.smithi046.stdout:231.out 2023-07-05T18:58:44.997 INFO:teuthology.orchestra.run.smithi046.stdout:232 2023-07-05T18:58:44.997 INFO:teuthology.orchestra.run.smithi046.stdout:232.out 2023-07-05T18:58:44.997 INFO:teuthology.orchestra.run.smithi046.stdout:233 2023-07-05T18:58:44.998 INFO:teuthology.orchestra.run.smithi046.stdout:233.out 2023-07-05T18:58:44.998 INFO:teuthology.orchestra.run.smithi046.stdout:234 2023-07-05T18:58:44.999 INFO:teuthology.orchestra.run.smithi046.stdout:234.out 2023-07-05T18:58:44.999 INFO:teuthology.orchestra.run.smithi046.stdout:235 2023-07-05T18:58:45.000 INFO:teuthology.orchestra.run.smithi046.stdout:235.out 2023-07-05T18:58:45.000 INFO:teuthology.orchestra.run.smithi046.stdout:236 2023-07-05T18:58:45.000 INFO:teuthology.orchestra.run.smithi046.stdout:236.out 2023-07-05T18:58:45.000 INFO:teuthology.orchestra.run.smithi046.stdout:237 2023-07-05T18:58:45.000 INFO:teuthology.orchestra.run.smithi046.stdout:237.out 2023-07-05T18:58:45.000 INFO:teuthology.orchestra.run.smithi046.stdout:238 2023-07-05T18:58:45.001 INFO:teuthology.orchestra.run.smithi046.stdout:238.out 2023-07-05T18:58:45.001 INFO:teuthology.orchestra.run.smithi046.stdout:239 2023-07-05T18:58:45.001 INFO:teuthology.orchestra.run.smithi046.stdout:239.out 2023-07-05T18:58:45.001 INFO:teuthology.orchestra.run.smithi046.stdout:240 2023-07-05T18:58:45.001 INFO:teuthology.orchestra.run.smithi046.stdout:240.out 2023-07-05T18:58:45.002 INFO:teuthology.orchestra.run.smithi046.stdout:241 2023-07-05T18:58:45.002 INFO:teuthology.orchestra.run.smithi046.stdout:241.out 2023-07-05T18:58:45.003 INFO:teuthology.orchestra.run.smithi046.stdout:242 2023-07-05T18:58:45.003 INFO:teuthology.orchestra.run.smithi046.stdout:242.out 2023-07-05T18:58:45.004 INFO:teuthology.orchestra.run.smithi046.stdout:243 2023-07-05T18:58:45.006 INFO:teuthology.orchestra.run.smithi046.stdout:243.out 2023-07-05T18:58:45.006 INFO:teuthology.orchestra.run.smithi046.stdout:244 2023-07-05T18:58:45.006 INFO:teuthology.orchestra.run.smithi046.stdout:244.out 2023-07-05T18:58:45.006 INFO:teuthology.orchestra.run.smithi046.stdout:245 2023-07-05T18:58:45.006 INFO:teuthology.orchestra.run.smithi046.stdout:245.out 2023-07-05T18:58:45.007 INFO:teuthology.orchestra.run.smithi046.stdout:246 2023-07-05T18:58:45.007 INFO:teuthology.orchestra.run.smithi046.stdout:246.out 2023-07-05T18:58:45.007 INFO:teuthology.orchestra.run.smithi046.stdout:247 2023-07-05T18:58:45.008 INFO:teuthology.orchestra.run.smithi046.stdout:247.out 2023-07-05T18:58:45.008 INFO:teuthology.orchestra.run.smithi046.stdout:248 2023-07-05T18:58:45.009 INFO:teuthology.orchestra.run.smithi046.stdout:248.out 2023-07-05T18:58:45.010 INFO:teuthology.orchestra.run.smithi046.stdout:249 2023-07-05T18:58:45.010 INFO:teuthology.orchestra.run.smithi046.stdout:249.out 2023-07-05T18:58:45.011 INFO:teuthology.orchestra.run.smithi046.stdout:250 2023-07-05T18:58:45.011 INFO:teuthology.orchestra.run.smithi046.stdout:250.out 2023-07-05T18:58:45.011 INFO:teuthology.orchestra.run.smithi046.stdout:251 2023-07-05T18:58:45.011 INFO:teuthology.orchestra.run.smithi046.stdout:251.out 2023-07-05T18:58:45.012 INFO:teuthology.orchestra.run.smithi046.stdout:252 2023-07-05T18:58:45.012 INFO:teuthology.orchestra.run.smithi046.stdout:252.out 2023-07-05T18:58:45.013 INFO:teuthology.orchestra.run.smithi046.stdout:253 2023-07-05T18:58:45.013 INFO:teuthology.orchestra.run.smithi046.stdout:253.out 2023-07-05T18:58:45.013 INFO:teuthology.orchestra.run.smithi046.stdout:254 2023-07-05T18:58:45.014 INFO:teuthology.orchestra.run.smithi046.stdout:254.out 2023-07-05T18:58:45.014 INFO:teuthology.orchestra.run.smithi046.stdout:255 2023-07-05T18:58:45.014 INFO:teuthology.orchestra.run.smithi046.stdout:255.out 2023-07-05T18:58:45.014 INFO:teuthology.orchestra.run.smithi046.stdout:256 2023-07-05T18:58:45.014 INFO:teuthology.orchestra.run.smithi046.stdout:256.out 2023-07-05T18:58:45.015 INFO:teuthology.orchestra.run.smithi046.stdout:257 2023-07-05T18:58:45.015 INFO:teuthology.orchestra.run.smithi046.stdout:257.out 2023-07-05T18:58:45.015 INFO:teuthology.orchestra.run.smithi046.stdout:258 2023-07-05T18:58:45.015 INFO:teuthology.orchestra.run.smithi046.stdout:258.out 2023-07-05T18:58:45.015 INFO:teuthology.orchestra.run.smithi046.stdout:259 2023-07-05T18:58:45.015 INFO:teuthology.orchestra.run.smithi046.stdout:259.out 2023-07-05T18:58:45.015 INFO:teuthology.orchestra.run.smithi046.stdout:260 2023-07-05T18:58:45.016 INFO:teuthology.orchestra.run.smithi046.stdout:260.out 2023-07-05T18:58:45.016 INFO:teuthology.orchestra.run.smithi046.stdout:261 2023-07-05T18:58:45.016 INFO:teuthology.orchestra.run.smithi046.stdout:261.out 2023-07-05T18:58:45.018 INFO:teuthology.orchestra.run.smithi046.stdout:262 2023-07-05T18:58:45.018 INFO:teuthology.orchestra.run.smithi046.stdout:262.out 2023-07-05T18:58:45.018 INFO:teuthology.orchestra.run.smithi046.stdout:263 2023-07-05T18:58:45.022 INFO:teuthology.orchestra.run.smithi046.stdout:263.out 2023-07-05T18:58:45.028 INFO:teuthology.orchestra.run.smithi046.stdout:264 2023-07-05T18:58:45.028 INFO:teuthology.orchestra.run.smithi046.stdout:264.out 2023-07-05T18:58:45.028 INFO:teuthology.orchestra.run.smithi046.stdout:265 2023-07-05T18:58:45.028 INFO:teuthology.orchestra.run.smithi046.stdout:265.out 2023-07-05T18:58:45.028 INFO:teuthology.orchestra.run.smithi046.stdout:266 2023-07-05T18:58:45.028 INFO:teuthology.orchestra.run.smithi046.stdout:266.out 2023-07-05T18:58:45.029 INFO:teuthology.orchestra.run.smithi046.stdout:267 2023-07-05T18:58:45.029 INFO:teuthology.orchestra.run.smithi046.stdout:267.out 2023-07-05T18:58:45.029 INFO:teuthology.orchestra.run.smithi046.stdout:268 2023-07-05T18:58:45.029 INFO:teuthology.orchestra.run.smithi046.stdout:268.out 2023-07-05T18:58:45.029 INFO:teuthology.orchestra.run.smithi046.stdout:269 2023-07-05T18:58:45.029 INFO:teuthology.orchestra.run.smithi046.stdout:269.out 2023-07-05T18:58:45.029 INFO:teuthology.orchestra.run.smithi046.stdout:270 2023-07-05T18:58:45.030 INFO:teuthology.orchestra.run.smithi046.stdout:270.out 2023-07-05T18:58:45.030 INFO:teuthology.orchestra.run.smithi046.stdout:271 2023-07-05T18:58:45.030 INFO:teuthology.orchestra.run.smithi046.stdout:271.out 2023-07-05T18:58:45.030 INFO:teuthology.orchestra.run.smithi046.stdout:272 2023-07-05T18:58:45.030 INFO:teuthology.orchestra.run.smithi046.stdout:272.out 2023-07-05T18:58:45.030 INFO:teuthology.orchestra.run.smithi046.stdout:273 2023-07-05T18:58:45.030 INFO:teuthology.orchestra.run.smithi046.stdout:273.out 2023-07-05T18:58:45.030 INFO:teuthology.orchestra.run.smithi046.stdout:274 2023-07-05T18:58:45.031 INFO:teuthology.orchestra.run.smithi046.stdout:274.out 2023-07-05T18:58:45.031 INFO:teuthology.orchestra.run.smithi046.stdout:275 2023-07-05T18:58:45.031 INFO:teuthology.orchestra.run.smithi046.stdout:275.out 2023-07-05T18:58:45.031 INFO:teuthology.orchestra.run.smithi046.stdout:276 2023-07-05T18:58:45.031 INFO:teuthology.orchestra.run.smithi046.stdout:276.out 2023-07-05T18:58:45.031 INFO:teuthology.orchestra.run.smithi046.stdout:277 2023-07-05T18:58:45.031 INFO:teuthology.orchestra.run.smithi046.stdout:277.out 2023-07-05T18:58:45.031 INFO:teuthology.orchestra.run.smithi046.stdout:278 2023-07-05T18:58:45.032 INFO:teuthology.orchestra.run.smithi046.stdout:278.out 2023-07-05T18:58:45.032 INFO:teuthology.orchestra.run.smithi046.stdout:279 2023-07-05T18:58:45.032 INFO:teuthology.orchestra.run.smithi046.stdout:279.out 2023-07-05T18:58:45.032 INFO:teuthology.orchestra.run.smithi046.stdout:280 2023-07-05T18:58:45.032 INFO:teuthology.orchestra.run.smithi046.stdout:280.out 2023-07-05T18:58:45.032 INFO:teuthology.orchestra.run.smithi046.stdout:281 2023-07-05T18:58:45.033 INFO:teuthology.orchestra.run.smithi046.stdout:281.out 2023-07-05T18:58:45.033 INFO:teuthology.orchestra.run.smithi046.stdout:282 2023-07-05T18:58:45.033 INFO:teuthology.orchestra.run.smithi046.stdout:282.out 2023-07-05T18:58:45.033 INFO:teuthology.orchestra.run.smithi046.stdout:283 2023-07-05T18:58:45.033 INFO:teuthology.orchestra.run.smithi046.stdout:283.out 2023-07-05T18:58:45.033 INFO:teuthology.orchestra.run.smithi046.stdout:284 2023-07-05T18:58:45.034 INFO:teuthology.orchestra.run.smithi046.stdout:284.out 2023-07-05T18:58:45.034 INFO:teuthology.orchestra.run.smithi046.stdout:285 2023-07-05T18:58:45.034 INFO:teuthology.orchestra.run.smithi046.stdout:285.out 2023-07-05T18:58:45.034 INFO:teuthology.orchestra.run.smithi046.stdout:286 2023-07-05T18:58:45.035 INFO:teuthology.orchestra.run.smithi046.stdout:286.out 2023-07-05T18:58:45.035 INFO:teuthology.orchestra.run.smithi046.stdout:287 2023-07-05T18:58:45.035 INFO:teuthology.orchestra.run.smithi046.stdout:287.out 2023-07-05T18:58:45.035 INFO:teuthology.orchestra.run.smithi046.stdout:288 2023-07-05T18:58:45.035 INFO:teuthology.orchestra.run.smithi046.stdout:288.out 2023-07-05T18:58:45.037 INFO:teuthology.orchestra.run.smithi046.stdout:289 2023-07-05T18:58:45.037 INFO:teuthology.orchestra.run.smithi046.stdout:289.out 2023-07-05T18:58:45.037 INFO:teuthology.orchestra.run.smithi046.stdout:290 2023-07-05T18:58:45.037 INFO:teuthology.orchestra.run.smithi046.stdout:290.out 2023-07-05T18:58:45.037 INFO:teuthology.orchestra.run.smithi046.stdout:291 2023-07-05T18:58:45.037 INFO:teuthology.orchestra.run.smithi046.stdout:291.out 2023-07-05T18:58:45.038 INFO:teuthology.orchestra.run.smithi046.stdout:292 2023-07-05T18:58:45.038 INFO:teuthology.orchestra.run.smithi046.stdout:292.out 2023-07-05T18:58:45.038 INFO:teuthology.orchestra.run.smithi046.stdout:293 2023-07-05T18:58:45.038 INFO:teuthology.orchestra.run.smithi046.stdout:293.out 2023-07-05T18:58:45.038 INFO:teuthology.orchestra.run.smithi046.stdout:294 2023-07-05T18:58:45.038 INFO:teuthology.orchestra.run.smithi046.stdout:294.out 2023-07-05T18:58:45.038 INFO:teuthology.orchestra.run.smithi046.stdout:295 2023-07-05T18:58:45.038 INFO:teuthology.orchestra.run.smithi046.stdout:295.out 2023-07-05T18:58:45.039 INFO:teuthology.orchestra.run.smithi046.stdout:296 2023-07-05T18:58:45.039 INFO:teuthology.orchestra.run.smithi046.stdout:296.out 2023-07-05T18:58:45.039 INFO:teuthology.orchestra.run.smithi046.stdout:297 2023-07-05T18:58:45.040 INFO:teuthology.orchestra.run.smithi046.stdout:297.out 2023-07-05T18:58:45.040 INFO:teuthology.orchestra.run.smithi046.stdout:298 2023-07-05T18:58:45.040 INFO:teuthology.orchestra.run.smithi046.stdout:298.out 2023-07-05T18:58:45.041 INFO:teuthology.orchestra.run.smithi046.stdout:299 2023-07-05T18:58:45.041 INFO:teuthology.orchestra.run.smithi046.stdout:299.out 2023-07-05T18:58:45.041 INFO:teuthology.orchestra.run.smithi046.stdout:300 2023-07-05T18:58:45.041 INFO:teuthology.orchestra.run.smithi046.stdout:300.out 2023-07-05T18:58:45.042 INFO:teuthology.orchestra.run.smithi046.stdout:301 2023-07-05T18:58:45.042 INFO:teuthology.orchestra.run.smithi046.stdout:301.out 2023-07-05T18:58:45.042 INFO:teuthology.orchestra.run.smithi046.stdout:302 2023-07-05T18:58:45.042 INFO:teuthology.orchestra.run.smithi046.stdout:302.out 2023-07-05T18:58:45.042 INFO:teuthology.orchestra.run.smithi046.stdout:303 2023-07-05T18:58:45.042 INFO:teuthology.orchestra.run.smithi046.stdout:303.out 2023-07-05T18:58:45.042 INFO:teuthology.orchestra.run.smithi046.stdout:304 2023-07-05T18:58:45.042 INFO:teuthology.orchestra.run.smithi046.stdout:304.out 2023-07-05T18:58:45.043 INFO:teuthology.orchestra.run.smithi046.stdout:305 2023-07-05T18:58:45.043 INFO:teuthology.orchestra.run.smithi046.stdout:305.out 2023-07-05T18:58:45.043 INFO:teuthology.orchestra.run.smithi046.stdout:306 2023-07-05T18:58:45.043 INFO:teuthology.orchestra.run.smithi046.stdout:306.out 2023-07-05T18:58:45.043 INFO:teuthology.orchestra.run.smithi046.stdout:307 2023-07-05T18:58:45.043 INFO:teuthology.orchestra.run.smithi046.stdout:307.out 2023-07-05T18:58:45.043 INFO:teuthology.orchestra.run.smithi046.stdout:308 2023-07-05T18:58:45.044 INFO:teuthology.orchestra.run.smithi046.stdout:308.out 2023-07-05T18:58:45.044 INFO:teuthology.orchestra.run.smithi046.stdout:309 2023-07-05T18:58:45.044 INFO:teuthology.orchestra.run.smithi046.stdout:309.out 2023-07-05T18:58:45.044 INFO:teuthology.orchestra.run.smithi046.stdout:310 2023-07-05T18:58:45.044 INFO:teuthology.orchestra.run.smithi046.stdout:310.out 2023-07-05T18:58:45.044 INFO:teuthology.orchestra.run.smithi046.stdout:311 2023-07-05T18:58:45.044 INFO:teuthology.orchestra.run.smithi046.stdout:311.out 2023-07-05T18:58:45.044 INFO:teuthology.orchestra.run.smithi046.stdout:312 2023-07-05T18:58:45.045 INFO:teuthology.orchestra.run.smithi046.stdout:312.out 2023-07-05T18:58:45.045 INFO:teuthology.orchestra.run.smithi046.stdout:313 2023-07-05T18:58:45.045 INFO:teuthology.orchestra.run.smithi046.stdout:313.out 2023-07-05T18:58:45.045 INFO:teuthology.orchestra.run.smithi046.stdout:314 2023-07-05T18:58:45.045 INFO:teuthology.orchestra.run.smithi046.stdout:314.out 2023-07-05T18:58:45.045 INFO:teuthology.orchestra.run.smithi046.stdout:315 2023-07-05T18:58:45.045 INFO:teuthology.orchestra.run.smithi046.stdout:315.out 2023-07-05T18:58:45.046 INFO:teuthology.orchestra.run.smithi046.stdout:316 2023-07-05T18:58:45.046 INFO:teuthology.orchestra.run.smithi046.stdout:316.out 2023-07-05T18:58:45.046 INFO:teuthology.orchestra.run.smithi046.stdout:317 2023-07-05T18:58:45.046 INFO:teuthology.orchestra.run.smithi046.stdout:317.out 2023-07-05T18:58:45.048 INFO:teuthology.orchestra.run.smithi046.stdout:318 2023-07-05T18:58:45.048 INFO:teuthology.orchestra.run.smithi046.stdout:318.out 2023-07-05T18:58:45.048 INFO:teuthology.orchestra.run.smithi046.stdout:319 2023-07-05T18:58:45.048 INFO:teuthology.orchestra.run.smithi046.stdout:319.out 2023-07-05T18:58:45.048 INFO:teuthology.orchestra.run.smithi046.stdout:320 2023-07-05T18:58:45.049 INFO:teuthology.orchestra.run.smithi046.stdout:320.out 2023-07-05T18:58:45.049 INFO:teuthology.orchestra.run.smithi046.stdout:321 2023-07-05T18:58:45.049 INFO:teuthology.orchestra.run.smithi046.stdout:321.out 2023-07-05T18:58:45.049 INFO:teuthology.orchestra.run.smithi046.stdout:322 2023-07-05T18:58:45.049 INFO:teuthology.orchestra.run.smithi046.stdout:322.out 2023-07-05T18:58:45.049 INFO:teuthology.orchestra.run.smithi046.stdout:323 2023-07-05T18:58:45.049 INFO:teuthology.orchestra.run.smithi046.stdout:323.out 2023-07-05T18:58:45.049 INFO:teuthology.orchestra.run.smithi046.stdout:324 2023-07-05T18:58:45.050 INFO:teuthology.orchestra.run.smithi046.stdout:324.out 2023-07-05T18:58:45.050 INFO:teuthology.orchestra.run.smithi046.stdout:325 2023-07-05T18:58:45.050 INFO:teuthology.orchestra.run.smithi046.stdout:325.out 2023-07-05T18:58:45.050 INFO:teuthology.orchestra.run.smithi046.stdout:326 2023-07-05T18:58:45.050 INFO:teuthology.orchestra.run.smithi046.stdout:326.out 2023-07-05T18:58:45.051 INFO:teuthology.orchestra.run.smithi046.stdout:327 2023-07-05T18:58:45.051 INFO:teuthology.orchestra.run.smithi046.stdout:327.out 2023-07-05T18:58:45.051 INFO:teuthology.orchestra.run.smithi046.stdout:328 2023-07-05T18:58:45.052 INFO:teuthology.orchestra.run.smithi046.stdout:328.out 2023-07-05T18:58:45.052 INFO:teuthology.orchestra.run.smithi046.stdout:329 2023-07-05T18:58:45.052 INFO:teuthology.orchestra.run.smithi046.stdout:329.out 2023-07-05T18:58:45.052 INFO:teuthology.orchestra.run.smithi046.stdout:330 2023-07-05T18:58:45.052 INFO:teuthology.orchestra.run.smithi046.stdout:330.out 2023-07-05T18:58:45.052 INFO:teuthology.orchestra.run.smithi046.stdout:331 2023-07-05T18:58:45.053 INFO:teuthology.orchestra.run.smithi046.stdout:331.out 2023-07-05T18:58:45.053 INFO:teuthology.orchestra.run.smithi046.stdout:332 2023-07-05T18:58:45.053 INFO:teuthology.orchestra.run.smithi046.stdout:332.out 2023-07-05T18:58:45.053 INFO:teuthology.orchestra.run.smithi046.stdout:333 2023-07-05T18:58:45.053 INFO:teuthology.orchestra.run.smithi046.stdout:333.out 2023-07-05T18:58:45.053 INFO:teuthology.orchestra.run.smithi046.stdout:334 2023-07-05T18:58:45.054 INFO:teuthology.orchestra.run.smithi046.stdout:334.out 2023-07-05T18:58:45.055 INFO:teuthology.orchestra.run.smithi046.stdout:335 2023-07-05T18:58:45.055 INFO:teuthology.orchestra.run.smithi046.stdout:335.out 2023-07-05T18:58:45.055 INFO:teuthology.orchestra.run.smithi046.stdout:336 2023-07-05T18:58:45.056 INFO:teuthology.orchestra.run.smithi046.stdout:336.out 2023-07-05T18:58:45.056 INFO:teuthology.orchestra.run.smithi046.stdout:337 2023-07-05T18:58:45.056 INFO:teuthology.orchestra.run.smithi046.stdout:337.out 2023-07-05T18:58:45.057 INFO:teuthology.orchestra.run.smithi046.stdout:338 2023-07-05T18:58:45.057 INFO:teuthology.orchestra.run.smithi046.stdout:338.out 2023-07-05T18:58:45.057 INFO:teuthology.orchestra.run.smithi046.stdout:339 2023-07-05T18:58:45.058 INFO:teuthology.orchestra.run.smithi046.stdout:339.out 2023-07-05T18:58:45.058 INFO:teuthology.orchestra.run.smithi046.stdout:340 2023-07-05T18:58:45.058 INFO:teuthology.orchestra.run.smithi046.stdout:340.out 2023-07-05T18:58:45.058 INFO:teuthology.orchestra.run.smithi046.stdout:341 2023-07-05T18:58:45.059 INFO:teuthology.orchestra.run.smithi046.stdout:341.out 2023-07-05T18:58:45.059 INFO:teuthology.orchestra.run.smithi046.stdout:342 2023-07-05T18:58:45.059 INFO:teuthology.orchestra.run.smithi046.stdout:342.out 2023-07-05T18:58:45.059 INFO:teuthology.orchestra.run.smithi046.stdout:343 2023-07-05T18:58:45.060 INFO:teuthology.orchestra.run.smithi046.stdout:343.out 2023-07-05T18:58:45.060 INFO:teuthology.orchestra.run.smithi046.stdout:344 2023-07-05T18:58:45.061 INFO:teuthology.orchestra.run.smithi046.stdout:344.out 2023-07-05T18:58:45.061 INFO:teuthology.orchestra.run.smithi046.stdout:345 2023-07-05T18:58:45.061 INFO:teuthology.orchestra.run.smithi046.stdout:345.out 2023-07-05T18:58:45.061 INFO:teuthology.orchestra.run.smithi046.stdout:346 2023-07-05T18:58:45.061 INFO:teuthology.orchestra.run.smithi046.stdout:346.out 2023-07-05T18:58:45.062 INFO:teuthology.orchestra.run.smithi046.stdout:347 2023-07-05T18:58:45.062 INFO:teuthology.orchestra.run.smithi046.stdout:347.out 2023-07-05T18:58:45.062 INFO:teuthology.orchestra.run.smithi046.stdout:348 2023-07-05T18:58:45.062 INFO:teuthology.orchestra.run.smithi046.stdout:348.out 2023-07-05T18:58:45.062 INFO:teuthology.orchestra.run.smithi046.stdout:349 2023-07-05T18:58:45.062 INFO:teuthology.orchestra.run.smithi046.stdout:349.out 2023-07-05T18:58:45.062 INFO:teuthology.orchestra.run.smithi046.stdout:350 2023-07-05T18:58:45.064 INFO:teuthology.orchestra.run.smithi046.stdout:350.out 2023-07-05T18:58:45.064 INFO:teuthology.orchestra.run.smithi046.stdout:351 2023-07-05T18:58:45.064 INFO:teuthology.orchestra.run.smithi046.stdout:351.out 2023-07-05T18:58:45.064 INFO:teuthology.orchestra.run.smithi046.stdout:352 2023-07-05T18:58:45.065 INFO:teuthology.orchestra.run.smithi046.stdout:352.out 2023-07-05T18:58:45.066 INFO:teuthology.orchestra.run.smithi046.stdout:353 2023-07-05T18:58:45.066 INFO:teuthology.orchestra.run.smithi046.stdout:353.out 2023-07-05T18:58:45.066 INFO:teuthology.orchestra.run.smithi046.stdout:354 2023-07-05T18:58:45.067 INFO:teuthology.orchestra.run.smithi046.stdout:354.out 2023-07-05T18:58:45.067 INFO:teuthology.orchestra.run.smithi046.stdout:355 2023-07-05T18:58:45.068 INFO:teuthology.orchestra.run.smithi046.stdout:355.out 2023-07-05T18:58:45.068 INFO:teuthology.orchestra.run.smithi046.stdout:356 2023-07-05T18:58:45.068 INFO:teuthology.orchestra.run.smithi046.stdout:356.out 2023-07-05T18:58:45.069 INFO:teuthology.orchestra.run.smithi046.stdout:357 2023-07-05T18:58:45.069 INFO:teuthology.orchestra.run.smithi046.stdout:357.out 2023-07-05T18:58:45.069 INFO:teuthology.orchestra.run.smithi046.stdout:358 2023-07-05T18:58:45.070 INFO:teuthology.orchestra.run.smithi046.stdout:358.out 2023-07-05T18:58:45.070 INFO:teuthology.orchestra.run.smithi046.stdout:359 2023-07-05T18:58:45.070 INFO:teuthology.orchestra.run.smithi046.stdout:359.out 2023-07-05T18:58:45.071 INFO:teuthology.orchestra.run.smithi046.stdout:360 2023-07-05T18:58:45.071 INFO:teuthology.orchestra.run.smithi046.stdout:360.out 2023-07-05T18:58:45.071 INFO:teuthology.orchestra.run.smithi046.stdout:361 2023-07-05T18:58:45.072 INFO:teuthology.orchestra.run.smithi046.stdout:361.out 2023-07-05T18:58:45.072 INFO:teuthology.orchestra.run.smithi046.stdout:362 2023-07-05T18:58:45.072 INFO:teuthology.orchestra.run.smithi046.stdout:362.out 2023-07-05T18:58:45.073 INFO:teuthology.orchestra.run.smithi046.stdout:363 2023-07-05T18:58:45.073 INFO:teuthology.orchestra.run.smithi046.stdout:363.out 2023-07-05T18:58:45.073 INFO:teuthology.orchestra.run.smithi046.stdout:364 2023-07-05T18:58:45.074 INFO:teuthology.orchestra.run.smithi046.stdout:364.out 2023-07-05T18:58:45.074 INFO:teuthology.orchestra.run.smithi046.stdout:365 2023-07-05T18:58:45.074 INFO:teuthology.orchestra.run.smithi046.stdout:365.out 2023-07-05T18:58:45.074 INFO:teuthology.orchestra.run.smithi046.stdout:366 2023-07-05T18:58:45.075 INFO:teuthology.orchestra.run.smithi046.stdout:366.out 2023-07-05T18:58:45.075 INFO:teuthology.orchestra.run.smithi046.stdout:367 2023-07-05T18:58:45.075 INFO:teuthology.orchestra.run.smithi046.stdout:367.out 2023-07-05T18:58:45.076 INFO:teuthology.orchestra.run.smithi046.stdout:368 2023-07-05T18:58:45.076 INFO:teuthology.orchestra.run.smithi046.stdout:368.out 2023-07-05T18:58:45.076 INFO:teuthology.orchestra.run.smithi046.stdout:369 2023-07-05T18:58:45.077 INFO:teuthology.orchestra.run.smithi046.stdout:369.out 2023-07-05T18:58:45.077 INFO:teuthology.orchestra.run.smithi046.stdout:370 2023-07-05T18:58:45.077 INFO:teuthology.orchestra.run.smithi046.stdout:370.out 2023-07-05T18:58:45.077 INFO:teuthology.orchestra.run.smithi046.stdout:371 2023-07-05T18:58:45.078 INFO:teuthology.orchestra.run.smithi046.stdout:371.out 2023-07-05T18:58:45.078 INFO:teuthology.orchestra.run.smithi046.stdout:372 2023-07-05T18:58:45.078 INFO:teuthology.orchestra.run.smithi046.stdout:372.out 2023-07-05T18:58:45.078 INFO:teuthology.orchestra.run.smithi046.stdout:373 2023-07-05T18:58:45.078 INFO:teuthology.orchestra.run.smithi046.stdout:373.out 2023-07-05T18:58:45.078 INFO:teuthology.orchestra.run.smithi046.stdout:374 2023-07-05T18:58:45.078 INFO:teuthology.orchestra.run.smithi046.stdout:374.out 2023-07-05T18:58:45.078 INFO:teuthology.orchestra.run.smithi046.stdout:375 2023-07-05T18:58:45.079 INFO:teuthology.orchestra.run.smithi046.stdout:375.out 2023-07-05T18:58:45.079 INFO:teuthology.orchestra.run.smithi046.stdout:376 2023-07-05T18:58:45.079 INFO:teuthology.orchestra.run.smithi046.stdout:376.out 2023-07-05T18:58:45.079 INFO:teuthology.orchestra.run.smithi046.stdout:377 2023-07-05T18:58:45.079 INFO:teuthology.orchestra.run.smithi046.stdout:377.out 2023-07-05T18:58:45.079 INFO:teuthology.orchestra.run.smithi046.stdout:378 2023-07-05T18:58:45.080 INFO:teuthology.orchestra.run.smithi046.stdout:378.out 2023-07-05T18:58:45.080 INFO:teuthology.orchestra.run.smithi046.stdout:379 2023-07-05T18:58:45.080 INFO:teuthology.orchestra.run.smithi046.stdout:379.out 2023-07-05T18:58:45.080 INFO:teuthology.orchestra.run.smithi046.stdout:380 2023-07-05T18:58:45.080 INFO:teuthology.orchestra.run.smithi046.stdout:380.out 2023-07-05T18:58:45.080 INFO:teuthology.orchestra.run.smithi046.stdout:381 2023-07-05T18:58:45.080 INFO:teuthology.orchestra.run.smithi046.stdout:381.out 2023-07-05T18:58:45.081 INFO:teuthology.orchestra.run.smithi046.stdout:382 2023-07-05T18:58:45.081 INFO:teuthology.orchestra.run.smithi046.stdout:382.out 2023-07-05T18:58:45.081 INFO:teuthology.orchestra.run.smithi046.stdout:383 2023-07-05T18:58:45.081 INFO:teuthology.orchestra.run.smithi046.stdout:383.out 2023-07-05T18:58:45.081 INFO:teuthology.orchestra.run.smithi046.stdout:384 2023-07-05T18:58:45.081 INFO:teuthology.orchestra.run.smithi046.stdout:384.out 2023-07-05T18:58:45.082 INFO:teuthology.orchestra.run.smithi046.stdout:385 2023-07-05T18:58:45.082 INFO:teuthology.orchestra.run.smithi046.stdout:385.out 2023-07-05T18:58:45.082 INFO:teuthology.orchestra.run.smithi046.stdout:386 2023-07-05T18:58:45.082 INFO:teuthology.orchestra.run.smithi046.stdout:386.out 2023-07-05T18:58:45.083 INFO:teuthology.orchestra.run.smithi046.stdout:387 2023-07-05T18:58:45.083 INFO:teuthology.orchestra.run.smithi046.stdout:387.out 2023-07-05T18:58:45.083 INFO:teuthology.orchestra.run.smithi046.stdout:388 2023-07-05T18:58:45.083 INFO:teuthology.orchestra.run.smithi046.stdout:388.out 2023-07-05T18:58:45.084 INFO:teuthology.orchestra.run.smithi046.stdout:389 2023-07-05T18:58:45.084 INFO:teuthology.orchestra.run.smithi046.stdout:389.out 2023-07-05T18:58:45.084 INFO:teuthology.orchestra.run.smithi046.stdout:390 2023-07-05T18:58:45.084 INFO:teuthology.orchestra.run.smithi046.stdout:390.out 2023-07-05T18:58:45.084 INFO:teuthology.orchestra.run.smithi046.stdout:391 2023-07-05T18:58:45.084 INFO:teuthology.orchestra.run.smithi046.stdout:391.out 2023-07-05T18:58:45.084 INFO:teuthology.orchestra.run.smithi046.stdout:392 2023-07-05T18:58:45.085 INFO:teuthology.orchestra.run.smithi046.stdout:392.out 2023-07-05T18:58:45.085 INFO:teuthology.orchestra.run.smithi046.stdout:393 2023-07-05T18:58:45.085 INFO:teuthology.orchestra.run.smithi046.stdout:393.out 2023-07-05T18:58:45.085 INFO:teuthology.orchestra.run.smithi046.stdout:394 2023-07-05T18:58:45.085 INFO:teuthology.orchestra.run.smithi046.stdout:394.out 2023-07-05T18:58:45.085 INFO:teuthology.orchestra.run.smithi046.stdout:395 2023-07-05T18:58:45.085 INFO:teuthology.orchestra.run.smithi046.stdout:395.out 2023-07-05T18:58:45.086 INFO:teuthology.orchestra.run.smithi046.stdout:396 2023-07-05T18:58:45.086 INFO:teuthology.orchestra.run.smithi046.stdout:396.out 2023-07-05T18:58:45.086 INFO:teuthology.orchestra.run.smithi046.stdout:397 2023-07-05T18:58:45.086 INFO:teuthology.orchestra.run.smithi046.stdout:397.out 2023-07-05T18:58:45.087 INFO:teuthology.orchestra.run.smithi046.stdout:398 2023-07-05T18:58:45.087 INFO:teuthology.orchestra.run.smithi046.stdout:398.out 2023-07-05T18:58:45.087 INFO:teuthology.orchestra.run.smithi046.stdout:399 2023-07-05T18:58:45.087 INFO:teuthology.orchestra.run.smithi046.stdout:399.out 2023-07-05T18:58:45.088 INFO:teuthology.orchestra.run.smithi046.stdout:400 2023-07-05T18:58:45.088 INFO:teuthology.orchestra.run.smithi046.stdout:400.out 2023-07-05T18:58:45.088 INFO:teuthology.orchestra.run.smithi046.stdout:401 2023-07-05T18:58:45.088 INFO:teuthology.orchestra.run.smithi046.stdout:401.out 2023-07-05T18:58:45.088 INFO:teuthology.orchestra.run.smithi046.stdout:402 2023-07-05T18:58:45.089 INFO:teuthology.orchestra.run.smithi046.stdout:402.out 2023-07-05T18:58:45.089 INFO:teuthology.orchestra.run.smithi046.stdout:403 2023-07-05T18:58:45.089 INFO:teuthology.orchestra.run.smithi046.stdout:403.out 2023-07-05T18:58:45.089 INFO:teuthology.orchestra.run.smithi046.stdout:404 2023-07-05T18:58:45.089 INFO:teuthology.orchestra.run.smithi046.stdout:404.out 2023-07-05T18:58:45.089 INFO:teuthology.orchestra.run.smithi046.stdout:405 2023-07-05T18:58:45.089 INFO:teuthology.orchestra.run.smithi046.stdout:405.out 2023-07-05T18:58:45.090 INFO:teuthology.orchestra.run.smithi046.stdout:406 2023-07-05T18:58:45.090 INFO:teuthology.orchestra.run.smithi046.stdout:406.out 2023-07-05T18:58:45.090 INFO:teuthology.orchestra.run.smithi046.stdout:407 2023-07-05T18:58:45.090 INFO:teuthology.orchestra.run.smithi046.stdout:407.out 2023-07-05T18:58:45.090 INFO:teuthology.orchestra.run.smithi046.stdout:408 2023-07-05T18:58:45.090 INFO:teuthology.orchestra.run.smithi046.stdout:408.out 2023-07-05T18:58:45.090 INFO:teuthology.orchestra.run.smithi046.stdout:409 2023-07-05T18:58:45.091 INFO:teuthology.orchestra.run.smithi046.stdout:409.out 2023-07-05T18:58:45.091 INFO:teuthology.orchestra.run.smithi046.stdout:410 2023-07-05T18:58:45.091 INFO:teuthology.orchestra.run.smithi046.stdout:410.out 2023-07-05T18:58:45.091 INFO:teuthology.orchestra.run.smithi046.stdout:411 2023-07-05T18:58:45.091 INFO:teuthology.orchestra.run.smithi046.stdout:411.out 2023-07-05T18:58:45.091 INFO:teuthology.orchestra.run.smithi046.stdout:412 2023-07-05T18:58:45.091 INFO:teuthology.orchestra.run.smithi046.stdout:412.out 2023-07-05T18:58:45.091 INFO:teuthology.orchestra.run.smithi046.stdout:413 2023-07-05T18:58:45.092 INFO:teuthology.orchestra.run.smithi046.stdout:413.out 2023-07-05T18:58:45.092 INFO:teuthology.orchestra.run.smithi046.stdout:414 2023-07-05T18:58:45.092 INFO:teuthology.orchestra.run.smithi046.stdout:414.out 2023-07-05T18:58:45.092 INFO:teuthology.orchestra.run.smithi046.stdout:415 2023-07-05T18:58:45.092 INFO:teuthology.orchestra.run.smithi046.stdout:415.out 2023-07-05T18:58:45.092 INFO:teuthology.orchestra.run.smithi046.stdout:416 2023-07-05T18:58:45.092 INFO:teuthology.orchestra.run.smithi046.stdout:416.out 2023-07-05T18:58:45.093 INFO:teuthology.orchestra.run.smithi046.stdout:417 2023-07-05T18:58:45.093 INFO:teuthology.orchestra.run.smithi046.stdout:417.out 2023-07-05T18:58:45.093 INFO:teuthology.orchestra.run.smithi046.stdout:418 2023-07-05T18:58:45.093 INFO:teuthology.orchestra.run.smithi046.stdout:418.out 2023-07-05T18:58:45.093 INFO:teuthology.orchestra.run.smithi046.stdout:419 2023-07-05T18:58:45.093 INFO:teuthology.orchestra.run.smithi046.stdout:419.out 2023-07-05T18:58:45.094 INFO:teuthology.orchestra.run.smithi046.stdout:420 2023-07-05T18:58:45.094 INFO:teuthology.orchestra.run.smithi046.stdout:420.out 2023-07-05T18:58:45.094 INFO:teuthology.orchestra.run.smithi046.stdout:421 2023-07-05T18:58:45.094 INFO:teuthology.orchestra.run.smithi046.stdout:421.out 2023-07-05T18:58:45.095 INFO:teuthology.orchestra.run.smithi046.stdout:422 2023-07-05T18:58:45.095 INFO:teuthology.orchestra.run.smithi046.stdout:422.out 2023-07-05T18:58:45.095 INFO:teuthology.orchestra.run.smithi046.stdout:423 2023-07-05T18:58:45.096 INFO:teuthology.orchestra.run.smithi046.stdout:423.out 2023-07-05T18:58:45.097 INFO:teuthology.orchestra.run.smithi046.stdout:424 2023-07-05T18:58:45.097 INFO:teuthology.orchestra.run.smithi046.stdout:424.out 2023-07-05T18:58:45.097 INFO:teuthology.orchestra.run.smithi046.stdout:425 2023-07-05T18:58:45.097 INFO:teuthology.orchestra.run.smithi046.stdout:425.out 2023-07-05T18:58:45.098 INFO:teuthology.orchestra.run.smithi046.stdout:426 2023-07-05T18:58:45.098 INFO:teuthology.orchestra.run.smithi046.stdout:426.out 2023-07-05T18:58:45.098 INFO:teuthology.orchestra.run.smithi046.stdout:427 2023-07-05T18:58:45.098 INFO:teuthology.orchestra.run.smithi046.stdout:427.out 2023-07-05T18:58:45.099 INFO:teuthology.orchestra.run.smithi046.stdout:428 2023-07-05T18:58:45.099 INFO:teuthology.orchestra.run.smithi046.stdout:428.out 2023-07-05T18:58:45.099 INFO:teuthology.orchestra.run.smithi046.stdout:429 2023-07-05T18:58:45.099 INFO:teuthology.orchestra.run.smithi046.stdout:429.out 2023-07-05T18:58:45.100 INFO:teuthology.orchestra.run.smithi046.stdout:430 2023-07-05T18:58:45.100 INFO:teuthology.orchestra.run.smithi046.stdout:430.out 2023-07-05T18:58:45.100 INFO:teuthology.orchestra.run.smithi046.stdout:431 2023-07-05T18:58:45.101 INFO:teuthology.orchestra.run.smithi046.stdout:431.out 2023-07-05T18:58:45.101 INFO:teuthology.orchestra.run.smithi046.stdout:432 2023-07-05T18:58:45.102 INFO:teuthology.orchestra.run.smithi046.stdout:432.out 2023-07-05T18:58:45.102 INFO:teuthology.orchestra.run.smithi046.stdout:433 2023-07-05T18:58:45.103 INFO:teuthology.orchestra.run.smithi046.stdout:433.out 2023-07-05T18:58:45.103 INFO:teuthology.orchestra.run.smithi046.stdout:434 2023-07-05T18:58:45.103 INFO:teuthology.orchestra.run.smithi046.stdout:434.out 2023-07-05T18:58:45.103 INFO:teuthology.orchestra.run.smithi046.stdout:435 2023-07-05T18:58:45.105 INFO:teuthology.orchestra.run.smithi046.stdout:435.out 2023-07-05T18:58:45.105 INFO:teuthology.orchestra.run.smithi046.stdout:436 2023-07-05T18:58:45.106 INFO:teuthology.orchestra.run.smithi046.stdout:436.out 2023-07-05T18:58:45.106 INFO:teuthology.orchestra.run.smithi046.stdout:437 2023-07-05T18:58:45.107 INFO:teuthology.orchestra.run.smithi046.stdout:437.out 2023-07-05T18:58:45.107 INFO:teuthology.orchestra.run.smithi046.stdout:438 2023-07-05T18:58:45.107 INFO:teuthology.orchestra.run.smithi046.stdout:438.out 2023-07-05T18:58:45.108 INFO:teuthology.orchestra.run.smithi046.stdout:439 2023-07-05T18:58:45.108 INFO:teuthology.orchestra.run.smithi046.stdout:439.out 2023-07-05T18:58:45.108 INFO:teuthology.orchestra.run.smithi046.stdout:440 2023-07-05T18:58:45.108 INFO:teuthology.orchestra.run.smithi046.stdout:440.out 2023-07-05T18:58:45.109 INFO:teuthology.orchestra.run.smithi046.stdout:441 2023-07-05T18:58:45.109 INFO:teuthology.orchestra.run.smithi046.stdout:441.out 2023-07-05T18:58:45.112 INFO:teuthology.orchestra.run.smithi046.stdout:442 2023-07-05T18:58:45.112 INFO:teuthology.orchestra.run.smithi046.stdout:442.out 2023-07-05T18:58:45.113 INFO:teuthology.orchestra.run.smithi046.stdout:443 2023-07-05T18:58:45.113 INFO:teuthology.orchestra.run.smithi046.stdout:443.out 2023-07-05T18:58:45.113 INFO:teuthology.orchestra.run.smithi046.stdout:444 2023-07-05T18:58:45.114 INFO:teuthology.orchestra.run.smithi046.stdout:444.out 2023-07-05T18:58:45.114 INFO:teuthology.orchestra.run.smithi046.stdout:445 2023-07-05T18:58:45.114 INFO:teuthology.orchestra.run.smithi046.stdout:445.out 2023-07-05T18:58:45.114 INFO:teuthology.orchestra.run.smithi046.stdout:446 2023-07-05T18:58:45.115 INFO:teuthology.orchestra.run.smithi046.stdout:446.out 2023-07-05T18:58:45.115 INFO:teuthology.orchestra.run.smithi046.stdout:447 2023-07-05T18:58:45.115 INFO:teuthology.orchestra.run.smithi046.stdout:447.out 2023-07-05T18:58:45.115 INFO:teuthology.orchestra.run.smithi046.stdout:448 2023-07-05T18:58:45.116 INFO:teuthology.orchestra.run.smithi046.stdout:448.out 2023-07-05T18:58:45.116 INFO:teuthology.orchestra.run.smithi046.stdout:449 2023-07-05T18:58:45.116 INFO:teuthology.orchestra.run.smithi046.stdout:449.out 2023-07-05T18:58:45.117 INFO:teuthology.orchestra.run.smithi046.stdout:450 2023-07-05T18:58:45.117 INFO:teuthology.orchestra.run.smithi046.stdout:450.out 2023-07-05T18:58:45.117 INFO:teuthology.orchestra.run.smithi046.stdout:451 2023-07-05T18:58:45.117 INFO:teuthology.orchestra.run.smithi046.stdout:451.out 2023-07-05T18:58:45.118 INFO:teuthology.orchestra.run.smithi046.stdout:452 2023-07-05T18:58:45.118 INFO:teuthology.orchestra.run.smithi046.stdout:452.out 2023-07-05T18:58:45.118 INFO:teuthology.orchestra.run.smithi046.stdout:453 2023-07-05T18:58:45.118 INFO:teuthology.orchestra.run.smithi046.stdout:453.out 2023-07-05T18:58:45.122 INFO:teuthology.orchestra.run.smithi046.stdout:454 2023-07-05T18:58:45.122 INFO:teuthology.orchestra.run.smithi046.stdout:454.out 2023-07-05T18:58:45.122 INFO:teuthology.orchestra.run.smithi046.stdout:455 2023-07-05T18:58:45.122 INFO:teuthology.orchestra.run.smithi046.stdout:455.out 2023-07-05T18:58:45.123 INFO:teuthology.orchestra.run.smithi046.stdout:456 2023-07-05T18:58:45.123 INFO:teuthology.orchestra.run.smithi046.stdout:456.out 2023-07-05T18:58:45.123 INFO:teuthology.orchestra.run.smithi046.stdout:457 2023-07-05T18:58:45.123 INFO:teuthology.orchestra.run.smithi046.stdout:457.out 2023-07-05T18:58:45.123 INFO:teuthology.orchestra.run.smithi046.stdout:458 2023-07-05T18:58:45.123 INFO:teuthology.orchestra.run.smithi046.stdout:458.out 2023-07-05T18:58:45.123 INFO:teuthology.orchestra.run.smithi046.stdout:459 2023-07-05T18:58:45.124 INFO:teuthology.orchestra.run.smithi046.stdout:459.out 2023-07-05T18:58:45.124 INFO:teuthology.orchestra.run.smithi046.stdout:460 2023-07-05T18:58:45.124 INFO:teuthology.orchestra.run.smithi046.stdout:460.out 2023-07-05T18:58:45.124 INFO:teuthology.orchestra.run.smithi046.stdout:461 2023-07-05T18:58:45.124 INFO:teuthology.orchestra.run.smithi046.stdout:461.out 2023-07-05T18:58:45.124 INFO:teuthology.orchestra.run.smithi046.stdout:462 2023-07-05T18:58:45.125 INFO:teuthology.orchestra.run.smithi046.stdout:462.out 2023-07-05T18:58:45.125 INFO:teuthology.orchestra.run.smithi046.stdout:463 2023-07-05T18:58:45.125 INFO:teuthology.orchestra.run.smithi046.stdout:463.out 2023-07-05T18:58:45.125 INFO:teuthology.orchestra.run.smithi046.stdout:464 2023-07-05T18:58:45.125 INFO:teuthology.orchestra.run.smithi046.stdout:464.out 2023-07-05T18:58:45.125 INFO:teuthology.orchestra.run.smithi046.stdout:465 2023-07-05T18:58:45.125 INFO:teuthology.orchestra.run.smithi046.stdout:465.out 2023-07-05T18:58:45.125 INFO:teuthology.orchestra.run.smithi046.stdout:466 2023-07-05T18:58:45.126 INFO:teuthology.orchestra.run.smithi046.stdout:466.out 2023-07-05T18:58:45.127 INFO:teuthology.orchestra.run.smithi046.stdout:467 2023-07-05T18:58:45.128 INFO:teuthology.orchestra.run.smithi046.stdout:467.out 2023-07-05T18:58:45.128 INFO:teuthology.orchestra.run.smithi046.stdout:468 2023-07-05T18:58:45.128 INFO:teuthology.orchestra.run.smithi046.stdout:468.out 2023-07-05T18:58:45.129 INFO:teuthology.orchestra.run.smithi046.stdout:469 2023-07-05T18:58:45.129 INFO:teuthology.orchestra.run.smithi046.stdout:469.out 2023-07-05T18:58:45.129 INFO:teuthology.orchestra.run.smithi046.stdout:470 2023-07-05T18:58:45.129 INFO:teuthology.orchestra.run.smithi046.stdout:470.out 2023-07-05T18:58:45.129 INFO:teuthology.orchestra.run.smithi046.stdout:471 2023-07-05T18:58:45.130 INFO:teuthology.orchestra.run.smithi046.stdout:471.out 2023-07-05T18:58:45.130 INFO:teuthology.orchestra.run.smithi046.stdout:472 2023-07-05T18:58:45.130 INFO:teuthology.orchestra.run.smithi046.stdout:472.out 2023-07-05T18:58:45.130 INFO:teuthology.orchestra.run.smithi046.stdout:473 2023-07-05T18:58:45.131 INFO:teuthology.orchestra.run.smithi046.stdout:473.out 2023-07-05T18:58:45.131 INFO:teuthology.orchestra.run.smithi046.stdout:474 2023-07-05T18:58:45.131 INFO:teuthology.orchestra.run.smithi046.stdout:474.out 2023-07-05T18:58:45.131 INFO:teuthology.orchestra.run.smithi046.stdout:475 2023-07-05T18:58:45.131 INFO:teuthology.orchestra.run.smithi046.stdout:475.out 2023-07-05T18:58:45.131 INFO:teuthology.orchestra.run.smithi046.stdout:476 2023-07-05T18:58:45.131 INFO:teuthology.orchestra.run.smithi046.stdout:476.out 2023-07-05T18:58:45.131 INFO:teuthology.orchestra.run.smithi046.stdout:477 2023-07-05T18:58:45.132 INFO:teuthology.orchestra.run.smithi046.stdout:477.out 2023-07-05T18:58:45.132 INFO:teuthology.orchestra.run.smithi046.stdout:478 2023-07-05T18:58:45.132 INFO:teuthology.orchestra.run.smithi046.stdout:478.out 2023-07-05T18:58:45.132 INFO:teuthology.orchestra.run.smithi046.stdout:479 2023-07-05T18:58:45.132 INFO:teuthology.orchestra.run.smithi046.stdout:479.out 2023-07-05T18:58:45.132 INFO:teuthology.orchestra.run.smithi046.stdout:480 2023-07-05T18:58:45.132 INFO:teuthology.orchestra.run.smithi046.stdout:480.out 2023-07-05T18:58:45.133 INFO:teuthology.orchestra.run.smithi046.stdout:481 2023-07-05T18:58:45.133 INFO:teuthology.orchestra.run.smithi046.stdout:481.out 2023-07-05T18:58:45.133 INFO:teuthology.orchestra.run.smithi046.stdout:482 2023-07-05T18:58:45.133 INFO:teuthology.orchestra.run.smithi046.stdout:482.out 2023-07-05T18:58:45.133 INFO:teuthology.orchestra.run.smithi046.stdout:483 2023-07-05T18:58:45.133 INFO:teuthology.orchestra.run.smithi046.stdout:483.out 2023-07-05T18:58:45.133 INFO:teuthology.orchestra.run.smithi046.stdout:484 2023-07-05T18:58:45.133 INFO:teuthology.orchestra.run.smithi046.stdout:484.out 2023-07-05T18:58:45.134 INFO:teuthology.orchestra.run.smithi046.stdout:485 2023-07-05T18:58:45.134 INFO:teuthology.orchestra.run.smithi046.stdout:485.out 2023-07-05T18:58:45.134 INFO:teuthology.orchestra.run.smithi046.stdout:486 2023-07-05T18:58:45.134 INFO:teuthology.orchestra.run.smithi046.stdout:486.out 2023-07-05T18:58:45.134 INFO:teuthology.orchestra.run.smithi046.stdout:487 2023-07-05T18:58:45.134 INFO:teuthology.orchestra.run.smithi046.stdout:487.out 2023-07-05T18:58:45.134 INFO:teuthology.orchestra.run.smithi046.stdout:488 2023-07-05T18:58:45.135 INFO:teuthology.orchestra.run.smithi046.stdout:488.out 2023-07-05T18:58:45.135 INFO:teuthology.orchestra.run.smithi046.stdout:489 2023-07-05T18:58:45.135 INFO:teuthology.orchestra.run.smithi046.stdout:489.out 2023-07-05T18:58:45.135 INFO:teuthology.orchestra.run.smithi046.stdout:490 2023-07-05T18:58:45.135 INFO:teuthology.orchestra.run.smithi046.stdout:490.out 2023-07-05T18:58:45.135 INFO:teuthology.orchestra.run.smithi046.stdout:491 2023-07-05T18:58:45.135 INFO:teuthology.orchestra.run.smithi046.stdout:491.out 2023-07-05T18:58:45.135 INFO:teuthology.orchestra.run.smithi046.stdout:492 2023-07-05T18:58:45.136 INFO:teuthology.orchestra.run.smithi046.stdout:492.out 2023-07-05T18:58:45.136 INFO:teuthology.orchestra.run.smithi046.stdout:493 2023-07-05T18:58:45.136 INFO:teuthology.orchestra.run.smithi046.stdout:493.out 2023-07-05T18:58:45.136 INFO:teuthology.orchestra.run.smithi046.stdout:494 2023-07-05T18:58:45.136 INFO:teuthology.orchestra.run.smithi046.stdout:494.out 2023-07-05T18:58:45.136 INFO:teuthology.orchestra.run.smithi046.stdout:495 2023-07-05T18:58:45.136 INFO:teuthology.orchestra.run.smithi046.stdout:495.out 2023-07-05T18:58:45.137 INFO:teuthology.orchestra.run.smithi046.stdout:496 2023-07-05T18:58:45.137 INFO:teuthology.orchestra.run.smithi046.stdout:496.out 2023-07-05T18:58:45.137 INFO:teuthology.orchestra.run.smithi046.stdout:497 2023-07-05T18:58:45.137 INFO:teuthology.orchestra.run.smithi046.stdout:497.out 2023-07-05T18:58:45.137 INFO:teuthology.orchestra.run.smithi046.stdout:498 2023-07-05T18:58:45.137 INFO:teuthology.orchestra.run.smithi046.stdout:498.out 2023-07-05T18:58:45.139 INFO:teuthology.orchestra.run.smithi046.stdout:499 2023-07-05T18:58:45.139 INFO:teuthology.orchestra.run.smithi046.stdout:499.out 2023-07-05T18:58:45.139 INFO:teuthology.orchestra.run.smithi046.stdout:500 2023-07-05T18:58:45.140 INFO:teuthology.orchestra.run.smithi046.stdout:500.out 2023-07-05T18:58:45.140 INFO:teuthology.orchestra.run.smithi046.stdout:501 2023-07-05T18:58:45.140 INFO:teuthology.orchestra.run.smithi046.stdout:501.out 2023-07-05T18:58:45.140 INFO:teuthology.orchestra.run.smithi046.stdout:502 2023-07-05T18:58:45.140 INFO:teuthology.orchestra.run.smithi046.stdout:502.out 2023-07-05T18:58:45.140 INFO:teuthology.orchestra.run.smithi046.stdout:503 2023-07-05T18:58:45.141 INFO:teuthology.orchestra.run.smithi046.stdout:503.out 2023-07-05T18:58:45.141 INFO:teuthology.orchestra.run.smithi046.stdout:504 2023-07-05T18:58:45.141 INFO:teuthology.orchestra.run.smithi046.stdout:504.out 2023-07-05T18:58:45.141 INFO:teuthology.orchestra.run.smithi046.stdout:505 2023-07-05T18:58:45.141 INFO:teuthology.orchestra.run.smithi046.stdout:505.out 2023-07-05T18:58:45.141 INFO:teuthology.orchestra.run.smithi046.stdout:506 2023-07-05T18:58:45.141 INFO:teuthology.orchestra.run.smithi046.stdout:506.out 2023-07-05T18:58:45.141 INFO:teuthology.orchestra.run.smithi046.stdout:507 2023-07-05T18:58:45.142 INFO:teuthology.orchestra.run.smithi046.stdout:507.out 2023-07-05T18:58:45.142 INFO:teuthology.orchestra.run.smithi046.stdout:508 2023-07-05T18:58:45.142 INFO:teuthology.orchestra.run.smithi046.stdout:508.out 2023-07-05T18:58:45.142 INFO:teuthology.orchestra.run.smithi046.stdout:509 2023-07-05T18:58:45.142 INFO:teuthology.orchestra.run.smithi046.stdout:509.out 2023-07-05T18:58:45.142 INFO:teuthology.orchestra.run.smithi046.stdout:510 2023-07-05T18:58:45.142 INFO:teuthology.orchestra.run.smithi046.stdout:510.out 2023-07-05T18:58:45.142 INFO:teuthology.orchestra.run.smithi046.stdout:511 2023-07-05T18:58:45.143 INFO:teuthology.orchestra.run.smithi046.stdout:511.out 2023-07-05T18:58:45.143 INFO:teuthology.orchestra.run.smithi046.stdout:512 2023-07-05T18:58:45.143 INFO:teuthology.orchestra.run.smithi046.stdout:512.out 2023-07-05T18:58:45.143 INFO:teuthology.orchestra.run.smithi046.stdout:513 2023-07-05T18:58:45.143 INFO:teuthology.orchestra.run.smithi046.stdout:513.out 2023-07-05T18:58:45.143 INFO:teuthology.orchestra.run.smithi046.stdout:514 2023-07-05T18:58:45.149 INFO:teuthology.orchestra.run.smithi046.stdout:514.out 2023-07-05T18:58:45.149 INFO:teuthology.orchestra.run.smithi046.stdout:515 2023-07-05T18:58:45.149 INFO:teuthology.orchestra.run.smithi046.stdout:515.out 2023-07-05T18:58:45.150 INFO:teuthology.orchestra.run.smithi046.stdout:516 2023-07-05T18:58:45.150 INFO:teuthology.orchestra.run.smithi046.stdout:516.out 2023-07-05T18:58:45.150 INFO:teuthology.orchestra.run.smithi046.stdout:517 2023-07-05T18:58:45.150 INFO:teuthology.orchestra.run.smithi046.stdout:517.out 2023-07-05T18:58:45.150 INFO:teuthology.orchestra.run.smithi046.stdout:518 2023-07-05T18:58:45.150 INFO:teuthology.orchestra.run.smithi046.stdout:518.out 2023-07-05T18:58:45.150 INFO:teuthology.orchestra.run.smithi046.stdout:519 2023-07-05T18:58:45.151 INFO:teuthology.orchestra.run.smithi046.stdout:519.out 2023-07-05T18:58:45.151 INFO:teuthology.orchestra.run.smithi046.stdout:520 2023-07-05T18:58:45.151 INFO:teuthology.orchestra.run.smithi046.stdout:520.out 2023-07-05T18:58:45.151 INFO:teuthology.orchestra.run.smithi046.stdout:521 2023-07-05T18:58:45.151 INFO:teuthology.orchestra.run.smithi046.stdout:521.out 2023-07-05T18:58:45.151 INFO:teuthology.orchestra.run.smithi046.stdout:522 2023-07-05T18:58:45.151 INFO:teuthology.orchestra.run.smithi046.stdout:522.out 2023-07-05T18:58:45.151 INFO:teuthology.orchestra.run.smithi046.stdout:523 2023-07-05T18:58:45.152 INFO:teuthology.orchestra.run.smithi046.stdout:523.out 2023-07-05T18:58:45.152 INFO:teuthology.orchestra.run.smithi046.stdout:524 2023-07-05T18:58:45.152 INFO:teuthology.orchestra.run.smithi046.stdout:524.out 2023-07-05T18:58:45.152 INFO:teuthology.orchestra.run.smithi046.stdout:525 2023-07-05T18:58:45.152 INFO:teuthology.orchestra.run.smithi046.stdout:525.out 2023-07-05T18:58:45.152 INFO:teuthology.orchestra.run.smithi046.stdout:526 2023-07-05T18:58:45.153 INFO:teuthology.orchestra.run.smithi046.stdout:526.out 2023-07-05T18:58:45.153 INFO:teuthology.orchestra.run.smithi046.stdout:527 2023-07-05T18:58:45.153 INFO:teuthology.orchestra.run.smithi046.stdout:527.out 2023-07-05T18:58:45.153 INFO:teuthology.orchestra.run.smithi046.stdout:528 2023-07-05T18:58:45.153 INFO:teuthology.orchestra.run.smithi046.stdout:528.out 2023-07-05T18:58:45.153 INFO:teuthology.orchestra.run.smithi046.stdout:529 2023-07-05T18:58:45.153 INFO:teuthology.orchestra.run.smithi046.stdout:529.out 2023-07-05T18:58:45.153 INFO:teuthology.orchestra.run.smithi046.stdout:530 2023-07-05T18:58:45.154 INFO:teuthology.orchestra.run.smithi046.stdout:530.out 2023-07-05T18:58:45.154 INFO:teuthology.orchestra.run.smithi046.stdout:531 2023-07-05T18:58:45.154 INFO:teuthology.orchestra.run.smithi046.stdout:531.out 2023-07-05T18:58:45.154 INFO:teuthology.orchestra.run.smithi046.stdout:532 2023-07-05T18:58:45.154 INFO:teuthology.orchestra.run.smithi046.stdout:532.out 2023-07-05T18:58:45.154 INFO:teuthology.orchestra.run.smithi046.stdout:533 2023-07-05T18:58:45.154 INFO:teuthology.orchestra.run.smithi046.stdout:533.out 2023-07-05T18:58:45.155 INFO:teuthology.orchestra.run.smithi046.stdout:534 2023-07-05T18:58:45.155 INFO:teuthology.orchestra.run.smithi046.stdout:534.out 2023-07-05T18:58:45.155 INFO:teuthology.orchestra.run.smithi046.stdout:535 2023-07-05T18:58:45.155 INFO:teuthology.orchestra.run.smithi046.stdout:535.out 2023-07-05T18:58:45.155 INFO:teuthology.orchestra.run.smithi046.stdout:536 2023-07-05T18:58:45.155 INFO:teuthology.orchestra.run.smithi046.stdout:536.out 2023-07-05T18:58:45.155 INFO:teuthology.orchestra.run.smithi046.stdout:537 2023-07-05T18:58:45.155 INFO:teuthology.orchestra.run.smithi046.stdout:537.out 2023-07-05T18:58:45.156 INFO:teuthology.orchestra.run.smithi046.stdout:538 2023-07-05T18:58:45.156 INFO:teuthology.orchestra.run.smithi046.stdout:538.out 2023-07-05T18:58:45.156 INFO:teuthology.orchestra.run.smithi046.stdout:539 2023-07-05T18:58:45.156 INFO:teuthology.orchestra.run.smithi046.stdout:539.out 2023-07-05T18:58:45.156 INFO:teuthology.orchestra.run.smithi046.stdout:540 2023-07-05T18:58:45.156 INFO:teuthology.orchestra.run.smithi046.stdout:540.out 2023-07-05T18:58:45.156 INFO:teuthology.orchestra.run.smithi046.stdout:541 2023-07-05T18:58:45.157 INFO:teuthology.orchestra.run.smithi046.stdout:541.out 2023-07-05T18:58:45.157 INFO:teuthology.orchestra.run.smithi046.stdout:542 2023-07-05T18:58:45.157 INFO:teuthology.orchestra.run.smithi046.stdout:542.out 2023-07-05T18:58:45.157 INFO:teuthology.orchestra.run.smithi046.stdout:543 2023-07-05T18:58:45.157 INFO:teuthology.orchestra.run.smithi046.stdout:543.out 2023-07-05T18:58:45.157 INFO:teuthology.orchestra.run.smithi046.stdout:544 2023-07-05T18:58:45.157 INFO:teuthology.orchestra.run.smithi046.stdout:544.out 2023-07-05T18:58:45.157 INFO:teuthology.orchestra.run.smithi046.stdout:545 2023-07-05T18:58:45.158 INFO:teuthology.orchestra.run.smithi046.stdout:545.out 2023-07-05T18:58:45.158 INFO:teuthology.orchestra.run.smithi046.stdout:546 2023-07-05T18:58:45.158 INFO:teuthology.orchestra.run.smithi046.stdout:546.out 2023-07-05T18:58:45.158 INFO:teuthology.orchestra.run.smithi046.stdout:547 2023-07-05T18:58:45.159 INFO:teuthology.orchestra.run.smithi046.stdout:547.out 2023-07-05T18:58:45.159 INFO:teuthology.orchestra.run.smithi046.stdout:548 2023-07-05T18:58:45.159 INFO:teuthology.orchestra.run.smithi046.stdout:548.out 2023-07-05T18:58:45.159 INFO:teuthology.orchestra.run.smithi046.stdout:549 2023-07-05T18:58:45.160 INFO:teuthology.orchestra.run.smithi046.stdout:549.out 2023-07-05T18:58:45.160 INFO:teuthology.orchestra.run.smithi046.stdout:550 2023-07-05T18:58:45.160 INFO:teuthology.orchestra.run.smithi046.stdout:550.out 2023-07-05T18:58:45.161 INFO:teuthology.orchestra.run.smithi046.stdout:551 2023-07-05T18:58:45.161 INFO:teuthology.orchestra.run.smithi046.stdout:551.out 2023-07-05T18:58:45.161 INFO:teuthology.orchestra.run.smithi046.stdout:552 2023-07-05T18:58:45.161 INFO:teuthology.orchestra.run.smithi046.stdout:552.out 2023-07-05T18:58:45.161 INFO:teuthology.orchestra.run.smithi046.stdout:553 2023-07-05T18:58:45.162 INFO:teuthology.orchestra.run.smithi046.stdout:553.out 2023-07-05T18:58:45.162 INFO:teuthology.orchestra.run.smithi046.stdout:554 2023-07-05T18:58:45.162 INFO:teuthology.orchestra.run.smithi046.stdout:554.out 2023-07-05T18:58:45.162 INFO:teuthology.orchestra.run.smithi046.stdout:555 2023-07-05T18:58:45.163 INFO:teuthology.orchestra.run.smithi046.stdout:555.out 2023-07-05T18:58:45.163 INFO:teuthology.orchestra.run.smithi046.stdout:556 2023-07-05T18:58:45.163 INFO:teuthology.orchestra.run.smithi046.stdout:556.out 2023-07-05T18:58:45.163 INFO:teuthology.orchestra.run.smithi046.stdout:557 2023-07-05T18:58:45.163 INFO:teuthology.orchestra.run.smithi046.stdout:557.out 2023-07-05T18:58:45.163 INFO:teuthology.orchestra.run.smithi046.stdout:558 2023-07-05T18:58:45.164 INFO:teuthology.orchestra.run.smithi046.stdout:558.out 2023-07-05T18:58:45.164 INFO:teuthology.orchestra.run.smithi046.stdout:559 2023-07-05T18:58:45.164 INFO:teuthology.orchestra.run.smithi046.stdout:559.out 2023-07-05T18:58:45.173 INFO:teuthology.orchestra.run.smithi046.stdout:560 2023-07-05T18:58:45.173 INFO:teuthology.orchestra.run.smithi046.stdout:560.out 2023-07-05T18:58:45.173 INFO:teuthology.orchestra.run.smithi046.stdout:561 2023-07-05T18:58:45.174 INFO:teuthology.orchestra.run.smithi046.stdout:561.out 2023-07-05T18:58:45.174 INFO:teuthology.orchestra.run.smithi046.stdout:562 2023-07-05T18:58:45.175 INFO:teuthology.orchestra.run.smithi046.stdout:562.out 2023-07-05T18:58:45.175 INFO:teuthology.orchestra.run.smithi046.stdout:563 2023-07-05T18:58:45.175 INFO:teuthology.orchestra.run.smithi046.stdout:563.out 2023-07-05T18:58:45.175 INFO:teuthology.orchestra.run.smithi046.stdout:564 2023-07-05T18:58:45.176 INFO:teuthology.orchestra.run.smithi046.stdout:564.out 2023-07-05T18:58:45.177 INFO:teuthology.orchestra.run.smithi046.stdout:565 2023-07-05T18:58:45.177 INFO:teuthology.orchestra.run.smithi046.stdout:565.out 2023-07-05T18:58:45.178 INFO:teuthology.orchestra.run.smithi046.stdout:566 2023-07-05T18:58:45.178 INFO:teuthology.orchestra.run.smithi046.stdout:566.out 2023-07-05T18:58:45.178 INFO:teuthology.orchestra.run.smithi046.stdout:567 2023-07-05T18:58:45.178 INFO:teuthology.orchestra.run.smithi046.stdout:567.out 2023-07-05T18:58:45.178 INFO:teuthology.orchestra.run.smithi046.stdout:568 2023-07-05T18:58:45.178 INFO:teuthology.orchestra.run.smithi046.stdout:568.out 2023-07-05T18:58:45.178 INFO:teuthology.orchestra.run.smithi046.stdout:569 2023-07-05T18:58:45.179 INFO:teuthology.orchestra.run.smithi046.stdout:569.out 2023-07-05T18:58:45.179 INFO:teuthology.orchestra.run.smithi046.stdout:570 2023-07-05T18:58:45.179 INFO:teuthology.orchestra.run.smithi046.stdout:570.out 2023-07-05T18:58:45.179 INFO:teuthology.orchestra.run.smithi046.stdout:571 2023-07-05T18:58:45.179 INFO:teuthology.orchestra.run.smithi046.stdout:571.out 2023-07-05T18:58:45.179 INFO:teuthology.orchestra.run.smithi046.stdout:572 2023-07-05T18:58:45.179 INFO:teuthology.orchestra.run.smithi046.stdout:572.out 2023-07-05T18:58:45.179 INFO:teuthology.orchestra.run.smithi046.stdout:573 2023-07-05T18:58:45.180 INFO:teuthology.orchestra.run.smithi046.stdout:573.out 2023-07-05T18:58:45.181 INFO:teuthology.orchestra.run.smithi046.stdout:574 2023-07-05T18:58:45.181 INFO:teuthology.orchestra.run.smithi046.stdout:574.out 2023-07-05T18:58:45.181 INFO:teuthology.orchestra.run.smithi046.stdout:575 2023-07-05T18:58:45.181 INFO:teuthology.orchestra.run.smithi046.stdout:575.out 2023-07-05T18:58:45.181 INFO:teuthology.orchestra.run.smithi046.stdout:576 2023-07-05T18:58:45.181 INFO:teuthology.orchestra.run.smithi046.stdout:576.out 2023-07-05T18:58:45.181 INFO:teuthology.orchestra.run.smithi046.stdout:577 2023-07-05T18:58:45.181 INFO:teuthology.orchestra.run.smithi046.stdout:577.out 2023-07-05T18:58:45.182 INFO:teuthology.orchestra.run.smithi046.stdout:578 2023-07-05T18:58:45.182 INFO:teuthology.orchestra.run.smithi046.stdout:578.out 2023-07-05T18:58:45.182 INFO:teuthology.orchestra.run.smithi046.stdout:579 2023-07-05T18:58:45.182 INFO:teuthology.orchestra.run.smithi046.stdout:579.out 2023-07-05T18:58:45.182 INFO:teuthology.orchestra.run.smithi046.stdout:580 2023-07-05T18:58:45.182 INFO:teuthology.orchestra.run.smithi046.stdout:580.out 2023-07-05T18:58:45.184 INFO:teuthology.orchestra.run.smithi046.stdout:581 2023-07-05T18:58:45.184 INFO:teuthology.orchestra.run.smithi046.stdout:581.out 2023-07-05T18:58:45.184 INFO:teuthology.orchestra.run.smithi046.stdout:582 2023-07-05T18:58:45.185 INFO:teuthology.orchestra.run.smithi046.stdout:582.out 2023-07-05T18:58:45.185 INFO:teuthology.orchestra.run.smithi046.stdout:583 2023-07-05T18:58:45.185 INFO:teuthology.orchestra.run.smithi046.stdout:583.out 2023-07-05T18:58:45.186 INFO:teuthology.orchestra.run.smithi046.stdout:584 2023-07-05T18:58:45.186 INFO:teuthology.orchestra.run.smithi046.stdout:584.out 2023-07-05T18:58:45.186 INFO:teuthology.orchestra.run.smithi046.stdout:585 2023-07-05T18:58:45.186 INFO:teuthology.orchestra.run.smithi046.stdout:585.out 2023-07-05T18:58:45.187 INFO:teuthology.orchestra.run.smithi046.stdout:586 2023-07-05T18:58:45.187 INFO:teuthology.orchestra.run.smithi046.stdout:586.out 2023-07-05T18:58:45.187 INFO:teuthology.orchestra.run.smithi046.stdout:587 2023-07-05T18:58:45.188 INFO:teuthology.orchestra.run.smithi046.stdout:587.out 2023-07-05T18:58:45.188 INFO:teuthology.orchestra.run.smithi046.stdout:588 2023-07-05T18:58:45.188 INFO:teuthology.orchestra.run.smithi046.stdout:588.out 2023-07-05T18:58:45.189 INFO:teuthology.orchestra.run.smithi046.stdout:589 2023-07-05T18:58:45.189 INFO:teuthology.orchestra.run.smithi046.stdout:589.out 2023-07-05T18:58:45.189 INFO:teuthology.orchestra.run.smithi046.stdout:590 2023-07-05T18:58:45.189 INFO:teuthology.orchestra.run.smithi046.stdout:590.out 2023-07-05T18:58:45.190 INFO:teuthology.orchestra.run.smithi046.stdout:591 2023-07-05T18:58:45.190 INFO:teuthology.orchestra.run.smithi046.stdout:591.out 2023-07-05T18:58:45.190 INFO:teuthology.orchestra.run.smithi046.stdout:592 2023-07-05T18:58:45.190 INFO:teuthology.orchestra.run.smithi046.stdout:592.out 2023-07-05T18:58:45.191 INFO:teuthology.orchestra.run.smithi046.stdout:593 2023-07-05T18:58:45.191 INFO:teuthology.orchestra.run.smithi046.stdout:593.out 2023-07-05T18:58:45.191 INFO:teuthology.orchestra.run.smithi046.stdout:594 2023-07-05T18:58:45.192 INFO:teuthology.orchestra.run.smithi046.stdout:594.out 2023-07-05T18:58:45.192 INFO:teuthology.orchestra.run.smithi046.stdout:595 2023-07-05T18:58:45.192 INFO:teuthology.orchestra.run.smithi046.stdout:595.out 2023-07-05T18:58:45.193 INFO:teuthology.orchestra.run.smithi046.stdout:596 2023-07-05T18:58:45.193 INFO:teuthology.orchestra.run.smithi046.stdout:596.out 2023-07-05T18:58:45.193 INFO:teuthology.orchestra.run.smithi046.stdout:597 2023-07-05T18:58:45.194 INFO:teuthology.orchestra.run.smithi046.stdout:597.out 2023-07-05T18:58:45.194 INFO:teuthology.orchestra.run.smithi046.stdout:598 2023-07-05T18:58:45.194 INFO:teuthology.orchestra.run.smithi046.stdout:598.out 2023-07-05T18:58:45.195 INFO:teuthology.orchestra.run.smithi046.stdout:599 2023-07-05T18:58:45.195 INFO:teuthology.orchestra.run.smithi046.stdout:599.out 2023-07-05T18:58:45.195 INFO:teuthology.orchestra.run.smithi046.stdout:600 2023-07-05T18:58:45.195 INFO:teuthology.orchestra.run.smithi046.stdout:600.out 2023-07-05T18:58:45.195 INFO:teuthology.orchestra.run.smithi046.stdout:601 2023-07-05T18:58:45.196 INFO:teuthology.orchestra.run.smithi046.stdout:601.out 2023-07-05T18:58:45.196 INFO:teuthology.orchestra.run.smithi046.stdout:602 2023-07-05T18:58:45.197 INFO:teuthology.orchestra.run.smithi046.stdout:602.out 2023-07-05T18:58:45.197 INFO:teuthology.orchestra.run.smithi046.stdout:603 2023-07-05T18:58:45.197 INFO:teuthology.orchestra.run.smithi046.stdout:603.out 2023-07-05T18:58:45.198 INFO:teuthology.orchestra.run.smithi046.stdout:604 2023-07-05T18:58:45.198 INFO:teuthology.orchestra.run.smithi046.stdout:604.out 2023-07-05T18:58:45.198 INFO:teuthology.orchestra.run.smithi046.stdout:605 2023-07-05T18:58:45.198 INFO:teuthology.orchestra.run.smithi046.stdout:605.out 2023-07-05T18:58:45.198 INFO:teuthology.orchestra.run.smithi046.stdout:606 2023-07-05T18:58:45.199 INFO:teuthology.orchestra.run.smithi046.stdout:606.out 2023-07-05T18:58:45.199 INFO:teuthology.orchestra.run.smithi046.stdout:607 2023-07-05T18:58:45.199 INFO:teuthology.orchestra.run.smithi046.stdout:607.out 2023-07-05T18:58:45.200 INFO:teuthology.orchestra.run.smithi046.stdout:608 2023-07-05T18:58:45.200 INFO:teuthology.orchestra.run.smithi046.stdout:608.out 2023-07-05T18:58:45.200 INFO:teuthology.orchestra.run.smithi046.stdout:609 2023-07-05T18:58:45.200 INFO:teuthology.orchestra.run.smithi046.stdout:609.out 2023-07-05T18:58:45.200 INFO:teuthology.orchestra.run.smithi046.stdout:610 2023-07-05T18:58:45.201 INFO:teuthology.orchestra.run.smithi046.stdout:610.out 2023-07-05T18:58:45.201 INFO:teuthology.orchestra.run.smithi046.stdout:611 2023-07-05T18:58:45.201 INFO:teuthology.orchestra.run.smithi046.stdout:611.out 2023-07-05T18:58:45.201 INFO:teuthology.orchestra.run.smithi046.stdout:612 2023-07-05T18:58:45.202 INFO:teuthology.orchestra.run.smithi046.stdout:612.out 2023-07-05T18:58:45.202 INFO:teuthology.orchestra.run.smithi046.stdout:613 2023-07-05T18:58:45.202 INFO:teuthology.orchestra.run.smithi046.stdout:613.out 2023-07-05T18:58:45.202 INFO:teuthology.orchestra.run.smithi046.stdout:614 2023-07-05T18:58:45.202 INFO:teuthology.orchestra.run.smithi046.stdout:614.out 2023-07-05T18:58:45.203 INFO:teuthology.orchestra.run.smithi046.stdout:615 2023-07-05T18:58:45.203 INFO:teuthology.orchestra.run.smithi046.stdout:615.out 2023-07-05T18:58:45.203 INFO:teuthology.orchestra.run.smithi046.stdout:616 2023-07-05T18:58:45.203 INFO:teuthology.orchestra.run.smithi046.stdout:616.out 2023-07-05T18:58:45.204 INFO:teuthology.orchestra.run.smithi046.stdout:617 2023-07-05T18:58:45.204 INFO:teuthology.orchestra.run.smithi046.stdout:617.out 2023-07-05T18:58:45.205 INFO:teuthology.orchestra.run.smithi046.stdout:618 2023-07-05T18:58:45.205 INFO:teuthology.orchestra.run.smithi046.stdout:618.out 2023-07-05T18:58:45.205 INFO:teuthology.orchestra.run.smithi046.stdout:619 2023-07-05T18:58:45.206 INFO:teuthology.orchestra.run.smithi046.stdout:619.out 2023-07-05T18:58:45.206 INFO:teuthology.orchestra.run.smithi046.stdout:620 2023-07-05T18:58:45.206 INFO:teuthology.orchestra.run.smithi046.stdout:620.out 2023-07-05T18:58:45.206 INFO:teuthology.orchestra.run.smithi046.stdout:621 2023-07-05T18:58:45.206 INFO:teuthology.orchestra.run.smithi046.stdout:621.out 2023-07-05T18:58:45.207 INFO:teuthology.orchestra.run.smithi046.stdout:622 2023-07-05T18:58:45.207 INFO:teuthology.orchestra.run.smithi046.stdout:622.out 2023-07-05T18:58:45.207 INFO:teuthology.orchestra.run.smithi046.stdout:623 2023-07-05T18:58:45.207 INFO:teuthology.orchestra.run.smithi046.stdout:623.out 2023-07-05T18:58:45.208 INFO:teuthology.orchestra.run.smithi046.stdout:624 2023-07-05T18:58:45.208 INFO:teuthology.orchestra.run.smithi046.stdout:624.out 2023-07-05T18:58:45.208 INFO:teuthology.orchestra.run.smithi046.stdout:625 2023-07-05T18:58:45.208 INFO:teuthology.orchestra.run.smithi046.stdout:625.out 2023-07-05T18:58:45.209 INFO:teuthology.orchestra.run.smithi046.stdout:626 2023-07-05T18:58:45.209 INFO:teuthology.orchestra.run.smithi046.stdout:626.out 2023-07-05T18:58:45.209 INFO:teuthology.orchestra.run.smithi046.stdout:627 2023-07-05T18:58:45.209 INFO:teuthology.orchestra.run.smithi046.stdout:627.out 2023-07-05T18:58:45.209 INFO:teuthology.orchestra.run.smithi046.stdout:628 2023-07-05T18:58:45.210 INFO:teuthology.orchestra.run.smithi046.stdout:628.out 2023-07-05T18:58:45.210 INFO:teuthology.orchestra.run.smithi046.stdout:629 2023-07-05T18:58:45.210 INFO:teuthology.orchestra.run.smithi046.stdout:629.out 2023-07-05T18:58:45.210 INFO:teuthology.orchestra.run.smithi046.stdout:630 2023-07-05T18:58:45.210 INFO:teuthology.orchestra.run.smithi046.stdout:630.out 2023-07-05T18:58:45.211 INFO:teuthology.orchestra.run.smithi046.stdout:631 2023-07-05T18:58:45.211 INFO:teuthology.orchestra.run.smithi046.stdout:631.out 2023-07-05T18:58:45.211 INFO:teuthology.orchestra.run.smithi046.stdout:632 2023-07-05T18:58:45.212 INFO:teuthology.orchestra.run.smithi046.stdout:632.out 2023-07-05T18:58:45.212 INFO:teuthology.orchestra.run.smithi046.stdout:633 2023-07-05T18:58:45.212 INFO:teuthology.orchestra.run.smithi046.stdout:633.out 2023-07-05T18:58:45.212 INFO:teuthology.orchestra.run.smithi046.stdout:634 2023-07-05T18:58:45.213 INFO:teuthology.orchestra.run.smithi046.stdout:634.out 2023-07-05T18:58:45.213 INFO:teuthology.orchestra.run.smithi046.stdout:635 2023-07-05T18:58:45.213 INFO:teuthology.orchestra.run.smithi046.stdout:635.out 2023-07-05T18:58:45.214 INFO:teuthology.orchestra.run.smithi046.stdout:636 2023-07-05T18:58:45.214 INFO:teuthology.orchestra.run.smithi046.stdout:636.out 2023-07-05T18:58:45.214 INFO:teuthology.orchestra.run.smithi046.stdout:637 2023-07-05T18:58:45.216 INFO:teuthology.orchestra.run.smithi046.stdout:637.out 2023-07-05T18:58:45.216 INFO:teuthology.orchestra.run.smithi046.stdout:638 2023-07-05T18:58:45.216 INFO:teuthology.orchestra.run.smithi046.stdout:638.out 2023-07-05T18:58:45.217 INFO:teuthology.orchestra.run.smithi046.stdout:639 2023-07-05T18:58:45.217 INFO:teuthology.orchestra.run.smithi046.stdout:639.out 2023-07-05T18:58:45.217 INFO:teuthology.orchestra.run.smithi046.stdout:640 2023-07-05T18:58:45.217 INFO:teuthology.orchestra.run.smithi046.stdout:640.out 2023-07-05T18:58:45.217 INFO:teuthology.orchestra.run.smithi046.stdout:641 2023-07-05T18:58:45.218 INFO:teuthology.orchestra.run.smithi046.stdout:641.out 2023-07-05T18:58:45.218 INFO:teuthology.orchestra.run.smithi046.stdout:642 2023-07-05T18:58:45.218 INFO:teuthology.orchestra.run.smithi046.stdout:642.out 2023-07-05T18:58:45.218 INFO:teuthology.orchestra.run.smithi046.stdout:643 2023-07-05T18:58:45.218 INFO:teuthology.orchestra.run.smithi046.stdout:643.out 2023-07-05T18:58:45.219 INFO:teuthology.orchestra.run.smithi046.stdout:644 2023-07-05T18:58:45.219 INFO:teuthology.orchestra.run.smithi046.stdout:644.out 2023-07-05T18:58:45.219 INFO:teuthology.orchestra.run.smithi046.stdout:645 2023-07-05T18:58:45.219 INFO:teuthology.orchestra.run.smithi046.stdout:645.out 2023-07-05T18:58:45.220 INFO:teuthology.orchestra.run.smithi046.stdout:646 2023-07-05T18:58:45.220 INFO:teuthology.orchestra.run.smithi046.stdout:646.out 2023-07-05T18:58:45.220 INFO:teuthology.orchestra.run.smithi046.stdout:647 2023-07-05T18:58:45.220 INFO:teuthology.orchestra.run.smithi046.stdout:647.out 2023-07-05T18:58:45.220 INFO:teuthology.orchestra.run.smithi046.stdout:648 2023-07-05T18:58:45.221 INFO:teuthology.orchestra.run.smithi046.stdout:648.out 2023-07-05T18:58:45.221 INFO:teuthology.orchestra.run.smithi046.stdout:649 2023-07-05T18:58:45.221 INFO:teuthology.orchestra.run.smithi046.stdout:649.out 2023-07-05T18:58:45.221 INFO:teuthology.orchestra.run.smithi046.stdout:650 2023-07-05T18:58:45.222 INFO:teuthology.orchestra.run.smithi046.stdout:650.out 2023-07-05T18:58:45.222 INFO:teuthology.orchestra.run.smithi046.stdout:651 2023-07-05T18:58:45.222 INFO:teuthology.orchestra.run.smithi046.stdout:651.out 2023-07-05T18:58:45.222 INFO:teuthology.orchestra.run.smithi046.stdout:652 2023-07-05T18:58:45.223 INFO:teuthology.orchestra.run.smithi046.stdout:652.out 2023-07-05T18:58:45.223 INFO:teuthology.orchestra.run.smithi046.stdout:653 2023-07-05T18:58:45.223 INFO:teuthology.orchestra.run.smithi046.stdout:653.out 2023-07-05T18:58:45.223 INFO:teuthology.orchestra.run.smithi046.stdout:654 2023-07-05T18:58:45.224 INFO:teuthology.orchestra.run.smithi046.stdout:654.out 2023-07-05T18:58:45.224 INFO:teuthology.orchestra.run.smithi046.stdout:655 2023-07-05T18:58:45.224 INFO:teuthology.orchestra.run.smithi046.stdout:655.out 2023-07-05T18:58:45.224 INFO:teuthology.orchestra.run.smithi046.stdout:656 2023-07-05T18:58:45.225 INFO:teuthology.orchestra.run.smithi046.stdout:656.out 2023-07-05T18:58:45.225 INFO:teuthology.orchestra.run.smithi046.stdout:657 2023-07-05T18:58:45.225 INFO:teuthology.orchestra.run.smithi046.stdout:657.out 2023-07-05T18:58:45.226 INFO:teuthology.orchestra.run.smithi046.stdout:658 2023-07-05T18:58:45.226 INFO:teuthology.orchestra.run.smithi046.stdout:658.out 2023-07-05T18:58:45.226 INFO:teuthology.orchestra.run.smithi046.stdout:659 2023-07-05T18:58:45.226 INFO:teuthology.orchestra.run.smithi046.stdout:659.out 2023-07-05T18:58:45.227 INFO:teuthology.orchestra.run.smithi046.stdout:660 2023-07-05T18:58:45.227 INFO:teuthology.orchestra.run.smithi046.stdout:660.out 2023-07-05T18:58:45.227 INFO:teuthology.orchestra.run.smithi046.stdout:661 2023-07-05T18:58:45.227 INFO:teuthology.orchestra.run.smithi046.stdout:661.out 2023-07-05T18:58:45.227 INFO:teuthology.orchestra.run.smithi046.stdout:662 2023-07-05T18:58:45.228 INFO:teuthology.orchestra.run.smithi046.stdout:662.out 2023-07-05T18:58:45.228 INFO:teuthology.orchestra.run.smithi046.stdout:663 2023-07-05T18:58:45.228 INFO:teuthology.orchestra.run.smithi046.stdout:663.out 2023-07-05T18:58:45.228 INFO:teuthology.orchestra.run.smithi046.stdout:664 2023-07-05T18:58:45.229 INFO:teuthology.orchestra.run.smithi046.stdout:664.out 2023-07-05T18:58:45.229 INFO:teuthology.orchestra.run.smithi046.stdout:665 2023-07-05T18:58:45.229 INFO:teuthology.orchestra.run.smithi046.stdout:665.out 2023-07-05T18:58:45.229 INFO:teuthology.orchestra.run.smithi046.stdout:666 2023-07-05T18:58:45.229 INFO:teuthology.orchestra.run.smithi046.stdout:666.out 2023-07-05T18:58:45.229 INFO:teuthology.orchestra.run.smithi046.stdout:667 2023-07-05T18:58:45.229 INFO:teuthology.orchestra.run.smithi046.stdout:667.out 2023-07-05T18:58:45.230 INFO:teuthology.orchestra.run.smithi046.stdout:668 2023-07-05T18:58:45.230 INFO:teuthology.orchestra.run.smithi046.stdout:668.out 2023-07-05T18:58:45.230 INFO:teuthology.orchestra.run.smithi046.stdout:669 2023-07-05T18:58:45.230 INFO:teuthology.orchestra.run.smithi046.stdout:669.out 2023-07-05T18:58:45.230 INFO:teuthology.orchestra.run.smithi046.stdout:670 2023-07-05T18:58:45.230 INFO:teuthology.orchestra.run.smithi046.stdout:670.out 2023-07-05T18:58:45.230 INFO:teuthology.orchestra.run.smithi046.stdout:671 2023-07-05T18:58:45.230 INFO:teuthology.orchestra.run.smithi046.stdout:671.out 2023-07-05T18:58:45.231 INFO:teuthology.orchestra.run.smithi046.stdout:672 2023-07-05T18:58:45.231 INFO:teuthology.orchestra.run.smithi046.stdout:672.out 2023-07-05T18:58:45.231 INFO:teuthology.orchestra.run.smithi046.stdout:673 2023-07-05T18:58:45.231 INFO:teuthology.orchestra.run.smithi046.stdout:673.out 2023-07-05T18:58:45.231 INFO:teuthology.orchestra.run.smithi046.stdout:674 2023-07-05T18:58:45.231 INFO:teuthology.orchestra.run.smithi046.stdout:674.out 2023-07-05T18:58:45.231 INFO:teuthology.orchestra.run.smithi046.stdout:675 2023-07-05T18:58:45.232 INFO:teuthology.orchestra.run.smithi046.stdout:675.out 2023-07-05T18:58:45.232 INFO:teuthology.orchestra.run.smithi046.stdout:676 2023-07-05T18:58:45.232 INFO:teuthology.orchestra.run.smithi046.stdout:676.out 2023-07-05T18:58:45.232 INFO:teuthology.orchestra.run.smithi046.stdout:677 2023-07-05T18:58:45.232 INFO:teuthology.orchestra.run.smithi046.stdout:677.out 2023-07-05T18:58:45.232 INFO:teuthology.orchestra.run.smithi046.stdout:678 2023-07-05T18:58:45.233 INFO:teuthology.orchestra.run.smithi046.stdout:678.out 2023-07-05T18:58:45.233 INFO:teuthology.orchestra.run.smithi046.stdout:679 2023-07-05T18:58:45.233 INFO:teuthology.orchestra.run.smithi046.stdout:679.out 2023-07-05T18:58:45.233 INFO:teuthology.orchestra.run.smithi046.stdout:680 2023-07-05T18:58:45.233 INFO:teuthology.orchestra.run.smithi046.stdout:680.out 2023-07-05T18:58:45.233 INFO:teuthology.orchestra.run.smithi046.stdout:681 2023-07-05T18:58:45.233 INFO:teuthology.orchestra.run.smithi046.stdout:681.out 2023-07-05T18:58:45.234 INFO:teuthology.orchestra.run.smithi046.stdout:682 2023-07-05T18:58:45.234 INFO:teuthology.orchestra.run.smithi046.stdout:682.out 2023-07-05T18:58:45.234 INFO:teuthology.orchestra.run.smithi046.stdout:683 2023-07-05T18:58:45.234 INFO:teuthology.orchestra.run.smithi046.stdout:683.out 2023-07-05T18:58:45.234 INFO:teuthology.orchestra.run.smithi046.stdout:684 2023-07-05T18:58:45.234 INFO:teuthology.orchestra.run.smithi046.stdout:684.out 2023-07-05T18:58:45.234 INFO:teuthology.orchestra.run.smithi046.stdout:685 2023-07-05T18:58:45.234 INFO:teuthology.orchestra.run.smithi046.stdout:685.out 2023-07-05T18:58:45.235 INFO:teuthology.orchestra.run.smithi046.stdout:686 2023-07-05T18:58:45.235 INFO:teuthology.orchestra.run.smithi046.stdout:686.out 2023-07-05T18:58:45.235 INFO:teuthology.orchestra.run.smithi046.stdout:687 2023-07-05T18:58:45.235 INFO:teuthology.orchestra.run.smithi046.stdout:687.out 2023-07-05T18:58:45.235 INFO:teuthology.orchestra.run.smithi046.stdout:688 2023-07-05T18:58:45.236 INFO:teuthology.orchestra.run.smithi046.stdout:688.out 2023-07-05T18:58:45.236 INFO:teuthology.orchestra.run.smithi046.stdout:689 2023-07-05T18:58:45.236 INFO:teuthology.orchestra.run.smithi046.stdout:689.out 2023-07-05T18:58:45.237 INFO:teuthology.orchestra.run.smithi046.stdout:690 2023-07-05T18:58:45.237 INFO:teuthology.orchestra.run.smithi046.stdout:690.out 2023-07-05T18:58:45.237 INFO:teuthology.orchestra.run.smithi046.stdout:691 2023-07-05T18:58:45.237 INFO:teuthology.orchestra.run.smithi046.stdout:691.out 2023-07-05T18:58:45.237 INFO:teuthology.orchestra.run.smithi046.stdout:692 2023-07-05T18:58:45.237 INFO:teuthology.orchestra.run.smithi046.stdout:692.out 2023-07-05T18:58:45.237 INFO:teuthology.orchestra.run.smithi046.stdout:693 2023-07-05T18:58:45.238 INFO:teuthology.orchestra.run.smithi046.stdout:693.out 2023-07-05T18:58:45.238 INFO:teuthology.orchestra.run.smithi046.stdout:694 2023-07-05T18:58:45.238 INFO:teuthology.orchestra.run.smithi046.stdout:694.out 2023-07-05T18:58:45.238 INFO:teuthology.orchestra.run.smithi046.stdout:695 2023-07-05T18:58:45.239 INFO:teuthology.orchestra.run.smithi046.stdout:695.out 2023-07-05T18:58:45.239 INFO:teuthology.orchestra.run.smithi046.stdout:696 2023-07-05T18:58:45.239 INFO:teuthology.orchestra.run.smithi046.stdout:696.out 2023-07-05T18:58:45.239 INFO:teuthology.orchestra.run.smithi046.stdout:697 2023-07-05T18:58:45.239 INFO:teuthology.orchestra.run.smithi046.stdout:697.out 2023-07-05T18:58:45.239 INFO:teuthology.orchestra.run.smithi046.stdout:698 2023-07-05T18:58:45.239 INFO:teuthology.orchestra.run.smithi046.stdout:698.out 2023-07-05T18:58:45.239 INFO:teuthology.orchestra.run.smithi046.stdout:699 2023-07-05T18:58:45.240 INFO:teuthology.orchestra.run.smithi046.stdout:699.out 2023-07-05T18:58:45.240 INFO:teuthology.orchestra.run.smithi046.stdout:700 2023-07-05T18:58:45.240 INFO:teuthology.orchestra.run.smithi046.stdout:700.out 2023-07-05T18:58:45.240 INFO:teuthology.orchestra.run.smithi046.stdout:701 2023-07-05T18:58:45.240 INFO:teuthology.orchestra.run.smithi046.stdout:701.out 2023-07-05T18:58:45.240 INFO:teuthology.orchestra.run.smithi046.stdout:702 2023-07-05T18:58:45.240 INFO:teuthology.orchestra.run.smithi046.stdout:702.out 2023-07-05T18:58:45.241 INFO:teuthology.orchestra.run.smithi046.stdout:703 2023-07-05T18:58:45.241 INFO:teuthology.orchestra.run.smithi046.stdout:703.out 2023-07-05T18:58:45.241 INFO:teuthology.orchestra.run.smithi046.stdout:704 2023-07-05T18:58:45.241 INFO:teuthology.orchestra.run.smithi046.stdout:704.out 2023-07-05T18:58:45.241 INFO:teuthology.orchestra.run.smithi046.stdout:705 2023-07-05T18:58:45.241 INFO:teuthology.orchestra.run.smithi046.stdout:705.out 2023-07-05T18:58:45.241 INFO:teuthology.orchestra.run.smithi046.stdout:706 2023-07-05T18:58:45.242 INFO:teuthology.orchestra.run.smithi046.stdout:706.out 2023-07-05T18:58:45.242 INFO:teuthology.orchestra.run.smithi046.stdout:707 2023-07-05T18:58:45.242 INFO:teuthology.orchestra.run.smithi046.stdout:707.out 2023-07-05T18:58:45.242 INFO:teuthology.orchestra.run.smithi046.stdout:708 2023-07-05T18:58:45.242 INFO:teuthology.orchestra.run.smithi046.stdout:708.out 2023-07-05T18:58:45.242 INFO:teuthology.orchestra.run.smithi046.stdout:709 2023-07-05T18:58:45.242 INFO:teuthology.orchestra.run.smithi046.stdout:709.out 2023-07-05T18:58:45.242 INFO:teuthology.orchestra.run.smithi046.stdout:710 2023-07-05T18:58:45.243 INFO:teuthology.orchestra.run.smithi046.stdout:710.out 2023-07-05T18:58:45.243 INFO:teuthology.orchestra.run.smithi046.stdout:711 2023-07-05T18:58:45.243 INFO:teuthology.orchestra.run.smithi046.stdout:711.out 2023-07-05T18:58:45.243 INFO:teuthology.orchestra.run.smithi046.stdout:712 2023-07-05T18:58:45.243 INFO:teuthology.orchestra.run.smithi046.stdout:712.out 2023-07-05T18:58:45.243 INFO:teuthology.orchestra.run.smithi046.stdout:713 2023-07-05T18:58:45.243 INFO:teuthology.orchestra.run.smithi046.stdout:713.out 2023-07-05T18:58:45.244 INFO:teuthology.orchestra.run.smithi046.stdout:714 2023-07-05T18:58:45.244 INFO:teuthology.orchestra.run.smithi046.stdout:714.out 2023-07-05T18:58:45.244 INFO:teuthology.orchestra.run.smithi046.stdout:715 2023-07-05T18:58:45.244 INFO:teuthology.orchestra.run.smithi046.stdout:715.out 2023-07-05T18:58:45.245 INFO:teuthology.orchestra.run.smithi046.stdout:716 2023-07-05T18:58:45.245 INFO:teuthology.orchestra.run.smithi046.stdout:716.out 2023-07-05T18:58:45.245 INFO:teuthology.orchestra.run.smithi046.stdout:717 2023-07-05T18:58:45.245 INFO:teuthology.orchestra.run.smithi046.stdout:717.out 2023-07-05T18:58:45.245 INFO:teuthology.orchestra.run.smithi046.stdout:718 2023-07-05T18:58:45.245 INFO:teuthology.orchestra.run.smithi046.stdout:718.out 2023-07-05T18:58:45.245 INFO:teuthology.orchestra.run.smithi046.stdout:719 2023-07-05T18:58:45.246 INFO:teuthology.orchestra.run.smithi046.stdout:719.out 2023-07-05T18:58:45.246 INFO:teuthology.orchestra.run.smithi046.stdout:720 2023-07-05T18:58:45.246 INFO:teuthology.orchestra.run.smithi046.stdout:720.out 2023-07-05T18:58:45.246 INFO:teuthology.orchestra.run.smithi046.stdout:721 2023-07-05T18:58:45.246 INFO:teuthology.orchestra.run.smithi046.stdout:721.out 2023-07-05T18:58:45.246 INFO:teuthology.orchestra.run.smithi046.stdout:722 2023-07-05T18:58:45.246 INFO:teuthology.orchestra.run.smithi046.stdout:722.out 2023-07-05T18:58:45.249 INFO:teuthology.orchestra.run.smithi046.stdout:723 2023-07-05T18:58:45.250 INFO:teuthology.orchestra.run.smithi046.stdout:723.out 2023-07-05T18:58:45.250 INFO:teuthology.orchestra.run.smithi046.stdout:724 2023-07-05T18:58:45.250 INFO:teuthology.orchestra.run.smithi046.stdout:724.out 2023-07-05T18:58:45.250 INFO:teuthology.orchestra.run.smithi046.stdout:725 2023-07-05T18:58:45.250 INFO:teuthology.orchestra.run.smithi046.stdout:725.out 2023-07-05T18:58:45.250 INFO:teuthology.orchestra.run.smithi046.stdout:726 2023-07-05T18:58:45.250 INFO:teuthology.orchestra.run.smithi046.stdout:726.out 2023-07-05T18:58:45.250 INFO:teuthology.orchestra.run.smithi046.stdout:727 2023-07-05T18:58:45.251 INFO:teuthology.orchestra.run.smithi046.stdout:727.out 2023-07-05T18:58:45.251 INFO:teuthology.orchestra.run.smithi046.stdout:728 2023-07-05T18:58:45.251 INFO:teuthology.orchestra.run.smithi046.stdout:728.out 2023-07-05T18:58:45.251 INFO:teuthology.orchestra.run.smithi046.stdout:group.list 2023-07-05T18:58:45.251 INFO:teuthology.orchestra.run.smithi046.stdout:Makefile 2023-07-05T18:58:45.252 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.rlt8E1h3iVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/001) 2023-07-05T18:58:45.500 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph 2023-07-05T18:58:45.506 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-05T18:58:45.506 INFO:teuthology.orchestra.run.smithi046.stdout:MKFS_OPTIONS -- 172.21.15.46:6789:/scratch 2023-07-05T18:58:45.507 INFO:teuthology.orchestra.run.smithi046.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCbvKVkpp1TIhAAvJTELoeH8wkIFqjtppg17w== -o context=system_u:object_r:root_t:s0 172.21.15.46:6789:/scratch /tmp/tmp.KrMG67MsYpscratch 2023-07-05T18:58:45.507 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T18:58:50.624 INFO:teuthology.orchestra.run.smithi046.stdout:generic/001 5s 2023-07-05T18:58:50.634 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/001 2023-07-05T18:58:50.641 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-07-05T18:58:50.642 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T18:58:51.322 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-05T18:58:51.325 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.rlt8E1h3iVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/002) 2023-07-05T18:58:51.680 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph 2023-07-05T18:58:51.689 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-05T18:58:51.693 INFO:teuthology.orchestra.run.smithi046.stdout:MKFS_OPTIONS -- 172.21.15.46:6789:/scratch 2023-07-05T18:58:51.693 INFO:teuthology.orchestra.run.smithi046.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCbvKVkpp1TIhAAvJTELoeH8wkIFqjtppg17w== -o context=system_u:object_r:root_t:s0 172.21.15.46:6789:/scratch /tmp/tmp.KrMG67MsYpscratch 2023-07-05T18:58:51.693 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T18:58:51.820 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-05T18:58:51.832 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-05T18:58:52.190 INFO:teuthology.orchestra.run.smithi046.stdout:generic/002 1s 2023-07-05T18:58:52.196 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/002 2023-07-05T18:58:52.196 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-07-05T18:58:52.196 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T18:58:52.266 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-05T18:58:52.267 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.rlt8E1h3iVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/003) 2023-07-05T18:58:52.494 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph 2023-07-05T18:58:52.494 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-05T18:58:52.494 INFO:teuthology.orchestra.run.smithi046.stdout:MKFS_OPTIONS -- 172.21.15.46:6789:/scratch 2023-07-05T18:58:52.495 INFO:teuthology.orchestra.run.smithi046.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCbvKVkpp1TIhAAvJTELoeH8wkIFqjtppg17w== -o context=system_u:object_r:root_t:s0 172.21.15.46:6789:/scratch /tmp/tmp.KrMG67MsYpscratch 2023-07-05T18:58:52.495 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T18:58:52.819 INFO:teuthology.orchestra.run.smithi046.stdout:generic/003 [not run] atime not maintained by ceph 2023-07-05T18:58:52.819 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/003 2023-07-05T18:58:52.819 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/003 2023-07-05T18:58:52.820 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-07-05T18:58:52.820 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T18:58:52.848 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-05T18:58:52.848 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.rlt8E1h3iVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/004) 2023-07-05T18:58:53.076 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph 2023-07-05T18:58:53.077 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-05T18:58:53.081 INFO:teuthology.orchestra.run.smithi046.stdout:MKFS_OPTIONS -- 172.21.15.46:6789:/scratch 2023-07-05T18:58:53.081 INFO:teuthology.orchestra.run.smithi046.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCbvKVkpp1TIhAAvJTELoeH8wkIFqjtppg17w== -o context=system_u:object_r:root_t:s0 172.21.15.46:6789:/scratch /tmp/tmp.KrMG67MsYpscratch 2023-07-05T18:58:53.081 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T18:58:53.424 INFO:teuthology.orchestra.run.smithi046.stdout:generic/004 [not run] O_TMPFILE is not supported 2023-07-05T18:58:53.429 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/004 2023-07-05T18:58:53.429 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/004 2023-07-05T18:58:53.429 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-07-05T18:58:53.431 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T18:58:53.456 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-05T18:58:53.456 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.rlt8E1h3iVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/005) 2023-07-05T18:58:53.682 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph 2023-07-05T18:58:53.690 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-05T18:58:53.690 INFO:teuthology.orchestra.run.smithi046.stdout:MKFS_OPTIONS -- 172.21.15.46:6789:/scratch 2023-07-05T18:58:53.691 INFO:teuthology.orchestra.run.smithi046.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCbvKVkpp1TIhAAvJTELoeH8wkIFqjtppg17w== -o context=system_u:object_r:root_t:s0 172.21.15.46:6789:/scratch /tmp/tmp.KrMG67MsYpscratch 2023-07-05T18:58:53.691 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T18:58:54.210 INFO:teuthology.orchestra.run.smithi046.stdout:generic/005 1s 2023-07-05T18:58:54.216 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/005 2023-07-05T18:58:54.217 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-07-05T18:58:54.217 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T18:58:54.309 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-05T18:58:54.310 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.rlt8E1h3iVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/006) 2023-07-05T18:58:54.547 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph 2023-07-05T18:58:54.553 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-05T18:58:54.553 INFO:teuthology.orchestra.run.smithi046.stdout:MKFS_OPTIONS -- 172.21.15.46:6789:/scratch 2023-07-05T18:58:54.554 INFO:teuthology.orchestra.run.smithi046.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCbvKVkpp1TIhAAvJTELoeH8wkIFqjtppg17w== -o context=system_u:object_r:root_t:s0 172.21.15.46:6789:/scratch /tmp/tmp.KrMG67MsYpscratch 2023-07-05T18:58:54.554 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T18:59:18.902 INFO:teuthology.orchestra.run.smithi046.stdout:generic/006 24s 2023-07-05T18:59:18.911 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/006 2023-07-05T18:59:18.911 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-07-05T18:59:18.914 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T18:59:19.113 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-05T18:59:19.113 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.rlt8E1h3iVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/007) 2023-07-05T18:59:19.320 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph 2023-07-05T18:59:19.324 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-05T18:59:19.324 INFO:teuthology.orchestra.run.smithi046.stdout:MKFS_OPTIONS -- 172.21.15.46:6789:/scratch 2023-07-05T18:59:19.325 INFO:teuthology.orchestra.run.smithi046.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCbvKVkpp1TIhAAvJTELoeH8wkIFqjtppg17w== -o context=system_u:object_r:root_t:s0 172.21.15.46:6789:/scratch /tmp/tmp.KrMG67MsYpscratch 2023-07-05T18:59:19.325 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T18:59:21.980 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-05T18:59:21.983 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-05T18:59:52.362 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-05T18:59:52.368 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-05T19:00:09.859 INFO:teuthology.orchestra.run.smithi046.stdout:generic/007 50s 2023-07-05T19:00:09.864 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/007 2023-07-05T19:00:09.865 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-07-05T19:00:09.868 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T19:00:09.939 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-05T19:00:09.939 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.rlt8E1h3iVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/008) 2023-07-05T19:00:10.168 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph 2023-07-05T19:00:10.174 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-05T19:00:10.175 INFO:teuthology.orchestra.run.smithi046.stdout:MKFS_OPTIONS -- 172.21.15.46:6789:/scratch 2023-07-05T19:00:10.175 INFO:teuthology.orchestra.run.smithi046.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCbvKVkpp1TIhAAvJTELoeH8wkIFqjtppg17w== -o context=system_u:object_r:root_t:s0 172.21.15.46:6789:/scratch /tmp/tmp.KrMG67MsYpscratch 2023-07-05T19:00:10.175 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T19:00:10.625 INFO:teuthology.orchestra.run.smithi046.stdout:generic/008 [not run] xfs_io fzero failed (old kernel/wrong fs?) 2023-07-05T19:00:10.630 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/008 2023-07-05T19:00:10.630 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/008 2023-07-05T19:00:10.630 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-07-05T19:00:10.631 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T19:00:10.663 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-05T19:00:10.664 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.rlt8E1h3iVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/009) 2023-07-05T19:00:10.892 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph 2023-07-05T19:00:10.896 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-05T19:00:10.896 INFO:teuthology.orchestra.run.smithi046.stdout:MKFS_OPTIONS -- 172.21.15.46:6789:/scratch 2023-07-05T19:00:10.897 INFO:teuthology.orchestra.run.smithi046.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCbvKVkpp1TIhAAvJTELoeH8wkIFqjtppg17w== -o context=system_u:object_r:root_t:s0 172.21.15.46:6789:/scratch /tmp/tmp.KrMG67MsYpscratch 2023-07-05T19:00:10.897 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T19:00:11.307 INFO:teuthology.orchestra.run.smithi046.stdout:generic/009 [not run] xfs_io fzero failed (old kernel/wrong fs?) 2023-07-05T19:00:11.313 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/009 2023-07-05T19:00:11.313 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/009 2023-07-05T19:00:11.313 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-07-05T19:00:11.313 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T19:00:11.338 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-05T19:00:11.339 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.rlt8E1h3iVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/010) 2023-07-05T19:00:11.560 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph 2023-07-05T19:00:11.564 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-05T19:00:11.564 INFO:teuthology.orchestra.run.smithi046.stdout:MKFS_OPTIONS -- 172.21.15.46:6789:/scratch 2023-07-05T19:00:11.565 INFO:teuthology.orchestra.run.smithi046.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCbvKVkpp1TIhAAvJTELoeH8wkIFqjtppg17w== -o context=system_u:object_r:root_t:s0 172.21.15.46:6789:/scratch /tmp/tmp.KrMG67MsYpscratch 2023-07-05T19:00:11.566 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T19:00:11.888 INFO:teuthology.orchestra.run.smithi046.stdout:generic/010 [not run] /tmp/tmp.rlt8E1h3iVxfstests-dev/src/dbtest not built 2023-07-05T19:00:11.892 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/010 2023-07-05T19:00:11.892 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/010 2023-07-05T19:00:11.892 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-07-05T19:00:11.894 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T19:00:11.914 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-05T19:00:11.914 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.rlt8E1h3iVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/011) 2023-07-05T19:00:12.138 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph 2023-07-05T19:00:12.141 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-05T19:00:12.142 INFO:teuthology.orchestra.run.smithi046.stdout:MKFS_OPTIONS -- 172.21.15.46:6789:/scratch 2023-07-05T19:00:12.142 INFO:teuthology.orchestra.run.smithi046.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCbvKVkpp1TIhAAvJTELoeH8wkIFqjtppg17w== -o context=system_u:object_r:root_t:s0 172.21.15.46:6789:/scratch /tmp/tmp.KrMG67MsYpscratch 2023-07-05T19:00:12.142 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T19:00:22.426 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-05T19:00:22.430 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-05T19:00:49.415 INFO:teuthology.orchestra.run.smithi046.stdout:generic/011 37s 2023-07-05T19:00:49.421 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/011 2023-07-05T19:00:49.421 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-07-05T19:00:49.423 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T19:00:49.653 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-05T19:00:49.654 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.rlt8E1h3iVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/012) 2023-07-05T19:00:49.967 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph 2023-07-05T19:00:49.973 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-05T19:00:49.973 INFO:teuthology.orchestra.run.smithi046.stdout:MKFS_OPTIONS -- 172.21.15.46:6789:/scratch 2023-07-05T19:00:49.973 INFO:teuthology.orchestra.run.smithi046.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCbvKVkpp1TIhAAvJTELoeH8wkIFqjtppg17w== -o context=system_u:object_r:root_t:s0 172.21.15.46:6789:/scratch /tmp/tmp.KrMG67MsYpscratch 2023-07-05T19:00:49.974 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T19:00:50.368 INFO:teuthology.orchestra.run.smithi046.stdout:generic/012 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-07-05T19:00:50.373 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/012 2023-07-05T19:00:50.373 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/012 2023-07-05T19:00:50.373 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-07-05T19:00:50.380 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T19:00:50.440 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-05T19:00:50.440 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.rlt8E1h3iVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/013) 2023-07-05T19:00:50.648 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph 2023-07-05T19:00:50.654 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-05T19:00:50.654 INFO:teuthology.orchestra.run.smithi046.stdout:MKFS_OPTIONS -- 172.21.15.46:6789:/scratch 2023-07-05T19:00:50.654 INFO:teuthology.orchestra.run.smithi046.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCbvKVkpp1TIhAAvJTELoeH8wkIFqjtppg17w== -o context=system_u:object_r:root_t:s0 172.21.15.46:6789:/scratch /tmp/tmp.KrMG67MsYpscratch 2023-07-05T19:00:50.655 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T19:00:52.713 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-05T19:00:52.722 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-05T19:01:22.881 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-05T19:01:22.884 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-05T19:01:44.367 INFO:teuthology.orchestra.run.smithi046.stdout:generic/013 54s 2023-07-05T19:01:44.506 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/013 2023-07-05T19:01:44.506 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-07-05T19:01:44.508 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T19:01:44.544 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-05T19:01:44.545 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.rlt8E1h3iVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/014) 2023-07-05T19:01:44.897 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph 2023-07-05T19:01:44.906 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-05T19:01:44.906 INFO:teuthology.orchestra.run.smithi046.stdout:MKFS_OPTIONS -- 172.21.15.46:6789:/scratch 2023-07-05T19:01:44.907 INFO:teuthology.orchestra.run.smithi046.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCbvKVkpp1TIhAAvJTELoeH8wkIFqjtppg17w== -o context=system_u:object_r:root_t:s0 172.21.15.46:6789:/scratch /tmp/tmp.KrMG67MsYpscratch 2023-07-05T19:01:44.907 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T19:01:53.208 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-05T19:01:53.212 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-05T19:02:23.286 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-05T19:02:23.291 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-05T19:02:53.379 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-05T19:02:53.384 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-05T19:03:23.475 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-05T19:03:23.477 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-05T19:03:53.552 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-05T19:03:53.557 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-05T19:04:23.625 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-05T19:04:23.628 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-05T19:04:53.753 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-05T19:04:53.773 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-05T19:05:24.138 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-05T19:05:24.141 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-05T19:05:54.501 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-05T19:05:54.508 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-05T19:06:17.441 INFO:teuthology.orchestra.run.smithi046.stdout:generic/014 272s 2023-07-05T19:06:17.450 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/014 2023-07-05T19:06:17.450 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-07-05T19:06:17.456 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T19:06:17.487 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-05T19:06:17.488 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.rlt8E1h3iVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/015) 2023-07-05T19:06:17.853 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph 2023-07-05T19:06:17.861 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-05T19:06:17.862 INFO:teuthology.orchestra.run.smithi046.stdout:MKFS_OPTIONS -- 172.21.15.46:6789:/scratch 2023-07-05T19:06:17.862 INFO:teuthology.orchestra.run.smithi046.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCbvKVkpp1TIhAAvJTELoeH8wkIFqjtppg17w== -o context=system_u:object_r:root_t:s0 172.21.15.46:6789:/scratch /tmp/tmp.KrMG67MsYpscratch 2023-07-05T19:06:17.863 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T19:06:18.381 INFO:teuthology.orchestra.run.smithi046.stdout:generic/015 [not run] Filesystem ceph not supported in _scratch_mkfs_sized 2023-07-05T19:06:18.393 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/015 2023-07-05T19:06:18.393 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/015 2023-07-05T19:06:18.393 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-07-05T19:06:18.395 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T19:06:18.427 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-05T19:06:18.428 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.rlt8E1h3iVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/016) 2023-07-05T19:06:18.809 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph 2023-07-05T19:06:18.820 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-05T19:06:18.820 INFO:teuthology.orchestra.run.smithi046.stdout:MKFS_OPTIONS -- 172.21.15.46:6789:/scratch 2023-07-05T19:06:18.822 INFO:teuthology.orchestra.run.smithi046.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCbvKVkpp1TIhAAvJTELoeH8wkIFqjtppg17w== -o context=system_u:object_r:root_t:s0 172.21.15.46:6789:/scratch /tmp/tmp.KrMG67MsYpscratch 2023-07-05T19:06:18.822 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T19:06:19.484 INFO:teuthology.orchestra.run.smithi046.stdout:generic/016 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-07-05T19:06:19.490 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/016 2023-07-05T19:06:19.491 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/016 2023-07-05T19:06:19.491 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-07-05T19:06:19.493 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T19:06:19.714 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-05T19:06:19.714 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.rlt8E1h3iVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/017) 2023-07-05T19:06:20.194 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph 2023-07-05T19:06:20.204 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-05T19:06:20.205 INFO:teuthology.orchestra.run.smithi046.stdout:MKFS_OPTIONS -- 172.21.15.46:6789:/scratch 2023-07-05T19:06:20.205 INFO:teuthology.orchestra.run.smithi046.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCbvKVkpp1TIhAAvJTELoeH8wkIFqjtppg17w== -o context=system_u:object_r:root_t:s0 172.21.15.46:6789:/scratch /tmp/tmp.KrMG67MsYpscratch 2023-07-05T19:06:20.206 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T19:06:20.768 INFO:teuthology.orchestra.run.smithi046.stdout:generic/017 [not run] xfs_io fiemap failed (old kernel/wrong fs?) 2023-07-05T19:06:20.772 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/017 2023-07-05T19:06:20.772 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/017 2023-07-05T19:06:20.773 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-07-05T19:06:20.775 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T19:06:20.810 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-05T19:06:20.811 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.rlt8E1h3iVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/018) 2023-07-05T19:06:21.200 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph 2023-07-05T19:06:21.205 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-05T19:06:21.205 INFO:teuthology.orchestra.run.smithi046.stdout:MKFS_OPTIONS -- 172.21.15.46:6789:/scratch 2023-07-05T19:06:21.206 INFO:teuthology.orchestra.run.smithi046.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCbvKVkpp1TIhAAvJTELoeH8wkIFqjtppg17w== -o context=system_u:object_r:root_t:s0 172.21.15.46:6789:/scratch /tmp/tmp.KrMG67MsYpscratch 2023-07-05T19:06:21.206 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T19:06:21.903 INFO:teuthology.orchestra.run.smithi046.stdout:generic/018 [not run] defragmentation not supported for fstype "ceph" 2023-07-05T19:06:21.924 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/018 2023-07-05T19:06:21.925 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/018 2023-07-05T19:06:21.925 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-07-05T19:06:21.928 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T19:06:21.954 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-05T19:06:21.954 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.rlt8E1h3iVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/019) 2023-07-05T19:06:22.307 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph 2023-07-05T19:06:22.321 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-05T19:06:22.321 INFO:teuthology.orchestra.run.smithi046.stdout:MKFS_OPTIONS -- 172.21.15.46:6789:/scratch 2023-07-05T19:06:22.322 INFO:teuthology.orchestra.run.smithi046.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCbvKVkpp1TIhAAvJTELoeH8wkIFqjtppg17w== -o context=system_u:object_r:root_t:s0 172.21.15.46:6789:/scratch /tmp/tmp.KrMG67MsYpscratch 2023-07-05T19:06:22.323 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T19:06:22.847 INFO:teuthology.orchestra.run.smithi046.stdout:generic/019 [not run] require 172.21.15.46:6789:/scratch to be valid block disk 2023-07-05T19:06:22.856 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/019 2023-07-05T19:06:22.856 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/019 2023-07-05T19:06:22.856 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-07-05T19:06:22.858 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T19:06:22.887 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-05T19:06:22.888 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.rlt8E1h3iVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/020) 2023-07-05T19:06:23.301 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph 2023-07-05T19:06:23.306 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-05T19:06:23.306 INFO:teuthology.orchestra.run.smithi046.stdout:MKFS_OPTIONS -- 172.21.15.46:6789:/scratch 2023-07-05T19:06:23.307 INFO:teuthology.orchestra.run.smithi046.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCbvKVkpp1TIhAAvJTELoeH8wkIFqjtppg17w== -o context=system_u:object_r:root_t:s0 172.21.15.46:6789:/scratch /tmp/tmp.KrMG67MsYpscratch 2023-07-05T19:06:23.308 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T19:06:24.793 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-05T19:06:24.797 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-05T19:06:27.365 INFO:teuthology.orchestra.run.smithi046.stdout:generic/020 4s 2023-07-05T19:06:27.431 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/020 2023-07-05T19:06:27.431 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-07-05T19:06:27.433 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T19:06:27.509 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-05T19:06:27.509 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.rlt8E1h3iVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/021) 2023-07-05T19:06:28.117 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph 2023-07-05T19:06:28.122 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-05T19:06:28.123 INFO:teuthology.orchestra.run.smithi046.stdout:MKFS_OPTIONS -- 172.21.15.46:6789:/scratch 2023-07-05T19:06:28.127 INFO:teuthology.orchestra.run.smithi046.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCbvKVkpp1TIhAAvJTELoeH8wkIFqjtppg17w== -o context=system_u:object_r:root_t:s0 172.21.15.46:6789:/scratch /tmp/tmp.KrMG67MsYpscratch 2023-07-05T19:06:28.127 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T19:06:28.763 INFO:teuthology.orchestra.run.smithi046.stdout:generic/021 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-07-05T19:06:28.767 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/021 2023-07-05T19:06:28.768 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/021 2023-07-05T19:06:28.768 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-07-05T19:06:28.770 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T19:06:29.024 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-05T19:06:29.025 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.rlt8E1h3iVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/022) 2023-07-05T19:06:29.460 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph 2023-07-05T19:06:29.465 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-05T19:06:29.466 INFO:teuthology.orchestra.run.smithi046.stdout:MKFS_OPTIONS -- 172.21.15.46:6789:/scratch 2023-07-05T19:06:29.467 INFO:teuthology.orchestra.run.smithi046.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCbvKVkpp1TIhAAvJTELoeH8wkIFqjtppg17w== -o context=system_u:object_r:root_t:s0 172.21.15.46:6789:/scratch /tmp/tmp.KrMG67MsYpscratch 2023-07-05T19:06:29.467 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T19:06:30.075 INFO:teuthology.orchestra.run.smithi046.stdout:generic/022 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-07-05T19:06:30.081 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/022 2023-07-05T19:06:30.082 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/022 2023-07-05T19:06:30.082 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-07-05T19:06:30.084 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T19:06:30.429 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-05T19:06:30.429 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.rlt8E1h3iVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/023) 2023-07-05T19:06:30.794 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph 2023-07-05T19:06:30.798 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-05T19:06:30.799 INFO:teuthology.orchestra.run.smithi046.stdout:MKFS_OPTIONS -- 172.21.15.46:6789:/scratch 2023-07-05T19:06:30.800 INFO:teuthology.orchestra.run.smithi046.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCbvKVkpp1TIhAAvJTELoeH8wkIFqjtppg17w== -o context=system_u:object_r:root_t:s0 172.21.15.46:6789:/scratch /tmp/tmp.KrMG67MsYpscratch 2023-07-05T19:06:30.800 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T19:06:55.102 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-05T19:06:55.105 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-05T19:07:25.171 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-05T19:07:25.179 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-05T19:07:27.913 INFO:teuthology.orchestra.run.smithi046.stdout:generic/023 56s 2023-07-05T19:07:27.921 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/023 2023-07-05T19:07:27.922 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-07-05T19:07:27.927 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T19:07:28.241 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-05T19:07:28.243 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.rlt8E1h3iVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/024) 2023-07-05T19:07:28.687 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph 2023-07-05T19:07:28.698 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-05T19:07:28.698 INFO:teuthology.orchestra.run.smithi046.stdout:MKFS_OPTIONS -- 172.21.15.46:6789:/scratch 2023-07-05T19:07:28.699 INFO:teuthology.orchestra.run.smithi046.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCbvKVkpp1TIhAAvJTELoeH8wkIFqjtppg17w== -o context=system_u:object_r:root_t:s0 172.21.15.46:6789:/scratch /tmp/tmp.KrMG67MsYpscratch 2023-07-05T19:07:28.699 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T19:07:29.196 INFO:teuthology.orchestra.run.smithi046.stdout:generic/024 [not run] kernel doesn't support renameat2 syscall 2023-07-05T19:07:29.201 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/024 2023-07-05T19:07:29.201 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/024 2023-07-05T19:07:29.201 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-07-05T19:07:29.204 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T19:07:29.361 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-05T19:07:29.361 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.rlt8E1h3iVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/025) 2023-07-05T19:07:29.899 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph 2023-07-05T19:07:29.904 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-05T19:07:29.905 INFO:teuthology.orchestra.run.smithi046.stdout:MKFS_OPTIONS -- 172.21.15.46:6789:/scratch 2023-07-05T19:07:29.907 INFO:teuthology.orchestra.run.smithi046.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCbvKVkpp1TIhAAvJTELoeH8wkIFqjtppg17w== -o context=system_u:object_r:root_t:s0 172.21.15.46:6789:/scratch /tmp/tmp.KrMG67MsYpscratch 2023-07-05T19:07:29.907 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T19:07:30.446 INFO:teuthology.orchestra.run.smithi046.stdout:generic/025 [not run] kernel doesn't support renameat2 syscall 2023-07-05T19:07:30.451 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/025 2023-07-05T19:07:30.451 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/025 2023-07-05T19:07:30.451 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-07-05T19:07:30.454 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T19:07:30.752 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-05T19:07:30.752 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.rlt8E1h3iVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/026) 2023-07-05T19:07:31.164 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph 2023-07-05T19:07:31.180 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-05T19:07:31.181 INFO:teuthology.orchestra.run.smithi046.stdout:MKFS_OPTIONS -- 172.21.15.46:6789:/scratch 2023-07-05T19:07:31.182 INFO:teuthology.orchestra.run.smithi046.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCbvKVkpp1TIhAAvJTELoeH8wkIFqjtppg17w== -o context=system_u:object_r:root_t:s0 172.21.15.46:6789:/scratch /tmp/tmp.KrMG67MsYpscratch 2023-07-05T19:07:31.182 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T19:07:31.736 INFO:teuthology.orchestra.run.smithi046.stdout:generic/026 [not run] ceph does not define maximum ACL count 2023-07-05T19:07:31.741 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/026 2023-07-05T19:07:31.741 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/026 2023-07-05T19:07:31.742 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-07-05T19:07:31.744 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T19:07:31.795 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-05T19:07:31.795 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.rlt8E1h3iVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/027) 2023-07-05T19:07:32.153 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph 2023-07-05T19:07:32.157 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-05T19:07:32.158 INFO:teuthology.orchestra.run.smithi046.stdout:MKFS_OPTIONS -- 172.21.15.46:6789:/scratch 2023-07-05T19:07:32.158 INFO:teuthology.orchestra.run.smithi046.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCbvKVkpp1TIhAAvJTELoeH8wkIFqjtppg17w== -o context=system_u:object_r:root_t:s0 172.21.15.46:6789:/scratch /tmp/tmp.KrMG67MsYpscratch 2023-07-05T19:07:32.159 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T19:07:32.645 INFO:teuthology.orchestra.run.smithi046.stdout:generic/027 [not run] Filesystem ceph not supported in _scratch_mkfs_sized 2023-07-05T19:07:32.653 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/027 2023-07-05T19:07:32.653 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/027 2023-07-05T19:07:32.653 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-07-05T19:07:32.659 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T19:07:32.691 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-05T19:07:32.691 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.rlt8E1h3iVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/028) 2023-07-05T19:07:33.038 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph 2023-07-05T19:07:33.046 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-05T19:07:33.047 INFO:teuthology.orchestra.run.smithi046.stdout:MKFS_OPTIONS -- 172.21.15.46:6789:/scratch 2023-07-05T19:07:33.048 INFO:teuthology.orchestra.run.smithi046.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCbvKVkpp1TIhAAvJTELoeH8wkIFqjtppg17w== -o context=system_u:object_r:root_t:s0 172.21.15.46:6789:/scratch /tmp/tmp.KrMG67MsYpscratch 2023-07-05T19:07:33.048 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T19:07:38.556 INFO:teuthology.orchestra.run.smithi046.stdout:generic/028 5s 2023-07-05T19:07:38.567 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/028 2023-07-05T19:07:38.567 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-07-05T19:07:38.574 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T19:07:38.598 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-05T19:07:38.599 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.rlt8E1h3iVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/029) 2023-07-05T19:07:38.932 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph 2023-07-05T19:07:38.940 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-05T19:07:38.941 INFO:teuthology.orchestra.run.smithi046.stdout:MKFS_OPTIONS -- 172.21.15.46:6789:/scratch 2023-07-05T19:07:38.942 INFO:teuthology.orchestra.run.smithi046.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCbvKVkpp1TIhAAvJTELoeH8wkIFqjtppg17w== -o context=system_u:object_r:root_t:s0 172.21.15.46:6789:/scratch /tmp/tmp.KrMG67MsYpscratch 2023-07-05T19:07:38.942 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T19:07:43.275 INFO:teuthology.orchestra.run.smithi046.stdout:generic/029 4s 2023-07-05T19:07:43.286 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/029 2023-07-05T19:07:43.287 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-07-05T19:07:43.293 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T19:07:43.308 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-05T19:07:43.308 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.rlt8E1h3iVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/030) 2023-07-05T19:07:43.650 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph 2023-07-05T19:07:43.655 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-05T19:07:43.656 INFO:teuthology.orchestra.run.smithi046.stdout:MKFS_OPTIONS -- 172.21.15.46:6789:/scratch 2023-07-05T19:07:43.656 INFO:teuthology.orchestra.run.smithi046.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCbvKVkpp1TIhAAvJTELoeH8wkIFqjtppg17w== -o context=system_u:object_r:root_t:s0 172.21.15.46:6789:/scratch /tmp/tmp.KrMG67MsYpscratch 2023-07-05T19:07:43.656 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T19:07:48.365 INFO:teuthology.orchestra.run.smithi046.stdout:generic/030 5s 2023-07-05T19:07:48.375 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/030 2023-07-05T19:07:48.375 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-07-05T19:07:48.378 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T19:07:48.390 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-05T19:07:48.390 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.rlt8E1h3iVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/031) 2023-07-05T19:07:48.780 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph 2023-07-05T19:07:48.784 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-05T19:07:48.785 INFO:teuthology.orchestra.run.smithi046.stdout:MKFS_OPTIONS -- 172.21.15.46:6789:/scratch 2023-07-05T19:07:48.786 INFO:teuthology.orchestra.run.smithi046.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCbvKVkpp1TIhAAvJTELoeH8wkIFqjtppg17w== -o context=system_u:object_r:root_t:s0 172.21.15.46:6789:/scratch /tmp/tmp.KrMG67MsYpscratch 2023-07-05T19:07:48.787 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T19:07:49.417 INFO:teuthology.orchestra.run.smithi046.stdout:generic/031 [not run] xfs_io fcollapse failed (old kernel/wrong fs?) 2023-07-05T19:07:49.422 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/031 2023-07-05T19:07:49.422 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/031 2023-07-05T19:07:49.422 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-07-05T19:07:49.428 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T19:07:49.460 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-05T19:07:49.461 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.rlt8E1h3iVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/032) 2023-07-05T19:07:49.840 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph 2023-07-05T19:07:49.845 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-05T19:07:49.845 INFO:teuthology.orchestra.run.smithi046.stdout:MKFS_OPTIONS -- 172.21.15.46:6789:/scratch 2023-07-05T19:07:49.846 INFO:teuthology.orchestra.run.smithi046.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCbvKVkpp1TIhAAvJTELoeH8wkIFqjtppg17w== -o context=system_u:object_r:root_t:s0 172.21.15.46:6789:/scratch /tmp/tmp.KrMG67MsYpscratch 2023-07-05T19:07:49.846 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T19:07:50.332 INFO:teuthology.orchestra.run.smithi046.stdout:generic/032 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-07-05T19:07:50.338 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/032 2023-07-05T19:07:50.338 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/032 2023-07-05T19:07:50.338 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-07-05T19:07:50.340 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T19:07:50.373 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-05T19:07:50.373 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.rlt8E1h3iVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/033) 2023-07-05T19:07:50.758 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph 2023-07-05T19:07:50.765 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-05T19:07:50.766 INFO:teuthology.orchestra.run.smithi046.stdout:MKFS_OPTIONS -- 172.21.15.46:6789:/scratch 2023-07-05T19:07:50.766 INFO:teuthology.orchestra.run.smithi046.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCbvKVkpp1TIhAAvJTELoeH8wkIFqjtppg17w== -o context=system_u:object_r:root_t:s0 172.21.15.46:6789:/scratch /tmp/tmp.KrMG67MsYpscratch 2023-07-05T19:07:50.767 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T19:07:51.345 INFO:teuthology.orchestra.run.smithi046.stdout:generic/033 [not run] xfs_io fzero failed (old kernel/wrong fs?) 2023-07-05T19:07:51.354 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/033 2023-07-05T19:07:51.354 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/033 2023-07-05T19:07:51.354 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-07-05T19:07:51.360 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T19:07:51.388 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-05T19:07:51.389 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.rlt8E1h3iVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/034) 2023-07-05T19:07:51.737 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph 2023-07-05T19:07:51.743 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-05T19:07:51.743 INFO:teuthology.orchestra.run.smithi046.stdout:MKFS_OPTIONS -- 172.21.15.46:6789:/scratch 2023-07-05T19:07:51.744 INFO:teuthology.orchestra.run.smithi046.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCbvKVkpp1TIhAAvJTELoeH8wkIFqjtppg17w== -o context=system_u:object_r:root_t:s0 172.21.15.46:6789:/scratch /tmp/tmp.KrMG67MsYpscratch 2023-07-05T19:07:51.744 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T19:07:52.260 INFO:teuthology.orchestra.run.smithi046.stdout:generic/034 [not run] require 172.21.15.46:6789:/scratch to be valid block disk 2023-07-05T19:07:52.264 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/034 2023-07-05T19:07:52.264 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/034 2023-07-05T19:07:52.264 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-07-05T19:07:52.266 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T19:07:52.301 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-05T19:07:52.302 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.rlt8E1h3iVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/035) 2023-07-05T19:07:52.672 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph 2023-07-05T19:07:52.681 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-05T19:07:52.683 INFO:teuthology.orchestra.run.smithi046.stdout:MKFS_OPTIONS -- 172.21.15.46:6789:/scratch 2023-07-05T19:07:52.683 INFO:teuthology.orchestra.run.smithi046.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCbvKVkpp1TIhAAvJTELoeH8wkIFqjtppg17w== -o context=system_u:object_r:root_t:s0 172.21.15.46:6789:/scratch /tmp/tmp.KrMG67MsYpscratch 2023-07-05T19:07:52.683 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T19:07:53.263 INFO:teuthology.orchestra.run.smithi046.stdout:generic/035 1s 2023-07-05T19:07:53.270 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/035 2023-07-05T19:07:53.270 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-07-05T19:07:53.273 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T19:07:53.579 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-05T19:07:53.580 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.rlt8E1h3iVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/036) 2023-07-05T19:07:53.984 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph 2023-07-05T19:07:53.990 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-05T19:07:53.991 INFO:teuthology.orchestra.run.smithi046.stdout:MKFS_OPTIONS -- 172.21.15.46:6789:/scratch 2023-07-05T19:07:53.992 INFO:teuthology.orchestra.run.smithi046.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCbvKVkpp1TIhAAvJTELoeH8wkIFqjtppg17w== -o context=system_u:object_r:root_t:s0 172.21.15.46:6789:/scratch /tmp/tmp.KrMG67MsYpscratch 2023-07-05T19:07:53.993 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T19:07:55.330 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-05T19:07:55.332 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-05T19:08:04.597 INFO:teuthology.orchestra.run.smithi046.stdout:generic/036 10s 2023-07-05T19:08:04.602 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/036 2023-07-05T19:08:04.602 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-07-05T19:08:04.604 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T19:08:04.922 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-05T19:08:04.922 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.rlt8E1h3iVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/037) 2023-07-05T19:08:05.174 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph 2023-07-05T19:08:05.178 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-05T19:08:05.179 INFO:teuthology.orchestra.run.smithi046.stdout:MKFS_OPTIONS -- 172.21.15.46:6789:/scratch 2023-07-05T19:08:05.180 INFO:teuthology.orchestra.run.smithi046.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCbvKVkpp1TIhAAvJTELoeH8wkIFqjtppg17w== -o context=system_u:object_r:root_t:s0 172.21.15.46:6789:/scratch /tmp/tmp.KrMG67MsYpscratch 2023-07-05T19:08:05.180 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T19:08:07.927 INFO:teuthology.orchestra.run.smithi046.stdout:generic/037 2s 2023-07-05T19:08:07.931 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/037 2023-07-05T19:08:07.932 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-07-05T19:08:07.933 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T19:08:07.942 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-05T19:08:07.942 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.rlt8E1h3iVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/038) 2023-07-05T19:08:08.161 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph 2023-07-05T19:08:08.165 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-05T19:08:08.166 INFO:teuthology.orchestra.run.smithi046.stdout:MKFS_OPTIONS -- 172.21.15.46:6789:/scratch 2023-07-05T19:08:08.167 INFO:teuthology.orchestra.run.smithi046.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCbvKVkpp1TIhAAvJTELoeH8wkIFqjtppg17w== -o context=system_u:object_r:root_t:s0 172.21.15.46:6789:/scratch /tmp/tmp.KrMG67MsYpscratch 2023-07-05T19:08:08.167 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T19:08:08.524 INFO:teuthology.orchestra.run.smithi046.stdout:generic/038 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-07-05T19:08:08.528 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/038 2023-07-05T19:08:08.528 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/038 2023-07-05T19:08:08.528 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-07-05T19:08:08.530 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T19:08:08.551 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-05T19:08:08.552 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.rlt8E1h3iVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/039) 2023-07-05T19:08:08.772 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph 2023-07-05T19:08:08.776 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-05T19:08:08.776 INFO:teuthology.orchestra.run.smithi046.stdout:MKFS_OPTIONS -- 172.21.15.46:6789:/scratch 2023-07-05T19:08:08.777 INFO:teuthology.orchestra.run.smithi046.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCbvKVkpp1TIhAAvJTELoeH8wkIFqjtppg17w== -o context=system_u:object_r:root_t:s0 172.21.15.46:6789:/scratch /tmp/tmp.KrMG67MsYpscratch 2023-07-05T19:08:08.777 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T19:08:09.131 INFO:teuthology.orchestra.run.smithi046.stdout:generic/039 [not run] require 172.21.15.46:6789:/scratch to be valid block disk 2023-07-05T19:08:09.135 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/039 2023-07-05T19:08:09.135 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/039 2023-07-05T19:08:09.135 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-07-05T19:08:09.137 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T19:08:09.165 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-05T19:08:09.165 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.rlt8E1h3iVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/040) 2023-07-05T19:08:09.380 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph 2023-07-05T19:08:09.384 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-05T19:08:09.384 INFO:teuthology.orchestra.run.smithi046.stdout:MKFS_OPTIONS -- 172.21.15.46:6789:/scratch 2023-07-05T19:08:09.385 INFO:teuthology.orchestra.run.smithi046.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCbvKVkpp1TIhAAvJTELoeH8wkIFqjtppg17w== -o context=system_u:object_r:root_t:s0 172.21.15.46:6789:/scratch /tmp/tmp.KrMG67MsYpscratch 2023-07-05T19:08:09.386 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T19:08:09.750 INFO:teuthology.orchestra.run.smithi046.stdout:generic/040 [not run] require 172.21.15.46:6789:/scratch to be valid block disk 2023-07-05T19:08:09.754 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/040 2023-07-05T19:08:09.754 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/040 2023-07-05T19:08:09.754 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-07-05T19:08:09.756 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T19:08:09.780 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-05T19:08:09.781 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.rlt8E1h3iVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/041) 2023-07-05T19:08:09.998 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph 2023-07-05T19:08:10.002 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-05T19:08:10.002 INFO:teuthology.orchestra.run.smithi046.stdout:MKFS_OPTIONS -- 172.21.15.46:6789:/scratch 2023-07-05T19:08:10.003 INFO:teuthology.orchestra.run.smithi046.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCbvKVkpp1TIhAAvJTELoeH8wkIFqjtppg17w== -o context=system_u:object_r:root_t:s0 172.21.15.46:6789:/scratch /tmp/tmp.KrMG67MsYpscratch 2023-07-05T19:08:10.003 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T19:08:10.364 INFO:teuthology.orchestra.run.smithi046.stdout:generic/041 [not run] require 172.21.15.46:6789:/scratch to be valid block disk 2023-07-05T19:08:10.368 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/041 2023-07-05T19:08:10.368 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/041 2023-07-05T19:08:10.368 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-07-05T19:08:10.371 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T19:08:10.393 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-05T19:08:10.393 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.rlt8E1h3iVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/042) 2023-07-05T19:08:10.614 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph 2023-07-05T19:08:10.618 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-05T19:08:10.618 INFO:teuthology.orchestra.run.smithi046.stdout:MKFS_OPTIONS -- 172.21.15.46:6789:/scratch 2023-07-05T19:08:10.619 INFO:teuthology.orchestra.run.smithi046.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCbvKVkpp1TIhAAvJTELoeH8wkIFqjtppg17w== -o context=system_u:object_r:root_t:s0 172.21.15.46:6789:/scratch /tmp/tmp.KrMG67MsYpscratch 2023-07-05T19:08:10.619 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T19:08:11.127 INFO:teuthology.orchestra.run.smithi046.stdout:generic/042 [not run] ceph does not support shutdown 2023-07-05T19:08:11.145 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/042 2023-07-05T19:08:11.145 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/042 2023-07-05T19:08:11.145 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-07-05T19:08:11.147 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T19:08:11.169 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-05T19:08:11.170 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.rlt8E1h3iVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/043) 2023-07-05T19:08:11.388 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph 2023-07-05T19:08:11.392 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-05T19:08:11.393 INFO:teuthology.orchestra.run.smithi046.stdout:MKFS_OPTIONS -- 172.21.15.46:6789:/scratch 2023-07-05T19:08:11.394 INFO:teuthology.orchestra.run.smithi046.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCbvKVkpp1TIhAAvJTELoeH8wkIFqjtppg17w== -o context=system_u:object_r:root_t:s0 172.21.15.46:6789:/scratch /tmp/tmp.KrMG67MsYpscratch 2023-07-05T19:08:11.394 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T19:08:11.901 INFO:teuthology.orchestra.run.smithi046.stdout:generic/043 [not run] ceph does not support shutdown 2023-07-05T19:08:11.923 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/043 2023-07-05T19:08:11.923 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/043 2023-07-05T19:08:11.923 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-07-05T19:08:11.925 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T19:08:11.957 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-05T19:08:11.958 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.rlt8E1h3iVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/044) 2023-07-05T19:08:12.177 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph 2023-07-05T19:08:12.181 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-05T19:08:12.182 INFO:teuthology.orchestra.run.smithi046.stdout:MKFS_OPTIONS -- 172.21.15.46:6789:/scratch 2023-07-05T19:08:12.183 INFO:teuthology.orchestra.run.smithi046.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCbvKVkpp1TIhAAvJTELoeH8wkIFqjtppg17w== -o context=system_u:object_r:root_t:s0 172.21.15.46:6789:/scratch /tmp/tmp.KrMG67MsYpscratch 2023-07-05T19:08:12.183 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T19:08:12.686 INFO:teuthology.orchestra.run.smithi046.stdout:generic/044 [not run] ceph does not support shutdown 2023-07-05T19:08:12.703 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/044 2023-07-05T19:08:12.704 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/044 2023-07-05T19:08:12.704 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-07-05T19:08:12.705 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T19:08:12.724 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-05T19:08:12.724 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.rlt8E1h3iVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/045) 2023-07-05T19:08:12.962 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph 2023-07-05T19:08:12.966 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-05T19:08:12.967 INFO:teuthology.orchestra.run.smithi046.stdout:MKFS_OPTIONS -- 172.21.15.46:6789:/scratch 2023-07-05T19:08:12.968 INFO:teuthology.orchestra.run.smithi046.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCbvKVkpp1TIhAAvJTELoeH8wkIFqjtppg17w== -o context=system_u:object_r:root_t:s0 172.21.15.46:6789:/scratch /tmp/tmp.KrMG67MsYpscratch 2023-07-05T19:08:12.968 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T19:08:13.487 INFO:teuthology.orchestra.run.smithi046.stdout:generic/045 [not run] ceph does not support shutdown 2023-07-05T19:08:13.504 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/045 2023-07-05T19:08:13.504 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/045 2023-07-05T19:08:13.504 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-07-05T19:08:13.506 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T19:08:13.525 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-05T19:08:13.526 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.rlt8E1h3iVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/046) 2023-07-05T19:08:13.742 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph 2023-07-05T19:08:13.746 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-05T19:08:13.747 INFO:teuthology.orchestra.run.smithi046.stdout:MKFS_OPTIONS -- 172.21.15.46:6789:/scratch 2023-07-05T19:08:13.747 INFO:teuthology.orchestra.run.smithi046.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCbvKVkpp1TIhAAvJTELoeH8wkIFqjtppg17w== -o context=system_u:object_r:root_t:s0 172.21.15.46:6789:/scratch /tmp/tmp.KrMG67MsYpscratch 2023-07-05T19:08:13.748 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T19:08:14.247 INFO:teuthology.orchestra.run.smithi046.stdout:generic/046 [not run] ceph does not support shutdown 2023-07-05T19:08:14.263 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/046 2023-07-05T19:08:14.263 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/046 2023-07-05T19:08:14.263 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-07-05T19:08:14.265 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T19:08:14.284 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-05T19:08:14.285 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.rlt8E1h3iVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/047) 2023-07-05T19:08:14.509 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph 2023-07-05T19:08:14.514 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-05T19:08:14.514 INFO:teuthology.orchestra.run.smithi046.stdout:MKFS_OPTIONS -- 172.21.15.46:6789:/scratch 2023-07-05T19:08:14.515 INFO:teuthology.orchestra.run.smithi046.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCbvKVkpp1TIhAAvJTELoeH8wkIFqjtppg17w== -o context=system_u:object_r:root_t:s0 172.21.15.46:6789:/scratch /tmp/tmp.KrMG67MsYpscratch 2023-07-05T19:08:14.515 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T19:08:15.041 INFO:teuthology.orchestra.run.smithi046.stdout:generic/047 [not run] ceph does not support shutdown 2023-07-05T19:08:15.061 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/047 2023-07-05T19:08:15.061 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/047 2023-07-05T19:08:15.061 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-07-05T19:08:15.063 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T19:08:15.088 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-05T19:08:15.089 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.rlt8E1h3iVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/048) 2023-07-05T19:08:15.313 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph 2023-07-05T19:08:15.317 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-05T19:08:15.318 INFO:teuthology.orchestra.run.smithi046.stdout:MKFS_OPTIONS -- 172.21.15.46:6789:/scratch 2023-07-05T19:08:15.319 INFO:teuthology.orchestra.run.smithi046.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCbvKVkpp1TIhAAvJTELoeH8wkIFqjtppg17w== -o context=system_u:object_r:root_t:s0 172.21.15.46:6789:/scratch /tmp/tmp.KrMG67MsYpscratch 2023-07-05T19:08:15.319 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T19:08:15.830 INFO:teuthology.orchestra.run.smithi046.stdout:generic/048 [not run] ceph does not support shutdown 2023-07-05T19:08:15.848 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/048 2023-07-05T19:08:15.849 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/048 2023-07-05T19:08:15.849 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-07-05T19:08:15.850 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T19:08:15.871 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-05T19:08:15.872 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.rlt8E1h3iVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/049) 2023-07-05T19:08:16.094 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph 2023-07-05T19:08:16.098 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-05T19:08:16.099 INFO:teuthology.orchestra.run.smithi046.stdout:MKFS_OPTIONS -- 172.21.15.46:6789:/scratch 2023-07-05T19:08:16.100 INFO:teuthology.orchestra.run.smithi046.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCbvKVkpp1TIhAAvJTELoeH8wkIFqjtppg17w== -o context=system_u:object_r:root_t:s0 172.21.15.46:6789:/scratch /tmp/tmp.KrMG67MsYpscratch 2023-07-05T19:08:16.100 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T19:08:16.605 INFO:teuthology.orchestra.run.smithi046.stdout:generic/049 [not run] ceph does not support shutdown 2023-07-05T19:08:16.634 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/049 2023-07-05T19:08:16.634 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/049 2023-07-05T19:08:16.634 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-07-05T19:08:16.636 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T19:08:16.659 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-05T19:08:16.659 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.rlt8E1h3iVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/050) 2023-07-05T19:08:16.880 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph 2023-07-05T19:08:16.884 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-05T19:08:16.885 INFO:teuthology.orchestra.run.smithi046.stdout:MKFS_OPTIONS -- 172.21.15.46:6789:/scratch 2023-07-05T19:08:16.886 INFO:teuthology.orchestra.run.smithi046.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCbvKVkpp1TIhAAvJTELoeH8wkIFqjtppg17w== -o context=system_u:object_r:root_t:s0 172.21.15.46:6789:/scratch /tmp/tmp.KrMG67MsYpscratch 2023-07-05T19:08:16.886 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T19:08:17.377 INFO:teuthology.orchestra.run.smithi046.stdout:generic/050 [not run] ceph does not support shutdown 2023-07-05T19:08:17.394 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/050 2023-07-05T19:08:17.395 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/050 2023-07-05T19:08:17.395 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-07-05T19:08:17.396 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T19:08:17.420 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-05T19:08:17.421 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.rlt8E1h3iVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/051) 2023-07-05T19:08:17.639 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph 2023-07-05T19:08:17.643 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-05T19:08:17.643 INFO:teuthology.orchestra.run.smithi046.stdout:MKFS_OPTIONS -- 172.21.15.46:6789:/scratch 2023-07-05T19:08:17.644 INFO:teuthology.orchestra.run.smithi046.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCbvKVkpp1TIhAAvJTELoeH8wkIFqjtppg17w== -o context=system_u:object_r:root_t:s0 172.21.15.46:6789:/scratch /tmp/tmp.KrMG67MsYpscratch 2023-07-05T19:08:17.644 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T19:08:18.187 INFO:teuthology.orchestra.run.smithi046.stdout:generic/051 [not run] ceph does not support shutdown 2023-07-05T19:08:18.191 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/051 2023-07-05T19:08:18.191 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/051 2023-07-05T19:08:18.191 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-07-05T19:08:18.193 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T19:08:18.221 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-05T19:08:18.222 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.rlt8E1h3iVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/052) 2023-07-05T19:08:18.446 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph 2023-07-05T19:08:18.450 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-05T19:08:18.451 INFO:teuthology.orchestra.run.smithi046.stdout:MKFS_OPTIONS -- 172.21.15.46:6789:/scratch 2023-07-05T19:08:18.452 INFO:teuthology.orchestra.run.smithi046.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCbvKVkpp1TIhAAvJTELoeH8wkIFqjtppg17w== -o context=system_u:object_r:root_t:s0 172.21.15.46:6789:/scratch /tmp/tmp.KrMG67MsYpscratch 2023-07-05T19:08:18.452 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T19:08:18.971 INFO:teuthology.orchestra.run.smithi046.stdout:generic/052 [not run] ceph does not support shutdown 2023-07-05T19:08:18.992 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/052 2023-07-05T19:08:18.993 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/052 2023-07-05T19:08:18.993 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-07-05T19:08:18.994 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T19:08:19.015 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-05T19:08:19.016 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.rlt8E1h3iVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/053) 2023-07-05T19:08:19.233 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph 2023-07-05T19:08:19.237 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-05T19:08:19.238 INFO:teuthology.orchestra.run.smithi046.stdout:MKFS_OPTIONS -- 172.21.15.46:6789:/scratch 2023-07-05T19:08:19.239 INFO:teuthology.orchestra.run.smithi046.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCbvKVkpp1TIhAAvJTELoeH8wkIFqjtppg17w== -o context=system_u:object_r:root_t:s0 172.21.15.46:6789:/scratch /tmp/tmp.KrMG67MsYpscratch 2023-07-05T19:08:19.239 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T19:08:20.166 INFO:teuthology.orchestra.run.smithi046.stdout:generic/053 1s 2023-07-05T19:08:20.223 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/053 2023-07-05T19:08:20.223 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-07-05T19:08:20.225 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T19:08:20.241 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-05T19:08:20.241 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.rlt8E1h3iVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/054) 2023-07-05T19:08:20.478 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph 2023-07-05T19:08:20.482 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-05T19:08:20.483 INFO:teuthology.orchestra.run.smithi046.stdout:MKFS_OPTIONS -- 172.21.15.46:6789:/scratch 2023-07-05T19:08:20.483 INFO:teuthology.orchestra.run.smithi046.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCbvKVkpp1TIhAAvJTELoeH8wkIFqjtppg17w== -o context=system_u:object_r:root_t:s0 172.21.15.46:6789:/scratch /tmp/tmp.KrMG67MsYpscratch 2023-07-05T19:08:20.484 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T19:08:21.005 INFO:teuthology.orchestra.run.smithi046.stdout:generic/054 [not run] ceph does not support shutdown 2023-07-05T19:08:21.029 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/054 2023-07-05T19:08:21.029 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/054 2023-07-05T19:08:21.029 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-07-05T19:08:21.031 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T19:08:21.053 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-05T19:08:21.053 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.rlt8E1h3iVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/055) 2023-07-05T19:08:21.276 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph 2023-07-05T19:08:21.280 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-05T19:08:21.281 INFO:teuthology.orchestra.run.smithi046.stdout:MKFS_OPTIONS -- 172.21.15.46:6789:/scratch 2023-07-05T19:08:21.282 INFO:teuthology.orchestra.run.smithi046.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCbvKVkpp1TIhAAvJTELoeH8wkIFqjtppg17w== -o context=system_u:object_r:root_t:s0 172.21.15.46:6789:/scratch /tmp/tmp.KrMG67MsYpscratch 2023-07-05T19:08:21.282 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T19:08:21.801 INFO:teuthology.orchestra.run.smithi046.stdout:generic/055 [not run] ceph does not support shutdown 2023-07-05T19:08:21.822 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/055 2023-07-05T19:08:21.823 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/055 2023-07-05T19:08:21.823 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-07-05T19:08:21.824 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T19:08:21.855 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-05T19:08:21.855 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.rlt8E1h3iVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/056) 2023-07-05T19:08:22.074 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph 2023-07-05T19:08:22.078 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-05T19:08:22.078 INFO:teuthology.orchestra.run.smithi046.stdout:MKFS_OPTIONS -- 172.21.15.46:6789:/scratch 2023-07-05T19:08:22.079 INFO:teuthology.orchestra.run.smithi046.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCbvKVkpp1TIhAAvJTELoeH8wkIFqjtppg17w== -o context=system_u:object_r:root_t:s0 172.21.15.46:6789:/scratch /tmp/tmp.KrMG67MsYpscratch 2023-07-05T19:08:22.079 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T19:08:22.441 INFO:teuthology.orchestra.run.smithi046.stdout:generic/056 [not run] require 172.21.15.46:6789:/scratch to be valid block disk 2023-07-05T19:08:22.446 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/056 2023-07-05T19:08:22.446 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/056 2023-07-05T19:08:22.446 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-07-05T19:08:22.448 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T19:08:22.487 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-05T19:08:22.487 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.rlt8E1h3iVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/057) 2023-07-05T19:08:22.723 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph 2023-07-05T19:08:22.727 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-05T19:08:22.728 INFO:teuthology.orchestra.run.smithi046.stdout:MKFS_OPTIONS -- 172.21.15.46:6789:/scratch 2023-07-05T19:08:22.729 INFO:teuthology.orchestra.run.smithi046.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCbvKVkpp1TIhAAvJTELoeH8wkIFqjtppg17w== -o context=system_u:object_r:root_t:s0 172.21.15.46:6789:/scratch /tmp/tmp.KrMG67MsYpscratch 2023-07-05T19:08:22.729 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T19:08:23.077 INFO:teuthology.orchestra.run.smithi046.stdout:generic/057 [not run] require 172.21.15.46:6789:/scratch to be valid block disk 2023-07-05T19:08:23.081 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/057 2023-07-05T19:08:23.081 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/057 2023-07-05T19:08:23.081 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-07-05T19:08:23.083 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T19:08:23.114 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-05T19:08:23.115 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.rlt8E1h3iVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/058) 2023-07-05T19:08:23.342 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph 2023-07-05T19:08:23.346 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-05T19:08:23.347 INFO:teuthology.orchestra.run.smithi046.stdout:MKFS_OPTIONS -- 172.21.15.46:6789:/scratch 2023-07-05T19:08:23.347 INFO:teuthology.orchestra.run.smithi046.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCbvKVkpp1TIhAAvJTELoeH8wkIFqjtppg17w== -o context=system_u:object_r:root_t:s0 172.21.15.46:6789:/scratch /tmp/tmp.KrMG67MsYpscratch 2023-07-05T19:08:23.348 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T19:08:23.781 INFO:teuthology.orchestra.run.smithi046.stdout:generic/058 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-07-05T19:08:23.785 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/058 2023-07-05T19:08:23.785 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/058 2023-07-05T19:08:23.785 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-07-05T19:08:23.787 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T19:08:24.031 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-05T19:08:24.032 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.rlt8E1h3iVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/059) 2023-07-05T19:08:24.358 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph 2023-07-05T19:08:24.362 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-05T19:08:24.362 INFO:teuthology.orchestra.run.smithi046.stdout:MKFS_OPTIONS -- 172.21.15.46:6789:/scratch 2023-07-05T19:08:24.363 INFO:teuthology.orchestra.run.smithi046.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCbvKVkpp1TIhAAvJTELoeH8wkIFqjtppg17w== -o context=system_u:object_r:root_t:s0 172.21.15.46:6789:/scratch /tmp/tmp.KrMG67MsYpscratch 2023-07-05T19:08:24.363 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T19:08:24.708 INFO:teuthology.orchestra.run.smithi046.stdout:generic/059 [not run] require 172.21.15.46:6789:/scratch to be valid block disk 2023-07-05T19:08:24.711 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/059 2023-07-05T19:08:24.712 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/059 2023-07-05T19:08:24.712 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-07-05T19:08:24.714 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T19:08:24.740 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-05T19:08:24.741 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.rlt8E1h3iVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/060) 2023-07-05T19:08:24.960 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph 2023-07-05T19:08:24.964 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-05T19:08:24.964 INFO:teuthology.orchestra.run.smithi046.stdout:MKFS_OPTIONS -- 172.21.15.46:6789:/scratch 2023-07-05T19:08:24.965 INFO:teuthology.orchestra.run.smithi046.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCbvKVkpp1TIhAAvJTELoeH8wkIFqjtppg17w== -o context=system_u:object_r:root_t:s0 172.21.15.46:6789:/scratch /tmp/tmp.KrMG67MsYpscratch 2023-07-05T19:08:24.965 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T19:08:25.391 INFO:teuthology.orchestra.run.smithi046.stdout:generic/060 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-07-05T19:08:25.395 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/060 2023-07-05T19:08:25.395 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/060 2023-07-05T19:08:25.395 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-07-05T19:08:25.397 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T19:08:25.399 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-05T19:08:25.401 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-05T19:08:25.603 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-05T19:08:25.604 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.rlt8E1h3iVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/061) 2023-07-05T19:08:25.961 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph 2023-07-05T19:08:25.965 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-05T19:08:25.965 INFO:teuthology.orchestra.run.smithi046.stdout:MKFS_OPTIONS -- 172.21.15.46:6789:/scratch 2023-07-05T19:08:25.966 INFO:teuthology.orchestra.run.smithi046.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCbvKVkpp1TIhAAvJTELoeH8wkIFqjtppg17w== -o context=system_u:object_r:root_t:s0 172.21.15.46:6789:/scratch /tmp/tmp.KrMG67MsYpscratch 2023-07-05T19:08:25.966 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T19:08:26.384 INFO:teuthology.orchestra.run.smithi046.stdout:generic/061 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-07-05T19:08:26.388 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/061 2023-07-05T19:08:26.388 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/061 2023-07-05T19:08:26.389 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-07-05T19:08:26.390 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T19:08:26.556 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-05T19:08:26.556 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.rlt8E1h3iVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/062) 2023-07-05T19:08:26.954 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph 2023-07-05T19:08:26.958 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-05T19:08:26.959 INFO:teuthology.orchestra.run.smithi046.stdout:MKFS_OPTIONS -- 172.21.15.46:6789:/scratch 2023-07-05T19:08:26.960 INFO:teuthology.orchestra.run.smithi046.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCbvKVkpp1TIhAAvJTELoeH8wkIFqjtppg17w== -o context=system_u:object_r:root_t:s0 172.21.15.46:6789:/scratch /tmp/tmp.KrMG67MsYpscratch 2023-07-05T19:08:26.960 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T19:08:28.792 INFO:teuthology.orchestra.run.smithi046.stdout:generic/062 1s 2023-07-05T19:08:28.816 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/062 2023-07-05T19:08:28.816 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-07-05T19:08:28.820 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T19:08:28.830 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-05T19:08:28.831 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.rlt8E1h3iVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/063) 2023-07-05T19:08:29.052 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph 2023-07-05T19:08:29.056 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-05T19:08:29.056 INFO:teuthology.orchestra.run.smithi046.stdout:MKFS_OPTIONS -- 172.21.15.46:6789:/scratch 2023-07-05T19:08:29.057 INFO:teuthology.orchestra.run.smithi046.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCbvKVkpp1TIhAAvJTELoeH8wkIFqjtppg17w== -o context=system_u:object_r:root_t:s0 172.21.15.46:6789:/scratch /tmp/tmp.KrMG67MsYpscratch 2023-07-05T19:08:29.057 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T19:08:29.535 INFO:teuthology.orchestra.run.smithi046.stdout:generic/063 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-07-05T19:08:29.538 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/063 2023-07-05T19:08:29.539 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/063 2023-07-05T19:08:29.539 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-07-05T19:08:29.541 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T19:08:29.878 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-05T19:08:29.879 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.rlt8E1h3iVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/064) 2023-07-05T19:08:30.111 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph 2023-07-05T19:08:30.115 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-05T19:08:30.115 INFO:teuthology.orchestra.run.smithi046.stdout:MKFS_OPTIONS -- 172.21.15.46:6789:/scratch 2023-07-05T19:08:30.116 INFO:teuthology.orchestra.run.smithi046.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCbvKVkpp1TIhAAvJTELoeH8wkIFqjtppg17w== -o context=system_u:object_r:root_t:s0 172.21.15.46:6789:/scratch /tmp/tmp.KrMG67MsYpscratch 2023-07-05T19:08:30.116 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T19:08:30.475 INFO:teuthology.orchestra.run.smithi046.stdout:generic/064 [not run] xfs_io fiemap failed (old kernel/wrong fs?) 2023-07-05T19:08:30.480 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/064 2023-07-05T19:08:30.480 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/064 2023-07-05T19:08:30.480 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-07-05T19:08:30.482 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T19:08:30.509 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-05T19:08:30.510 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.rlt8E1h3iVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/065) 2023-07-05T19:08:30.745 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph 2023-07-05T19:08:30.750 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-05T19:08:30.750 INFO:teuthology.orchestra.run.smithi046.stdout:MKFS_OPTIONS -- 172.21.15.46:6789:/scratch 2023-07-05T19:08:30.751 INFO:teuthology.orchestra.run.smithi046.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCbvKVkpp1TIhAAvJTELoeH8wkIFqjtppg17w== -o context=system_u:object_r:root_t:s0 172.21.15.46:6789:/scratch /tmp/tmp.KrMG67MsYpscratch 2023-07-05T19:08:30.751 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T19:08:31.120 INFO:teuthology.orchestra.run.smithi046.stdout:generic/065 [not run] require 172.21.15.46:6789:/scratch to be valid block disk 2023-07-05T19:08:31.124 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/065 2023-07-05T19:08:31.125 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/065 2023-07-05T19:08:31.125 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-07-05T19:08:31.127 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T19:08:31.152 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-05T19:08:31.153 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.rlt8E1h3iVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/066) 2023-07-05T19:08:31.377 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph 2023-07-05T19:08:31.382 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-05T19:08:31.382 INFO:teuthology.orchestra.run.smithi046.stdout:MKFS_OPTIONS -- 172.21.15.46:6789:/scratch 2023-07-05T19:08:31.383 INFO:teuthology.orchestra.run.smithi046.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCbvKVkpp1TIhAAvJTELoeH8wkIFqjtppg17w== -o context=system_u:object_r:root_t:s0 172.21.15.46:6789:/scratch /tmp/tmp.KrMG67MsYpscratch 2023-07-05T19:08:31.383 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T19:08:31.737 INFO:teuthology.orchestra.run.smithi046.stdout:generic/066 [not run] require 172.21.15.46:6789:/scratch to be valid block disk 2023-07-05T19:08:31.741 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/066 2023-07-05T19:08:31.741 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/066 2023-07-05T19:08:31.741 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-07-05T19:08:31.743 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T19:08:31.766 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-05T19:08:31.766 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.rlt8E1h3iVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/067) 2023-07-05T19:08:31.983 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph 2023-07-05T19:08:31.987 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-05T19:08:31.988 INFO:teuthology.orchestra.run.smithi046.stdout:MKFS_OPTIONS -- 172.21.15.46:6789:/scratch 2023-07-05T19:08:31.988 INFO:teuthology.orchestra.run.smithi046.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCbvKVkpp1TIhAAvJTELoeH8wkIFqjtppg17w== -o context=system_u:object_r:root_t:s0 172.21.15.46:6789:/scratch /tmp/tmp.KrMG67MsYpscratch 2023-07-05T19:08:31.989 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T19:08:32.393 INFO:teuthology.orchestra.run.smithi046.stdout:generic/067 [not run] require 172.21.15.46:6789:/scratch to be valid block disk 2023-07-05T19:08:32.397 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/067 2023-07-05T19:08:32.397 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/067 2023-07-05T19:08:32.397 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-07-05T19:08:32.399 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T19:08:32.423 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-05T19:08:32.423 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.rlt8E1h3iVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/068) 2023-07-05T19:08:32.645 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph 2023-07-05T19:08:32.649 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-05T19:08:32.650 INFO:teuthology.orchestra.run.smithi046.stdout:MKFS_OPTIONS -- 172.21.15.46:6789:/scratch 2023-07-05T19:08:32.651 INFO:teuthology.orchestra.run.smithi046.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCbvKVkpp1TIhAAvJTELoeH8wkIFqjtppg17w== -o context=system_u:object_r:root_t:s0 172.21.15.46:6789:/scratch /tmp/tmp.KrMG67MsYpscratch 2023-07-05T19:08:32.651 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T19:08:33.007 INFO:teuthology.orchestra.run.smithi046.stdout:generic/068 [not run] ceph does not support freezing 2023-07-05T19:08:33.011 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/068 2023-07-05T19:08:33.012 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/068 2023-07-05T19:08:33.012 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-07-05T19:08:33.014 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T19:08:33.038 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-05T19:08:33.039 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.rlt8E1h3iVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/069) 2023-07-05T19:08:33.258 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph 2023-07-05T19:08:33.262 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-05T19:08:33.262 INFO:teuthology.orchestra.run.smithi046.stdout:MKFS_OPTIONS -- 172.21.15.46:6789:/scratch 2023-07-05T19:08:33.263 INFO:teuthology.orchestra.run.smithi046.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCbvKVkpp1TIhAAvJTELoeH8wkIFqjtppg17w== -o context=system_u:object_r:root_t:s0 172.21.15.46:6789:/scratch /tmp/tmp.KrMG67MsYpscratch 2023-07-05T19:08:33.263 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T19:08:40.125 INFO:teuthology.orchestra.run.smithi046.stdout:generic/069 7s 2023-07-05T19:08:40.132 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/069 2023-07-05T19:08:40.132 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-07-05T19:08:40.136 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T19:08:40.146 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-05T19:08:40.147 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.rlt8E1h3iVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/070) 2023-07-05T19:08:40.366 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph 2023-07-05T19:08:40.370 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-05T19:08:40.371 INFO:teuthology.orchestra.run.smithi046.stdout:MKFS_OPTIONS -- 172.21.15.46:6789:/scratch 2023-07-05T19:08:40.372 INFO:teuthology.orchestra.run.smithi046.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCbvKVkpp1TIhAAvJTELoeH8wkIFqjtppg17w== -o context=system_u:object_r:root_t:s0 172.21.15.46:6789:/scratch /tmp/tmp.KrMG67MsYpscratch 2023-07-05T19:08:40.372 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T19:08:55.616 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-05T19:08:55.620 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-05T19:08:55.675 INFO:tasks.ceph.mds.b.smithi073.stderr:2023-07-05T19:08:55.672+0000 7f1ff165c700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 110098) UID: 0 2023-07-05T19:08:55.676 INFO:tasks.ceph.mds.d.smithi073.stderr:2023-07-05T19:08:55.672+0000 7f07b5126700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 110098) UID: 0 2023-07-05T19:09:08.893 INFO:teuthology.orchestra.run.smithi046.stdout:generic/070 28s 2023-07-05T19:09:08.899 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/070 2023-07-05T19:09:08.899 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-07-05T19:09:08.901 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T19:09:09.283 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-05T19:09:09.283 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.rlt8E1h3iVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/071) 2023-07-05T19:09:09.624 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph 2023-07-05T19:09:09.629 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-05T19:09:09.630 INFO:teuthology.orchestra.run.smithi046.stdout:MKFS_OPTIONS -- 172.21.15.46:6789:/scratch 2023-07-05T19:09:09.630 INFO:teuthology.orchestra.run.smithi046.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCbvKVkpp1TIhAAvJTELoeH8wkIFqjtppg17w== -o context=system_u:object_r:root_t:s0 172.21.15.46:6789:/scratch /tmp/tmp.KrMG67MsYpscratch 2023-07-05T19:09:09.630 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T19:09:10.108 INFO:teuthology.orchestra.run.smithi046.stdout:generic/071 [not run] xfs_io falloc -k failed (old kernel/wrong fs?) 2023-07-05T19:09:10.116 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/071 2023-07-05T19:09:10.116 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/071 2023-07-05T19:09:10.116 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-07-05T19:09:10.118 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T19:09:10.152 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-05T19:09:10.153 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.rlt8E1h3iVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/072) 2023-07-05T19:09:10.472 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph 2023-07-05T19:09:10.481 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-05T19:09:10.482 INFO:teuthology.orchestra.run.smithi046.stdout:MKFS_OPTIONS -- 172.21.15.46:6789:/scratch 2023-07-05T19:09:10.483 INFO:teuthology.orchestra.run.smithi046.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCbvKVkpp1TIhAAvJTELoeH8wkIFqjtppg17w== -o context=system_u:object_r:root_t:s0 172.21.15.46:6789:/scratch /tmp/tmp.KrMG67MsYpscratch 2023-07-05T19:09:10.483 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T19:09:11.095 INFO:teuthology.orchestra.run.smithi046.stdout:generic/072 [not run] xfs_io fcollapse failed (old kernel/wrong fs?) 2023-07-05T19:09:11.100 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/072 2023-07-05T19:09:11.101 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/072 2023-07-05T19:09:11.101 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-07-05T19:09:11.103 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T19:09:11.138 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-05T19:09:11.138 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.rlt8E1h3iVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/073) 2023-07-05T19:09:11.507 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph 2023-07-05T19:09:11.514 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-05T19:09:11.515 INFO:teuthology.orchestra.run.smithi046.stdout:MKFS_OPTIONS -- 172.21.15.46:6789:/scratch 2023-07-05T19:09:11.516 INFO:teuthology.orchestra.run.smithi046.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCbvKVkpp1TIhAAvJTELoeH8wkIFqjtppg17w== -o context=system_u:object_r:root_t:s0 172.21.15.46:6789:/scratch /tmp/tmp.KrMG67MsYpscratch 2023-07-05T19:09:11.516 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T19:09:12.044 INFO:teuthology.orchestra.run.smithi046.stdout:generic/073 [not run] require 172.21.15.46:6789:/scratch to be valid block disk 2023-07-05T19:09:12.049 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/073 2023-07-05T19:09:12.049 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/073 2023-07-05T19:09:12.049 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-07-05T19:09:12.051 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T19:09:12.084 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-05T19:09:12.085 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.rlt8E1h3iVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/074) 2023-07-05T19:09:12.404 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph 2023-07-05T19:09:12.409 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-05T19:09:12.410 INFO:teuthology.orchestra.run.smithi046.stdout:MKFS_OPTIONS -- 172.21.15.46:6789:/scratch 2023-07-05T19:09:12.411 INFO:teuthology.orchestra.run.smithi046.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCbvKVkpp1TIhAAvJTELoeH8wkIFqjtppg17w== -o context=system_u:object_r:root_t:s0 172.21.15.46:6789:/scratch /tmp/tmp.KrMG67MsYpscratch 2023-07-05T19:09:12.411 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T19:09:32.997 INFO:teuthology.orchestra.run.smithi046.stdout:generic/074 20s 2023-07-05T19:09:33.004 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/074 2023-07-05T19:09:33.004 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-07-05T19:09:33.007 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T19:09:33.456 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-05T19:09:33.457 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.rlt8E1h3iVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/075) 2023-07-05T19:09:33.984 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph 2023-07-05T19:09:33.989 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-05T19:09:33.990 INFO:teuthology.orchestra.run.smithi046.stdout:MKFS_OPTIONS -- 172.21.15.46:6789:/scratch 2023-07-05T19:09:33.991 INFO:teuthology.orchestra.run.smithi046.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCbvKVkpp1TIhAAvJTELoeH8wkIFqjtppg17w== -o context=system_u:object_r:root_t:s0 172.21.15.46:6789:/scratch /tmp/tmp.KrMG67MsYpscratch 2023-07-05T19:09:33.991 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T19:10:08.469 INFO:teuthology.orchestra.run.smithi046.stdout:generic/075 34s 2023-07-05T19:10:08.475 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/075 2023-07-05T19:10:08.475 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-07-05T19:10:08.477 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T19:10:08.673 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-05T19:10:08.674 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.rlt8E1h3iVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/076) 2023-07-05T19:10:09.157 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph 2023-07-05T19:10:09.163 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-05T19:10:09.163 INFO:teuthology.orchestra.run.smithi046.stdout:MKFS_OPTIONS -- 172.21.15.46:6789:/scratch 2023-07-05T19:10:09.164 INFO:teuthology.orchestra.run.smithi046.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCbvKVkpp1TIhAAvJTELoeH8wkIFqjtppg17w== -o context=system_u:object_r:root_t:s0 172.21.15.46:6789:/scratch /tmp/tmp.KrMG67MsYpscratch 2023-07-05T19:10:09.165 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T19:10:09.659 INFO:teuthology.orchestra.run.smithi046.stdout:generic/076 [not run] require 172.21.15.46:6789:/scratch to be local device 2023-07-05T19:10:09.664 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/076 2023-07-05T19:10:09.664 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/076 2023-07-05T19:10:09.664 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-07-05T19:10:09.668 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T19:10:09.698 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-05T19:10:09.698 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.rlt8E1h3iVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/077) 2023-07-05T19:10:10.043 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph 2023-07-05T19:10:10.053 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-05T19:10:10.053 INFO:teuthology.orchestra.run.smithi046.stdout:MKFS_OPTIONS -- 172.21.15.46:6789:/scratch 2023-07-05T19:10:10.055 INFO:teuthology.orchestra.run.smithi046.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCbvKVkpp1TIhAAvJTELoeH8wkIFqjtppg17w== -o context=system_u:object_r:root_t:s0 172.21.15.46:6789:/scratch /tmp/tmp.KrMG67MsYpscratch 2023-07-05T19:10:10.055 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T19:10:12.842 INFO:teuthology.orchestra.run.smithi046.stdout:generic/077 [not run] Filesystem ceph not supported in _scratch_mkfs_sized 2023-07-05T19:10:12.850 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/077 2023-07-05T19:10:12.850 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/077 2023-07-05T19:10:12.850 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-07-05T19:10:12.854 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T19:10:13.153 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-05T19:10:13.154 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.rlt8E1h3iVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/078) 2023-07-05T19:10:13.549 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph 2023-07-05T19:10:13.558 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-05T19:10:13.558 INFO:teuthology.orchestra.run.smithi046.stdout:MKFS_OPTIONS -- 172.21.15.46:6789:/scratch 2023-07-05T19:10:13.559 INFO:teuthology.orchestra.run.smithi046.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCbvKVkpp1TIhAAvJTELoeH8wkIFqjtppg17w== -o context=system_u:object_r:root_t:s0 172.21.15.46:6789:/scratch /tmp/tmp.KrMG67MsYpscratch 2023-07-05T19:10:13.559 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T19:10:14.072 INFO:teuthology.orchestra.run.smithi046.stdout:generic/078 [not run] kernel doesn't support renameat2 syscall 2023-07-05T19:10:14.077 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/078 2023-07-05T19:10:14.079 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/078 2023-07-05T19:10:14.079 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-07-05T19:10:14.080 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T19:10:14.449 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-05T19:10:14.449 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.rlt8E1h3iVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/079) 2023-07-05T19:10:14.810 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph 2023-07-05T19:10:14.817 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-05T19:10:14.817 INFO:teuthology.orchestra.run.smithi046.stdout:MKFS_OPTIONS -- 172.21.15.46:6789:/scratch 2023-07-05T19:10:14.818 INFO:teuthology.orchestra.run.smithi046.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCbvKVkpp1TIhAAvJTELoeH8wkIFqjtppg17w== -o context=system_u:object_r:root_t:s0 172.21.15.46:6789:/scratch /tmp/tmp.KrMG67MsYpscratch 2023-07-05T19:10:14.819 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T19:10:15.334 INFO:teuthology.orchestra.run.smithi046.stdout:generic/079 [not run] file system doesn't support chattr +ia 2023-07-05T19:10:15.339 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/079 2023-07-05T19:10:15.339 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/079 2023-07-05T19:10:15.339 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-07-05T19:10:15.341 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T19:10:15.405 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-05T19:10:15.405 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.rlt8E1h3iVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/080) 2023-07-05T19:10:15.774 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph 2023-07-05T19:10:15.793 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-05T19:10:15.794 INFO:teuthology.orchestra.run.smithi046.stdout:MKFS_OPTIONS -- 172.21.15.46:6789:/scratch 2023-07-05T19:10:15.795 INFO:teuthology.orchestra.run.smithi046.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCbvKVkpp1TIhAAvJTELoeH8wkIFqjtppg17w== -o context=system_u:object_r:root_t:s0 172.21.15.46:6789:/scratch /tmp/tmp.KrMG67MsYpscratch 2023-07-05T19:10:15.795 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T19:10:18.319 INFO:teuthology.orchestra.run.smithi046.stdout:generic/080 2s 2023-07-05T19:10:18.325 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/080 2023-07-05T19:10:18.326 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-07-05T19:10:18.328 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T19:10:18.371 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-05T19:10:18.372 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.rlt8E1h3iVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/081) 2023-07-05T19:10:18.723 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph 2023-07-05T19:10:18.735 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-05T19:10:18.735 INFO:teuthology.orchestra.run.smithi046.stdout:MKFS_OPTIONS -- 172.21.15.46:6789:/scratch 2023-07-05T19:10:18.736 INFO:teuthology.orchestra.run.smithi046.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCbvKVkpp1TIhAAvJTELoeH8wkIFqjtppg17w== -o context=system_u:object_r:root_t:s0 172.21.15.46:6789:/scratch /tmp/tmp.KrMG67MsYpscratch 2023-07-05T19:10:18.736 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T19:10:19.233 INFO:teuthology.orchestra.run.smithi046.stdout:generic/081 [not run] require 172.21.15.46:6789:/scratch to be valid block disk 2023-07-05T19:10:19.238 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/081 2023-07-05T19:10:19.238 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/081 2023-07-05T19:10:19.238 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-07-05T19:10:19.241 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T19:10:19.274 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-05T19:10:19.274 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.rlt8E1h3iVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/082) 2023-07-05T19:10:19.601 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph 2023-07-05T19:10:19.609 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-05T19:10:19.610 INFO:teuthology.orchestra.run.smithi046.stdout:MKFS_OPTIONS -- 172.21.15.46:6789:/scratch 2023-07-05T19:10:19.611 INFO:teuthology.orchestra.run.smithi046.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCbvKVkpp1TIhAAvJTELoeH8wkIFqjtppg17w== -o context=system_u:object_r:root_t:s0 172.21.15.46:6789:/scratch /tmp/tmp.KrMG67MsYpscratch 2023-07-05T19:10:19.611 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T19:10:20.172 INFO:teuthology.orchestra.run.smithi046.stdout:generic/082 [not run] disk quotas not supported by this filesystem type: ceph 2023-07-05T19:10:20.180 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/082 2023-07-05T19:10:20.180 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/082 2023-07-05T19:10:20.180 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-07-05T19:10:20.183 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T19:10:20.214 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-05T19:10:20.215 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.rlt8E1h3iVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/083) 2023-07-05T19:10:20.569 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph 2023-07-05T19:10:20.576 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-05T19:10:20.577 INFO:teuthology.orchestra.run.smithi046.stdout:MKFS_OPTIONS -- 172.21.15.46:6789:/scratch 2023-07-05T19:10:20.578 INFO:teuthology.orchestra.run.smithi046.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCbvKVkpp1TIhAAvJTELoeH8wkIFqjtppg17w== -o context=system_u:object_r:root_t:s0 172.21.15.46:6789:/scratch /tmp/tmp.KrMG67MsYpscratch 2023-07-05T19:10:20.578 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T19:10:21.088 INFO:teuthology.orchestra.run.smithi046.stdout:generic/083 [not run] Filesystem ceph not supported in _scratch_mkfs_sized 2023-07-05T19:10:21.093 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/083 2023-07-05T19:10:21.093 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/083 2023-07-05T19:10:21.093 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-07-05T19:10:21.096 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T19:10:21.126 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-05T19:10:21.126 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.rlt8E1h3iVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/084) 2023-07-05T19:10:21.463 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph 2023-07-05T19:10:21.468 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-05T19:10:21.468 INFO:teuthology.orchestra.run.smithi046.stdout:MKFS_OPTIONS -- 172.21.15.46:6789:/scratch 2023-07-05T19:10:21.469 INFO:teuthology.orchestra.run.smithi046.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCbvKVkpp1TIhAAvJTELoeH8wkIFqjtppg17w== -o context=system_u:object_r:root_t:s0 172.21.15.46:6789:/scratch /tmp/tmp.KrMG67MsYpscratch 2023-07-05T19:10:21.469 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T19:10:27.649 INFO:teuthology.orchestra.run.smithi046.stdout:generic/084 6s 2023-07-05T19:10:27.690 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/084 2023-07-05T19:10:27.691 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-07-05T19:10:27.692 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T19:10:27.703 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-05T19:10:27.704 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.rlt8E1h3iVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/085) 2023-07-05T19:10:28.090 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph 2023-07-05T19:10:28.094 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-05T19:10:28.095 INFO:teuthology.orchestra.run.smithi046.stdout:MKFS_OPTIONS -- 172.21.15.46:6789:/scratch 2023-07-05T19:10:28.096 INFO:teuthology.orchestra.run.smithi046.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCbvKVkpp1TIhAAvJTELoeH8wkIFqjtppg17w== -o context=system_u:object_r:root_t:s0 172.21.15.46:6789:/scratch /tmp/tmp.KrMG67MsYpscratch 2023-07-05T19:10:28.096 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T19:10:28.594 INFO:teuthology.orchestra.run.smithi046.stdout:generic/085 [not run] require 172.21.15.46:6789:/scratch to be valid block disk 2023-07-05T19:10:28.599 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/085 2023-07-05T19:10:28.599 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/085 2023-07-05T19:10:28.599 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-07-05T19:10:28.601 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T19:10:28.626 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-05T19:10:28.626 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.rlt8E1h3iVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/086) 2023-07-05T19:10:28.960 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph 2023-07-05T19:10:28.966 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-05T19:10:28.966 INFO:teuthology.orchestra.run.smithi046.stdout:MKFS_OPTIONS -- 172.21.15.46:6789:/scratch 2023-07-05T19:10:28.968 INFO:teuthology.orchestra.run.smithi046.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCbvKVkpp1TIhAAvJTELoeH8wkIFqjtppg17w== -o context=system_u:object_r:root_t:s0 172.21.15.46:6789:/scratch /tmp/tmp.KrMG67MsYpscratch 2023-07-05T19:10:28.968 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T19:10:29.431 INFO:teuthology.orchestra.run.smithi046.stdout:generic/086 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-07-05T19:10:29.435 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/086 2023-07-05T19:10:29.436 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/086 2023-07-05T19:10:29.436 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-07-05T19:10:29.438 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T19:10:29.489 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-05T19:10:29.490 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.rlt8E1h3iVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/087) 2023-07-05T19:10:29.851 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph 2023-07-05T19:10:29.857 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-05T19:10:29.857 INFO:teuthology.orchestra.run.smithi046.stdout:MKFS_OPTIONS -- 172.21.15.46:6789:/scratch 2023-07-05T19:10:29.858 INFO:teuthology.orchestra.run.smithi046.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCbvKVkpp1TIhAAvJTELoeH8wkIFqjtppg17w== -o context=system_u:object_r:root_t:s0 172.21.15.46:6789:/scratch /tmp/tmp.KrMG67MsYpscratch 2023-07-05T19:10:29.858 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T19:10:30.498 INFO:teuthology.orchestra.run.smithi046.stdout:generic/087 0s 2023-07-05T19:10:30.508 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/087 2023-07-05T19:10:30.509 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-07-05T19:10:30.511 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T19:10:30.870 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-05T19:10:30.870 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.rlt8E1h3iVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/088) 2023-07-05T19:10:31.191 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph 2023-07-05T19:10:31.195 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-05T19:10:31.196 INFO:teuthology.orchestra.run.smithi046.stdout:MKFS_OPTIONS -- 172.21.15.46:6789:/scratch 2023-07-05T19:10:31.197 INFO:teuthology.orchestra.run.smithi046.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCbvKVkpp1TIhAAvJTELoeH8wkIFqjtppg17w== -o context=system_u:object_r:root_t:s0 172.21.15.46:6789:/scratch /tmp/tmp.KrMG67MsYpscratch 2023-07-05T19:10:31.197 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T19:10:31.673 INFO:teuthology.orchestra.run.smithi046.stdout:generic/088 0s 2023-07-05T19:10:31.682 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/088 2023-07-05T19:10:31.682 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-07-05T19:10:31.684 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T19:10:32.019 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-05T19:10:32.019 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.rlt8E1h3iVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/089) 2023-07-05T19:10:32.334 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph 2023-07-05T19:10:32.339 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-05T19:10:32.340 INFO:teuthology.orchestra.run.smithi046.stdout:MKFS_OPTIONS -- 172.21.15.46:6789:/scratch 2023-07-05T19:10:32.345 INFO:teuthology.orchestra.run.smithi046.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCbvKVkpp1TIhAAvJTELoeH8wkIFqjtppg17w== -o context=system_u:object_r:root_t:s0 172.21.15.46:6789:/scratch /tmp/tmp.KrMG67MsYpscratch 2023-07-05T19:10:32.345 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T19:12:02.332 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-05T19:12:02.334 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-05T19:12:32.445 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-05T19:12:32.447 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-05T19:13:02.501 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-05T19:13:02.503 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-05T19:13:32.571 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-05T19:13:32.573 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-05T19:14:02.627 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-05T19:14:02.630 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-05T19:14:32.685 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-05T19:14:32.687 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-05T19:14:32.725 INFO:tasks.ceph.mds.b.smithi073.stderr:2023-07-05T19:14:32.723+0000 7f1ff165c700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 110285) UID: 0 2023-07-05T19:14:32.725 INFO:tasks.ceph.mds.d.smithi073.stderr:2023-07-05T19:14:32.723+0000 7f07b5126700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 110285) UID: 0 2023-07-05T19:17:26.972 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-05T19:17:26.974 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-05T19:17:57.127 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-05T19:17:57.130 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-05T19:18:27.192 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-05T19:18:27.194 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-05T19:18:27.226 INFO:tasks.ceph.mds.b.smithi073.stderr:2023-07-05T19:18:27.224+0000 7f1ff165c700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 110384) UID: 0 2023-07-05T19:18:27.226 INFO:tasks.ceph.mds.d.smithi073.stderr:2023-07-05T19:18:27.224+0000 7f07b5126700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 110384) UID: 0 2023-07-05T19:18:51.739 INFO:teuthology.orchestra.run.smithi046.stdout:generic/089 499s 2023-07-05T19:18:51.744 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/089 2023-07-05T19:18:51.744 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-07-05T19:18:51.746 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T19:18:52.156 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-05T19:18:52.157 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.rlt8E1h3iVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/090) 2023-07-05T19:18:52.492 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph 2023-07-05T19:18:52.496 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-05T19:18:52.497 INFO:teuthology.orchestra.run.smithi046.stdout:MKFS_OPTIONS -- 172.21.15.46:6789:/scratch 2023-07-05T19:18:52.497 INFO:teuthology.orchestra.run.smithi046.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCbvKVkpp1TIhAAvJTELoeH8wkIFqjtppg17w== -o context=system_u:object_r:root_t:s0 172.21.15.46:6789:/scratch /tmp/tmp.KrMG67MsYpscratch 2023-07-05T19:18:52.498 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T19:18:52.860 INFO:teuthology.orchestra.run.smithi046.stdout:generic/090 [not run] require 172.21.15.46:6789:/scratch to be valid block disk 2023-07-05T19:18:52.864 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/090 2023-07-05T19:18:52.865 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/090 2023-07-05T19:18:52.865 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-07-05T19:18:52.867 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T19:18:52.893 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-05T19:18:52.894 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.rlt8E1h3iVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/091) 2023-07-05T19:18:53.113 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph 2023-07-05T19:18:53.117 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-05T19:18:53.118 INFO:teuthology.orchestra.run.smithi046.stdout:MKFS_OPTIONS -- 172.21.15.46:6789:/scratch 2023-07-05T19:18:53.119 INFO:teuthology.orchestra.run.smithi046.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCbvKVkpp1TIhAAvJTELoeH8wkIFqjtppg17w== -o context=system_u:object_r:root_t:s0 172.21.15.46:6789:/scratch /tmp/tmp.KrMG67MsYpscratch 2023-07-05T19:18:53.119 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T19:20:37.731 INFO:teuthology.orchestra.run.smithi046.stdout:generic/091 104s 2023-07-05T19:20:37.736 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/091 2023-07-05T19:20:37.736 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-07-05T19:20:37.738 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T19:20:38.063 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-05T19:20:38.064 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.rlt8E1h3iVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/092) 2023-07-05T19:20:38.307 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph 2023-07-05T19:20:38.311 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-05T19:20:38.312 INFO:teuthology.orchestra.run.smithi046.stdout:MKFS_OPTIONS -- 172.21.15.46:6789:/scratch 2023-07-05T19:20:38.312 INFO:teuthology.orchestra.run.smithi046.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCbvKVkpp1TIhAAvJTELoeH8wkIFqjtppg17w== -o context=system_u:object_r:root_t:s0 172.21.15.46:6789:/scratch /tmp/tmp.KrMG67MsYpscratch 2023-07-05T19:20:38.313 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T19:20:38.637 INFO:teuthology.orchestra.run.smithi046.stdout:generic/092 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-07-05T19:20:38.641 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/092 2023-07-05T19:20:38.641 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/092 2023-07-05T19:20:38.641 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-07-05T19:20:38.643 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T19:20:38.668 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-05T19:20:38.669 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.rlt8E1h3iVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/093) 2023-07-05T19:20:38.886 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph 2023-07-05T19:20:38.890 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-05T19:20:38.890 INFO:teuthology.orchestra.run.smithi046.stdout:MKFS_OPTIONS -- 172.21.15.46:6789:/scratch 2023-07-05T19:20:38.891 INFO:teuthology.orchestra.run.smithi046.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCbvKVkpp1TIhAAvJTELoeH8wkIFqjtppg17w== -o context=system_u:object_r:root_t:s0 172.21.15.46:6789:/scratch /tmp/tmp.KrMG67MsYpscratch 2023-07-05T19:20:38.892 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T19:20:39.403 INFO:teuthology.orchestra.run.smithi046.stdout:generic/093 0s 2023-07-05T19:20:39.408 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/093 2023-07-05T19:20:39.408 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-07-05T19:20:39.410 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T19:20:39.541 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-05T19:20:39.542 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.rlt8E1h3iVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/094) 2023-07-05T19:20:39.987 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph 2023-07-05T19:20:39.991 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-05T19:20:39.991 INFO:teuthology.orchestra.run.smithi046.stdout:MKFS_OPTIONS -- 172.21.15.46:6789:/scratch 2023-07-05T19:20:39.992 INFO:teuthology.orchestra.run.smithi046.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCbvKVkpp1TIhAAvJTELoeH8wkIFqjtppg17w== -o context=system_u:object_r:root_t:s0 172.21.15.46:6789:/scratch /tmp/tmp.KrMG67MsYpscratch 2023-07-05T19:20:39.992 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T19:20:40.387 INFO:teuthology.orchestra.run.smithi046.stdout:generic/094 [not run] xfs_io fiemap failed (old kernel/wrong fs?) 2023-07-05T19:20:40.391 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/094 2023-07-05T19:20:40.391 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/094 2023-07-05T19:20:40.391 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-07-05T19:20:40.393 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T19:20:40.722 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-05T19:20:40.723 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.rlt8E1h3iVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/095) 2023-07-05T19:20:40.955 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph 2023-07-05T19:20:40.959 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-05T19:20:40.960 INFO:teuthology.orchestra.run.smithi046.stdout:MKFS_OPTIONS -- 172.21.15.46:6789:/scratch 2023-07-05T19:20:40.961 INFO:teuthology.orchestra.run.smithi046.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCbvKVkpp1TIhAAvJTELoeH8wkIFqjtppg17w== -o context=system_u:object_r:root_t:s0 172.21.15.46:6789:/scratch /tmp/tmp.KrMG67MsYpscratch 2023-07-05T19:20:40.961 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T19:20:52.939 INFO:teuthology.orchestra.run.smithi046.stdout:generic/095 11s 2023-07-05T19:20:52.943 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/095 2023-07-05T19:20:52.944 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-07-05T19:20:52.946 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T19:20:52.954 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-05T19:20:52.955 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.rlt8E1h3iVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/096) 2023-07-05T19:20:53.176 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph 2023-07-05T19:20:53.180 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-05T19:20:53.180 INFO:teuthology.orchestra.run.smithi046.stdout:MKFS_OPTIONS -- 172.21.15.46:6789:/scratch 2023-07-05T19:20:53.181 INFO:teuthology.orchestra.run.smithi046.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCbvKVkpp1TIhAAvJTELoeH8wkIFqjtppg17w== -o context=system_u:object_r:root_t:s0 172.21.15.46:6789:/scratch /tmp/tmp.KrMG67MsYpscratch 2023-07-05T19:20:53.181 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T19:20:53.601 INFO:teuthology.orchestra.run.smithi046.stdout:generic/096 [not run] xfs_io fzero failed (old kernel/wrong fs?) 2023-07-05T19:20:53.605 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/096 2023-07-05T19:20:53.605 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/096 2023-07-05T19:20:53.605 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-07-05T19:20:53.607 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T19:20:53.638 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-05T19:20:53.638 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.rlt8E1h3iVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/097) 2023-07-05T19:20:53.847 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph 2023-07-05T19:20:53.851 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-05T19:20:53.852 INFO:teuthology.orchestra.run.smithi046.stdout:MKFS_OPTIONS -- 172.21.15.46:6789:/scratch 2023-07-05T19:20:53.853 INFO:teuthology.orchestra.run.smithi046.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCbvKVkpp1TIhAAvJTELoeH8wkIFqjtppg17w== -o context=system_u:object_r:root_t:s0 172.21.15.46:6789:/scratch /tmp/tmp.KrMG67MsYpscratch 2023-07-05T19:20:53.853 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T19:20:54.672 INFO:teuthology.orchestra.run.smithi046.stdout:generic/097 0s 2023-07-05T19:20:54.677 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/097 2023-07-05T19:20:54.678 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-07-05T19:20:54.679 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T19:20:54.703 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-05T19:20:54.703 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.rlt8E1h3iVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/098) 2023-07-05T19:20:54.911 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph 2023-07-05T19:20:54.915 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-05T19:20:54.916 INFO:teuthology.orchestra.run.smithi046.stdout:MKFS_OPTIONS -- 172.21.15.46:6789:/scratch 2023-07-05T19:20:54.917 INFO:teuthology.orchestra.run.smithi046.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCbvKVkpp1TIhAAvJTELoeH8wkIFqjtppg17w== -o context=system_u:object_r:root_t:s0 172.21.15.46:6789:/scratch /tmp/tmp.KrMG67MsYpscratch 2023-07-05T19:20:54.917 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T19:20:57.113 INFO:teuthology.orchestra.run.smithi046.stdout:generic/098 2s 2023-07-05T19:20:57.118 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/098 2023-07-05T19:20:57.118 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-07-05T19:20:57.120 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T19:20:57.128 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-05T19:20:57.129 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.rlt8E1h3iVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/099) 2023-07-05T19:20:57.346 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph 2023-07-05T19:20:57.350 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-05T19:20:57.351 INFO:teuthology.orchestra.run.smithi046.stdout:MKFS_OPTIONS -- 172.21.15.46:6789:/scratch 2023-07-05T19:20:57.351 INFO:teuthology.orchestra.run.smithi046.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCbvKVkpp1TIhAAvJTELoeH8wkIFqjtppg17w== -o context=system_u:object_r:root_t:s0 172.21.15.46:6789:/scratch /tmp/tmp.KrMG67MsYpscratch 2023-07-05T19:20:57.352 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T19:20:58.268 INFO:teuthology.orchestra.run.smithi046.stdout:generic/099 1s 2023-07-05T19:20:58.273 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/099 2023-07-05T19:20:58.273 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-07-05T19:20:58.275 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T19:20:58.626 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-05T19:20:58.626 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.rlt8E1h3iVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/100) 2023-07-05T19:20:58.901 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph 2023-07-05T19:20:58.905 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-05T19:20:58.905 INFO:teuthology.orchestra.run.smithi046.stdout:MKFS_OPTIONS -- 172.21.15.46:6789:/scratch 2023-07-05T19:20:58.906 INFO:teuthology.orchestra.run.smithi046.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCbvKVkpp1TIhAAvJTELoeH8wkIFqjtppg17w== -o context=system_u:object_r:root_t:s0 172.21.15.46:6789:/scratch /tmp/tmp.KrMG67MsYpscratch 2023-07-05T19:20:58.906 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T19:21:10.606 INFO:teuthology.orchestra.run.smithi046.stdout:generic/100 11s 2023-07-05T19:21:10.610 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/100 2023-07-05T19:21:10.611 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-07-05T19:21:10.613 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T19:21:11.345 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-05T19:21:11.369 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-05T19:21:14.628 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-05T19:21:14.629 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.rlt8E1h3iVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/101) 2023-07-05T19:21:14.900 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph 2023-07-05T19:21:14.904 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-05T19:21:14.904 INFO:teuthology.orchestra.run.smithi046.stdout:MKFS_OPTIONS -- 172.21.15.46:6789:/scratch 2023-07-05T19:21:14.905 INFO:teuthology.orchestra.run.smithi046.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCbvKVkpp1TIhAAvJTELoeH8wkIFqjtppg17w== -o context=system_u:object_r:root_t:s0 172.21.15.46:6789:/scratch /tmp/tmp.KrMG67MsYpscratch 2023-07-05T19:21:14.905 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T19:21:15.245 INFO:teuthology.orchestra.run.smithi046.stdout:generic/101 [not run] require 172.21.15.46:6789:/scratch to be valid block disk 2023-07-05T19:21:15.250 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/101 2023-07-05T19:21:15.250 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/101 2023-07-05T19:21:15.250 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-07-05T19:21:15.252 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T19:21:15.284 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-05T19:21:15.284 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.rlt8E1h3iVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/102) 2023-07-05T19:21:15.522 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph 2023-07-05T19:21:15.526 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-05T19:21:15.526 INFO:teuthology.orchestra.run.smithi046.stdout:MKFS_OPTIONS -- 172.21.15.46:6789:/scratch 2023-07-05T19:21:15.527 INFO:teuthology.orchestra.run.smithi046.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCbvKVkpp1TIhAAvJTELoeH8wkIFqjtppg17w== -o context=system_u:object_r:root_t:s0 172.21.15.46:6789:/scratch /tmp/tmp.KrMG67MsYpscratch 2023-07-05T19:21:15.527 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T19:21:15.861 INFO:teuthology.orchestra.run.smithi046.stdout:generic/102 [not run] Filesystem ceph not supported in _scratch_mkfs_sized 2023-07-05T19:21:15.865 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/102 2023-07-05T19:21:15.865 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/102 2023-07-05T19:21:15.865 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-07-05T19:21:15.867 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T19:21:15.886 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-05T19:21:15.886 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.rlt8E1h3iVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/103) 2023-07-05T19:21:16.104 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph 2023-07-05T19:21:16.108 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-05T19:21:16.109 INFO:teuthology.orchestra.run.smithi046.stdout:MKFS_OPTIONS -- 172.21.15.46:6789:/scratch 2023-07-05T19:21:16.110 INFO:teuthology.orchestra.run.smithi046.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCbvKVkpp1TIhAAvJTELoeH8wkIFqjtppg17w== -o context=system_u:object_r:root_t:s0 172.21.15.46:6789:/scratch /tmp/tmp.KrMG67MsYpscratch 2023-07-05T19:21:16.110 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T19:21:16.479 INFO:teuthology.orchestra.run.smithi046.stdout:generic/103 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-07-05T19:21:16.483 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/103 2023-07-05T19:21:16.484 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/103 2023-07-05T19:21:16.484 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-07-05T19:21:16.485 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T19:21:16.832 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-05T19:21:16.833 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.rlt8E1h3iVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/104) 2023-07-05T19:21:17.071 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph 2023-07-05T19:21:17.075 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-05T19:21:17.076 INFO:teuthology.orchestra.run.smithi046.stdout:MKFS_OPTIONS -- 172.21.15.46:6789:/scratch 2023-07-05T19:21:17.080 INFO:teuthology.orchestra.run.smithi046.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCbvKVkpp1TIhAAvJTELoeH8wkIFqjtppg17w== -o context=system_u:object_r:root_t:s0 172.21.15.46:6789:/scratch /tmp/tmp.KrMG67MsYpscratch 2023-07-05T19:21:17.080 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T19:21:17.445 INFO:teuthology.orchestra.run.smithi046.stdout:generic/104 [not run] require 172.21.15.46:6789:/scratch to be valid block disk 2023-07-05T19:21:17.449 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/104 2023-07-05T19:21:17.450 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/104 2023-07-05T19:21:17.450 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-07-05T19:21:17.452 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T19:21:17.484 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-05T19:21:17.485 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.rlt8E1h3iVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/105) 2023-07-05T19:21:17.708 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph 2023-07-05T19:21:17.712 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-05T19:21:17.712 INFO:teuthology.orchestra.run.smithi046.stdout:MKFS_OPTIONS -- 172.21.15.46:6789:/scratch 2023-07-05T19:21:17.713 INFO:teuthology.orchestra.run.smithi046.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCbvKVkpp1TIhAAvJTELoeH8wkIFqjtppg17w== -o context=system_u:object_r:root_t:s0 172.21.15.46:6789:/scratch /tmp/tmp.KrMG67MsYpscratch 2023-07-05T19:21:17.714 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T19:21:18.721 INFO:teuthology.orchestra.run.smithi046.stdout:generic/105 1s 2023-07-05T19:21:18.728 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/105 2023-07-05T19:21:18.728 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-07-05T19:21:18.736 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T19:21:18.746 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-05T19:21:18.747 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.rlt8E1h3iVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/106) 2023-07-05T19:21:18.973 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph 2023-07-05T19:21:18.977 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-05T19:21:18.978 INFO:teuthology.orchestra.run.smithi046.stdout:MKFS_OPTIONS -- 172.21.15.46:6789:/scratch 2023-07-05T19:21:18.979 INFO:teuthology.orchestra.run.smithi046.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCbvKVkpp1TIhAAvJTELoeH8wkIFqjtppg17w== -o context=system_u:object_r:root_t:s0 172.21.15.46:6789:/scratch /tmp/tmp.KrMG67MsYpscratch 2023-07-05T19:21:18.979 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T19:21:19.342 INFO:teuthology.orchestra.run.smithi046.stdout:generic/106 [not run] require 172.21.15.46:6789:/scratch to be valid block disk 2023-07-05T19:21:19.346 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/106 2023-07-05T19:21:19.346 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/106 2023-07-05T19:21:19.346 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-07-05T19:21:19.348 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T19:21:19.380 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-05T19:21:19.381 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.rlt8E1h3iVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/107) 2023-07-05T19:21:19.598 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph 2023-07-05T19:21:19.602 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-05T19:21:19.602 INFO:teuthology.orchestra.run.smithi046.stdout:MKFS_OPTIONS -- 172.21.15.46:6789:/scratch 2023-07-05T19:21:19.604 INFO:teuthology.orchestra.run.smithi046.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCbvKVkpp1TIhAAvJTELoeH8wkIFqjtppg17w== -o context=system_u:object_r:root_t:s0 172.21.15.46:6789:/scratch /tmp/tmp.KrMG67MsYpscratch 2023-07-05T19:21:19.604 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T19:21:19.962 INFO:teuthology.orchestra.run.smithi046.stdout:generic/107 [not run] require 172.21.15.46:6789:/scratch to be valid block disk 2023-07-05T19:21:19.966 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/107 2023-07-05T19:21:19.966 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/107 2023-07-05T19:21:19.967 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-07-05T19:21:19.968 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T19:21:19.997 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-05T19:21:19.997 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.rlt8E1h3iVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/108) 2023-07-05T19:21:20.219 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph 2023-07-05T19:21:20.223 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-05T19:21:20.223 INFO:teuthology.orchestra.run.smithi046.stdout:MKFS_OPTIONS -- 172.21.15.46:6789:/scratch 2023-07-05T19:21:20.224 INFO:teuthology.orchestra.run.smithi046.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCbvKVkpp1TIhAAvJTELoeH8wkIFqjtppg17w== -o context=system_u:object_r:root_t:s0 172.21.15.46:6789:/scratch /tmp/tmp.KrMG67MsYpscratch 2023-07-05T19:21:20.224 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T19:21:20.664 INFO:teuthology.orchestra.run.smithi046.stdout:generic/108 [not run] require 172.21.15.46:6789:/scratch to be valid block disk 2023-07-05T19:21:20.668 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/108 2023-07-05T19:21:20.668 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/108 2023-07-05T19:21:20.668 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-07-05T19:21:20.670 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T19:21:20.693 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-05T19:21:20.694 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.rlt8E1h3iVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/109) 2023-07-05T19:21:20.913 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph 2023-07-05T19:21:20.917 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-05T19:21:20.917 INFO:teuthology.orchestra.run.smithi046.stdout:MKFS_OPTIONS -- 172.21.15.46:6789:/scratch 2023-07-05T19:21:20.918 INFO:teuthology.orchestra.run.smithi046.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCbvKVkpp1TIhAAvJTELoeH8wkIFqjtppg17w== -o context=system_u:object_r:root_t:s0 172.21.15.46:6789:/scratch /tmp/tmp.KrMG67MsYpscratch 2023-07-05T19:21:20.918 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T19:21:31.677 INFO:teuthology.orchestra.run.smithi046.stdout:generic/109 10s 2023-07-05T19:21:31.689 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/109 2023-07-05T19:21:31.689 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-07-05T19:21:31.691 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T19:21:31.701 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-05T19:21:31.701 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.rlt8E1h3iVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/110) 2023-07-05T19:21:32.643 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph 2023-07-05T19:21:32.647 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-05T19:21:32.648 INFO:teuthology.orchestra.run.smithi046.stdout:MKFS_OPTIONS -- 172.21.15.46:6789:/scratch 2023-07-05T19:21:32.649 INFO:teuthology.orchestra.run.smithi046.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCbvKVkpp1TIhAAvJTELoeH8wkIFqjtppg17w== -o context=system_u:object_r:root_t:s0 172.21.15.46:6789:/scratch /tmp/tmp.KrMG67MsYpscratch 2023-07-05T19:21:32.649 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T19:21:42.024 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-05T19:21:42.033 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-05T19:21:54.107 INFO:teuthology.orchestra.run.smithi046.stdout:generic/110 [not run] Reflink not supported by test filesystem type: ceph 2023-07-05T19:21:54.116 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/110 2023-07-05T19:21:54.116 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/110 2023-07-05T19:21:54.116 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-07-05T19:21:54.120 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T19:21:54.521 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-05T19:21:54.522 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.rlt8E1h3iVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/111) 2023-07-05T19:21:54.746 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph 2023-07-05T19:21:54.750 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-05T19:21:54.751 INFO:teuthology.orchestra.run.smithi046.stdout:MKFS_OPTIONS -- 172.21.15.46:6789:/scratch 2023-07-05T19:21:54.752 INFO:teuthology.orchestra.run.smithi046.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCbvKVkpp1TIhAAvJTELoeH8wkIFqjtppg17w== -o context=system_u:object_r:root_t:s0 172.21.15.46:6789:/scratch /tmp/tmp.KrMG67MsYpscratch 2023-07-05T19:21:54.752 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T19:21:55.122 INFO:teuthology.orchestra.run.smithi046.stdout:generic/111 [not run] Reflink not supported by test filesystem type: ceph 2023-07-05T19:21:55.126 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/111 2023-07-05T19:21:55.127 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/111 2023-07-05T19:21:55.127 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-07-05T19:21:55.128 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T19:21:55.363 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-05T19:21:55.364 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.rlt8E1h3iVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/112) 2023-07-05T19:21:55.715 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph 2023-07-05T19:21:55.719 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-05T19:21:55.719 INFO:teuthology.orchestra.run.smithi046.stdout:MKFS_OPTIONS -- 172.21.15.46:6789:/scratch 2023-07-05T19:21:55.720 INFO:teuthology.orchestra.run.smithi046.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCbvKVkpp1TIhAAvJTELoeH8wkIFqjtppg17w== -o context=system_u:object_r:root_t:s0 172.21.15.46:6789:/scratch /tmp/tmp.KrMG67MsYpscratch 2023-07-05T19:21:55.721 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T19:22:11.796 INFO:teuthology.orchestra.run.smithi046.stdout:generic/112 16s 2023-07-05T19:22:11.801 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/112 2023-07-05T19:22:11.801 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-07-05T19:22:11.803 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T19:22:12.025 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-05T19:22:12.025 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.rlt8E1h3iVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/113) 2023-07-05T19:22:12.321 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-05T19:22:12.325 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-05T19:22:12.406 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph 2023-07-05T19:22:12.410 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-05T19:22:12.411 INFO:teuthology.orchestra.run.smithi046.stdout:MKFS_OPTIONS -- 172.21.15.46:6789:/scratch 2023-07-05T19:22:12.411 INFO:teuthology.orchestra.run.smithi046.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCbvKVkpp1TIhAAvJTELoeH8wkIFqjtppg17w== -o context=system_u:object_r:root_t:s0 172.21.15.46:6789:/scratch /tmp/tmp.KrMG67MsYpscratch 2023-07-05T19:22:12.412 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T19:22:26.005 INFO:teuthology.orchestra.run.smithi046.stdout:generic/113 14s 2023-07-05T19:22:26.010 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/113 2023-07-05T19:22:26.010 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-07-05T19:22:26.012 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T19:22:26.335 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-05T19:22:26.336 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.rlt8E1h3iVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/114) 2023-07-05T19:22:26.604 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph 2023-07-05T19:22:26.608 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-05T19:22:26.609 INFO:teuthology.orchestra.run.smithi046.stdout:MKFS_OPTIONS -- 172.21.15.46:6789:/scratch 2023-07-05T19:22:26.609 INFO:teuthology.orchestra.run.smithi046.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCbvKVkpp1TIhAAvJTELoeH8wkIFqjtppg17w== -o context=system_u:object_r:root_t:s0 172.21.15.46:6789:/scratch /tmp/tmp.KrMG67MsYpscratch 2023-07-05T19:22:26.609 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T19:22:27.166 INFO:teuthology.orchestra.run.smithi046.stdout:generic/114 [not run] device block size: 4096 greater than 512 2023-07-05T19:22:27.170 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/114 2023-07-05T19:22:27.171 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/114 2023-07-05T19:22:27.171 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-07-05T19:22:27.172 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T19:22:27.208 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-05T19:22:27.209 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.rlt8E1h3iVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/115) 2023-07-05T19:22:27.435 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph 2023-07-05T19:22:27.439 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-05T19:22:27.440 INFO:teuthology.orchestra.run.smithi046.stdout:MKFS_OPTIONS -- 172.21.15.46:6789:/scratch 2023-07-05T19:22:27.441 INFO:teuthology.orchestra.run.smithi046.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCbvKVkpp1TIhAAvJTELoeH8wkIFqjtppg17w== -o context=system_u:object_r:root_t:s0 172.21.15.46:6789:/scratch /tmp/tmp.KrMG67MsYpscratch 2023-07-05T19:22:27.441 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T19:22:27.798 INFO:teuthology.orchestra.run.smithi046.stdout:generic/115 [not run] Reflink not supported by test filesystem type: ceph 2023-07-05T19:22:27.802 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/115 2023-07-05T19:22:27.802 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/115 2023-07-05T19:22:27.802 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-07-05T19:22:27.804 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T19:22:28.134 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-05T19:22:28.134 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.rlt8E1h3iVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/116) 2023-07-05T19:22:28.399 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph 2023-07-05T19:22:28.403 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-05T19:22:28.404 INFO:teuthology.orchestra.run.smithi046.stdout:MKFS_OPTIONS -- 172.21.15.46:6789:/scratch 2023-07-05T19:22:28.404 INFO:teuthology.orchestra.run.smithi046.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCbvKVkpp1TIhAAvJTELoeH8wkIFqjtppg17w== -o context=system_u:object_r:root_t:s0 172.21.15.46:6789:/scratch /tmp/tmp.KrMG67MsYpscratch 2023-07-05T19:22:28.405 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T19:22:28.776 INFO:teuthology.orchestra.run.smithi046.stdout:generic/116 [not run] Reflink not supported by test filesystem type: ceph 2023-07-05T19:22:28.780 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/116 2023-07-05T19:22:28.780 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/116 2023-07-05T19:22:28.780 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-07-05T19:22:28.782 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T19:22:29.004 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-05T19:22:29.005 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.rlt8E1h3iVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/117) 2023-07-05T19:22:29.366 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph 2023-07-05T19:22:29.370 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-05T19:22:29.370 INFO:teuthology.orchestra.run.smithi046.stdout:MKFS_OPTIONS -- 172.21.15.46:6789:/scratch 2023-07-05T19:22:29.371 INFO:teuthology.orchestra.run.smithi046.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCbvKVkpp1TIhAAvJTELoeH8wkIFqjtppg17w== -o context=system_u:object_r:root_t:s0 172.21.15.46:6789:/scratch /tmp/tmp.KrMG67MsYpscratch 2023-07-05T19:22:29.372 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T19:22:40.149 INFO:teuthology.orchestra.run.smithi046.stdout:generic/117 11s 2023-07-05T19:22:40.149 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/117 2023-07-05T19:22:40.149 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-07-05T19:22:40.150 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T19:22:40.160 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-05T19:22:40.161 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.rlt8E1h3iVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/118) 2023-07-05T19:22:40.384 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph 2023-07-05T19:22:40.388 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-05T19:22:40.389 INFO:teuthology.orchestra.run.smithi046.stdout:MKFS_OPTIONS -- 172.21.15.46:6789:/scratch 2023-07-05T19:22:40.390 INFO:teuthology.orchestra.run.smithi046.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCbvKVkpp1TIhAAvJTELoeH8wkIFqjtppg17w== -o context=system_u:object_r:root_t:s0 172.21.15.46:6789:/scratch /tmp/tmp.KrMG67MsYpscratch 2023-07-05T19:22:40.390 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T19:22:41.210 INFO:teuthology.orchestra.run.smithi046.stdout:generic/118 [not run] Reflink not supported by test filesystem type: ceph 2023-07-05T19:22:41.214 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/118 2023-07-05T19:22:41.214 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/118 2023-07-05T19:22:41.214 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-07-05T19:22:41.216 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T19:22:41.328 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-05T19:22:41.329 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.rlt8E1h3iVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/119) 2023-07-05T19:22:41.782 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph 2023-07-05T19:22:41.786 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-05T19:22:41.787 INFO:teuthology.orchestra.run.smithi046.stdout:MKFS_OPTIONS -- 172.21.15.46:6789:/scratch 2023-07-05T19:22:41.787 INFO:teuthology.orchestra.run.smithi046.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCbvKVkpp1TIhAAvJTELoeH8wkIFqjtppg17w== -o context=system_u:object_r:root_t:s0 172.21.15.46:6789:/scratch /tmp/tmp.KrMG67MsYpscratch 2023-07-05T19:22:41.787 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T19:22:42.118 INFO:teuthology.orchestra.run.smithi046.stdout:generic/119 [not run] Reflink not supported by test filesystem type: ceph 2023-07-05T19:22:42.122 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/119 2023-07-05T19:22:42.122 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/119 2023-07-05T19:22:42.123 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-07-05T19:22:42.124 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T19:22:42.347 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-05T19:22:42.347 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.rlt8E1h3iVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/120) 2023-07-05T19:22:42.427 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-05T19:22:42.450 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-05T19:22:42.675 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph 2023-07-05T19:22:42.679 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-05T19:22:42.680 INFO:teuthology.orchestra.run.smithi046.stdout:MKFS_OPTIONS -- 172.21.15.46:6789:/scratch 2023-07-05T19:22:42.681 INFO:teuthology.orchestra.run.smithi046.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCbvKVkpp1TIhAAvJTELoeH8wkIFqjtppg17w== -o context=system_u:object_r:root_t:s0 172.21.15.46:6789:/scratch /tmp/tmp.KrMG67MsYpscratch 2023-07-05T19:22:42.681 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T19:22:42.992 INFO:teuthology.orchestra.run.smithi046.stdout:generic/120 [not run] atime not maintained by ceph 2023-07-05T19:22:42.996 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/120 2023-07-05T19:22:42.996 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/120 2023-07-05T19:22:42.996 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-07-05T19:22:42.998 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T19:22:43.028 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-05T19:22:43.029 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.rlt8E1h3iVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/121) 2023-07-05T19:22:43.237 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph 2023-07-05T19:22:43.242 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-05T19:22:43.242 INFO:teuthology.orchestra.run.smithi046.stdout:MKFS_OPTIONS -- 172.21.15.46:6789:/scratch 2023-07-05T19:22:43.243 INFO:teuthology.orchestra.run.smithi046.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCbvKVkpp1TIhAAvJTELoeH8wkIFqjtppg17w== -o context=system_u:object_r:root_t:s0 172.21.15.46:6789:/scratch /tmp/tmp.KrMG67MsYpscratch 2023-07-05T19:22:43.243 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T19:22:43.573 INFO:teuthology.orchestra.run.smithi046.stdout:generic/121 [not run] Dedupe not supported by test filesystem type: ceph 2023-07-05T19:22:43.577 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/121 2023-07-05T19:22:43.577 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/121 2023-07-05T19:22:43.577 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-07-05T19:22:43.579 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T19:22:43.930 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-05T19:22:43.931 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.rlt8E1h3iVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/122) 2023-07-05T19:22:44.148 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph 2023-07-05T19:22:44.151 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-05T19:22:44.152 INFO:teuthology.orchestra.run.smithi046.stdout:MKFS_OPTIONS -- 172.21.15.46:6789:/scratch 2023-07-05T19:22:44.153 INFO:teuthology.orchestra.run.smithi046.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCbvKVkpp1TIhAAvJTELoeH8wkIFqjtppg17w== -o context=system_u:object_r:root_t:s0 172.21.15.46:6789:/scratch /tmp/tmp.KrMG67MsYpscratch 2023-07-05T19:22:44.153 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T19:22:44.507 INFO:teuthology.orchestra.run.smithi046.stdout:generic/122 [not run] Dedupe not supported by test filesystem type: ceph 2023-07-05T19:22:44.511 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/122 2023-07-05T19:22:44.511 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/122 2023-07-05T19:22:44.511 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-07-05T19:22:44.513 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T19:22:44.885 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-05T19:22:44.885 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.rlt8E1h3iVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/123) 2023-07-05T19:22:45.129 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph 2023-07-05T19:22:45.132 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-05T19:22:45.133 INFO:teuthology.orchestra.run.smithi046.stdout:MKFS_OPTIONS -- 172.21.15.46:6789:/scratch 2023-07-05T19:22:45.134 INFO:teuthology.orchestra.run.smithi046.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCbvKVkpp1TIhAAvJTELoeH8wkIFqjtppg17w== -o context=system_u:object_r:root_t:s0 172.21.15.46:6789:/scratch /tmp/tmp.KrMG67MsYpscratch 2023-07-05T19:22:45.134 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T19:22:45.625 INFO:teuthology.orchestra.run.smithi046.stdout:generic/123 0s 2023-07-05T19:22:45.629 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/123 2023-07-05T19:22:45.630 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-07-05T19:22:45.631 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T19:22:45.958 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-05T19:22:45.959 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.rlt8E1h3iVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/124) 2023-07-05T19:22:46.207 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph 2023-07-05T19:22:46.211 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-05T19:22:46.211 INFO:teuthology.orchestra.run.smithi046.stdout:MKFS_OPTIONS -- 172.21.15.46:6789:/scratch 2023-07-05T19:22:46.212 INFO:teuthology.orchestra.run.smithi046.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCbvKVkpp1TIhAAvJTELoeH8wkIFqjtppg17w== -o context=system_u:object_r:root_t:s0 172.21.15.46:6789:/scratch /tmp/tmp.KrMG67MsYpscratch 2023-07-05T19:22:46.212 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T19:22:48.514 INFO:teuthology.orchestra.run.smithi046.stdout:generic/124 2s 2023-07-05T19:22:48.535 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/124 2023-07-05T19:22:48.535 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-07-05T19:22:48.537 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T19:22:49.037 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-05T19:22:49.037 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.rlt8E1h3iVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/125) 2023-07-05T19:22:49.408 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph 2023-07-05T19:22:49.410 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-05T19:22:49.410 INFO:teuthology.orchestra.run.smithi046.stdout:MKFS_OPTIONS -- 172.21.15.46:6789:/scratch 2023-07-05T19:22:49.411 INFO:teuthology.orchestra.run.smithi046.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCbvKVkpp1TIhAAvJTELoeH8wkIFqjtppg17w== -o context=system_u:object_r:root_t:s0 172.21.15.46:6789:/scratch /tmp/tmp.KrMG67MsYpscratch 2023-07-05T19:22:49.412 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T19:23:12.617 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-05T19:23:12.620 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-05T19:23:42.690 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-05T19:23:42.693 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-05T19:23:50.906 INFO:teuthology.orchestra.run.smithi046.stdout:generic/125 61s 2023-07-05T19:23:50.911 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/125 2023-07-05T19:23:50.912 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-07-05T19:23:50.914 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T19:23:51.209 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-05T19:23:51.210 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.rlt8E1h3iVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/126) 2023-07-05T19:23:51.477 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph 2023-07-05T19:23:51.481 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-05T19:23:51.482 INFO:teuthology.orchestra.run.smithi046.stdout:MKFS_OPTIONS -- 172.21.15.46:6789:/scratch 2023-07-05T19:23:51.483 INFO:teuthology.orchestra.run.smithi046.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCbvKVkpp1TIhAAvJTELoeH8wkIFqjtppg17w== -o context=system_u:object_r:root_t:s0 172.21.15.46:6789:/scratch /tmp/tmp.KrMG67MsYpscratch 2023-07-05T19:23:51.483 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T19:23:51.952 INFO:teuthology.orchestra.run.smithi046.stdout:generic/126 0s 2023-07-05T19:23:51.956 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/126 2023-07-05T19:23:51.957 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-07-05T19:23:51.959 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T19:23:52.156 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-05T19:23:52.157 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.rlt8E1h3iVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/127) 2023-07-05T19:23:52.543 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph 2023-07-05T19:23:52.547 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-05T19:23:52.548 INFO:teuthology.orchestra.run.smithi046.stdout:MKFS_OPTIONS -- 172.21.15.46:6789:/scratch 2023-07-05T19:23:52.549 INFO:teuthology.orchestra.run.smithi046.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCbvKVkpp1TIhAAvJTELoeH8wkIFqjtppg17w== -o context=system_u:object_r:root_t:s0 172.21.15.46:6789:/scratch /tmp/tmp.KrMG67MsYpscratch 2023-07-05T19:23:52.549 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T19:24:12.769 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-05T19:24:12.772 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-05T19:24:42.959 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-05T19:24:42.962 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-05T19:25:13.017 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-05T19:25:13.020 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-05T19:25:43.081 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-05T19:25:43.084 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-05T19:26:13.163 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-05T19:26:13.165 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-05T19:26:43.227 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-05T19:26:43.229 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-05T19:27:13.650 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-05T19:27:13.653 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-05T19:27:43.714 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-05T19:27:43.716 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-05T19:28:13.782 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-05T19:28:13.784 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-05T19:28:43.995 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-05T19:28:43.998 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-05T19:29:14.076 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-05T19:29:14.078 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-05T19:29:44.365 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-05T19:29:44.369 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-05T19:30:14.446 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-05T19:30:14.448 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-05T19:30:44.510 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-05T19:30:44.512 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-05T19:31:14.573 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-05T19:31:14.575 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-05T19:31:44.636 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-05T19:31:44.639 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-05T19:32:14.697 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-05T19:32:14.699 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-05T19:32:44.752 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-05T19:32:44.754 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-05T19:33:14.863 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-05T19:33:14.865 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-05T19:33:16.129 INFO:teuthology.orchestra.run.smithi046.stdout:generic/127 564s 2023-07-05T19:33:16.134 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/127 2023-07-05T19:33:16.134 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-07-05T19:33:16.136 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T19:33:16.464 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-05T19:33:16.465 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.rlt8E1h3iVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/128) 2023-07-05T19:33:16.717 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph 2023-07-05T19:33:16.721 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-05T19:33:16.722 INFO:teuthology.orchestra.run.smithi046.stdout:MKFS_OPTIONS -- 172.21.15.46:6789:/scratch 2023-07-05T19:33:16.723 INFO:teuthology.orchestra.run.smithi046.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCbvKVkpp1TIhAAvJTELoeH8wkIFqjtppg17w== -o context=system_u:object_r:root_t:s0 172.21.15.46:6789:/scratch /tmp/tmp.KrMG67MsYpscratch 2023-07-05T19:33:16.723 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T19:33:17.761 INFO:teuthology.orchestra.run.smithi046.stdout:generic/128 1s 2023-07-05T19:33:17.766 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/128 2023-07-05T19:33:17.766 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-07-05T19:33:17.768 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T19:33:17.777 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-05T19:33:17.778 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.rlt8E1h3iVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/129) 2023-07-05T19:33:18.006 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph 2023-07-05T19:33:18.010 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-05T19:33:18.011 INFO:teuthology.orchestra.run.smithi046.stdout:MKFS_OPTIONS -- 172.21.15.46:6789:/scratch 2023-07-05T19:33:18.011 INFO:teuthology.orchestra.run.smithi046.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCbvKVkpp1TIhAAvJTELoeH8wkIFqjtppg17w== -o context=system_u:object_r:root_t:s0 172.21.15.46:6789:/scratch /tmp/tmp.KrMG67MsYpscratch 2023-07-05T19:33:18.012 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T19:33:44.960 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-05T19:33:44.963 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-05T19:34:15.082 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-05T19:34:15.091 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-05T19:34:45.532 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-05T19:34:45.543 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-05T19:35:15.635 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-05T19:35:15.654 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-05T19:35:45.737 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-05T19:35:45.764 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-05T19:36:15.923 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-05T19:36:15.927 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-05T19:36:46.038 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-05T19:36:46.052 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-05T19:37:16.158 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-05T19:37:16.161 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-05T19:37:46.269 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-05T19:37:46.298 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-05T19:38:16.704 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-05T19:38:16.726 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-05T19:38:46.848 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-05T19:38:46.885 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-05T19:39:17.808 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-05T19:39:17.850 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-05T19:39:47.984 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-05T19:39:47.986 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-05T19:40:18.152 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-05T19:40:18.155 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-05T19:40:48.406 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-05T19:40:48.412 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-05T19:41:18.621 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-05T19:41:18.662 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-05T19:41:49.221 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-05T19:41:49.224 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-05T19:42:19.448 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-05T19:42:19.450 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-05T19:42:49.786 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-05T19:42:49.791 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-05T19:43:19.958 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-05T19:43:19.972 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-05T19:43:50.358 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-05T19:43:50.402 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-05T19:44:20.577 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-05T19:44:20.582 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-05T19:44:50.739 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-05T19:44:50.757 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-05T19:45:21.197 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-05T19:45:21.222 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-05T19:45:51.370 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-05T19:45:51.372 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-05T19:46:21.661 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-05T19:46:21.692 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-05T19:46:52.136 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-05T19:46:52.138 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-05T19:47:22.283 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-05T19:47:22.306 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-05T19:47:52.652 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-05T19:47:52.664 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-05T19:48:22.872 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-05T19:48:22.875 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-05T19:48:53.334 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-05T19:48:53.338 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-05T19:49:23.540 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-05T19:49:23.551 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-05T19:49:23.721 INFO:tasks.ceph.osd.7.smithi073.stderr:2023-07-05T19:49:23.717+0000 7fe6067a5700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 112713) UID: 0 2023-07-05T19:49:23.729 INFO:tasks.ceph.osd.4.smithi073.stderr:2023-07-05T19:49:23.718+0000 7fb7867e9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 112713) UID: 0 2023-07-05T19:49:23.747 INFO:tasks.ceph.osd.5.smithi073.stderr:2023-07-05T19:49:23.722+0000 7f1dead60700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 112713) UID: 0 2023-07-05T19:49:23.779 INFO:tasks.ceph.osd.6.smithi073.stderr:2023-07-05T19:49:23.761+0000 7f2582084700 -1 Fail to open '/proc/112713/cmdline' error = (2) No such file or directory 2023-07-05T19:49:23.779 INFO:tasks.ceph.osd.6.smithi073.stderr:2023-07-05T19:49:23.774+0000 7f2582084700 -1 received signal: Hangup from (PID: 112713) UID: 0 2023-07-05T19:51:01.909 INFO:tasks.ceph.osd.6.smithi073.stderr:2023-07-05T19:51:01.907+0000 7f2582084700 -1 Fail to open '/proc/112735/cmdline' error = (2) No such file or directory 2023-07-05T19:51:01.909 INFO:tasks.ceph.osd.6.smithi073.stderr:2023-07-05T19:51:01.907+0000 7f2582084700 -1 received signal: Hangup from (PID: 112735) UID: 0 2023-07-05T19:51:01.909 INFO:tasks.ceph.osd.7.smithi073.stderr:2023-07-05T19:51:01.907+0000 7fe6067a5700 -1 Fail to open '/proc/112735/cmdline' error = (2) No such file or directory 2023-07-05T19:51:01.910 INFO:tasks.ceph.osd.7.smithi073.stderr:2023-07-05T19:51:01.907+0000 7fe6067a5700 -1 received signal: Hangup from (PID: 112735) UID: 0 2023-07-05T19:51:01.924 INFO:tasks.ceph.osd.4.smithi073.stderr:2023-07-05T19:51:01.910+0000 7fb7867e9700 -1 Fail to open '/proc/112735/cmdline' error = (2) No such file or directory 2023-07-05T19:51:01.925 INFO:tasks.ceph.osd.4.smithi073.stderr:2023-07-05T19:51:01.910+0000 7fb7867e9700 -1 received signal: Hangup from (PID: 112735) UID: 0 2023-07-05T19:51:01.925 INFO:tasks.ceph.osd.5.smithi073.stderr:2023-07-05T19:51:01.908+0000 7f1dead60700 -1 Fail to open '/proc/112735/cmdline' error = (2) No such file or directory 2023-07-05T19:51:01.925 INFO:tasks.ceph.osd.5.smithi073.stderr:2023-07-05T19:51:01.908+0000 7f1dead60700 -1 received signal: Hangup from (PID: 112735) UID: 0 2023-07-05T19:52:45.734 INFO:teuthology.orchestra.run.smithi046.stdout:generic/129 1167s 2023-07-05T19:52:45.750 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/129 2023-07-05T19:52:45.751 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-07-05T19:52:45.752 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T19:52:45.763 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-05T19:52:45.764 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.rlt8E1h3iVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/130) 2023-07-05T19:52:46.198 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph 2023-07-05T19:52:46.202 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-05T19:52:46.203 INFO:teuthology.orchestra.run.smithi046.stdout:MKFS_OPTIONS -- 172.21.15.46:6789:/scratch 2023-07-05T19:52:46.204 INFO:teuthology.orchestra.run.smithi046.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCbvKVkpp1TIhAAvJTELoeH8wkIFqjtppg17w== -o context=system_u:object_r:root_t:s0 172.21.15.46:6789:/scratch /tmp/tmp.KrMG67MsYpscratch 2023-07-05T19:52:46.204 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T19:52:59.654 INFO:teuthology.orchestra.run.smithi046.stdout:generic/130 13s 2023-07-05T19:52:59.677 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/130 2023-07-05T19:52:59.677 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-07-05T19:52:59.687 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T19:52:59.698 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-05T19:52:59.699 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.rlt8E1h3iVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/131) 2023-07-05T19:53:00.154 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph 2023-07-05T19:53:00.162 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-05T19:53:00.166 INFO:teuthology.orchestra.run.smithi046.stdout:MKFS_OPTIONS -- 172.21.15.46:6789:/scratch 2023-07-05T19:53:00.168 INFO:teuthology.orchestra.run.smithi046.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCbvKVkpp1TIhAAvJTELoeH8wkIFqjtppg17w== -o context=system_u:object_r:root_t:s0 172.21.15.46:6789:/scratch /tmp/tmp.KrMG67MsYpscratch 2023-07-05T19:53:00.169 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T19:53:02.173 INFO:teuthology.orchestra.run.smithi046.stdout:generic/131 2s 2023-07-05T19:53:02.179 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/131 2023-07-05T19:53:02.180 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-07-05T19:53:02.182 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T19:53:02.538 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-05T19:53:02.539 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.rlt8E1h3iVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/132) 2023-07-05T19:53:02.874 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph 2023-07-05T19:53:02.881 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-05T19:53:02.881 INFO:teuthology.orchestra.run.smithi046.stdout:MKFS_OPTIONS -- 172.21.15.46:6789:/scratch 2023-07-05T19:53:02.882 INFO:teuthology.orchestra.run.smithi046.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCbvKVkpp1TIhAAvJTELoeH8wkIFqjtppg17w== -o context=system_u:object_r:root_t:s0 172.21.15.46:6789:/scratch /tmp/tmp.KrMG67MsYpscratch 2023-07-05T19:53:02.883 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T19:53:17.143 INFO:teuthology.orchestra.run.smithi046.stdout:generic/132 14s 2023-07-05T19:53:17.148 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/132 2023-07-05T19:53:17.148 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-07-05T19:53:17.150 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T19:53:17.158 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-05T19:53:17.159 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.rlt8E1h3iVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/133) 2023-07-05T19:53:17.398 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph 2023-07-05T19:53:17.402 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-05T19:53:17.403 INFO:teuthology.orchestra.run.smithi046.stdout:MKFS_OPTIONS -- 172.21.15.46:6789:/scratch 2023-07-05T19:53:17.404 INFO:teuthology.orchestra.run.smithi046.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCbvKVkpp1TIhAAvJTELoeH8wkIFqjtppg17w== -o context=system_u:object_r:root_t:s0 172.21.15.46:6789:/scratch /tmp/tmp.KrMG67MsYpscratch 2023-07-05T19:53:17.404 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T19:53:36.676 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-05T19:53:36.679 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-05T19:53:36.726 INFO:tasks.ceph.osd.1.smithi046.stderr:2023-07-05T19:53:36.724+0000 7f2fc7c11700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 257092) UID: 0 2023-07-05T19:53:36.726 INFO:tasks.ceph.osd.2.smithi046.stderr:2023-07-05T19:53:36.724+0000 7f5a7ef99700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 257092) UID: 0 2023-07-05T19:53:36.727 INFO:tasks.ceph.osd.3.smithi046.stderr:2023-07-05T19:53:36.724+0000 7f1104079700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 257092) UID: 0 2023-07-05T19:53:36.727 INFO:tasks.ceph.osd.0.smithi046.stderr:2023-07-05T19:53:36.724+0000 7f77d1dc1700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 257092) UID: 0 2023-07-05T19:56:02.606 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-05T19:56:02.608 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-05T19:56:32.769 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-05T19:56:32.772 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-05T19:57:02.842 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-05T19:57:02.844 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-05T19:57:29.854 INFO:teuthology.orchestra.run.smithi046.stdout:generic/133 252s 2023-07-05T19:57:29.862 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/133 2023-07-05T19:57:29.862 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-07-05T19:57:29.864 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T19:57:30.155 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-05T19:57:30.155 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.rlt8E1h3iVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/134) 2023-07-05T19:57:30.570 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph 2023-07-05T19:57:30.574 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-05T19:57:30.575 INFO:teuthology.orchestra.run.smithi046.stdout:MKFS_OPTIONS -- 172.21.15.46:6789:/scratch 2023-07-05T19:57:30.576 INFO:teuthology.orchestra.run.smithi046.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCbvKVkpp1TIhAAvJTELoeH8wkIFqjtppg17w== -o context=system_u:object_r:root_t:s0 172.21.15.46:6789:/scratch /tmp/tmp.KrMG67MsYpscratch 2023-07-05T19:57:30.576 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T19:57:31.117 INFO:teuthology.orchestra.run.smithi046.stdout:generic/134 [not run] Reflink not supported by test filesystem type: ceph 2023-07-05T19:57:31.122 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/134 2023-07-05T19:57:31.122 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/134 2023-07-05T19:57:31.122 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-07-05T19:57:31.124 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T19:57:31.330 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-05T19:57:31.331 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.rlt8E1h3iVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/135) 2023-07-05T19:57:31.716 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph 2023-07-05T19:57:31.720 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-05T19:57:31.720 INFO:teuthology.orchestra.run.smithi046.stdout:MKFS_OPTIONS -- 172.21.15.46:6789:/scratch 2023-07-05T19:57:31.721 INFO:teuthology.orchestra.run.smithi046.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCbvKVkpp1TIhAAvJTELoeH8wkIFqjtppg17w== -o context=system_u:object_r:root_t:s0 172.21.15.46:6789:/scratch /tmp/tmp.KrMG67MsYpscratch 2023-07-05T19:57:31.721 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T19:57:32.852 INFO:teuthology.orchestra.run.smithi046.stdout:generic/135 1s 2023-07-05T19:57:32.857 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/135 2023-07-05T19:57:32.857 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-07-05T19:57:32.859 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T19:57:32.867 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-05T19:57:32.868 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.rlt8E1h3iVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/136) 2023-07-05T19:57:32.924 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-05T19:57:32.926 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-05T19:57:32.963 INFO:tasks.ceph.osd.4.smithi073.stderr:2023-07-05T19:57:32.962+0000 7fb7867e9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 113367) UID: 0 2023-07-05T19:57:32.963 INFO:tasks.ceph.osd.6.smithi073.stderr:2023-07-05T19:57:32.962+0000 7f2582084700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 113367) UID: 0 2023-07-05T19:57:32.964 INFO:tasks.ceph.osd.5.smithi073.stderr:2023-07-05T19:57:32.962+0000 7f1dead60700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 113367) UID: 0 2023-07-05T19:57:32.964 INFO:tasks.ceph.osd.7.smithi073.stderr:2023-07-05T19:57:32.962+0000 7fe6067a5700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 113367) UID: 0 2023-07-05T19:57:33.090 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph 2023-07-05T19:57:33.094 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-05T19:57:33.095 INFO:teuthology.orchestra.run.smithi046.stdout:MKFS_OPTIONS -- 172.21.15.46:6789:/scratch 2023-07-05T19:57:33.095 INFO:teuthology.orchestra.run.smithi046.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCbvKVkpp1TIhAAvJTELoeH8wkIFqjtppg17w== -o context=system_u:object_r:root_t:s0 172.21.15.46:6789:/scratch /tmp/tmp.KrMG67MsYpscratch 2023-07-05T19:57:33.096 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T19:57:33.467 INFO:teuthology.orchestra.run.smithi046.stdout:generic/136 [not run] Dedupe not supported by test filesystem type: ceph 2023-07-05T19:57:33.471 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/136 2023-07-05T19:57:33.471 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/136 2023-07-05T19:57:33.471 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-07-05T19:57:33.473 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T19:57:33.811 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-05T19:57:33.812 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.rlt8E1h3iVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/137) 2023-07-05T19:57:34.081 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph 2023-07-05T19:57:34.085 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-05T19:57:34.085 INFO:teuthology.orchestra.run.smithi046.stdout:MKFS_OPTIONS -- 172.21.15.46:6789:/scratch 2023-07-05T19:57:34.086 INFO:teuthology.orchestra.run.smithi046.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCbvKVkpp1TIhAAvJTELoeH8wkIFqjtppg17w== -o context=system_u:object_r:root_t:s0 172.21.15.46:6789:/scratch /tmp/tmp.KrMG67MsYpscratch 2023-07-05T19:57:34.087 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T19:57:34.460 INFO:teuthology.orchestra.run.smithi046.stdout:generic/137 [not run] Reflink not supported by test filesystem type: ceph 2023-07-05T19:57:34.464 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/137 2023-07-05T19:57:34.465 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/137 2023-07-05T19:57:34.465 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-07-05T19:57:34.466 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T19:57:34.821 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-05T19:57:34.821 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.rlt8E1h3iVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/138) 2023-07-05T19:57:35.093 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph 2023-07-05T19:57:35.098 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-05T19:57:35.098 INFO:teuthology.orchestra.run.smithi046.stdout:MKFS_OPTIONS -- 172.21.15.46:6789:/scratch 2023-07-05T19:57:35.099 INFO:teuthology.orchestra.run.smithi046.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCbvKVkpp1TIhAAvJTELoeH8wkIFqjtppg17w== -o context=system_u:object_r:root_t:s0 172.21.15.46:6789:/scratch /tmp/tmp.KrMG67MsYpscratch 2023-07-05T19:57:35.099 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T19:57:35.488 INFO:teuthology.orchestra.run.smithi046.stdout:generic/138 [not run] Reflink not supported by test filesystem type: ceph 2023-07-05T19:57:35.492 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/138 2023-07-05T19:57:35.492 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/138 2023-07-05T19:57:35.492 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-07-05T19:57:35.494 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T19:57:35.852 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-05T19:57:35.853 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.rlt8E1h3iVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/139) 2023-07-05T19:57:36.103 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph 2023-07-05T19:57:36.108 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-05T19:57:36.108 INFO:teuthology.orchestra.run.smithi046.stdout:MKFS_OPTIONS -- 172.21.15.46:6789:/scratch 2023-07-05T19:57:36.109 INFO:teuthology.orchestra.run.smithi046.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCbvKVkpp1TIhAAvJTELoeH8wkIFqjtppg17w== -o context=system_u:object_r:root_t:s0 172.21.15.46:6789:/scratch /tmp/tmp.KrMG67MsYpscratch 2023-07-05T19:57:36.109 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T19:57:36.466 INFO:teuthology.orchestra.run.smithi046.stdout:generic/139 [not run] Reflink not supported by test filesystem type: ceph 2023-07-05T19:57:36.470 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/139 2023-07-05T19:57:36.470 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/139 2023-07-05T19:57:36.470 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-07-05T19:57:36.472 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T19:57:36.855 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-05T19:57:36.855 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.rlt8E1h3iVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/140) 2023-07-05T19:57:37.095 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph 2023-07-05T19:57:37.100 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-05T19:57:37.100 INFO:teuthology.orchestra.run.smithi046.stdout:MKFS_OPTIONS -- 172.21.15.46:6789:/scratch 2023-07-05T19:57:37.101 INFO:teuthology.orchestra.run.smithi046.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCbvKVkpp1TIhAAvJTELoeH8wkIFqjtppg17w== -o context=system_u:object_r:root_t:s0 172.21.15.46:6789:/scratch /tmp/tmp.KrMG67MsYpscratch 2023-07-05T19:57:37.101 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T19:57:37.471 INFO:teuthology.orchestra.run.smithi046.stdout:generic/140 [not run] Reflink not supported by test filesystem type: ceph 2023-07-05T19:57:37.475 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/140 2023-07-05T19:57:37.476 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/140 2023-07-05T19:57:37.476 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-07-05T19:57:37.477 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T19:57:37.734 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-05T19:57:37.735 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.rlt8E1h3iVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/141) 2023-07-05T19:57:38.080 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph 2023-07-05T19:57:38.084 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-05T19:57:38.085 INFO:teuthology.orchestra.run.smithi046.stdout:MKFS_OPTIONS -- 172.21.15.46:6789:/scratch 2023-07-05T19:57:38.086 INFO:teuthology.orchestra.run.smithi046.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCbvKVkpp1TIhAAvJTELoeH8wkIFqjtppg17w== -o context=system_u:object_r:root_t:s0 172.21.15.46:6789:/scratch /tmp/tmp.KrMG67MsYpscratch 2023-07-05T19:57:38.086 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T19:57:38.689 INFO:teuthology.orchestra.run.smithi046.stdout:generic/141 0s 2023-07-05T19:57:38.694 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/141 2023-07-05T19:57:38.694 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-07-05T19:57:38.696 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T19:57:38.704 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-05T19:57:38.705 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.rlt8E1h3iVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/142) 2023-07-05T19:57:38.930 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph 2023-07-05T19:57:38.935 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-05T19:57:38.935 INFO:teuthology.orchestra.run.smithi046.stdout:MKFS_OPTIONS -- 172.21.15.46:6789:/scratch 2023-07-05T19:57:38.936 INFO:teuthology.orchestra.run.smithi046.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCbvKVkpp1TIhAAvJTELoeH8wkIFqjtppg17w== -o context=system_u:object_r:root_t:s0 172.21.15.46:6789:/scratch /tmp/tmp.KrMG67MsYpscratch 2023-07-05T19:57:38.936 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T19:57:39.297 INFO:teuthology.orchestra.run.smithi046.stdout:generic/142 [not run] Reflink not supported by test filesystem type: ceph 2023-07-05T19:57:39.301 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/142 2023-07-05T19:57:39.301 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/142 2023-07-05T19:57:39.302 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-07-05T19:57:39.303 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T19:57:39.594 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-05T19:57:39.594 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.rlt8E1h3iVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/143) 2023-07-05T19:57:39.892 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph 2023-07-05T19:57:39.895 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-05T19:57:39.896 INFO:teuthology.orchestra.run.smithi046.stdout:MKFS_OPTIONS -- 172.21.15.46:6789:/scratch 2023-07-05T19:57:39.897 INFO:teuthology.orchestra.run.smithi046.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCbvKVkpp1TIhAAvJTELoeH8wkIFqjtppg17w== -o context=system_u:object_r:root_t:s0 172.21.15.46:6789:/scratch /tmp/tmp.KrMG67MsYpscratch 2023-07-05T19:57:39.898 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T19:57:40.273 INFO:teuthology.orchestra.run.smithi046.stdout:generic/143 [not run] Reflink not supported by test filesystem type: ceph 2023-07-05T19:57:40.277 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/143 2023-07-05T19:57:40.278 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/143 2023-07-05T19:57:40.278 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-07-05T19:57:40.278 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T19:57:40.553 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-05T19:57:40.554 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.rlt8E1h3iVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/144) 2023-07-05T19:57:40.892 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph 2023-07-05T19:57:40.897 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-05T19:57:40.897 INFO:teuthology.orchestra.run.smithi046.stdout:MKFS_OPTIONS -- 172.21.15.46:6789:/scratch 2023-07-05T19:57:40.898 INFO:teuthology.orchestra.run.smithi046.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCbvKVkpp1TIhAAvJTELoeH8wkIFqjtppg17w== -o context=system_u:object_r:root_t:s0 172.21.15.46:6789:/scratch /tmp/tmp.KrMG67MsYpscratch 2023-07-05T19:57:40.898 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T19:57:41.264 INFO:teuthology.orchestra.run.smithi046.stdout:generic/144 [not run] Reflink not supported by test filesystem type: ceph 2023-07-05T19:57:41.268 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/144 2023-07-05T19:57:41.269 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/144 2023-07-05T19:57:41.269 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-07-05T19:57:41.270 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T19:57:41.619 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-05T19:57:41.619 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.rlt8E1h3iVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/145) 2023-07-05T19:57:41.885 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph 2023-07-05T19:57:41.890 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-05T19:57:41.890 INFO:teuthology.orchestra.run.smithi046.stdout:MKFS_OPTIONS -- 172.21.15.46:6789:/scratch 2023-07-05T19:57:41.891 INFO:teuthology.orchestra.run.smithi046.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCbvKVkpp1TIhAAvJTELoeH8wkIFqjtppg17w== -o context=system_u:object_r:root_t:s0 172.21.15.46:6789:/scratch /tmp/tmp.KrMG67MsYpscratch 2023-07-05T19:57:41.891 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T19:57:42.267 INFO:teuthology.orchestra.run.smithi046.stdout:generic/145 [not run] Reflink not supported by test filesystem type: ceph 2023-07-05T19:57:42.271 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/145 2023-07-05T19:57:42.271 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/145 2023-07-05T19:57:42.271 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-07-05T19:57:42.273 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T19:57:42.401 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-05T19:57:42.401 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.rlt8E1h3iVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/146) 2023-07-05T19:57:42.873 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph 2023-07-05T19:57:42.878 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-05T19:57:42.878 INFO:teuthology.orchestra.run.smithi046.stdout:MKFS_OPTIONS -- 172.21.15.46:6789:/scratch 2023-07-05T19:57:42.878 INFO:teuthology.orchestra.run.smithi046.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCbvKVkpp1TIhAAvJTELoeH8wkIFqjtppg17w== -o context=system_u:object_r:root_t:s0 172.21.15.46:6789:/scratch /tmp/tmp.KrMG67MsYpscratch 2023-07-05T19:57:42.879 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T19:57:43.247 INFO:teuthology.orchestra.run.smithi046.stdout:generic/146 [not run] Reflink not supported by test filesystem type: ceph 2023-07-05T19:57:43.251 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/146 2023-07-05T19:57:43.251 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/146 2023-07-05T19:57:43.251 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-07-05T19:57:43.253 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T19:57:43.398 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-05T19:57:43.399 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.rlt8E1h3iVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/147) 2023-07-05T19:57:43.857 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph 2023-07-05T19:57:43.861 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-05T19:57:43.862 INFO:teuthology.orchestra.run.smithi046.stdout:MKFS_OPTIONS -- 172.21.15.46:6789:/scratch 2023-07-05T19:57:43.863 INFO:teuthology.orchestra.run.smithi046.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCbvKVkpp1TIhAAvJTELoeH8wkIFqjtppg17w== -o context=system_u:object_r:root_t:s0 172.21.15.46:6789:/scratch /tmp/tmp.KrMG67MsYpscratch 2023-07-05T19:57:43.863 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T19:57:44.237 INFO:teuthology.orchestra.run.smithi046.stdout:generic/147 [not run] Reflink not supported by test filesystem type: ceph 2023-07-05T19:57:44.241 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/147 2023-07-05T19:57:44.241 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/147 2023-07-05T19:57:44.241 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-07-05T19:57:44.243 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T19:57:44.584 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-05T19:57:44.584 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.rlt8E1h3iVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/148) 2023-07-05T19:57:44.848 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph 2023-07-05T19:57:44.852 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-05T19:57:44.853 INFO:teuthology.orchestra.run.smithi046.stdout:MKFS_OPTIONS -- 172.21.15.46:6789:/scratch 2023-07-05T19:57:44.853 INFO:teuthology.orchestra.run.smithi046.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCbvKVkpp1TIhAAvJTELoeH8wkIFqjtppg17w== -o context=system_u:object_r:root_t:s0 172.21.15.46:6789:/scratch /tmp/tmp.KrMG67MsYpscratch 2023-07-05T19:57:44.854 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T19:57:45.227 INFO:teuthology.orchestra.run.smithi046.stdout:generic/148 [not run] Reflink not supported by test filesystem type: ceph 2023-07-05T19:57:45.231 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/148 2023-07-05T19:57:45.231 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/148 2023-07-05T19:57:45.231 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-07-05T19:57:45.233 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T19:57:45.600 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-05T19:57:45.601 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.rlt8E1h3iVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/149) 2023-07-05T19:57:45.846 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph 2023-07-05T19:57:45.850 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-05T19:57:45.850 INFO:teuthology.orchestra.run.smithi046.stdout:MKFS_OPTIONS -- 172.21.15.46:6789:/scratch 2023-07-05T19:57:45.851 INFO:teuthology.orchestra.run.smithi046.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCbvKVkpp1TIhAAvJTELoeH8wkIFqjtppg17w== -o context=system_u:object_r:root_t:s0 172.21.15.46:6789:/scratch /tmp/tmp.KrMG67MsYpscratch 2023-07-05T19:57:45.852 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T19:57:46.227 INFO:teuthology.orchestra.run.smithi046.stdout:generic/149 [not run] Reflink not supported by test filesystem type: ceph 2023-07-05T19:57:46.231 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/149 2023-07-05T19:57:46.231 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/149 2023-07-05T19:57:46.232 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-07-05T19:57:46.233 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T19:57:46.543 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-05T19:57:46.544 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.rlt8E1h3iVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/150) 2023-07-05T19:57:46.849 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph 2023-07-05T19:57:46.854 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-05T19:57:46.854 INFO:teuthology.orchestra.run.smithi046.stdout:MKFS_OPTIONS -- 172.21.15.46:6789:/scratch 2023-07-05T19:57:46.855 INFO:teuthology.orchestra.run.smithi046.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCbvKVkpp1TIhAAvJTELoeH8wkIFqjtppg17w== -o context=system_u:object_r:root_t:s0 172.21.15.46:6789:/scratch /tmp/tmp.KrMG67MsYpscratch 2023-07-05T19:57:46.855 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T19:57:47.224 INFO:teuthology.orchestra.run.smithi046.stdout:generic/150 [not run] Reflink not supported by test filesystem type: ceph 2023-07-05T19:57:47.228 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/150 2023-07-05T19:57:47.228 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/150 2023-07-05T19:57:47.228 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-07-05T19:57:47.230 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T19:57:47.596 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-05T19:57:47.596 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.rlt8E1h3iVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/151) 2023-07-05T19:57:47.837 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph 2023-07-05T19:57:47.841 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-05T19:57:47.842 INFO:teuthology.orchestra.run.smithi046.stdout:MKFS_OPTIONS -- 172.21.15.46:6789:/scratch 2023-07-05T19:57:47.843 INFO:teuthology.orchestra.run.smithi046.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCbvKVkpp1TIhAAvJTELoeH8wkIFqjtppg17w== -o context=system_u:object_r:root_t:s0 172.21.15.46:6789:/scratch /tmp/tmp.KrMG67MsYpscratch 2023-07-05T19:57:47.843 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T19:57:48.198 INFO:teuthology.orchestra.run.smithi046.stdout:generic/151 [not run] Reflink not supported by test filesystem type: ceph 2023-07-05T19:57:48.202 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/151 2023-07-05T19:57:48.202 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/151 2023-07-05T19:57:48.202 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-07-05T19:57:48.204 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T19:57:48.570 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-05T19:57:48.570 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.rlt8E1h3iVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/152) 2023-07-05T19:57:48.828 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph 2023-07-05T19:57:48.832 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-05T19:57:48.832 INFO:teuthology.orchestra.run.smithi046.stdout:MKFS_OPTIONS -- 172.21.15.46:6789:/scratch 2023-07-05T19:57:48.833 INFO:teuthology.orchestra.run.smithi046.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCbvKVkpp1TIhAAvJTELoeH8wkIFqjtppg17w== -o context=system_u:object_r:root_t:s0 172.21.15.46:6789:/scratch /tmp/tmp.KrMG67MsYpscratch 2023-07-05T19:57:48.833 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T19:57:49.202 INFO:teuthology.orchestra.run.smithi046.stdout:generic/152 [not run] Reflink not supported by test filesystem type: ceph 2023-07-05T19:57:49.206 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/152 2023-07-05T19:57:49.207 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/152 2023-07-05T19:57:49.207 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-07-05T19:57:49.209 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T19:57:49.522 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-05T19:57:49.522 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.rlt8E1h3iVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/153) 2023-07-05T19:57:49.822 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph 2023-07-05T19:57:49.826 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-05T19:57:49.827 INFO:teuthology.orchestra.run.smithi046.stdout:MKFS_OPTIONS -- 172.21.15.46:6789:/scratch 2023-07-05T19:57:49.828 INFO:teuthology.orchestra.run.smithi046.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCbvKVkpp1TIhAAvJTELoeH8wkIFqjtppg17w== -o context=system_u:object_r:root_t:s0 172.21.15.46:6789:/scratch /tmp/tmp.KrMG67MsYpscratch 2023-07-05T19:57:49.828 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T19:57:50.192 INFO:teuthology.orchestra.run.smithi046.stdout:generic/153 [not run] Reflink not supported by test filesystem type: ceph 2023-07-05T19:57:50.196 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/153 2023-07-05T19:57:50.196 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/153 2023-07-05T19:57:50.197 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-07-05T19:57:50.198 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T19:57:50.552 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-05T19:57:50.552 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.rlt8E1h3iVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/154) 2023-07-05T19:57:50.818 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph 2023-07-05T19:57:50.822 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-05T19:57:50.823 INFO:teuthology.orchestra.run.smithi046.stdout:MKFS_OPTIONS -- 172.21.15.46:6789:/scratch 2023-07-05T19:57:50.824 INFO:teuthology.orchestra.run.smithi046.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCbvKVkpp1TIhAAvJTELoeH8wkIFqjtppg17w== -o context=system_u:object_r:root_t:s0 172.21.15.46:6789:/scratch /tmp/tmp.KrMG67MsYpscratch 2023-07-05T19:57:50.824 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T19:57:51.184 INFO:teuthology.orchestra.run.smithi046.stdout:generic/154 [not run] Reflink not supported by test filesystem type: ceph 2023-07-05T19:57:51.188 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/154 2023-07-05T19:57:51.188 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/154 2023-07-05T19:57:51.188 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-07-05T19:57:51.190 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T19:57:51.401 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-05T19:57:51.402 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.rlt8E1h3iVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/155) 2023-07-05T19:57:51.779 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph 2023-07-05T19:57:51.783 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-05T19:57:51.783 INFO:teuthology.orchestra.run.smithi046.stdout:MKFS_OPTIONS -- 172.21.15.46:6789:/scratch 2023-07-05T19:57:51.784 INFO:teuthology.orchestra.run.smithi046.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCbvKVkpp1TIhAAvJTELoeH8wkIFqjtppg17w== -o context=system_u:object_r:root_t:s0 172.21.15.46:6789:/scratch /tmp/tmp.KrMG67MsYpscratch 2023-07-05T19:57:51.784 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T19:57:52.164 INFO:teuthology.orchestra.run.smithi046.stdout:generic/155 [not run] Reflink not supported by test filesystem type: ceph 2023-07-05T19:57:52.168 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/155 2023-07-05T19:57:52.168 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/155 2023-07-05T19:57:52.168 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-07-05T19:57:52.170 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T19:57:52.513 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-05T19:57:52.514 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.rlt8E1h3iVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/156) 2023-07-05T19:57:52.774 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph 2023-07-05T19:57:52.779 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-05T19:57:52.779 INFO:teuthology.orchestra.run.smithi046.stdout:MKFS_OPTIONS -- 172.21.15.46:6789:/scratch 2023-07-05T19:57:52.780 INFO:teuthology.orchestra.run.smithi046.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCbvKVkpp1TIhAAvJTELoeH8wkIFqjtppg17w== -o context=system_u:object_r:root_t:s0 172.21.15.46:6789:/scratch /tmp/tmp.KrMG67MsYpscratch 2023-07-05T19:57:52.780 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T19:57:53.156 INFO:teuthology.orchestra.run.smithi046.stdout:generic/156 [not run] Reflink not supported by test filesystem type: ceph 2023-07-05T19:57:53.160 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/156 2023-07-05T19:57:53.160 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/156 2023-07-05T19:57:53.160 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-07-05T19:57:53.162 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T19:57:53.522 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-05T19:57:53.523 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.rlt8E1h3iVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/157) 2023-07-05T19:57:53.772 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph 2023-07-05T19:57:53.777 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-05T19:57:53.777 INFO:teuthology.orchestra.run.smithi046.stdout:MKFS_OPTIONS -- 172.21.15.46:6789:/scratch 2023-07-05T19:57:53.778 INFO:teuthology.orchestra.run.smithi046.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCbvKVkpp1TIhAAvJTELoeH8wkIFqjtppg17w== -o context=system_u:object_r:root_t:s0 172.21.15.46:6789:/scratch /tmp/tmp.KrMG67MsYpscratch 2023-07-05T19:57:53.779 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T19:57:54.160 INFO:teuthology.orchestra.run.smithi046.stdout:generic/157 [not run] Reflink not supported by test filesystem type: ceph 2023-07-05T19:57:54.165 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/157 2023-07-05T19:57:54.165 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/157 2023-07-05T19:57:54.165 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-07-05T19:57:54.167 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T19:57:54.479 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-05T19:57:54.480 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.rlt8E1h3iVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/158) 2023-07-05T19:57:54.757 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph 2023-07-05T19:57:54.762 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-05T19:57:54.762 INFO:teuthology.orchestra.run.smithi046.stdout:MKFS_OPTIONS -- 172.21.15.46:6789:/scratch 2023-07-05T19:57:54.763 INFO:teuthology.orchestra.run.smithi046.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCbvKVkpp1TIhAAvJTELoeH8wkIFqjtppg17w== -o context=system_u:object_r:root_t:s0 172.21.15.46:6789:/scratch /tmp/tmp.KrMG67MsYpscratch 2023-07-05T19:57:54.763 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T19:57:55.132 INFO:teuthology.orchestra.run.smithi046.stdout:generic/158 [not run] Dedupe not supported by test filesystem type: ceph 2023-07-05T19:57:55.136 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/158 2023-07-05T19:57:55.136 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/158 2023-07-05T19:57:55.136 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-07-05T19:57:55.138 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T19:57:55.462 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-05T19:57:55.463 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.rlt8E1h3iVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/159) 2023-07-05T19:57:55.745 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph 2023-07-05T19:57:55.749 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-05T19:57:55.750 INFO:teuthology.orchestra.run.smithi046.stdout:MKFS_OPTIONS -- 172.21.15.46:6789:/scratch 2023-07-05T19:57:55.750 INFO:teuthology.orchestra.run.smithi046.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCbvKVkpp1TIhAAvJTELoeH8wkIFqjtppg17w== -o context=system_u:object_r:root_t:s0 172.21.15.46:6789:/scratch /tmp/tmp.KrMG67MsYpscratch 2023-07-05T19:57:55.751 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T19:57:56.226 INFO:teuthology.orchestra.run.smithi046.stdout:generic/159 [not run] file system doesn't support chattr +i 2023-07-05T19:57:56.230 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/159 2023-07-05T19:57:56.230 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/159 2023-07-05T19:57:56.230 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-07-05T19:57:56.232 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T19:57:56.265 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-05T19:57:56.265 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.rlt8E1h3iVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/160) 2023-07-05T19:57:56.488 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph 2023-07-05T19:57:56.492 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-05T19:57:56.493 INFO:teuthology.orchestra.run.smithi046.stdout:MKFS_OPTIONS -- 172.21.15.46:6789:/scratch 2023-07-05T19:57:56.494 INFO:teuthology.orchestra.run.smithi046.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCbvKVkpp1TIhAAvJTELoeH8wkIFqjtppg17w== -o context=system_u:object_r:root_t:s0 172.21.15.46:6789:/scratch /tmp/tmp.KrMG67MsYpscratch 2023-07-05T19:57:56.494 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T19:57:56.873 INFO:teuthology.orchestra.run.smithi046.stdout:generic/160 [not run] file system doesn't support chattr +i 2023-07-05T19:57:56.877 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/160 2023-07-05T19:57:56.877 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/160 2023-07-05T19:57:56.878 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-07-05T19:57:56.879 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T19:57:56.914 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-05T19:57:56.914 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.rlt8E1h3iVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/161) 2023-07-05T19:57:57.155 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph 2023-07-05T19:57:57.159 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-05T19:57:57.160 INFO:teuthology.orchestra.run.smithi046.stdout:MKFS_OPTIONS -- 172.21.15.46:6789:/scratch 2023-07-05T19:57:57.161 INFO:teuthology.orchestra.run.smithi046.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCbvKVkpp1TIhAAvJTELoeH8wkIFqjtppg17w== -o context=system_u:object_r:root_t:s0 172.21.15.46:6789:/scratch /tmp/tmp.KrMG67MsYpscratch 2023-07-05T19:57:57.161 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T19:57:58.016 INFO:teuthology.orchestra.run.smithi046.stdout:generic/161 [not run] Reflink not supported by scratch filesystem type: ceph 2023-07-05T19:57:58.024 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/161 2023-07-05T19:57:58.025 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/161 2023-07-05T19:57:58.025 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-07-05T19:57:58.053 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T19:57:58.120 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-05T19:57:58.121 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.rlt8E1h3iVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/162) 2023-07-05T19:57:58.343 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph 2023-07-05T19:57:58.347 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-05T19:57:58.347 INFO:teuthology.orchestra.run.smithi046.stdout:MKFS_OPTIONS -- 172.21.15.46:6789:/scratch 2023-07-05T19:57:58.348 INFO:teuthology.orchestra.run.smithi046.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCbvKVkpp1TIhAAvJTELoeH8wkIFqjtppg17w== -o context=system_u:object_r:root_t:s0 172.21.15.46:6789:/scratch /tmp/tmp.KrMG67MsYpscratch 2023-07-05T19:57:58.348 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T19:57:58.885 INFO:teuthology.orchestra.run.smithi046.stdout:generic/162 [not run] Dedupe not supported by scratch filesystem type: ceph 2023-07-05T19:57:59.116 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/162 2023-07-05T19:57:59.116 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/162 2023-07-05T19:57:59.117 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-07-05T19:57:59.176 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T19:57:59.294 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-05T19:57:59.294 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.rlt8E1h3iVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/163) 2023-07-05T19:57:59.521 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph 2023-07-05T19:57:59.525 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-05T19:57:59.526 INFO:teuthology.orchestra.run.smithi046.stdout:MKFS_OPTIONS -- 172.21.15.46:6789:/scratch 2023-07-05T19:57:59.527 INFO:teuthology.orchestra.run.smithi046.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCbvKVkpp1TIhAAvJTELoeH8wkIFqjtppg17w== -o context=system_u:object_r:root_t:s0 172.21.15.46:6789:/scratch /tmp/tmp.KrMG67MsYpscratch 2023-07-05T19:57:59.527 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T19:58:00.070 INFO:teuthology.orchestra.run.smithi046.stdout:generic/163 [not run] Dedupe not supported by scratch filesystem type: ceph 2023-07-05T19:58:00.385 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/163 2023-07-05T19:58:00.385 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/163 2023-07-05T19:58:00.385 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-07-05T19:58:00.389 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T19:58:00.537 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-05T19:58:00.538 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.rlt8E1h3iVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/164) 2023-07-05T19:58:00.763 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph 2023-07-05T19:58:00.767 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-05T19:58:00.768 INFO:teuthology.orchestra.run.smithi046.stdout:MKFS_OPTIONS -- 172.21.15.46:6789:/scratch 2023-07-05T19:58:00.769 INFO:teuthology.orchestra.run.smithi046.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCbvKVkpp1TIhAAvJTELoeH8wkIFqjtppg17w== -o context=system_u:object_r:root_t:s0 172.21.15.46:6789:/scratch /tmp/tmp.KrMG67MsYpscratch 2023-07-05T19:58:00.769 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T19:58:01.597 INFO:teuthology.orchestra.run.smithi046.stdout:generic/164 [not run] Reflink not supported by scratch filesystem type: ceph 2023-07-05T19:58:01.608 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/164 2023-07-05T19:58:01.609 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/164 2023-07-05T19:58:01.609 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-07-05T19:58:01.622 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T19:58:01.740 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-05T19:58:01.741 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.rlt8E1h3iVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/165) 2023-07-05T19:58:01.973 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph 2023-07-05T19:58:01.977 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-05T19:58:01.979 INFO:teuthology.orchestra.run.smithi046.stdout:MKFS_OPTIONS -- 172.21.15.46:6789:/scratch 2023-07-05T19:58:01.979 INFO:teuthology.orchestra.run.smithi046.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCbvKVkpp1TIhAAvJTELoeH8wkIFqjtppg17w== -o context=system_u:object_r:root_t:s0 172.21.15.46:6789:/scratch /tmp/tmp.KrMG67MsYpscratch 2023-07-05T19:58:01.979 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T19:58:02.821 INFO:teuthology.orchestra.run.smithi046.stdout:generic/165 [not run] Reflink not supported by scratch filesystem type: ceph 2023-07-05T19:58:02.841 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/165 2023-07-05T19:58:02.842 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/165 2023-07-05T19:58:02.842 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-07-05T19:58:02.845 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T19:58:02.992 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-05T19:58:02.993 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.rlt8E1h3iVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/166) 2023-07-05T19:58:03.228 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph 2023-07-05T19:58:03.233 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-05T19:58:03.233 INFO:teuthology.orchestra.run.smithi046.stdout:MKFS_OPTIONS -- 172.21.15.46:6789:/scratch 2023-07-05T19:58:03.234 INFO:teuthology.orchestra.run.smithi046.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCbvKVkpp1TIhAAvJTELoeH8wkIFqjtppg17w== -o context=system_u:object_r:root_t:s0 172.21.15.46:6789:/scratch /tmp/tmp.KrMG67MsYpscratch 2023-07-05T19:58:03.234 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T19:58:03.954 INFO:teuthology.orchestra.run.smithi046.stdout:generic/166 [not run] Reflink not supported by scratch filesystem type: ceph 2023-07-05T19:58:03.968 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/166 2023-07-05T19:58:03.968 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/166 2023-07-05T19:58:03.968 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-07-05T19:58:04.111 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T19:58:04.187 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-05T19:58:04.187 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.rlt8E1h3iVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/167) 2023-07-05T19:58:04.413 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph 2023-07-05T19:58:04.417 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-05T19:58:04.417 INFO:teuthology.orchestra.run.smithi046.stdout:MKFS_OPTIONS -- 172.21.15.46:6789:/scratch 2023-07-05T19:58:04.418 INFO:teuthology.orchestra.run.smithi046.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCbvKVkpp1TIhAAvJTELoeH8wkIFqjtppg17w== -o context=system_u:object_r:root_t:s0 172.21.15.46:6789:/scratch /tmp/tmp.KrMG67MsYpscratch 2023-07-05T19:58:04.419 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T19:58:05.240 INFO:teuthology.orchestra.run.smithi046.stdout:generic/167 [not run] Reflink not supported by scratch filesystem type: ceph 2023-07-05T19:58:05.322 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/167 2023-07-05T19:58:05.323 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/167 2023-07-05T19:58:05.323 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-07-05T19:58:05.330 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T19:58:05.422 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-05T19:58:05.423 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.rlt8E1h3iVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/168) 2023-07-05T19:58:05.647 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph 2023-07-05T19:58:05.651 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-05T19:58:05.652 INFO:teuthology.orchestra.run.smithi046.stdout:MKFS_OPTIONS -- 172.21.15.46:6789:/scratch 2023-07-05T19:58:05.652 INFO:teuthology.orchestra.run.smithi046.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCbvKVkpp1TIhAAvJTELoeH8wkIFqjtppg17w== -o context=system_u:object_r:root_t:s0 172.21.15.46:6789:/scratch /tmp/tmp.KrMG67MsYpscratch 2023-07-05T19:58:05.652 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T19:58:06.537 INFO:teuthology.orchestra.run.smithi046.stdout:generic/168 [not run] Reflink not supported by scratch filesystem type: ceph 2023-07-05T19:58:06.555 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/168 2023-07-05T19:58:06.555 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/168 2023-07-05T19:58:06.555 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-07-05T19:58:06.560 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T19:58:06.630 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-05T19:58:06.631 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.rlt8E1h3iVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/169) 2023-07-05T19:58:06.859 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph 2023-07-05T19:58:06.863 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-05T19:58:06.864 INFO:teuthology.orchestra.run.smithi046.stdout:MKFS_OPTIONS -- 172.21.15.46:6789:/scratch 2023-07-05T19:58:06.864 INFO:teuthology.orchestra.run.smithi046.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCbvKVkpp1TIhAAvJTELoeH8wkIFqjtppg17w== -o context=system_u:object_r:root_t:s0 172.21.15.46:6789:/scratch /tmp/tmp.KrMG67MsYpscratch 2023-07-05T19:58:06.865 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T19:58:07.705 INFO:teuthology.orchestra.run.smithi046.stdout:generic/169 0s 2023-07-05T19:58:07.710 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/169 2023-07-05T19:58:07.710 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-07-05T19:58:07.712 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T19:58:07.721 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-05T19:58:07.721 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.rlt8E1h3iVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/170) 2023-07-05T19:58:07.942 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph 2023-07-05T19:58:07.947 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-05T19:58:07.947 INFO:teuthology.orchestra.run.smithi046.stdout:MKFS_OPTIONS -- 172.21.15.46:6789:/scratch 2023-07-05T19:58:07.948 INFO:teuthology.orchestra.run.smithi046.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCbvKVkpp1TIhAAvJTELoeH8wkIFqjtppg17w== -o context=system_u:object_r:root_t:s0 172.21.15.46:6789:/scratch /tmp/tmp.KrMG67MsYpscratch 2023-07-05T19:58:07.948 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T19:58:08.792 INFO:teuthology.orchestra.run.smithi046.stdout:generic/170 [not run] Reflink not supported by scratch filesystem type: ceph 2023-07-05T19:58:08.849 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/170 2023-07-05T19:58:08.849 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/170 2023-07-05T19:58:08.849 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-07-05T19:58:08.854 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T19:58:08.908 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-05T19:58:08.909 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.rlt8E1h3iVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/171) 2023-07-05T19:58:09.130 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph 2023-07-05T19:58:09.134 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-05T19:58:09.134 INFO:teuthology.orchestra.run.smithi046.stdout:MKFS_OPTIONS -- 172.21.15.46:6789:/scratch 2023-07-05T19:58:09.135 INFO:teuthology.orchestra.run.smithi046.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCbvKVkpp1TIhAAvJTELoeH8wkIFqjtppg17w== -o context=system_u:object_r:root_t:s0 172.21.15.46:6789:/scratch /tmp/tmp.KrMG67MsYpscratch 2023-07-05T19:58:09.135 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T19:58:10.086 INFO:teuthology.orchestra.run.smithi046.stdout:generic/171 [not run] Reflink not supported by scratch filesystem type: ceph 2023-07-05T19:58:10.093 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/171 2023-07-05T19:58:10.093 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/171 2023-07-05T19:58:10.093 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-07-05T19:58:10.095 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T19:58:10.139 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-05T19:58:10.140 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.rlt8E1h3iVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/172) 2023-07-05T19:58:10.362 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph 2023-07-05T19:58:10.366 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-05T19:58:10.366 INFO:teuthology.orchestra.run.smithi046.stdout:MKFS_OPTIONS -- 172.21.15.46:6789:/scratch 2023-07-05T19:58:10.367 INFO:teuthology.orchestra.run.smithi046.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCbvKVkpp1TIhAAvJTELoeH8wkIFqjtppg17w== -o context=system_u:object_r:root_t:s0 172.21.15.46:6789:/scratch /tmp/tmp.KrMG67MsYpscratch 2023-07-05T19:58:10.367 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T19:58:11.247 INFO:teuthology.orchestra.run.smithi046.stdout:generic/172 [not run] Reflink not supported by scratch filesystem type: ceph 2023-07-05T19:58:11.259 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/172 2023-07-05T19:58:11.259 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/172 2023-07-05T19:58:11.259 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-07-05T19:58:11.272 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T19:58:11.337 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-05T19:58:11.337 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.rlt8E1h3iVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/173) 2023-07-05T19:58:11.562 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph 2023-07-05T19:58:11.566 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-05T19:58:11.566 INFO:teuthology.orchestra.run.smithi046.stdout:MKFS_OPTIONS -- 172.21.15.46:6789:/scratch 2023-07-05T19:58:11.567 INFO:teuthology.orchestra.run.smithi046.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCbvKVkpp1TIhAAvJTELoeH8wkIFqjtppg17w== -o context=system_u:object_r:root_t:s0 172.21.15.46:6789:/scratch /tmp/tmp.KrMG67MsYpscratch 2023-07-05T19:58:11.568 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T19:58:12.470 INFO:teuthology.orchestra.run.smithi046.stdout:generic/173 [not run] Reflink not supported by scratch filesystem type: ceph 2023-07-05T19:58:12.486 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/173 2023-07-05T19:58:12.486 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/173 2023-07-05T19:58:12.486 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-07-05T19:58:12.488 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T19:58:12.535 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-05T19:58:12.536 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.rlt8E1h3iVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/174) 2023-07-05T19:58:12.758 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph 2023-07-05T19:58:12.762 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-05T19:58:12.763 INFO:teuthology.orchestra.run.smithi046.stdout:MKFS_OPTIONS -- 172.21.15.46:6789:/scratch 2023-07-05T19:58:12.764 INFO:teuthology.orchestra.run.smithi046.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCbvKVkpp1TIhAAvJTELoeH8wkIFqjtppg17w== -o context=system_u:object_r:root_t:s0 172.21.15.46:6789:/scratch /tmp/tmp.KrMG67MsYpscratch 2023-07-05T19:58:12.764 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T19:58:13.636 INFO:teuthology.orchestra.run.smithi046.stdout:generic/174 [not run] Reflink not supported by scratch filesystem type: ceph 2023-07-05T19:58:13.643 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/174 2023-07-05T19:58:13.643 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/174 2023-07-05T19:58:13.643 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-07-05T19:58:13.672 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T19:58:13.766 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-05T19:58:13.767 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.rlt8E1h3iVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/175) 2023-07-05T19:58:13.992 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph 2023-07-05T19:58:13.996 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-05T19:58:13.997 INFO:teuthology.orchestra.run.smithi046.stdout:MKFS_OPTIONS -- 172.21.15.46:6789:/scratch 2023-07-05T19:58:13.998 INFO:teuthology.orchestra.run.smithi046.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCbvKVkpp1TIhAAvJTELoeH8wkIFqjtppg17w== -o context=system_u:object_r:root_t:s0 172.21.15.46:6789:/scratch /tmp/tmp.KrMG67MsYpscratch 2023-07-05T19:58:13.998 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T19:58:14.914 INFO:teuthology.orchestra.run.smithi046.stdout:generic/175 [not run] Reflink not supported by scratch filesystem type: ceph 2023-07-05T19:58:14.927 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/175 2023-07-05T19:58:14.927 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/175 2023-07-05T19:58:14.927 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-07-05T19:58:14.930 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T19:58:15.044 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-05T19:58:15.044 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.rlt8E1h3iVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/176) 2023-07-05T19:58:15.266 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph 2023-07-05T19:58:15.270 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-05T19:58:15.270 INFO:teuthology.orchestra.run.smithi046.stdout:MKFS_OPTIONS -- 172.21.15.46:6789:/scratch 2023-07-05T19:58:15.271 INFO:teuthology.orchestra.run.smithi046.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCbvKVkpp1TIhAAvJTELoeH8wkIFqjtppg17w== -o context=system_u:object_r:root_t:s0 172.21.15.46:6789:/scratch /tmp/tmp.KrMG67MsYpscratch 2023-07-05T19:58:15.271 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T19:58:16.167 INFO:teuthology.orchestra.run.smithi046.stdout:generic/176 [not run] Reflink not supported by scratch filesystem type: ceph 2023-07-05T19:58:16.181 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/176 2023-07-05T19:58:16.181 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/176 2023-07-05T19:58:16.181 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-07-05T19:58:16.183 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T19:58:16.250 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-05T19:58:16.250 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.rlt8E1h3iVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/177) 2023-07-05T19:58:16.474 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph 2023-07-05T19:58:16.479 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-05T19:58:16.479 INFO:teuthology.orchestra.run.smithi046.stdout:MKFS_OPTIONS -- 172.21.15.46:6789:/scratch 2023-07-05T19:58:16.480 INFO:teuthology.orchestra.run.smithi046.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCbvKVkpp1TIhAAvJTELoeH8wkIFqjtppg17w== -o context=system_u:object_r:root_t:s0 172.21.15.46:6789:/scratch /tmp/tmp.KrMG67MsYpscratch 2023-07-05T19:58:16.480 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T19:58:16.991 INFO:teuthology.orchestra.run.smithi046.stdout:generic/177 [not run] xfs_io fiemap failed (old kernel/wrong fs?) 2023-07-05T19:58:16.995 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/177 2023-07-05T19:58:16.996 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/177 2023-07-05T19:58:16.996 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-07-05T19:58:16.998 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T19:58:17.135 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-05T19:58:17.136 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.rlt8E1h3iVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/178) 2023-07-05T19:58:17.592 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph 2023-07-05T19:58:17.596 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-05T19:58:17.596 INFO:teuthology.orchestra.run.smithi046.stdout:MKFS_OPTIONS -- 172.21.15.46:6789:/scratch 2023-07-05T19:58:17.597 INFO:teuthology.orchestra.run.smithi046.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCbvKVkpp1TIhAAvJTELoeH8wkIFqjtppg17w== -o context=system_u:object_r:root_t:s0 172.21.15.46:6789:/scratch /tmp/tmp.KrMG67MsYpscratch 2023-07-05T19:58:17.598 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T19:58:17.988 INFO:teuthology.orchestra.run.smithi046.stdout:generic/178 [not run] Reflink not supported by test filesystem type: ceph 2023-07-05T19:58:17.992 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/178 2023-07-05T19:58:17.992 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/178 2023-07-05T19:58:17.992 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-07-05T19:58:17.994 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T19:58:18.358 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-05T19:58:18.359 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.rlt8E1h3iVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/179) 2023-07-05T19:58:18.595 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph 2023-07-05T19:58:18.599 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-05T19:58:18.600 INFO:teuthology.orchestra.run.smithi046.stdout:MKFS_OPTIONS -- 172.21.15.46:6789:/scratch 2023-07-05T19:58:18.600 INFO:teuthology.orchestra.run.smithi046.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCbvKVkpp1TIhAAvJTELoeH8wkIFqjtppg17w== -o context=system_u:object_r:root_t:s0 172.21.15.46:6789:/scratch /tmp/tmp.KrMG67MsYpscratch 2023-07-05T19:58:18.601 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T19:58:18.969 INFO:teuthology.orchestra.run.smithi046.stdout:generic/179 [not run] Reflink not supported by test filesystem type: ceph 2023-07-05T19:58:18.972 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/179 2023-07-05T19:58:18.973 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/179 2023-07-05T19:58:18.973 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-07-05T19:58:18.975 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T19:58:19.206 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-05T19:58:19.207 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.rlt8E1h3iVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/180) 2023-07-05T19:58:19.582 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph 2023-07-05T19:58:19.586 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-05T19:58:19.586 INFO:teuthology.orchestra.run.smithi046.stdout:MKFS_OPTIONS -- 172.21.15.46:6789:/scratch 2023-07-05T19:58:19.587 INFO:teuthology.orchestra.run.smithi046.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCbvKVkpp1TIhAAvJTELoeH8wkIFqjtppg17w== -o context=system_u:object_r:root_t:s0 172.21.15.46:6789:/scratch /tmp/tmp.KrMG67MsYpscratch 2023-07-05T19:58:19.587 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T19:58:19.967 INFO:teuthology.orchestra.run.smithi046.stdout:generic/180 [not run] Reflink not supported by test filesystem type: ceph 2023-07-05T19:58:19.971 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/180 2023-07-05T19:58:19.972 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/180 2023-07-05T19:58:19.972 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-07-05T19:58:19.973 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T19:58:20.144 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-05T19:58:20.145 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.rlt8E1h3iVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/181) 2023-07-05T19:58:20.575 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph 2023-07-05T19:58:20.579 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-05T19:58:20.579 INFO:teuthology.orchestra.run.smithi046.stdout:MKFS_OPTIONS -- 172.21.15.46:6789:/scratch 2023-07-05T19:58:20.580 INFO:teuthology.orchestra.run.smithi046.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCbvKVkpp1TIhAAvJTELoeH8wkIFqjtppg17w== -o context=system_u:object_r:root_t:s0 172.21.15.46:6789:/scratch /tmp/tmp.KrMG67MsYpscratch 2023-07-05T19:58:20.581 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T19:58:20.951 INFO:teuthology.orchestra.run.smithi046.stdout:generic/181 [not run] Reflink not supported by test filesystem type: ceph 2023-07-05T19:58:20.955 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/181 2023-07-05T19:58:20.955 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/181 2023-07-05T19:58:20.955 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-07-05T19:58:20.957 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T19:58:21.220 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-05T19:58:21.220 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.rlt8E1h3iVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/182) 2023-07-05T19:58:21.559 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph 2023-07-05T19:58:21.563 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-05T19:58:21.564 INFO:teuthology.orchestra.run.smithi046.stdout:MKFS_OPTIONS -- 172.21.15.46:6789:/scratch 2023-07-05T19:58:21.565 INFO:teuthology.orchestra.run.smithi046.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCbvKVkpp1TIhAAvJTELoeH8wkIFqjtppg17w== -o context=system_u:object_r:root_t:s0 172.21.15.46:6789:/scratch /tmp/tmp.KrMG67MsYpscratch 2023-07-05T19:58:21.565 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T19:58:21.943 INFO:teuthology.orchestra.run.smithi046.stdout:generic/182 [not run] Dedupe not supported by test filesystem type: ceph 2023-07-05T19:58:21.947 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/182 2023-07-05T19:58:21.947 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/182 2023-07-05T19:58:21.947 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-07-05T19:58:21.949 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T19:58:22.025 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-05T19:58:22.025 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.rlt8E1h3iVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/183) 2023-07-05T19:58:22.548 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph 2023-07-05T19:58:22.552 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-05T19:58:22.553 INFO:teuthology.orchestra.run.smithi046.stdout:MKFS_OPTIONS -- 172.21.15.46:6789:/scratch 2023-07-05T19:58:22.553 INFO:teuthology.orchestra.run.smithi046.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCbvKVkpp1TIhAAvJTELoeH8wkIFqjtppg17w== -o context=system_u:object_r:root_t:s0 172.21.15.46:6789:/scratch /tmp/tmp.KrMG67MsYpscratch 2023-07-05T19:58:22.554 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T19:58:23.358 INFO:teuthology.orchestra.run.smithi046.stdout:generic/183 [not run] Reflink not supported by scratch filesystem type: ceph 2023-07-05T19:58:24.876 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/183 2023-07-05T19:58:24.876 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/183 2023-07-05T19:58:24.876 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-07-05T19:58:24.876 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T19:58:24.876 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-05T19:58:24.877 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.rlt8E1h3iVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/184) 2023-07-05T19:58:25.120 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph 2023-07-05T19:58:25.123 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-05T19:58:25.124 INFO:teuthology.orchestra.run.smithi046.stdout:MKFS_OPTIONS -- 172.21.15.46:6789:/scratch 2023-07-05T19:58:25.125 INFO:teuthology.orchestra.run.smithi046.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCbvKVkpp1TIhAAvJTELoeH8wkIFqjtppg17w== -o context=system_u:object_r:root_t:s0 172.21.15.46:6789:/scratch /tmp/tmp.KrMG67MsYpscratch 2023-07-05T19:58:25.125 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T19:58:25.513 INFO:teuthology.orchestra.run.smithi046.stdout:generic/184 0s 2023-07-05T19:58:25.518 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/184 2023-07-05T19:58:25.519 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-07-05T19:58:25.520 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T19:58:25.552 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-05T19:58:25.552 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.rlt8E1h3iVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/185) 2023-07-05T19:58:25.774 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph 2023-07-05T19:58:25.779 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-05T19:58:25.780 INFO:teuthology.orchestra.run.smithi046.stdout:MKFS_OPTIONS -- 172.21.15.46:6789:/scratch 2023-07-05T19:58:25.780 INFO:teuthology.orchestra.run.smithi046.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCbvKVkpp1TIhAAvJTELoeH8wkIFqjtppg17w== -o context=system_u:object_r:root_t:s0 172.21.15.46:6789:/scratch /tmp/tmp.KrMG67MsYpscratch 2023-07-05T19:58:25.781 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T19:58:26.608 INFO:teuthology.orchestra.run.smithi046.stdout:generic/185 [not run] Reflink not supported by scratch filesystem type: ceph 2023-07-05T19:58:26.691 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/185 2023-07-05T19:58:26.691 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/185 2023-07-05T19:58:26.691 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-07-05T19:58:26.694 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T19:58:26.750 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-05T19:58:26.751 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.rlt8E1h3iVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/186) 2023-07-05T19:58:26.976 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph 2023-07-05T19:58:26.980 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-05T19:58:26.980 INFO:teuthology.orchestra.run.smithi046.stdout:MKFS_OPTIONS -- 172.21.15.46:6789:/scratch 2023-07-05T19:58:26.981 INFO:teuthology.orchestra.run.smithi046.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCbvKVkpp1TIhAAvJTELoeH8wkIFqjtppg17w== -o context=system_u:object_r:root_t:s0 172.21.15.46:6789:/scratch /tmp/tmp.KrMG67MsYpscratch 2023-07-05T19:58:26.981 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T19:58:27.873 INFO:teuthology.orchestra.run.smithi046.stdout:generic/186 [not run] Reflink not supported by scratch filesystem type: ceph 2023-07-05T19:58:27.895 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/186 2023-07-05T19:58:27.895 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/186 2023-07-05T19:58:27.895 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-07-05T19:58:27.901 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T19:58:27.942 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-05T19:58:27.942 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.rlt8E1h3iVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/187) 2023-07-05T19:58:28.163 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph 2023-07-05T19:58:28.167 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-05T19:58:28.168 INFO:teuthology.orchestra.run.smithi046.stdout:MKFS_OPTIONS -- 172.21.15.46:6789:/scratch 2023-07-05T19:58:28.169 INFO:teuthology.orchestra.run.smithi046.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCbvKVkpp1TIhAAvJTELoeH8wkIFqjtppg17w== -o context=system_u:object_r:root_t:s0 172.21.15.46:6789:/scratch /tmp/tmp.KrMG67MsYpscratch 2023-07-05T19:58:28.169 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T19:58:28.829 INFO:teuthology.orchestra.run.smithi046.stdout:generic/187 [not run] Reflink not supported by scratch filesystem type: ceph 2023-07-05T19:58:28.836 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/187 2023-07-05T19:58:28.837 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/187 2023-07-05T19:58:28.837 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-07-05T19:58:28.884 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T19:58:29.103 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-05T19:58:29.104 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.rlt8E1h3iVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/188) 2023-07-05T19:58:29.329 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph 2023-07-05T19:58:29.333 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-05T19:58:29.334 INFO:teuthology.orchestra.run.smithi046.stdout:MKFS_OPTIONS -- 172.21.15.46:6789:/scratch 2023-07-05T19:58:29.335 INFO:teuthology.orchestra.run.smithi046.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCbvKVkpp1TIhAAvJTELoeH8wkIFqjtppg17w== -o context=system_u:object_r:root_t:s0 172.21.15.46:6789:/scratch /tmp/tmp.KrMG67MsYpscratch 2023-07-05T19:58:29.335 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T19:58:30.152 INFO:teuthology.orchestra.run.smithi046.stdout:generic/188 [not run] Reflink not supported by scratch filesystem type: ceph 2023-07-05T19:58:30.244 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/188 2023-07-05T19:58:30.244 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/188 2023-07-05T19:58:30.244 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-07-05T19:58:30.257 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T19:58:30.299 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-05T19:58:30.300 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.rlt8E1h3iVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/189) 2023-07-05T19:58:30.532 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph 2023-07-05T19:58:30.537 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-05T19:58:30.537 INFO:teuthology.orchestra.run.smithi046.stdout:MKFS_OPTIONS -- 172.21.15.46:6789:/scratch 2023-07-05T19:58:30.538 INFO:teuthology.orchestra.run.smithi046.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCbvKVkpp1TIhAAvJTELoeH8wkIFqjtppg17w== -o context=system_u:object_r:root_t:s0 172.21.15.46:6789:/scratch /tmp/tmp.KrMG67MsYpscratch 2023-07-05T19:58:30.538 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T19:58:31.314 INFO:teuthology.orchestra.run.smithi046.stdout:generic/189 [not run] Reflink not supported by scratch filesystem type: ceph 2023-07-05T19:58:31.411 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/189 2023-07-05T19:58:31.411 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/189 2023-07-05T19:58:31.414 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-07-05T19:58:31.418 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T19:58:31.483 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-05T19:58:31.483 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.rlt8E1h3iVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/190) 2023-07-05T19:58:31.706 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph 2023-07-05T19:58:31.710 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-05T19:58:31.710 INFO:teuthology.orchestra.run.smithi046.stdout:MKFS_OPTIONS -- 172.21.15.46:6789:/scratch 2023-07-05T19:58:31.711 INFO:teuthology.orchestra.run.smithi046.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCbvKVkpp1TIhAAvJTELoeH8wkIFqjtppg17w== -o context=system_u:object_r:root_t:s0 172.21.15.46:6789:/scratch /tmp/tmp.KrMG67MsYpscratch 2023-07-05T19:58:31.711 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T19:58:32.601 INFO:teuthology.orchestra.run.smithi046.stdout:generic/190 [not run] Reflink not supported by scratch filesystem type: ceph 2023-07-05T19:58:32.619 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/190 2023-07-05T19:58:32.619 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/190 2023-07-05T19:58:32.619 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-07-05T19:58:32.622 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T19:58:32.664 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-05T19:58:32.664 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.rlt8E1h3iVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/191) 2023-07-05T19:58:32.896 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph 2023-07-05T19:58:32.900 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-05T19:58:32.901 INFO:teuthology.orchestra.run.smithi046.stdout:MKFS_OPTIONS -- 172.21.15.46:6789:/scratch 2023-07-05T19:58:32.902 INFO:teuthology.orchestra.run.smithi046.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCbvKVkpp1TIhAAvJTELoeH8wkIFqjtppg17w== -o context=system_u:object_r:root_t:s0 172.21.15.46:6789:/scratch /tmp/tmp.KrMG67MsYpscratch 2023-07-05T19:58:32.902 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T19:58:33.757 INFO:teuthology.orchestra.run.smithi046.stdout:generic/191 [not run] Reflink not supported by scratch filesystem type: ceph 2023-07-05T19:58:33.780 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/191 2023-07-05T19:58:33.780 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/191 2023-07-05T19:58:33.781 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-07-05T19:58:33.824 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T19:58:33.873 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-05T19:58:33.874 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.rlt8E1h3iVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/192) 2023-07-05T19:58:34.114 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph 2023-07-05T19:58:34.118 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-05T19:58:34.119 INFO:teuthology.orchestra.run.smithi046.stdout:MKFS_OPTIONS -- 172.21.15.46:6789:/scratch 2023-07-05T19:58:34.120 INFO:teuthology.orchestra.run.smithi046.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCbvKVkpp1TIhAAvJTELoeH8wkIFqjtppg17w== -o context=system_u:object_r:root_t:s0 172.21.15.46:6789:/scratch /tmp/tmp.KrMG67MsYpscratch 2023-07-05T19:58:34.120 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T19:58:34.466 INFO:teuthology.orchestra.run.smithi046.stdout:generic/192 [not run] atime not maintained by ceph 2023-07-05T19:58:34.470 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/192 2023-07-05T19:58:34.471 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/192 2023-07-05T19:58:34.471 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-07-05T19:58:34.472 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T19:58:34.496 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-05T19:58:34.497 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.rlt8E1h3iVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/193) 2023-07-05T19:58:34.720 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph 2023-07-05T19:58:34.724 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-05T19:58:34.725 INFO:teuthology.orchestra.run.smithi046.stdout:MKFS_OPTIONS -- 172.21.15.46:6789:/scratch 2023-07-05T19:58:34.726 INFO:teuthology.orchestra.run.smithi046.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCbvKVkpp1TIhAAvJTELoeH8wkIFqjtppg17w== -o context=system_u:object_r:root_t:s0 172.21.15.46:6789:/scratch /tmp/tmp.KrMG67MsYpscratch 2023-07-05T19:58:34.726 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T19:58:35.642 INFO:teuthology.orchestra.run.smithi046.stdout:generic/193 1s 2023-07-05T19:58:35.646 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/193 2023-07-05T19:58:35.647 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-07-05T19:58:35.649 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T19:58:36.026 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-05T19:58:36.026 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.rlt8E1h3iVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/194) 2023-07-05T19:58:36.263 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph 2023-07-05T19:58:36.267 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-05T19:58:36.268 INFO:teuthology.orchestra.run.smithi046.stdout:MKFS_OPTIONS -- 172.21.15.46:6789:/scratch 2023-07-05T19:58:36.268 INFO:teuthology.orchestra.run.smithi046.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCbvKVkpp1TIhAAvJTELoeH8wkIFqjtppg17w== -o context=system_u:object_r:root_t:s0 172.21.15.46:6789:/scratch /tmp/tmp.KrMG67MsYpscratch 2023-07-05T19:58:36.269 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T19:58:37.188 INFO:teuthology.orchestra.run.smithi046.stdout:generic/194 [not run] Reflink not supported by scratch filesystem type: ceph 2023-07-05T19:58:37.193 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/194 2023-07-05T19:58:37.194 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/194 2023-07-05T19:58:37.194 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-07-05T19:58:37.201 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T19:58:37.242 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-05T19:58:37.244 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.rlt8E1h3iVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/195) 2023-07-05T19:58:37.467 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph 2023-07-05T19:58:37.471 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-05T19:58:37.472 INFO:teuthology.orchestra.run.smithi046.stdout:MKFS_OPTIONS -- 172.21.15.46:6789:/scratch 2023-07-05T19:58:37.473 INFO:teuthology.orchestra.run.smithi046.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCbvKVkpp1TIhAAvJTELoeH8wkIFqjtppg17w== -o context=system_u:object_r:root_t:s0 172.21.15.46:6789:/scratch /tmp/tmp.KrMG67MsYpscratch 2023-07-05T19:58:37.473 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T19:58:38.261 INFO:teuthology.orchestra.run.smithi046.stdout:generic/195 [not run] Reflink not supported by scratch filesystem type: ceph 2023-07-05T19:58:38.377 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/195 2023-07-05T19:58:38.377 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/195 2023-07-05T19:58:38.378 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-07-05T19:58:38.381 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T19:58:38.419 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-05T19:58:38.420 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.rlt8E1h3iVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/196) 2023-07-05T19:58:38.650 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph 2023-07-05T19:58:38.654 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-05T19:58:38.654 INFO:teuthology.orchestra.run.smithi046.stdout:MKFS_OPTIONS -- 172.21.15.46:6789:/scratch 2023-07-05T19:58:38.655 INFO:teuthology.orchestra.run.smithi046.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCbvKVkpp1TIhAAvJTELoeH8wkIFqjtppg17w== -o context=system_u:object_r:root_t:s0 172.21.15.46:6789:/scratch /tmp/tmp.KrMG67MsYpscratch 2023-07-05T19:58:38.655 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T19:58:39.525 INFO:teuthology.orchestra.run.smithi046.stdout:generic/196 [not run] Reflink not supported by scratch filesystem type: ceph 2023-07-05T19:58:39.570 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/196 2023-07-05T19:58:39.570 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/196 2023-07-05T19:58:39.571 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-07-05T19:58:39.573 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T19:58:39.621 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-05T19:58:39.621 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.rlt8E1h3iVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/197) 2023-07-05T19:58:39.841 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph 2023-07-05T19:58:39.845 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-05T19:58:39.847 INFO:teuthology.orchestra.run.smithi046.stdout:MKFS_OPTIONS -- 172.21.15.46:6789:/scratch 2023-07-05T19:58:39.847 INFO:teuthology.orchestra.run.smithi046.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCbvKVkpp1TIhAAvJTELoeH8wkIFqjtppg17w== -o context=system_u:object_r:root_t:s0 172.21.15.46:6789:/scratch /tmp/tmp.KrMG67MsYpscratch 2023-07-05T19:58:39.847 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T19:58:40.681 INFO:teuthology.orchestra.run.smithi046.stdout:generic/197 [not run] Reflink not supported by scratch filesystem type: ceph 2023-07-05T19:58:40.688 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/197 2023-07-05T19:58:40.689 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/197 2023-07-05T19:58:40.689 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-07-05T19:58:40.693 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T19:58:40.789 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-05T19:58:40.789 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.rlt8E1h3iVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/198) 2023-07-05T19:58:41.031 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph 2023-07-05T19:58:41.036 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-05T19:58:41.036 INFO:teuthology.orchestra.run.smithi046.stdout:MKFS_OPTIONS -- 172.21.15.46:6789:/scratch 2023-07-05T19:58:41.037 INFO:teuthology.orchestra.run.smithi046.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCbvKVkpp1TIhAAvJTELoeH8wkIFqjtppg17w== -o context=system_u:object_r:root_t:s0 172.21.15.46:6789:/scratch /tmp/tmp.KrMG67MsYpscratch 2023-07-05T19:58:41.037 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T19:58:41.763 INFO:teuthology.orchestra.run.smithi046.stdout:generic/198 0s 2023-07-05T19:58:41.768 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/198 2023-07-05T19:58:41.768 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-07-05T19:58:41.770 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T19:58:42.162 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-05T19:58:42.163 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.rlt8E1h3iVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/199) 2023-07-05T19:58:42.392 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph 2023-07-05T19:58:42.396 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-05T19:58:42.397 INFO:teuthology.orchestra.run.smithi046.stdout:MKFS_OPTIONS -- 172.21.15.46:6789:/scratch 2023-07-05T19:58:42.398 INFO:teuthology.orchestra.run.smithi046.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCbvKVkpp1TIhAAvJTELoeH8wkIFqjtppg17w== -o context=system_u:object_r:root_t:s0 172.21.15.46:6789:/scratch /tmp/tmp.KrMG67MsYpscratch 2023-07-05T19:58:42.398 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T19:58:43.217 INFO:teuthology.orchestra.run.smithi046.stdout:generic/199 [not run] Reflink not supported by scratch filesystem type: ceph 2023-07-05T19:58:43.327 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/199 2023-07-05T19:58:43.327 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/199 2023-07-05T19:58:43.327 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-07-05T19:58:43.330 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T19:58:43.386 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-05T19:58:43.387 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.rlt8E1h3iVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/200) 2023-07-05T19:58:43.612 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph 2023-07-05T19:58:43.616 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-05T19:58:43.616 INFO:teuthology.orchestra.run.smithi046.stdout:MKFS_OPTIONS -- 172.21.15.46:6789:/scratch 2023-07-05T19:58:43.617 INFO:teuthology.orchestra.run.smithi046.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCbvKVkpp1TIhAAvJTELoeH8wkIFqjtppg17w== -o context=system_u:object_r:root_t:s0 172.21.15.46:6789:/scratch /tmp/tmp.KrMG67MsYpscratch 2023-07-05T19:58:43.617 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T19:58:44.323 INFO:teuthology.orchestra.run.smithi046.stdout:generic/200 [not run] Reflink not supported by scratch filesystem type: ceph 2023-07-05T19:58:44.376 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/200 2023-07-05T19:58:44.377 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/200 2023-07-05T19:58:44.377 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-07-05T19:58:44.380 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T19:58:44.547 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-05T19:58:44.548 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.rlt8E1h3iVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/201) 2023-07-05T19:58:44.797 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph 2023-07-05T19:58:44.797 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-05T19:58:44.798 INFO:teuthology.orchestra.run.smithi046.stdout:MKFS_OPTIONS -- 172.21.15.46:6789:/scratch 2023-07-05T19:58:44.798 INFO:teuthology.orchestra.run.smithi046.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCbvKVkpp1TIhAAvJTELoeH8wkIFqjtppg17w== -o context=system_u:object_r:root_t:s0 172.21.15.46:6789:/scratch /tmp/tmp.KrMG67MsYpscratch 2023-07-05T19:58:44.799 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T19:58:45.700 INFO:teuthology.orchestra.run.smithi046.stdout:generic/201 [not run] Reflink not supported by scratch filesystem type: ceph 2023-07-05T19:58:45.712 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/201 2023-07-05T19:58:45.712 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/201 2023-07-05T19:58:45.712 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-07-05T19:58:45.716 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T19:58:45.766 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-05T19:58:45.767 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.rlt8E1h3iVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/202) 2023-07-05T19:58:45.989 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph 2023-07-05T19:58:45.994 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-05T19:58:45.994 INFO:teuthology.orchestra.run.smithi046.stdout:MKFS_OPTIONS -- 172.21.15.46:6789:/scratch 2023-07-05T19:58:45.995 INFO:teuthology.orchestra.run.smithi046.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCbvKVkpp1TIhAAvJTELoeH8wkIFqjtppg17w== -o context=system_u:object_r:root_t:s0 172.21.15.46:6789:/scratch /tmp/tmp.KrMG67MsYpscratch 2023-07-05T19:58:45.995 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T19:58:46.747 INFO:teuthology.orchestra.run.smithi046.stdout:generic/202 [not run] Reflink not supported by scratch filesystem type: ceph 2023-07-05T19:58:46.920 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/202 2023-07-05T19:58:46.920 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/202 2023-07-05T19:58:46.920 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-07-05T19:58:46.923 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T19:58:46.992 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-05T19:58:46.993 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.rlt8E1h3iVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/203) 2023-07-05T19:58:47.212 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph 2023-07-05T19:58:47.217 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-05T19:58:47.217 INFO:teuthology.orchestra.run.smithi046.stdout:MKFS_OPTIONS -- 172.21.15.46:6789:/scratch 2023-07-05T19:58:47.218 INFO:teuthology.orchestra.run.smithi046.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCbvKVkpp1TIhAAvJTELoeH8wkIFqjtppg17w== -o context=system_u:object_r:root_t:s0 172.21.15.46:6789:/scratch /tmp/tmp.KrMG67MsYpscratch 2023-07-05T19:58:47.219 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T19:58:47.905 INFO:teuthology.orchestra.run.smithi046.stdout:generic/203 [not run] Reflink not supported by scratch filesystem type: ceph 2023-07-05T19:58:47.919 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/203 2023-07-05T19:58:47.919 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/203 2023-07-05T19:58:47.919 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-07-05T19:58:47.922 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T19:58:48.172 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-05T19:58:48.173 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.rlt8E1h3iVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/204) 2023-07-05T19:58:48.400 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph 2023-07-05T19:58:48.404 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-05T19:58:48.405 INFO:teuthology.orchestra.run.smithi046.stdout:MKFS_OPTIONS -- 172.21.15.46:6789:/scratch 2023-07-05T19:58:48.406 INFO:teuthology.orchestra.run.smithi046.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCbvKVkpp1TIhAAvJTELoeH8wkIFqjtppg17w== -o context=system_u:object_r:root_t:s0 172.21.15.46:6789:/scratch /tmp/tmp.KrMG67MsYpscratch 2023-07-05T19:58:48.406 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T19:58:50.041 INFO:teuthology.orchestra.run.smithi046.stdout:generic/204 [not run] Filesystem ceph not supported in _scratch_mkfs_sized 2023-07-05T19:58:50.046 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/204 2023-07-05T19:58:50.046 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/204 2023-07-05T19:58:50.046 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-07-05T19:58:50.048 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T19:58:50.078 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-05T19:58:50.079 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.rlt8E1h3iVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/205) 2023-07-05T19:58:50.312 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph 2023-07-05T19:58:50.317 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-05T19:58:50.317 INFO:teuthology.orchestra.run.smithi046.stdout:MKFS_OPTIONS -- 172.21.15.46:6789:/scratch 2023-07-05T19:58:50.318 INFO:teuthology.orchestra.run.smithi046.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCbvKVkpp1TIhAAvJTELoeH8wkIFqjtppg17w== -o context=system_u:object_r:root_t:s0 172.21.15.46:6789:/scratch /tmp/tmp.KrMG67MsYpscratch 2023-07-05T19:58:50.318 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T19:58:51.227 INFO:teuthology.orchestra.run.smithi046.stdout:generic/205 [not run] Reflink not supported by scratch filesystem type: ceph 2023-07-05T19:58:51.241 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/205 2023-07-05T19:58:51.241 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/205 2023-07-05T19:58:51.241 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-07-05T19:58:51.244 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T19:58:51.292 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-05T19:58:51.293 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.rlt8E1h3iVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/206) 2023-07-05T19:58:51.542 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph 2023-07-05T19:58:51.546 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-05T19:58:51.546 INFO:teuthology.orchestra.run.smithi046.stdout:MKFS_OPTIONS -- 172.21.15.46:6789:/scratch 2023-07-05T19:58:51.548 INFO:teuthology.orchestra.run.smithi046.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCbvKVkpp1TIhAAvJTELoeH8wkIFqjtppg17w== -o context=system_u:object_r:root_t:s0 172.21.15.46:6789:/scratch /tmp/tmp.KrMG67MsYpscratch 2023-07-05T19:58:51.548 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T19:58:52.407 INFO:teuthology.orchestra.run.smithi046.stdout:generic/206 [not run] Reflink not supported by scratch filesystem type: ceph 2023-07-05T19:58:52.415 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/206 2023-07-05T19:58:52.415 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/206 2023-07-05T19:58:52.415 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-07-05T19:58:52.419 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T19:58:52.501 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-05T19:58:52.502 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.rlt8E1h3iVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/207) 2023-07-05T19:58:52.728 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph 2023-07-05T19:58:52.732 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-05T19:58:52.732 INFO:teuthology.orchestra.run.smithi046.stdout:MKFS_OPTIONS -- 172.21.15.46:6789:/scratch 2023-07-05T19:58:52.733 INFO:teuthology.orchestra.run.smithi046.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCbvKVkpp1TIhAAvJTELoeH8wkIFqjtppg17w== -o context=system_u:object_r:root_t:s0 172.21.15.46:6789:/scratch /tmp/tmp.KrMG67MsYpscratch 2023-07-05T19:58:52.733 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T19:58:59.101 INFO:teuthology.orchestra.run.smithi046.stdout:generic/207 7s 2023-07-05T19:58:59.106 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/207 2023-07-05T19:58:59.106 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-07-05T19:58:59.108 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T19:58:59.513 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-05T19:58:59.513 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.rlt8E1h3iVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/208) 2023-07-05T19:58:59.745 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph 2023-07-05T19:58:59.749 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-05T19:58:59.749 INFO:teuthology.orchestra.run.smithi046.stdout:MKFS_OPTIONS -- 172.21.15.46:6789:/scratch 2023-07-05T19:58:59.750 INFO:teuthology.orchestra.run.smithi046.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCbvKVkpp1TIhAAvJTELoeH8wkIFqjtppg17w== -o context=system_u:object_r:root_t:s0 172.21.15.46:6789:/scratch /tmp/tmp.KrMG67MsYpscratch 2023-07-05T19:58:59.750 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T20:00:09.772 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-05T20:00:09.781 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-05T20:00:39.868 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-05T20:00:39.871 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-05T20:00:39.909 INFO:tasks.ceph.osd.0.smithi046.stderr:2023-07-05T20:00:39.908+0000 7f77d1dc1700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 295274) UID: 0 2023-07-05T20:00:39.910 INFO:tasks.ceph.osd.2.smithi046.stderr:2023-07-05T20:00:39.908+0000 7f5a7ef99700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 295274) UID: 0 2023-07-05T20:00:39.910 INFO:tasks.ceph.osd.1.smithi046.stderr:2023-07-05T20:00:39.908+0000 7f2fc7c11700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 295274) UID: 0 2023-07-05T20:00:39.911 INFO:tasks.ceph.osd.3.smithi046.stderr:2023-07-05T20:00:39.908+0000 7f1104079700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 295274) UID: 0 2023-07-05T20:02:20.244 INFO:teuthology.orchestra.run.smithi046.stdout:generic/208 201s 2023-07-05T20:02:20.249 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/208 2023-07-05T20:02:20.249 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-07-05T20:02:20.252 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T20:02:20.653 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-05T20:02:20.653 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.rlt8E1h3iVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/209) 2023-07-05T20:02:20.959 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph 2023-07-05T20:02:20.963 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-05T20:02:20.964 INFO:teuthology.orchestra.run.smithi046.stdout:MKFS_OPTIONS -- 172.21.15.46:6789:/scratch 2023-07-05T20:02:20.965 INFO:teuthology.orchestra.run.smithi046.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCbvKVkpp1TIhAAvJTELoeH8wkIFqjtppg17w== -o context=system_u:object_r:root_t:s0 172.21.15.46:6789:/scratch /tmp/tmp.KrMG67MsYpscratch 2023-07-05T20:02:20.965 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T20:02:53.506 INFO:teuthology.orchestra.run.smithi046.stdout:generic/209 32s 2023-07-05T20:02:53.511 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/209 2023-07-05T20:02:53.511 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-07-05T20:02:53.513 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T20:02:53.648 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-05T20:02:53.649 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.rlt8E1h3iVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/210) 2023-07-05T20:02:54.135 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph 2023-07-05T20:02:54.139 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-05T20:02:54.139 INFO:teuthology.orchestra.run.smithi046.stdout:MKFS_OPTIONS -- 172.21.15.46:6789:/scratch 2023-07-05T20:02:54.140 INFO:teuthology.orchestra.run.smithi046.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCbvKVkpp1TIhAAvJTELoeH8wkIFqjtppg17w== -o context=system_u:object_r:root_t:s0 172.21.15.46:6789:/scratch /tmp/tmp.KrMG67MsYpscratch 2023-07-05T20:02:54.141 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T20:02:54.594 INFO:teuthology.orchestra.run.smithi046.stdout:generic/210 0s 2023-07-05T20:02:54.599 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/210 2023-07-05T20:02:54.599 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-07-05T20:02:54.601 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T20:02:54.867 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-05T20:02:54.867 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.rlt8E1h3iVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/211) 2023-07-05T20:02:55.223 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph 2023-07-05T20:02:55.227 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-05T20:02:55.227 INFO:teuthology.orchestra.run.smithi046.stdout:MKFS_OPTIONS -- 172.21.15.46:6789:/scratch 2023-07-05T20:02:55.229 INFO:teuthology.orchestra.run.smithi046.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCbvKVkpp1TIhAAvJTELoeH8wkIFqjtppg17w== -o context=system_u:object_r:root_t:s0 172.21.15.46:6789:/scratch /tmp/tmp.KrMG67MsYpscratch 2023-07-05T20:02:55.229 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T20:02:55.772 INFO:teuthology.orchestra.run.smithi046.stdout:generic/211 0s 2023-07-05T20:02:55.777 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/211 2023-07-05T20:02:55.777 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-07-05T20:02:55.779 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T20:02:55.809 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-05T20:02:55.810 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.rlt8E1h3iVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/212) 2023-07-05T20:02:56.033 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph 2023-07-05T20:02:56.038 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-05T20:02:56.038 INFO:teuthology.orchestra.run.smithi046.stdout:MKFS_OPTIONS -- 172.21.15.46:6789:/scratch 2023-07-05T20:02:56.039 INFO:teuthology.orchestra.run.smithi046.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCbvKVkpp1TIhAAvJTELoeH8wkIFqjtppg17w== -o context=system_u:object_r:root_t:s0 172.21.15.46:6789:/scratch /tmp/tmp.KrMG67MsYpscratch 2023-07-05T20:02:56.039 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T20:02:56.472 INFO:teuthology.orchestra.run.smithi046.stdout:generic/212 0s 2023-07-05T20:02:56.477 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/212 2023-07-05T20:02:56.477 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-07-05T20:02:56.479 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T20:02:56.516 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-05T20:02:56.516 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.rlt8E1h3iVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/213) 2023-07-05T20:02:56.740 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph 2023-07-05T20:02:56.745 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-05T20:02:56.745 INFO:teuthology.orchestra.run.smithi046.stdout:MKFS_OPTIONS -- 172.21.15.46:6789:/scratch 2023-07-05T20:02:56.746 INFO:teuthology.orchestra.run.smithi046.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCbvKVkpp1TIhAAvJTELoeH8wkIFqjtppg17w== -o context=system_u:object_r:root_t:s0 172.21.15.46:6789:/scratch /tmp/tmp.KrMG67MsYpscratch 2023-07-05T20:02:56.746 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T20:02:57.100 INFO:teuthology.orchestra.run.smithi046.stdout:generic/213 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-07-05T20:02:57.104 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/213 2023-07-05T20:02:57.104 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/213 2023-07-05T20:02:57.104 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-07-05T20:02:57.106 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T20:02:57.138 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-05T20:02:57.139 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.rlt8E1h3iVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/214) 2023-07-05T20:02:57.364 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph 2023-07-05T20:02:57.368 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-05T20:02:57.369 INFO:teuthology.orchestra.run.smithi046.stdout:MKFS_OPTIONS -- 172.21.15.46:6789:/scratch 2023-07-05T20:02:57.370 INFO:teuthology.orchestra.run.smithi046.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCbvKVkpp1TIhAAvJTELoeH8wkIFqjtppg17w== -o context=system_u:object_r:root_t:s0 172.21.15.46:6789:/scratch /tmp/tmp.KrMG67MsYpscratch 2023-07-05T20:02:57.370 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T20:02:57.733 INFO:teuthology.orchestra.run.smithi046.stdout:generic/214 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-07-05T20:02:57.738 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/214 2023-07-05T20:02:57.738 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/214 2023-07-05T20:02:57.738 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-07-05T20:02:57.739 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T20:02:57.765 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-05T20:02:57.766 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.rlt8E1h3iVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/215) 2023-07-05T20:02:57.987 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph 2023-07-05T20:02:57.991 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-05T20:02:57.992 INFO:teuthology.orchestra.run.smithi046.stdout:MKFS_OPTIONS -- 172.21.15.46:6789:/scratch 2023-07-05T20:02:57.993 INFO:teuthology.orchestra.run.smithi046.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCbvKVkpp1TIhAAvJTELoeH8wkIFqjtppg17w== -o context=system_u:object_r:root_t:s0 172.21.15.46:6789:/scratch /tmp/tmp.KrMG67MsYpscratch 2023-07-05T20:02:57.993 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T20:03:00.414 INFO:teuthology.orchestra.run.smithi046.stdout:generic/215 2s 2023-07-05T20:03:00.420 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/215 2023-07-05T20:03:00.420 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-07-05T20:03:00.423 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T20:03:00.476 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-05T20:03:00.477 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.rlt8E1h3iVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/216) 2023-07-05T20:03:00.703 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph 2023-07-05T20:03:00.707 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-05T20:03:00.707 INFO:teuthology.orchestra.run.smithi046.stdout:MKFS_OPTIONS -- 172.21.15.46:6789:/scratch 2023-07-05T20:03:00.708 INFO:teuthology.orchestra.run.smithi046.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCbvKVkpp1TIhAAvJTELoeH8wkIFqjtppg17w== -o context=system_u:object_r:root_t:s0 172.21.15.46:6789:/scratch /tmp/tmp.KrMG67MsYpscratch 2023-07-05T20:03:00.709 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T20:03:01.662 INFO:teuthology.orchestra.run.smithi046.stdout:generic/216 [not run] Reflink not supported by scratch filesystem type: ceph 2023-07-05T20:03:01.676 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/216 2023-07-05T20:03:01.677 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/216 2023-07-05T20:03:01.677 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-07-05T20:03:01.679 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T20:03:01.704 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-05T20:03:01.705 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.rlt8E1h3iVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/217) 2023-07-05T20:03:01.927 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph 2023-07-05T20:03:01.931 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-05T20:03:01.932 INFO:teuthology.orchestra.run.smithi046.stdout:MKFS_OPTIONS -- 172.21.15.46:6789:/scratch 2023-07-05T20:03:01.933 INFO:teuthology.orchestra.run.smithi046.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCbvKVkpp1TIhAAvJTELoeH8wkIFqjtppg17w== -o context=system_u:object_r:root_t:s0 172.21.15.46:6789:/scratch /tmp/tmp.KrMG67MsYpscratch 2023-07-05T20:03:01.933 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T20:03:02.745 INFO:teuthology.orchestra.run.smithi046.stdout:generic/217 [not run] Reflink not supported by scratch filesystem type: ceph 2023-07-05T20:03:02.758 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/217 2023-07-05T20:03:02.758 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/217 2023-07-05T20:03:02.759 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-07-05T20:03:02.763 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T20:03:02.879 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-05T20:03:02.880 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.rlt8E1h3iVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/218) 2023-07-05T20:03:03.100 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph 2023-07-05T20:03:03.104 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-05T20:03:03.105 INFO:teuthology.orchestra.run.smithi046.stdout:MKFS_OPTIONS -- 172.21.15.46:6789:/scratch 2023-07-05T20:03:03.106 INFO:teuthology.orchestra.run.smithi046.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCbvKVkpp1TIhAAvJTELoeH8wkIFqjtppg17w== -o context=system_u:object_r:root_t:s0 172.21.15.46:6789:/scratch /tmp/tmp.KrMG67MsYpscratch 2023-07-05T20:03:03.106 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T20:03:03.912 INFO:teuthology.orchestra.run.smithi046.stdout:generic/218 [not run] Reflink not supported by scratch filesystem type: ceph 2023-07-05T20:03:03.970 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/218 2023-07-05T20:03:03.970 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/218 2023-07-05T20:03:03.971 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-07-05T20:03:03.975 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T20:03:04.072 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-05T20:03:04.073 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.rlt8E1h3iVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/219) 2023-07-05T20:03:04.320 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph 2023-07-05T20:03:04.324 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-05T20:03:04.325 INFO:teuthology.orchestra.run.smithi046.stdout:MKFS_OPTIONS -- 172.21.15.46:6789:/scratch 2023-07-05T20:03:04.326 INFO:teuthology.orchestra.run.smithi046.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCbvKVkpp1TIhAAvJTELoeH8wkIFqjtppg17w== -o context=system_u:object_r:root_t:s0 172.21.15.46:6789:/scratch /tmp/tmp.KrMG67MsYpscratch 2023-07-05T20:03:04.326 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T20:03:04.675 INFO:teuthology.orchestra.run.smithi046.stdout:generic/219 [not run] disk quotas not supported by this filesystem type: ceph 2023-07-05T20:03:04.679 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/219 2023-07-05T20:03:04.679 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/219 2023-07-05T20:03:04.679 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-07-05T20:03:04.681 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T20:03:04.705 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-05T20:03:04.705 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.rlt8E1h3iVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/220) 2023-07-05T20:03:04.937 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph 2023-07-05T20:03:04.942 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-05T20:03:04.942 INFO:teuthology.orchestra.run.smithi046.stdout:MKFS_OPTIONS -- 172.21.15.46:6789:/scratch 2023-07-05T20:03:04.943 INFO:teuthology.orchestra.run.smithi046.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCbvKVkpp1TIhAAvJTELoeH8wkIFqjtppg17w== -o context=system_u:object_r:root_t:s0 172.21.15.46:6789:/scratch /tmp/tmp.KrMG67MsYpscratch 2023-07-05T20:03:04.943 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T20:03:05.870 INFO:teuthology.orchestra.run.smithi046.stdout:generic/220 [not run] Reflink not supported by scratch filesystem type: ceph 2023-07-05T20:03:05.884 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/220 2023-07-05T20:03:05.885 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/220 2023-07-05T20:03:05.885 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-07-05T20:03:05.887 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T20:03:05.913 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-05T20:03:05.914 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.rlt8E1h3iVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/221) 2023-07-05T20:03:06.137 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph 2023-07-05T20:03:06.142 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-05T20:03:06.142 INFO:teuthology.orchestra.run.smithi046.stdout:MKFS_OPTIONS -- 172.21.15.46:6789:/scratch 2023-07-05T20:03:06.143 INFO:teuthology.orchestra.run.smithi046.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCbvKVkpp1TIhAAvJTELoeH8wkIFqjtppg17w== -o context=system_u:object_r:root_t:s0 172.21.15.46:6789:/scratch /tmp/tmp.KrMG67MsYpscratch 2023-07-05T20:03:06.143 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T20:03:07.517 INFO:teuthology.orchestra.run.smithi046.stdout:generic/221 1s 2023-07-05T20:03:07.524 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/221 2023-07-05T20:03:07.525 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-07-05T20:03:07.525 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T20:03:07.554 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-05T20:03:07.555 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.rlt8E1h3iVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/222) 2023-07-05T20:03:07.783 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph 2023-07-05T20:03:07.787 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-05T20:03:07.788 INFO:teuthology.orchestra.run.smithi046.stdout:MKFS_OPTIONS -- 172.21.15.46:6789:/scratch 2023-07-05T20:03:07.789 INFO:teuthology.orchestra.run.smithi046.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCbvKVkpp1TIhAAvJTELoeH8wkIFqjtppg17w== -o context=system_u:object_r:root_t:s0 172.21.15.46:6789:/scratch /tmp/tmp.KrMG67MsYpscratch 2023-07-05T20:03:07.789 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T20:03:08.610 INFO:teuthology.orchestra.run.smithi046.stdout:generic/222 [not run] Reflink not supported by scratch filesystem type: ceph 2023-07-05T20:03:08.700 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/222 2023-07-05T20:03:08.700 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/222 2023-07-05T20:03:08.700 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-07-05T20:03:08.703 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T20:03:08.744 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-05T20:03:08.745 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.rlt8E1h3iVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/223) 2023-07-05T20:03:08.973 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph 2023-07-05T20:03:08.978 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-05T20:03:08.978 INFO:teuthology.orchestra.run.smithi046.stdout:MKFS_OPTIONS -- 172.21.15.46:6789:/scratch 2023-07-05T20:03:08.979 INFO:teuthology.orchestra.run.smithi046.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCbvKVkpp1TIhAAvJTELoeH8wkIFqjtppg17w== -o context=system_u:object_r:root_t:s0 172.21.15.46:6789:/scratch /tmp/tmp.KrMG67MsYpscratch 2023-07-05T20:03:08.980 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T20:03:09.347 INFO:teuthology.orchestra.run.smithi046.stdout:generic/223 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-07-05T20:03:09.351 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/223 2023-07-05T20:03:09.351 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/223 2023-07-05T20:03:09.351 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-07-05T20:03:09.353 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T20:03:09.379 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-05T20:03:09.380 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.rlt8E1h3iVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/224) 2023-07-05T20:03:09.616 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph 2023-07-05T20:03:09.621 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-05T20:03:09.621 INFO:teuthology.orchestra.run.smithi046.stdout:MKFS_OPTIONS -- 172.21.15.46:6789:/scratch 2023-07-05T20:03:09.622 INFO:teuthology.orchestra.run.smithi046.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCbvKVkpp1TIhAAvJTELoeH8wkIFqjtppg17w== -o context=system_u:object_r:root_t:s0 172.21.15.46:6789:/scratch /tmp/tmp.KrMG67MsYpscratch 2023-07-05T20:03:09.622 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T20:03:09.973 INFO:teuthology.orchestra.run.smithi046.stdout:generic/224 [not run] Filesystem ceph not supported in _scratch_mkfs_sized 2023-07-05T20:03:09.977 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/224 2023-07-05T20:03:09.978 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/224 2023-07-05T20:03:09.978 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-07-05T20:03:09.979 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T20:03:10.007 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-05T20:03:10.007 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.rlt8E1h3iVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/225) 2023-07-05T20:03:10.230 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph 2023-07-05T20:03:10.234 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-05T20:03:10.234 INFO:teuthology.orchestra.run.smithi046.stdout:MKFS_OPTIONS -- 172.21.15.46:6789:/scratch 2023-07-05T20:03:10.235 INFO:teuthology.orchestra.run.smithi046.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCbvKVkpp1TIhAAvJTELoeH8wkIFqjtppg17w== -o context=system_u:object_r:root_t:s0 172.21.15.46:6789:/scratch /tmp/tmp.KrMG67MsYpscratch 2023-07-05T20:03:10.235 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T20:03:10.647 INFO:teuthology.orchestra.run.smithi046.stdout:generic/225 [not run] xfs_io fiemap failed (old kernel/wrong fs?) 2023-07-05T20:03:10.651 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/225 2023-07-05T20:03:10.652 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/225 2023-07-05T20:03:10.652 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-07-05T20:03:10.653 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T20:03:11.031 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-05T20:03:11.031 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.rlt8E1h3iVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/226) 2023-07-05T20:03:11.265 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph 2023-07-05T20:03:11.269 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-05T20:03:11.269 INFO:teuthology.orchestra.run.smithi046.stdout:MKFS_OPTIONS -- 172.21.15.46:6789:/scratch 2023-07-05T20:03:11.270 INFO:teuthology.orchestra.run.smithi046.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCbvKVkpp1TIhAAvJTELoeH8wkIFqjtppg17w== -o context=system_u:object_r:root_t:s0 172.21.15.46:6789:/scratch /tmp/tmp.KrMG67MsYpscratch 2023-07-05T20:03:11.270 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T20:03:11.633 INFO:teuthology.orchestra.run.smithi046.stdout:generic/226 [not run] Filesystem ceph not supported in _scratch_mkfs_sized 2023-07-05T20:03:11.637 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/226 2023-07-05T20:03:11.637 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/226 2023-07-05T20:03:11.637 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-07-05T20:03:11.639 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T20:03:11.675 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-05T20:03:11.675 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.rlt8E1h3iVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/227) 2023-07-05T20:03:11.901 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph 2023-07-05T20:03:11.905 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-05T20:03:11.906 INFO:teuthology.orchestra.run.smithi046.stdout:MKFS_OPTIONS -- 172.21.15.46:6789:/scratch 2023-07-05T20:03:11.907 INFO:teuthology.orchestra.run.smithi046.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCbvKVkpp1TIhAAvJTELoeH8wkIFqjtppg17w== -o context=system_u:object_r:root_t:s0 172.21.15.46:6789:/scratch /tmp/tmp.KrMG67MsYpscratch 2023-07-05T20:03:11.907 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T20:03:12.751 INFO:teuthology.orchestra.run.smithi046.stdout:generic/227 [not run] Reflink not supported by scratch filesystem type: ceph 2023-07-05T20:03:12.810 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/227 2023-07-05T20:03:12.810 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/227 2023-07-05T20:03:12.811 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-07-05T20:03:12.821 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T20:03:12.851 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-05T20:03:12.851 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.rlt8E1h3iVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/228) 2023-07-05T20:03:13.069 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph 2023-07-05T20:03:13.073 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-05T20:03:13.074 INFO:teuthology.orchestra.run.smithi046.stdout:MKFS_OPTIONS -- 172.21.15.46:6789:/scratch 2023-07-05T20:03:13.074 INFO:teuthology.orchestra.run.smithi046.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCbvKVkpp1TIhAAvJTELoeH8wkIFqjtppg17w== -o context=system_u:object_r:root_t:s0 172.21.15.46:6789:/scratch /tmp/tmp.KrMG67MsYpscratch 2023-07-05T20:03:13.075 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T20:03:13.449 INFO:teuthology.orchestra.run.smithi046.stdout:generic/228 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-07-05T20:03:13.453 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/228 2023-07-05T20:03:13.453 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/228 2023-07-05T20:03:13.454 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-07-05T20:03:13.455 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T20:03:13.487 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-05T20:03:13.488 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.rlt8E1h3iVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/229) 2023-07-05T20:03:13.712 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph 2023-07-05T20:03:13.716 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-05T20:03:13.716 INFO:teuthology.orchestra.run.smithi046.stdout:MKFS_OPTIONS -- 172.21.15.46:6789:/scratch 2023-07-05T20:03:13.717 INFO:teuthology.orchestra.run.smithi046.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCbvKVkpp1TIhAAvJTELoeH8wkIFqjtppg17w== -o context=system_u:object_r:root_t:s0 172.21.15.46:6789:/scratch /tmp/tmp.KrMG67MsYpscratch 2023-07-05T20:03:13.718 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T20:03:14.619 INFO:teuthology.orchestra.run.smithi046.stdout:generic/229 [not run] Reflink not supported by scratch filesystem type: ceph 2023-07-05T20:03:14.641 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/229 2023-07-05T20:03:14.641 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/229 2023-07-05T20:03:14.641 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-07-05T20:03:14.645 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T20:03:14.675 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-05T20:03:14.676 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.rlt8E1h3iVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/230) 2023-07-05T20:03:14.897 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph 2023-07-05T20:03:14.901 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-05T20:03:14.902 INFO:teuthology.orchestra.run.smithi046.stdout:MKFS_OPTIONS -- 172.21.15.46:6789:/scratch 2023-07-05T20:03:14.903 INFO:teuthology.orchestra.run.smithi046.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCbvKVkpp1TIhAAvJTELoeH8wkIFqjtppg17w== -o context=system_u:object_r:root_t:s0 172.21.15.46:6789:/scratch /tmp/tmp.KrMG67MsYpscratch 2023-07-05T20:03:14.903 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T20:03:15.238 INFO:teuthology.orchestra.run.smithi046.stdout:generic/230 [not run] disk quotas not supported by this filesystem type: ceph 2023-07-05T20:03:15.242 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/230 2023-07-05T20:03:15.242 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/230 2023-07-05T20:03:15.242 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-07-05T20:03:15.244 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T20:03:15.279 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-05T20:03:15.279 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.rlt8E1h3iVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/231) 2023-07-05T20:03:15.519 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph 2023-07-05T20:03:15.523 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-05T20:03:15.525 INFO:teuthology.orchestra.run.smithi046.stdout:MKFS_OPTIONS -- 172.21.15.46:6789:/scratch 2023-07-05T20:03:15.525 INFO:teuthology.orchestra.run.smithi046.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCbvKVkpp1TIhAAvJTELoeH8wkIFqjtppg17w== -o context=system_u:object_r:root_t:s0 172.21.15.46:6789:/scratch /tmp/tmp.KrMG67MsYpscratch 2023-07-05T20:03:15.525 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T20:03:15.868 INFO:teuthology.orchestra.run.smithi046.stdout:generic/231 [not run] disk quotas not supported by this filesystem type: ceph 2023-07-05T20:03:15.872 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/231 2023-07-05T20:03:15.872 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/231 2023-07-05T20:03:15.872 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-07-05T20:03:15.874 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T20:03:15.900 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-05T20:03:15.900 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.rlt8E1h3iVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/232) 2023-07-05T20:03:16.123 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph 2023-07-05T20:03:16.127 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-05T20:03:16.127 INFO:teuthology.orchestra.run.smithi046.stdout:MKFS_OPTIONS -- 172.21.15.46:6789:/scratch 2023-07-05T20:03:16.128 INFO:teuthology.orchestra.run.smithi046.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCbvKVkpp1TIhAAvJTELoeH8wkIFqjtppg17w== -o context=system_u:object_r:root_t:s0 172.21.15.46:6789:/scratch /tmp/tmp.KrMG67MsYpscratch 2023-07-05T20:03:16.128 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T20:03:16.472 INFO:teuthology.orchestra.run.smithi046.stdout:generic/232 [not run] disk quotas not supported by this filesystem type: ceph 2023-07-05T20:03:16.476 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/232 2023-07-05T20:03:16.476 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/232 2023-07-05T20:03:16.476 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-07-05T20:03:16.478 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T20:03:16.510 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-05T20:03:16.511 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.rlt8E1h3iVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/233) 2023-07-05T20:03:16.735 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph 2023-07-05T20:03:16.739 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-05T20:03:16.739 INFO:teuthology.orchestra.run.smithi046.stdout:MKFS_OPTIONS -- 172.21.15.46:6789:/scratch 2023-07-05T20:03:16.740 INFO:teuthology.orchestra.run.smithi046.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCbvKVkpp1TIhAAvJTELoeH8wkIFqjtppg17w== -o context=system_u:object_r:root_t:s0 172.21.15.46:6789:/scratch /tmp/tmp.KrMG67MsYpscratch 2023-07-05T20:03:16.740 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T20:03:17.093 INFO:teuthology.orchestra.run.smithi046.stdout:generic/233 [not run] disk quotas not supported by this filesystem type: ceph 2023-07-05T20:03:17.097 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/233 2023-07-05T20:03:17.098 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/233 2023-07-05T20:03:17.098 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-07-05T20:03:17.099 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T20:03:17.118 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-05T20:03:17.118 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.rlt8E1h3iVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/234) 2023-07-05T20:03:17.249 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-05T20:03:17.252 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-05T20:03:17.341 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph 2023-07-05T20:03:17.345 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-05T20:03:17.346 INFO:teuthology.orchestra.run.smithi046.stdout:MKFS_OPTIONS -- 172.21.15.46:6789:/scratch 2023-07-05T20:03:17.347 INFO:teuthology.orchestra.run.smithi046.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCbvKVkpp1TIhAAvJTELoeH8wkIFqjtppg17w== -o context=system_u:object_r:root_t:s0 172.21.15.46:6789:/scratch /tmp/tmp.KrMG67MsYpscratch 2023-07-05T20:03:17.347 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T20:03:17.685 INFO:teuthology.orchestra.run.smithi046.stdout:generic/234 [not run] disk quotas not supported by this filesystem type: ceph 2023-07-05T20:03:17.689 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/234 2023-07-05T20:03:17.690 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/234 2023-07-05T20:03:17.690 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-07-05T20:03:17.692 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T20:03:17.719 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-05T20:03:17.720 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.rlt8E1h3iVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/235) 2023-07-05T20:03:17.982 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph 2023-07-05T20:03:17.987 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-05T20:03:17.987 INFO:teuthology.orchestra.run.smithi046.stdout:MKFS_OPTIONS -- 172.21.15.46:6789:/scratch 2023-07-05T20:03:17.988 INFO:teuthology.orchestra.run.smithi046.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCbvKVkpp1TIhAAvJTELoeH8wkIFqjtppg17w== -o context=system_u:object_r:root_t:s0 172.21.15.46:6789:/scratch /tmp/tmp.KrMG67MsYpscratch 2023-07-05T20:03:17.988 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T20:03:18.343 INFO:teuthology.orchestra.run.smithi046.stdout:generic/235 [not run] disk quotas not supported by this filesystem type: ceph 2023-07-05T20:03:18.347 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/235 2023-07-05T20:03:18.347 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/235 2023-07-05T20:03:18.348 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-07-05T20:03:18.350 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T20:03:18.383 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-05T20:03:18.383 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.rlt8E1h3iVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/236) 2023-07-05T20:03:18.621 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph 2023-07-05T20:03:18.625 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-05T20:03:18.625 INFO:teuthology.orchestra.run.smithi046.stdout:MKFS_OPTIONS -- 172.21.15.46:6789:/scratch 2023-07-05T20:03:18.626 INFO:teuthology.orchestra.run.smithi046.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCbvKVkpp1TIhAAvJTELoeH8wkIFqjtppg17w== -o context=system_u:object_r:root_t:s0 172.21.15.46:6789:/scratch /tmp/tmp.KrMG67MsYpscratch 2023-07-05T20:03:18.626 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T20:03:20.056 INFO:teuthology.orchestra.run.smithi046.stdout:generic/236 2s 2023-07-05T20:03:20.062 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/236 2023-07-05T20:03:20.062 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-07-05T20:03:20.064 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T20:03:20.418 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-05T20:03:20.418 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.rlt8E1h3iVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/237) 2023-07-05T20:03:20.697 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph 2023-07-05T20:03:20.701 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-05T20:03:20.702 INFO:teuthology.orchestra.run.smithi046.stdout:MKFS_OPTIONS -- 172.21.15.46:6789:/scratch 2023-07-05T20:03:20.703 INFO:teuthology.orchestra.run.smithi046.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCbvKVkpp1TIhAAvJTELoeH8wkIFqjtppg17w== -o context=system_u:object_r:root_t:s0 172.21.15.46:6789:/scratch /tmp/tmp.KrMG67MsYpscratch 2023-07-05T20:03:20.703 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T20:03:21.170 INFO:teuthology.orchestra.run.smithi046.stdout:generic/237 1s 2023-07-05T20:03:21.175 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/237 2023-07-05T20:03:21.175 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-07-05T20:03:21.177 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T20:03:21.572 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-05T20:03:21.573 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.rlt8E1h3iVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/238) 2023-07-05T20:03:21.802 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph 2023-07-05T20:03:21.806 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-05T20:03:21.807 INFO:teuthology.orchestra.run.smithi046.stdout:MKFS_OPTIONS -- 172.21.15.46:6789:/scratch 2023-07-05T20:03:21.807 INFO:teuthology.orchestra.run.smithi046.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCbvKVkpp1TIhAAvJTELoeH8wkIFqjtppg17w== -o context=system_u:object_r:root_t:s0 172.21.15.46:6789:/scratch /tmp/tmp.KrMG67MsYpscratch 2023-07-05T20:03:21.807 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T20:03:22.600 INFO:teuthology.orchestra.run.smithi046.stdout:generic/238 [not run] Reflink not supported by scratch filesystem type: ceph 2023-07-05T20:03:22.691 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/238 2023-07-05T20:03:22.691 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/238 2023-07-05T20:03:22.691 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-07-05T20:03:22.716 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T20:03:22.751 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-05T20:03:22.752 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.rlt8E1h3iVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/239) 2023-07-05T20:03:22.994 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph 2023-07-05T20:03:22.998 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-05T20:03:22.999 INFO:teuthology.orchestra.run.smithi046.stdout:MKFS_OPTIONS -- 172.21.15.46:6789:/scratch 2023-07-05T20:03:22.999 INFO:teuthology.orchestra.run.smithi046.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCbvKVkpp1TIhAAvJTELoeH8wkIFqjtppg17w== -o context=system_u:object_r:root_t:s0 172.21.15.46:6789:/scratch /tmp/tmp.KrMG67MsYpscratch 2023-07-05T20:03:23.000 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T20:03:47.334 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-05T20:03:47.362 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-05T20:04:17.471 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-05T20:04:17.482 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-05T20:04:47.692 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-05T20:04:47.697 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-05T20:04:47.800 INFO:tasks.ceph.osd.2.smithi046.stderr:2023-07-05T20:04:47.799+0000 7f5a7ef99700 -1 Fail to open '/proc/310926/cmdline' error = (2) No such file or directory 2023-07-05T20:04:47.800 INFO:tasks.ceph.osd.2.smithi046.stderr:2023-07-05T20:04:47.799+0000 7f5a7ef99700 -1 received signal: Hangup from (PID: 310926) UID: 0 2023-07-05T20:04:47.801 INFO:tasks.ceph.osd.1.smithi046.stderr:2023-07-05T20:04:47.799+0000 7f2fc7c11700 -1 Fail to open '/proc/310926/cmdline' error = (2) No such file or directory 2023-07-05T20:04:47.801 INFO:tasks.ceph.osd.1.smithi046.stderr:2023-07-05T20:04:47.799+0000 7f2fc7c11700 -1 received signal: Hangup from (PID: 310926) UID: 0 2023-07-05T20:04:47.804 INFO:tasks.ceph.osd.3.smithi046.stderr:2023-07-05T20:04:47.802+0000 7f1104079700 -1 Fail to open '/proc/310926/cmdline' error = (2) No such file or directory 2023-07-05T20:04:47.804 INFO:tasks.ceph.osd.3.smithi046.stderr:2023-07-05T20:04:47.802+0000 7f1104079700 -1 received signal: Hangup from (PID: 310926) UID: 0 2023-07-05T20:04:47.805 INFO:tasks.ceph.osd.0.smithi046.stderr:2023-07-05T20:04:47.802+0000 7f77d1dc1700 -1 Fail to open '/proc/310926/cmdline' error = (2) No such file or directory 2023-07-05T20:04:47.805 INFO:tasks.ceph.osd.0.smithi046.stderr:2023-07-05T20:04:47.802+0000 7f77d1dc1700 -1 received signal: Hangup from (PID: 310926) UID: 0 2023-07-05T20:05:15.816 INFO:teuthology.orchestra.run.smithi046.stdout:generic/239 112s 2023-07-05T20:05:15.835 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/239 2023-07-05T20:05:15.835 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-07-05T20:05:15.837 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T20:05:16.198 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-05T20:05:16.198 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.rlt8E1h3iVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/240) 2023-07-05T20:05:16.479 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph 2023-07-05T20:05:16.483 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-05T20:05:16.484 INFO:teuthology.orchestra.run.smithi046.stdout:MKFS_OPTIONS -- 172.21.15.46:6789:/scratch 2023-07-05T20:05:16.485 INFO:teuthology.orchestra.run.smithi046.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCbvKVkpp1TIhAAvJTELoeH8wkIFqjtppg17w== -o context=system_u:object_r:root_t:s0 172.21.15.46:6789:/scratch /tmp/tmp.KrMG67MsYpscratch 2023-07-05T20:05:16.485 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T20:05:17.291 INFO:teuthology.orchestra.run.smithi046.stdout:generic/240 1s 2023-07-05T20:05:17.296 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/240 2023-07-05T20:05:17.296 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-07-05T20:05:17.298 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T20:05:17.578 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-05T20:05:17.579 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.rlt8E1h3iVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/241) 2023-07-05T20:05:17.973 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph 2023-07-05T20:05:17.977 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-05T20:05:17.978 INFO:teuthology.orchestra.run.smithi046.stdout:MKFS_OPTIONS -- 172.21.15.46:6789:/scratch 2023-07-05T20:05:17.978 INFO:teuthology.orchestra.run.smithi046.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCbvKVkpp1TIhAAvJTELoeH8wkIFqjtppg17w== -o context=system_u:object_r:root_t:s0 172.21.15.46:6789:/scratch /tmp/tmp.KrMG67MsYpscratch 2023-07-05T20:05:17.979 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T20:06:31.253 INFO:teuthology.orchestra.run.smithi046.stdout:generic/241 73s 2023-07-05T20:06:31.258 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/241 2023-07-05T20:06:31.258 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-07-05T20:06:31.260 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T20:06:33.667 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-05T20:06:33.668 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.rlt8E1h3iVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/242) 2023-07-05T20:06:34.401 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph 2023-07-05T20:06:34.407 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-05T20:06:34.411 INFO:teuthology.orchestra.run.smithi046.stdout:MKFS_OPTIONS -- 172.21.15.46:6789:/scratch 2023-07-05T20:06:34.412 INFO:teuthology.orchestra.run.smithi046.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCbvKVkpp1TIhAAvJTELoeH8wkIFqjtppg17w== -o context=system_u:object_r:root_t:s0 172.21.15.46:6789:/scratch /tmp/tmp.KrMG67MsYpscratch 2023-07-05T20:06:34.412 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T20:06:35.880 INFO:teuthology.orchestra.run.smithi046.stdout:generic/242 [not run] Reflink not supported by scratch filesystem type: ceph 2023-07-05T20:06:35.886 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/242 2023-07-05T20:06:35.886 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/242 2023-07-05T20:06:35.887 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-07-05T20:06:35.889 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T20:06:36.183 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-05T20:06:36.183 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.rlt8E1h3iVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/243) 2023-07-05T20:06:36.443 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph 2023-07-05T20:06:36.447 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-05T20:06:36.448 INFO:teuthology.orchestra.run.smithi046.stdout:MKFS_OPTIONS -- 172.21.15.46:6789:/scratch 2023-07-05T20:06:36.449 INFO:teuthology.orchestra.run.smithi046.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCbvKVkpp1TIhAAvJTELoeH8wkIFqjtppg17w== -o context=system_u:object_r:root_t:s0 172.21.15.46:6789:/scratch /tmp/tmp.KrMG67MsYpscratch 2023-07-05T20:06:36.449 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T20:06:37.373 INFO:teuthology.orchestra.run.smithi046.stdout:generic/243 [not run] Reflink not supported by scratch filesystem type: ceph 2023-07-05T20:06:37.390 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/243 2023-07-05T20:06:37.391 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/243 2023-07-05T20:06:37.391 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-07-05T20:06:37.394 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T20:06:37.419 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-05T20:06:37.419 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.rlt8E1h3iVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/244) 2023-07-05T20:06:37.653 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph 2023-07-05T20:06:37.657 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-05T20:06:37.658 INFO:teuthology.orchestra.run.smithi046.stdout:MKFS_OPTIONS -- 172.21.15.46:6789:/scratch 2023-07-05T20:06:37.659 INFO:teuthology.orchestra.run.smithi046.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCbvKVkpp1TIhAAvJTELoeH8wkIFqjtppg17w== -o context=system_u:object_r:root_t:s0 172.21.15.46:6789:/scratch /tmp/tmp.KrMG67MsYpscratch 2023-07-05T20:06:37.659 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T20:06:37.998 INFO:teuthology.orchestra.run.smithi046.stdout:generic/244 [not run] disk quotas not supported by this filesystem type: ceph 2023-07-05T20:06:38.002 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/244 2023-07-05T20:06:38.002 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/244 2023-07-05T20:06:38.003 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-07-05T20:06:38.004 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T20:06:38.040 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-05T20:06:38.041 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.rlt8E1h3iVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/245) 2023-07-05T20:06:38.263 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph 2023-07-05T20:06:38.268 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-05T20:06:38.268 INFO:teuthology.orchestra.run.smithi046.stdout:MKFS_OPTIONS -- 172.21.15.46:6789:/scratch 2023-07-05T20:06:38.269 INFO:teuthology.orchestra.run.smithi046.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCbvKVkpp1TIhAAvJTELoeH8wkIFqjtppg17w== -o context=system_u:object_r:root_t:s0 172.21.15.46:6789:/scratch /tmp/tmp.KrMG67MsYpscratch 2023-07-05T20:06:38.269 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T20:06:38.685 INFO:teuthology.orchestra.run.smithi046.stdout:generic/245 0s 2023-07-05T20:06:38.690 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/245 2023-07-05T20:06:38.691 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-07-05T20:06:38.692 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T20:06:39.111 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-05T20:06:39.112 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.rlt8E1h3iVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/246) 2023-07-05T20:06:39.355 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph 2023-07-05T20:06:39.359 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-05T20:06:39.359 INFO:teuthology.orchestra.run.smithi046.stdout:MKFS_OPTIONS -- 172.21.15.46:6789:/scratch 2023-07-05T20:06:39.360 INFO:teuthology.orchestra.run.smithi046.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCbvKVkpp1TIhAAvJTELoeH8wkIFqjtppg17w== -o context=system_u:object_r:root_t:s0 172.21.15.46:6789:/scratch /tmp/tmp.KrMG67MsYpscratch 2023-07-05T20:06:39.361 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T20:06:39.756 INFO:teuthology.orchestra.run.smithi046.stdout:generic/246 0s 2023-07-05T20:06:39.760 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/246 2023-07-05T20:06:39.761 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-07-05T20:06:39.762 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T20:06:40.068 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-05T20:06:40.068 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.rlt8E1h3iVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/247) 2023-07-05T20:06:40.417 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph 2023-07-05T20:06:40.422 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-05T20:06:40.422 INFO:teuthology.orchestra.run.smithi046.stdout:MKFS_OPTIONS -- 172.21.15.46:6789:/scratch 2023-07-05T20:06:40.422 INFO:teuthology.orchestra.run.smithi046.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCbvKVkpp1TIhAAvJTELoeH8wkIFqjtppg17w== -o context=system_u:object_r:root_t:s0 172.21.15.46:6789:/scratch /tmp/tmp.KrMG67MsYpscratch 2023-07-05T20:06:40.423 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T20:06:46.892 INFO:teuthology.orchestra.run.smithi046.stdout:generic/247 6s 2023-07-05T20:06:46.897 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/247 2023-07-05T20:06:46.897 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-07-05T20:06:46.899 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T20:06:46.907 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-05T20:06:46.908 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.rlt8E1h3iVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/248) 2023-07-05T20:06:47.134 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph 2023-07-05T20:06:47.138 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-05T20:06:47.139 INFO:teuthology.orchestra.run.smithi046.stdout:MKFS_OPTIONS -- 172.21.15.46:6789:/scratch 2023-07-05T20:06:47.139 INFO:teuthology.orchestra.run.smithi046.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCbvKVkpp1TIhAAvJTELoeH8wkIFqjtppg17w== -o context=system_u:object_r:root_t:s0 172.21.15.46:6789:/scratch /tmp/tmp.KrMG67MsYpscratch 2023-07-05T20:06:47.139 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T20:06:47.514 INFO:teuthology.orchestra.run.smithi046.stdout:generic/248 0s 2023-07-05T20:06:47.520 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/248 2023-07-05T20:06:47.520 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-07-05T20:06:47.522 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T20:06:47.565 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-05T20:06:47.566 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.rlt8E1h3iVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/249) 2023-07-05T20:06:47.786 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph 2023-07-05T20:06:47.790 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-05T20:06:47.791 INFO:teuthology.orchestra.run.smithi046.stdout:MKFS_OPTIONS -- 172.21.15.46:6789:/scratch 2023-07-05T20:06:47.792 INFO:teuthology.orchestra.run.smithi046.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCbvKVkpp1TIhAAvJTELoeH8wkIFqjtppg17w== -o context=system_u:object_r:root_t:s0 172.21.15.46:6789:/scratch /tmp/tmp.KrMG67MsYpscratch 2023-07-05T20:06:47.792 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T20:06:48.438 INFO:teuthology.orchestra.run.smithi046.stdout:generic/249 0s 2023-07-05T20:06:48.442 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/249 2023-07-05T20:06:48.443 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-07-05T20:06:48.445 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T20:06:48.776 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-05T20:06:48.776 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.rlt8E1h3iVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/250) 2023-07-05T20:06:49.094 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph 2023-07-05T20:06:49.098 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-05T20:06:49.099 INFO:teuthology.orchestra.run.smithi046.stdout:MKFS_OPTIONS -- 172.21.15.46:6789:/scratch 2023-07-05T20:06:49.099 INFO:teuthology.orchestra.run.smithi046.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCbvKVkpp1TIhAAvJTELoeH8wkIFqjtppg17w== -o context=system_u:object_r:root_t:s0 172.21.15.46:6789:/scratch /tmp/tmp.KrMG67MsYpscratch 2023-07-05T20:06:49.099 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T20:06:49.457 INFO:teuthology.orchestra.run.smithi046.stdout:generic/250 [not run] require 172.21.15.46:6789:/scratch to be valid block disk 2023-07-05T20:06:49.461 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/250 2023-07-05T20:06:49.461 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/250 2023-07-05T20:06:49.461 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-07-05T20:06:49.463 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T20:06:49.486 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-05T20:06:49.487 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.rlt8E1h3iVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/251) 2023-07-05T20:06:49.714 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph 2023-07-05T20:06:49.718 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-05T20:06:49.718 INFO:teuthology.orchestra.run.smithi046.stdout:MKFS_OPTIONS -- 172.21.15.46:6789:/scratch 2023-07-05T20:06:49.719 INFO:teuthology.orchestra.run.smithi046.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCbvKVkpp1TIhAAvJTELoeH8wkIFqjtppg17w== -o context=system_u:object_r:root_t:s0 172.21.15.46:6789:/scratch /tmp/tmp.KrMG67MsYpscratch 2023-07-05T20:06:49.719 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T20:06:50.257 INFO:teuthology.orchestra.run.smithi046.stdout:generic/251 [not run] FITRIM not supported on /tmp/tmp.KrMG67MsYpscratch 2023-07-05T20:06:50.281 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/251 2023-07-05T20:06:50.282 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/251 2023-07-05T20:06:50.282 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-07-05T20:06:50.283 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T20:06:50.304 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-05T20:06:50.305 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.rlt8E1h3iVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/252) 2023-07-05T20:06:50.532 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph 2023-07-05T20:06:50.536 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-05T20:06:50.536 INFO:teuthology.orchestra.run.smithi046.stdout:MKFS_OPTIONS -- 172.21.15.46:6789:/scratch 2023-07-05T20:06:50.537 INFO:teuthology.orchestra.run.smithi046.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCbvKVkpp1TIhAAvJTELoeH8wkIFqjtppg17w== -o context=system_u:object_r:root_t:s0 172.21.15.46:6789:/scratch /tmp/tmp.KrMG67MsYpscratch 2023-07-05T20:06:50.537 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T20:06:50.918 INFO:teuthology.orchestra.run.smithi046.stdout:generic/252 [not run] require 172.21.15.46:6789:/scratch to be valid block disk 2023-07-05T20:06:50.922 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/252 2023-07-05T20:06:50.922 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/252 2023-07-05T20:06:50.922 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-07-05T20:06:50.924 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T20:06:50.950 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-05T20:06:50.950 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.rlt8E1h3iVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/253) 2023-07-05T20:06:51.175 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph 2023-07-05T20:06:51.179 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-05T20:06:51.179 INFO:teuthology.orchestra.run.smithi046.stdout:MKFS_OPTIONS -- 172.21.15.46:6789:/scratch 2023-07-05T20:06:51.180 INFO:teuthology.orchestra.run.smithi046.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCbvKVkpp1TIhAAvJTELoeH8wkIFqjtppg17w== -o context=system_u:object_r:root_t:s0 172.21.15.46:6789:/scratch /tmp/tmp.KrMG67MsYpscratch 2023-07-05T20:06:51.180 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T20:06:52.064 INFO:teuthology.orchestra.run.smithi046.stdout:generic/253 [not run] Reflink not supported by scratch filesystem type: ceph 2023-07-05T20:06:52.075 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/253 2023-07-05T20:06:52.076 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/253 2023-07-05T20:06:52.076 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-07-05T20:06:52.096 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T20:06:52.162 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-05T20:06:52.163 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.rlt8E1h3iVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/254) 2023-07-05T20:06:52.407 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph 2023-07-05T20:06:52.412 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-05T20:06:52.412 INFO:teuthology.orchestra.run.smithi046.stdout:MKFS_OPTIONS -- 172.21.15.46:6789:/scratch 2023-07-05T20:06:52.413 INFO:teuthology.orchestra.run.smithi046.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCbvKVkpp1TIhAAvJTELoeH8wkIFqjtppg17w== -o context=system_u:object_r:root_t:s0 172.21.15.46:6789:/scratch /tmp/tmp.KrMG67MsYpscratch 2023-07-05T20:06:52.413 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T20:06:53.147 INFO:teuthology.orchestra.run.smithi046.stdout:generic/254 [not run] Reflink not supported by scratch filesystem type: ceph 2023-07-05T20:06:53.153 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/254 2023-07-05T20:06:53.154 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/254 2023-07-05T20:06:53.154 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-07-05T20:06:53.251 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T20:06:53.407 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-05T20:06:53.408 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.rlt8E1h3iVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/255) 2023-07-05T20:06:53.639 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph 2023-07-05T20:06:53.643 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-05T20:06:53.644 INFO:teuthology.orchestra.run.smithi046.stdout:MKFS_OPTIONS -- 172.21.15.46:6789:/scratch 2023-07-05T20:06:53.644 INFO:teuthology.orchestra.run.smithi046.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCbvKVkpp1TIhAAvJTELoeH8wkIFqjtppg17w== -o context=system_u:object_r:root_t:s0 172.21.15.46:6789:/scratch /tmp/tmp.KrMG67MsYpscratch 2023-07-05T20:06:53.645 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T20:06:54.120 INFO:teuthology.orchestra.run.smithi046.stdout:generic/255 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-07-05T20:06:54.123 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/255 2023-07-05T20:06:54.124 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/255 2023-07-05T20:06:54.124 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-07-05T20:06:54.126 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T20:06:54.534 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-05T20:06:54.535 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.rlt8E1h3iVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/256) 2023-07-05T20:06:54.789 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph 2023-07-05T20:06:54.793 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-05T20:06:54.794 INFO:teuthology.orchestra.run.smithi046.stdout:MKFS_OPTIONS -- 172.21.15.46:6789:/scratch 2023-07-05T20:06:54.795 INFO:teuthology.orchestra.run.smithi046.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCbvKVkpp1TIhAAvJTELoeH8wkIFqjtppg17w== -o context=system_u:object_r:root_t:s0 172.21.15.46:6789:/scratch /tmp/tmp.KrMG67MsYpscratch 2023-07-05T20:06:54.795 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T20:06:55.336 INFO:teuthology.orchestra.run.smithi046.stdout:generic/256 [not run] Filesystem ceph not supported in _scratch_mkfs_sized 2023-07-05T20:06:55.341 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/256 2023-07-05T20:06:55.341 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/256 2023-07-05T20:06:55.341 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-07-05T20:06:55.343 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T20:06:55.378 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-05T20:06:55.378 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.rlt8E1h3iVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/257) 2023-07-05T20:06:55.606 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph 2023-07-05T20:06:55.610 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-05T20:06:55.610 INFO:teuthology.orchestra.run.smithi046.stdout:MKFS_OPTIONS -- 172.21.15.46:6789:/scratch 2023-07-05T20:06:55.611 INFO:teuthology.orchestra.run.smithi046.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCbvKVkpp1TIhAAvJTELoeH8wkIFqjtppg17w== -o context=system_u:object_r:root_t:s0 172.21.15.46:6789:/scratch /tmp/tmp.KrMG67MsYpscratch 2023-07-05T20:06:55.611 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T20:06:56.510 INFO:teuthology.orchestra.run.smithi046.stdout:generic/257 1s 2023-07-05T20:06:56.515 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/257 2023-07-05T20:06:56.515 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-07-05T20:06:56.517 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T20:06:56.974 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-05T20:06:56.975 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.rlt8E1h3iVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/258) 2023-07-05T20:06:57.361 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph 2023-07-05T20:06:57.365 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-05T20:06:57.365 INFO:teuthology.orchestra.run.smithi046.stdout:MKFS_OPTIONS -- 172.21.15.46:6789:/scratch 2023-07-05T20:06:57.366 INFO:teuthology.orchestra.run.smithi046.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCbvKVkpp1TIhAAvJTELoeH8wkIFqjtppg17w== -o context=system_u:object_r:root_t:s0 172.21.15.46:6789:/scratch /tmp/tmp.KrMG67MsYpscratch 2023-07-05T20:06:57.366 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T20:06:57.703 INFO:teuthology.orchestra.run.smithi046.stdout:generic/258 [not run] ceph does not support negative timestamps 2023-07-05T20:06:57.707 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/258 2023-07-05T20:06:57.707 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/258 2023-07-05T20:06:57.707 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-07-05T20:06:57.709 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T20:06:57.735 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-05T20:06:57.736 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.rlt8E1h3iVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/259) 2023-07-05T20:06:57.961 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph 2023-07-05T20:06:57.966 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-05T20:06:57.966 INFO:teuthology.orchestra.run.smithi046.stdout:MKFS_OPTIONS -- 172.21.15.46:6789:/scratch 2023-07-05T20:06:57.967 INFO:teuthology.orchestra.run.smithi046.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCbvKVkpp1TIhAAvJTELoeH8wkIFqjtppg17w== -o context=system_u:object_r:root_t:s0 172.21.15.46:6789:/scratch /tmp/tmp.KrMG67MsYpscratch 2023-07-05T20:06:57.967 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T20:06:58.835 INFO:teuthology.orchestra.run.smithi046.stdout:generic/259 [not run] Reflink not supported by scratch filesystem type: ceph 2023-07-05T20:06:58.853 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/259 2023-07-05T20:06:58.853 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/259 2023-07-05T20:06:58.853 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-07-05T20:06:58.863 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T20:06:58.923 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-05T20:06:58.923 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.rlt8E1h3iVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/260) 2023-07-05T20:06:59.187 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph 2023-07-05T20:06:59.190 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-05T20:06:59.191 INFO:teuthology.orchestra.run.smithi046.stdout:MKFS_OPTIONS -- 172.21.15.46:6789:/scratch 2023-07-05T20:06:59.192 INFO:teuthology.orchestra.run.smithi046.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCbvKVkpp1TIhAAvJTELoeH8wkIFqjtppg17w== -o context=system_u:object_r:root_t:s0 172.21.15.46:6789:/scratch /tmp/tmp.KrMG67MsYpscratch 2023-07-05T20:06:59.192 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T20:06:59.720 INFO:teuthology.orchestra.run.smithi046.stdout:generic/260 [not run] FITRIM not supported on /tmp/tmp.KrMG67MsYpscratch 2023-07-05T20:06:59.738 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/260 2023-07-05T20:06:59.739 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/260 2023-07-05T20:06:59.739 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-07-05T20:06:59.740 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T20:06:59.763 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-05T20:06:59.763 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.rlt8E1h3iVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/261) 2023-07-05T20:06:59.991 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph 2023-07-05T20:06:59.995 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-05T20:06:59.996 INFO:teuthology.orchestra.run.smithi046.stdout:MKFS_OPTIONS -- 172.21.15.46:6789:/scratch 2023-07-05T20:06:59.996 INFO:teuthology.orchestra.run.smithi046.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCbvKVkpp1TIhAAvJTELoeH8wkIFqjtppg17w== -o context=system_u:object_r:root_t:s0 172.21.15.46:6789:/scratch /tmp/tmp.KrMG67MsYpscratch 2023-07-05T20:06:59.997 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T20:07:00.891 INFO:teuthology.orchestra.run.smithi046.stdout:generic/261 [not run] Reflink not supported by scratch filesystem type: ceph 2023-07-05T20:07:00.945 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/261 2023-07-05T20:07:00.946 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/261 2023-07-05T20:07:00.946 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-07-05T20:07:00.947 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T20:07:00.972 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-05T20:07:00.973 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.rlt8E1h3iVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/262) 2023-07-05T20:07:01.206 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph 2023-07-05T20:07:01.210 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-05T20:07:01.210 INFO:teuthology.orchestra.run.smithi046.stdout:MKFS_OPTIONS -- 172.21.15.46:6789:/scratch 2023-07-05T20:07:01.211 INFO:teuthology.orchestra.run.smithi046.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCbvKVkpp1TIhAAvJTELoeH8wkIFqjtppg17w== -o context=system_u:object_r:root_t:s0 172.21.15.46:6789:/scratch /tmp/tmp.KrMG67MsYpscratch 2023-07-05T20:07:01.211 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T20:07:02.106 INFO:teuthology.orchestra.run.smithi046.stdout:generic/262 [not run] Reflink not supported by scratch filesystem type: ceph 2023-07-05T20:07:02.159 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/262 2023-07-05T20:07:02.159 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/262 2023-07-05T20:07:02.159 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-07-05T20:07:02.161 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T20:07:02.197 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-05T20:07:02.198 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.rlt8E1h3iVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/263) 2023-07-05T20:07:02.429 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph 2023-07-05T20:07:02.433 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-05T20:07:02.433 INFO:teuthology.orchestra.run.smithi046.stdout:MKFS_OPTIONS -- 172.21.15.46:6789:/scratch 2023-07-05T20:07:02.434 INFO:teuthology.orchestra.run.smithi046.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCbvKVkpp1TIhAAvJTELoeH8wkIFqjtppg17w== -o context=system_u:object_r:root_t:s0 172.21.15.46:6789:/scratch /tmp/tmp.KrMG67MsYpscratch 2023-07-05T20:07:02.435 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T20:07:35.236 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-05T20:07:35.239 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-05T20:07:35.287 INFO:tasks.ceph.mds.b.smithi073.stderr:2023-07-05T20:07:35.286+0000 7f1ff165c700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 114256) UID: 0 2023-07-05T20:07:35.287 INFO:tasks.ceph.mds.d.smithi073.stderr:2023-07-05T20:07:35.286+0000 7f07b5126700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 114256) UID: 0 2023-07-05T20:07:38.717 INFO:teuthology.orchestra.run.smithi046.stdout:generic/263 36s 2023-07-05T20:07:38.722 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/263 2023-07-05T20:07:38.722 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-07-05T20:07:38.724 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T20:07:39.095 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-05T20:07:39.096 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.rlt8E1h3iVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/264) 2023-07-05T20:07:39.335 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph 2023-07-05T20:07:39.339 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-05T20:07:39.340 INFO:teuthology.orchestra.run.smithi046.stdout:MKFS_OPTIONS -- 172.21.15.46:6789:/scratch 2023-07-05T20:07:39.341 INFO:teuthology.orchestra.run.smithi046.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCbvKVkpp1TIhAAvJTELoeH8wkIFqjtppg17w== -o context=system_u:object_r:root_t:s0 172.21.15.46:6789:/scratch /tmp/tmp.KrMG67MsYpscratch 2023-07-05T20:07:39.341 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T20:07:40.231 INFO:teuthology.orchestra.run.smithi046.stdout:generic/264 [not run] Reflink not supported by scratch filesystem type: ceph 2023-07-05T20:07:40.236 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/264 2023-07-05T20:07:40.237 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/264 2023-07-05T20:07:40.237 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-07-05T20:07:40.240 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T20:07:40.280 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-05T20:07:40.281 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.rlt8E1h3iVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/265) 2023-07-05T20:07:40.509 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph 2023-07-05T20:07:40.514 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-05T20:07:40.514 INFO:teuthology.orchestra.run.smithi046.stdout:MKFS_OPTIONS -- 172.21.15.46:6789:/scratch 2023-07-05T20:07:40.515 INFO:teuthology.orchestra.run.smithi046.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCbvKVkpp1TIhAAvJTELoeH8wkIFqjtppg17w== -o context=system_u:object_r:root_t:s0 172.21.15.46:6789:/scratch /tmp/tmp.KrMG67MsYpscratch 2023-07-05T20:07:40.515 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T20:07:41.324 INFO:teuthology.orchestra.run.smithi046.stdout:generic/265 [not run] Reflink not supported by scratch filesystem type: ceph 2023-07-05T20:07:41.444 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/265 2023-07-05T20:07:41.445 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/265 2023-07-05T20:07:41.445 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-07-05T20:07:41.451 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T20:07:41.506 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-05T20:07:41.506 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.rlt8E1h3iVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/266) 2023-07-05T20:07:41.741 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph 2023-07-05T20:07:41.745 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-05T20:07:41.746 INFO:teuthology.orchestra.run.smithi046.stdout:MKFS_OPTIONS -- 172.21.15.46:6789:/scratch 2023-07-05T20:07:41.746 INFO:teuthology.orchestra.run.smithi046.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCbvKVkpp1TIhAAvJTELoeH8wkIFqjtppg17w== -o context=system_u:object_r:root_t:s0 172.21.15.46:6789:/scratch /tmp/tmp.KrMG67MsYpscratch 2023-07-05T20:07:41.747 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T20:07:42.634 INFO:teuthology.orchestra.run.smithi046.stdout:generic/266 [not run] Reflink not supported by scratch filesystem type: ceph 2023-07-05T20:07:42.645 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/266 2023-07-05T20:07:42.645 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/266 2023-07-05T20:07:42.645 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-07-05T20:07:42.683 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T20:07:42.725 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-05T20:07:42.725 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.rlt8E1h3iVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/267) 2023-07-05T20:07:42.955 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph 2023-07-05T20:07:42.959 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-05T20:07:42.959 INFO:teuthology.orchestra.run.smithi046.stdout:MKFS_OPTIONS -- 172.21.15.46:6789:/scratch 2023-07-05T20:07:42.960 INFO:teuthology.orchestra.run.smithi046.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCbvKVkpp1TIhAAvJTELoeH8wkIFqjtppg17w== -o context=system_u:object_r:root_t:s0 172.21.15.46:6789:/scratch /tmp/tmp.KrMG67MsYpscratch 2023-07-05T20:07:42.960 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T20:07:43.879 INFO:teuthology.orchestra.run.smithi046.stdout:generic/267 [not run] Reflink not supported by scratch filesystem type: ceph 2023-07-05T20:07:43.887 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/267 2023-07-05T20:07:43.887 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/267 2023-07-05T20:07:43.888 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-07-05T20:07:43.891 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T20:07:43.937 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-05T20:07:43.938 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.rlt8E1h3iVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/268) 2023-07-05T20:07:44.171 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph 2023-07-05T20:07:44.175 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-05T20:07:44.176 INFO:teuthology.orchestra.run.smithi046.stdout:MKFS_OPTIONS -- 172.21.15.46:6789:/scratch 2023-07-05T20:07:44.177 INFO:teuthology.orchestra.run.smithi046.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCbvKVkpp1TIhAAvJTELoeH8wkIFqjtppg17w== -o context=system_u:object_r:root_t:s0 172.21.15.46:6789:/scratch /tmp/tmp.KrMG67MsYpscratch 2023-07-05T20:07:44.177 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T20:07:45.011 INFO:teuthology.orchestra.run.smithi046.stdout:generic/268 [not run] Reflink not supported by scratch filesystem type: ceph 2023-07-05T20:07:45.018 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/268 2023-07-05T20:07:45.019 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/268 2023-07-05T20:07:45.019 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-07-05T20:07:45.083 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T20:07:45.155 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-05T20:07:45.155 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.rlt8E1h3iVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/269) 2023-07-05T20:07:45.382 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph 2023-07-05T20:07:45.386 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-05T20:07:45.386 INFO:teuthology.orchestra.run.smithi046.stdout:MKFS_OPTIONS -- 172.21.15.46:6789:/scratch 2023-07-05T20:07:45.387 INFO:teuthology.orchestra.run.smithi046.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCbvKVkpp1TIhAAvJTELoeH8wkIFqjtppg17w== -o context=system_u:object_r:root_t:s0 172.21.15.46:6789:/scratch /tmp/tmp.KrMG67MsYpscratch 2023-07-05T20:07:45.388 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T20:07:45.751 INFO:teuthology.orchestra.run.smithi046.stdout:generic/269 [not run] Filesystem ceph not supported in _scratch_mkfs_sized 2023-07-05T20:07:45.755 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/269 2023-07-05T20:07:45.755 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/269 2023-07-05T20:07:45.756 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-07-05T20:07:45.757 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T20:07:45.784 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-05T20:07:45.784 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.rlt8E1h3iVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/270) 2023-07-05T20:07:46.008 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph 2023-07-05T20:07:46.012 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-05T20:07:46.013 INFO:teuthology.orchestra.run.smithi046.stdout:MKFS_OPTIONS -- 172.21.15.46:6789:/scratch 2023-07-05T20:07:46.014 INFO:teuthology.orchestra.run.smithi046.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCbvKVkpp1TIhAAvJTELoeH8wkIFqjtppg17w== -o context=system_u:object_r:root_t:s0 172.21.15.46:6789:/scratch /tmp/tmp.KrMG67MsYpscratch 2023-07-05T20:07:46.014 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T20:07:46.345 INFO:teuthology.orchestra.run.smithi046.stdout:generic/270 [not run] disk quotas not supported by this filesystem type: ceph 2023-07-05T20:07:46.349 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/270 2023-07-05T20:07:46.350 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/270 2023-07-05T20:07:46.350 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-07-05T20:07:46.352 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T20:07:46.373 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-05T20:07:46.374 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.rlt8E1h3iVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/271) 2023-07-05T20:07:46.615 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph 2023-07-05T20:07:46.619 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-05T20:07:46.620 INFO:teuthology.orchestra.run.smithi046.stdout:MKFS_OPTIONS -- 172.21.15.46:6789:/scratch 2023-07-05T20:07:46.621 INFO:teuthology.orchestra.run.smithi046.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCbvKVkpp1TIhAAvJTELoeH8wkIFqjtppg17w== -o context=system_u:object_r:root_t:s0 172.21.15.46:6789:/scratch /tmp/tmp.KrMG67MsYpscratch 2023-07-05T20:07:46.621 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T20:07:47.393 INFO:teuthology.orchestra.run.smithi046.stdout:generic/271 [not run] Reflink not supported by scratch filesystem type: ceph 2023-07-05T20:07:47.399 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/271 2023-07-05T20:07:47.399 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/271 2023-07-05T20:07:47.400 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-07-05T20:07:47.476 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T20:07:47.578 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-05T20:07:47.579 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.rlt8E1h3iVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/272) 2023-07-05T20:07:47.805 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph 2023-07-05T20:07:47.809 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-05T20:07:47.810 INFO:teuthology.orchestra.run.smithi046.stdout:MKFS_OPTIONS -- 172.21.15.46:6789:/scratch 2023-07-05T20:07:47.811 INFO:teuthology.orchestra.run.smithi046.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCbvKVkpp1TIhAAvJTELoeH8wkIFqjtppg17w== -o context=system_u:object_r:root_t:s0 172.21.15.46:6789:/scratch /tmp/tmp.KrMG67MsYpscratch 2023-07-05T20:07:47.811 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T20:07:48.653 INFO:teuthology.orchestra.run.smithi046.stdout:generic/272 [not run] Reflink not supported by scratch filesystem type: ceph 2023-07-05T20:07:48.694 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/272 2023-07-05T20:07:48.694 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/272 2023-07-05T20:07:48.695 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-07-05T20:07:48.698 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T20:07:48.771 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-05T20:07:48.772 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.rlt8E1h3iVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/273) 2023-07-05T20:07:49.000 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph 2023-07-05T20:07:49.004 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-05T20:07:49.005 INFO:teuthology.orchestra.run.smithi046.stdout:MKFS_OPTIONS -- 172.21.15.46:6789:/scratch 2023-07-05T20:07:49.006 INFO:teuthology.orchestra.run.smithi046.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCbvKVkpp1TIhAAvJTELoeH8wkIFqjtppg17w== -o context=system_u:object_r:root_t:s0 172.21.15.46:6789:/scratch /tmp/tmp.KrMG67MsYpscratch 2023-07-05T20:07:49.006 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T20:07:49.354 INFO:teuthology.orchestra.run.smithi046.stdout:generic/273 [not run] Filesystem ceph not supported in _scratch_mkfs_sized 2023-07-05T20:07:49.358 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/273 2023-07-05T20:07:49.358 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/273 2023-07-05T20:07:49.358 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-07-05T20:07:49.361 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T20:07:49.391 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-05T20:07:49.391 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.rlt8E1h3iVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/274) 2023-07-05T20:07:49.631 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph 2023-07-05T20:07:49.635 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-05T20:07:49.636 INFO:teuthology.orchestra.run.smithi046.stdout:MKFS_OPTIONS -- 172.21.15.46:6789:/scratch 2023-07-05T20:07:49.637 INFO:teuthology.orchestra.run.smithi046.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCbvKVkpp1TIhAAvJTELoeH8wkIFqjtppg17w== -o context=system_u:object_r:root_t:s0 172.21.15.46:6789:/scratch /tmp/tmp.KrMG67MsYpscratch 2023-07-05T20:07:49.637 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T20:07:49.984 INFO:teuthology.orchestra.run.smithi046.stdout:generic/274 [not run] xfs_io falloc -k failed (old kernel/wrong fs?) 2023-07-05T20:07:49.988 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/274 2023-07-05T20:07:49.988 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/274 2023-07-05T20:07:49.988 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-07-05T20:07:49.990 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T20:07:50.023 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-05T20:07:50.024 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.rlt8E1h3iVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/275) 2023-07-05T20:07:50.263 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph 2023-07-05T20:07:50.267 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-05T20:07:50.267 INFO:teuthology.orchestra.run.smithi046.stdout:MKFS_OPTIONS -- 172.21.15.46:6789:/scratch 2023-07-05T20:07:50.268 INFO:teuthology.orchestra.run.smithi046.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCbvKVkpp1TIhAAvJTELoeH8wkIFqjtppg17w== -o context=system_u:object_r:root_t:s0 172.21.15.46:6789:/scratch /tmp/tmp.KrMG67MsYpscratch 2023-07-05T20:07:50.269 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T20:07:50.605 INFO:teuthology.orchestra.run.smithi046.stdout:generic/275 [not run] Filesystem ceph not supported in _scratch_mkfs_sized 2023-07-05T20:07:50.609 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/275 2023-07-05T20:07:50.609 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/275 2023-07-05T20:07:50.609 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-07-05T20:07:50.611 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T20:07:50.637 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-05T20:07:50.638 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.rlt8E1h3iVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/276) 2023-07-05T20:07:50.865 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph 2023-07-05T20:07:50.869 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-05T20:07:50.870 INFO:teuthology.orchestra.run.smithi046.stdout:MKFS_OPTIONS -- 172.21.15.46:6789:/scratch 2023-07-05T20:07:50.871 INFO:teuthology.orchestra.run.smithi046.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCbvKVkpp1TIhAAvJTELoeH8wkIFqjtppg17w== -o context=system_u:object_r:root_t:s0 172.21.15.46:6789:/scratch /tmp/tmp.KrMG67MsYpscratch 2023-07-05T20:07:50.871 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T20:07:51.680 INFO:teuthology.orchestra.run.smithi046.stdout:generic/276 [not run] Reflink not supported by scratch filesystem type: ceph 2023-07-05T20:07:51.686 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/276 2023-07-05T20:07:51.686 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/276 2023-07-05T20:07:51.687 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-07-05T20:07:51.689 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T20:07:51.813 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-05T20:07:51.814 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.rlt8E1h3iVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/277) 2023-07-05T20:07:52.058 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph 2023-07-05T20:07:52.063 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-05T20:07:52.063 INFO:teuthology.orchestra.run.smithi046.stdout:MKFS_OPTIONS -- 172.21.15.46:6789:/scratch 2023-07-05T20:07:52.064 INFO:teuthology.orchestra.run.smithi046.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCbvKVkpp1TIhAAvJTELoeH8wkIFqjtppg17w== -o context=system_u:object_r:root_t:s0 172.21.15.46:6789:/scratch /tmp/tmp.KrMG67MsYpscratch 2023-07-05T20:07:52.065 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T20:07:52.446 INFO:teuthology.orchestra.run.smithi046.stdout:generic/277 [not run] file system doesn't support chattr +A 2023-07-05T20:07:52.451 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/277 2023-07-05T20:07:52.451 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/277 2023-07-05T20:07:52.451 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-07-05T20:07:52.453 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T20:07:52.487 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-05T20:07:52.487 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.rlt8E1h3iVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/278) 2023-07-05T20:07:52.709 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph 2023-07-05T20:07:52.713 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-05T20:07:52.713 INFO:teuthology.orchestra.run.smithi046.stdout:MKFS_OPTIONS -- 172.21.15.46:6789:/scratch 2023-07-05T20:07:52.714 INFO:teuthology.orchestra.run.smithi046.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCbvKVkpp1TIhAAvJTELoeH8wkIFqjtppg17w== -o context=system_u:object_r:root_t:s0 172.21.15.46:6789:/scratch /tmp/tmp.KrMG67MsYpscratch 2023-07-05T20:07:52.715 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T20:07:53.575 INFO:teuthology.orchestra.run.smithi046.stdout:generic/278 [not run] Reflink not supported by scratch filesystem type: ceph 2023-07-05T20:07:53.584 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/278 2023-07-05T20:07:53.584 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/278 2023-07-05T20:07:53.585 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-07-05T20:07:53.588 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T20:07:53.674 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-05T20:07:53.674 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.rlt8E1h3iVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/279) 2023-07-05T20:07:53.910 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph 2023-07-05T20:07:53.914 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-05T20:07:53.915 INFO:teuthology.orchestra.run.smithi046.stdout:MKFS_OPTIONS -- 172.21.15.46:6789:/scratch 2023-07-05T20:07:53.916 INFO:teuthology.orchestra.run.smithi046.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCbvKVkpp1TIhAAvJTELoeH8wkIFqjtppg17w== -o context=system_u:object_r:root_t:s0 172.21.15.46:6789:/scratch /tmp/tmp.KrMG67MsYpscratch 2023-07-05T20:07:53.916 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T20:07:54.670 INFO:teuthology.orchestra.run.smithi046.stdout:generic/279 [not run] Reflink not supported by scratch filesystem type: ceph 2023-07-05T20:07:54.676 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/279 2023-07-05T20:07:54.676 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/279 2023-07-05T20:07:54.676 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-07-05T20:07:54.696 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T20:07:54.839 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-05T20:07:54.840 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.rlt8E1h3iVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/280) 2023-07-05T20:07:55.077 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph 2023-07-05T20:07:55.081 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-05T20:07:55.082 INFO:teuthology.orchestra.run.smithi046.stdout:MKFS_OPTIONS -- 172.21.15.46:6789:/scratch 2023-07-05T20:07:55.083 INFO:teuthology.orchestra.run.smithi046.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCbvKVkpp1TIhAAvJTELoeH8wkIFqjtppg17w== -o context=system_u:object_r:root_t:s0 172.21.15.46:6789:/scratch /tmp/tmp.KrMG67MsYpscratch 2023-07-05T20:07:55.083 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T20:07:55.451 INFO:teuthology.orchestra.run.smithi046.stdout:generic/280 [not run] disk quotas not supported by this filesystem type: ceph 2023-07-05T20:07:55.455 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/280 2023-07-05T20:07:55.456 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/280 2023-07-05T20:07:55.456 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-07-05T20:07:55.457 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T20:07:55.488 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-05T20:07:55.489 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.rlt8E1h3iVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/281) 2023-07-05T20:07:55.715 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph 2023-07-05T20:07:55.719 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-05T20:07:55.719 INFO:teuthology.orchestra.run.smithi046.stdout:MKFS_OPTIONS -- 172.21.15.46:6789:/scratch 2023-07-05T20:07:55.720 INFO:teuthology.orchestra.run.smithi046.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCbvKVkpp1TIhAAvJTELoeH8wkIFqjtppg17w== -o context=system_u:object_r:root_t:s0 172.21.15.46:6789:/scratch /tmp/tmp.KrMG67MsYpscratch 2023-07-05T20:07:55.721 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T20:07:56.574 INFO:teuthology.orchestra.run.smithi046.stdout:generic/281 [not run] Reflink not supported by scratch filesystem type: ceph 2023-07-05T20:07:56.632 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/281 2023-07-05T20:07:56.632 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/281 2023-07-05T20:07:56.633 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-07-05T20:07:56.644 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T20:07:56.681 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-05T20:07:56.682 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.rlt8E1h3iVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/282) 2023-07-05T20:07:56.913 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph 2023-07-05T20:07:56.917 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-05T20:07:56.918 INFO:teuthology.orchestra.run.smithi046.stdout:MKFS_OPTIONS -- 172.21.15.46:6789:/scratch 2023-07-05T20:07:56.919 INFO:teuthology.orchestra.run.smithi046.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCbvKVkpp1TIhAAvJTELoeH8wkIFqjtppg17w== -o context=system_u:object_r:root_t:s0 172.21.15.46:6789:/scratch /tmp/tmp.KrMG67MsYpscratch 2023-07-05T20:07:56.919 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T20:07:57.795 INFO:teuthology.orchestra.run.smithi046.stdout:generic/282 [not run] Reflink not supported by scratch filesystem type: ceph 2023-07-05T20:07:57.800 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/282 2023-07-05T20:07:57.801 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/282 2023-07-05T20:07:57.801 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-07-05T20:07:57.803 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T20:07:57.861 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-05T20:07:57.862 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.rlt8E1h3iVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/283) 2023-07-05T20:07:58.094 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph 2023-07-05T20:07:58.098 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-05T20:07:58.099 INFO:teuthology.orchestra.run.smithi046.stdout:MKFS_OPTIONS -- 172.21.15.46:6789:/scratch 2023-07-05T20:07:58.100 INFO:teuthology.orchestra.run.smithi046.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCbvKVkpp1TIhAAvJTELoeH8wkIFqjtppg17w== -o context=system_u:object_r:root_t:s0 172.21.15.46:6789:/scratch /tmp/tmp.KrMG67MsYpscratch 2023-07-05T20:07:58.100 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T20:07:59.040 INFO:teuthology.orchestra.run.smithi046.stdout:generic/283 [not run] Reflink not supported by scratch filesystem type: ceph 2023-07-05T20:07:59.059 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/283 2023-07-05T20:07:59.060 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/283 2023-07-05T20:07:59.060 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-07-05T20:07:59.062 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T20:07:59.104 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-05T20:07:59.105 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.rlt8E1h3iVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/284) 2023-07-05T20:07:59.332 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph 2023-07-05T20:07:59.336 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-05T20:07:59.336 INFO:teuthology.orchestra.run.smithi046.stdout:MKFS_OPTIONS -- 172.21.15.46:6789:/scratch 2023-07-05T20:07:59.337 INFO:teuthology.orchestra.run.smithi046.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCbvKVkpp1TIhAAvJTELoeH8wkIFqjtppg17w== -o context=system_u:object_r:root_t:s0 172.21.15.46:6789:/scratch /tmp/tmp.KrMG67MsYpscratch 2023-07-05T20:07:59.338 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T20:08:00.191 INFO:teuthology.orchestra.run.smithi046.stdout:generic/284 [not run] Reflink not supported by scratch filesystem type: ceph 2023-07-05T20:08:00.241 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/284 2023-07-05T20:08:00.241 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/284 2023-07-05T20:08:00.241 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-07-05T20:08:00.261 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T20:08:00.327 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-05T20:08:00.328 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.rlt8E1h3iVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/285) 2023-07-05T20:08:00.552 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph 2023-07-05T20:08:00.556 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-05T20:08:00.556 INFO:teuthology.orchestra.run.smithi046.stdout:MKFS_OPTIONS -- 172.21.15.46:6789:/scratch 2023-07-05T20:08:00.557 INFO:teuthology.orchestra.run.smithi046.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCbvKVkpp1TIhAAvJTELoeH8wkIFqjtppg17w== -o context=system_u:object_r:root_t:s0 172.21.15.46:6789:/scratch /tmp/tmp.KrMG67MsYpscratch 2023-07-05T20:08:00.558 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T20:08:01.933 INFO:teuthology.orchestra.run.smithi046.stdout:generic/285 1s 2023-07-05T20:08:01.938 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/285 2023-07-05T20:08:01.938 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-07-05T20:08:01.940 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T20:08:02.540 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-05T20:08:02.541 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.rlt8E1h3iVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/286) 2023-07-05T20:08:02.911 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph 2023-07-05T20:08:02.915 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-05T20:08:02.916 INFO:teuthology.orchestra.run.smithi046.stdout:MKFS_OPTIONS -- 172.21.15.46:6789:/scratch 2023-07-05T20:08:02.917 INFO:teuthology.orchestra.run.smithi046.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCbvKVkpp1TIhAAvJTELoeH8wkIFqjtppg17w== -o context=system_u:object_r:root_t:s0 172.21.15.46:6789:/scratch /tmp/tmp.KrMG67MsYpscratch 2023-07-05T20:08:02.917 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T20:08:03.431 INFO:teuthology.orchestra.run.smithi046.stdout:generic/286 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-07-05T20:08:03.437 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/286 2023-07-05T20:08:03.437 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/286 2023-07-05T20:08:03.437 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-07-05T20:08:03.439 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T20:08:03.489 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-05T20:08:03.490 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.rlt8E1h3iVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/287) 2023-07-05T20:08:03.857 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph 2023-07-05T20:08:03.861 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-05T20:08:03.862 INFO:teuthology.orchestra.run.smithi046.stdout:MKFS_OPTIONS -- 172.21.15.46:6789:/scratch 2023-07-05T20:08:03.863 INFO:teuthology.orchestra.run.smithi046.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCbvKVkpp1TIhAAvJTELoeH8wkIFqjtppg17w== -o context=system_u:object_r:root_t:s0 172.21.15.46:6789:/scratch /tmp/tmp.KrMG67MsYpscratch 2023-07-05T20:08:03.863 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T20:08:05.019 INFO:teuthology.orchestra.run.smithi046.stdout:generic/287 [not run] Reflink not supported by scratch filesystem type: ceph 2023-07-05T20:08:05.024 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/287 2023-07-05T20:08:05.025 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/287 2023-07-05T20:08:05.025 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-07-05T20:08:05.051 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T20:08:05.085 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-05T20:08:05.085 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.rlt8E1h3iVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/288) 2023-07-05T20:08:05.400 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph 2023-07-05T20:08:05.405 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-05T20:08:05.405 INFO:teuthology.orchestra.run.smithi046.stdout:MKFS_OPTIONS -- 172.21.15.46:6789:/scratch 2023-07-05T20:08:05.406 INFO:teuthology.orchestra.run.smithi046.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCbvKVkpp1TIhAAvJTELoeH8wkIFqjtppg17w== -o context=system_u:object_r:root_t:s0 172.21.15.46:6789:/scratch /tmp/tmp.KrMG67MsYpscratch 2023-07-05T20:08:05.407 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T20:08:06.177 INFO:teuthology.orchestra.run.smithi046.stdout:generic/288 [not run] FITRIM not supported on /tmp/tmp.KrMG67MsYpscratch 2023-07-05T20:08:06.202 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/288 2023-07-05T20:08:06.203 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/288 2023-07-05T20:08:06.203 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-07-05T20:08:06.205 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T20:08:06.236 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-05T20:08:06.237 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.rlt8E1h3iVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/289) 2023-07-05T20:08:06.619 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph 2023-07-05T20:08:06.625 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-05T20:08:06.626 INFO:teuthology.orchestra.run.smithi046.stdout:MKFS_OPTIONS -- 172.21.15.46:6789:/scratch 2023-07-05T20:08:06.627 INFO:teuthology.orchestra.run.smithi046.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCbvKVkpp1TIhAAvJTELoeH8wkIFqjtppg17w== -o context=system_u:object_r:root_t:s0 172.21.15.46:6789:/scratch /tmp/tmp.KrMG67MsYpscratch 2023-07-05T20:08:06.628 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T20:08:07.763 INFO:teuthology.orchestra.run.smithi046.stdout:generic/289 [not run] Reflink not supported by scratch filesystem type: ceph 2023-07-05T20:08:07.799 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/289 2023-07-05T20:08:07.800 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/289 2023-07-05T20:08:07.800 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-07-05T20:08:07.813 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T20:08:07.884 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-05T20:08:07.884 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.rlt8E1h3iVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/290) 2023-07-05T20:08:08.262 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph 2023-07-05T20:08:08.271 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-05T20:08:08.271 INFO:teuthology.orchestra.run.smithi046.stdout:MKFS_OPTIONS -- 172.21.15.46:6789:/scratch 2023-07-05T20:08:08.272 INFO:teuthology.orchestra.run.smithi046.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCbvKVkpp1TIhAAvJTELoeH8wkIFqjtppg17w== -o context=system_u:object_r:root_t:s0 172.21.15.46:6789:/scratch /tmp/tmp.KrMG67MsYpscratch 2023-07-05T20:08:08.273 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T20:08:09.329 INFO:teuthology.orchestra.run.smithi046.stdout:generic/290 [not run] Reflink not supported by scratch filesystem type: ceph 2023-07-05T20:08:09.334 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/290 2023-07-05T20:08:09.335 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/290 2023-07-05T20:08:09.335 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-07-05T20:08:09.340 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T20:08:09.392 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-05T20:08:09.393 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.rlt8E1h3iVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/291) 2023-07-05T20:08:09.618 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph 2023-07-05T20:08:09.622 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-05T20:08:09.623 INFO:teuthology.orchestra.run.smithi046.stdout:MKFS_OPTIONS -- 172.21.15.46:6789:/scratch 2023-07-05T20:08:09.624 INFO:teuthology.orchestra.run.smithi046.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCbvKVkpp1TIhAAvJTELoeH8wkIFqjtppg17w== -o context=system_u:object_r:root_t:s0 172.21.15.46:6789:/scratch /tmp/tmp.KrMG67MsYpscratch 2023-07-05T20:08:09.624 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T20:08:10.479 INFO:teuthology.orchestra.run.smithi046.stdout:generic/291 [not run] Reflink not supported by scratch filesystem type: ceph 2023-07-05T20:08:10.556 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/291 2023-07-05T20:08:10.557 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/291 2023-07-05T20:08:10.557 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-07-05T20:08:10.572 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T20:08:10.614 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-05T20:08:10.614 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.rlt8E1h3iVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/292) 2023-07-05T20:08:10.842 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph 2023-07-05T20:08:10.846 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-05T20:08:10.847 INFO:teuthology.orchestra.run.smithi046.stdout:MKFS_OPTIONS -- 172.21.15.46:6789:/scratch 2023-07-05T20:08:10.847 INFO:teuthology.orchestra.run.smithi046.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCbvKVkpp1TIhAAvJTELoeH8wkIFqjtppg17w== -o context=system_u:object_r:root_t:s0 172.21.15.46:6789:/scratch /tmp/tmp.KrMG67MsYpscratch 2023-07-05T20:08:10.847 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T20:08:11.698 INFO:teuthology.orchestra.run.smithi046.stdout:generic/292 [not run] Reflink not supported by scratch filesystem type: ceph 2023-07-05T20:08:11.744 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/292 2023-07-05T20:08:11.744 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/292 2023-07-05T20:08:11.745 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-07-05T20:08:11.823 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T20:08:11.858 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-05T20:08:11.858 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.rlt8E1h3iVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/293) 2023-07-05T20:08:12.083 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph 2023-07-05T20:08:12.087 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-05T20:08:12.087 INFO:teuthology.orchestra.run.smithi046.stdout:MKFS_OPTIONS -- 172.21.15.46:6789:/scratch 2023-07-05T20:08:12.088 INFO:teuthology.orchestra.run.smithi046.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCbvKVkpp1TIhAAvJTELoeH8wkIFqjtppg17w== -o context=system_u:object_r:root_t:s0 172.21.15.46:6789:/scratch /tmp/tmp.KrMG67MsYpscratch 2023-07-05T20:08:12.088 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T20:08:12.959 INFO:teuthology.orchestra.run.smithi046.stdout:generic/293 [not run] Reflink not supported by scratch filesystem type: ceph 2023-07-05T20:08:12.977 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/293 2023-07-05T20:08:12.977 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/293 2023-07-05T20:08:12.977 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-07-05T20:08:13.007 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T20:08:13.058 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-05T20:08:13.059 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.rlt8E1h3iVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/294) 2023-07-05T20:08:13.282 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph 2023-07-05T20:08:13.286 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-05T20:08:13.287 INFO:teuthology.orchestra.run.smithi046.stdout:MKFS_OPTIONS -- 172.21.15.46:6789:/scratch 2023-07-05T20:08:13.287 INFO:teuthology.orchestra.run.smithi046.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCbvKVkpp1TIhAAvJTELoeH8wkIFqjtppg17w== -o context=system_u:object_r:root_t:s0 172.21.15.46:6789:/scratch /tmp/tmp.KrMG67MsYpscratch 2023-07-05T20:08:13.288 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T20:08:14.248 INFO:teuthology.orchestra.run.smithi046.stdout:generic/294 1s 2023-07-05T20:08:14.260 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/294 2023-07-05T20:08:14.260 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-07-05T20:08:14.262 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T20:08:14.272 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-05T20:08:14.272 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.rlt8E1h3iVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/295) 2023-07-05T20:08:14.510 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph 2023-07-05T20:08:14.514 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-05T20:08:14.514 INFO:teuthology.orchestra.run.smithi046.stdout:MKFS_OPTIONS -- 172.21.15.46:6789:/scratch 2023-07-05T20:08:14.515 INFO:teuthology.orchestra.run.smithi046.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCbvKVkpp1TIhAAvJTELoeH8wkIFqjtppg17w== -o context=system_u:object_r:root_t:s0 172.21.15.46:6789:/scratch /tmp/tmp.KrMG67MsYpscratch 2023-07-05T20:08:14.516 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T20:08:15.437 INFO:teuthology.orchestra.run.smithi046.stdout:generic/295 [not run] Reflink not supported by scratch filesystem type: ceph 2023-07-05T20:08:15.474 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/295 2023-07-05T20:08:15.475 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/295 2023-07-05T20:08:15.475 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-07-05T20:08:15.479 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T20:08:15.519 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-05T20:08:15.520 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.rlt8E1h3iVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/296) 2023-07-05T20:08:15.745 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph 2023-07-05T20:08:15.749 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-05T20:08:15.750 INFO:teuthology.orchestra.run.smithi046.stdout:MKFS_OPTIONS -- 172.21.15.46:6789:/scratch 2023-07-05T20:08:15.751 INFO:teuthology.orchestra.run.smithi046.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCbvKVkpp1TIhAAvJTELoeH8wkIFqjtppg17w== -o context=system_u:object_r:root_t:s0 172.21.15.46:6789:/scratch /tmp/tmp.KrMG67MsYpscratch 2023-07-05T20:08:15.751 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T20:08:16.517 INFO:teuthology.orchestra.run.smithi046.stdout:generic/296 [not run] Reflink not supported by scratch filesystem type: ceph 2023-07-05T20:08:16.524 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/296 2023-07-05T20:08:16.524 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/296 2023-07-05T20:08:16.525 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-07-05T20:08:16.672 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T20:08:16.734 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-05T20:08:16.735 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.rlt8E1h3iVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/297) 2023-07-05T20:08:16.964 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph 2023-07-05T20:08:16.968 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-05T20:08:16.969 INFO:teuthology.orchestra.run.smithi046.stdout:MKFS_OPTIONS -- 172.21.15.46:6789:/scratch 2023-07-05T20:08:16.969 INFO:teuthology.orchestra.run.smithi046.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCbvKVkpp1TIhAAvJTELoeH8wkIFqjtppg17w== -o context=system_u:object_r:root_t:s0 172.21.15.46:6789:/scratch /tmp/tmp.KrMG67MsYpscratch 2023-07-05T20:08:16.970 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T20:08:17.844 INFO:teuthology.orchestra.run.smithi046.stdout:generic/297 [not run] Reflink not supported by scratch filesystem type: ceph 2023-07-05T20:08:17.864 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/297 2023-07-05T20:08:17.865 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/297 2023-07-05T20:08:17.865 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-07-05T20:08:17.865 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T20:08:17.945 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-05T20:08:17.946 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.rlt8E1h3iVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/298) 2023-07-05T20:08:18.187 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph 2023-07-05T20:08:18.191 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-05T20:08:18.191 INFO:teuthology.orchestra.run.smithi046.stdout:MKFS_OPTIONS -- 172.21.15.46:6789:/scratch 2023-07-05T20:08:18.192 INFO:teuthology.orchestra.run.smithi046.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCbvKVkpp1TIhAAvJTELoeH8wkIFqjtppg17w== -o context=system_u:object_r:root_t:s0 172.21.15.46:6789:/scratch /tmp/tmp.KrMG67MsYpscratch 2023-07-05T20:08:18.192 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T20:08:19.099 INFO:teuthology.orchestra.run.smithi046.stdout:generic/298 [not run] Reflink not supported by scratch filesystem type: ceph 2023-07-05T20:08:19.124 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/298 2023-07-05T20:08:19.124 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/298 2023-07-05T20:08:19.124 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-07-05T20:08:19.129 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T20:08:19.176 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-05T20:08:19.177 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.rlt8E1h3iVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/299) 2023-07-05T20:08:19.407 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph 2023-07-05T20:08:19.411 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-05T20:08:19.412 INFO:teuthology.orchestra.run.smithi046.stdout:MKFS_OPTIONS -- 172.21.15.46:6789:/scratch 2023-07-05T20:08:19.412 INFO:teuthology.orchestra.run.smithi046.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCbvKVkpp1TIhAAvJTELoeH8wkIFqjtppg17w== -o context=system_u:object_r:root_t:s0 172.21.15.46:6789:/scratch /tmp/tmp.KrMG67MsYpscratch 2023-07-05T20:08:19.413 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T20:08:19.824 INFO:teuthology.orchestra.run.smithi046.stdout:generic/299 [not run] require 172.21.15.46:6789:/scratch to be valid block disk 2023-07-05T20:08:19.828 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/299 2023-07-05T20:08:19.828 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/299 2023-07-05T20:08:19.828 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-07-05T20:08:19.830 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T20:08:19.871 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-05T20:08:19.872 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.rlt8E1h3iVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/300) 2023-07-05T20:08:20.111 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph 2023-07-05T20:08:20.115 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-05T20:08:20.116 INFO:teuthology.orchestra.run.smithi046.stdout:MKFS_OPTIONS -- 172.21.15.46:6789:/scratch 2023-07-05T20:08:20.117 INFO:teuthology.orchestra.run.smithi046.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCbvKVkpp1TIhAAvJTELoeH8wkIFqjtppg17w== -o context=system_u:object_r:root_t:s0 172.21.15.46:6789:/scratch /tmp/tmp.KrMG67MsYpscratch 2023-07-05T20:08:20.117 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T20:08:20.524 INFO:teuthology.orchestra.run.smithi046.stdout:generic/300 [not run] require 172.21.15.46:6789:/scratch to be valid block disk 2023-07-05T20:08:20.528 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/300 2023-07-05T20:08:20.528 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/300 2023-07-05T20:08:20.528 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-07-05T20:08:20.530 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T20:08:20.566 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-05T20:08:20.567 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.rlt8E1h3iVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/301) 2023-07-05T20:08:20.790 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph 2023-07-05T20:08:20.794 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-05T20:08:20.795 INFO:teuthology.orchestra.run.smithi046.stdout:MKFS_OPTIONS -- 172.21.15.46:6789:/scratch 2023-07-05T20:08:20.796 INFO:teuthology.orchestra.run.smithi046.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCbvKVkpp1TIhAAvJTELoeH8wkIFqjtppg17w== -o context=system_u:object_r:root_t:s0 172.21.15.46:6789:/scratch /tmp/tmp.KrMG67MsYpscratch 2023-07-05T20:08:20.796 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T20:08:21.625 INFO:teuthology.orchestra.run.smithi046.stdout:generic/301 [not run] Reflink not supported by scratch filesystem type: ceph 2023-07-05T20:08:21.715 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/301 2023-07-05T20:08:21.715 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/301 2023-07-05T20:08:21.715 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-07-05T20:08:21.715 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T20:08:21.744 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-05T20:08:21.744 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.rlt8E1h3iVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/302) 2023-07-05T20:08:21.992 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph 2023-07-05T20:08:21.996 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-05T20:08:21.996 INFO:teuthology.orchestra.run.smithi046.stdout:MKFS_OPTIONS -- 172.21.15.46:6789:/scratch 2023-07-05T20:08:21.998 INFO:teuthology.orchestra.run.smithi046.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCbvKVkpp1TIhAAvJTELoeH8wkIFqjtppg17w== -o context=system_u:object_r:root_t:s0 172.21.15.46:6789:/scratch /tmp/tmp.KrMG67MsYpscratch 2023-07-05T20:08:21.998 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T20:08:22.882 INFO:teuthology.orchestra.run.smithi046.stdout:generic/302 [not run] Reflink not supported by scratch filesystem type: ceph 2023-07-05T20:08:22.922 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/302 2023-07-05T20:08:22.922 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/302 2023-07-05T20:08:22.922 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-07-05T20:08:22.925 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T20:08:22.976 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-05T20:08:22.977 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.rlt8E1h3iVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/303) 2023-07-05T20:08:23.203 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph 2023-07-05T20:08:23.209 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-05T20:08:23.209 INFO:teuthology.orchestra.run.smithi046.stdout:MKFS_OPTIONS -- 172.21.15.46:6789:/scratch 2023-07-05T20:08:23.215 INFO:teuthology.orchestra.run.smithi046.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCbvKVkpp1TIhAAvJTELoeH8wkIFqjtppg17w== -o context=system_u:object_r:root_t:s0 172.21.15.46:6789:/scratch /tmp/tmp.KrMG67MsYpscratch 2023-07-05T20:08:23.216 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T20:08:23.592 INFO:teuthology.orchestra.run.smithi046.stdout:generic/303 [not run] Reflink not supported by test filesystem type: ceph 2023-07-05T20:08:23.596 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/303 2023-07-05T20:08:23.597 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/303 2023-07-05T20:08:23.597 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-07-05T20:08:23.599 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T20:08:23.965 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-05T20:08:23.965 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.rlt8E1h3iVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/304) 2023-07-05T20:08:24.232 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph 2023-07-05T20:08:24.236 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-05T20:08:24.237 INFO:teuthology.orchestra.run.smithi046.stdout:MKFS_OPTIONS -- 172.21.15.46:6789:/scratch 2023-07-05T20:08:24.238 INFO:teuthology.orchestra.run.smithi046.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCbvKVkpp1TIhAAvJTELoeH8wkIFqjtppg17w== -o context=system_u:object_r:root_t:s0 172.21.15.46:6789:/scratch /tmp/tmp.KrMG67MsYpscratch 2023-07-05T20:08:24.238 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T20:08:24.631 INFO:teuthology.orchestra.run.smithi046.stdout:generic/304 [not run] Dedupe not supported by test filesystem type: ceph 2023-07-05T20:08:24.635 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/304 2023-07-05T20:08:24.636 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/304 2023-07-05T20:08:24.636 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-07-05T20:08:24.637 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T20:08:24.835 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-05T20:08:24.835 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.rlt8E1h3iVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/305) 2023-07-05T20:08:25.260 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph 2023-07-05T20:08:25.264 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-05T20:08:25.265 INFO:teuthology.orchestra.run.smithi046.stdout:MKFS_OPTIONS -- 172.21.15.46:6789:/scratch 2023-07-05T20:08:25.265 INFO:teuthology.orchestra.run.smithi046.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCbvKVkpp1TIhAAvJTELoeH8wkIFqjtppg17w== -o context=system_u:object_r:root_t:s0 172.21.15.46:6789:/scratch /tmp/tmp.KrMG67MsYpscratch 2023-07-05T20:08:25.265 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T20:08:26.120 INFO:teuthology.orchestra.run.smithi046.stdout:generic/305 [not run] Reflink not supported by scratch filesystem type: ceph 2023-07-05T20:08:26.135 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/305 2023-07-05T20:08:26.136 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/305 2023-07-05T20:08:26.136 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-07-05T20:08:26.139 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T20:08:26.240 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-05T20:08:26.240 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.rlt8E1h3iVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/306) 2023-07-05T20:08:26.467 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph 2023-07-05T20:08:26.471 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-05T20:08:26.471 INFO:teuthology.orchestra.run.smithi046.stdout:MKFS_OPTIONS -- 172.21.15.46:6789:/scratch 2023-07-05T20:08:26.472 INFO:teuthology.orchestra.run.smithi046.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCbvKVkpp1TIhAAvJTELoeH8wkIFqjtppg17w== -o context=system_u:object_r:root_t:s0 172.21.15.46:6789:/scratch /tmp/tmp.KrMG67MsYpscratch 2023-07-05T20:08:26.473 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T20:08:27.483 INFO:teuthology.orchestra.run.smithi046.stdout:generic/306 1s 2023-07-05T20:08:27.488 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/306 2023-07-05T20:08:27.489 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-07-05T20:08:27.491 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T20:08:27.921 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-05T20:08:27.922 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.rlt8E1h3iVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/307) 2023-07-05T20:08:28.161 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph 2023-07-05T20:08:28.165 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-05T20:08:28.166 INFO:teuthology.orchestra.run.smithi046.stdout:MKFS_OPTIONS -- 172.21.15.46:6789:/scratch 2023-07-05T20:08:28.167 INFO:teuthology.orchestra.run.smithi046.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCbvKVkpp1TIhAAvJTELoeH8wkIFqjtppg17w== -o context=system_u:object_r:root_t:s0 172.21.15.46:6789:/scratch /tmp/tmp.KrMG67MsYpscratch 2023-07-05T20:08:28.167 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T20:08:30.066 INFO:teuthology.orchestra.run.smithi046.stdout:generic/307 2s 2023-07-05T20:08:30.071 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/307 2023-07-05T20:08:30.071 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-07-05T20:08:30.073 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T20:08:30.082 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-05T20:08:30.082 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.rlt8E1h3iVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/308) 2023-07-05T20:08:30.308 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph 2023-07-05T20:08:30.313 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-05T20:08:30.313 INFO:teuthology.orchestra.run.smithi046.stdout:MKFS_OPTIONS -- 172.21.15.46:6789:/scratch 2023-07-05T20:08:30.314 INFO:teuthology.orchestra.run.smithi046.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCbvKVkpp1TIhAAvJTELoeH8wkIFqjtppg17w== -o context=system_u:object_r:root_t:s0 172.21.15.46:6789:/scratch /tmp/tmp.KrMG67MsYpscratch 2023-07-05T20:08:30.314 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T20:08:30.692 INFO:teuthology.orchestra.run.smithi046.stdout:generic/308 0s 2023-07-05T20:08:30.697 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/308 2023-07-05T20:08:30.697 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-07-05T20:08:30.699 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T20:08:30.730 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-05T20:08:30.730 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.rlt8E1h3iVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/309) 2023-07-05T20:08:30.964 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph 2023-07-05T20:08:30.968 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-05T20:08:30.969 INFO:teuthology.orchestra.run.smithi046.stdout:MKFS_OPTIONS -- 172.21.15.46:6789:/scratch 2023-07-05T20:08:30.969 INFO:teuthology.orchestra.run.smithi046.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCbvKVkpp1TIhAAvJTELoeH8wkIFqjtppg17w== -o context=system_u:object_r:root_t:s0 172.21.15.46:6789:/scratch /tmp/tmp.KrMG67MsYpscratch 2023-07-05T20:08:30.970 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T20:08:32.377 INFO:teuthology.orchestra.run.smithi046.stdout:generic/309 1s 2023-07-05T20:08:32.383 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/309 2023-07-05T20:08:32.383 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-07-05T20:08:32.385 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T20:08:32.721 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-05T20:08:32.722 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.rlt8E1h3iVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/310) 2023-07-05T20:08:33.006 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph 2023-07-05T20:08:33.010 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-05T20:08:33.010 INFO:teuthology.orchestra.run.smithi046.stdout:MKFS_OPTIONS -- 172.21.15.46:6789:/scratch 2023-07-05T20:08:33.011 INFO:teuthology.orchestra.run.smithi046.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCbvKVkpp1TIhAAvJTELoeH8wkIFqjtppg17w== -o context=system_u:object_r:root_t:s0 172.21.15.46:6789:/scratch /tmp/tmp.KrMG67MsYpscratch 2023-07-05T20:08:33.011 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T20:09:50.601 INFO:teuthology.orchestra.run.smithi046.stdout:generic/310 77s 2023-07-05T20:09:50.610 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/310 2023-07-05T20:09:50.611 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-07-05T20:09:50.613 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T20:09:51.051 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-05T20:09:51.052 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.rlt8E1h3iVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/311) 2023-07-05T20:09:51.430 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph 2023-07-05T20:09:51.435 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-05T20:09:51.436 INFO:teuthology.orchestra.run.smithi046.stdout:MKFS_OPTIONS -- 172.21.15.46:6789:/scratch 2023-07-05T20:09:51.437 INFO:teuthology.orchestra.run.smithi046.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCbvKVkpp1TIhAAvJTELoeH8wkIFqjtppg17w== -o context=system_u:object_r:root_t:s0 172.21.15.46:6789:/scratch /tmp/tmp.KrMG67MsYpscratch 2023-07-05T20:09:51.437 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T20:09:51.816 INFO:teuthology.orchestra.run.smithi046.stdout:generic/311 [not run] require 172.21.15.46:6789:/scratch to be valid block disk 2023-07-05T20:09:51.820 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/311 2023-07-05T20:09:51.820 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/311 2023-07-05T20:09:51.820 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-07-05T20:09:51.822 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T20:09:51.853 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-05T20:09:51.853 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.rlt8E1h3iVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/312) 2023-07-05T20:09:52.085 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph 2023-07-05T20:09:52.089 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-05T20:09:52.089 INFO:teuthology.orchestra.run.smithi046.stdout:MKFS_OPTIONS -- 172.21.15.46:6789:/scratch 2023-07-05T20:09:52.090 INFO:teuthology.orchestra.run.smithi046.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCbvKVkpp1TIhAAvJTELoeH8wkIFqjtppg17w== -o context=system_u:object_r:root_t:s0 172.21.15.46:6789:/scratch /tmp/tmp.KrMG67MsYpscratch 2023-07-05T20:09:52.090 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T20:09:52.435 INFO:teuthology.orchestra.run.smithi046.stdout:generic/312 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-07-05T20:09:52.439 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/312 2023-07-05T20:09:52.440 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/312 2023-07-05T20:09:52.440 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-07-05T20:09:52.441 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T20:09:52.473 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-05T20:09:52.473 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.rlt8E1h3iVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/313) 2023-07-05T20:09:52.697 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph 2023-07-05T20:09:52.701 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-05T20:09:52.702 INFO:teuthology.orchestra.run.smithi046.stdout:MKFS_OPTIONS -- 172.21.15.46:6789:/scratch 2023-07-05T20:09:52.703 INFO:teuthology.orchestra.run.smithi046.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCbvKVkpp1TIhAAvJTELoeH8wkIFqjtppg17w== -o context=system_u:object_r:root_t:s0 172.21.15.46:6789:/scratch /tmp/tmp.KrMG67MsYpscratch 2023-07-05T20:09:52.703 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T20:09:57.078 INFO:teuthology.orchestra.run.smithi046.stdout:generic/313 5s 2023-07-05T20:09:57.084 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/313 2023-07-05T20:09:57.084 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-07-05T20:09:57.086 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T20:09:57.122 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-05T20:09:57.122 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.rlt8E1h3iVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/314) 2023-07-05T20:09:57.350 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph 2023-07-05T20:09:57.354 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-05T20:09:57.355 INFO:teuthology.orchestra.run.smithi046.stdout:MKFS_OPTIONS -- 172.21.15.46:6789:/scratch 2023-07-05T20:09:57.355 INFO:teuthology.orchestra.run.smithi046.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCbvKVkpp1TIhAAvJTELoeH8wkIFqjtppg17w== -o context=system_u:object_r:root_t:s0 172.21.15.46:6789:/scratch /tmp/tmp.KrMG67MsYpscratch 2023-07-05T20:09:57.356 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T20:09:57.833 INFO:teuthology.orchestra.run.smithi046.stdout:generic/314 0s 2023-07-05T20:09:57.837 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/314 2023-07-05T20:09:57.838 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-07-05T20:09:57.839 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T20:09:57.877 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-05T20:09:57.877 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.rlt8E1h3iVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/315) 2023-07-05T20:09:58.122 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph 2023-07-05T20:09:58.126 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-05T20:09:58.127 INFO:teuthology.orchestra.run.smithi046.stdout:MKFS_OPTIONS -- 172.21.15.46:6789:/scratch 2023-07-05T20:09:58.127 INFO:teuthology.orchestra.run.smithi046.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCbvKVkpp1TIhAAvJTELoeH8wkIFqjtppg17w== -o context=system_u:object_r:root_t:s0 172.21.15.46:6789:/scratch /tmp/tmp.KrMG67MsYpscratch 2023-07-05T20:09:58.128 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T20:09:58.474 INFO:teuthology.orchestra.run.smithi046.stdout:generic/315 [not run] xfs_io falloc -k failed (old kernel/wrong fs?) 2023-07-05T20:09:58.478 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/315 2023-07-05T20:09:58.478 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/315 2023-07-05T20:09:58.478 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-07-05T20:09:58.480 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T20:09:58.508 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-05T20:09:58.509 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.rlt8E1h3iVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/316) 2023-07-05T20:09:58.732 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph 2023-07-05T20:09:58.737 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-05T20:09:58.737 INFO:teuthology.orchestra.run.smithi046.stdout:MKFS_OPTIONS -- 172.21.15.46:6789:/scratch 2023-07-05T20:09:58.738 INFO:teuthology.orchestra.run.smithi046.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCbvKVkpp1TIhAAvJTELoeH8wkIFqjtppg17w== -o context=system_u:object_r:root_t:s0 172.21.15.46:6789:/scratch /tmp/tmp.KrMG67MsYpscratch 2023-07-05T20:09:58.738 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T20:09:59.185 INFO:teuthology.orchestra.run.smithi046.stdout:generic/316 [not run] xfs_io fiemap failed (old kernel/wrong fs?) 2023-07-05T20:09:59.189 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/316 2023-07-05T20:09:59.189 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/316 2023-07-05T20:09:59.190 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-07-05T20:09:59.191 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T20:09:59.386 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-05T20:09:59.387 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.rlt8E1h3iVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/317) 2023-07-05T20:09:59.798 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph 2023-07-05T20:09:59.803 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-05T20:09:59.803 INFO:teuthology.orchestra.run.smithi046.stdout:MKFS_OPTIONS -- 172.21.15.46:6789:/scratch 2023-07-05T20:09:59.804 INFO:teuthology.orchestra.run.smithi046.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCbvKVkpp1TIhAAvJTELoeH8wkIFqjtppg17w== -o context=system_u:object_r:root_t:s0 172.21.15.46:6789:/scratch /tmp/tmp.KrMG67MsYpscratch 2023-07-05T20:09:59.804 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T20:10:00.798 INFO:teuthology.orchestra.run.smithi046.stdout:generic/317 0s 2023-07-05T20:10:00.803 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/317 2023-07-05T20:10:00.804 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-07-05T20:10:00.805 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T20:10:00.813 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-05T20:10:00.814 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.rlt8E1h3iVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/318) 2023-07-05T20:10:01.045 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph 2023-07-05T20:10:01.050 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-05T20:10:01.050 INFO:teuthology.orchestra.run.smithi046.stdout:MKFS_OPTIONS -- 172.21.15.46:6789:/scratch 2023-07-05T20:10:01.051 INFO:teuthology.orchestra.run.smithi046.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCbvKVkpp1TIhAAvJTELoeH8wkIFqjtppg17w== -o context=system_u:object_r:root_t:s0 172.21.15.46:6789:/scratch /tmp/tmp.KrMG67MsYpscratch 2023-07-05T20:10:01.051 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T20:10:01.891 INFO:teuthology.orchestra.run.smithi046.stdout:generic/318 0s 2023-07-05T20:10:01.896 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/318 2023-07-05T20:10:01.896 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-07-05T20:10:01.898 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T20:10:01.906 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-05T20:10:01.907 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.rlt8E1h3iVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/319) 2023-07-05T20:10:02.128 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph 2023-07-05T20:10:02.132 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-05T20:10:02.133 INFO:teuthology.orchestra.run.smithi046.stdout:MKFS_OPTIONS -- 172.21.15.46:6789:/scratch 2023-07-05T20:10:02.134 INFO:teuthology.orchestra.run.smithi046.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCbvKVkpp1TIhAAvJTELoeH8wkIFqjtppg17w== -o context=system_u:object_r:root_t:s0 172.21.15.46:6789:/scratch /tmp/tmp.KrMG67MsYpscratch 2023-07-05T20:10:02.134 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T20:10:02.732 INFO:teuthology.orchestra.run.smithi046.stdout:generic/319 0s 2023-07-05T20:10:02.736 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/319 2023-07-05T20:10:02.737 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-07-05T20:10:02.738 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T20:10:02.747 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-05T20:10:02.747 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.rlt8E1h3iVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/320) 2023-07-05T20:10:02.974 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph 2023-07-05T20:10:02.978 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-05T20:10:02.979 INFO:teuthology.orchestra.run.smithi046.stdout:MKFS_OPTIONS -- 172.21.15.46:6789:/scratch 2023-07-05T20:10:02.979 INFO:teuthology.orchestra.run.smithi046.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCbvKVkpp1TIhAAvJTELoeH8wkIFqjtppg17w== -o context=system_u:object_r:root_t:s0 172.21.15.46:6789:/scratch /tmp/tmp.KrMG67MsYpscratch 2023-07-05T20:10:02.980 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T20:10:03.337 INFO:teuthology.orchestra.run.smithi046.stdout:generic/320 [not run] Filesystem ceph not supported in _scratch_mkfs_sized 2023-07-05T20:10:03.341 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/320 2023-07-05T20:10:03.342 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/320 2023-07-05T20:10:03.342 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-07-05T20:10:03.343 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T20:10:03.368 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-05T20:10:03.369 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.rlt8E1h3iVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/321) 2023-07-05T20:10:03.591 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph 2023-07-05T20:10:03.596 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-05T20:10:03.596 INFO:teuthology.orchestra.run.smithi046.stdout:MKFS_OPTIONS -- 172.21.15.46:6789:/scratch 2023-07-05T20:10:03.597 INFO:teuthology.orchestra.run.smithi046.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCbvKVkpp1TIhAAvJTELoeH8wkIFqjtppg17w== -o context=system_u:object_r:root_t:s0 172.21.15.46:6789:/scratch /tmp/tmp.KrMG67MsYpscratch 2023-07-05T20:10:03.597 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T20:10:03.943 INFO:teuthology.orchestra.run.smithi046.stdout:generic/321 [not run] require 172.21.15.46:6789:/scratch to be valid block disk 2023-07-05T20:10:03.947 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/321 2023-07-05T20:10:03.947 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/321 2023-07-05T20:10:03.947 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-07-05T20:10:03.949 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T20:10:03.979 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-05T20:10:03.979 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.rlt8E1h3iVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/322) 2023-07-05T20:10:04.208 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph 2023-07-05T20:10:04.212 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-05T20:10:04.213 INFO:teuthology.orchestra.run.smithi046.stdout:MKFS_OPTIONS -- 172.21.15.46:6789:/scratch 2023-07-05T20:10:04.214 INFO:teuthology.orchestra.run.smithi046.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCbvKVkpp1TIhAAvJTELoeH8wkIFqjtppg17w== -o context=system_u:object_r:root_t:s0 172.21.15.46:6789:/scratch /tmp/tmp.KrMG67MsYpscratch 2023-07-05T20:10:04.214 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T20:10:04.563 INFO:teuthology.orchestra.run.smithi046.stdout:generic/322 [not run] require 172.21.15.46:6789:/scratch to be valid block disk 2023-07-05T20:10:04.567 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/322 2023-07-05T20:10:04.568 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/322 2023-07-05T20:10:04.568 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-07-05T20:10:04.570 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T20:10:04.593 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-05T20:10:04.594 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.rlt8E1h3iVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/323) 2023-07-05T20:10:04.813 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph 2023-07-05T20:10:04.817 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-05T20:10:04.817 INFO:teuthology.orchestra.run.smithi046.stdout:MKFS_OPTIONS -- 172.21.15.46:6789:/scratch 2023-07-05T20:10:04.818 INFO:teuthology.orchestra.run.smithi046.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCbvKVkpp1TIhAAvJTELoeH8wkIFqjtppg17w== -o context=system_u:object_r:root_t:s0 172.21.15.46:6789:/scratch /tmp/tmp.KrMG67MsYpscratch 2023-07-05T20:10:04.818 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T20:11:01.850 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-05T20:11:01.853 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-05T20:11:32.188 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-05T20:11:32.190 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-05T20:12:02.252 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-05T20:12:02.258 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-05T20:12:05.638 INFO:teuthology.orchestra.run.smithi046.stdout:generic/323 120s 2023-07-05T20:12:05.643 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/323 2023-07-05T20:12:05.643 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-07-05T20:12:05.645 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T20:12:06.041 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-05T20:12:06.042 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.rlt8E1h3iVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/324) 2023-07-05T20:12:06.270 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph 2023-07-05T20:12:06.274 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-05T20:12:06.274 INFO:teuthology.orchestra.run.smithi046.stdout:MKFS_OPTIONS -- 172.21.15.46:6789:/scratch 2023-07-05T20:12:06.275 INFO:teuthology.orchestra.run.smithi046.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCbvKVkpp1TIhAAvJTELoeH8wkIFqjtppg17w== -o context=system_u:object_r:root_t:s0 172.21.15.46:6789:/scratch /tmp/tmp.KrMG67MsYpscratch 2023-07-05T20:12:06.276 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T20:12:06.617 INFO:teuthology.orchestra.run.smithi046.stdout:generic/324 [not run] defragmentation not supported for fstype "ceph" 2023-07-05T20:12:06.621 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/324 2023-07-05T20:12:06.621 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/324 2023-07-05T20:12:06.622 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-07-05T20:12:06.623 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T20:12:06.652 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-05T20:12:06.653 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.rlt8E1h3iVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/325) 2023-07-05T20:12:06.875 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph 2023-07-05T20:12:06.879 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-05T20:12:06.880 INFO:teuthology.orchestra.run.smithi046.stdout:MKFS_OPTIONS -- 172.21.15.46:6789:/scratch 2023-07-05T20:12:06.881 INFO:teuthology.orchestra.run.smithi046.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCbvKVkpp1TIhAAvJTELoeH8wkIFqjtppg17w== -o context=system_u:object_r:root_t:s0 172.21.15.46:6789:/scratch /tmp/tmp.KrMG67MsYpscratch 2023-07-05T20:12:06.881 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T20:12:07.230 INFO:teuthology.orchestra.run.smithi046.stdout:generic/325 [not run] require 172.21.15.46:6789:/scratch to be valid block disk 2023-07-05T20:12:07.235 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/325 2023-07-05T20:12:07.235 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/325 2023-07-05T20:12:07.235 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-07-05T20:12:07.237 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T20:12:07.262 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-05T20:12:07.262 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.rlt8E1h3iVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/326) 2023-07-05T20:12:07.498 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph 2023-07-05T20:12:07.503 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-05T20:12:07.503 INFO:teuthology.orchestra.run.smithi046.stdout:MKFS_OPTIONS -- 172.21.15.46:6789:/scratch 2023-07-05T20:12:07.504 INFO:teuthology.orchestra.run.smithi046.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCbvKVkpp1TIhAAvJTELoeH8wkIFqjtppg17w== -o context=system_u:object_r:root_t:s0 172.21.15.46:6789:/scratch /tmp/tmp.KrMG67MsYpscratch 2023-07-05T20:12:07.505 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T20:12:08.205 INFO:teuthology.orchestra.run.smithi046.stdout:generic/326 [not run] Reflink not supported by scratch filesystem type: ceph 2023-07-05T20:12:08.319 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/326 2023-07-05T20:12:08.320 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/326 2023-07-05T20:12:08.321 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-07-05T20:12:08.409 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T20:12:08.465 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-05T20:12:08.466 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.rlt8E1h3iVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/327) 2023-07-05T20:12:08.690 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph 2023-07-05T20:12:08.694 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-05T20:12:08.695 INFO:teuthology.orchestra.run.smithi046.stdout:MKFS_OPTIONS -- 172.21.15.46:6789:/scratch 2023-07-05T20:12:08.695 INFO:teuthology.orchestra.run.smithi046.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCbvKVkpp1TIhAAvJTELoeH8wkIFqjtppg17w== -o context=system_u:object_r:root_t:s0 172.21.15.46:6789:/scratch /tmp/tmp.KrMG67MsYpscratch 2023-07-05T20:12:08.696 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T20:12:09.547 INFO:teuthology.orchestra.run.smithi046.stdout:generic/327 [not run] Reflink not supported by scratch filesystem type: ceph 2023-07-05T20:12:09.569 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/327 2023-07-05T20:12:09.570 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/327 2023-07-05T20:12:09.570 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-07-05T20:12:09.654 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T20:12:09.684 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-05T20:12:09.685 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.rlt8E1h3iVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/328) 2023-07-05T20:12:09.908 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph 2023-07-05T20:12:09.912 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-05T20:12:09.913 INFO:teuthology.orchestra.run.smithi046.stdout:MKFS_OPTIONS -- 172.21.15.46:6789:/scratch 2023-07-05T20:12:09.913 INFO:teuthology.orchestra.run.smithi046.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCbvKVkpp1TIhAAvJTELoeH8wkIFqjtppg17w== -o context=system_u:object_r:root_t:s0 172.21.15.46:6789:/scratch /tmp/tmp.KrMG67MsYpscratch 2023-07-05T20:12:09.914 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T20:12:10.723 INFO:teuthology.orchestra.run.smithi046.stdout:generic/328 [not run] Reflink not supported by scratch filesystem type: ceph 2023-07-05T20:12:10.849 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/328 2023-07-05T20:12:10.849 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/328 2023-07-05T20:12:10.850 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-07-05T20:12:10.877 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T20:12:10.917 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-05T20:12:10.918 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.rlt8E1h3iVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/329) 2023-07-05T20:12:11.144 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph 2023-07-05T20:12:11.149 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-05T20:12:11.149 INFO:teuthology.orchestra.run.smithi046.stdout:MKFS_OPTIONS -- 172.21.15.46:6789:/scratch 2023-07-05T20:12:11.150 INFO:teuthology.orchestra.run.smithi046.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCbvKVkpp1TIhAAvJTELoeH8wkIFqjtppg17w== -o context=system_u:object_r:root_t:s0 172.21.15.46:6789:/scratch /tmp/tmp.KrMG67MsYpscratch 2023-07-05T20:12:11.150 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T20:12:12.035 INFO:teuthology.orchestra.run.smithi046.stdout:generic/329 [not run] Reflink not supported by scratch filesystem type: ceph 2023-07-05T20:12:12.043 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/329 2023-07-05T20:12:12.043 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/329 2023-07-05T20:12:12.043 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-07-05T20:12:12.063 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T20:12:12.142 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-05T20:12:12.143 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.rlt8E1h3iVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/330) 2023-07-05T20:12:12.367 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph 2023-07-05T20:12:12.371 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-05T20:12:12.372 INFO:teuthology.orchestra.run.smithi046.stdout:MKFS_OPTIONS -- 172.21.15.46:6789:/scratch 2023-07-05T20:12:12.373 INFO:teuthology.orchestra.run.smithi046.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCbvKVkpp1TIhAAvJTELoeH8wkIFqjtppg17w== -o context=system_u:object_r:root_t:s0 172.21.15.46:6789:/scratch /tmp/tmp.KrMG67MsYpscratch 2023-07-05T20:12:12.373 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T20:12:13.037 INFO:teuthology.orchestra.run.smithi046.stdout:generic/330 [not run] Reflink not supported by scratch filesystem type: ceph 2023-07-05T20:12:13.142 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/330 2023-07-05T20:12:13.142 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/330 2023-07-05T20:12:13.142 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-07-05T20:12:13.200 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T20:12:13.326 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-05T20:12:13.327 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.rlt8E1h3iVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/331) 2023-07-05T20:12:13.568 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph 2023-07-05T20:12:13.572 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-05T20:12:13.573 INFO:teuthology.orchestra.run.smithi046.stdout:MKFS_OPTIONS -- 172.21.15.46:6789:/scratch 2023-07-05T20:12:13.574 INFO:teuthology.orchestra.run.smithi046.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCbvKVkpp1TIhAAvJTELoeH8wkIFqjtppg17w== -o context=system_u:object_r:root_t:s0 172.21.15.46:6789:/scratch /tmp/tmp.KrMG67MsYpscratch 2023-07-05T20:12:13.574 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T20:12:14.541 INFO:teuthology.orchestra.run.smithi046.stdout:generic/331 [not run] Reflink not supported by scratch filesystem type: ceph 2023-07-05T20:12:14.557 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/331 2023-07-05T20:12:14.557 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/331 2023-07-05T20:12:14.558 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-07-05T20:12:14.561 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T20:12:14.594 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-05T20:12:14.594 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.rlt8E1h3iVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/332) 2023-07-05T20:12:14.819 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph 2023-07-05T20:12:14.824 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-05T20:12:14.824 INFO:teuthology.orchestra.run.smithi046.stdout:MKFS_OPTIONS -- 172.21.15.46:6789:/scratch 2023-07-05T20:12:14.825 INFO:teuthology.orchestra.run.smithi046.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCbvKVkpp1TIhAAvJTELoeH8wkIFqjtppg17w== -o context=system_u:object_r:root_t:s0 172.21.15.46:6789:/scratch /tmp/tmp.KrMG67MsYpscratch 2023-07-05T20:12:14.825 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T20:12:15.715 INFO:teuthology.orchestra.run.smithi046.stdout:generic/332 [not run] Reflink not supported by scratch filesystem type: ceph 2023-07-05T20:12:15.751 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/332 2023-07-05T20:12:15.751 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/332 2023-07-05T20:12:15.751 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-07-05T20:12:15.783 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T20:12:15.820 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-05T20:12:15.821 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.rlt8E1h3iVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/333) 2023-07-05T20:12:16.048 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph 2023-07-05T20:12:16.052 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-05T20:12:16.052 INFO:teuthology.orchestra.run.smithi046.stdout:MKFS_OPTIONS -- 172.21.15.46:6789:/scratch 2023-07-05T20:12:16.053 INFO:teuthology.orchestra.run.smithi046.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCbvKVkpp1TIhAAvJTELoeH8wkIFqjtppg17w== -o context=system_u:object_r:root_t:s0 172.21.15.46:6789:/scratch /tmp/tmp.KrMG67MsYpscratch 2023-07-05T20:12:16.053 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T20:12:16.943 INFO:teuthology.orchestra.run.smithi046.stdout:generic/333 [not run] Reflink not supported by scratch filesystem type: ceph 2023-07-05T20:12:16.953 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/333 2023-07-05T20:12:16.954 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/333 2023-07-05T20:12:16.954 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-07-05T20:12:16.958 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T20:12:17.043 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-05T20:12:17.044 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.rlt8E1h3iVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/334) 2023-07-05T20:12:17.267 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph 2023-07-05T20:12:17.271 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-05T20:12:17.272 INFO:teuthology.orchestra.run.smithi046.stdout:MKFS_OPTIONS -- 172.21.15.46:6789:/scratch 2023-07-05T20:12:17.272 INFO:teuthology.orchestra.run.smithi046.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCbvKVkpp1TIhAAvJTELoeH8wkIFqjtppg17w== -o context=system_u:object_r:root_t:s0 172.21.15.46:6789:/scratch /tmp/tmp.KrMG67MsYpscratch 2023-07-05T20:12:17.273 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T20:12:18.000 INFO:teuthology.orchestra.run.smithi046.stdout:generic/334 [not run] Reflink not supported by scratch filesystem type: ceph 2023-07-05T20:12:18.071 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/334 2023-07-05T20:12:18.071 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/334 2023-07-05T20:12:18.072 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-07-05T20:12:18.108 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T20:12:18.241 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-05T20:12:18.242 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.rlt8E1h3iVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/335) 2023-07-05T20:12:18.477 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph 2023-07-05T20:12:18.481 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-05T20:12:18.482 INFO:teuthology.orchestra.run.smithi046.stdout:MKFS_OPTIONS -- 172.21.15.46:6789:/scratch 2023-07-05T20:12:18.483 INFO:teuthology.orchestra.run.smithi046.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCbvKVkpp1TIhAAvJTELoeH8wkIFqjtppg17w== -o context=system_u:object_r:root_t:s0 172.21.15.46:6789:/scratch /tmp/tmp.KrMG67MsYpscratch 2023-07-05T20:12:18.483 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T20:12:18.858 INFO:teuthology.orchestra.run.smithi046.stdout:generic/335 [not run] require 172.21.15.46:6789:/scratch to be valid block disk 2023-07-05T20:12:18.863 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/335 2023-07-05T20:12:18.863 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/335 2023-07-05T20:12:18.863 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-07-05T20:12:18.865 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T20:12:18.893 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-05T20:12:18.893 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.rlt8E1h3iVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/336) 2023-07-05T20:12:19.138 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph 2023-07-05T20:12:19.142 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-05T20:12:19.142 INFO:teuthology.orchestra.run.smithi046.stdout:MKFS_OPTIONS -- 172.21.15.46:6789:/scratch 2023-07-05T20:12:19.143 INFO:teuthology.orchestra.run.smithi046.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCbvKVkpp1TIhAAvJTELoeH8wkIFqjtppg17w== -o context=system_u:object_r:root_t:s0 172.21.15.46:6789:/scratch /tmp/tmp.KrMG67MsYpscratch 2023-07-05T20:12:19.143 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T20:12:19.524 INFO:teuthology.orchestra.run.smithi046.stdout:generic/336 [not run] require 172.21.15.46:6789:/scratch to be valid block disk 2023-07-05T20:12:19.528 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/336 2023-07-05T20:12:19.528 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/336 2023-07-05T20:12:19.528 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-07-05T20:12:19.530 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T20:12:19.575 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-05T20:12:19.576 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.rlt8E1h3iVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/337) 2023-07-05T20:12:19.797 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph 2023-07-05T20:12:19.801 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-05T20:12:19.801 INFO:teuthology.orchestra.run.smithi046.stdout:MKFS_OPTIONS -- 172.21.15.46:6789:/scratch 2023-07-05T20:12:19.802 INFO:teuthology.orchestra.run.smithi046.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCbvKVkpp1TIhAAvJTELoeH8wkIFqjtppg17w== -o context=system_u:object_r:root_t:s0 172.21.15.46:6789:/scratch /tmp/tmp.KrMG67MsYpscratch 2023-07-05T20:12:19.802 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T20:12:20.458 INFO:teuthology.orchestra.run.smithi046.stdout:generic/337 0s 2023-07-05T20:12:20.463 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/337 2023-07-05T20:12:20.464 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-07-05T20:12:20.468 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T20:12:20.474 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-05T20:12:20.475 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.rlt8E1h3iVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/338) 2023-07-05T20:12:20.704 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph 2023-07-05T20:12:20.708 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-05T20:12:20.708 INFO:teuthology.orchestra.run.smithi046.stdout:MKFS_OPTIONS -- 172.21.15.46:6789:/scratch 2023-07-05T20:12:20.709 INFO:teuthology.orchestra.run.smithi046.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCbvKVkpp1TIhAAvJTELoeH8wkIFqjtppg17w== -o context=system_u:object_r:root_t:s0 172.21.15.46:6789:/scratch /tmp/tmp.KrMG67MsYpscratch 2023-07-05T20:12:20.709 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T20:12:21.074 INFO:teuthology.orchestra.run.smithi046.stdout:generic/338 [not run] require 172.21.15.46:6789:/scratch to be valid block disk 2023-07-05T20:12:21.078 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/338 2023-07-05T20:12:21.078 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/338 2023-07-05T20:12:21.078 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-07-05T20:12:21.080 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T20:12:21.107 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-05T20:12:21.108 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.rlt8E1h3iVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/339) 2023-07-05T20:12:21.336 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph 2023-07-05T20:12:21.344 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-05T20:12:21.344 INFO:teuthology.orchestra.run.smithi046.stdout:MKFS_OPTIONS -- 172.21.15.46:6789:/scratch 2023-07-05T20:12:21.345 INFO:teuthology.orchestra.run.smithi046.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCbvKVkpp1TIhAAvJTELoeH8wkIFqjtppg17w== -o context=system_u:object_r:root_t:s0 172.21.15.46:6789:/scratch /tmp/tmp.KrMG67MsYpscratch 2023-07-05T20:12:21.345 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T20:12:32.317 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-05T20:12:32.320 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-05T20:13:02.465 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-05T20:13:02.467 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-05T20:13:16.467 INFO:teuthology.orchestra.run.smithi046.stdout:generic/339 55s 2023-07-05T20:13:16.474 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/339 2023-07-05T20:13:16.475 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-07-05T20:13:16.475 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T20:13:16.483 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-05T20:13:16.483 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.rlt8E1h3iVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/340) 2023-07-05T20:13:16.878 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph 2023-07-05T20:13:16.882 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-05T20:13:16.882 INFO:teuthology.orchestra.run.smithi046.stdout:MKFS_OPTIONS -- 172.21.15.46:6789:/scratch 2023-07-05T20:13:16.883 INFO:teuthology.orchestra.run.smithi046.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCbvKVkpp1TIhAAvJTELoeH8wkIFqjtppg17w== -o context=system_u:object_r:root_t:s0 172.21.15.46:6789:/scratch /tmp/tmp.KrMG67MsYpscratch 2023-07-05T20:13:16.883 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T20:13:19.889 INFO:teuthology.orchestra.run.smithi046.stdout:generic/340 2s 2023-07-05T20:13:19.925 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/340 2023-07-05T20:13:19.926 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-07-05T20:13:19.928 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T20:13:19.946 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-05T20:13:19.947 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.rlt8E1h3iVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/341) 2023-07-05T20:13:20.399 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph 2023-07-05T20:13:20.403 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-05T20:13:20.404 INFO:teuthology.orchestra.run.smithi046.stdout:MKFS_OPTIONS -- 172.21.15.46:6789:/scratch 2023-07-05T20:13:20.404 INFO:teuthology.orchestra.run.smithi046.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCbvKVkpp1TIhAAvJTELoeH8wkIFqjtppg17w== -o context=system_u:object_r:root_t:s0 172.21.15.46:6789:/scratch /tmp/tmp.KrMG67MsYpscratch 2023-07-05T20:13:20.405 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T20:13:20.789 INFO:teuthology.orchestra.run.smithi046.stdout:generic/341 [not run] require 172.21.15.46:6789:/scratch to be valid block disk 2023-07-05T20:13:20.793 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/341 2023-07-05T20:13:20.794 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/341 2023-07-05T20:13:20.794 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-07-05T20:13:20.796 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T20:13:20.817 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-05T20:13:20.818 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.rlt8E1h3iVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/342) 2023-07-05T20:13:21.040 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph 2023-07-05T20:13:21.044 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-05T20:13:21.045 INFO:teuthology.orchestra.run.smithi046.stdout:MKFS_OPTIONS -- 172.21.15.46:6789:/scratch 2023-07-05T20:13:21.046 INFO:teuthology.orchestra.run.smithi046.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCbvKVkpp1TIhAAvJTELoeH8wkIFqjtppg17w== -o context=system_u:object_r:root_t:s0 172.21.15.46:6789:/scratch /tmp/tmp.KrMG67MsYpscratch 2023-07-05T20:13:21.046 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T20:13:21.419 INFO:teuthology.orchestra.run.smithi046.stdout:generic/342 [not run] require 172.21.15.46:6789:/scratch to be valid block disk 2023-07-05T20:13:21.423 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/342 2023-07-05T20:13:21.424 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/342 2023-07-05T20:13:21.424 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-07-05T20:13:21.425 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T20:13:21.449 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-05T20:13:21.450 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.rlt8E1h3iVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/343) 2023-07-05T20:13:21.691 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph 2023-07-05T20:13:21.694 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-05T20:13:21.695 INFO:teuthology.orchestra.run.smithi046.stdout:MKFS_OPTIONS -- 172.21.15.46:6789:/scratch 2023-07-05T20:13:21.696 INFO:teuthology.orchestra.run.smithi046.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCbvKVkpp1TIhAAvJTELoeH8wkIFqjtppg17w== -o context=system_u:object_r:root_t:s0 172.21.15.46:6789:/scratch /tmp/tmp.KrMG67MsYpscratch 2023-07-05T20:13:21.696 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T20:13:22.080 INFO:teuthology.orchestra.run.smithi046.stdout:generic/343 [not run] require 172.21.15.46:6789:/scratch to be valid block disk 2023-07-05T20:13:22.084 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/343 2023-07-05T20:13:22.085 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/343 2023-07-05T20:13:22.085 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-07-05T20:13:22.087 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T20:13:22.121 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-05T20:13:22.121 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.rlt8E1h3iVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/344) 2023-07-05T20:13:22.359 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph 2023-07-05T20:13:22.363 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-05T20:13:22.364 INFO:teuthology.orchestra.run.smithi046.stdout:MKFS_OPTIONS -- 172.21.15.46:6789:/scratch 2023-07-05T20:13:22.364 INFO:teuthology.orchestra.run.smithi046.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCbvKVkpp1TIhAAvJTELoeH8wkIFqjtppg17w== -o context=system_u:object_r:root_t:s0 172.21.15.46:6789:/scratch /tmp/tmp.KrMG67MsYpscratch 2023-07-05T20:13:22.364 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T20:13:28.073 INFO:teuthology.orchestra.run.smithi046.stdout:generic/344 5s 2023-07-05T20:13:28.078 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/344 2023-07-05T20:13:28.079 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-07-05T20:13:28.081 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T20:13:28.089 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-05T20:13:28.089 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.rlt8E1h3iVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/345) 2023-07-05T20:13:28.311 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph 2023-07-05T20:13:28.316 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-05T20:13:28.316 INFO:teuthology.orchestra.run.smithi046.stdout:MKFS_OPTIONS -- 172.21.15.46:6789:/scratch 2023-07-05T20:13:28.317 INFO:teuthology.orchestra.run.smithi046.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCbvKVkpp1TIhAAvJTELoeH8wkIFqjtppg17w== -o context=system_u:object_r:root_t:s0 172.21.15.46:6789:/scratch /tmp/tmp.KrMG67MsYpscratch 2023-07-05T20:13:28.317 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T20:13:32.829 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-05T20:13:32.838 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-05T20:13:34.186 INFO:teuthology.orchestra.run.smithi046.stdout:generic/345 6s 2023-07-05T20:13:34.192 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/345 2023-07-05T20:13:34.192 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-07-05T20:13:34.195 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T20:13:34.205 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-05T20:13:34.205 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.rlt8E1h3iVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/346) 2023-07-05T20:13:34.434 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph 2023-07-05T20:13:34.438 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-05T20:13:34.438 INFO:teuthology.orchestra.run.smithi046.stdout:MKFS_OPTIONS -- 172.21.15.46:6789:/scratch 2023-07-05T20:13:34.439 INFO:teuthology.orchestra.run.smithi046.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCbvKVkpp1TIhAAvJTELoeH8wkIFqjtppg17w== -o context=system_u:object_r:root_t:s0 172.21.15.46:6789:/scratch /tmp/tmp.KrMG67MsYpscratch 2023-07-05T20:13:34.439 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T20:13:38.076 INFO:teuthology.orchestra.run.smithi046.stdout:generic/346 4s 2023-07-05T20:13:38.163 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/346 2023-07-05T20:13:38.164 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-07-05T20:13:38.185 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T20:13:38.203 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-05T20:13:38.204 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.rlt8E1h3iVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/347) 2023-07-05T20:13:38.437 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph 2023-07-05T20:13:38.441 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-05T20:13:38.442 INFO:teuthology.orchestra.run.smithi046.stdout:MKFS_OPTIONS -- 172.21.15.46:6789:/scratch 2023-07-05T20:13:38.443 INFO:teuthology.orchestra.run.smithi046.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCbvKVkpp1TIhAAvJTELoeH8wkIFqjtppg17w== -o context=system_u:object_r:root_t:s0 172.21.15.46:6789:/scratch /tmp/tmp.KrMG67MsYpscratch 2023-07-05T20:13:38.443 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T20:13:39.035 INFO:teuthology.orchestra.run.smithi046.stdout:generic/347 [not run] require 172.21.15.46:6789:/scratch to be valid block disk 2023-07-05T20:13:39.044 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/347 2023-07-05T20:13:39.044 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/347 2023-07-05T20:13:39.045 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-07-05T20:13:39.049 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T20:13:39.087 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-05T20:13:39.088 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.rlt8E1h3iVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/348) 2023-07-05T20:13:39.383 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph 2023-07-05T20:13:39.387 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-05T20:13:39.387 INFO:teuthology.orchestra.run.smithi046.stdout:MKFS_OPTIONS -- 172.21.15.46:6789:/scratch 2023-07-05T20:13:39.388 INFO:teuthology.orchestra.run.smithi046.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCbvKVkpp1TIhAAvJTELoeH8wkIFqjtppg17w== -o context=system_u:object_r:root_t:s0 172.21.15.46:6789:/scratch /tmp/tmp.KrMG67MsYpscratch 2023-07-05T20:13:39.389 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T20:13:39.758 INFO:teuthology.orchestra.run.smithi046.stdout:generic/348 [not run] require 172.21.15.46:6789:/scratch to be valid block disk 2023-07-05T20:13:39.762 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/348 2023-07-05T20:13:39.763 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/348 2023-07-05T20:13:39.763 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-07-05T20:13:39.764 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T20:13:39.796 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-05T20:13:39.796 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.rlt8E1h3iVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/349) 2023-07-05T20:13:40.019 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph 2023-07-05T20:13:40.023 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-05T20:13:40.024 INFO:teuthology.orchestra.run.smithi046.stdout:MKFS_OPTIONS -- 172.21.15.46:6789:/scratch 2023-07-05T20:13:40.024 INFO:teuthology.orchestra.run.smithi046.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCbvKVkpp1TIhAAvJTELoeH8wkIFqjtppg17w== -o context=system_u:object_r:root_t:s0 172.21.15.46:6789:/scratch /tmp/tmp.KrMG67MsYpscratch 2023-07-05T20:13:40.025 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T20:13:40.471 INFO:teuthology.orchestra.run.smithi046.stdout:generic/349 [not run] xfs_io fzero failed (old kernel/wrong fs?) 2023-07-05T20:13:40.475 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/349 2023-07-05T20:13:40.475 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/349 2023-07-05T20:13:40.475 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-07-05T20:13:40.477 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T20:13:40.509 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-05T20:13:40.510 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.rlt8E1h3iVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/350) 2023-07-05T20:13:40.737 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph 2023-07-05T20:13:40.741 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-05T20:13:40.742 INFO:teuthology.orchestra.run.smithi046.stdout:MKFS_OPTIONS -- 172.21.15.46:6789:/scratch 2023-07-05T20:13:40.742 INFO:teuthology.orchestra.run.smithi046.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCbvKVkpp1TIhAAvJTELoeH8wkIFqjtppg17w== -o context=system_u:object_r:root_t:s0 172.21.15.46:6789:/scratch /tmp/tmp.KrMG67MsYpscratch 2023-07-05T20:13:40.743 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T20:13:41.663 INFO:teuthology.orchestra.run.smithi046.stdout:generic/350 1s 2023-07-05T20:13:41.668 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/350 2023-07-05T20:13:41.668 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-07-05T20:13:41.670 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T20:13:41.678 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-05T20:13:41.679 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.rlt8E1h3iVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/351) 2023-07-05T20:13:41.903 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph 2023-07-05T20:13:41.908 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-05T20:13:41.908 INFO:teuthology.orchestra.run.smithi046.stdout:MKFS_OPTIONS -- 172.21.15.46:6789:/scratch 2023-07-05T20:13:41.909 INFO:teuthology.orchestra.run.smithi046.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCbvKVkpp1TIhAAvJTELoeH8wkIFqjtppg17w== -o context=system_u:object_r:root_t:s0 172.21.15.46:6789:/scratch /tmp/tmp.KrMG67MsYpscratch 2023-07-05T20:13:41.909 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T20:13:42.267 INFO:teuthology.orchestra.run.smithi046.stdout:generic/351 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-07-05T20:13:42.271 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/351 2023-07-05T20:13:42.272 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/351 2023-07-05T20:13:42.272 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-07-05T20:13:42.273 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T20:13:42.305 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-05T20:13:42.306 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.rlt8E1h3iVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/352) 2023-07-05T20:13:42.533 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph 2023-07-05T20:13:42.537 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-05T20:13:42.537 INFO:teuthology.orchestra.run.smithi046.stdout:MKFS_OPTIONS -- 172.21.15.46:6789:/scratch 2023-07-05T20:13:42.538 INFO:teuthology.orchestra.run.smithi046.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCbvKVkpp1TIhAAvJTELoeH8wkIFqjtppg17w== -o context=system_u:object_r:root_t:s0 172.21.15.46:6789:/scratch /tmp/tmp.KrMG67MsYpscratch 2023-07-05T20:13:42.538 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T20:13:43.441 INFO:teuthology.orchestra.run.smithi046.stdout:generic/352 [not run] Reflink not supported by scratch filesystem type: ceph 2023-07-05T20:13:43.475 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/352 2023-07-05T20:13:43.475 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/352 2023-07-05T20:13:43.475 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-07-05T20:13:43.481 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T20:13:43.512 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-05T20:13:43.513 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.rlt8E1h3iVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/353) 2023-07-05T20:13:43.734 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph 2023-07-05T20:13:43.738 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-05T20:13:43.739 INFO:teuthology.orchestra.run.smithi046.stdout:MKFS_OPTIONS -- 172.21.15.46:6789:/scratch 2023-07-05T20:13:43.739 INFO:teuthology.orchestra.run.smithi046.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCbvKVkpp1TIhAAvJTELoeH8wkIFqjtppg17w== -o context=system_u:object_r:root_t:s0 172.21.15.46:6789:/scratch /tmp/tmp.KrMG67MsYpscratch 2023-07-05T20:13:43.739 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T20:13:44.786 INFO:teuthology.orchestra.run.smithi046.stdout:generic/353 [not run] Reflink not supported by scratch filesystem type: ceph 2023-07-05T20:13:44.819 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/353 2023-07-05T20:13:44.819 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/353 2023-07-05T20:13:44.820 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-07-05T20:13:44.827 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T20:13:44.875 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-05T20:13:44.876 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.rlt8E1h3iVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/354) 2023-07-05T20:13:45.105 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph 2023-07-05T20:13:45.109 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-05T20:13:45.109 INFO:teuthology.orchestra.run.smithi046.stdout:MKFS_OPTIONS -- 172.21.15.46:6789:/scratch 2023-07-05T20:13:45.111 INFO:teuthology.orchestra.run.smithi046.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCbvKVkpp1TIhAAvJTELoeH8wkIFqjtppg17w== -o context=system_u:object_r:root_t:s0 172.21.15.46:6789:/scratch /tmp/tmp.KrMG67MsYpscratch 2023-07-05T20:13:45.111 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T20:13:50.404 INFO:teuthology.orchestra.run.smithi046.stdout:generic/354 5s 2023-07-05T20:13:50.412 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/354 2023-07-05T20:13:50.413 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-07-05T20:13:50.415 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T20:13:50.424 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-05T20:13:50.425 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.rlt8E1h3iVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/355) 2023-07-05T20:13:50.704 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph 2023-07-05T20:13:50.710 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-05T20:13:50.711 INFO:teuthology.orchestra.run.smithi046.stdout:MKFS_OPTIONS -- 172.21.15.46:6789:/scratch 2023-07-05T20:13:50.713 INFO:teuthology.orchestra.run.smithi046.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCbvKVkpp1TIhAAvJTELoeH8wkIFqjtppg17w== -o context=system_u:object_r:root_t:s0 172.21.15.46:6789:/scratch /tmp/tmp.KrMG67MsYpscratch 2023-07-05T20:13:50.713 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T20:13:51.717 INFO:teuthology.orchestra.run.smithi046.stdout:generic/355 0s 2023-07-05T20:13:51.732 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/355 2023-07-05T20:13:51.732 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-07-05T20:13:51.734 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T20:13:52.097 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-05T20:13:52.098 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.rlt8E1h3iVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/356) 2023-07-05T20:13:52.425 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph 2023-07-05T20:13:52.430 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-05T20:13:52.431 INFO:teuthology.orchestra.run.smithi046.stdout:MKFS_OPTIONS -- 172.21.15.46:6789:/scratch 2023-07-05T20:13:52.431 INFO:teuthology.orchestra.run.smithi046.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCbvKVkpp1TIhAAvJTELoeH8wkIFqjtppg17w== -o context=system_u:object_r:root_t:s0 172.21.15.46:6789:/scratch /tmp/tmp.KrMG67MsYpscratch 2023-07-05T20:13:52.431 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T20:13:53.043 INFO:teuthology.orchestra.run.smithi046.stdout:generic/356 [not run] swapfiles are not supported 2023-07-05T20:13:53.047 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/356 2023-07-05T20:13:53.047 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/356 2023-07-05T20:13:53.047 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-07-05T20:13:53.049 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T20:13:53.076 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-05T20:13:53.077 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.rlt8E1h3iVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/357) 2023-07-05T20:13:53.298 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph 2023-07-05T20:13:53.302 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-05T20:13:53.303 INFO:teuthology.orchestra.run.smithi046.stdout:MKFS_OPTIONS -- 172.21.15.46:6789:/scratch 2023-07-05T20:13:53.304 INFO:teuthology.orchestra.run.smithi046.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCbvKVkpp1TIhAAvJTELoeH8wkIFqjtppg17w== -o context=system_u:object_r:root_t:s0 172.21.15.46:6789:/scratch /tmp/tmp.KrMG67MsYpscratch 2023-07-05T20:13:53.304 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T20:13:53.893 INFO:teuthology.orchestra.run.smithi046.stdout:generic/357 [not run] swapfiles are not supported 2023-07-05T20:13:53.897 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/357 2023-07-05T20:13:53.897 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/357 2023-07-05T20:13:53.897 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-07-05T20:13:53.899 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T20:13:53.929 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-05T20:13:53.930 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.rlt8E1h3iVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/358) 2023-07-05T20:13:54.152 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph 2023-07-05T20:13:54.157 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-05T20:13:54.157 INFO:teuthology.orchestra.run.smithi046.stdout:MKFS_OPTIONS -- 172.21.15.46:6789:/scratch 2023-07-05T20:13:54.158 INFO:teuthology.orchestra.run.smithi046.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCbvKVkpp1TIhAAvJTELoeH8wkIFqjtppg17w== -o context=system_u:object_r:root_t:s0 172.21.15.46:6789:/scratch /tmp/tmp.KrMG67MsYpscratch 2023-07-05T20:13:54.158 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T20:13:54.843 INFO:teuthology.orchestra.run.smithi046.stdout:generic/358 [not run] Reflink not supported by scratch filesystem type: ceph 2023-07-05T20:13:55.115 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/358 2023-07-05T20:13:55.115 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/358 2023-07-05T20:13:55.115 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-07-05T20:13:55.123 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T20:13:55.150 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-05T20:13:55.151 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.rlt8E1h3iVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/359) 2023-07-05T20:13:55.383 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph 2023-07-05T20:13:55.388 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-05T20:13:55.388 INFO:teuthology.orchestra.run.smithi046.stdout:MKFS_OPTIONS -- 172.21.15.46:6789:/scratch 2023-07-05T20:13:55.389 INFO:teuthology.orchestra.run.smithi046.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCbvKVkpp1TIhAAvJTELoeH8wkIFqjtppg17w== -o context=system_u:object_r:root_t:s0 172.21.15.46:6789:/scratch /tmp/tmp.KrMG67MsYpscratch 2023-07-05T20:13:55.389 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T20:13:56.281 INFO:teuthology.orchestra.run.smithi046.stdout:generic/359 [not run] Reflink not supported by scratch filesystem type: ceph 2023-07-05T20:13:56.325 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/359 2023-07-05T20:13:56.326 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/359 2023-07-05T20:13:56.326 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-07-05T20:13:56.328 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T20:13:56.355 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-05T20:13:56.355 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.rlt8E1h3iVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/360) 2023-07-05T20:13:56.577 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph 2023-07-05T20:13:56.581 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-05T20:13:56.582 INFO:teuthology.orchestra.run.smithi046.stdout:MKFS_OPTIONS -- 172.21.15.46:6789:/scratch 2023-07-05T20:13:56.583 INFO:teuthology.orchestra.run.smithi046.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCbvKVkpp1TIhAAvJTELoeH8wkIFqjtppg17w== -o context=system_u:object_r:root_t:s0 172.21.15.46:6789:/scratch /tmp/tmp.KrMG67MsYpscratch 2023-07-05T20:13:56.583 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T20:13:56.984 INFO:teuthology.orchestra.run.smithi046.stdout:generic/360 0s 2023-07-05T20:13:56.988 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/360 2023-07-05T20:13:56.988 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-07-05T20:13:56.990 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T20:13:57.027 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-05T20:13:57.027 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.rlt8E1h3iVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/361) 2023-07-05T20:13:57.253 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph 2023-07-05T20:13:57.257 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-05T20:13:57.258 INFO:teuthology.orchestra.run.smithi046.stdout:MKFS_OPTIONS -- 172.21.15.46:6789:/scratch 2023-07-05T20:13:57.258 INFO:teuthology.orchestra.run.smithi046.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCbvKVkpp1TIhAAvJTELoeH8wkIFqjtppg17w== -o context=system_u:object_r:root_t:s0 172.21.15.46:6789:/scratch /tmp/tmp.KrMG67MsYpscratch 2023-07-05T20:13:57.259 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T20:13:57.609 INFO:teuthology.orchestra.run.smithi046.stdout:generic/361 [not run] require 172.21.15.46:6789:/scratch to be valid block disk 2023-07-05T20:13:57.614 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/361 2023-07-05T20:13:57.614 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/361 2023-07-05T20:13:57.614 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-07-05T20:13:57.616 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T20:13:57.650 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-05T20:13:57.651 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.rlt8E1h3iVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/362) 2023-07-05T20:13:57.872 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph 2023-07-05T20:13:57.877 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-05T20:13:57.877 INFO:teuthology.orchestra.run.smithi046.stdout:MKFS_OPTIONS -- 172.21.15.46:6789:/scratch 2023-07-05T20:13:57.878 INFO:teuthology.orchestra.run.smithi046.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCbvKVkpp1TIhAAvJTELoeH8wkIFqjtppg17w== -o context=system_u:object_r:root_t:s0 172.21.15.46:6789:/scratch /tmp/tmp.KrMG67MsYpscratch 2023-07-05T20:13:57.878 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T20:13:58.219 INFO:teuthology.orchestra.run.smithi046.stdout:generic/362 [not run] this test requires richacl support on $SCRATCH_DEV 2023-07-05T20:13:58.223 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/362 2023-07-05T20:13:58.223 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/362 2023-07-05T20:13:58.223 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-07-05T20:13:58.225 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T20:13:58.256 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-05T20:13:58.257 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.rlt8E1h3iVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/363) 2023-07-05T20:13:58.499 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph 2023-07-05T20:13:58.503 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-05T20:13:58.504 INFO:teuthology.orchestra.run.smithi046.stdout:MKFS_OPTIONS -- 172.21.15.46:6789:/scratch 2023-07-05T20:13:58.505 INFO:teuthology.orchestra.run.smithi046.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCbvKVkpp1TIhAAvJTELoeH8wkIFqjtppg17w== -o context=system_u:object_r:root_t:s0 172.21.15.46:6789:/scratch /tmp/tmp.KrMG67MsYpscratch 2023-07-05T20:13:58.505 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T20:13:58.843 INFO:teuthology.orchestra.run.smithi046.stdout:generic/363 [not run] this test requires richacl support on $SCRATCH_DEV 2023-07-05T20:13:58.847 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/363 2023-07-05T20:13:58.848 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/363 2023-07-05T20:13:58.848 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-07-05T20:13:58.850 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T20:13:58.882 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-05T20:13:58.883 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.rlt8E1h3iVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/364) 2023-07-05T20:13:59.107 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph 2023-07-05T20:13:59.112 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-05T20:13:59.112 INFO:teuthology.orchestra.run.smithi046.stdout:MKFS_OPTIONS -- 172.21.15.46:6789:/scratch 2023-07-05T20:13:59.113 INFO:teuthology.orchestra.run.smithi046.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCbvKVkpp1TIhAAvJTELoeH8wkIFqjtppg17w== -o context=system_u:object_r:root_t:s0 172.21.15.46:6789:/scratch /tmp/tmp.KrMG67MsYpscratch 2023-07-05T20:13:59.113 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T20:13:59.455 INFO:teuthology.orchestra.run.smithi046.stdout:generic/364 [not run] this test requires richacl support on $SCRATCH_DEV 2023-07-05T20:13:59.459 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/364 2023-07-05T20:13:59.460 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/364 2023-07-05T20:13:59.460 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-07-05T20:13:59.461 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T20:13:59.488 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-05T20:13:59.489 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.rlt8E1h3iVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/365) 2023-07-05T20:13:59.714 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph 2023-07-05T20:13:59.718 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-05T20:13:59.719 INFO:teuthology.orchestra.run.smithi046.stdout:MKFS_OPTIONS -- 172.21.15.46:6789:/scratch 2023-07-05T20:13:59.720 INFO:teuthology.orchestra.run.smithi046.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCbvKVkpp1TIhAAvJTELoeH8wkIFqjtppg17w== -o context=system_u:object_r:root_t:s0 172.21.15.46:6789:/scratch /tmp/tmp.KrMG67MsYpscratch 2023-07-05T20:13:59.720 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T20:14:00.052 INFO:teuthology.orchestra.run.smithi046.stdout:generic/365 [not run] this test requires richacl support on $SCRATCH_DEV 2023-07-05T20:14:00.057 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/365 2023-07-05T20:14:00.057 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/365 2023-07-05T20:14:00.058 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-07-05T20:14:00.058 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T20:14:00.081 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-05T20:14:00.082 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.rlt8E1h3iVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/366) 2023-07-05T20:14:00.308 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph 2023-07-05T20:14:00.312 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-05T20:14:00.312 INFO:teuthology.orchestra.run.smithi046.stdout:MKFS_OPTIONS -- 172.21.15.46:6789:/scratch 2023-07-05T20:14:00.313 INFO:teuthology.orchestra.run.smithi046.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCbvKVkpp1TIhAAvJTELoeH8wkIFqjtppg17w== -o context=system_u:object_r:root_t:s0 172.21.15.46:6789:/scratch /tmp/tmp.KrMG67MsYpscratch 2023-07-05T20:14:00.313 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T20:14:00.660 INFO:teuthology.orchestra.run.smithi046.stdout:generic/366 [not run] this test requires richacl support on $SCRATCH_DEV 2023-07-05T20:14:00.664 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/366 2023-07-05T20:14:00.664 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/366 2023-07-05T20:14:00.664 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-07-05T20:14:00.666 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T20:14:00.688 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-05T20:14:00.689 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.rlt8E1h3iVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/367) 2023-07-05T20:14:00.910 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph 2023-07-05T20:14:00.914 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-05T20:14:00.914 INFO:teuthology.orchestra.run.smithi046.stdout:MKFS_OPTIONS -- 172.21.15.46:6789:/scratch 2023-07-05T20:14:00.915 INFO:teuthology.orchestra.run.smithi046.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCbvKVkpp1TIhAAvJTELoeH8wkIFqjtppg17w== -o context=system_u:object_r:root_t:s0 172.21.15.46:6789:/scratch /tmp/tmp.KrMG67MsYpscratch 2023-07-05T20:14:00.916 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T20:14:01.252 INFO:teuthology.orchestra.run.smithi046.stdout:generic/367 [not run] this test requires richacl support on $SCRATCH_DEV 2023-07-05T20:14:01.256 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/367 2023-07-05T20:14:01.256 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/367 2023-07-05T20:14:01.257 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-07-05T20:14:01.258 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T20:14:01.288 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-05T20:14:01.288 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.rlt8E1h3iVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/368) 2023-07-05T20:14:01.515 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph 2023-07-05T20:14:01.519 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-05T20:14:01.520 INFO:teuthology.orchestra.run.smithi046.stdout:MKFS_OPTIONS -- 172.21.15.46:6789:/scratch 2023-07-05T20:14:01.521 INFO:teuthology.orchestra.run.smithi046.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCbvKVkpp1TIhAAvJTELoeH8wkIFqjtppg17w== -o context=system_u:object_r:root_t:s0 172.21.15.46:6789:/scratch /tmp/tmp.KrMG67MsYpscratch 2023-07-05T20:14:01.521 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T20:14:01.855 INFO:teuthology.orchestra.run.smithi046.stdout:generic/368 [not run] this test requires richacl support on $SCRATCH_DEV 2023-07-05T20:14:01.859 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/368 2023-07-05T20:14:01.859 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/368 2023-07-05T20:14:01.859 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-07-05T20:14:01.861 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T20:14:01.892 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-05T20:14:01.893 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.rlt8E1h3iVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/369) 2023-07-05T20:14:02.113 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph 2023-07-05T20:14:02.117 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-05T20:14:02.117 INFO:teuthology.orchestra.run.smithi046.stdout:MKFS_OPTIONS -- 172.21.15.46:6789:/scratch 2023-07-05T20:14:02.118 INFO:teuthology.orchestra.run.smithi046.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCbvKVkpp1TIhAAvJTELoeH8wkIFqjtppg17w== -o context=system_u:object_r:root_t:s0 172.21.15.46:6789:/scratch /tmp/tmp.KrMG67MsYpscratch 2023-07-05T20:14:02.119 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T20:14:02.449 INFO:teuthology.orchestra.run.smithi046.stdout:generic/369 [not run] this test requires richacl support on $SCRATCH_DEV 2023-07-05T20:14:02.453 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/369 2023-07-05T20:14:02.454 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/369 2023-07-05T20:14:02.454 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-07-05T20:14:02.456 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T20:14:02.479 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-05T20:14:02.479 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.rlt8E1h3iVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/370) 2023-07-05T20:14:02.700 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph 2023-07-05T20:14:02.705 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-05T20:14:02.705 INFO:teuthology.orchestra.run.smithi046.stdout:MKFS_OPTIONS -- 172.21.15.46:6789:/scratch 2023-07-05T20:14:02.706 INFO:teuthology.orchestra.run.smithi046.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCbvKVkpp1TIhAAvJTELoeH8wkIFqjtppg17w== -o context=system_u:object_r:root_t:s0 172.21.15.46:6789:/scratch /tmp/tmp.KrMG67MsYpscratch 2023-07-05T20:14:02.706 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T20:14:03.038 INFO:teuthology.orchestra.run.smithi046.stdout:generic/370 [not run] this test requires richacl support on $SCRATCH_DEV 2023-07-05T20:14:03.042 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/370 2023-07-05T20:14:03.042 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/370 2023-07-05T20:14:03.042 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-07-05T20:14:03.044 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T20:14:03.063 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-05T20:14:03.065 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-05T20:14:03.065 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.rlt8E1h3iVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/371) 2023-07-05T20:14:03.106 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-05T20:14:03.329 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph 2023-07-05T20:14:03.333 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-05T20:14:03.333 INFO:teuthology.orchestra.run.smithi046.stdout:MKFS_OPTIONS -- 172.21.15.46:6789:/scratch 2023-07-05T20:14:03.334 INFO:teuthology.orchestra.run.smithi046.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCbvKVkpp1TIhAAvJTELoeH8wkIFqjtppg17w== -o context=system_u:object_r:root_t:s0 172.21.15.46:6789:/scratch /tmp/tmp.KrMG67MsYpscratch 2023-07-05T20:14:03.334 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T20:14:03.692 INFO:teuthology.orchestra.run.smithi046.stdout:generic/371 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-07-05T20:14:03.696 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/371 2023-07-05T20:14:03.696 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/371 2023-07-05T20:14:03.697 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-07-05T20:14:03.698 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T20:14:03.728 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-05T20:14:03.732 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.rlt8E1h3iVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/372) 2023-07-05T20:14:03.953 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph 2023-07-05T20:14:03.957 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-05T20:14:03.958 INFO:teuthology.orchestra.run.smithi046.stdout:MKFS_OPTIONS -- 172.21.15.46:6789:/scratch 2023-07-05T20:14:03.958 INFO:teuthology.orchestra.run.smithi046.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCbvKVkpp1TIhAAvJTELoeH8wkIFqjtppg17w== -o context=system_u:object_r:root_t:s0 172.21.15.46:6789:/scratch /tmp/tmp.KrMG67MsYpscratch 2023-07-05T20:14:03.959 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T20:14:04.597 INFO:teuthology.orchestra.run.smithi046.stdout:generic/372 [not run] Reflink not supported by scratch filesystem type: ceph 2023-07-05T20:14:04.763 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/372 2023-07-05T20:14:04.774 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/372 2023-07-05T20:14:04.774 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-07-05T20:14:04.886 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T20:14:04.928 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-05T20:14:04.929 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.rlt8E1h3iVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/373) 2023-07-05T20:14:05.154 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph 2023-07-05T20:14:05.158 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-05T20:14:05.159 INFO:teuthology.orchestra.run.smithi046.stdout:MKFS_OPTIONS -- 172.21.15.46:6789:/scratch 2023-07-05T20:14:05.160 INFO:teuthology.orchestra.run.smithi046.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCbvKVkpp1TIhAAvJTELoeH8wkIFqjtppg17w== -o context=system_u:object_r:root_t:s0 172.21.15.46:6789:/scratch /tmp/tmp.KrMG67MsYpscratch 2023-07-05T20:14:05.160 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T20:14:06.060 INFO:teuthology.orchestra.run.smithi046.stdout:generic/373 [not run] Reflink not supported by scratch filesystem type: ceph 2023-07-05T20:14:06.078 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/373 2023-07-05T20:14:06.078 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/373 2023-07-05T20:14:06.078 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-07-05T20:14:06.080 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T20:14:06.127 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-05T20:14:06.127 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.rlt8E1h3iVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/374) 2023-07-05T20:14:06.368 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph 2023-07-05T20:14:06.372 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-05T20:14:06.373 INFO:teuthology.orchestra.run.smithi046.stdout:MKFS_OPTIONS -- 172.21.15.46:6789:/scratch 2023-07-05T20:14:06.374 INFO:teuthology.orchestra.run.smithi046.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCbvKVkpp1TIhAAvJTELoeH8wkIFqjtppg17w== -o context=system_u:object_r:root_t:s0 172.21.15.46:6789:/scratch /tmp/tmp.KrMG67MsYpscratch 2023-07-05T20:14:06.374 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T20:14:06.936 INFO:teuthology.orchestra.run.smithi046.stdout:generic/374 [not run] Dedupe not supported by scratch filesystem type: ceph 2023-07-05T20:14:07.276 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/374 2023-07-05T20:14:07.277 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/374 2023-07-05T20:14:07.277 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-07-05T20:14:07.285 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T20:14:07.356 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-05T20:14:07.357 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.rlt8E1h3iVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/375) 2023-07-05T20:14:07.579 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph 2023-07-05T20:14:07.584 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-05T20:14:07.585 INFO:teuthology.orchestra.run.smithi046.stdout:MKFS_OPTIONS -- 172.21.15.46:6789:/scratch 2023-07-05T20:14:07.585 INFO:teuthology.orchestra.run.smithi046.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCbvKVkpp1TIhAAvJTELoeH8wkIFqjtppg17w== -o context=system_u:object_r:root_t:s0 172.21.15.46:6789:/scratch /tmp/tmp.KrMG67MsYpscratch 2023-07-05T20:14:07.585 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T20:14:08.013 INFO:teuthology.orchestra.run.smithi046.stdout:generic/375 1s 2023-07-05T20:14:08.018 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/375 2023-07-05T20:14:08.018 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-07-05T20:14:08.020 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T20:14:08.325 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-05T20:14:08.325 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.rlt8E1h3iVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/376) 2023-07-05T20:14:08.659 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph 2023-07-05T20:14:08.663 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-05T20:14:08.664 INFO:teuthology.orchestra.run.smithi046.stdout:MKFS_OPTIONS -- 172.21.15.46:6789:/scratch 2023-07-05T20:14:08.665 INFO:teuthology.orchestra.run.smithi046.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCbvKVkpp1TIhAAvJTELoeH8wkIFqjtppg17w== -o context=system_u:object_r:root_t:s0 172.21.15.46:6789:/scratch /tmp/tmp.KrMG67MsYpscratch 2023-07-05T20:14:08.665 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T20:14:09.036 INFO:teuthology.orchestra.run.smithi046.stdout:generic/376 [not run] require 172.21.15.46:6789:/scratch to be valid block disk 2023-07-05T20:14:09.041 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/376 2023-07-05T20:14:09.041 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/376 2023-07-05T20:14:09.041 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-07-05T20:14:09.042 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T20:14:09.064 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-05T20:14:09.064 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.rlt8E1h3iVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/377) 2023-07-05T20:14:09.290 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph 2023-07-05T20:14:09.295 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-05T20:14:09.295 INFO:teuthology.orchestra.run.smithi046.stdout:MKFS_OPTIONS -- 172.21.15.46:6789:/scratch 2023-07-05T20:14:09.296 INFO:teuthology.orchestra.run.smithi046.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCbvKVkpp1TIhAAvJTELoeH8wkIFqjtppg17w== -o context=system_u:object_r:root_t:s0 172.21.15.46:6789:/scratch /tmp/tmp.KrMG67MsYpscratch 2023-07-05T20:14:09.296 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T20:14:09.916 INFO:teuthology.orchestra.run.smithi046.stdout:generic/377 0s 2023-07-05T20:14:09.921 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/377 2023-07-05T20:14:09.921 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-07-05T20:14:09.923 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T20:14:09.931 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-05T20:14:09.931 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.rlt8E1h3iVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/378) 2023-07-05T20:14:10.154 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph 2023-07-05T20:14:10.158 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-05T20:14:10.159 INFO:teuthology.orchestra.run.smithi046.stdout:MKFS_OPTIONS -- 172.21.15.46:6789:/scratch 2023-07-05T20:14:10.160 INFO:teuthology.orchestra.run.smithi046.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCbvKVkpp1TIhAAvJTELoeH8wkIFqjtppg17w== -o context=system_u:object_r:root_t:s0 172.21.15.46:6789:/scratch /tmp/tmp.KrMG67MsYpscratch 2023-07-05T20:14:10.160 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T20:14:10.640 INFO:teuthology.orchestra.run.smithi046.stdout:generic/378 0s 2023-07-05T20:14:10.644 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/378 2023-07-05T20:14:10.645 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-07-05T20:14:10.647 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T20:14:11.020 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-05T20:14:11.020 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.rlt8E1h3iVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/379) 2023-07-05T20:14:11.287 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph 2023-07-05T20:14:11.291 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-05T20:14:11.292 INFO:teuthology.orchestra.run.smithi046.stdout:MKFS_OPTIONS -- 172.21.15.46:6789:/scratch 2023-07-05T20:14:11.292 INFO:teuthology.orchestra.run.smithi046.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCbvKVkpp1TIhAAvJTELoeH8wkIFqjtppg17w== -o context=system_u:object_r:root_t:s0 172.21.15.46:6789:/scratch /tmp/tmp.KrMG67MsYpscratch 2023-07-05T20:14:11.293 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T20:14:11.658 INFO:teuthology.orchestra.run.smithi046.stdout:generic/379 [not run] disk quotas not supported by this filesystem type: ceph 2023-07-05T20:14:11.662 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/379 2023-07-05T20:14:11.663 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/379 2023-07-05T20:14:11.663 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-07-05T20:14:11.664 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T20:14:11.699 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-05T20:14:11.700 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.rlt8E1h3iVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/380) 2023-07-05T20:14:11.940 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph 2023-07-05T20:14:11.945 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-05T20:14:11.945 INFO:teuthology.orchestra.run.smithi046.stdout:MKFS_OPTIONS -- 172.21.15.46:6789:/scratch 2023-07-05T20:14:11.946 INFO:teuthology.orchestra.run.smithi046.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCbvKVkpp1TIhAAvJTELoeH8wkIFqjtppg17w== -o context=system_u:object_r:root_t:s0 172.21.15.46:6789:/scratch /tmp/tmp.KrMG67MsYpscratch 2023-07-05T20:14:11.947 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T20:14:12.285 INFO:teuthology.orchestra.run.smithi046.stdout:generic/380 [not run] disk quotas not supported by this filesystem type: ceph 2023-07-05T20:14:12.289 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/380 2023-07-05T20:14:12.290 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/380 2023-07-05T20:14:12.290 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-07-05T20:14:12.292 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T20:14:12.312 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-05T20:14:12.313 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.rlt8E1h3iVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/381) 2023-07-05T20:14:12.537 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph 2023-07-05T20:14:12.545 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-05T20:14:12.545 INFO:teuthology.orchestra.run.smithi046.stdout:MKFS_OPTIONS -- 172.21.15.46:6789:/scratch 2023-07-05T20:14:12.545 INFO:teuthology.orchestra.run.smithi046.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCbvKVkpp1TIhAAvJTELoeH8wkIFqjtppg17w== -o context=system_u:object_r:root_t:s0 172.21.15.46:6789:/scratch /tmp/tmp.KrMG67MsYpscratch 2023-07-05T20:14:12.545 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T20:14:12.890 INFO:teuthology.orchestra.run.smithi046.stdout:generic/381 [not run] disk quotas not supported by this filesystem type: ceph 2023-07-05T20:14:12.894 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/381 2023-07-05T20:14:12.894 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/381 2023-07-05T20:14:12.894 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-07-05T20:14:12.896 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T20:14:12.918 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-05T20:14:12.919 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.rlt8E1h3iVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/382) 2023-07-05T20:14:13.160 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph 2023-07-05T20:14:13.164 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-05T20:14:13.165 INFO:teuthology.orchestra.run.smithi046.stdout:MKFS_OPTIONS -- 172.21.15.46:6789:/scratch 2023-07-05T20:14:13.166 INFO:teuthology.orchestra.run.smithi046.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCbvKVkpp1TIhAAvJTELoeH8wkIFqjtppg17w== -o context=system_u:object_r:root_t:s0 172.21.15.46:6789:/scratch /tmp/tmp.KrMG67MsYpscratch 2023-07-05T20:14:13.166 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T20:14:13.511 INFO:teuthology.orchestra.run.smithi046.stdout:generic/382 [not run] disk quotas not supported by this filesystem type: ceph 2023-07-05T20:14:13.515 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/382 2023-07-05T20:14:13.515 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/382 2023-07-05T20:14:13.516 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-07-05T20:14:13.518 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T20:14:13.539 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-05T20:14:13.540 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.rlt8E1h3iVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/383) 2023-07-05T20:14:13.767 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph 2023-07-05T20:14:13.772 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-05T20:14:13.772 INFO:teuthology.orchestra.run.smithi046.stdout:MKFS_OPTIONS -- 172.21.15.46:6789:/scratch 2023-07-05T20:14:13.773 INFO:teuthology.orchestra.run.smithi046.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCbvKVkpp1TIhAAvJTELoeH8wkIFqjtppg17w== -o context=system_u:object_r:root_t:s0 172.21.15.46:6789:/scratch /tmp/tmp.KrMG67MsYpscratch 2023-07-05T20:14:13.773 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T20:14:14.125 INFO:teuthology.orchestra.run.smithi046.stdout:generic/383 [not run] disk quotas not supported by this filesystem type: ceph 2023-07-05T20:14:14.129 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/383 2023-07-05T20:14:14.130 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/383 2023-07-05T20:14:14.130 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-07-05T20:14:14.132 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T20:14:14.157 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-05T20:14:14.158 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.rlt8E1h3iVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/384) 2023-07-05T20:14:14.398 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph 2023-07-05T20:14:14.402 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-05T20:14:14.403 INFO:teuthology.orchestra.run.smithi046.stdout:MKFS_OPTIONS -- 172.21.15.46:6789:/scratch 2023-07-05T20:14:14.404 INFO:teuthology.orchestra.run.smithi046.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCbvKVkpp1TIhAAvJTELoeH8wkIFqjtppg17w== -o context=system_u:object_r:root_t:s0 172.21.15.46:6789:/scratch /tmp/tmp.KrMG67MsYpscratch 2023-07-05T20:14:14.404 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T20:14:14.750 INFO:teuthology.orchestra.run.smithi046.stdout:generic/384 [not run] disk quotas not supported by this filesystem type: ceph 2023-07-05T20:14:14.754 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/384 2023-07-05T20:14:14.755 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/384 2023-07-05T20:14:14.755 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-07-05T20:14:14.756 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T20:14:14.786 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-05T20:14:14.787 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.rlt8E1h3iVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/385) 2023-07-05T20:14:15.010 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph 2023-07-05T20:14:15.014 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-05T20:14:15.014 INFO:teuthology.orchestra.run.smithi046.stdout:MKFS_OPTIONS -- 172.21.15.46:6789:/scratch 2023-07-05T20:14:15.015 INFO:teuthology.orchestra.run.smithi046.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCbvKVkpp1TIhAAvJTELoeH8wkIFqjtppg17w== -o context=system_u:object_r:root_t:s0 172.21.15.46:6789:/scratch /tmp/tmp.KrMG67MsYpscratch 2023-07-05T20:14:15.015 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T20:14:15.367 INFO:teuthology.orchestra.run.smithi046.stdout:generic/385 [not run] disk quotas not supported by this filesystem type: ceph 2023-07-05T20:14:15.371 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/385 2023-07-05T20:14:15.372 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/385 2023-07-05T20:14:15.372 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-07-05T20:14:15.373 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T20:14:15.402 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-05T20:14:15.403 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.rlt8E1h3iVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/386) 2023-07-05T20:14:15.641 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph 2023-07-05T20:14:15.645 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-05T20:14:15.646 INFO:teuthology.orchestra.run.smithi046.stdout:MKFS_OPTIONS -- 172.21.15.46:6789:/scratch 2023-07-05T20:14:15.647 INFO:teuthology.orchestra.run.smithi046.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCbvKVkpp1TIhAAvJTELoeH8wkIFqjtppg17w== -o context=system_u:object_r:root_t:s0 172.21.15.46:6789:/scratch /tmp/tmp.KrMG67MsYpscratch 2023-07-05T20:14:15.647 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T20:14:15.976 INFO:teuthology.orchestra.run.smithi046.stdout:generic/386 [not run] disk quotas not supported by this filesystem type: ceph 2023-07-05T20:14:15.980 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/386 2023-07-05T20:14:15.980 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/386 2023-07-05T20:14:15.981 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-07-05T20:14:15.983 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T20:14:16.015 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-05T20:14:16.015 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.rlt8E1h3iVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/387) 2023-07-05T20:14:16.238 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph 2023-07-05T20:14:16.243 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-05T20:14:16.243 INFO:teuthology.orchestra.run.smithi046.stdout:MKFS_OPTIONS -- 172.21.15.46:6789:/scratch 2023-07-05T20:14:16.244 INFO:teuthology.orchestra.run.smithi046.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCbvKVkpp1TIhAAvJTELoeH8wkIFqjtppg17w== -o context=system_u:object_r:root_t:s0 172.21.15.46:6789:/scratch /tmp/tmp.KrMG67MsYpscratch 2023-07-05T20:14:16.244 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T20:14:17.136 INFO:teuthology.orchestra.run.smithi046.stdout:generic/387 [not run] Reflink not supported by scratch filesystem type: ceph 2023-07-05T20:14:17.165 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/387 2023-07-05T20:14:17.166 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/387 2023-07-05T20:14:17.166 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-07-05T20:14:17.172 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T20:14:17.221 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-05T20:14:17.222 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.rlt8E1h3iVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/388) 2023-07-05T20:14:17.464 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph 2023-07-05T20:14:17.468 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-05T20:14:17.469 INFO:teuthology.orchestra.run.smithi046.stdout:MKFS_OPTIONS -- 172.21.15.46:6789:/scratch 2023-07-05T20:14:17.470 INFO:teuthology.orchestra.run.smithi046.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCbvKVkpp1TIhAAvJTELoeH8wkIFqjtppg17w== -o context=system_u:object_r:root_t:s0 172.21.15.46:6789:/scratch /tmp/tmp.KrMG67MsYpscratch 2023-07-05T20:14:17.470 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T20:14:17.839 INFO:teuthology.orchestra.run.smithi046.stdout:generic/388 [not run] require 172.21.15.46:6789:/scratch to be local device 2023-07-05T20:14:17.845 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/388 2023-07-05T20:14:17.845 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/388 2023-07-05T20:14:17.846 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-07-05T20:14:17.846 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T20:14:17.879 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-05T20:14:17.880 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.rlt8E1h3iVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/389) 2023-07-05T20:14:18.109 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph 2023-07-05T20:14:18.113 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-05T20:14:18.114 INFO:teuthology.orchestra.run.smithi046.stdout:MKFS_OPTIONS -- 172.21.15.46:6789:/scratch 2023-07-05T20:14:18.115 INFO:teuthology.orchestra.run.smithi046.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCbvKVkpp1TIhAAvJTELoeH8wkIFqjtppg17w== -o context=system_u:object_r:root_t:s0 172.21.15.46:6789:/scratch /tmp/tmp.KrMG67MsYpscratch 2023-07-05T20:14:18.115 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T20:14:18.461 INFO:teuthology.orchestra.run.smithi046.stdout:generic/389 [not run] O_TMPFILE is not supported 2023-07-05T20:14:18.465 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/389 2023-07-05T20:14:18.465 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/389 2023-07-05T20:14:18.465 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-07-05T20:14:18.467 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T20:14:18.499 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-05T20:14:18.500 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.rlt8E1h3iVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/390) 2023-07-05T20:14:18.722 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph 2023-07-05T20:14:18.726 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-05T20:14:18.726 INFO:teuthology.orchestra.run.smithi046.stdout:MKFS_OPTIONS -- 172.21.15.46:6789:/scratch 2023-07-05T20:14:18.727 INFO:teuthology.orchestra.run.smithi046.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCbvKVkpp1TIhAAvJTELoeH8wkIFqjtppg17w== -o context=system_u:object_r:root_t:s0 172.21.15.46:6789:/scratch /tmp/tmp.KrMG67MsYpscratch 2023-07-05T20:14:18.727 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T20:14:19.084 INFO:teuthology.orchestra.run.smithi046.stdout:generic/390 [not run] ceph does not support freezing 2023-07-05T20:14:19.088 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/390 2023-07-05T20:14:19.088 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/390 2023-07-05T20:14:19.088 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-07-05T20:14:19.090 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T20:14:19.111 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-05T20:14:19.112 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.rlt8E1h3iVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/391) 2023-07-05T20:14:19.335 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph 2023-07-05T20:14:19.340 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-05T20:14:19.340 INFO:teuthology.orchestra.run.smithi046.stdout:MKFS_OPTIONS -- 172.21.15.46:6789:/scratch 2023-07-05T20:14:19.341 INFO:teuthology.orchestra.run.smithi046.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCbvKVkpp1TIhAAvJTELoeH8wkIFqjtppg17w== -o context=system_u:object_r:root_t:s0 172.21.15.46:6789:/scratch /tmp/tmp.KrMG67MsYpscratch 2023-07-05T20:14:19.341 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T20:14:19.696 INFO:teuthology.orchestra.run.smithi046.stdout:generic/391 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-07-05T20:14:19.700 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/391 2023-07-05T20:14:19.700 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/391 2023-07-05T20:14:19.700 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-07-05T20:14:19.702 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T20:14:19.731 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-05T20:14:19.732 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.rlt8E1h3iVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/392) 2023-07-05T20:14:19.957 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph 2023-07-05T20:14:19.961 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-05T20:14:19.961 INFO:teuthology.orchestra.run.smithi046.stdout:MKFS_OPTIONS -- 172.21.15.46:6789:/scratch 2023-07-05T20:14:19.962 INFO:teuthology.orchestra.run.smithi046.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCbvKVkpp1TIhAAvJTELoeH8wkIFqjtppg17w== -o context=system_u:object_r:root_t:s0 172.21.15.46:6789:/scratch /tmp/tmp.KrMG67MsYpscratch 2023-07-05T20:14:19.962 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T20:14:20.486 INFO:teuthology.orchestra.run.smithi046.stdout:generic/392 [not run] ceph does not support shutdown 2023-07-05T20:14:20.508 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/392 2023-07-05T20:14:20.509 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/392 2023-07-05T20:14:20.509 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-07-05T20:14:20.510 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T20:14:20.538 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-05T20:14:20.538 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.rlt8E1h3iVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/393) 2023-07-05T20:14:20.765 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph 2023-07-05T20:14:20.769 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-05T20:14:20.770 INFO:teuthology.orchestra.run.smithi046.stdout:MKFS_OPTIONS -- 172.21.15.46:6789:/scratch 2023-07-05T20:14:20.771 INFO:teuthology.orchestra.run.smithi046.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCbvKVkpp1TIhAAvJTELoeH8wkIFqjtppg17w== -o context=system_u:object_r:root_t:s0 172.21.15.46:6789:/scratch /tmp/tmp.KrMG67MsYpscratch 2023-07-05T20:14:20.771 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T20:14:21.909 INFO:teuthology.orchestra.run.smithi046.stdout:generic/393 1s 2023-07-05T20:14:21.914 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/393 2023-07-05T20:14:21.915 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-07-05T20:14:21.916 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T20:14:21.925 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-05T20:14:21.925 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.rlt8E1h3iVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/394) 2023-07-05T20:14:22.149 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph 2023-07-05T20:14:22.154 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-05T20:14:22.154 INFO:teuthology.orchestra.run.smithi046.stdout:MKFS_OPTIONS -- 172.21.15.46:6789:/scratch 2023-07-05T20:14:22.155 INFO:teuthology.orchestra.run.smithi046.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCbvKVkpp1TIhAAvJTELoeH8wkIFqjtppg17w== -o context=system_u:object_r:root_t:s0 172.21.15.46:6789:/scratch /tmp/tmp.KrMG67MsYpscratch 2023-07-05T20:14:22.155 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T20:14:22.525 INFO:teuthology.orchestra.run.smithi046.stdout:generic/394 0s 2023-07-05T20:14:22.530 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/394 2023-07-05T20:14:22.530 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-07-05T20:14:22.532 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T20:14:22.884 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-05T20:14:22.885 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.rlt8E1h3iVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/395) 2023-07-05T20:14:23.337 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph 2023-07-05T20:14:23.347 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-05T20:14:23.348 INFO:teuthology.orchestra.run.smithi046.stdout:MKFS_OPTIONS -- 172.21.15.46:6789:/scratch 2023-07-05T20:14:23.348 INFO:teuthology.orchestra.run.smithi046.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCbvKVkpp1TIhAAvJTELoeH8wkIFqjtppg17w== -o context=system_u:object_r:root_t:s0 172.21.15.46:6789:/scratch /tmp/tmp.KrMG67MsYpscratch 2023-07-05T20:14:23.349 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T20:14:24.218 INFO:teuthology.orchestra.run.smithi046.stdout:generic/395 [not run] kernel does not support ceph encryption 2023-07-05T20:14:24.248 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/395 2023-07-05T20:14:24.248 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/395 2023-07-05T20:14:24.248 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-07-05T20:14:24.249 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T20:14:24.288 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-05T20:14:24.288 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.rlt8E1h3iVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/396) 2023-07-05T20:14:24.585 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph 2023-07-05T20:14:24.589 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-05T20:14:24.589 INFO:teuthology.orchestra.run.smithi046.stdout:MKFS_OPTIONS -- 172.21.15.46:6789:/scratch 2023-07-05T20:14:24.590 INFO:teuthology.orchestra.run.smithi046.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCbvKVkpp1TIhAAvJTELoeH8wkIFqjtppg17w== -o context=system_u:object_r:root_t:s0 172.21.15.46:6789:/scratch /tmp/tmp.KrMG67MsYpscratch 2023-07-05T20:14:24.590 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T20:14:25.182 INFO:teuthology.orchestra.run.smithi046.stdout:generic/396 [not run] kernel does not support ceph encryption 2023-07-05T20:14:25.204 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/396 2023-07-05T20:14:25.205 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/396 2023-07-05T20:14:25.205 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-07-05T20:14:25.206 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T20:14:25.229 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-05T20:14:25.231 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.rlt8E1h3iVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/397) 2023-07-05T20:14:25.456 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph 2023-07-05T20:14:25.460 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-05T20:14:25.461 INFO:teuthology.orchestra.run.smithi046.stdout:MKFS_OPTIONS -- 172.21.15.46:6789:/scratch 2023-07-05T20:14:25.462 INFO:teuthology.orchestra.run.smithi046.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCbvKVkpp1TIhAAvJTELoeH8wkIFqjtppg17w== -o context=system_u:object_r:root_t:s0 172.21.15.46:6789:/scratch /tmp/tmp.KrMG67MsYpscratch 2023-07-05T20:14:25.462 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T20:14:26.053 INFO:teuthology.orchestra.run.smithi046.stdout:generic/397 [not run] kernel does not support ceph encryption 2023-07-05T20:14:26.074 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/397 2023-07-05T20:14:26.075 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/397 2023-07-05T20:14:26.075 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-07-05T20:14:26.076 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T20:14:26.101 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-05T20:14:26.102 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.rlt8E1h3iVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/398) 2023-07-05T20:14:26.326 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph 2023-07-05T20:14:26.330 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-05T20:14:26.331 INFO:teuthology.orchestra.run.smithi046.stdout:MKFS_OPTIONS -- 172.21.15.46:6789:/scratch 2023-07-05T20:14:26.331 INFO:teuthology.orchestra.run.smithi046.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCbvKVkpp1TIhAAvJTELoeH8wkIFqjtppg17w== -o context=system_u:object_r:root_t:s0 172.21.15.46:6789:/scratch /tmp/tmp.KrMG67MsYpscratch 2023-07-05T20:14:26.332 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T20:14:26.922 INFO:teuthology.orchestra.run.smithi046.stdout:generic/398 [not run] kernel does not support ceph encryption 2023-07-05T20:14:26.940 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/398 2023-07-05T20:14:26.940 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/398 2023-07-05T20:14:26.940 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-07-05T20:14:26.942 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T20:14:26.966 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-05T20:14:26.966 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.rlt8E1h3iVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/399) 2023-07-05T20:14:27.189 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph 2023-07-05T20:14:27.193 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-05T20:14:27.193 INFO:teuthology.orchestra.run.smithi046.stdout:MKFS_OPTIONS -- 172.21.15.46:6789:/scratch 2023-07-05T20:14:27.194 INFO:teuthology.orchestra.run.smithi046.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCbvKVkpp1TIhAAvJTELoeH8wkIFqjtppg17w== -o context=system_u:object_r:root_t:s0 172.21.15.46:6789:/scratch /tmp/tmp.KrMG67MsYpscratch 2023-07-05T20:14:27.195 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T20:14:27.751 INFO:teuthology.orchestra.run.smithi046.stdout:generic/399 [not run] kernel does not support ceph encryption 2023-07-05T20:14:27.773 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/399 2023-07-05T20:14:27.773 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/399 2023-07-05T20:14:27.773 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-07-05T20:14:27.774 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T20:14:27.802 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-05T20:14:27.804 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.rlt8E1h3iVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/400) 2023-07-05T20:14:28.025 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph 2023-07-05T20:14:28.030 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-05T20:14:28.030 INFO:teuthology.orchestra.run.smithi046.stdout:MKFS_OPTIONS -- 172.21.15.46:6789:/scratch 2023-07-05T20:14:28.030 INFO:teuthology.orchestra.run.smithi046.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCbvKVkpp1TIhAAvJTELoeH8wkIFqjtppg17w== -o context=system_u:object_r:root_t:s0 172.21.15.46:6789:/scratch /tmp/tmp.KrMG67MsYpscratch 2023-07-05T20:14:28.031 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T20:14:28.361 INFO:teuthology.orchestra.run.smithi046.stdout:generic/400 [not run] disk quotas not supported by this filesystem type: ceph 2023-07-05T20:14:28.365 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/400 2023-07-05T20:14:28.366 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/400 2023-07-05T20:14:28.366 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-07-05T20:14:28.367 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T20:14:28.391 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-05T20:14:28.392 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.rlt8E1h3iVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/401) 2023-07-05T20:14:28.615 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph 2023-07-05T20:14:28.619 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-05T20:14:28.620 INFO:teuthology.orchestra.run.smithi046.stdout:MKFS_OPTIONS -- 172.21.15.46:6789:/scratch 2023-07-05T20:14:28.621 INFO:teuthology.orchestra.run.smithi046.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCbvKVkpp1TIhAAvJTELoeH8wkIFqjtppg17w== -o context=system_u:object_r:root_t:s0 172.21.15.46:6789:/scratch /tmp/tmp.KrMG67MsYpscratch 2023-07-05T20:14:28.621 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T20:14:29.585 INFO:teuthology.orchestra.run.smithi046.stdout:generic/401 1s 2023-07-05T20:14:29.591 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/401 2023-07-05T20:14:29.591 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-07-05T20:14:29.593 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T20:14:29.604 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-05T20:14:29.604 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.rlt8E1h3iVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/402) 2023-07-05T20:14:29.847 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph 2023-07-05T20:14:29.851 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-05T20:14:29.851 INFO:teuthology.orchestra.run.smithi046.stdout:MKFS_OPTIONS -- 172.21.15.46:6789:/scratch 2023-07-05T20:14:29.852 INFO:teuthology.orchestra.run.smithi046.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCbvKVkpp1TIhAAvJTELoeH8wkIFqjtppg17w== -o context=system_u:object_r:root_t:s0 172.21.15.46:6789:/scratch /tmp/tmp.KrMG67MsYpscratch 2023-07-05T20:14:29.852 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T20:14:30.395 INFO:teuthology.orchestra.run.smithi046.stdout:generic/402 [not run] filesystem ceph timestamp bounds are unknown 2023-07-05T20:14:30.414 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/402 2023-07-05T20:14:30.414 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/402 2023-07-05T20:14:30.415 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-07-05T20:14:30.416 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T20:14:30.450 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-05T20:14:30.450 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.rlt8E1h3iVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/403) 2023-07-05T20:14:30.680 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph 2023-07-05T20:14:30.684 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-05T20:14:30.684 INFO:teuthology.orchestra.run.smithi046.stdout:MKFS_OPTIONS -- 172.21.15.46:6789:/scratch 2023-07-05T20:14:30.685 INFO:teuthology.orchestra.run.smithi046.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCbvKVkpp1TIhAAvJTELoeH8wkIFqjtppg17w== -o context=system_u:object_r:root_t:s0 172.21.15.46:6789:/scratch /tmp/tmp.KrMG67MsYpscratch 2023-07-05T20:14:30.685 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T20:14:31.444 INFO:teuthology.orchestra.run.smithi046.stdout:generic/403 1s 2023-07-05T20:14:31.449 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/403 2023-07-05T20:14:31.449 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-07-05T20:14:31.451 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T20:14:31.459 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-05T20:14:31.460 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.rlt8E1h3iVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/404) 2023-07-05T20:14:31.682 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph 2023-07-05T20:14:31.686 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-05T20:14:31.686 INFO:teuthology.orchestra.run.smithi046.stdout:MKFS_OPTIONS -- 172.21.15.46:6789:/scratch 2023-07-05T20:14:31.687 INFO:teuthology.orchestra.run.smithi046.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCbvKVkpp1TIhAAvJTELoeH8wkIFqjtppg17w== -o context=system_u:object_r:root_t:s0 172.21.15.46:6789:/scratch /tmp/tmp.KrMG67MsYpscratch 2023-07-05T20:14:31.687 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T20:14:32.054 INFO:teuthology.orchestra.run.smithi046.stdout:generic/404 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-07-05T20:14:32.058 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/404 2023-07-05T20:14:32.058 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/404 2023-07-05T20:14:32.059 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-07-05T20:14:32.060 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T20:14:32.100 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-05T20:14:32.101 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.rlt8E1h3iVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/405) 2023-07-05T20:14:32.326 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph 2023-07-05T20:14:32.330 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-05T20:14:32.331 INFO:teuthology.orchestra.run.smithi046.stdout:MKFS_OPTIONS -- 172.21.15.46:6789:/scratch 2023-07-05T20:14:32.331 INFO:teuthology.orchestra.run.smithi046.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCbvKVkpp1TIhAAvJTELoeH8wkIFqjtppg17w== -o context=system_u:object_r:root_t:s0 172.21.15.46:6789:/scratch /tmp/tmp.KrMG67MsYpscratch 2023-07-05T20:14:32.332 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T20:14:32.722 INFO:teuthology.orchestra.run.smithi046.stdout:generic/405 [not run] require 172.21.15.46:6789:/scratch to be valid block disk 2023-07-05T20:14:32.726 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/405 2023-07-05T20:14:32.726 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/405 2023-07-05T20:14:32.726 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-07-05T20:14:32.728 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T20:14:32.752 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-05T20:14:32.753 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.rlt8E1h3iVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/406) 2023-07-05T20:14:32.976 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph 2023-07-05T20:14:32.981 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-05T20:14:32.981 INFO:teuthology.orchestra.run.smithi046.stdout:MKFS_OPTIONS -- 172.21.15.46:6789:/scratch 2023-07-05T20:14:32.982 INFO:teuthology.orchestra.run.smithi046.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCbvKVkpp1TIhAAvJTELoeH8wkIFqjtppg17w== -o context=system_u:object_r:root_t:s0 172.21.15.46:6789:/scratch /tmp/tmp.KrMG67MsYpscratch 2023-07-05T20:14:32.982 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T20:14:33.169 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-05T20:14:33.171 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-05T20:14:34.793 INFO:teuthology.orchestra.run.smithi046.stdout:generic/406 1s 2023-07-05T20:14:34.798 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/406 2023-07-05T20:14:34.799 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-07-05T20:14:34.800 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T20:14:34.809 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-05T20:14:34.809 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.rlt8E1h3iVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/407) 2023-07-05T20:14:35.029 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph 2023-07-05T20:14:35.033 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-05T20:14:35.034 INFO:teuthology.orchestra.run.smithi046.stdout:MKFS_OPTIONS -- 172.21.15.46:6789:/scratch 2023-07-05T20:14:35.036 INFO:teuthology.orchestra.run.smithi046.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCbvKVkpp1TIhAAvJTELoeH8wkIFqjtppg17w== -o context=system_u:object_r:root_t:s0 172.21.15.46:6789:/scratch /tmp/tmp.KrMG67MsYpscratch 2023-07-05T20:14:35.037 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T20:14:35.430 INFO:teuthology.orchestra.run.smithi046.stdout:generic/407 [not run] Reflink not supported by test filesystem type: ceph 2023-07-05T20:14:35.434 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/407 2023-07-05T20:14:35.434 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/407 2023-07-05T20:14:35.435 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-07-05T20:14:35.436 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T20:14:35.822 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-05T20:14:35.822 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.rlt8E1h3iVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/408) 2023-07-05T20:14:36.103 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph 2023-07-05T20:14:36.107 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-05T20:14:36.108 INFO:teuthology.orchestra.run.smithi046.stdout:MKFS_OPTIONS -- 172.21.15.46:6789:/scratch 2023-07-05T20:14:36.109 INFO:teuthology.orchestra.run.smithi046.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCbvKVkpp1TIhAAvJTELoeH8wkIFqjtppg17w== -o context=system_u:object_r:root_t:s0 172.21.15.46:6789:/scratch /tmp/tmp.KrMG67MsYpscratch 2023-07-05T20:14:36.109 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T20:14:36.494 INFO:teuthology.orchestra.run.smithi046.stdout:generic/408 [not run] Dedupe not supported by test filesystem type: ceph 2023-07-05T20:14:36.499 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/408 2023-07-05T20:14:36.499 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/408 2023-07-05T20:14:36.499 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-07-05T20:14:36.501 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T20:14:36.883 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-05T20:14:36.884 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.rlt8E1h3iVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/409) 2023-07-05T20:14:37.123 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph 2023-07-05T20:14:37.128 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-05T20:14:37.129 INFO:teuthology.orchestra.run.smithi046.stdout:MKFS_OPTIONS -- 172.21.15.46:6789:/scratch 2023-07-05T20:14:37.130 INFO:teuthology.orchestra.run.smithi046.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCbvKVkpp1TIhAAvJTELoeH8wkIFqjtppg17w== -o context=system_u:object_r:root_t:s0 172.21.15.46:6789:/scratch /tmp/tmp.KrMG67MsYpscratch 2023-07-05T20:14:37.130 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T20:14:37.470 INFO:teuthology.orchestra.run.smithi046.stdout:generic/409 [not run] require 172.21.15.46:6789:/scratch to be local device 2023-07-05T20:14:37.475 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/409 2023-07-05T20:14:37.475 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/409 2023-07-05T20:14:37.475 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-07-05T20:14:37.477 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T20:14:37.510 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-05T20:14:37.511 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.rlt8E1h3iVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/410) 2023-07-05T20:14:37.732 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph 2023-07-05T20:14:37.737 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-05T20:14:37.737 INFO:teuthology.orchestra.run.smithi046.stdout:MKFS_OPTIONS -- 172.21.15.46:6789:/scratch 2023-07-05T20:14:37.738 INFO:teuthology.orchestra.run.smithi046.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCbvKVkpp1TIhAAvJTELoeH8wkIFqjtppg17w== -o context=system_u:object_r:root_t:s0 172.21.15.46:6789:/scratch /tmp/tmp.KrMG67MsYpscratch 2023-07-05T20:14:37.738 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T20:14:38.084 INFO:teuthology.orchestra.run.smithi046.stdout:generic/410 [not run] require 172.21.15.46:6789:/scratch to be local device 2023-07-05T20:14:38.088 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/410 2023-07-05T20:14:38.088 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/410 2023-07-05T20:14:38.088 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-07-05T20:14:38.090 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T20:14:38.116 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-05T20:14:38.117 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.rlt8E1h3iVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/411) 2023-07-05T20:14:38.341 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph 2023-07-05T20:14:38.345 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-05T20:14:38.346 INFO:teuthology.orchestra.run.smithi046.stdout:MKFS_OPTIONS -- 172.21.15.46:6789:/scratch 2023-07-05T20:14:38.346 INFO:teuthology.orchestra.run.smithi046.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCbvKVkpp1TIhAAvJTELoeH8wkIFqjtppg17w== -o context=system_u:object_r:root_t:s0 172.21.15.46:6789:/scratch /tmp/tmp.KrMG67MsYpscratch 2023-07-05T20:14:38.347 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T20:14:38.697 INFO:teuthology.orchestra.run.smithi046.stdout:generic/411 [not run] require 172.21.15.46:6789:/scratch to be local device 2023-07-05T20:14:38.701 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/411 2023-07-05T20:14:38.702 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/411 2023-07-05T20:14:38.702 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-07-05T20:14:38.703 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T20:14:38.729 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-05T20:14:38.730 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.rlt8E1h3iVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/412) 2023-07-05T20:14:38.964 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph 2023-07-05T20:14:38.968 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-05T20:14:38.969 INFO:teuthology.orchestra.run.smithi046.stdout:MKFS_OPTIONS -- 172.21.15.46:6789:/scratch 2023-07-05T20:14:38.969 INFO:teuthology.orchestra.run.smithi046.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCbvKVkpp1TIhAAvJTELoeH8wkIFqjtppg17w== -o context=system_u:object_r:root_t:s0 172.21.15.46:6789:/scratch /tmp/tmp.KrMG67MsYpscratch 2023-07-05T20:14:38.970 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T20:14:39.702 INFO:teuthology.orchestra.run.smithi046.stdout:generic/412 0s 2023-07-05T20:14:39.707 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/412 2023-07-05T20:14:39.707 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-07-05T20:14:39.709 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T20:14:39.717 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-05T20:14:39.718 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.rlt8E1h3iVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/413) 2023-07-05T20:14:39.939 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph 2023-07-05T20:14:39.943 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-05T20:14:39.943 INFO:teuthology.orchestra.run.smithi046.stdout:MKFS_OPTIONS -- 172.21.15.46:6789:/scratch 2023-07-05T20:14:39.944 INFO:teuthology.orchestra.run.smithi046.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCbvKVkpp1TIhAAvJTELoeH8wkIFqjtppg17w== -o context=system_u:object_r:root_t:s0 172.21.15.46:6789:/scratch /tmp/tmp.KrMG67MsYpscratch 2023-07-05T20:14:39.944 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T20:14:40.454 INFO:teuthology.orchestra.run.smithi046.stdout:generic/413 [not run] mount 172.21.15.46:6789:/scratch with dax failed 2023-07-05T20:14:40.458 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/413 2023-07-05T20:14:40.458 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/413 2023-07-05T20:14:40.458 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-07-05T20:14:40.460 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T20:14:40.487 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-05T20:14:40.488 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.rlt8E1h3iVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/414) 2023-07-05T20:14:40.715 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph 2023-07-05T20:14:40.719 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-05T20:14:40.720 INFO:teuthology.orchestra.run.smithi046.stdout:MKFS_OPTIONS -- 172.21.15.46:6789:/scratch 2023-07-05T20:14:40.721 INFO:teuthology.orchestra.run.smithi046.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCbvKVkpp1TIhAAvJTELoeH8wkIFqjtppg17w== -o context=system_u:object_r:root_t:s0 172.21.15.46:6789:/scratch /tmp/tmp.KrMG67MsYpscratch 2023-07-05T20:14:40.721 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T20:14:41.351 INFO:teuthology.orchestra.run.smithi046.stdout:generic/414 [not run] Reflink not supported by scratch filesystem type: ceph 2023-07-05T20:14:41.589 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/414 2023-07-05T20:14:41.589 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/414 2023-07-05T20:14:41.589 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-07-05T20:14:41.592 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T20:14:41.685 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-05T20:14:41.686 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.rlt8E1h3iVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/415) 2023-07-05T20:14:41.912 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph 2023-07-05T20:14:41.916 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-05T20:14:41.916 INFO:teuthology.orchestra.run.smithi046.stdout:MKFS_OPTIONS -- 172.21.15.46:6789:/scratch 2023-07-05T20:14:41.917 INFO:teuthology.orchestra.run.smithi046.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCbvKVkpp1TIhAAvJTELoeH8wkIFqjtppg17w== -o context=system_u:object_r:root_t:s0 172.21.15.46:6789:/scratch /tmp/tmp.KrMG67MsYpscratch 2023-07-05T20:14:41.917 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T20:14:42.588 INFO:teuthology.orchestra.run.smithi046.stdout:generic/415 [not run] Reflink not supported by scratch filesystem type: ceph 2023-07-05T20:14:42.594 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/415 2023-07-05T20:14:42.594 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/415 2023-07-05T20:14:42.594 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-07-05T20:14:42.788 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T20:14:42.877 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-05T20:14:42.878 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.rlt8E1h3iVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/416) 2023-07-05T20:14:43.105 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph 2023-07-05T20:14:43.109 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-05T20:14:43.110 INFO:teuthology.orchestra.run.smithi046.stdout:MKFS_OPTIONS -- 172.21.15.46:6789:/scratch 2023-07-05T20:14:43.110 INFO:teuthology.orchestra.run.smithi046.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCbvKVkpp1TIhAAvJTELoeH8wkIFqjtppg17w== -o context=system_u:object_r:root_t:s0 172.21.15.46:6789:/scratch /tmp/tmp.KrMG67MsYpscratch 2023-07-05T20:14:43.111 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T20:14:43.452 INFO:teuthology.orchestra.run.smithi046.stdout:generic/416 [not run] Filesystem ceph not supported in _scratch_mkfs_sized 2023-07-05T20:14:43.456 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/416 2023-07-05T20:14:43.456 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/416 2023-07-05T20:14:43.456 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-07-05T20:14:43.458 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T20:14:43.489 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-05T20:14:43.490 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.rlt8E1h3iVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/417) 2023-07-05T20:14:43.727 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph 2023-07-05T20:14:43.732 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-05T20:14:43.732 INFO:teuthology.orchestra.run.smithi046.stdout:MKFS_OPTIONS -- 172.21.15.46:6789:/scratch 2023-07-05T20:14:43.733 INFO:teuthology.orchestra.run.smithi046.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCbvKVkpp1TIhAAvJTELoeH8wkIFqjtppg17w== -o context=system_u:object_r:root_t:s0 172.21.15.46:6789:/scratch /tmp/tmp.KrMG67MsYpscratch 2023-07-05T20:14:43.733 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T20:14:44.263 INFO:teuthology.orchestra.run.smithi046.stdout:generic/417 [not run] ceph does not support shutdown 2023-07-05T20:14:44.287 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/417 2023-07-05T20:14:44.288 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/417 2023-07-05T20:14:44.288 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-07-05T20:14:44.289 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T20:14:44.312 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-05T20:14:44.313 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.rlt8E1h3iVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/418) 2023-07-05T20:14:44.551 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph 2023-07-05T20:14:44.555 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-05T20:14:44.556 INFO:teuthology.orchestra.run.smithi046.stdout:MKFS_OPTIONS -- 172.21.15.46:6789:/scratch 2023-07-05T20:14:44.557 INFO:teuthology.orchestra.run.smithi046.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCbvKVkpp1TIhAAvJTELoeH8wkIFqjtppg17w== -o context=system_u:object_r:root_t:s0 172.21.15.46:6789:/scratch /tmp/tmp.KrMG67MsYpscratch 2023-07-05T20:14:44.557 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T20:14:44.958 INFO:teuthology.orchestra.run.smithi046.stdout:generic/418 [not run] require 172.21.15.46:6789:/test to be valid block disk 2023-07-05T20:14:44.962 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/418 2023-07-05T20:14:44.962 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/418 2023-07-05T20:14:44.963 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-07-05T20:14:44.964 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T20:14:45.004 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-05T20:14:45.004 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.rlt8E1h3iVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/419) 2023-07-05T20:14:45.226 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph 2023-07-05T20:14:45.230 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-05T20:14:45.231 INFO:teuthology.orchestra.run.smithi046.stdout:MKFS_OPTIONS -- 172.21.15.46:6789:/scratch 2023-07-05T20:14:45.231 INFO:teuthology.orchestra.run.smithi046.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCbvKVkpp1TIhAAvJTELoeH8wkIFqjtppg17w== -o context=system_u:object_r:root_t:s0 172.21.15.46:6789:/scratch /tmp/tmp.KrMG67MsYpscratch 2023-07-05T20:14:45.232 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T20:14:45.782 INFO:teuthology.orchestra.run.smithi046.stdout:generic/419 [not run] kernel does not support ceph encryption 2023-07-05T20:14:45.799 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/419 2023-07-05T20:14:45.799 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/419 2023-07-05T20:14:45.800 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-07-05T20:14:45.801 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T20:14:45.828 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-05T20:14:45.829 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.rlt8E1h3iVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/420) 2023-07-05T20:14:46.051 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph 2023-07-05T20:14:46.055 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-05T20:14:46.055 INFO:teuthology.orchestra.run.smithi046.stdout:MKFS_OPTIONS -- 172.21.15.46:6789:/scratch 2023-07-05T20:14:46.056 INFO:teuthology.orchestra.run.smithi046.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCbvKVkpp1TIhAAvJTELoeH8wkIFqjtppg17w== -o context=system_u:object_r:root_t:s0 172.21.15.46:6789:/scratch /tmp/tmp.KrMG67MsYpscratch 2023-07-05T20:14:46.056 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T20:14:46.533 INFO:teuthology.orchestra.run.smithi046.stdout:generic/420 0s 2023-07-05T20:14:46.538 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/420 2023-07-05T20:14:46.538 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-07-05T20:14:46.540 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T20:14:46.879 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-05T20:14:46.880 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.rlt8E1h3iVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/421) 2023-07-05T20:14:47.165 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph 2023-07-05T20:14:47.169 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-05T20:14:47.169 INFO:teuthology.orchestra.run.smithi046.stdout:MKFS_OPTIONS -- 172.21.15.46:6789:/scratch 2023-07-05T20:14:47.170 INFO:teuthology.orchestra.run.smithi046.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCbvKVkpp1TIhAAvJTELoeH8wkIFqjtppg17w== -o context=system_u:object_r:root_t:s0 172.21.15.46:6789:/scratch /tmp/tmp.KrMG67MsYpscratch 2023-07-05T20:14:47.170 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T20:14:47.770 INFO:teuthology.orchestra.run.smithi046.stdout:generic/421 [not run] kernel does not support ceph encryption 2023-07-05T20:14:47.792 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/421 2023-07-05T20:14:47.792 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/421 2023-07-05T20:14:47.792 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-07-05T20:14:47.794 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T20:14:47.817 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-05T20:14:47.817 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.rlt8E1h3iVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/422) 2023-07-05T20:14:48.056 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph 2023-07-05T20:14:48.060 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-05T20:14:48.061 INFO:teuthology.orchestra.run.smithi046.stdout:MKFS_OPTIONS -- 172.21.15.46:6789:/scratch 2023-07-05T20:14:48.062 INFO:teuthology.orchestra.run.smithi046.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCbvKVkpp1TIhAAvJTELoeH8wkIFqjtppg17w== -o context=system_u:object_r:root_t:s0 172.21.15.46:6789:/scratch /tmp/tmp.KrMG67MsYpscratch 2023-07-05T20:14:48.062 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T20:14:48.428 INFO:teuthology.orchestra.run.smithi046.stdout:generic/422 [not run] xfs_io falloc -k failed (old kernel/wrong fs?) 2023-07-05T20:14:48.432 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/422 2023-07-05T20:14:48.433 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/422 2023-07-05T20:14:48.433 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-07-05T20:14:48.435 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T20:14:48.473 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-05T20:14:48.474 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.rlt8E1h3iVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/423) 2023-07-05T20:14:48.701 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph 2023-07-05T20:14:48.706 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-05T20:14:48.706 INFO:teuthology.orchestra.run.smithi046.stdout:MKFS_OPTIONS -- 172.21.15.46:6789:/scratch 2023-07-05T20:14:48.707 INFO:teuthology.orchestra.run.smithi046.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCbvKVkpp1TIhAAvJTELoeH8wkIFqjtppg17w== -o context=system_u:object_r:root_t:s0 172.21.15.46:6789:/scratch /tmp/tmp.KrMG67MsYpscratch 2023-07-05T20:14:48.707 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T20:14:49.153 INFO:teuthology.orchestra.run.smithi046.stdout:generic/423 1s 2023-07-05T20:14:49.158 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/423 2023-07-05T20:14:49.159 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-07-05T20:14:49.160 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T20:14:49.343 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-05T20:14:49.344 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.rlt8E1h3iVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/424) 2023-07-05T20:14:49.781 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph 2023-07-05T20:14:49.785 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-05T20:14:49.786 INFO:teuthology.orchestra.run.smithi046.stdout:MKFS_OPTIONS -- 172.21.15.46:6789:/scratch 2023-07-05T20:14:49.787 INFO:teuthology.orchestra.run.smithi046.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCbvKVkpp1TIhAAvJTELoeH8wkIFqjtppg17w== -o context=system_u:object_r:root_t:s0 172.21.15.46:6789:/scratch /tmp/tmp.KrMG67MsYpscratch 2023-07-05T20:14:49.787 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T20:14:50.146 INFO:teuthology.orchestra.run.smithi046.stdout:generic/424 [not run] file system doesn't support any of /bin/chattr +a/+c/+d/+i 2023-07-05T20:14:50.150 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/424 2023-07-05T20:14:50.150 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/424 2023-07-05T20:14:50.150 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-07-05T20:14:50.152 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T20:14:50.181 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-05T20:14:50.181 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.rlt8E1h3iVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/425) 2023-07-05T20:14:50.403 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph 2023-07-05T20:14:50.408 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-05T20:14:50.408 INFO:teuthology.orchestra.run.smithi046.stdout:MKFS_OPTIONS -- 172.21.15.46:6789:/scratch 2023-07-05T20:14:50.409 INFO:teuthology.orchestra.run.smithi046.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCbvKVkpp1TIhAAvJTELoeH8wkIFqjtppg17w== -o context=system_u:object_r:root_t:s0 172.21.15.46:6789:/scratch /tmp/tmp.KrMG67MsYpscratch 2023-07-05T20:14:50.409 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T20:14:50.794 INFO:teuthology.orchestra.run.smithi046.stdout:generic/425 [not run] xfs_io fiemap -a failed (old kernel/wrong fs?) 2023-07-05T20:14:50.798 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/425 2023-07-05T20:14:50.798 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/425 2023-07-05T20:14:50.798 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-07-05T20:14:50.800 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T20:14:50.990 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-05T20:14:50.991 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.rlt8E1h3iVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/426) 2023-07-05T20:14:51.405 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph 2023-07-05T20:14:51.409 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-05T20:14:51.409 INFO:teuthology.orchestra.run.smithi046.stdout:MKFS_OPTIONS -- 172.21.15.46:6789:/scratch 2023-07-05T20:14:51.410 INFO:teuthology.orchestra.run.smithi046.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCbvKVkpp1TIhAAvJTELoeH8wkIFqjtppg17w== -o context=system_u:object_r:root_t:s0 172.21.15.46:6789:/scratch /tmp/tmp.KrMG67MsYpscratch 2023-07-05T20:14:51.410 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T20:15:03.226 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-05T20:15:03.229 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-05T20:15:33.307 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-05T20:15:33.309 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-05T20:15:34.866 INFO:teuthology.orchestra.run.smithi046.stdout:generic/426 43s 2023-07-05T20:15:34.935 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/426 2023-07-05T20:15:34.936 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-07-05T20:15:34.938 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T20:15:35.299 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-05T20:15:35.300 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.rlt8E1h3iVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/427) 2023-07-05T20:15:36.263 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph 2023-07-05T20:15:36.267 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-05T20:15:36.268 INFO:teuthology.orchestra.run.smithi046.stdout:MKFS_OPTIONS -- 172.21.15.46:6789:/scratch 2023-07-05T20:15:36.269 INFO:teuthology.orchestra.run.smithi046.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCbvKVkpp1TIhAAvJTELoeH8wkIFqjtppg17w== -o context=system_u:object_r:root_t:s0 172.21.15.46:6789:/scratch /tmp/tmp.KrMG67MsYpscratch 2023-07-05T20:15:36.269 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T20:15:36.770 INFO:teuthology.orchestra.run.smithi046.stdout:generic/427 [not run] Filesystem ceph not supported in _scratch_mkfs_sized 2023-07-05T20:15:36.774 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/427 2023-07-05T20:15:36.774 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/427 2023-07-05T20:15:36.774 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-07-05T20:15:36.776 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T20:15:36.806 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-05T20:15:36.806 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.rlt8E1h3iVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/428) 2023-07-05T20:15:37.042 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph 2023-07-05T20:15:37.046 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-05T20:15:37.046 INFO:teuthology.orchestra.run.smithi046.stdout:MKFS_OPTIONS -- 172.21.15.46:6789:/scratch 2023-07-05T20:15:37.047 INFO:teuthology.orchestra.run.smithi046.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCbvKVkpp1TIhAAvJTELoeH8wkIFqjtppg17w== -o context=system_u:object_r:root_t:s0 172.21.15.46:6789:/scratch /tmp/tmp.KrMG67MsYpscratch 2023-07-05T20:15:37.047 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T20:15:37.413 INFO:teuthology.orchestra.run.smithi046.stdout:generic/428 0s 2023-07-05T20:15:37.418 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/428 2023-07-05T20:15:37.418 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-07-05T20:15:37.420 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T20:15:37.447 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-05T20:15:37.448 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.rlt8E1h3iVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/429) 2023-07-05T20:15:37.670 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph 2023-07-05T20:15:37.674 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-05T20:15:37.675 INFO:teuthology.orchestra.run.smithi046.stdout:MKFS_OPTIONS -- 172.21.15.46:6789:/scratch 2023-07-05T20:15:37.676 INFO:teuthology.orchestra.run.smithi046.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCbvKVkpp1TIhAAvJTELoeH8wkIFqjtppg17w== -o context=system_u:object_r:root_t:s0 172.21.15.46:6789:/scratch /tmp/tmp.KrMG67MsYpscratch 2023-07-05T20:15:37.676 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T20:15:38.252 INFO:teuthology.orchestra.run.smithi046.stdout:generic/429 [not run] kernel does not support ceph encryption 2023-07-05T20:15:38.273 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/429 2023-07-05T20:15:38.273 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/429 2023-07-05T20:15:38.273 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-07-05T20:15:38.275 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T20:15:38.295 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-05T20:15:38.295 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.rlt8E1h3iVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/430) 2023-07-05T20:15:38.538 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph 2023-07-05T20:15:38.543 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-05T20:15:38.543 INFO:teuthology.orchestra.run.smithi046.stdout:MKFS_OPTIONS -- 172.21.15.46:6789:/scratch 2023-07-05T20:15:38.544 INFO:teuthology.orchestra.run.smithi046.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCbvKVkpp1TIhAAvJTELoeH8wkIFqjtppg17w== -o context=system_u:object_r:root_t:s0 172.21.15.46:6789:/scratch /tmp/tmp.KrMG67MsYpscratch 2023-07-05T20:15:38.544 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T20:15:39.003 INFO:teuthology.orchestra.run.smithi046.stdout:generic/430 0s 2023-07-05T20:15:39.008 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/430 2023-07-05T20:15:39.008 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-07-05T20:15:39.010 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T20:15:39.356 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-05T20:15:39.357 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.rlt8E1h3iVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/431) 2023-07-05T20:15:39.640 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph 2023-07-05T20:15:39.644 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-05T20:15:39.645 INFO:teuthology.orchestra.run.smithi046.stdout:MKFS_OPTIONS -- 172.21.15.46:6789:/scratch 2023-07-05T20:15:39.645 INFO:teuthology.orchestra.run.smithi046.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCbvKVkpp1TIhAAvJTELoeH8wkIFqjtppg17w== -o context=system_u:object_r:root_t:s0 172.21.15.46:6789:/scratch /tmp/tmp.KrMG67MsYpscratch 2023-07-05T20:15:39.646 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T20:15:40.073 INFO:teuthology.orchestra.run.smithi046.stdout:generic/431 1s 2023-07-05T20:15:40.079 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/431 2023-07-05T20:15:40.079 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-07-05T20:15:40.081 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T20:15:40.421 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-05T20:15:40.421 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.rlt8E1h3iVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/432) 2023-07-05T20:15:40.694 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph 2023-07-05T20:15:40.698 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-05T20:15:40.699 INFO:teuthology.orchestra.run.smithi046.stdout:MKFS_OPTIONS -- 172.21.15.46:6789:/scratch 2023-07-05T20:15:40.699 INFO:teuthology.orchestra.run.smithi046.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCbvKVkpp1TIhAAvJTELoeH8wkIFqjtppg17w== -o context=system_u:object_r:root_t:s0 172.21.15.46:6789:/scratch /tmp/tmp.KrMG67MsYpscratch 2023-07-05T20:15:40.700 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T20:15:41.141 INFO:teuthology.orchestra.run.smithi046.stdout:generic/432 1s 2023-07-05T20:15:41.146 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/432 2023-07-05T20:15:41.147 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-07-05T20:15:41.148 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T20:15:41.471 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-05T20:15:41.471 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.rlt8E1h3iVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/433) 2023-07-05T20:15:41.754 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph 2023-07-05T20:15:41.758 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-05T20:15:41.759 INFO:teuthology.orchestra.run.smithi046.stdout:MKFS_OPTIONS -- 172.21.15.46:6789:/scratch 2023-07-05T20:15:41.759 INFO:teuthology.orchestra.run.smithi046.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCbvKVkpp1TIhAAvJTELoeH8wkIFqjtppg17w== -o context=system_u:object_r:root_t:s0 172.21.15.46:6789:/scratch /tmp/tmp.KrMG67MsYpscratch 2023-07-05T20:15:41.760 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T20:15:42.179 INFO:teuthology.orchestra.run.smithi046.stdout:generic/433 1s 2023-07-05T20:15:42.184 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/433 2023-07-05T20:15:42.184 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-07-05T20:15:42.186 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T20:15:42.521 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-05T20:15:42.521 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.rlt8E1h3iVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/434) 2023-07-05T20:15:42.792 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph 2023-07-05T20:15:42.796 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-05T20:15:42.797 INFO:teuthology.orchestra.run.smithi046.stdout:MKFS_OPTIONS -- 172.21.15.46:6789:/scratch 2023-07-05T20:15:42.797 INFO:teuthology.orchestra.run.smithi046.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCbvKVkpp1TIhAAvJTELoeH8wkIFqjtppg17w== -o context=system_u:object_r:root_t:s0 172.21.15.46:6789:/scratch /tmp/tmp.KrMG67MsYpscratch 2023-07-05T20:15:42.798 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T20:15:43.237 INFO:teuthology.orchestra.run.smithi046.stdout:generic/434 0s 2023-07-05T20:15:43.242 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/434 2023-07-05T20:15:43.243 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-07-05T20:15:43.244 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T20:15:43.599 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-05T20:15:43.599 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.rlt8E1h3iVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/435) 2023-07-05T20:15:43.900 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph 2023-07-05T20:15:43.904 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-05T20:15:43.904 INFO:teuthology.orchestra.run.smithi046.stdout:MKFS_OPTIONS -- 172.21.15.46:6789:/scratch 2023-07-05T20:15:43.905 INFO:teuthology.orchestra.run.smithi046.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCbvKVkpp1TIhAAvJTELoeH8wkIFqjtppg17w== -o context=system_u:object_r:root_t:s0 172.21.15.46:6789:/scratch /tmp/tmp.KrMG67MsYpscratch 2023-07-05T20:15:43.905 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T20:15:44.462 INFO:teuthology.orchestra.run.smithi046.stdout:generic/435 [not run] kernel does not support ceph encryption 2023-07-05T20:15:44.484 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/435 2023-07-05T20:15:44.484 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/435 2023-07-05T20:15:44.485 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-07-05T20:15:44.486 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T20:15:44.509 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-05T20:15:44.509 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.rlt8E1h3iVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/436) 2023-07-05T20:15:44.735 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph 2023-07-05T20:15:44.739 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-05T20:15:44.739 INFO:teuthology.orchestra.run.smithi046.stdout:MKFS_OPTIONS -- 172.21.15.46:6789:/scratch 2023-07-05T20:15:44.740 INFO:teuthology.orchestra.run.smithi046.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCbvKVkpp1TIhAAvJTELoeH8wkIFqjtppg17w== -o context=system_u:object_r:root_t:s0 172.21.15.46:6789:/scratch /tmp/tmp.KrMG67MsYpscratch 2023-07-05T20:15:44.740 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T20:15:45.392 INFO:teuthology.orchestra.run.smithi046.stdout:generic/436 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-07-05T20:15:45.396 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/436 2023-07-05T20:15:45.397 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/436 2023-07-05T20:15:45.397 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-07-05T20:15:45.398 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T20:15:45.738 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-05T20:15:45.738 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.rlt8E1h3iVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/437) 2023-07-05T20:15:46.003 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph 2023-07-05T20:15:46.007 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-05T20:15:46.008 INFO:teuthology.orchestra.run.smithi046.stdout:MKFS_OPTIONS -- 172.21.15.46:6789:/scratch 2023-07-05T20:15:46.008 INFO:teuthology.orchestra.run.smithi046.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCbvKVkpp1TIhAAvJTELoeH8wkIFqjtppg17w== -o context=system_u:object_r:root_t:s0 172.21.15.46:6789:/scratch /tmp/tmp.KrMG67MsYpscratch 2023-07-05T20:15:46.009 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T20:15:47.005 INFO:teuthology.orchestra.run.smithi046.stdout:generic/437 1s 2023-07-05T20:15:47.011 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/437 2023-07-05T20:15:47.011 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-07-05T20:15:47.012 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T20:15:47.047 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-05T20:15:47.047 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.rlt8E1h3iVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/438) 2023-07-05T20:15:47.270 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph 2023-07-05T20:15:47.274 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-05T20:15:47.274 INFO:teuthology.orchestra.run.smithi046.stdout:MKFS_OPTIONS -- 172.21.15.46:6789:/scratch 2023-07-05T20:15:47.275 INFO:teuthology.orchestra.run.smithi046.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCbvKVkpp1TIhAAvJTELoeH8wkIFqjtppg17w== -o context=system_u:object_r:root_t:s0 172.21.15.46:6789:/scratch /tmp/tmp.KrMG67MsYpscratch 2023-07-05T20:15:47.275 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T20:16:04.274 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-05T20:16:04.276 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-05T20:16:34.379 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-05T20:16:34.383 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-05T20:16:53.112 INFO:teuthology.orchestra.run.smithi046.stdout:generic/438 66s 2023-07-05T20:16:53.117 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/438 2023-07-05T20:16:53.118 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-07-05T20:16:53.119 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T20:16:53.159 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-05T20:16:53.160 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.rlt8E1h3iVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/439) 2023-07-05T20:16:53.382 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph 2023-07-05T20:16:53.386 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-05T20:16:53.386 INFO:teuthology.orchestra.run.smithi046.stdout:MKFS_OPTIONS -- 172.21.15.46:6789:/scratch 2023-07-05T20:16:53.387 INFO:teuthology.orchestra.run.smithi046.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCbvKVkpp1TIhAAvJTELoeH8wkIFqjtppg17w== -o context=system_u:object_r:root_t:s0 172.21.15.46:6789:/scratch /tmp/tmp.KrMG67MsYpscratch 2023-07-05T20:16:53.388 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T20:16:54.558 INFO:teuthology.orchestra.run.smithi046.stdout:generic/439 1s 2023-07-05T20:16:54.563 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/439 2023-07-05T20:16:54.564 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-07-05T20:16:54.565 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T20:16:54.603 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-05T20:16:54.604 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.rlt8E1h3iVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/440) 2023-07-05T20:16:54.844 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph 2023-07-05T20:16:54.848 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-05T20:16:54.849 INFO:teuthology.orchestra.run.smithi046.stdout:MKFS_OPTIONS -- 172.21.15.46:6789:/scratch 2023-07-05T20:16:54.850 INFO:teuthology.orchestra.run.smithi046.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCbvKVkpp1TIhAAvJTELoeH8wkIFqjtppg17w== -o context=system_u:object_r:root_t:s0 172.21.15.46:6789:/scratch /tmp/tmp.KrMG67MsYpscratch 2023-07-05T20:16:54.850 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T20:16:55.439 INFO:teuthology.orchestra.run.smithi046.stdout:generic/440 [not run] kernel does not support ceph encryption 2023-07-05T20:16:55.462 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/440 2023-07-05T20:16:55.463 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/440 2023-07-05T20:16:55.463 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-07-05T20:16:55.464 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T20:16:55.485 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-05T20:16:55.486 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.rlt8E1h3iVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/441) 2023-07-05T20:16:55.705 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph 2023-07-05T20:16:55.709 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-05T20:16:55.709 INFO:teuthology.orchestra.run.smithi046.stdout:MKFS_OPTIONS -- 172.21.15.46:6789:/scratch 2023-07-05T20:16:55.710 INFO:teuthology.orchestra.run.smithi046.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCbvKVkpp1TIhAAvJTELoeH8wkIFqjtppg17w== -o context=system_u:object_r:root_t:s0 172.21.15.46:6789:/scratch /tmp/tmp.KrMG67MsYpscratch 2023-07-05T20:16:55.710 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T20:16:56.159 INFO:teuthology.orchestra.run.smithi046.stdout:generic/441 [not run] require 172.21.15.46:6789:/scratch to be valid block disk 2023-07-05T20:16:56.163 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/441 2023-07-05T20:16:56.163 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/441 2023-07-05T20:16:56.163 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-07-05T20:16:56.165 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T20:16:56.189 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-05T20:16:56.190 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.rlt8E1h3iVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/442) 2023-07-05T20:16:56.415 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph 2023-07-05T20:16:56.419 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-05T20:16:56.419 INFO:teuthology.orchestra.run.smithi046.stdout:MKFS_OPTIONS -- 172.21.15.46:6789:/scratch 2023-07-05T20:16:56.420 INFO:teuthology.orchestra.run.smithi046.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCbvKVkpp1TIhAAvJTELoeH8wkIFqjtppg17w== -o context=system_u:object_r:root_t:s0 172.21.15.46:6789:/scratch /tmp/tmp.KrMG67MsYpscratch 2023-07-05T20:16:56.420 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T20:16:56.779 INFO:teuthology.orchestra.run.smithi046.stdout:generic/442 [not run] require 172.21.15.46:6789:/scratch to be valid block disk 2023-07-05T20:16:56.784 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/442 2023-07-05T20:16:56.784 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/442 2023-07-05T20:16:56.784 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-07-05T20:16:56.786 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T20:16:56.823 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-05T20:16:56.823 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.rlt8E1h3iVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/443) 2023-07-05T20:16:57.067 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph 2023-07-05T20:16:57.072 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-05T20:16:57.073 INFO:teuthology.orchestra.run.smithi046.stdout:MKFS_OPTIONS -- 172.21.15.46:6789:/scratch 2023-07-05T20:16:57.073 INFO:teuthology.orchestra.run.smithi046.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCbvKVkpp1TIhAAvJTELoeH8wkIFqjtppg17w== -o context=system_u:object_r:root_t:s0 172.21.15.46:6789:/scratch /tmp/tmp.KrMG67MsYpscratch 2023-07-05T20:16:57.073 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T20:16:57.454 INFO:teuthology.orchestra.run.smithi046.stdout:generic/443 0s 2023-07-05T20:16:57.459 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/443 2023-07-05T20:16:57.459 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-07-05T20:16:57.461 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T20:16:57.491 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-05T20:16:57.491 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.rlt8E1h3iVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/444) 2023-07-05T20:16:57.713 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph 2023-07-05T20:16:57.717 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-05T20:16:57.718 INFO:teuthology.orchestra.run.smithi046.stdout:MKFS_OPTIONS -- 172.21.15.46:6789:/scratch 2023-07-05T20:16:57.718 INFO:teuthology.orchestra.run.smithi046.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCbvKVkpp1TIhAAvJTELoeH8wkIFqjtppg17w== -o context=system_u:object_r:root_t:s0 172.21.15.46:6789:/scratch /tmp/tmp.KrMG67MsYpscratch 2023-07-05T20:16:57.719 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T20:16:58.183 INFO:teuthology.orchestra.run.smithi046.stdout:generic/444 1s 2023-07-05T20:16:58.188 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/444 2023-07-05T20:16:58.188 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-07-05T20:16:58.190 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T20:16:58.233 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-05T20:16:58.233 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.rlt8E1h3iVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/445) 2023-07-05T20:16:58.459 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph 2023-07-05T20:16:58.463 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-05T20:16:58.464 INFO:teuthology.orchestra.run.smithi046.stdout:MKFS_OPTIONS -- 172.21.15.46:6789:/scratch 2023-07-05T20:16:58.465 INFO:teuthology.orchestra.run.smithi046.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCbvKVkpp1TIhAAvJTELoeH8wkIFqjtppg17w== -o context=system_u:object_r:root_t:s0 172.21.15.46:6789:/scratch /tmp/tmp.KrMG67MsYpscratch 2023-07-05T20:16:58.465 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T20:16:59.165 INFO:teuthology.orchestra.run.smithi046.stdout:generic/445 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-07-05T20:16:59.169 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/445 2023-07-05T20:16:59.169 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/445 2023-07-05T20:16:59.169 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-07-05T20:16:59.171 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T20:16:59.478 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-05T20:16:59.478 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.rlt8E1h3iVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/446) 2023-07-05T20:16:59.776 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph 2023-07-05T20:16:59.780 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-05T20:16:59.781 INFO:teuthology.orchestra.run.smithi046.stdout:MKFS_OPTIONS -- 172.21.15.46:6789:/scratch 2023-07-05T20:16:59.782 INFO:teuthology.orchestra.run.smithi046.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCbvKVkpp1TIhAAvJTELoeH8wkIFqjtppg17w== -o context=system_u:object_r:root_t:s0 172.21.15.46:6789:/scratch /tmp/tmp.KrMG67MsYpscratch 2023-07-05T20:16:59.783 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T20:17:04.736 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-05T20:17:04.739 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-05T20:17:22.381 INFO:teuthology.orchestra.run.smithi046.stdout:generic/446 23s 2023-07-05T20:17:22.428 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/446 2023-07-05T20:17:22.429 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-07-05T20:17:22.435 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T20:17:22.453 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-05T20:17:22.454 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.rlt8E1h3iVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/447) 2023-07-05T20:17:22.692 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph 2023-07-05T20:17:22.694 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-05T20:17:22.694 INFO:teuthology.orchestra.run.smithi046.stdout:MKFS_OPTIONS -- 172.21.15.46:6789:/scratch 2023-07-05T20:17:22.695 INFO:teuthology.orchestra.run.smithi046.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCbvKVkpp1TIhAAvJTELoeH8wkIFqjtppg17w== -o context=system_u:object_r:root_t:s0 172.21.15.46:6789:/scratch /tmp/tmp.KrMG67MsYpscratch 2023-07-05T20:17:22.695 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T20:17:23.591 INFO:teuthology.orchestra.run.smithi046.stdout:generic/447 [not run] Reflink not supported by scratch filesystem type: ceph 2023-07-05T20:17:23.607 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/447 2023-07-05T20:17:23.608 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/447 2023-07-05T20:17:23.608 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-07-05T20:17:23.611 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T20:17:23.651 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-05T20:17:23.652 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.rlt8E1h3iVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/448) 2023-07-05T20:17:23.877 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph 2023-07-05T20:17:23.881 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-05T20:17:23.882 INFO:teuthology.orchestra.run.smithi046.stdout:MKFS_OPTIONS -- 172.21.15.46:6789:/scratch 2023-07-05T20:17:23.883 INFO:teuthology.orchestra.run.smithi046.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCbvKVkpp1TIhAAvJTELoeH8wkIFqjtppg17w== -o context=system_u:object_r:root_t:s0 172.21.15.46:6789:/scratch /tmp/tmp.KrMG67MsYpscratch 2023-07-05T20:17:23.883 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T20:17:25.024 INFO:teuthology.orchestra.run.smithi046.stdout:generic/448 1s 2023-07-05T20:17:25.029 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/448 2023-07-05T20:17:25.030 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-07-05T20:17:25.031 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T20:17:25.363 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-05T20:17:25.363 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.rlt8E1h3iVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/449) 2023-07-05T20:17:25.637 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph 2023-07-05T20:17:25.642 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-05T20:17:25.642 INFO:teuthology.orchestra.run.smithi046.stdout:MKFS_OPTIONS -- 172.21.15.46:6789:/scratch 2023-07-05T20:17:25.643 INFO:teuthology.orchestra.run.smithi046.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCbvKVkpp1TIhAAvJTELoeH8wkIFqjtppg17w== -o context=system_u:object_r:root_t:s0 172.21.15.46:6789:/scratch /tmp/tmp.KrMG67MsYpscratch 2023-07-05T20:17:25.643 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T20:17:26.035 INFO:teuthology.orchestra.run.smithi046.stdout:generic/449 [not run] Filesystem ceph not supported in _scratch_mkfs_sized 2023-07-05T20:17:26.039 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/449 2023-07-05T20:17:26.040 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/449 2023-07-05T20:17:26.040 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-07-05T20:17:26.041 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T20:17:26.313 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-05T20:17:26.313 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.rlt8E1h3iVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/450) 2023-07-05T20:17:26.658 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph 2023-07-05T20:17:26.663 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-05T20:17:26.663 INFO:teuthology.orchestra.run.smithi046.stdout:MKFS_OPTIONS -- 172.21.15.46:6789:/scratch 2023-07-05T20:17:26.664 INFO:teuthology.orchestra.run.smithi046.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCbvKVkpp1TIhAAvJTELoeH8wkIFqjtppg17w== -o context=system_u:object_r:root_t:s0 172.21.15.46:6789:/scratch /tmp/tmp.KrMG67MsYpscratch 2023-07-05T20:17:26.665 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T20:17:27.415 INFO:teuthology.orchestra.run.smithi046.stdout:generic/450 1s 2023-07-05T20:17:27.420 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/450 2023-07-05T20:17:27.420 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-07-05T20:17:27.422 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T20:17:27.796 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-05T20:17:27.797 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.rlt8E1h3iVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/451) 2023-07-05T20:17:28.038 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph 2023-07-05T20:17:28.042 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-05T20:17:28.043 INFO:teuthology.orchestra.run.smithi046.stdout:MKFS_OPTIONS -- 172.21.15.46:6789:/scratch 2023-07-05T20:17:28.044 INFO:teuthology.orchestra.run.smithi046.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCbvKVkpp1TIhAAvJTELoeH8wkIFqjtppg17w== -o context=system_u:object_r:root_t:s0 172.21.15.46:6789:/scratch /tmp/tmp.KrMG67MsYpscratch 2023-07-05T20:17:28.044 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T20:17:34.794 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-05T20:17:34.797 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-05T20:17:58.538 INFO:teuthology.orchestra.run.smithi046.stdout:generic/451 30s 2023-07-05T20:17:58.543 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/451 2023-07-05T20:17:58.544 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-07-05T20:17:58.545 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T20:17:58.881 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-05T20:17:58.881 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.rlt8E1h3iVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/452) 2023-07-05T20:17:59.156 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph 2023-07-05T20:17:59.160 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-05T20:17:59.161 INFO:teuthology.orchestra.run.smithi046.stdout:MKFS_OPTIONS -- 172.21.15.46:6789:/scratch 2023-07-05T20:17:59.162 INFO:teuthology.orchestra.run.smithi046.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCbvKVkpp1TIhAAvJTELoeH8wkIFqjtppg17w== -o context=system_u:object_r:root_t:s0 172.21.15.46:6789:/scratch /tmp/tmp.KrMG67MsYpscratch 2023-07-05T20:17:59.162 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T20:17:59.807 INFO:teuthology.orchestra.run.smithi046.stdout:generic/452 0s 2023-07-05T20:17:59.812 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/452 2023-07-05T20:17:59.813 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-07-05T20:17:59.814 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T20:17:59.823 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-05T20:17:59.823 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.rlt8E1h3iVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/453) 2023-07-05T20:18:00.048 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph 2023-07-05T20:18:00.052 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-05T20:18:00.053 INFO:teuthology.orchestra.run.smithi046.stdout:MKFS_OPTIONS -- 172.21.15.46:6789:/scratch 2023-07-05T20:18:00.053 INFO:teuthology.orchestra.run.smithi046.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCbvKVkpp1TIhAAvJTELoeH8wkIFqjtppg17w== -o context=system_u:object_r:root_t:s0 172.21.15.46:6789:/scratch /tmp/tmp.KrMG67MsYpscratch 2023-07-05T20:18:00.053 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T20:18:00.414 INFO:teuthology.orchestra.run.smithi046.stdout:generic/453 [not run] ceph does not allow unrestricted byte streams for names 2023-07-05T20:18:00.418 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/453 2023-07-05T20:18:00.418 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/453 2023-07-05T20:18:00.418 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-07-05T20:18:00.421 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T20:18:00.442 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-05T20:18:00.443 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.rlt8E1h3iVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/454) 2023-07-05T20:18:00.672 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph 2023-07-05T20:18:00.676 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-05T20:18:00.676 INFO:teuthology.orchestra.run.smithi046.stdout:MKFS_OPTIONS -- 172.21.15.46:6789:/scratch 2023-07-05T20:18:00.678 INFO:teuthology.orchestra.run.smithi046.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCbvKVkpp1TIhAAvJTELoeH8wkIFqjtppg17w== -o context=system_u:object_r:root_t:s0 172.21.15.46:6789:/scratch /tmp/tmp.KrMG67MsYpscratch 2023-07-05T20:18:00.678 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T20:18:01.037 INFO:teuthology.orchestra.run.smithi046.stdout:generic/454 [not run] ceph does not allow unrestricted byte streams for names 2023-07-05T20:18:01.041 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/454 2023-07-05T20:18:01.042 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/454 2023-07-05T20:18:01.042 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-07-05T20:18:01.043 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T20:18:01.082 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-05T20:18:01.083 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.rlt8E1h3iVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/455) 2023-07-05T20:18:01.309 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph 2023-07-05T20:18:01.313 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-05T20:18:01.314 INFO:teuthology.orchestra.run.smithi046.stdout:MKFS_OPTIONS -- 172.21.15.46:6789:/scratch 2023-07-05T20:18:01.315 INFO:teuthology.orchestra.run.smithi046.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCbvKVkpp1TIhAAvJTELoeH8wkIFqjtppg17w== -o context=system_u:object_r:root_t:s0 172.21.15.46:6789:/scratch /tmp/tmp.KrMG67MsYpscratch 2023-07-05T20:18:01.315 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T20:18:01.741 INFO:teuthology.orchestra.run.smithi046.stdout:generic/455 [not run] This test requires a valid $LOGWRITES_DEV 2023-07-05T20:18:01.745 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/455 2023-07-05T20:18:01.745 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/455 2023-07-05T20:18:01.745 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-07-05T20:18:01.747 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T20:18:01.777 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-05T20:18:01.777 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.rlt8E1h3iVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/456) 2023-07-05T20:18:02.006 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph 2023-07-05T20:18:02.011 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-05T20:18:02.011 INFO:teuthology.orchestra.run.smithi046.stdout:MKFS_OPTIONS -- 172.21.15.46:6789:/scratch 2023-07-05T20:18:02.012 INFO:teuthology.orchestra.run.smithi046.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCbvKVkpp1TIhAAvJTELoeH8wkIFqjtppg17w== -o context=system_u:object_r:root_t:s0 172.21.15.46:6789:/scratch /tmp/tmp.KrMG67MsYpscratch 2023-07-05T20:18:02.012 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T20:18:02.388 INFO:teuthology.orchestra.run.smithi046.stdout:generic/456 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-07-05T20:18:02.392 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/456 2023-07-05T20:18:02.393 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/456 2023-07-05T20:18:02.393 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-07-05T20:18:02.395 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T20:18:02.427 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-05T20:18:02.427 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.rlt8E1h3iVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/457) 2023-07-05T20:18:02.651 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph 2023-07-05T20:18:02.655 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-05T20:18:02.655 INFO:teuthology.orchestra.run.smithi046.stdout:MKFS_OPTIONS -- 172.21.15.46:6789:/scratch 2023-07-05T20:18:02.656 INFO:teuthology.orchestra.run.smithi046.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCbvKVkpp1TIhAAvJTELoeH8wkIFqjtppg17w== -o context=system_u:object_r:root_t:s0 172.21.15.46:6789:/scratch /tmp/tmp.KrMG67MsYpscratch 2023-07-05T20:18:02.656 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T20:18:03.573 INFO:teuthology.orchestra.run.smithi046.stdout:generic/457 [not run] Reflink not supported by scratch filesystem type: ceph 2023-07-05T20:18:03.595 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/457 2023-07-05T20:18:03.595 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/457 2023-07-05T20:18:03.596 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-07-05T20:18:03.603 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T20:18:03.636 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-05T20:18:03.640 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.rlt8E1h3iVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/458) 2023-07-05T20:18:03.875 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph 2023-07-05T20:18:03.880 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-05T20:18:03.880 INFO:teuthology.orchestra.run.smithi046.stdout:MKFS_OPTIONS -- 172.21.15.46:6789:/scratch 2023-07-05T20:18:03.881 INFO:teuthology.orchestra.run.smithi046.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCbvKVkpp1TIhAAvJTELoeH8wkIFqjtppg17w== -o context=system_u:object_r:root_t:s0 172.21.15.46:6789:/scratch /tmp/tmp.KrMG67MsYpscratch 2023-07-05T20:18:03.881 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T20:18:04.740 INFO:teuthology.orchestra.run.smithi046.stdout:generic/458 [not run] Reflink not supported by scratch filesystem type: ceph 2023-07-05T20:18:04.747 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/458 2023-07-05T20:18:04.748 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/458 2023-07-05T20:18:04.748 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-07-05T20:18:04.752 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T20:18:04.855 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-05T20:18:04.857 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.rlt8E1h3iVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/459) 2023-07-05T20:18:04.862 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-05T20:18:04.902 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-05T20:18:05.089 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph 2023-07-05T20:18:05.093 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-05T20:18:05.094 INFO:teuthology.orchestra.run.smithi046.stdout:MKFS_OPTIONS -- 172.21.15.46:6789:/scratch 2023-07-05T20:18:05.095 INFO:teuthology.orchestra.run.smithi046.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCbvKVkpp1TIhAAvJTELoeH8wkIFqjtppg17w== -o context=system_u:object_r:root_t:s0 172.21.15.46:6789:/scratch /tmp/tmp.KrMG67MsYpscratch 2023-07-05T20:18:05.095 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T20:18:05.654 INFO:teuthology.orchestra.run.smithi046.stdout:generic/459 [not run] require 172.21.15.46:6789:/scratch to be valid block disk 2023-07-05T20:18:05.658 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/459 2023-07-05T20:18:05.658 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/459 2023-07-05T20:18:05.659 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-07-05T20:18:05.660 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T20:18:05.686 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-05T20:18:05.686 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.rlt8E1h3iVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/460) 2023-07-05T20:18:05.912 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph 2023-07-05T20:18:05.916 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-05T20:18:05.916 INFO:teuthology.orchestra.run.smithi046.stdout:MKFS_OPTIONS -- 172.21.15.46:6789:/scratch 2023-07-05T20:18:05.917 INFO:teuthology.orchestra.run.smithi046.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCbvKVkpp1TIhAAvJTELoeH8wkIFqjtppg17w== -o context=system_u:object_r:root_t:s0 172.21.15.46:6789:/scratch /tmp/tmp.KrMG67MsYpscratch 2023-07-05T20:18:05.918 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T20:18:07.930 INFO:teuthology.orchestra.run.smithi046.stdout:generic/460 1s 2023-07-05T20:18:07.936 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/460 2023-07-05T20:18:07.936 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-07-05T20:18:07.937 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T20:18:07.946 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-05T20:18:07.946 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.rlt8E1h3iVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/461) 2023-07-05T20:18:08.183 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph 2023-07-05T20:18:08.188 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-05T20:18:08.188 INFO:teuthology.orchestra.run.smithi046.stdout:MKFS_OPTIONS -- 172.21.15.46:6789:/scratch 2023-07-05T20:18:08.189 INFO:teuthology.orchestra.run.smithi046.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCbvKVkpp1TIhAAvJTELoeH8wkIFqjtppg17w== -o context=system_u:object_r:root_t:s0 172.21.15.46:6789:/scratch /tmp/tmp.KrMG67MsYpscratch 2023-07-05T20:18:08.189 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T20:18:08.772 INFO:teuthology.orchestra.run.smithi046.stdout:generic/461 [not run] ceph does not support shutdown 2023-07-05T20:18:08.776 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/461 2023-07-05T20:18:08.777 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/461 2023-07-05T20:18:08.777 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-07-05T20:18:08.779 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T20:18:08.800 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-05T20:18:08.801 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.rlt8E1h3iVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/462) 2023-07-05T20:18:09.131 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph 2023-07-05T20:18:09.137 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-05T20:18:09.139 INFO:teuthology.orchestra.run.smithi046.stdout:MKFS_OPTIONS -- 172.21.15.46:6789:/scratch 2023-07-05T20:18:09.146 INFO:teuthology.orchestra.run.smithi046.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCbvKVkpp1TIhAAvJTELoeH8wkIFqjtppg17w== -o context=system_u:object_r:root_t:s0 172.21.15.46:6789:/scratch /tmp/tmp.KrMG67MsYpscratch 2023-07-05T20:18:09.146 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T20:18:09.699 INFO:teuthology.orchestra.run.smithi046.stdout:generic/462 [not run] mount 172.21.15.46:6789:/scratch with dax failed 2023-07-05T20:18:09.704 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/462 2023-07-05T20:18:09.704 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/462 2023-07-05T20:18:09.704 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-07-05T20:18:09.705 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T20:18:09.734 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-05T20:18:09.735 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.rlt8E1h3iVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/463) 2023-07-05T20:18:09.958 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph 2023-07-05T20:18:09.962 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-05T20:18:09.962 INFO:teuthology.orchestra.run.smithi046.stdout:MKFS_OPTIONS -- 172.21.15.46:6789:/scratch 2023-07-05T20:18:09.963 INFO:teuthology.orchestra.run.smithi046.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCbvKVkpp1TIhAAvJTELoeH8wkIFqjtppg17w== -o context=system_u:object_r:root_t:s0 172.21.15.46:6789:/scratch /tmp/tmp.KrMG67MsYpscratch 2023-07-05T20:18:09.963 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T20:18:10.372 INFO:teuthology.orchestra.run.smithi046.stdout:generic/463 [not run] Reflink not supported by test filesystem type: ceph 2023-07-05T20:18:10.376 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/463 2023-07-05T20:18:10.377 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/463 2023-07-05T20:18:10.377 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-07-05T20:18:10.379 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T20:18:10.494 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-05T20:18:10.495 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.rlt8E1h3iVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/464) 2023-07-05T20:18:11.007 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph 2023-07-05T20:18:11.012 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-05T20:18:11.013 INFO:teuthology.orchestra.run.smithi046.stdout:MKFS_OPTIONS -- 172.21.15.46:6789:/scratch 2023-07-05T20:18:11.014 INFO:teuthology.orchestra.run.smithi046.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCbvKVkpp1TIhAAvJTELoeH8wkIFqjtppg17w== -o context=system_u:object_r:root_t:s0 172.21.15.46:6789:/scratch /tmp/tmp.KrMG67MsYpscratch 2023-07-05T20:18:11.014 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T20:18:34.971 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-05T20:18:34.978 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-05T20:19:05.078 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-05T20:19:05.082 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-05T20:19:08.072 INFO:teuthology.orchestra.run.smithi046.stdout:generic/464 57s 2023-07-05T20:19:08.077 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/464 2023-07-05T20:19:08.077 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-07-05T20:19:08.079 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T20:19:08.087 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-05T20:19:08.088 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.rlt8E1h3iVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/465) 2023-07-05T20:19:08.313 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph 2023-07-05T20:19:08.317 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-05T20:19:08.318 INFO:teuthology.orchestra.run.smithi046.stdout:MKFS_OPTIONS -- 172.21.15.46:6789:/scratch 2023-07-05T20:19:08.319 INFO:teuthology.orchestra.run.smithi046.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCbvKVkpp1TIhAAvJTELoeH8wkIFqjtppg17w== -o context=system_u:object_r:root_t:s0 172.21.15.46:6789:/scratch /tmp/tmp.KrMG67MsYpscratch 2023-07-05T20:19:08.319 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T20:19:12.753 INFO:teuthology.orchestra.run.smithi046.stdout:generic/465 4s 2023-07-05T20:19:12.765 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/465 2023-07-05T20:19:12.766 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-07-05T20:19:12.768 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T20:19:12.778 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-05T20:19:12.778 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.rlt8E1h3iVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/466) 2023-07-05T20:19:13.003 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph 2023-07-05T20:19:13.008 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-05T20:19:13.009 INFO:teuthology.orchestra.run.smithi046.stdout:MKFS_OPTIONS -- 172.21.15.46:6789:/scratch 2023-07-05T20:19:13.009 INFO:teuthology.orchestra.run.smithi046.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCbvKVkpp1TIhAAvJTELoeH8wkIFqjtppg17w== -o context=system_u:object_r:root_t:s0 172.21.15.46:6789:/scratch /tmp/tmp.KrMG67MsYpscratch 2023-07-05T20:19:13.010 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T20:19:13.395 INFO:teuthology.orchestra.run.smithi046.stdout:generic/466 [not run] require 172.21.15.46:6789:/scratch to be valid block disk 2023-07-05T20:19:13.400 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/466 2023-07-05T20:19:13.400 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/466 2023-07-05T20:19:13.400 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-07-05T20:19:13.402 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T20:19:13.428 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-05T20:19:13.429 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.rlt8E1h3iVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/467) 2023-07-05T20:19:13.656 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph 2023-07-05T20:19:13.660 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-05T20:19:13.660 INFO:teuthology.orchestra.run.smithi046.stdout:MKFS_OPTIONS -- 172.21.15.46:6789:/scratch 2023-07-05T20:19:13.661 INFO:teuthology.orchestra.run.smithi046.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCbvKVkpp1TIhAAvJTELoeH8wkIFqjtppg17w== -o context=system_u:object_r:root_t:s0 172.21.15.46:6789:/scratch /tmp/tmp.KrMG67MsYpscratch 2023-07-05T20:19:13.661 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T20:19:35.337 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-05T20:19:35.339 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-05T20:20:05.863 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-05T20:20:05.866 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-05T20:20:14.573 INFO:teuthology.orchestra.run.smithi046.stdout:generic/467 61s 2023-07-05T20:20:14.660 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/467 2023-07-05T20:20:14.661 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-07-05T20:20:14.676 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T20:20:15.089 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-05T20:20:15.089 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.rlt8E1h3iVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/468) 2023-07-05T20:20:16.106 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph 2023-07-05T20:20:16.111 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-05T20:20:16.111 INFO:teuthology.orchestra.run.smithi046.stdout:MKFS_OPTIONS -- 172.21.15.46:6789:/scratch 2023-07-05T20:20:16.112 INFO:teuthology.orchestra.run.smithi046.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCbvKVkpp1TIhAAvJTELoeH8wkIFqjtppg17w== -o context=system_u:object_r:root_t:s0 172.21.15.46:6789:/scratch /tmp/tmp.KrMG67MsYpscratch 2023-07-05T20:20:16.112 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T20:20:16.724 INFO:teuthology.orchestra.run.smithi046.stdout:generic/468 [not run] ceph does not support shutdown 2023-07-05T20:20:16.746 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/468 2023-07-05T20:20:16.746 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/468 2023-07-05T20:20:16.746 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-07-05T20:20:16.748 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T20:20:16.775 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-05T20:20:16.775 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.rlt8E1h3iVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/469) 2023-07-05T20:20:17.001 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph 2023-07-05T20:20:17.006 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-05T20:20:17.006 INFO:teuthology.orchestra.run.smithi046.stdout:MKFS_OPTIONS -- 172.21.15.46:6789:/scratch 2023-07-05T20:20:17.007 INFO:teuthology.orchestra.run.smithi046.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCbvKVkpp1TIhAAvJTELoeH8wkIFqjtppg17w== -o context=system_u:object_r:root_t:s0 172.21.15.46:6789:/scratch /tmp/tmp.KrMG67MsYpscratch 2023-07-05T20:20:17.007 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T20:20:17.383 INFO:teuthology.orchestra.run.smithi046.stdout:generic/469 [not run] xfs_io falloc -k failed (old kernel/wrong fs?) 2023-07-05T20:20:17.387 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/469 2023-07-05T20:20:17.387 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/469 2023-07-05T20:20:17.387 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-07-05T20:20:17.389 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T20:20:17.426 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-05T20:20:17.426 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.rlt8E1h3iVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/470) 2023-07-05T20:20:17.651 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph 2023-07-05T20:20:17.656 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-05T20:20:17.656 INFO:teuthology.orchestra.run.smithi046.stdout:MKFS_OPTIONS -- 172.21.15.46:6789:/scratch 2023-07-05T20:20:17.657 INFO:teuthology.orchestra.run.smithi046.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCbvKVkpp1TIhAAvJTELoeH8wkIFqjtppg17w== -o context=system_u:object_r:root_t:s0 172.21.15.46:6789:/scratch /tmp/tmp.KrMG67MsYpscratch 2023-07-05T20:20:17.657 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T20:20:18.110 INFO:teuthology.orchestra.run.smithi046.stdout:generic/470 [not run] This test requires a valid $LOGWRITES_DEV 2023-07-05T20:20:18.114 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/470 2023-07-05T20:20:18.115 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/470 2023-07-05T20:20:18.115 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-07-05T20:20:18.116 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T20:20:18.142 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-05T20:20:18.143 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.rlt8E1h3iVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/471) 2023-07-05T20:20:18.386 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph 2023-07-05T20:20:18.390 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-05T20:20:18.391 INFO:teuthology.orchestra.run.smithi046.stdout:MKFS_OPTIONS -- 172.21.15.46:6789:/scratch 2023-07-05T20:20:18.392 INFO:teuthology.orchestra.run.smithi046.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCbvKVkpp1TIhAAvJTELoeH8wkIFqjtppg17w== -o context=system_u:object_r:root_t:s0 172.21.15.46:6789:/scratch /tmp/tmp.KrMG67MsYpscratch 2023-07-05T20:20:18.392 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T20:20:18.821 INFO:teuthology.orchestra.run.smithi046.stdout:generic/471 [not run] xfs_io pwrite -V 1 -b 4k -N failed (old kernel/wrong fs?) 2023-07-05T20:20:18.825 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/471 2023-07-05T20:20:18.826 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/471 2023-07-05T20:20:18.826 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-07-05T20:20:18.828 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T20:20:19.186 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-05T20:20:19.187 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.rlt8E1h3iVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/472) 2023-07-05T20:20:19.451 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph 2023-07-05T20:20:19.455 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-05T20:20:19.455 INFO:teuthology.orchestra.run.smithi046.stdout:MKFS_OPTIONS -- 172.21.15.46:6789:/scratch 2023-07-05T20:20:19.456 INFO:teuthology.orchestra.run.smithi046.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCbvKVkpp1TIhAAvJTELoeH8wkIFqjtppg17w== -o context=system_u:object_r:root_t:s0 172.21.15.46:6789:/scratch /tmp/tmp.KrMG67MsYpscratch 2023-07-05T20:20:19.456 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T20:20:20.052 INFO:teuthology.orchestra.run.smithi046.stdout:generic/472 [not run] swapfiles are not supported 2023-07-05T20:20:20.056 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/472 2023-07-05T20:20:20.056 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/472 2023-07-05T20:20:20.056 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-07-05T20:20:20.058 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T20:20:20.080 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-05T20:20:20.081 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.rlt8E1h3iVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/473) 2023-07-05T20:20:20.308 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph 2023-07-05T20:20:20.313 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-05T20:20:20.313 INFO:teuthology.orchestra.run.smithi046.stdout:MKFS_OPTIONS -- 172.21.15.46:6789:/scratch 2023-07-05T20:20:20.314 INFO:teuthology.orchestra.run.smithi046.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCbvKVkpp1TIhAAvJTELoeH8wkIFqjtppg17w== -o context=system_u:object_r:root_t:s0 172.21.15.46:6789:/scratch /tmp/tmp.KrMG67MsYpscratch 2023-07-05T20:20:20.314 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T20:20:20.703 INFO:teuthology.orchestra.run.smithi046.stdout:generic/473 [not run] xfs_io fiemap failed (old kernel/wrong fs?) 2023-07-05T20:20:20.707 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/473 2023-07-05T20:20:20.708 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/473 2023-07-05T20:20:20.708 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-07-05T20:20:20.710 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T20:20:20.736 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-05T20:20:20.737 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.rlt8E1h3iVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/474) 2023-07-05T20:20:20.957 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph 2023-07-05T20:20:20.961 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-05T20:20:20.962 INFO:teuthology.orchestra.run.smithi046.stdout:MKFS_OPTIONS -- 172.21.15.46:6789:/scratch 2023-07-05T20:20:20.963 INFO:teuthology.orchestra.run.smithi046.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCbvKVkpp1TIhAAvJTELoeH8wkIFqjtppg17w== -o context=system_u:object_r:root_t:s0 172.21.15.46:6789:/scratch /tmp/tmp.KrMG67MsYpscratch 2023-07-05T20:20:20.963 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T20:20:21.481 INFO:teuthology.orchestra.run.smithi046.stdout:generic/474 [not run] ceph does not support shutdown 2023-07-05T20:20:21.495 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/474 2023-07-05T20:20:21.495 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/474 2023-07-05T20:20:21.495 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-07-05T20:20:21.497 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T20:20:21.526 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-05T20:20:21.526 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.rlt8E1h3iVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/475) 2023-07-05T20:20:21.750 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph 2023-07-05T20:20:21.754 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-05T20:20:21.755 INFO:teuthology.orchestra.run.smithi046.stdout:MKFS_OPTIONS -- 172.21.15.46:6789:/scratch 2023-07-05T20:20:21.756 INFO:teuthology.orchestra.run.smithi046.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCbvKVkpp1TIhAAvJTELoeH8wkIFqjtppg17w== -o context=system_u:object_r:root_t:s0 172.21.15.46:6789:/scratch /tmp/tmp.KrMG67MsYpscratch 2023-07-05T20:20:21.756 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T20:20:22.134 INFO:teuthology.orchestra.run.smithi046.stdout:generic/475 [not run] require 172.21.15.46:6789:/scratch to be valid block disk 2023-07-05T20:20:22.139 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/475 2023-07-05T20:20:22.139 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/475 2023-07-05T20:20:22.139 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-07-05T20:20:22.141 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T20:20:22.165 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-05T20:20:22.166 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.rlt8E1h3iVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/476) 2023-07-05T20:20:22.406 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph 2023-07-05T20:20:22.410 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-05T20:20:22.411 INFO:teuthology.orchestra.run.smithi046.stdout:MKFS_OPTIONS -- 172.21.15.46:6789:/scratch 2023-07-05T20:20:22.412 INFO:teuthology.orchestra.run.smithi046.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCbvKVkpp1TIhAAvJTELoeH8wkIFqjtppg17w== -o context=system_u:object_r:root_t:s0 172.21.15.46:6789:/scratch /tmp/tmp.KrMG67MsYpscratch 2023-07-05T20:20:22.412 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T20:20:36.326 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-05T20:20:36.334 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-05T20:21:06.691 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-05T20:21:06.698 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-05T20:21:37.240 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-05T20:21:37.254 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-05T20:22:07.431 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-05T20:22:07.436 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-05T20:22:38.495 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-05T20:22:38.498 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-05T20:22:38.970 INFO:tasks.ceph.osd.7.smithi073.stderr:2023-07-05T20:22:38.969+0000 7fe6067a5700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 117372) UID: 0 2023-07-05T20:22:38.980 INFO:tasks.ceph.osd.4.smithi073.stderr:2023-07-05T20:22:38.970+0000 7fb7867e9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 117372) UID: 0 2023-07-05T20:22:38.980 INFO:tasks.ceph.osd.5.smithi073.stderr:2023-07-05T20:22:38.966+0000 7f1dead60700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 117372) UID: 0 2023-07-05T20:22:38.981 INFO:tasks.ceph.osd.6.smithi073.stderr:2023-07-05T20:22:38.971+0000 7f2582084700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 117372) UID: 0 2023-07-05T20:25:51.256 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-05T20:25:51.291 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-05T20:25:51.686 INFO:tasks.ceph.osd.2.smithi046.stderr:2023-07-05T20:25:51.684+0000 7f5a7ef99700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 616552) UID: 0 2023-07-05T20:25:51.687 INFO:tasks.ceph.osd.1.smithi046.stderr:2023-07-05T20:25:51.685+0000 7f2fc7c11700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 616552) UID: 0 2023-07-05T20:25:51.687 INFO:tasks.ceph.osd.3.smithi046.stderr:2023-07-05T20:25:51.685+0000 7f1104079700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 616552) UID: 0 2023-07-05T20:25:51.690 INFO:tasks.ceph.osd.0.smithi046.stderr:2023-07-05T20:25:51.685+0000 7f77d1dc1700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 616552) UID: 0 2023-07-05T20:25:51.715 INFO:tasks.ceph.osd.4.smithi073.stderr:2023-07-05T20:25:51.713+0000 7fb7867e9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 117511) UID: 0 2023-07-05T20:25:51.715 INFO:tasks.ceph.osd.6.smithi073.stderr:2023-07-05T20:25:51.713+0000 7f2582084700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 117511) UID: 0 2023-07-05T20:25:51.715 INFO:tasks.ceph.osd.5.smithi073.stderr:2023-07-05T20:25:51.714+0000 7f1dead60700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 117511) UID: 0 2023-07-05T20:25:51.716 INFO:tasks.ceph.osd.7.smithi073.stderr:2023-07-05T20:25:51.714+0000 7fe6067a5700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 117511) UID: 0 2023-07-05T20:30:01.608 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-05T20:30:01.611 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-05T20:30:01.930 INFO:tasks.ceph.mds.d.smithi073.stderr:2023-07-05T20:30:01.924+0000 7f07b5126700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 117595) UID: 0 2023-07-05T20:30:01.931 INFO:tasks.ceph.mds.b.smithi073.stderr:2023-07-05T20:30:01.924+0000 7f1ff165c700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 117595) UID: 0 2023-07-05T20:35:03.226 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-05T20:35:03.229 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-05T20:35:33.873 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-05T20:35:33.961 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-05T20:36:04.134 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-05T20:36:04.148 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-05T20:36:34.455 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-05T20:36:34.505 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-05T20:37:04.746 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-05T20:37:04.748 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-05T20:37:34.881 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-05T20:37:34.900 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-05T20:38:05.083 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-05T20:38:05.086 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-05T20:38:35.176 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-05T20:38:35.178 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-05T20:39:05.708 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-05T20:39:05.716 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-05T20:39:36.193 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-05T20:39:36.196 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-05T20:40:06.261 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-05T20:40:06.264 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-05T20:40:36.385 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-05T20:40:36.390 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-05T20:41:06.779 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-05T20:41:06.784 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-05T20:41:37.404 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-05T20:41:37.438 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-05T20:42:08.155 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-05T20:42:08.158 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-05T20:42:38.560 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-05T20:42:38.685 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-05T20:42:39.764 INFO:tasks.ceph.osd.6.smithi073.stderr:2023-07-05T20:42:39.763+0000 7f2582084700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 118065) UID: 0 2023-07-05T20:42:39.765 INFO:tasks.ceph.osd.5.smithi073.stderr:2023-07-05T20:42:39.763+0000 7f1dead60700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 118065) UID: 0 2023-07-05T20:42:39.768 INFO:tasks.ceph.osd.4.smithi073.stderr:2023-07-05T20:42:39.763+0000 7fb7867e9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 118065) UID: 0 2023-07-05T20:42:39.769 INFO:tasks.ceph.osd.7.smithi073.stderr:2023-07-05T20:42:39.766+0000 7fe6067a5700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 118065) UID: 0 2023-07-05T20:46:48.499 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-05T20:46:48.504 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-05T20:46:48.779 INFO:tasks.ceph.mds.d.smithi073.stderr:2023-07-05T20:46:48.773+0000 7f07b5126700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 118136) UID: 0 2023-07-05T20:46:48.780 INFO:tasks.ceph.mds.b.smithi073.stderr:2023-07-05T20:46:48.779+0000 7f1ff165c700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 118136) UID: 0 2023-07-05T20:51:28.022 INFO:tasks.ceph.osd.4.smithi073.stderr:2023-07-05T20:51:28.021+0000 7fb7867e9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 118189) UID: 0 2023-07-05T20:51:28.023 INFO:tasks.ceph.osd.6.smithi073.stderr:2023-07-05T20:51:28.021+0000 7f2582084700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 118189) UID: 0 2023-07-05T20:51:28.024 INFO:tasks.ceph.osd.7.smithi073.stderr:2023-07-05T20:51:28.023+0000 7fe6067a5700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 118189) UID: 0 2023-07-05T20:51:28.026 INFO:tasks.ceph.osd.5.smithi073.stderr:2023-07-05T20:51:28.025+0000 7f1dead60700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 118189) UID: 0 2023-07-05T20:55:33.239 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-05T20:55:33.242 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-05T20:55:33.333 INFO:tasks.ceph.osd.2.smithi046.stderr:2023-07-05T20:55:33.331+0000 7f5a7ef99700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 617283) UID: 0 2023-07-05T20:55:33.333 INFO:tasks.ceph.osd.0.smithi046.stderr:2023-07-05T20:55:33.332+0000 7f77d1dc1700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 617283) UID: 0 2023-07-05T20:55:33.340 INFO:tasks.ceph.osd.1.smithi046.stderr:2023-07-05T20:55:33.332+0000 7f2fc7c11700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 617283) UID: 0 2023-07-05T20:55:33.345 INFO:tasks.ceph.osd.3.smithi046.stderr:2023-07-05T20:55:33.339+0000 7f1104079700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 617283) UID: 0 2023-07-05T20:59:20.246 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-05T20:59:20.258 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-05T20:59:20.600 INFO:tasks.ceph.mds.d.smithi073.stderr:2023-07-05T20:59:20.598+0000 7f07b5126700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 118310) UID: 0 2023-07-05T20:59:20.601 INFO:tasks.ceph.mds.b.smithi073.stderr:2023-07-05T20:59:20.598+0000 7f1ff165c700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 118310) UID: 0 2023-07-05T20:59:20.704 INFO:tasks.ceph.osd.2.smithi046.stderr:2023-07-05T20:59:20.702+0000 7f5a7ef99700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 617363) UID: 0 2023-07-05T20:59:20.704 INFO:tasks.ceph.osd.0.smithi046.stderr:2023-07-05T20:59:20.702+0000 7f77d1dc1700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 617363) UID: 0 2023-07-05T20:59:20.705 INFO:tasks.ceph.osd.1.smithi046.stderr:2023-07-05T20:59:20.702+0000 7f2fc7c11700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 617363) UID: 0 2023-07-05T20:59:20.705 INFO:tasks.ceph.osd.3.smithi046.stderr:2023-07-05T20:59:20.702+0000 7f1104079700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 617363) UID: 0 2023-07-05T21:03:15.483 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-05T21:03:15.497 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-05T21:03:45.936 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-05T21:03:45.950 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-05T21:04:16.191 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-05T21:04:16.197 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-05T21:04:46.699 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-05T21:04:46.715 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-05T21:05:17.225 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-05T21:05:17.228 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-05T21:05:47.350 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-05T21:05:47.353 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-05T21:06:17.759 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-05T21:06:17.769 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-05T21:06:47.994 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-05T21:06:47.996 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-05T21:07:18.245 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-05T21:07:18.247 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-05T21:07:48.316 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-05T21:07:48.318 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-05T21:08:18.419 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-05T21:08:18.422 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-05T21:08:48.592 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-05T21:08:48.604 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-05T21:09:19.204 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-05T21:09:19.206 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-05T21:09:49.412 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-05T21:09:49.414 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-05T21:10:19.603 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-05T21:10:19.674 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-05T21:10:50.386 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-05T21:10:50.391 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-05T21:11:20.550 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-05T21:11:20.553 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-05T21:11:20.627 INFO:tasks.ceph.mds.b.smithi073.stderr:2023-07-05T21:11:20.626+0000 7f1ff165c700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 118993) UID: 0 2023-07-05T21:11:20.628 INFO:tasks.ceph.mds.d.smithi073.stderr:2023-07-05T21:11:20.626+0000 7f07b5126700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 118993) UID: 0 2023-07-05T21:15:03.367 INFO:tasks.ceph.osd.5.smithi073.stderr:2023-07-05T21:15:03.365+0000 7f1dead60700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 119027) UID: 0 2023-07-05T21:15:03.368 INFO:tasks.ceph.osd.4.smithi073.stderr:2023-07-05T21:15:03.366+0000 7fb7867e9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 119027) UID: 0 2023-07-05T21:15:03.371 INFO:tasks.ceph.osd.6.smithi073.stderr:2023-07-05T21:15:03.365+0000 7f2582084700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 119027) UID: 0 2023-07-05T21:15:03.381 INFO:tasks.ceph.osd.7.smithi073.stderr:2023-07-05T21:15:03.380+0000 7fe6067a5700 -1 Fail to open '/proc/119027/cmdline' error = (2) No such file or directory 2023-07-05T21:15:03.381 INFO:tasks.ceph.osd.7.smithi073.stderr:2023-07-05T21:15:03.380+0000 7fe6067a5700 -1 received signal: Hangup from (PID: 119027) UID: 0 2023-07-05T21:17:24.615 INFO:teuthology.orchestra.run.smithi046.stdout:generic/476 3422s 2023-07-05T21:17:24.639 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/476 2023-07-05T21:17:24.639 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-07-05T21:17:24.641 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T21:17:24.662 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-05T21:17:24.663 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.rlt8E1h3iVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/477) 2023-07-05T21:17:37.318 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph 2023-07-05T21:17:37.322 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-05T21:17:37.323 INFO:teuthology.orchestra.run.smithi046.stdout:MKFS_OPTIONS -- 172.21.15.46:6789:/scratch 2023-07-05T21:17:37.324 INFO:teuthology.orchestra.run.smithi046.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCbvKVkpp1TIhAAvJTELoeH8wkIFqjtppg17w== -o context=system_u:object_r:root_t:s0 172.21.15.46:6789:/scratch /tmp/tmp.KrMG67MsYpscratch 2023-07-05T21:17:37.324 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T21:18:51.937 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-05T21:18:51.941 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-05T21:18:52.013 INFO:tasks.ceph.osd.0.smithi046.stderr:2023-07-05T21:18:52.010+0000 7f77d1dc1700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 618323) UID: 0 2023-07-05T21:18:52.013 INFO:tasks.ceph.osd.2.smithi046.stderr:2023-07-05T21:18:52.010+0000 7f5a7ef99700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 618323) UID: 0 2023-07-05T21:18:52.014 INFO:tasks.ceph.osd.3.smithi046.stderr:2023-07-05T21:18:52.011+0000 7f1104079700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 618323) UID: 0 2023-07-05T21:18:52.014 INFO:tasks.ceph.osd.1.smithi046.stderr:2023-07-05T21:18:52.011+0000 7f2fc7c11700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 618323) UID: 0 2023-07-05T21:24:36.451 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-05T21:24:36.453 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-05T21:24:36.532 INFO:tasks.ceph.mds.b.smithi073.stderr:2023-07-05T21:24:36.531+0000 7f1ff165c700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 119158) UID: 0 2023-07-05T21:24:36.533 INFO:tasks.ceph.mds.d.smithi073.stderr:2023-07-05T21:24:36.531+0000 7f07b5126700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 119158) UID: 0 2023-07-05T21:27:52.315 INFO:teuthology.orchestra.run.smithi046.stdout:generic/477 22s 2023-07-05T21:27:52.419 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/477 2023-07-05T21:27:52.419 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-07-05T21:27:52.423 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T21:27:52.524 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-05T21:27:52.525 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.rlt8E1h3iVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/478) 2023-07-05T21:27:53.670 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph 2023-07-05T21:27:53.680 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-05T21:27:53.681 INFO:teuthology.orchestra.run.smithi046.stdout:MKFS_OPTIONS -- 172.21.15.46:6789:/scratch 2023-07-05T21:27:53.681 INFO:teuthology.orchestra.run.smithi046.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCbvKVkpp1TIhAAvJTELoeH8wkIFqjtppg17w== -o context=system_u:object_r:root_t:s0 172.21.15.46:6789:/scratch /tmp/tmp.KrMG67MsYpscratch 2023-07-05T21:27:53.681 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T21:28:10.975 INFO:teuthology.orchestra.run.smithi046.stdout:generic/478 17s 2023-07-05T21:28:10.980 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/478 2023-07-05T21:28:10.981 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-07-05T21:28:10.982 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T21:28:11.035 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-05T21:28:11.036 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.rlt8E1h3iVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/479) 2023-07-05T21:28:11.415 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph 2023-07-05T21:28:11.429 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-05T21:28:11.430 INFO:teuthology.orchestra.run.smithi046.stdout:MKFS_OPTIONS -- 172.21.15.46:6789:/scratch 2023-07-05T21:28:11.431 INFO:teuthology.orchestra.run.smithi046.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCbvKVkpp1TIhAAvJTELoeH8wkIFqjtppg17w== -o context=system_u:object_r:root_t:s0 172.21.15.46:6789:/scratch /tmp/tmp.KrMG67MsYpscratch 2023-07-05T21:28:11.431 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T21:28:12.125 INFO:teuthology.orchestra.run.smithi046.stdout:generic/479 [not run] require 172.21.15.46:6789:/scratch to be valid block disk 2023-07-05T21:28:12.135 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/479 2023-07-05T21:28:12.136 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/479 2023-07-05T21:28:12.136 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-07-05T21:28:12.138 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T21:28:12.190 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-05T21:28:12.191 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.rlt8E1h3iVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/480) 2023-07-05T21:28:12.535 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph 2023-07-05T21:28:12.545 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-05T21:28:12.546 INFO:teuthology.orchestra.run.smithi046.stdout:MKFS_OPTIONS -- 172.21.15.46:6789:/scratch 2023-07-05T21:28:12.546 INFO:teuthology.orchestra.run.smithi046.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCbvKVkpp1TIhAAvJTELoeH8wkIFqjtppg17w== -o context=system_u:object_r:root_t:s0 172.21.15.46:6789:/scratch /tmp/tmp.KrMG67MsYpscratch 2023-07-05T21:28:12.547 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T21:28:13.191 INFO:teuthology.orchestra.run.smithi046.stdout:generic/480 [not run] require 172.21.15.46:6789:/scratch to be valid block disk 2023-07-05T21:28:13.203 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/480 2023-07-05T21:28:13.203 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/480 2023-07-05T21:28:13.204 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-07-05T21:28:13.204 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T21:28:13.250 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-05T21:28:13.250 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.rlt8E1h3iVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/481) 2023-07-05T21:28:13.593 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph 2023-07-05T21:28:13.598 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-05T21:28:13.598 INFO:teuthology.orchestra.run.smithi046.stdout:MKFS_OPTIONS -- 172.21.15.46:6789:/scratch 2023-07-05T21:28:13.599 INFO:teuthology.orchestra.run.smithi046.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCbvKVkpp1TIhAAvJTELoeH8wkIFqjtppg17w== -o context=system_u:object_r:root_t:s0 172.21.15.46:6789:/scratch /tmp/tmp.KrMG67MsYpscratch 2023-07-05T21:28:13.600 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T21:28:14.146 INFO:teuthology.orchestra.run.smithi046.stdout:generic/481 [not run] require 172.21.15.46:6789:/scratch to be valid block disk 2023-07-05T21:28:14.152 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/481 2023-07-05T21:28:14.152 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/481 2023-07-05T21:28:14.152 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-07-05T21:28:14.155 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T21:28:14.189 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-05T21:28:14.189 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.rlt8E1h3iVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/482) 2023-07-05T21:28:14.570 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph 2023-07-05T21:28:14.574 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-05T21:28:14.575 INFO:teuthology.orchestra.run.smithi046.stdout:MKFS_OPTIONS -- 172.21.15.46:6789:/scratch 2023-07-05T21:28:14.576 INFO:teuthology.orchestra.run.smithi046.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCbvKVkpp1TIhAAvJTELoeH8wkIFqjtppg17w== -o context=system_u:object_r:root_t:s0 172.21.15.46:6789:/scratch /tmp/tmp.KrMG67MsYpscratch 2023-07-05T21:28:14.576 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T21:28:15.195 INFO:teuthology.orchestra.run.smithi046.stdout:generic/482 [not run] This test requires a valid $LOGWRITES_DEV 2023-07-05T21:28:15.202 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/482 2023-07-05T21:28:15.203 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/482 2023-07-05T21:28:15.203 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-07-05T21:28:15.205 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T21:28:15.246 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-05T21:28:15.247 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.rlt8E1h3iVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/483) 2023-07-05T21:28:15.613 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph 2023-07-05T21:28:15.618 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-05T21:28:15.619 INFO:teuthology.orchestra.run.smithi046.stdout:MKFS_OPTIONS -- 172.21.15.46:6789:/scratch 2023-07-05T21:28:15.625 INFO:teuthology.orchestra.run.smithi046.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCbvKVkpp1TIhAAvJTELoeH8wkIFqjtppg17w== -o context=system_u:object_r:root_t:s0 172.21.15.46:6789:/scratch /tmp/tmp.KrMG67MsYpscratch 2023-07-05T21:28:15.626 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T21:28:16.148 INFO:teuthology.orchestra.run.smithi046.stdout:generic/483 [not run] require 172.21.15.46:6789:/scratch to be valid block disk 2023-07-05T21:28:16.156 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/483 2023-07-05T21:28:16.156 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/483 2023-07-05T21:28:16.156 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-07-05T21:28:16.156 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T21:28:16.199 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-05T21:28:16.200 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.rlt8E1h3iVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/484) 2023-07-05T21:28:16.543 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph 2023-07-05T21:28:16.548 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-05T21:28:16.549 INFO:teuthology.orchestra.run.smithi046.stdout:MKFS_OPTIONS -- 172.21.15.46:6789:/scratch 2023-07-05T21:28:16.550 INFO:teuthology.orchestra.run.smithi046.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCbvKVkpp1TIhAAvJTELoeH8wkIFqjtppg17w== -o context=system_u:object_r:root_t:s0 172.21.15.46:6789:/scratch /tmp/tmp.KrMG67MsYpscratch 2023-07-05T21:28:16.550 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T21:28:17.040 INFO:teuthology.orchestra.run.smithi046.stdout:generic/484 [not run] require 172.21.15.46:6789:/scratch to be valid block disk 2023-07-05T21:28:17.046 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/484 2023-07-05T21:28:17.046 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/484 2023-07-05T21:28:17.046 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-07-05T21:28:17.049 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T21:28:17.090 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-05T21:28:17.090 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.rlt8E1h3iVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/485) 2023-07-05T21:28:17.459 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph 2023-07-05T21:28:17.471 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-05T21:28:17.472 INFO:teuthology.orchestra.run.smithi046.stdout:MKFS_OPTIONS -- 172.21.15.46:6789:/scratch 2023-07-05T21:28:17.473 INFO:teuthology.orchestra.run.smithi046.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCbvKVkpp1TIhAAvJTELoeH8wkIFqjtppg17w== -o context=system_u:object_r:root_t:s0 172.21.15.46:6789:/scratch /tmp/tmp.KrMG67MsYpscratch 2023-07-05T21:28:17.473 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T21:28:18.018 INFO:teuthology.orchestra.run.smithi046.stdout:generic/485 [not run] xfs_io falloc -k failed (old kernel/wrong fs?) 2023-07-05T21:28:18.024 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/485 2023-07-05T21:28:18.024 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/485 2023-07-05T21:28:18.024 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-07-05T21:28:18.026 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T21:28:18.088 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-05T21:28:18.089 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.rlt8E1h3iVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/486) 2023-07-05T21:28:18.768 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph 2023-07-05T21:28:18.779 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-05T21:28:18.779 INFO:teuthology.orchestra.run.smithi046.stdout:MKFS_OPTIONS -- 172.21.15.46:6789:/scratch 2023-07-05T21:28:18.780 INFO:teuthology.orchestra.run.smithi046.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCbvKVkpp1TIhAAvJTELoeH8wkIFqjtppg17w== -o context=system_u:object_r:root_t:s0 172.21.15.46:6789:/scratch /tmp/tmp.KrMG67MsYpscratch 2023-07-05T21:28:18.780 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T21:28:20.212 INFO:teuthology.orchestra.run.smithi046.stdout:generic/486 1s 2023-07-05T21:28:20.217 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/486 2023-07-05T21:28:20.217 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-07-05T21:28:20.220 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T21:28:20.239 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-05T21:28:20.240 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.rlt8E1h3iVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/487) 2023-07-05T21:28:20.603 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph 2023-07-05T21:28:20.620 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-05T21:28:20.620 INFO:teuthology.orchestra.run.smithi046.stdout:MKFS_OPTIONS -- 172.21.15.46:6789:/scratch 2023-07-05T21:28:20.620 INFO:teuthology.orchestra.run.smithi046.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCbvKVkpp1TIhAAvJTELoeH8wkIFqjtppg17w== -o context=system_u:object_r:root_t:s0 172.21.15.46:6789:/scratch /tmp/tmp.KrMG67MsYpscratch 2023-07-05T21:28:20.621 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T21:28:21.134 INFO:teuthology.orchestra.run.smithi046.stdout:generic/487 [not run] This test requires a valid $SCRATCH_LOGDEV 2023-07-05T21:28:21.140 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/487 2023-07-05T21:28:21.140 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/487 2023-07-05T21:28:21.140 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-07-05T21:28:21.142 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T21:28:21.182 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-05T21:28:21.183 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.rlt8E1h3iVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/488) 2023-07-05T21:28:21.547 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph 2023-07-05T21:28:21.558 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-05T21:28:21.558 INFO:teuthology.orchestra.run.smithi046.stdout:MKFS_OPTIONS -- 172.21.15.46:6789:/scratch 2023-07-05T21:28:21.559 INFO:teuthology.orchestra.run.smithi046.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCbvKVkpp1TIhAAvJTELoeH8wkIFqjtppg17w== -o context=system_u:object_r:root_t:s0 172.21.15.46:6789:/scratch /tmp/tmp.KrMG67MsYpscratch 2023-07-05T21:28:21.559 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T21:28:22.030 INFO:teuthology.orchestra.run.smithi046.stdout:generic/488 [not run] Filesystem ceph not supported in _scratch_mkfs_sized 2023-07-05T21:28:22.035 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/488 2023-07-05T21:28:22.035 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/488 2023-07-05T21:28:22.035 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-07-05T21:28:22.037 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T21:28:22.079 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-05T21:28:22.079 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.rlt8E1h3iVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/489) 2023-07-05T21:28:22.427 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph 2023-07-05T21:28:22.438 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-05T21:28:22.439 INFO:teuthology.orchestra.run.smithi046.stdout:MKFS_OPTIONS -- 172.21.15.46:6789:/scratch 2023-07-05T21:28:22.439 INFO:teuthology.orchestra.run.smithi046.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCbvKVkpp1TIhAAvJTELoeH8wkIFqjtppg17w== -o context=system_u:object_r:root_t:s0 172.21.15.46:6789:/scratch /tmp/tmp.KrMG67MsYpscratch 2023-07-05T21:28:22.439 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T21:28:23.015 INFO:teuthology.orchestra.run.smithi046.stdout:generic/489 [not run] require 172.21.15.46:6789:/scratch to be valid block disk 2023-07-05T21:28:23.020 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/489 2023-07-05T21:28:23.021 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/489 2023-07-05T21:28:23.021 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-07-05T21:28:23.023 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T21:28:23.057 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-05T21:28:23.057 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.rlt8E1h3iVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/490) 2023-07-05T21:28:23.426 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph 2023-07-05T21:28:23.431 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-05T21:28:23.431 INFO:teuthology.orchestra.run.smithi046.stdout:MKFS_OPTIONS -- 172.21.15.46:6789:/scratch 2023-07-05T21:28:23.433 INFO:teuthology.orchestra.run.smithi046.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCbvKVkpp1TIhAAvJTELoeH8wkIFqjtppg17w== -o context=system_u:object_r:root_t:s0 172.21.15.46:6789:/scratch /tmp/tmp.KrMG67MsYpscratch 2023-07-05T21:28:23.433 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T21:28:25.939 INFO:teuthology.orchestra.run.smithi046.stdout:generic/490 2s 2023-07-05T21:28:25.945 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/490 2023-07-05T21:28:25.946 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-07-05T21:28:25.947 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T21:28:26.297 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-05T21:28:26.298 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.rlt8E1h3iVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/491) 2023-07-05T21:28:26.686 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph 2023-07-05T21:28:26.690 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-05T21:28:26.691 INFO:teuthology.orchestra.run.smithi046.stdout:MKFS_OPTIONS -- 172.21.15.46:6789:/scratch 2023-07-05T21:28:26.698 INFO:teuthology.orchestra.run.smithi046.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCbvKVkpp1TIhAAvJTELoeH8wkIFqjtppg17w== -o context=system_u:object_r:root_t:s0 172.21.15.46:6789:/scratch /tmp/tmp.KrMG67MsYpscratch 2023-07-05T21:28:26.698 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T21:28:27.221 INFO:teuthology.orchestra.run.smithi046.stdout:generic/491 [not run] ceph does not support freezing 2023-07-05T21:28:27.226 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/491 2023-07-05T21:28:27.226 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/491 2023-07-05T21:28:27.227 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-07-05T21:28:27.228 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T21:28:27.266 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-05T21:28:27.267 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.rlt8E1h3iVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/492) 2023-07-05T21:28:27.626 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph 2023-07-05T21:28:27.631 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-05T21:28:27.631 INFO:teuthology.orchestra.run.smithi046.stdout:MKFS_OPTIONS -- 172.21.15.46:6789:/scratch 2023-07-05T21:28:27.632 INFO:teuthology.orchestra.run.smithi046.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCbvKVkpp1TIhAAvJTELoeH8wkIFqjtppg17w== -o context=system_u:object_r:root_t:s0 172.21.15.46:6789:/scratch /tmp/tmp.KrMG67MsYpscratch 2023-07-05T21:28:27.633 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T21:28:28.193 INFO:teuthology.orchestra.run.smithi046.stdout:generic/492 [not run] xfs_io label failed (old kernel/wrong fs?) 2023-07-05T21:28:28.198 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/492 2023-07-05T21:28:28.199 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/492 2023-07-05T21:28:28.199 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-07-05T21:28:28.202 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T21:28:28.232 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-05T21:28:28.233 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.rlt8E1h3iVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/493) 2023-07-05T21:28:28.552 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph 2023-07-05T21:28:28.556 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-05T21:28:28.557 INFO:teuthology.orchestra.run.smithi046.stdout:MKFS_OPTIONS -- 172.21.15.46:6789:/scratch 2023-07-05T21:28:28.558 INFO:teuthology.orchestra.run.smithi046.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCbvKVkpp1TIhAAvJTELoeH8wkIFqjtppg17w== -o context=system_u:object_r:root_t:s0 172.21.15.46:6789:/scratch /tmp/tmp.KrMG67MsYpscratch 2023-07-05T21:28:28.558 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T21:28:29.511 INFO:teuthology.orchestra.run.smithi046.stdout:generic/493 [not run] swapfiles are not supported 2023-07-05T21:28:29.515 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/493 2023-07-05T21:28:29.515 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/493 2023-07-05T21:28:29.515 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-07-05T21:28:29.517 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T21:28:29.558 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-05T21:28:29.559 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.rlt8E1h3iVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/494) 2023-07-05T21:28:29.963 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph 2023-07-05T21:28:29.969 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-05T21:28:29.969 INFO:teuthology.orchestra.run.smithi046.stdout:MKFS_OPTIONS -- 172.21.15.46:6789:/scratch 2023-07-05T21:28:29.970 INFO:teuthology.orchestra.run.smithi046.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCbvKVkpp1TIhAAvJTELoeH8wkIFqjtppg17w== -o context=system_u:object_r:root_t:s0 172.21.15.46:6789:/scratch /tmp/tmp.KrMG67MsYpscratch 2023-07-05T21:28:29.970 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T21:28:30.859 INFO:teuthology.orchestra.run.smithi046.stdout:generic/494 [not run] swapfiles are not supported 2023-07-05T21:28:30.869 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/494 2023-07-05T21:28:30.870 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/494 2023-07-05T21:28:30.870 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-07-05T21:28:30.871 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T21:28:30.909 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-05T21:28:30.910 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.rlt8E1h3iVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/495) 2023-07-05T21:28:31.298 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph 2023-07-05T21:28:31.305 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-05T21:28:31.305 INFO:teuthology.orchestra.run.smithi046.stdout:MKFS_OPTIONS -- 172.21.15.46:6789:/scratch 2023-07-05T21:28:31.306 INFO:teuthology.orchestra.run.smithi046.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCbvKVkpp1TIhAAvJTELoeH8wkIFqjtppg17w== -o context=system_u:object_r:root_t:s0 172.21.15.46:6789:/scratch /tmp/tmp.KrMG67MsYpscratch 2023-07-05T21:28:31.307 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T21:28:32.241 INFO:teuthology.orchestra.run.smithi046.stdout:generic/495 [not run] swapfiles are not supported 2023-07-05T21:28:32.246 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/495 2023-07-05T21:28:32.246 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/495 2023-07-05T21:28:32.246 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-07-05T21:28:32.248 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T21:28:32.296 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-05T21:28:32.296 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.rlt8E1h3iVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/496) 2023-07-05T21:28:32.616 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph 2023-07-05T21:28:32.621 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-05T21:28:32.622 INFO:teuthology.orchestra.run.smithi046.stdout:MKFS_OPTIONS -- 172.21.15.46:6789:/scratch 2023-07-05T21:28:32.625 INFO:teuthology.orchestra.run.smithi046.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCbvKVkpp1TIhAAvJTELoeH8wkIFqjtppg17w== -o context=system_u:object_r:root_t:s0 172.21.15.46:6789:/scratch /tmp/tmp.KrMG67MsYpscratch 2023-07-05T21:28:32.625 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T21:28:33.543 INFO:teuthology.orchestra.run.smithi046.stdout:generic/496 [not run] swapfiles are not supported 2023-07-05T21:28:33.548 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/496 2023-07-05T21:28:33.549 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/496 2023-07-05T21:28:33.549 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-07-05T21:28:33.551 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T21:28:33.590 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-05T21:28:33.591 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.rlt8E1h3iVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/497) 2023-07-05T21:28:33.928 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph 2023-07-05T21:28:33.932 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-05T21:28:33.933 INFO:teuthology.orchestra.run.smithi046.stdout:MKFS_OPTIONS -- 172.21.15.46:6789:/scratch 2023-07-05T21:28:33.934 INFO:teuthology.orchestra.run.smithi046.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCbvKVkpp1TIhAAvJTELoeH8wkIFqjtppg17w== -o context=system_u:object_r:root_t:s0 172.21.15.46:6789:/scratch /tmp/tmp.KrMG67MsYpscratch 2023-07-05T21:28:33.934 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T21:28:34.882 INFO:teuthology.orchestra.run.smithi046.stdout:generic/497 [not run] swapfiles are not supported 2023-07-05T21:28:34.887 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/497 2023-07-05T21:28:34.887 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/497 2023-07-05T21:28:34.887 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-07-05T21:28:34.894 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T21:28:34.948 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-05T21:28:34.949 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.rlt8E1h3iVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/498) 2023-07-05T21:28:35.319 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph 2023-07-05T21:28:35.323 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-05T21:28:35.324 INFO:teuthology.orchestra.run.smithi046.stdout:MKFS_OPTIONS -- 172.21.15.46:6789:/scratch 2023-07-05T21:28:35.325 INFO:teuthology.orchestra.run.smithi046.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCbvKVkpp1TIhAAvJTELoeH8wkIFqjtppg17w== -o context=system_u:object_r:root_t:s0 172.21.15.46:6789:/scratch /tmp/tmp.KrMG67MsYpscratch 2023-07-05T21:28:35.325 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T21:28:35.917 INFO:teuthology.orchestra.run.smithi046.stdout:generic/498 [not run] require 172.21.15.46:6789:/scratch to be valid block disk 2023-07-05T21:28:35.917 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/498 2023-07-05T21:28:35.917 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/498 2023-07-05T21:28:35.918 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-07-05T21:28:35.921 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T21:28:35.977 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-05T21:28:35.978 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.rlt8E1h3iVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/499) 2023-07-05T21:28:36.370 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph 2023-07-05T21:28:36.375 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-05T21:28:36.376 INFO:teuthology.orchestra.run.smithi046.stdout:MKFS_OPTIONS -- 172.21.15.46:6789:/scratch 2023-07-05T21:28:36.377 INFO:teuthology.orchestra.run.smithi046.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCbvKVkpp1TIhAAvJTELoeH8wkIFqjtppg17w== -o context=system_u:object_r:root_t:s0 172.21.15.46:6789:/scratch /tmp/tmp.KrMG67MsYpscratch 2023-07-05T21:28:36.377 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T21:28:36.913 INFO:teuthology.orchestra.run.smithi046.stdout:generic/499 [not run] xfs_io falloc -k failed (old kernel/wrong fs?) 2023-07-05T21:28:36.918 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/499 2023-07-05T21:28:36.918 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/499 2023-07-05T21:28:36.918 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-07-05T21:28:36.921 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T21:28:36.985 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-05T21:28:36.985 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.rlt8E1h3iVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/500) 2023-07-05T21:28:37.359 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph 2023-07-05T21:28:37.364 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-05T21:28:37.365 INFO:teuthology.orchestra.run.smithi046.stdout:MKFS_OPTIONS -- 172.21.15.46:6789:/scratch 2023-07-05T21:28:37.366 INFO:teuthology.orchestra.run.smithi046.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCbvKVkpp1TIhAAvJTELoeH8wkIFqjtppg17w== -o context=system_u:object_r:root_t:s0 172.21.15.46:6789:/scratch /tmp/tmp.KrMG67MsYpscratch 2023-07-05T21:28:37.366 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T21:28:37.935 INFO:teuthology.orchestra.run.smithi046.stdout:generic/500 [not run] require 172.21.15.46:6789:/scratch to be valid block disk 2023-07-05T21:28:37.940 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/500 2023-07-05T21:28:37.940 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/500 2023-07-05T21:28:37.941 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-07-05T21:28:37.943 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T21:28:37.976 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-05T21:28:37.977 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.rlt8E1h3iVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/501) 2023-07-05T21:28:38.330 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph 2023-07-05T21:28:38.337 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-05T21:28:38.338 INFO:teuthology.orchestra.run.smithi046.stdout:MKFS_OPTIONS -- 172.21.15.46:6789:/scratch 2023-07-05T21:28:38.339 INFO:teuthology.orchestra.run.smithi046.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCbvKVkpp1TIhAAvJTELoeH8wkIFqjtppg17w== -o context=system_u:object_r:root_t:s0 172.21.15.46:6789:/scratch /tmp/tmp.KrMG67MsYpscratch 2023-07-05T21:28:38.339 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T21:28:39.386 INFO:teuthology.orchestra.run.smithi046.stdout:generic/501 [not run] Reflink not supported by scratch filesystem type: ceph 2023-07-05T21:28:39.393 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/501 2023-07-05T21:28:39.394 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/501 2023-07-05T21:28:39.394 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-07-05T21:28:39.414 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T21:28:39.548 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-05T21:28:39.548 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.rlt8E1h3iVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/502) 2023-07-05T21:28:39.894 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph 2023-07-05T21:28:39.899 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-05T21:28:39.899 INFO:teuthology.orchestra.run.smithi046.stdout:MKFS_OPTIONS -- 172.21.15.46:6789:/scratch 2023-07-05T21:28:39.900 INFO:teuthology.orchestra.run.smithi046.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCbvKVkpp1TIhAAvJTELoeH8wkIFqjtppg17w== -o context=system_u:object_r:root_t:s0 172.21.15.46:6789:/scratch /tmp/tmp.KrMG67MsYpscratch 2023-07-05T21:28:39.901 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T21:28:40.438 INFO:teuthology.orchestra.run.smithi046.stdout:generic/502 [not run] require 172.21.15.46:6789:/scratch to be valid block disk 2023-07-05T21:28:40.443 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/502 2023-07-05T21:28:40.443 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/502 2023-07-05T21:28:40.443 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-07-05T21:28:40.445 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T21:28:40.484 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-05T21:28:40.484 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.rlt8E1h3iVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/503) 2023-07-05T21:28:40.827 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph 2023-07-05T21:28:40.833 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-05T21:28:40.833 INFO:teuthology.orchestra.run.smithi046.stdout:MKFS_OPTIONS -- 172.21.15.46:6789:/scratch 2023-07-05T21:28:40.834 INFO:teuthology.orchestra.run.smithi046.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCbvKVkpp1TIhAAvJTELoeH8wkIFqjtppg17w== -o context=system_u:object_r:root_t:s0 172.21.15.46:6789:/scratch /tmp/tmp.KrMG67MsYpscratch 2023-07-05T21:28:40.835 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T21:28:41.436 INFO:teuthology.orchestra.run.smithi046.stdout:generic/503 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-07-05T21:28:41.446 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/503 2023-07-05T21:28:41.447 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/503 2023-07-05T21:28:41.447 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-07-05T21:28:41.448 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T21:28:41.495 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-05T21:28:41.496 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.rlt8E1h3iVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/504) 2023-07-05T21:28:41.874 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph 2023-07-05T21:28:41.879 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-05T21:28:41.880 INFO:teuthology.orchestra.run.smithi046.stdout:MKFS_OPTIONS -- 172.21.15.46:6789:/scratch 2023-07-05T21:28:41.881 INFO:teuthology.orchestra.run.smithi046.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCbvKVkpp1TIhAAvJTELoeH8wkIFqjtppg17w== -o context=system_u:object_r:root_t:s0 172.21.15.46:6789:/scratch /tmp/tmp.KrMG67MsYpscratch 2023-07-05T21:28:41.883 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T21:28:42.451 INFO:teuthology.orchestra.run.smithi046.stdout:generic/504 0s 2023-07-05T21:28:42.458 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/504 2023-07-05T21:28:42.458 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-07-05T21:28:42.467 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T21:28:42.520 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-05T21:28:42.521 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.rlt8E1h3iVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/505) 2023-07-05T21:28:42.865 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph 2023-07-05T21:28:42.869 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-05T21:28:42.870 INFO:teuthology.orchestra.run.smithi046.stdout:MKFS_OPTIONS -- 172.21.15.46:6789:/scratch 2023-07-05T21:28:42.871 INFO:teuthology.orchestra.run.smithi046.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCbvKVkpp1TIhAAvJTELoeH8wkIFqjtppg17w== -o context=system_u:object_r:root_t:s0 172.21.15.46:6789:/scratch /tmp/tmp.KrMG67MsYpscratch 2023-07-05T21:28:42.871 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T21:28:43.659 INFO:teuthology.orchestra.run.smithi046.stdout:generic/505 [not run] ceph does not support shutdown 2023-07-05T21:28:43.691 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/505 2023-07-05T21:28:43.692 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/505 2023-07-05T21:28:43.692 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-07-05T21:28:43.694 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T21:28:43.732 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-05T21:28:43.733 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.rlt8E1h3iVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/506) 2023-07-05T21:28:44.086 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph 2023-07-05T21:28:44.091 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-05T21:28:44.091 INFO:teuthology.orchestra.run.smithi046.stdout:MKFS_OPTIONS -- 172.21.15.46:6789:/scratch 2023-07-05T21:28:44.093 INFO:teuthology.orchestra.run.smithi046.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCbvKVkpp1TIhAAvJTELoeH8wkIFqjtppg17w== -o context=system_u:object_r:root_t:s0 172.21.15.46:6789:/scratch /tmp/tmp.KrMG67MsYpscratch 2023-07-05T21:28:44.093 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T21:28:44.622 INFO:teuthology.orchestra.run.smithi046.stdout:generic/506 [not run] disk quotas not supported by this filesystem type: ceph 2023-07-05T21:28:44.627 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/506 2023-07-05T21:28:44.627 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/506 2023-07-05T21:28:44.627 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-07-05T21:28:44.629 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T21:28:44.657 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-05T21:28:44.658 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.rlt8E1h3iVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/507) 2023-07-05T21:28:44.976 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph 2023-07-05T21:28:44.981 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-05T21:28:44.982 INFO:teuthology.orchestra.run.smithi046.stdout:MKFS_OPTIONS -- 172.21.15.46:6789:/scratch 2023-07-05T21:28:44.985 INFO:teuthology.orchestra.run.smithi046.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCbvKVkpp1TIhAAvJTELoeH8wkIFqjtppg17w== -o context=system_u:object_r:root_t:s0 172.21.15.46:6789:/scratch /tmp/tmp.KrMG67MsYpscratch 2023-07-05T21:28:44.986 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T21:28:45.571 INFO:teuthology.orchestra.run.smithi046.stdout:generic/507 [not run] file system doesn't support chattr +ASai 2023-07-05T21:28:45.577 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/507 2023-07-05T21:28:45.577 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/507 2023-07-05T21:28:45.577 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-07-05T21:28:45.579 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T21:28:45.628 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-05T21:28:45.628 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.rlt8E1h3iVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/508) 2023-07-05T21:28:45.985 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph 2023-07-05T21:28:45.990 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-05T21:28:45.990 INFO:teuthology.orchestra.run.smithi046.stdout:MKFS_OPTIONS -- 172.21.15.46:6789:/scratch 2023-07-05T21:28:45.991 INFO:teuthology.orchestra.run.smithi046.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCbvKVkpp1TIhAAvJTELoeH8wkIFqjtppg17w== -o context=system_u:object_r:root_t:s0 172.21.15.46:6789:/scratch /tmp/tmp.KrMG67MsYpscratch 2023-07-05T21:28:45.992 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T21:28:46.510 INFO:teuthology.orchestra.run.smithi046.stdout:generic/508 [not run] lsattr not supported by test filesystem type: ceph 2023-07-05T21:28:46.521 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/508 2023-07-05T21:28:46.521 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/508 2023-07-05T21:28:46.521 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-07-05T21:28:46.524 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T21:28:46.555 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-05T21:28:46.555 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.rlt8E1h3iVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/509) 2023-07-05T21:28:46.921 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph 2023-07-05T21:28:46.927 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-05T21:28:46.927 INFO:teuthology.orchestra.run.smithi046.stdout:MKFS_OPTIONS -- 172.21.15.46:6789:/scratch 2023-07-05T21:28:46.928 INFO:teuthology.orchestra.run.smithi046.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCbvKVkpp1TIhAAvJTELoeH8wkIFqjtppg17w== -o context=system_u:object_r:root_t:s0 172.21.15.46:6789:/scratch /tmp/tmp.KrMG67MsYpscratch 2023-07-05T21:28:46.928 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T21:28:47.440 INFO:teuthology.orchestra.run.smithi046.stdout:generic/509 [not run] O_TMPFILE is not supported 2023-07-05T21:28:47.444 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/509 2023-07-05T21:28:47.445 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/509 2023-07-05T21:28:47.445 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-07-05T21:28:47.447 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T21:28:47.487 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-05T21:28:47.488 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.rlt8E1h3iVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/510) 2023-07-05T21:28:47.864 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph 2023-07-05T21:28:47.868 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-05T21:28:47.869 INFO:teuthology.orchestra.run.smithi046.stdout:MKFS_OPTIONS -- 172.21.15.46:6789:/scratch 2023-07-05T21:28:47.870 INFO:teuthology.orchestra.run.smithi046.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCbvKVkpp1TIhAAvJTELoeH8wkIFqjtppg17w== -o context=system_u:object_r:root_t:s0 172.21.15.46:6789:/scratch /tmp/tmp.KrMG67MsYpscratch 2023-07-05T21:28:47.870 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T21:28:48.397 INFO:teuthology.orchestra.run.smithi046.stdout:generic/510 [not run] require 172.21.15.46:6789:/scratch to be valid block disk 2023-07-05T21:28:48.408 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/510 2023-07-05T21:28:48.408 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/510 2023-07-05T21:28:48.408 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-07-05T21:28:48.409 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T21:28:48.446 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-05T21:28:48.447 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.rlt8E1h3iVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/511) 2023-07-05T21:28:48.809 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph 2023-07-05T21:28:48.816 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-05T21:28:48.817 INFO:teuthology.orchestra.run.smithi046.stdout:MKFS_OPTIONS -- 172.21.15.46:6789:/scratch 2023-07-05T21:28:48.818 INFO:teuthology.orchestra.run.smithi046.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCbvKVkpp1TIhAAvJTELoeH8wkIFqjtppg17w== -o context=system_u:object_r:root_t:s0 172.21.15.46:6789:/scratch /tmp/tmp.KrMG67MsYpscratch 2023-07-05T21:28:48.818 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T21:28:49.337 INFO:teuthology.orchestra.run.smithi046.stdout:generic/511 [not run] xfs_io falloc -k failed (old kernel/wrong fs?) 2023-07-05T21:28:49.337 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/511 2023-07-05T21:28:49.337 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/511 2023-07-05T21:28:49.338 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-07-05T21:28:49.338 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T21:28:49.386 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-05T21:28:49.386 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.rlt8E1h3iVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/512) 2023-07-05T21:28:49.735 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph 2023-07-05T21:28:49.740 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-05T21:28:49.741 INFO:teuthology.orchestra.run.smithi046.stdout:MKFS_OPTIONS -- 172.21.15.46:6789:/scratch 2023-07-05T21:28:49.741 INFO:teuthology.orchestra.run.smithi046.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCbvKVkpp1TIhAAvJTELoeH8wkIFqjtppg17w== -o context=system_u:object_r:root_t:s0 172.21.15.46:6789:/scratch /tmp/tmp.KrMG67MsYpscratch 2023-07-05T21:28:49.742 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T21:28:50.287 INFO:teuthology.orchestra.run.smithi046.stdout:generic/512 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-07-05T21:28:50.292 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/512 2023-07-05T21:28:50.292 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/512 2023-07-05T21:28:50.292 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-07-05T21:28:50.294 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T21:28:50.349 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-05T21:28:50.349 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.rlt8E1h3iVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/513) 2023-07-05T21:28:50.720 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph 2023-07-05T21:28:50.726 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-05T21:28:50.727 INFO:teuthology.orchestra.run.smithi046.stdout:MKFS_OPTIONS -- 172.21.15.46:6789:/scratch 2023-07-05T21:28:50.732 INFO:teuthology.orchestra.run.smithi046.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCbvKVkpp1TIhAAvJTELoeH8wkIFqjtppg17w== -o context=system_u:object_r:root_t:s0 172.21.15.46:6789:/scratch /tmp/tmp.KrMG67MsYpscratch 2023-07-05T21:28:50.732 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T21:28:51.803 INFO:teuthology.orchestra.run.smithi046.stdout:generic/513 [not run] Reflink not supported by scratch filesystem type: ceph 2023-07-05T21:28:51.810 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/513 2023-07-05T21:28:51.811 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/513 2023-07-05T21:28:51.811 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-07-05T21:28:51.828 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T21:28:52.056 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-05T21:28:52.057 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.rlt8E1h3iVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/514) 2023-07-05T21:28:52.442 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph 2023-07-05T21:28:52.447 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-05T21:28:52.448 INFO:teuthology.orchestra.run.smithi046.stdout:MKFS_OPTIONS -- 172.21.15.46:6789:/scratch 2023-07-05T21:28:52.448 INFO:teuthology.orchestra.run.smithi046.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCbvKVkpp1TIhAAvJTELoeH8wkIFqjtppg17w== -o context=system_u:object_r:root_t:s0 172.21.15.46:6789:/scratch /tmp/tmp.KrMG67MsYpscratch 2023-07-05T21:28:52.449 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T21:28:53.774 INFO:teuthology.orchestra.run.smithi046.stdout:generic/514 [not run] Reflink not supported by scratch filesystem type: ceph 2023-07-05T21:28:53.811 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/514 2023-07-05T21:28:53.811 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/514 2023-07-05T21:28:53.811 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-07-05T21:28:53.817 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T21:28:53.879 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-05T21:28:53.880 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.rlt8E1h3iVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/515) 2023-07-05T21:28:54.240 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph 2023-07-05T21:28:54.245 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-05T21:28:54.245 INFO:teuthology.orchestra.run.smithi046.stdout:MKFS_OPTIONS -- 172.21.15.46:6789:/scratch 2023-07-05T21:28:54.246 INFO:teuthology.orchestra.run.smithi046.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCbvKVkpp1TIhAAvJTELoeH8wkIFqjtppg17w== -o context=system_u:object_r:root_t:s0 172.21.15.46:6789:/scratch /tmp/tmp.KrMG67MsYpscratch 2023-07-05T21:28:54.246 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T21:28:55.462 INFO:teuthology.orchestra.run.smithi046.stdout:generic/515 [not run] Reflink not supported by scratch filesystem type: ceph 2023-07-05T21:28:55.469 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/515 2023-07-05T21:28:55.469 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/515 2023-07-05T21:28:55.469 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-07-05T21:28:55.472 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T21:28:55.541 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-05T21:28:55.542 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.rlt8E1h3iVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/516) 2023-07-05T21:28:55.907 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph 2023-07-05T21:28:55.915 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-05T21:28:55.916 INFO:teuthology.orchestra.run.smithi046.stdout:MKFS_OPTIONS -- 172.21.15.46:6789:/scratch 2023-07-05T21:28:55.917 INFO:teuthology.orchestra.run.smithi046.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCbvKVkpp1TIhAAvJTELoeH8wkIFqjtppg17w== -o context=system_u:object_r:root_t:s0 172.21.15.46:6789:/scratch /tmp/tmp.KrMG67MsYpscratch 2023-07-05T21:28:55.917 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T21:28:56.588 INFO:teuthology.orchestra.run.smithi046.stdout:generic/516 [not run] Dedupe not supported by test filesystem type: ceph 2023-07-05T21:28:56.594 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/516 2023-07-05T21:28:56.594 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/516 2023-07-05T21:28:56.594 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-07-05T21:28:56.596 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T21:28:56.982 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-05T21:28:56.983 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.rlt8E1h3iVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/517) 2023-07-05T21:28:57.325 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph 2023-07-05T21:28:57.330 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-05T21:28:57.331 INFO:teuthology.orchestra.run.smithi046.stdout:MKFS_OPTIONS -- 172.21.15.46:6789:/scratch 2023-07-05T21:28:57.332 INFO:teuthology.orchestra.run.smithi046.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCbvKVkpp1TIhAAvJTELoeH8wkIFqjtppg17w== -o context=system_u:object_r:root_t:s0 172.21.15.46:6789:/scratch /tmp/tmp.KrMG67MsYpscratch 2023-07-05T21:28:57.332 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T21:28:58.181 INFO:teuthology.orchestra.run.smithi046.stdout:generic/517 [not run] Dedupe not supported by scratch filesystem type: ceph 2023-07-05T21:28:58.436 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/517 2023-07-05T21:28:58.437 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/517 2023-07-05T21:28:58.437 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-07-05T21:28:58.484 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T21:28:58.613 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-05T21:28:58.614 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.rlt8E1h3iVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/518) 2023-07-05T21:28:58.937 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph 2023-07-05T21:28:58.946 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-05T21:28:58.946 INFO:teuthology.orchestra.run.smithi046.stdout:MKFS_OPTIONS -- 172.21.15.46:6789:/scratch 2023-07-05T21:28:58.947 INFO:teuthology.orchestra.run.smithi046.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCbvKVkpp1TIhAAvJTELoeH8wkIFqjtppg17w== -o context=system_u:object_r:root_t:s0 172.21.15.46:6789:/scratch /tmp/tmp.KrMG67MsYpscratch 2023-07-05T21:28:58.947 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T21:28:59.996 INFO:teuthology.orchestra.run.smithi046.stdout:generic/518 [not run] Reflink not supported by scratch filesystem type: ceph 2023-07-05T21:29:00.002 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/518 2023-07-05T21:29:00.003 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/518 2023-07-05T21:29:00.003 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-07-05T21:29:00.024 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T21:29:00.310 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-05T21:29:00.311 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.rlt8E1h3iVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/519) 2023-07-05T21:29:00.704 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph 2023-07-05T21:29:00.711 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-05T21:29:00.712 INFO:teuthology.orchestra.run.smithi046.stdout:MKFS_OPTIONS -- 172.21.15.46:6789:/scratch 2023-07-05T21:29:00.713 INFO:teuthology.orchestra.run.smithi046.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCbvKVkpp1TIhAAvJTELoeH8wkIFqjtppg17w== -o context=system_u:object_r:root_t:s0 172.21.15.46:6789:/scratch /tmp/tmp.KrMG67MsYpscratch 2023-07-05T21:29:00.713 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T21:29:01.295 INFO:teuthology.orchestra.run.smithi046.stdout:generic/519 [not run] FIBMAP not supported by this filesystem 2023-07-05T21:29:01.301 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/519 2023-07-05T21:29:01.301 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/519 2023-07-05T21:29:01.301 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-07-05T21:29:01.304 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T21:29:01.697 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-05T21:29:01.698 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.rlt8E1h3iVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/520) 2023-07-05T21:29:02.112 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph 2023-07-05T21:29:02.119 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-05T21:29:02.119 INFO:teuthology.orchestra.run.smithi046.stdout:MKFS_OPTIONS -- 172.21.15.46:6789:/scratch 2023-07-05T21:29:02.120 INFO:teuthology.orchestra.run.smithi046.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCbvKVkpp1TIhAAvJTELoeH8wkIFqjtppg17w== -o context=system_u:object_r:root_t:s0 172.21.15.46:6789:/scratch /tmp/tmp.KrMG67MsYpscratch 2023-07-05T21:29:02.120 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T21:29:02.670 INFO:teuthology.orchestra.run.smithi046.stdout:generic/520 [not run] require 172.21.15.46:6789:/scratch to be valid block disk 2023-07-05T21:29:02.676 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/520 2023-07-05T21:29:02.676 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/520 2023-07-05T21:29:02.676 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-07-05T21:29:02.679 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T21:29:02.703 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-05T21:29:02.704 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.rlt8E1h3iVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/521) 2023-07-05T21:29:03.053 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph 2023-07-05T21:29:03.057 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-05T21:29:03.058 INFO:teuthology.orchestra.run.smithi046.stdout:MKFS_OPTIONS -- 172.21.15.46:6789:/scratch 2023-07-05T21:29:03.062 INFO:teuthology.orchestra.run.smithi046.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCbvKVkpp1TIhAAvJTELoeH8wkIFqjtppg17w== -o context=system_u:object_r:root_t:s0 172.21.15.46:6789:/scratch /tmp/tmp.KrMG67MsYpscratch 2023-07-05T21:29:03.062 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T21:29:08.378 INFO:tasks.ceph.osd.4.smithi073.stderr:2023-07-05T21:29:08.375+0000 7fb7867e9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 119193) UID: 0 2023-07-05T21:29:08.379 INFO:tasks.ceph.osd.7.smithi073.stderr:2023-07-05T21:29:08.375+0000 7fe6067a5700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 119193) UID: 0 2023-07-05T21:29:08.379 INFO:tasks.ceph.osd.5.smithi073.stderr:2023-07-05T21:29:08.375+0000 7f1dead60700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 119193) UID: 0 2023-07-05T21:29:08.380 INFO:tasks.ceph.osd.6.smithi073.stderr:2023-07-05T21:29:08.375+0000 7f2582084700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 119193) UID: 0 2023-07-05T21:35:20.549 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-05T21:35:20.552 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-05T21:35:20.709 INFO:tasks.ceph.osd.6.smithi073.stderr:2023-07-05T21:35:20.707+0000 7f2582084700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 119284) UID: 0 2023-07-05T21:35:20.709 INFO:tasks.ceph.osd.4.smithi073.stderr:2023-07-05T21:35:20.707+0000 7fb7867e9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 119284) UID: 0 2023-07-05T21:35:20.711 INFO:tasks.ceph.osd.5.smithi073.stderr:2023-07-05T21:35:20.708+0000 7f1dead60700 -1 Fail to open '/proc/119284/cmdline' error = (2) No such file or directory 2023-07-05T21:35:20.711 INFO:tasks.ceph.osd.5.smithi073.stderr:2023-07-05T21:35:20.708+0000 7f1dead60700 -1 received signal: Hangup from (PID: 119284) UID: 0 2023-07-05T21:35:20.713 INFO:tasks.ceph.osd.7.smithi073.stderr:2023-07-05T21:35:20.712+0000 7fe6067a5700 -1 Fail to open '/proc/119284/cmdline' error = (2) No such file or directory 2023-07-05T21:35:20.714 INFO:tasks.ceph.osd.7.smithi073.stderr:2023-07-05T21:35:20.712+0000 7fe6067a5700 -1 received signal: Hangup from (PID: 119284) UID: 0 2023-07-05T21:38:20.641 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-05T21:38:20.645 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-05T21:38:50.723 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-05T21:38:50.727 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-05T21:39:20.826 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-05T21:39:20.829 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-05T21:39:50.899 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-05T21:39:50.902 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-05T21:40:20.996 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-05T21:40:20.999 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-05T21:40:51.143 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-05T21:40:51.145 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-05T21:41:21.275 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-05T21:41:21.277 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-05T21:41:51.365 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-05T21:41:51.368 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-05T21:41:51.414 INFO:tasks.ceph.osd.2.smithi046.stderr:2023-07-05T21:41:51.412+0000 7f5a7ef99700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 640736) UID: 0 2023-07-05T21:41:51.415 INFO:tasks.ceph.osd.0.smithi046.stderr:2023-07-05T21:41:51.412+0000 7f77d1dc1700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 640736) UID: 0 2023-07-05T21:41:51.416 INFO:tasks.ceph.osd.1.smithi046.stderr:2023-07-05T21:41:51.414+0000 7f2fc7c11700 -1 Fail to open '/proc/640736/cmdline' error = (2) No such file or directory 2023-07-05T21:41:51.416 INFO:tasks.ceph.osd.1.smithi046.stderr:2023-07-05T21:41:51.414+0000 7f2fc7c11700 -1 received signal: Hangup from (PID: 640736) UID: 0 2023-07-05T21:41:51.416 INFO:tasks.ceph.osd.3.smithi046.stderr:2023-07-05T21:41:51.412+0000 7f1104079700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 640736) UID: 0 2023-07-05T21:44:43.697 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-05T21:44:43.699 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-05T21:45:14.112 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-05T21:45:14.115 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-05T21:45:44.184 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-05T21:45:44.186 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-05T21:46:14.294 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-05T21:46:14.297 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-05T21:46:44.372 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-05T21:46:44.375 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-05T21:47:14.521 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-05T21:47:14.524 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-05T21:47:44.724 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-05T21:47:44.727 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-05T21:48:14.801 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-05T21:48:14.803 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-05T21:48:44.881 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-05T21:48:44.884 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-05T21:49:15.248 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-05T21:49:15.251 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-05T21:49:45.331 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-05T21:49:45.334 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-05T21:50:15.412 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-05T21:50:15.414 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-05T21:50:45.513 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-05T21:50:45.515 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-05T21:51:15.616 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-05T21:51:15.619 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-05T21:51:45.796 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-05T21:51:45.799 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-05T21:52:15.865 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-05T21:52:15.868 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-05T21:52:46.106 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-05T21:52:46.109 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-05T21:53:16.217 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-05T21:53:16.219 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-05T21:53:46.452 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-05T21:53:46.456 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-05T21:54:16.544 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-05T21:54:16.548 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-05T21:54:46.618 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-05T21:54:46.620 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-05T21:55:16.706 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-05T21:55:16.708 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-05T21:55:46.803 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-05T21:55:46.827 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-05T21:56:16.918 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-05T21:56:16.921 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-05T21:56:47.118 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-05T21:56:47.121 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-05T21:57:17.237 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-05T21:57:17.243 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-05T21:57:47.351 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-05T21:57:47.355 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-05T21:58:17.447 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-05T21:58:17.450 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-05T21:58:47.706 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-05T21:58:47.709 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-05T21:59:17.784 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-05T21:59:17.786 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-05T21:59:47.982 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-05T21:59:47.985 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-05T22:00:18.075 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-05T22:00:18.078 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-05T22:00:48.178 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-05T22:00:48.180 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-05T22:01:18.291 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-05T22:01:18.293 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-05T22:01:48.439 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-05T22:01:48.441 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-05T22:01:48.512 INFO:tasks.ceph.osd.0.smithi046.stderr:2023-07-05T22:01:48.510+0000 7f77d1dc1700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 641663) UID: 0 2023-07-05T22:01:48.512 INFO:tasks.ceph.osd.1.smithi046.stderr:2023-07-05T22:01:48.510+0000 7f2fc7c11700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 641663) UID: 0 2023-07-05T22:01:48.513 INFO:tasks.ceph.osd.2.smithi046.stderr:2023-07-05T22:01:48.510+0000 7f5a7ef99700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 641663) UID: 0 2023-07-05T22:01:48.513 INFO:tasks.ceph.osd.3.smithi046.stderr:2023-07-05T22:01:48.511+0000 7f1104079700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 641663) UID: 0 2023-07-05T22:04:41.306 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-05T22:04:41.309 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-05T22:05:11.594 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-05T22:05:11.596 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-05T22:05:41.680 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-05T22:05:41.684 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-05T22:06:11.772 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-05T22:06:11.775 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-05T22:06:42.068 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-05T22:06:42.072 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-05T22:07:12.157 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-05T22:07:12.160 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-05T22:07:42.229 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-05T22:07:42.232 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-05T22:08:12.327 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-05T22:08:12.331 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-05T22:08:42.423 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-05T22:08:42.426 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-05T22:09:12.509 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-05T22:09:12.511 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-05T22:09:12.597 INFO:tasks.ceph.osd.6.smithi073.stderr:2023-07-05T22:09:12.595+0000 7f2582084700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 120704) UID: 0 2023-07-05T22:09:12.599 INFO:tasks.ceph.osd.4.smithi073.stderr:2023-07-05T22:09:12.594+0000 7fb7867e9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 120704) UID: 0 2023-07-05T22:09:12.601 INFO:tasks.ceph.osd.7.smithi073.stderr:2023-07-05T22:09:12.595+0000 7fe6067a5700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 120704) UID: 0 2023-07-05T22:09:12.602 INFO:tasks.ceph.osd.5.smithi073.stderr:2023-07-05T22:09:12.595+0000 7f1dead60700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 120704) UID: 0 2023-07-05T22:12:12.877 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-05T22:12:12.880 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-05T22:12:42.981 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-05T22:12:42.984 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-05T22:13:13.088 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-05T22:13:13.090 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-05T22:13:43.234 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-05T22:13:43.236 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-05T22:14:13.602 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-05T22:14:13.604 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-05T22:14:43.670 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-05T22:14:43.673 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-05T22:15:13.787 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-05T22:15:13.789 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-05T22:15:43.866 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-05T22:15:43.868 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-05T22:15:43.919 INFO:tasks.ceph.osd.5.smithi073.stderr:2023-07-05T22:15:43.916+0000 7f1dead60700 -1 received signal: Hangup from (PID: 120938) UID: 0 2023-07-05T22:15:43.919 INFO:tasks.ceph.osd.7.smithi073.stderr:2023-07-05T22:15:43.916+0000 7fe6067a5700 -1 received signal: Hangup from (PID: 120938) UID: 0 2023-07-05T22:15:43.920 INFO:tasks.ceph.osd.6.smithi073.stderr:2023-07-05T22:15:43.916+0000 7f2582084700 -1 received signal: Hangup from (PID: 120938) UID: 0 2023-07-05T22:15:43.920 INFO:tasks.ceph.osd.4.smithi073.stderr:2023-07-05T22:15:43.915+0000 7fb7867e9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 120938) UID: 0 2023-07-05T22:18:42.622 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-05T22:18:42.624 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-05T22:19:12.719 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-05T22:19:12.721 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-05T22:19:42.841 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-05T22:19:42.844 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-05T22:20:12.931 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-05T22:20:12.934 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-05T22:20:43.026 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-05T22:20:43.029 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-05T22:21:13.145 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-05T22:21:13.148 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-05T22:21:43.296 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-05T22:21:43.298 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-05T22:22:13.395 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-05T22:22:13.404 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-05T22:22:13.446 INFO:tasks.ceph.osd.4.smithi073.stderr:2023-07-05T22:22:13.444+0000 7fb7867e9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 121165) UID: 0 2023-07-05T22:22:13.447 INFO:tasks.ceph.osd.6.smithi073.stderr:2023-07-05T22:22:13.444+0000 7f2582084700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 121165) UID: 0 2023-07-05T22:22:13.447 INFO:tasks.ceph.osd.7.smithi073.stderr:2023-07-05T22:22:13.444+0000 7fe6067a5700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 121165) UID: 0 2023-07-05T22:22:13.447 INFO:tasks.ceph.osd.5.smithi073.stderr:2023-07-05T22:22:13.445+0000 7f1dead60700 -1 Fail to open '/proc/121165/cmdline' error = (2) No such file or directory 2023-07-05T22:22:13.448 INFO:tasks.ceph.osd.5.smithi073.stderr:2023-07-05T22:22:13.445+0000 7f1dead60700 -1 received signal: Hangup from (PID: 121165) UID: 0 2023-07-05T22:25:16.017 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-05T22:25:16.020 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-05T22:25:16.084 INFO:tasks.ceph.mds.b.smithi073.stderr:2023-07-05T22:25:16.082+0000 7f1ff165c700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 121222) UID: 0 2023-07-05T22:25:16.084 INFO:tasks.ceph.mds.d.smithi073.stderr:2023-07-05T22:25:16.083+0000 7f07b5126700 -1 Fail to open '/proc/121222/cmdline' error = (2) No such file or directory 2023-07-05T22:25:16.084 INFO:tasks.ceph.mds.d.smithi073.stderr:2023-07-05T22:25:16.083+0000 7f07b5126700 -1 received signal: Hangup from (PID: 121222) UID: 0 2023-07-05T22:25:16.105 INFO:tasks.ceph.osd.2.smithi046.stderr:2023-07-05T22:25:16.104+0000 7f5a7ef99700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 642436) UID: 0 2023-07-05T22:25:16.106 INFO:tasks.ceph.osd.0.smithi046.stderr:2023-07-05T22:25:16.104+0000 7f77d1dc1700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 642436) UID: 0 2023-07-05T22:25:16.106 INFO:tasks.ceph.osd.3.smithi046.stderr:2023-07-05T22:25:16.104+0000 7f1104079700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 642436) UID: 0 2023-07-05T22:25:16.110 INFO:tasks.ceph.osd.1.smithi046.stderr:2023-07-05T22:25:16.109+0000 7f2fc7c11700 -1 Fail to open '/proc/642436/cmdline' error = (2) No such file or directory 2023-07-05T22:25:16.110 INFO:tasks.ceph.osd.1.smithi046.stderr:2023-07-05T22:25:16.109+0000 7f2fc7c11700 -1 received signal: Hangup from (PID: 642436) UID: 0 2023-07-05T22:28:27.261 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-05T22:28:27.265 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-05T22:28:57.352 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-05T22:28:57.355 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-05T22:29:27.455 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-05T22:29:27.458 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-05T22:29:57.570 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-05T22:29:57.573 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-05T22:30:27.675 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-05T22:30:27.678 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-05T22:30:57.803 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-05T22:30:57.805 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-05T22:31:27.922 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-05T22:31:27.925 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-05T22:31:58.007 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-05T22:31:58.009 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-05T22:31:58.076 INFO:tasks.ceph.osd.4.smithi073.stderr:2023-07-05T22:31:58.074+0000 7fb7867e9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 121448) UID: 0 2023-07-05T22:31:58.076 INFO:tasks.ceph.osd.6.smithi073.stderr:2023-07-05T22:31:58.074+0000 7f2582084700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 121448) UID: 0 2023-07-05T22:31:58.077 INFO:tasks.ceph.osd.7.smithi073.stderr:2023-07-05T22:31:58.074+0000 7fe6067a5700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 121448) UID: 0 2023-07-05T22:31:58.078 INFO:tasks.ceph.osd.5.smithi073.stderr:2023-07-05T22:31:58.074+0000 7f1dead60700 -1 Fail to open '/proc/121448/cmdline' error = (2) No such file or directory 2023-07-05T22:31:58.078 INFO:tasks.ceph.osd.5.smithi073.stderr:2023-07-05T22:31:58.074+0000 7f1dead60700 -1 received signal: Hangup from (PID: 121448) UID: 0 2023-07-05T22:35:04.158 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-05T22:35:04.161 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-05T22:35:04.208 INFO:tasks.ceph.osd.2.smithi046.stderr:2023-07-05T22:35:04.206+0000 7f5a7ef99700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 642714) UID: 0 2023-07-05T22:35:04.209 INFO:tasks.ceph.osd.0.smithi046.stderr:2023-07-05T22:35:04.206+0000 7f77d1dc1700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 642714) UID: 0 2023-07-05T22:35:04.209 INFO:tasks.ceph.osd.1.smithi046.stderr:2023-07-05T22:35:04.206+0000 7f2fc7c11700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 642714) UID: 0 2023-07-05T22:35:04.209 INFO:tasks.ceph.osd.3.smithi046.stderr:2023-07-05T22:35:04.206+0000 7f1104079700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 642714) UID: 0 2023-07-05T22:37:59.965 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-05T22:37:59.968 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-05T22:38:00.061 INFO:tasks.ceph.osd.2.smithi046.stderr:2023-07-05T22:38:00.059+0000 7f5a7ef99700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 642765) UID: 0 2023-07-05T22:38:00.062 INFO:tasks.ceph.osd.0.smithi046.stderr:2023-07-05T22:38:00.059+0000 7f77d1dc1700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 642765) UID: 0 2023-07-05T22:38:00.063 INFO:tasks.ceph.osd.1.smithi046.stderr:2023-07-05T22:38:00.061+0000 7f2fc7c11700 -1 Fail to open '/proc/642765/cmdline' error = (2) No such file or directory 2023-07-05T22:38:00.063 INFO:tasks.ceph.osd.1.smithi046.stderr:2023-07-05T22:38:00.061+0000 7f2fc7c11700 -1 received signal: Hangup from (PID: 642765) UID: 0 2023-07-05T22:38:00.063 INFO:tasks.ceph.osd.3.smithi046.stderr:2023-07-05T22:38:00.061+0000 7f1104079700 -1 Fail to open '/proc/642765/cmdline' error = (2) No such file or directory 2023-07-05T22:38:00.063 INFO:tasks.ceph.osd.3.smithi046.stderr:2023-07-05T22:38:00.061+0000 7f1104079700 -1 received signal: Hangup from (PID: 642765) UID: 0 2023-07-05T22:40:57.193 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-05T22:40:57.196 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-05T22:41:27.527 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-05T22:41:27.529 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-05T22:41:57.626 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-05T22:41:57.629 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-05T22:42:27.714 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-05T22:42:27.716 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-05T22:42:58.026 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-05T22:42:58.035 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-05T22:43:28.376 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-05T22:43:28.379 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-05T22:43:58.481 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-05T22:43:58.484 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-05T22:43:58.539 INFO:tasks.ceph.osd.4.smithi073.stderr:2023-07-05T22:43:58.537+0000 7fb7867e9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 121747) UID: 0 2023-07-05T22:43:58.539 INFO:tasks.ceph.osd.7.smithi073.stderr:2023-07-05T22:43:58.537+0000 7fe6067a5700 -1 Fail to open '/proc/121747/cmdline' error = (2) No such file or directory 2023-07-05T22:43:58.541 INFO:tasks.ceph.osd.7.smithi073.stderr:2023-07-05T22:43:58.537+0000 7fe6067a5700 -1 received signal: Hangup from (PID: 121747) UID: 0 2023-07-05T22:43:58.541 INFO:tasks.ceph.osd.5.smithi073.stderr:2023-07-05T22:43:58.536+0000 7f1dead60700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 121747) UID: 0 2023-07-05T22:43:58.542 INFO:tasks.ceph.osd.6.smithi073.stderr:2023-07-05T22:43:58.538+0000 7f2582084700 -1 Fail to open '/proc/121747/cmdline' error = (2) No such file or directory 2023-07-05T22:43:58.542 INFO:tasks.ceph.osd.6.smithi073.stderr:2023-07-05T22:43:58.538+0000 7f2582084700 -1 received signal: Hangup from (PID: 121747) UID: 0 2023-07-05T22:46:57.570 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-05T22:46:57.573 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-05T22:47:27.661 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-05T22:47:27.664 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-05T22:47:57.772 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-05T22:47:57.777 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-05T22:48:28.146 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-05T22:48:28.148 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-05T22:48:58.225 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-05T22:48:58.228 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-05T22:49:28.696 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-05T22:49:28.700 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-05T22:49:58.787 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-05T22:49:58.794 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-05T22:50:29.232 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-05T22:50:29.235 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-05T22:50:59.309 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-05T22:50:59.312 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-05T22:51:29.398 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-05T22:51:29.400 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-05T22:51:59.777 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-05T22:51:59.780 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-05T22:52:29.853 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-05T22:52:29.856 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-05T22:52:59.991 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-05T22:52:59.994 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-05T22:53:30.110 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-05T22:53:30.113 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-05T22:54:00.210 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-05T22:54:00.213 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-05T22:54:30.313 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-05T22:54:30.315 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-05T22:55:00.436 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-05T22:55:00.461 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-05T22:55:30.562 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-05T22:55:30.564 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-05T22:56:00.881 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-05T22:56:00.883 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-05T22:56:30.996 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-05T22:56:30.998 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-05T22:57:01.288 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-05T22:57:01.291 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-05T22:57:31.591 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-05T22:57:31.593 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-05T22:58:01.673 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-05T22:58:01.675 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-05T22:58:31.806 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-05T22:58:31.808 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-05T22:59:01.922 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-05T22:59:01.924 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-05T22:59:32.230 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-05T22:59:32.234 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-05T23:00:02.329 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-05T23:00:02.331 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-05T23:00:32.439 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-05T23:00:32.442 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-05T23:01:02.541 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-05T23:01:02.545 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-05T23:01:32.654 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-05T23:01:32.657 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-05T23:02:03.004 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-05T23:02:03.006 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-05T23:02:33.202 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-05T23:02:33.204 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-05T23:03:03.307 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-05T23:03:03.310 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-05T23:03:03.414 INFO:tasks.ceph.osd.6.smithi073.stderr:2023-07-05T23:03:03.413+0000 7f2582084700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 122624) UID: 0 2023-07-05T23:03:03.415 INFO:tasks.ceph.osd.7.smithi073.stderr:2023-07-05T23:03:03.413+0000 7fe6067a5700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 122624) UID: 0 2023-07-05T23:03:03.416 INFO:tasks.ceph.osd.5.smithi073.stderr:2023-07-05T23:03:03.412+0000 7f1dead60700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 122624) UID: 0 2023-07-05T23:03:03.417 INFO:tasks.ceph.osd.4.smithi073.stderr:2023-07-05T23:03:03.413+0000 7fb7867e9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 122624) UID: 0 2023-07-05T23:06:00.303 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-05T23:06:00.310 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-05T23:06:30.429 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-05T23:06:30.436 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-05T23:07:00.867 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-05T23:07:00.870 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-05T23:07:30.946 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-05T23:07:30.955 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-05T23:07:31.011 INFO:tasks.ceph.osd.1.smithi046.stderr:2023-07-05T23:07:31.009+0000 7f2fc7c11700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 644160) UID: 0 2023-07-05T23:07:31.013 INFO:tasks.ceph.osd.2.smithi046.stderr:2023-07-05T23:07:31.009+0000 7f5a7ef99700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 644160) UID: 0 2023-07-05T23:07:31.014 INFO:tasks.ceph.osd.0.smithi046.stderr:2023-07-05T23:07:31.009+0000 7f77d1dc1700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 644160) UID: 0 2023-07-05T23:07:31.016 INFO:tasks.ceph.osd.3.smithi046.stderr:2023-07-05T23:07:31.009+0000 7f1104079700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 644160) UID: 0 2023-07-05T23:10:24.852 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-05T23:10:24.856 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-05T23:10:55.100 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-05T23:10:55.102 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-05T23:11:25.188 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-05T23:11:25.204 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-05T23:11:55.371 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-05T23:11:55.374 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-05T23:12:25.497 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-05T23:12:25.500 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-05T23:12:55.784 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-05T23:12:55.787 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-05T23:13:25.872 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-05T23:13:25.874 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-05T23:13:55.944 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-05T23:13:55.947 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-05T23:14:26.064 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-05T23:14:26.067 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-05T23:14:56.161 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-05T23:14:56.164 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-05T23:15:26.268 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-05T23:15:26.270 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-05T23:15:56.368 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-05T23:15:56.370 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-05T23:16:26.466 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-05T23:16:26.468 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-05T23:16:56.597 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-05T23:16:56.600 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-05T23:17:26.686 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-05T23:17:26.693 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-05T23:17:37.604 INFO:teuthology.orchestra.run.smithi046.stdout:generic/521 6514s 2023-07-05T23:17:37.629 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/521 2023-07-05T23:17:37.629 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-07-05T23:17:37.632 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T23:17:37.878 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-05T23:17:37.879 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.rlt8E1h3iVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/522) 2023-07-05T23:17:38.604 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph 2023-07-05T23:17:38.609 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-05T23:17:38.610 INFO:teuthology.orchestra.run.smithi046.stdout:MKFS_OPTIONS -- 172.21.15.46:6789:/scratch 2023-07-05T23:17:38.611 INFO:teuthology.orchestra.run.smithi046.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCbvKVkpp1TIhAAvJTELoeH8wkIFqjtppg17w== -o context=system_u:object_r:root_t:s0 172.21.15.46:6789:/scratch /tmp/tmp.KrMG67MsYpscratch 2023-07-05T23:17:38.611 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-05T23:17:56.816 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-05T23:17:56.818 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-05T23:17:56.869 INFO:tasks.ceph.osd.4.smithi073.stderr:2023-07-05T23:17:56.867+0000 7fb7867e9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 123178) UID: 0 2023-07-05T23:17:56.870 INFO:tasks.ceph.osd.6.smithi073.stderr:2023-07-05T23:17:56.867+0000 7f2582084700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 123178) UID: 0 2023-07-05T23:17:56.870 INFO:tasks.ceph.osd.7.smithi073.stderr:2023-07-05T23:17:56.867+0000 7fe6067a5700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 123178) UID: 0 2023-07-05T23:17:56.875 INFO:tasks.ceph.osd.5.smithi073.stderr:2023-07-05T23:17:56.868+0000 7f1dead60700 -1 received signal: Hangup from (PID: 123178) UID: 0 2023-07-05T23:20:57.789 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-05T23:20:57.792 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-05T23:21:27.880 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-05T23:21:27.883 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-05T23:21:58.433 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-05T23:21:58.436 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-05T23:22:28.514 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-05T23:22:28.522 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-05T23:22:58.619 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-05T23:22:58.624 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-05T23:23:28.722 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-05T23:23:28.724 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-05T23:23:58.824 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-05T23:23:58.828 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-05T23:24:28.899 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-05T23:24:28.901 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-05T23:24:59.005 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-05T23:24:59.009 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-05T23:25:29.413 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-05T23:25:29.415 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-05T23:25:59.859 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-05T23:25:59.861 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-05T23:26:29.928 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-05T23:26:29.936 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-05T23:27:00.117 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-05T23:27:00.121 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-05T23:27:30.209 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-05T23:27:30.214 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-05T23:27:30.272 INFO:tasks.ceph.osd.0.smithi046.stderr:2023-07-05T23:27:30.269+0000 7f77d1dc1700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 645469) UID: 0 2023-07-05T23:27:30.273 INFO:tasks.ceph.osd.2.smithi046.stderr:2023-07-05T23:27:30.269+0000 7f5a7ef99700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 645469) UID: 0 2023-07-05T23:27:30.273 INFO:tasks.ceph.osd.3.smithi046.stderr:2023-07-05T23:27:30.269+0000 7f1104079700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 645469) UID: 0 2023-07-05T23:27:30.274 INFO:tasks.ceph.osd.1.smithi046.stderr:2023-07-05T23:27:30.270+0000 7f2fc7c11700 -1 Fail to open '/proc/645469/cmdline' error = (2) No such file or directory 2023-07-05T23:27:30.274 INFO:tasks.ceph.osd.1.smithi046.stderr:2023-07-05T23:27:30.270+0000 7f2fc7c11700 -1 received signal: Hangup from (PID: 645469) UID: 0 2023-07-05T23:30:20.596 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-05T23:30:20.599 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-05T23:30:20.657 INFO:tasks.ceph.osd.2.smithi046.stderr:2023-07-05T23:30:20.654+0000 7f5a7ef99700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 645522) UID: 0 2023-07-05T23:30:20.657 INFO:tasks.ceph.osd.1.smithi046.stderr:2023-07-05T23:30:20.654+0000 7f2fc7c11700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 645522) UID: 0 2023-07-05T23:30:20.657 INFO:tasks.ceph.osd.0.smithi046.stderr:2023-07-05T23:30:20.654+0000 7f77d1dc1700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 645522) UID: 0 2023-07-05T23:30:20.658 INFO:tasks.ceph.osd.3.smithi046.stderr:2023-07-05T23:30:20.654+0000 7f1104079700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 645522) UID: 0 2023-07-05T23:33:15.557 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-05T23:33:15.559 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-05T23:33:15.656 INFO:tasks.ceph.osd.4.smithi073.stderr:2023-07-05T23:33:15.653+0000 7fb7867e9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 123660) UID: 0 2023-07-05T23:33:15.656 INFO:tasks.ceph.osd.6.smithi073.stderr:2023-07-05T23:33:15.653+0000 7f2582084700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 123660) UID: 0 2023-07-05T23:33:15.657 INFO:tasks.ceph.osd.7.smithi073.stderr:2023-07-05T23:33:15.654+0000 7fe6067a5700 -1 received signal: Hangup from (PID: 123660) UID: 0 2023-07-05T23:33:15.658 INFO:tasks.ceph.osd.5.smithi073.stderr:2023-07-05T23:33:15.656+0000 7f1dead60700 -1 Fail to open '/proc/123660/cmdline' error = (2) No such file or directory 2023-07-05T23:33:15.659 INFO:tasks.ceph.osd.5.smithi073.stderr:2023-07-05T23:33:15.656+0000 7f1dead60700 -1 received signal: Hangup from (PID: 123660) UID: 0 2023-07-05T23:36:20.696 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-05T23:36:20.698 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-05T23:36:20.754 INFO:tasks.ceph.osd.4.smithi073.stderr:2023-07-05T23:36:20.752+0000 7fb7867e9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 123708) UID: 0 2023-07-05T23:36:20.755 INFO:tasks.ceph.osd.6.smithi073.stderr:2023-07-05T23:36:20.752+0000 7f2582084700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 123708) UID: 0 2023-07-05T23:36:20.755 INFO:tasks.ceph.osd.5.smithi073.stderr:2023-07-05T23:36:20.753+0000 7f1dead60700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 123708) UID: 0 2023-07-05T23:36:20.756 INFO:tasks.ceph.osd.7.smithi073.stderr:2023-07-05T23:36:20.753+0000 7fe6067a5700 -1 Fail to open '/proc/123708/cmdline' error = (2) No such file or directory 2023-07-05T23:36:20.756 INFO:tasks.ceph.osd.7.smithi073.stderr:2023-07-05T23:36:20.753+0000 7fe6067a5700 -1 received signal: Hangup from (PID: 123708) UID: 0 2023-07-05T23:39:24.188 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-05T23:39:24.191 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-05T23:39:54.302 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-05T23:39:54.304 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-05T23:40:24.692 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-05T23:40:24.695 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-05T23:40:54.807 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-05T23:40:54.812 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-05T23:40:54.870 INFO:tasks.ceph.osd.4.smithi073.stderr:2023-07-05T23:40:54.867+0000 7fb7867e9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 123833) UID: 0 2023-07-05T23:40:54.870 INFO:tasks.ceph.osd.6.smithi073.stderr:2023-07-05T23:40:54.867+0000 7f2582084700 -1 Fail to open '/proc/123833/cmdline' error = (2) No such file or directory 2023-07-05T23:40:54.871 INFO:tasks.ceph.osd.6.smithi073.stderr:2023-07-05T23:40:54.867+0000 7f2582084700 -1 received signal: Hangup from (PID: 123833) UID: 0 2023-07-05T23:40:54.872 INFO:tasks.ceph.osd.5.smithi073.stderr:2023-07-05T23:40:54.869+0000 7f1dead60700 -1 Fail to open '/proc/123833/cmdline' error = (2) No such file or directory 2023-07-05T23:40:54.872 INFO:tasks.ceph.osd.5.smithi073.stderr:2023-07-05T23:40:54.869+0000 7f1dead60700 -1 received signal: Hangup from (PID: 123833) UID: 0 2023-07-05T23:40:54.875 INFO:tasks.ceph.osd.7.smithi073.stderr:2023-07-05T23:40:54.869+0000 7fe6067a5700 -1 Fail to open '/proc/123833/cmdline' error = (2) No such file or directory 2023-07-05T23:40:54.876 INFO:tasks.ceph.osd.7.smithi073.stderr:2023-07-05T23:40:54.869+0000 7fe6067a5700 -1 received signal: Hangup from (PID: 123833) UID: 0 2023-07-05T23:43:54.674 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-05T23:43:54.678 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-05T23:44:24.765 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-05T23:44:24.768 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-05T23:44:54.867 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-05T23:44:54.870 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-05T23:45:24.973 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-05T23:45:24.976 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-05T23:45:55.104 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-05T23:45:55.107 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-05T23:46:25.187 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-05T23:46:25.190 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-05T23:46:55.426 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-05T23:46:55.432 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-05T23:47:25.572 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-05T23:47:25.578 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-05T23:47:55.808 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-05T23:47:55.810 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-05T23:48:25.908 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-05T23:48:25.911 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-05T23:48:56.082 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-05T23:48:56.084 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-05T23:48:56.145 INFO:tasks.ceph.mds.d.smithi073.stderr:2023-07-05T23:48:56.142+0000 7f07b5126700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 124134) UID: 0 2023-07-05T23:48:56.145 INFO:tasks.ceph.mds.b.smithi073.stderr:2023-07-05T23:48:56.142+0000 7f1ff165c700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 124134) UID: 0 2023-07-05T23:52:06.870 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-05T23:52:06.874 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-05T23:52:36.969 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-05T23:52:36.973 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-05T23:53:07.051 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-05T23:53:07.054 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-05T23:53:07.139 INFO:tasks.ceph.osd.2.smithi046.stderr:2023-07-05T23:53:07.127+0000 7f5a7ef99700 -1 received signal: Hangup from (PID: 646150) UID: 0 2023-07-05T23:53:07.139 INFO:tasks.ceph.osd.3.smithi046.stderr:2023-07-05T23:53:07.126+0000 7f1104079700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 646150) UID: 0 2023-07-05T23:53:07.139 INFO:tasks.ceph.osd.0.smithi046.stderr:2023-07-05T23:53:07.127+0000 7f77d1dc1700 -1 received signal: Hangup from (PID: 646150) UID: 0 2023-07-05T23:53:07.140 INFO:tasks.ceph.osd.1.smithi046.stderr:2023-07-05T23:53:07.126+0000 7f2fc7c11700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 646150) UID: 0 2023-07-05T23:56:08.920 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-05T23:56:08.923 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-05T23:56:39.089 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-05T23:56:39.092 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-05T23:57:09.175 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-05T23:57:09.183 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-05T23:57:39.668 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-05T23:57:39.672 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-05T23:58:09.763 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-05T23:58:09.767 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-05T23:58:40.123 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-05T23:58:40.126 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-05T23:59:10.227 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-05T23:59:10.230 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-05T23:59:40.330 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-05T23:59:40.332 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-06T00:00:10.405 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-06T00:00:10.408 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-06T00:00:40.495 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-06T00:00:40.500 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-06T00:01:10.600 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-06T00:01:10.607 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-06T00:01:40.765 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-06T00:01:40.768 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-06T00:02:11.067 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-06T00:02:11.070 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-06T00:02:41.184 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-06T00:02:41.186 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-06T00:03:11.343 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-06T00:03:11.346 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-06T00:03:41.471 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-06T00:03:41.476 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-06T00:04:11.808 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-06T00:04:11.811 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-06T00:04:41.898 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-06T00:04:41.900 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-06T00:05:12.021 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-06T00:05:12.025 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-06T00:05:12.084 INFO:tasks.ceph.osd.7.smithi073.stderr:2023-07-06T00:05:12.082+0000 7fe6067a5700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 124766) UID: 0 2023-07-06T00:05:12.086 INFO:tasks.ceph.osd.4.smithi073.stderr:2023-07-06T00:05:12.082+0000 7fb7867e9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 124766) UID: 0 2023-07-06T00:05:12.087 INFO:tasks.ceph.osd.6.smithi073.stderr:2023-07-06T00:05:12.085+0000 7f2582084700 -1 Fail to open '/proc/124766/cmdline' error = (2) No such file or directory 2023-07-06T00:05:12.087 INFO:tasks.ceph.osd.6.smithi073.stderr:2023-07-06T00:05:12.085+0000 7f2582084700 -1 received signal: Hangup from (PID: 124766) UID: 0 2023-07-06T00:05:12.088 INFO:tasks.ceph.osd.5.smithi073.stderr:2023-07-06T00:05:12.085+0000 7f1dead60700 -1 Fail to open '/proc/124766/cmdline' error = (2) No such file or directory 2023-07-06T00:05:12.088 INFO:tasks.ceph.osd.5.smithi073.stderr:2023-07-06T00:05:12.085+0000 7f1dead60700 -1 received signal: Hangup from (PID: 124766) UID: 0 2023-07-06T00:08:11.329 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-06T00:08:11.333 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-06T00:08:41.772 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-06T00:08:41.774 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-06T00:09:11.986 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-06T00:09:11.991 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-06T00:09:42.103 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-06T00:09:42.120 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-06T00:10:12.204 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-06T00:10:12.207 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-06T00:10:42.297 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-06T00:10:42.300 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-06T00:11:12.380 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-06T00:11:12.384 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-06T00:11:42.470 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-06T00:11:42.473 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-06T00:11:42.536 INFO:tasks.ceph.osd.2.smithi046.stderr:2023-07-06T00:11:42.533+0000 7f5a7ef99700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 646968) UID: 0 2023-07-06T00:11:42.536 INFO:tasks.ceph.osd.0.smithi046.stderr:2023-07-06T00:11:42.533+0000 7f77d1dc1700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 646968) UID: 0 2023-07-06T00:11:42.537 INFO:tasks.ceph.osd.1.smithi046.stderr:2023-07-06T00:11:42.533+0000 7f2fc7c11700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 646968) UID: 0 2023-07-06T00:11:42.537 INFO:tasks.ceph.osd.3.smithi046.stderr:2023-07-06T00:11:42.533+0000 7f1104079700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 646968) UID: 0 2023-07-06T00:14:38.767 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-06T00:14:38.769 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-06T00:14:38.859 INFO:tasks.ceph.osd.4.smithi073.stderr:2023-07-06T00:14:38.856+0000 7fb7867e9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 125111) UID: 0 2023-07-06T00:14:38.860 INFO:tasks.ceph.osd.7.smithi073.stderr:2023-07-06T00:14:38.857+0000 7fe6067a5700 -1 Fail to open '/proc/125111/cmdline' error = (2) No such file or directory 2023-07-06T00:14:38.860 INFO:tasks.ceph.osd.7.smithi073.stderr:2023-07-06T00:14:38.857+0000 7fe6067a5700 -1 received signal: Hangup from (PID: 125111) UID: 0 2023-07-06T00:14:38.861 INFO:tasks.ceph.osd.6.smithi073.stderr:2023-07-06T00:14:38.858+0000 7f2582084700 -1 Fail to open '/proc/125111/cmdline' error = (2) No such file or directory 2023-07-06T00:14:38.861 INFO:tasks.ceph.osd.6.smithi073.stderr:2023-07-06T00:14:38.858+0000 7f2582084700 -1 received signal: Hangup from (PID: 125111) UID: 0 2023-07-06T00:14:38.868 INFO:tasks.ceph.osd.5.smithi073.stderr:2023-07-06T00:14:38.857+0000 7f1dead60700 -1 Fail to open '/proc/125111/cmdline' error = (2) No such file or directory 2023-07-06T00:14:38.868 INFO:tasks.ceph.osd.5.smithi073.stderr:2023-07-06T00:14:38.857+0000 7f1dead60700 -1 received signal: Hangup from (PID: 125111) UID: 0 2023-07-06T00:17:47.282 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-06T00:17:47.285 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-06T00:18:17.378 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-06T00:18:17.387 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-06T00:18:47.488 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-06T00:18:47.490 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-06T00:19:17.819 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-06T00:19:17.822 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-06T00:19:17.865 INFO:tasks.ceph.osd.2.smithi046.stderr:2023-07-06T00:19:17.862+0000 7f5a7ef99700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 647138) UID: 0 2023-07-06T00:19:17.866 INFO:tasks.ceph.osd.1.smithi046.stderr:2023-07-06T00:19:17.863+0000 7f2fc7c11700 -1 received signal: Hangup from (PID: 647138) UID: 0 2023-07-06T00:19:17.866 INFO:tasks.ceph.osd.3.smithi046.stderr:2023-07-06T00:19:17.863+0000 7f1104079700 -1 received signal: Hangup from (PID: 647138) UID: 0 2023-07-06T00:19:17.867 INFO:tasks.ceph.osd.0.smithi046.stderr:2023-07-06T00:19:17.865+0000 7f77d1dc1700 -1 Fail to open '/proc/647138/cmdline' error = (2) No such file or directory 2023-07-06T00:19:17.868 INFO:tasks.ceph.osd.0.smithi046.stderr:2023-07-06T00:19:17.865+0000 7f77d1dc1700 -1 received signal: Hangup from (PID: 647138) UID: 0 2023-07-06T00:22:10.708 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-06T00:22:10.710 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-06T00:22:40.807 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-06T00:22:40.811 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-06T00:23:11.096 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-06T00:23:11.099 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-06T00:23:41.182 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-06T00:23:41.189 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-06T00:24:11.486 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-06T00:24:11.489 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-06T00:24:41.576 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-06T00:24:41.580 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-06T00:25:11.694 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-06T00:25:11.698 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-06T00:25:41.841 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-06T00:25:41.847 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-06T00:26:10.131 INFO:teuthology.orchestra.run.smithi046.stdout:generic/522 4112s 2023-07-06T00:26:10.164 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/522 2023-07-06T00:26:10.164 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-07-06T00:26:10.166 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-06T00:26:10.226 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-06T00:26:10.227 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.rlt8E1h3iVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/523) 2023-07-06T00:26:10.784 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph 2023-07-06T00:26:10.795 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-06T00:26:10.796 INFO:teuthology.orchestra.run.smithi046.stdout:MKFS_OPTIONS -- 172.21.15.46:6789:/scratch 2023-07-06T00:26:10.797 INFO:teuthology.orchestra.run.smithi046.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCbvKVkpp1TIhAAvJTELoeH8wkIFqjtppg17w== -o context=system_u:object_r:root_t:s0 172.21.15.46:6789:/scratch /tmp/tmp.KrMG67MsYpscratch 2023-07-06T00:26:10.797 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-06T00:26:11.798 INFO:teuthology.orchestra.run.smithi046.stdout:generic/523 0s 2023-07-06T00:26:11.810 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/523 2023-07-06T00:26:11.811 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-07-06T00:26:11.818 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-06T00:26:11.827 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-06T00:26:11.828 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.rlt8E1h3iVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/524) 2023-07-06T00:26:11.947 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-06T00:26:11.949 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-06T00:26:12.209 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph 2023-07-06T00:26:12.214 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-06T00:26:12.258 INFO:teuthology.orchestra.run.smithi046.stdout:MKFS_OPTIONS -- 172.21.15.46:6789:/scratch 2023-07-06T00:26:12.258 INFO:teuthology.orchestra.run.smithi046.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCbvKVkpp1TIhAAvJTELoeH8wkIFqjtppg17w== -o context=system_u:object_r:root_t:s0 172.21.15.46:6789:/scratch /tmp/tmp.KrMG67MsYpscratch 2023-07-06T00:26:12.258 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-06T00:26:18.385 INFO:teuthology.orchestra.run.smithi046.stdout:generic/524 6s 2023-07-06T00:26:18.391 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/524 2023-07-06T00:26:18.392 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-07-06T00:26:18.394 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-06T00:26:18.412 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-06T00:26:18.412 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.rlt8E1h3iVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/525) 2023-07-06T00:26:18.853 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph 2023-07-06T00:26:18.857 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-06T00:26:18.858 INFO:teuthology.orchestra.run.smithi046.stdout:MKFS_OPTIONS -- 172.21.15.46:6789:/scratch 2023-07-06T00:26:18.858 INFO:teuthology.orchestra.run.smithi046.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCbvKVkpp1TIhAAvJTELoeH8wkIFqjtppg17w== -o context=system_u:object_r:root_t:s0 172.21.15.46:6789:/scratch /tmp/tmp.KrMG67MsYpscratch 2023-07-06T00:26:18.859 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-06T00:26:19.675 INFO:teuthology.orchestra.run.smithi046.stdout:generic/525 [not run] filesystem does not support huge file size 2023-07-06T00:26:19.703 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/525 2023-07-06T00:26:19.704 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/525 2023-07-06T00:26:19.704 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-07-06T00:26:19.707 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-06T00:26:19.760 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-06T00:26:19.760 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.rlt8E1h3iVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/526) 2023-07-06T00:26:20.125 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph 2023-07-06T00:26:20.129 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-06T00:26:20.130 INFO:teuthology.orchestra.run.smithi046.stdout:MKFS_OPTIONS -- 172.21.15.46:6789:/scratch 2023-07-06T00:26:20.131 INFO:teuthology.orchestra.run.smithi046.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCbvKVkpp1TIhAAvJTELoeH8wkIFqjtppg17w== -o context=system_u:object_r:root_t:s0 172.21.15.46:6789:/scratch /tmp/tmp.KrMG67MsYpscratch 2023-07-06T00:26:20.131 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-06T00:26:20.734 INFO:teuthology.orchestra.run.smithi046.stdout:generic/526 [not run] require 172.21.15.46:6789:/scratch to be valid block disk 2023-07-06T00:26:20.740 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/526 2023-07-06T00:26:20.740 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/526 2023-07-06T00:26:20.740 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-07-06T00:26:20.742 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-06T00:26:20.797 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-06T00:26:20.798 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.rlt8E1h3iVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/527) 2023-07-06T00:26:21.193 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph 2023-07-06T00:26:21.213 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-06T00:26:21.213 INFO:teuthology.orchestra.run.smithi046.stdout:MKFS_OPTIONS -- 172.21.15.46:6789:/scratch 2023-07-06T00:26:21.214 INFO:teuthology.orchestra.run.smithi046.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCbvKVkpp1TIhAAvJTELoeH8wkIFqjtppg17w== -o context=system_u:object_r:root_t:s0 172.21.15.46:6789:/scratch /tmp/tmp.KrMG67MsYpscratch 2023-07-06T00:26:21.214 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-06T00:26:21.767 INFO:teuthology.orchestra.run.smithi046.stdout:generic/527 [not run] require 172.21.15.46:6789:/scratch to be valid block disk 2023-07-06T00:26:21.772 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/527 2023-07-06T00:26:21.773 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/527 2023-07-06T00:26:21.773 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-07-06T00:26:21.775 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-06T00:26:21.829 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-06T00:26:21.829 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.rlt8E1h3iVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/528) 2023-07-06T00:26:22.217 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph 2023-07-06T00:26:22.222 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-06T00:26:22.223 INFO:teuthology.orchestra.run.smithi046.stdout:MKFS_OPTIONS -- 172.21.15.46:6789:/scratch 2023-07-06T00:26:22.225 INFO:teuthology.orchestra.run.smithi046.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCbvKVkpp1TIhAAvJTELoeH8wkIFqjtppg17w== -o context=system_u:object_r:root_t:s0 172.21.15.46:6789:/scratch /tmp/tmp.KrMG67MsYpscratch 2023-07-06T00:26:22.225 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-06T00:26:22.960 INFO:teuthology.orchestra.run.smithi046.stdout:generic/528 0s 2023-07-06T00:26:22.977 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/528 2023-07-06T00:26:22.977 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-07-06T00:26:22.979 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-06T00:26:23.383 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-06T00:26:23.383 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.rlt8E1h3iVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/529) 2023-07-06T00:26:23.824 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph 2023-07-06T00:26:23.829 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-06T00:26:23.830 INFO:teuthology.orchestra.run.smithi046.stdout:MKFS_OPTIONS -- 172.21.15.46:6789:/scratch 2023-07-06T00:26:23.837 INFO:teuthology.orchestra.run.smithi046.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCbvKVkpp1TIhAAvJTELoeH8wkIFqjtppg17w== -o context=system_u:object_r:root_t:s0 172.21.15.46:6789:/scratch /tmp/tmp.KrMG67MsYpscratch 2023-07-06T00:26:23.837 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-06T00:26:24.768 INFO:teuthology.orchestra.run.smithi046.stdout:generic/529 0s 2023-07-06T00:26:24.790 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/529 2023-07-06T00:26:24.791 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-07-06T00:26:24.794 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-06T00:26:24.803 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-06T00:26:24.804 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.rlt8E1h3iVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/530) 2023-07-06T00:26:25.206 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph 2023-07-06T00:26:25.230 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-06T00:26:25.230 INFO:teuthology.orchestra.run.smithi046.stdout:MKFS_OPTIONS -- 172.21.15.46:6789:/scratch 2023-07-06T00:26:25.232 INFO:teuthology.orchestra.run.smithi046.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCbvKVkpp1TIhAAvJTELoeH8wkIFqjtppg17w== -o context=system_u:object_r:root_t:s0 172.21.15.46:6789:/scratch /tmp/tmp.KrMG67MsYpscratch 2023-07-06T00:26:25.232 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-06T00:26:26.014 INFO:teuthology.orchestra.run.smithi046.stdout:generic/530 [not run] ceph does not support shutdown 2023-07-06T00:26:26.053 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/530 2023-07-06T00:26:26.054 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/530 2023-07-06T00:26:26.054 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-07-06T00:26:26.058 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-06T00:26:26.088 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-06T00:26:26.089 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.rlt8E1h3iVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/531) 2023-07-06T00:26:26.514 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph 2023-07-06T00:26:26.526 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-06T00:26:26.527 INFO:teuthology.orchestra.run.smithi046.stdout:MKFS_OPTIONS -- 172.21.15.46:6789:/scratch 2023-07-06T00:26:26.527 INFO:teuthology.orchestra.run.smithi046.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCbvKVkpp1TIhAAvJTELoeH8wkIFqjtppg17w== -o context=system_u:object_r:root_t:s0 172.21.15.46:6789:/scratch /tmp/tmp.KrMG67MsYpscratch 2023-07-06T00:26:26.528 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-06T00:26:26.992 INFO:teuthology.orchestra.run.smithi046.stdout:generic/531 [not run] O_TMPFILE is not supported 2023-07-06T00:26:26.997 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/531 2023-07-06T00:26:26.997 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/531 2023-07-06T00:26:26.997 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-07-06T00:26:27.000 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-06T00:26:27.040 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-06T00:26:27.041 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.rlt8E1h3iVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/532) 2023-07-06T00:26:27.434 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph 2023-07-06T00:26:27.439 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-06T00:26:27.440 INFO:teuthology.orchestra.run.smithi046.stdout:MKFS_OPTIONS -- 172.21.15.46:6789:/scratch 2023-07-06T00:26:27.444 INFO:teuthology.orchestra.run.smithi046.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCbvKVkpp1TIhAAvJTELoeH8wkIFqjtppg17w== -o context=system_u:object_r:root_t:s0 172.21.15.46:6789:/scratch /tmp/tmp.KrMG67MsYpscratch 2023-07-06T00:26:27.444 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-06T00:26:28.026 INFO:teuthology.orchestra.run.smithi046.stdout:generic/532 1s 2023-07-06T00:26:28.051 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/532 2023-07-06T00:26:28.051 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-07-06T00:26:28.055 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-06T00:26:28.115 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-06T00:26:28.116 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.rlt8E1h3iVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/533) 2023-07-06T00:26:28.518 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph 2023-07-06T00:26:28.523 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-06T00:26:28.524 INFO:teuthology.orchestra.run.smithi046.stdout:MKFS_OPTIONS -- 172.21.15.46:6789:/scratch 2023-07-06T00:26:28.525 INFO:teuthology.orchestra.run.smithi046.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCbvKVkpp1TIhAAvJTELoeH8wkIFqjtppg17w== -o context=system_u:object_r:root_t:s0 172.21.15.46:6789:/scratch /tmp/tmp.KrMG67MsYpscratch 2023-07-06T00:26:28.525 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-06T00:26:29.944 INFO:teuthology.orchestra.run.smithi046.stdout:generic/533 1s 2023-07-06T00:26:29.950 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/533 2023-07-06T00:26:29.950 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-07-06T00:26:29.958 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-06T00:26:29.988 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-06T00:26:29.988 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.rlt8E1h3iVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/534) 2023-07-06T00:26:30.356 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph 2023-07-06T00:26:30.361 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-06T00:26:30.361 INFO:teuthology.orchestra.run.smithi046.stdout:MKFS_OPTIONS -- 172.21.15.46:6789:/scratch 2023-07-06T00:26:30.362 INFO:teuthology.orchestra.run.smithi046.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCbvKVkpp1TIhAAvJTELoeH8wkIFqjtppg17w== -o context=system_u:object_r:root_t:s0 172.21.15.46:6789:/scratch /tmp/tmp.KrMG67MsYpscratch 2023-07-06T00:26:30.363 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-06T00:26:30.885 INFO:teuthology.orchestra.run.smithi046.stdout:generic/534 [not run] require 172.21.15.46:6789:/scratch to be valid block disk 2023-07-06T00:26:30.897 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/534 2023-07-06T00:26:30.897 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/534 2023-07-06T00:26:30.898 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-07-06T00:26:30.899 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-06T00:26:30.927 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-06T00:26:30.928 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.rlt8E1h3iVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/535) 2023-07-06T00:26:31.279 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph 2023-07-06T00:26:31.284 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-06T00:26:31.284 INFO:teuthology.orchestra.run.smithi046.stdout:MKFS_OPTIONS -- 172.21.15.46:6789:/scratch 2023-07-06T00:26:31.285 INFO:teuthology.orchestra.run.smithi046.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCbvKVkpp1TIhAAvJTELoeH8wkIFqjtppg17w== -o context=system_u:object_r:root_t:s0 172.21.15.46:6789:/scratch /tmp/tmp.KrMG67MsYpscratch 2023-07-06T00:26:31.286 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-06T00:26:31.817 INFO:teuthology.orchestra.run.smithi046.stdout:generic/535 [not run] require 172.21.15.46:6789:/scratch to be valid block disk 2023-07-06T00:26:31.828 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/535 2023-07-06T00:26:31.828 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/535 2023-07-06T00:26:31.828 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-07-06T00:26:31.830 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-06T00:26:31.866 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-06T00:26:31.866 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.rlt8E1h3iVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/536) 2023-07-06T00:26:32.272 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph 2023-07-06T00:26:32.282 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-06T00:26:32.282 INFO:teuthology.orchestra.run.smithi046.stdout:MKFS_OPTIONS -- 172.21.15.46:6789:/scratch 2023-07-06T00:26:32.283 INFO:teuthology.orchestra.run.smithi046.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCbvKVkpp1TIhAAvJTELoeH8wkIFqjtppg17w== -o context=system_u:object_r:root_t:s0 172.21.15.46:6789:/scratch /tmp/tmp.KrMG67MsYpscratch 2023-07-06T00:26:32.284 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-06T00:26:33.046 INFO:teuthology.orchestra.run.smithi046.stdout:generic/536 [not run] ceph does not support shutdown 2023-07-06T00:26:33.076 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/536 2023-07-06T00:26:33.076 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/536 2023-07-06T00:26:33.076 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-07-06T00:26:33.079 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-06T00:26:33.120 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-06T00:26:33.120 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.rlt8E1h3iVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/537) 2023-07-06T00:26:33.539 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph 2023-07-06T00:26:33.544 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-06T00:26:33.545 INFO:teuthology.orchestra.run.smithi046.stdout:MKFS_OPTIONS -- 172.21.15.46:6789:/scratch 2023-07-06T00:26:33.545 INFO:teuthology.orchestra.run.smithi046.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCbvKVkpp1TIhAAvJTELoeH8wkIFqjtppg17w== -o context=system_u:object_r:root_t:s0 172.21.15.46:6789:/scratch /tmp/tmp.KrMG67MsYpscratch 2023-07-06T00:26:33.546 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-06T00:26:34.302 INFO:teuthology.orchestra.run.smithi046.stdout:generic/537 [not run] FSTRIM not supported 2023-07-06T00:26:34.338 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/537 2023-07-06T00:26:34.338 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/537 2023-07-06T00:26:34.338 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-07-06T00:26:34.341 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-06T00:26:34.381 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-06T00:26:34.382 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.rlt8E1h3iVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/538) 2023-07-06T00:26:34.765 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph 2023-07-06T00:26:34.770 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-06T00:26:34.773 INFO:teuthology.orchestra.run.smithi046.stdout:MKFS_OPTIONS -- 172.21.15.46:6789:/scratch 2023-07-06T00:26:34.775 INFO:teuthology.orchestra.run.smithi046.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCbvKVkpp1TIhAAvJTELoeH8wkIFqjtppg17w== -o context=system_u:object_r:root_t:s0 172.21.15.46:6789:/scratch /tmp/tmp.KrMG67MsYpscratch 2023-07-06T00:26:34.775 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-06T00:26:42.086 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-06T00:26:42.089 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-06T00:27:12.175 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-06T00:27:12.177 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-06T00:27:42.280 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-06T00:27:42.284 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-06T00:28:12.370 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-06T00:28:12.373 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-06T00:28:42.492 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-06T00:28:42.495 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-06T00:29:12.649 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-06T00:29:12.651 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-06T00:29:42.937 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-06T00:29:42.939 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-06T00:30:13.118 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-06T00:30:13.121 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-06T00:30:43.207 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-06T00:30:43.210 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-06T00:31:13.363 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-06T00:31:13.366 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-06T00:31:43.509 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-06T00:31:43.512 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-06T00:32:13.591 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-06T00:32:13.594 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-06T00:32:43.694 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-06T00:32:43.697 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-06T00:32:43.758 INFO:tasks.ceph.osd.1.smithi046.stderr:2023-07-06T00:32:43.755+0000 7f2fc7c11700 -1 Fail to open '/proc/660382/cmdline' error = (2) No such file or directory 2023-07-06T00:32:43.758 INFO:tasks.ceph.osd.1.smithi046.stderr:2023-07-06T00:32:43.755+0000 7f2fc7c11700 -1 received signal: Hangup from (PID: 660382) UID: 0 2023-07-06T00:32:43.759 INFO:tasks.ceph.osd.0.smithi046.stderr:2023-07-06T00:32:43.752+0000 7f77d1dc1700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 660382) UID: 0 2023-07-06T00:32:43.760 INFO:tasks.ceph.osd.3.smithi046.stderr:2023-07-06T00:32:43.756+0000 7f1104079700 -1 Fail to open '/proc/660382/cmdline' error = (2) No such file or directory 2023-07-06T00:32:43.760 INFO:tasks.ceph.osd.3.smithi046.stderr:2023-07-06T00:32:43.756+0000 7f1104079700 -1 received signal: Hangup from (PID: 660382) UID: 0 2023-07-06T00:32:43.761 INFO:tasks.ceph.osd.2.smithi046.stderr:2023-07-06T00:32:43.752+0000 7f5a7ef99700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 660382) UID: 0 2023-07-06T00:35:39.030 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-06T00:35:39.046 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-06T00:35:46.081 INFO:teuthology.orchestra.run.smithi046.stdout:generic/538 550s 2023-07-06T00:35:46.087 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/538 2023-07-06T00:35:46.087 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-07-06T00:35:46.092 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-06T00:35:46.691 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-06T00:35:46.692 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.rlt8E1h3iVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/539) 2023-07-06T00:35:47.074 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph 2023-07-06T00:35:47.092 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-06T00:35:47.093 INFO:teuthology.orchestra.run.smithi046.stdout:MKFS_OPTIONS -- 172.21.15.46:6789:/scratch 2023-07-06T00:35:47.094 INFO:teuthology.orchestra.run.smithi046.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCbvKVkpp1TIhAAvJTELoeH8wkIFqjtppg17w== -o context=system_u:object_r:root_t:s0 172.21.15.46:6789:/scratch /tmp/tmp.KrMG67MsYpscratch 2023-07-06T00:35:47.094 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-06T00:35:49.636 INFO:teuthology.orchestra.run.smithi046.stdout:generic/539 2s 2023-07-06T00:35:49.643 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/539 2023-07-06T00:35:49.643 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-07-06T00:35:49.645 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-06T00:35:49.959 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-06T00:35:49.960 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.rlt8E1h3iVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/540) 2023-07-06T00:35:50.402 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph 2023-07-06T00:35:50.409 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-06T00:35:50.409 INFO:teuthology.orchestra.run.smithi046.stdout:MKFS_OPTIONS -- 172.21.15.46:6789:/scratch 2023-07-06T00:35:50.411 INFO:teuthology.orchestra.run.smithi046.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCbvKVkpp1TIhAAvJTELoeH8wkIFqjtppg17w== -o context=system_u:object_r:root_t:s0 172.21.15.46:6789:/scratch /tmp/tmp.KrMG67MsYpscratch 2023-07-06T00:35:50.411 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-06T00:35:51.751 INFO:teuthology.orchestra.run.smithi046.stdout:generic/540 [not run] Reflink not supported by scratch filesystem type: ceph 2023-07-06T00:35:51.778 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/540 2023-07-06T00:35:51.779 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/540 2023-07-06T00:35:51.779 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-07-06T00:35:51.782 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-06T00:35:51.843 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-06T00:35:51.843 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.rlt8E1h3iVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/541) 2023-07-06T00:35:52.206 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph 2023-07-06T00:35:52.209 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-06T00:35:52.210 INFO:teuthology.orchestra.run.smithi046.stdout:MKFS_OPTIONS -- 172.21.15.46:6789:/scratch 2023-07-06T00:35:52.211 INFO:teuthology.orchestra.run.smithi046.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCbvKVkpp1TIhAAvJTELoeH8wkIFqjtppg17w== -o context=system_u:object_r:root_t:s0 172.21.15.46:6789:/scratch /tmp/tmp.KrMG67MsYpscratch 2023-07-06T00:35:52.211 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-06T00:35:53.432 INFO:teuthology.orchestra.run.smithi046.stdout:generic/541 [not run] Reflink not supported by scratch filesystem type: ceph 2023-07-06T00:35:53.538 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/541 2023-07-06T00:35:53.538 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/541 2023-07-06T00:35:53.539 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-07-06T00:35:53.555 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-06T00:35:53.648 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-06T00:35:53.649 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.rlt8E1h3iVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/542) 2023-07-06T00:35:54.041 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph 2023-07-06T00:35:54.046 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-06T00:35:54.046 INFO:teuthology.orchestra.run.smithi046.stdout:MKFS_OPTIONS -- 172.21.15.46:6789:/scratch 2023-07-06T00:35:54.047 INFO:teuthology.orchestra.run.smithi046.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCbvKVkpp1TIhAAvJTELoeH8wkIFqjtppg17w== -o context=system_u:object_r:root_t:s0 172.21.15.46:6789:/scratch /tmp/tmp.KrMG67MsYpscratch 2023-07-06T00:35:54.047 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-06T00:35:55.278 INFO:teuthology.orchestra.run.smithi046.stdout:generic/542 [not run] Reflink not supported by scratch filesystem type: ceph 2023-07-06T00:35:55.289 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/542 2023-07-06T00:35:55.289 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/542 2023-07-06T00:35:55.289 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-07-06T00:35:55.292 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-06T00:35:55.350 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-06T00:35:55.351 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.rlt8E1h3iVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/543) 2023-07-06T00:35:55.772 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph 2023-07-06T00:35:55.776 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-06T00:35:55.777 INFO:teuthology.orchestra.run.smithi046.stdout:MKFS_OPTIONS -- 172.21.15.46:6789:/scratch 2023-07-06T00:35:55.778 INFO:teuthology.orchestra.run.smithi046.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCbvKVkpp1TIhAAvJTELoeH8wkIFqjtppg17w== -o context=system_u:object_r:root_t:s0 172.21.15.46:6789:/scratch /tmp/tmp.KrMG67MsYpscratch 2023-07-06T00:35:55.778 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-06T00:35:57.107 INFO:teuthology.orchestra.run.smithi046.stdout:generic/543 [not run] Reflink not supported by scratch filesystem type: ceph 2023-07-06T00:35:57.116 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/543 2023-07-06T00:35:57.116 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/543 2023-07-06T00:35:57.117 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-07-06T00:35:57.120 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-06T00:35:57.168 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-06T00:35:57.168 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.rlt8E1h3iVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/544) 2023-07-06T00:35:57.529 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph 2023-07-06T00:35:57.534 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-06T00:35:57.534 INFO:teuthology.orchestra.run.smithi046.stdout:MKFS_OPTIONS -- 172.21.15.46:6789:/scratch 2023-07-06T00:35:57.538 INFO:teuthology.orchestra.run.smithi046.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCbvKVkpp1TIhAAvJTELoeH8wkIFqjtppg17w== -o context=system_u:object_r:root_t:s0 172.21.15.46:6789:/scratch /tmp/tmp.KrMG67MsYpscratch 2023-07-06T00:35:57.538 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-06T00:35:58.561 INFO:teuthology.orchestra.run.smithi046.stdout:generic/544 [not run] Reflink not supported by scratch filesystem type: ceph 2023-07-06T00:35:58.759 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/544 2023-07-06T00:35:58.759 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/544 2023-07-06T00:35:58.759 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-07-06T00:35:58.837 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-06T00:35:58.898 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-06T00:35:58.899 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.rlt8E1h3iVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/545) 2023-07-06T00:35:59.300 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph 2023-07-06T00:35:59.305 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-06T00:35:59.305 INFO:teuthology.orchestra.run.smithi046.stdout:MKFS_OPTIONS -- 172.21.15.46:6789:/scratch 2023-07-06T00:35:59.306 INFO:teuthology.orchestra.run.smithi046.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCbvKVkpp1TIhAAvJTELoeH8wkIFqjtppg17w== -o context=system_u:object_r:root_t:s0 172.21.15.46:6789:/scratch /tmp/tmp.KrMG67MsYpscratch 2023-07-06T00:35:59.306 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-06T00:36:00.115 INFO:teuthology.orchestra.run.smithi046.stdout:generic/545 [not run] file system doesn't support chattr +i 2023-07-06T00:36:00.123 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/545 2023-07-06T00:36:00.123 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/545 2023-07-06T00:36:00.123 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-07-06T00:36:00.126 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-06T00:36:00.200 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-06T00:36:00.201 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.rlt8E1h3iVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/546) 2023-07-06T00:36:00.630 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph 2023-07-06T00:36:00.635 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-06T00:36:00.635 INFO:teuthology.orchestra.run.smithi046.stdout:MKFS_OPTIONS -- 172.21.15.46:6789:/scratch 2023-07-06T00:36:00.636 INFO:teuthology.orchestra.run.smithi046.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCbvKVkpp1TIhAAvJTELoeH8wkIFqjtppg17w== -o context=system_u:object_r:root_t:s0 172.21.15.46:6789:/scratch /tmp/tmp.KrMG67MsYpscratch 2023-07-06T00:36:00.637 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-06T00:36:01.263 INFO:teuthology.orchestra.run.smithi046.stdout:generic/546 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-07-06T00:36:01.268 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/546 2023-07-06T00:36:01.268 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/546 2023-07-06T00:36:01.269 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-07-06T00:36:01.271 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-06T00:36:01.316 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-06T00:36:01.317 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.rlt8E1h3iVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/547) 2023-07-06T00:36:01.731 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph 2023-07-06T00:36:01.742 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-06T00:36:01.743 INFO:teuthology.orchestra.run.smithi046.stdout:MKFS_OPTIONS -- 172.21.15.46:6789:/scratch 2023-07-06T00:36:01.744 INFO:teuthology.orchestra.run.smithi046.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCbvKVkpp1TIhAAvJTELoeH8wkIFqjtppg17w== -o context=system_u:object_r:root_t:s0 172.21.15.46:6789:/scratch /tmp/tmp.KrMG67MsYpscratch 2023-07-06T00:36:01.744 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-06T00:36:02.344 INFO:teuthology.orchestra.run.smithi046.stdout:generic/547 [not run] require 172.21.15.46:6789:/scratch to be valid block disk 2023-07-06T00:36:02.348 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/547 2023-07-06T00:36:02.348 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/547 2023-07-06T00:36:02.348 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-07-06T00:36:02.350 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-06T00:36:02.385 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-06T00:36:02.385 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.rlt8E1h3iVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/548) 2023-07-06T00:36:02.797 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph 2023-07-06T00:36:02.803 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-06T00:36:02.804 INFO:teuthology.orchestra.run.smithi046.stdout:MKFS_OPTIONS -- 172.21.15.46:6789:/scratch 2023-07-06T00:36:02.805 INFO:teuthology.orchestra.run.smithi046.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCbvKVkpp1TIhAAvJTELoeH8wkIFqjtppg17w== -o context=system_u:object_r:root_t:s0 172.21.15.46:6789:/scratch /tmp/tmp.KrMG67MsYpscratch 2023-07-06T00:36:02.805 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-06T00:36:03.689 INFO:teuthology.orchestra.run.smithi046.stdout:generic/548 [not run] kernel does not support ceph encryption 2023-07-06T00:36:03.724 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/548 2023-07-06T00:36:03.725 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/548 2023-07-06T00:36:03.725 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-07-06T00:36:03.727 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-06T00:36:03.770 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-06T00:36:03.771 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.rlt8E1h3iVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/549) 2023-07-06T00:36:04.170 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph 2023-07-06T00:36:04.175 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-06T00:36:04.175 INFO:teuthology.orchestra.run.smithi046.stdout:MKFS_OPTIONS -- 172.21.15.46:6789:/scratch 2023-07-06T00:36:04.176 INFO:teuthology.orchestra.run.smithi046.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCbvKVkpp1TIhAAvJTELoeH8wkIFqjtppg17w== -o context=system_u:object_r:root_t:s0 172.21.15.46:6789:/scratch /tmp/tmp.KrMG67MsYpscratch 2023-07-06T00:36:04.177 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-06T00:36:05.125 INFO:teuthology.orchestra.run.smithi046.stdout:generic/549 [not run] kernel does not support ceph encryption 2023-07-06T00:36:05.157 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/549 2023-07-06T00:36:05.158 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/549 2023-07-06T00:36:05.158 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-07-06T00:36:05.163 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-06T00:36:05.198 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-06T00:36:05.199 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.rlt8E1h3iVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/550) 2023-07-06T00:36:05.592 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph 2023-07-06T00:36:05.596 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-06T00:36:05.597 INFO:teuthology.orchestra.run.smithi046.stdout:MKFS_OPTIONS -- 172.21.15.46:6789:/scratch 2023-07-06T00:36:05.598 INFO:teuthology.orchestra.run.smithi046.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCbvKVkpp1TIhAAvJTELoeH8wkIFqjtppg17w== -o context=system_u:object_r:root_t:s0 172.21.15.46:6789:/scratch /tmp/tmp.KrMG67MsYpscratch 2023-07-06T00:36:05.598 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-06T00:36:06.481 INFO:teuthology.orchestra.run.smithi046.stdout:generic/550 [not run] kernel does not support ceph encryption 2023-07-06T00:36:06.512 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/550 2023-07-06T00:36:06.512 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/550 2023-07-06T00:36:06.513 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-07-06T00:36:06.519 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-06T00:36:06.567 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-06T00:36:06.567 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.rlt8E1h3iVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/551) 2023-07-06T00:36:06.920 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph 2023-07-06T00:36:06.933 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-06T00:36:06.934 INFO:teuthology.orchestra.run.smithi046.stdout:MKFS_OPTIONS -- 172.21.15.46:6789:/scratch 2023-07-06T00:36:06.935 INFO:teuthology.orchestra.run.smithi046.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCbvKVkpp1TIhAAvJTELoeH8wkIFqjtppg17w== -o context=system_u:object_r:root_t:s0 172.21.15.46:6789:/scratch /tmp/tmp.KrMG67MsYpscratch 2023-07-06T00:36:06.935 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-06T00:36:09.136 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-06T00:36:09.138 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-06T00:36:39.412 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-06T00:36:39.418 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-06T00:37:09.553 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-06T00:37:09.555 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-06T00:37:39.653 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-06T00:37:39.657 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-06T00:38:09.757 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-06T00:38:09.759 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-06T00:38:39.845 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-06T00:38:39.851 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-06T00:39:09.958 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-06T00:39:09.967 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-06T00:39:40.244 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-06T00:39:40.251 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-06T00:40:10.370 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-06T00:40:10.373 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-06T00:40:40.510 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-06T00:40:40.512 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-06T00:41:10.631 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-06T00:41:10.634 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-06T00:41:40.779 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-06T00:41:40.782 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-06T00:42:10.848 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-06T00:42:10.851 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-06T00:42:40.982 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-06T00:42:40.989 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-06T00:43:11.159 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-06T00:43:11.161 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-06T00:43:41.259 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-06T00:43:41.262 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-06T00:44:11.340 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-06T00:44:11.343 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-06T00:44:41.487 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-06T00:44:41.489 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-06T00:45:11.618 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-06T00:45:11.620 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-06T00:45:41.789 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-06T00:45:41.792 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-06T00:46:11.862 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-06T00:46:11.865 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-06T00:46:42.088 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-06T00:46:42.090 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-06T00:47:12.148 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-06T00:47:12.151 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-06T00:47:42.213 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-06T00:47:42.216 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-06T00:48:12.335 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-06T00:48:12.338 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-06T00:48:42.473 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-06T00:48:42.476 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-06T00:49:12.545 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-06T00:49:12.548 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-06T00:49:42.659 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-06T00:49:42.661 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-06T00:50:03.373 INFO:teuthology.orchestra.run.smithi046.stdout:generic/551 836s 2023-07-06T00:50:03.378 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/551 2023-07-06T00:50:03.379 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-07-06T00:50:03.380 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-06T00:50:03.389 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-06T00:50:03.390 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.rlt8E1h3iVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/552) 2023-07-06T00:50:03.648 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph 2023-07-06T00:50:03.652 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-06T00:50:03.652 INFO:teuthology.orchestra.run.smithi046.stdout:MKFS_OPTIONS -- 172.21.15.46:6789:/scratch 2023-07-06T00:50:03.653 INFO:teuthology.orchestra.run.smithi046.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCbvKVkpp1TIhAAvJTELoeH8wkIFqjtppg17w== -o context=system_u:object_r:root_t:s0 172.21.15.46:6789:/scratch /tmp/tmp.KrMG67MsYpscratch 2023-07-06T00:50:03.653 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-06T00:50:04.081 INFO:teuthology.orchestra.run.smithi046.stdout:generic/552 [not run] require 172.21.15.46:6789:/scratch to be valid block disk 2023-07-06T00:50:04.085 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/552 2023-07-06T00:50:04.086 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/552 2023-07-06T00:50:04.086 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-07-06T00:50:04.088 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-06T00:50:04.124 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-06T00:50:04.124 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.rlt8E1h3iVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/553) 2023-07-06T00:50:04.405 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph 2023-07-06T00:50:04.409 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-06T00:50:04.410 INFO:teuthology.orchestra.run.smithi046.stdout:MKFS_OPTIONS -- 172.21.15.46:6789:/scratch 2023-07-06T00:50:04.410 INFO:teuthology.orchestra.run.smithi046.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCbvKVkpp1TIhAAvJTELoeH8wkIFqjtppg17w== -o context=system_u:object_r:root_t:s0 172.21.15.46:6789:/scratch /tmp/tmp.KrMG67MsYpscratch 2023-07-06T00:50:04.411 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-06T00:50:04.806 INFO:teuthology.orchestra.run.smithi046.stdout:generic/553 [not run] xfs_io chattr +i failed (old kernel/wrong fs?) 2023-07-06T00:50:04.809 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/553 2023-07-06T00:50:04.809 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/553 2023-07-06T00:50:04.810 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-07-06T00:50:04.811 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-06T00:50:05.098 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-06T00:50:05.099 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.rlt8E1h3iVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/554) 2023-07-06T00:50:05.455 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph 2023-07-06T00:50:05.459 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-06T00:50:05.459 INFO:teuthology.orchestra.run.smithi046.stdout:MKFS_OPTIONS -- 172.21.15.46:6789:/scratch 2023-07-06T00:50:05.460 INFO:teuthology.orchestra.run.smithi046.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCbvKVkpp1TIhAAvJTELoeH8wkIFqjtppg17w== -o context=system_u:object_r:root_t:s0 172.21.15.46:6789:/scratch /tmp/tmp.KrMG67MsYpscratch 2023-07-06T00:50:05.460 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-06T00:50:06.125 INFO:teuthology.orchestra.run.smithi046.stdout:generic/554 [not run] swapfiles are not supported 2023-07-06T00:50:06.129 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/554 2023-07-06T00:50:06.129 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/554 2023-07-06T00:50:06.130 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-07-06T00:50:06.131 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-06T00:50:06.443 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-06T00:50:06.443 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.rlt8E1h3iVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/555) 2023-07-06T00:50:06.767 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph 2023-07-06T00:50:06.771 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-06T00:50:06.771 INFO:teuthology.orchestra.run.smithi046.stdout:MKFS_OPTIONS -- 172.21.15.46:6789:/scratch 2023-07-06T00:50:06.772 INFO:teuthology.orchestra.run.smithi046.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCbvKVkpp1TIhAAvJTELoeH8wkIFqjtppg17w== -o context=system_u:object_r:root_t:s0 172.21.15.46:6789:/scratch /tmp/tmp.KrMG67MsYpscratch 2023-07-06T00:50:06.773 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-06T00:50:07.162 INFO:teuthology.orchestra.run.smithi046.stdout:generic/555 [not run] xfs_io chattr +ia failed (old kernel/wrong fs?) 2023-07-06T00:50:07.166 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/555 2023-07-06T00:50:07.167 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/555 2023-07-06T00:50:07.167 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-07-06T00:50:07.169 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-06T00:50:07.504 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-06T00:50:07.504 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.rlt8E1h3iVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/556) 2023-07-06T00:50:07.816 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph 2023-07-06T00:50:07.820 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-06T00:50:07.820 INFO:teuthology.orchestra.run.smithi046.stdout:MKFS_OPTIONS -- 172.21.15.46:6789:/scratch 2023-07-06T00:50:07.821 INFO:teuthology.orchestra.run.smithi046.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCbvKVkpp1TIhAAvJTELoeH8wkIFqjtppg17w== -o context=system_u:object_r:root_t:s0 172.21.15.46:6789:/scratch /tmp/tmp.KrMG67MsYpscratch 2023-07-06T00:50:07.821 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-06T00:50:08.177 INFO:teuthology.orchestra.run.smithi046.stdout:generic/556 [not run] ceph does not support casefold feature 2023-07-06T00:50:08.181 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/556 2023-07-06T00:50:08.181 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/556 2023-07-06T00:50:08.181 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-07-06T00:50:08.183 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-06T00:50:08.222 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-06T00:50:08.222 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.rlt8E1h3iVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/557) 2023-07-06T00:50:08.446 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph 2023-07-06T00:50:08.450 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-06T00:50:08.450 INFO:teuthology.orchestra.run.smithi046.stdout:MKFS_OPTIONS -- 172.21.15.46:6789:/scratch 2023-07-06T00:50:08.451 INFO:teuthology.orchestra.run.smithi046.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCbvKVkpp1TIhAAvJTELoeH8wkIFqjtppg17w== -o context=system_u:object_r:root_t:s0 172.21.15.46:6789:/scratch /tmp/tmp.KrMG67MsYpscratch 2023-07-06T00:50:08.451 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-06T00:50:08.805 INFO:teuthology.orchestra.run.smithi046.stdout:generic/557 [not run] require 172.21.15.46:6789:/scratch to be valid block disk 2023-07-06T00:50:08.809 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/557 2023-07-06T00:50:08.809 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/557 2023-07-06T00:50:08.809 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-07-06T00:50:08.811 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-06T00:50:08.839 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-06T00:50:08.840 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.rlt8E1h3iVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/558) 2023-07-06T00:50:09.068 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph 2023-07-06T00:50:09.072 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-06T00:50:09.072 INFO:teuthology.orchestra.run.smithi046.stdout:MKFS_OPTIONS -- 172.21.15.46:6789:/scratch 2023-07-06T00:50:09.073 INFO:teuthology.orchestra.run.smithi046.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCbvKVkpp1TIhAAvJTELoeH8wkIFqjtppg17w== -o context=system_u:object_r:root_t:s0 172.21.15.46:6789:/scratch /tmp/tmp.KrMG67MsYpscratch 2023-07-06T00:50:09.073 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-06T00:50:09.430 INFO:teuthology.orchestra.run.smithi046.stdout:generic/558 [not run] Filesystem ceph not supported in _scratch_mkfs_sized 2023-07-06T00:50:09.434 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/558 2023-07-06T00:50:09.435 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/558 2023-07-06T00:50:09.435 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-07-06T00:50:09.437 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-06T00:50:09.472 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-06T00:50:09.473 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.rlt8E1h3iVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/559) 2023-07-06T00:50:09.696 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph 2023-07-06T00:50:09.701 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-06T00:50:09.701 INFO:teuthology.orchestra.run.smithi046.stdout:MKFS_OPTIONS -- 172.21.15.46:6789:/scratch 2023-07-06T00:50:09.702 INFO:teuthology.orchestra.run.smithi046.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCbvKVkpp1TIhAAvJTELoeH8wkIFqjtppg17w== -o context=system_u:object_r:root_t:s0 172.21.15.46:6789:/scratch /tmp/tmp.KrMG67MsYpscratch 2023-07-06T00:50:09.702 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-06T00:50:10.072 INFO:teuthology.orchestra.run.smithi046.stdout:generic/559 [not run] duperemove utility required, skipped this test 2023-07-06T00:50:10.076 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/559 2023-07-06T00:50:10.076 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/559 2023-07-06T00:50:10.077 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-07-06T00:50:10.078 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-06T00:50:10.104 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-06T00:50:10.104 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.rlt8E1h3iVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/560) 2023-07-06T00:50:10.338 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph 2023-07-06T00:50:10.343 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-06T00:50:10.343 INFO:teuthology.orchestra.run.smithi046.stdout:MKFS_OPTIONS -- 172.21.15.46:6789:/scratch 2023-07-06T00:50:10.344 INFO:teuthology.orchestra.run.smithi046.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCbvKVkpp1TIhAAvJTELoeH8wkIFqjtppg17w== -o context=system_u:object_r:root_t:s0 172.21.15.46:6789:/scratch /tmp/tmp.KrMG67MsYpscratch 2023-07-06T00:50:10.344 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-06T00:50:10.706 INFO:teuthology.orchestra.run.smithi046.stdout:generic/560 [not run] duperemove utility required, skipped this test 2023-07-06T00:50:10.710 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/560 2023-07-06T00:50:10.711 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/560 2023-07-06T00:50:10.711 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-07-06T00:50:10.712 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-06T00:50:10.738 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-06T00:50:10.739 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.rlt8E1h3iVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/561) 2023-07-06T00:50:10.963 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph 2023-07-06T00:50:10.967 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-06T00:50:10.968 INFO:teuthology.orchestra.run.smithi046.stdout:MKFS_OPTIONS -- 172.21.15.46:6789:/scratch 2023-07-06T00:50:10.969 INFO:teuthology.orchestra.run.smithi046.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCbvKVkpp1TIhAAvJTELoeH8wkIFqjtppg17w== -o context=system_u:object_r:root_t:s0 172.21.15.46:6789:/scratch /tmp/tmp.KrMG67MsYpscratch 2023-07-06T00:50:10.969 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-06T00:50:11.330 INFO:teuthology.orchestra.run.smithi046.stdout:generic/561 [not run] duperemove utility required, skipped this test 2023-07-06T00:50:11.334 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/561 2023-07-06T00:50:11.335 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/561 2023-07-06T00:50:11.335 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-07-06T00:50:11.337 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-06T00:50:11.363 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-06T00:50:11.364 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.rlt8E1h3iVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/562) 2023-07-06T00:50:11.587 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph 2023-07-06T00:50:11.591 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-06T00:50:11.592 INFO:teuthology.orchestra.run.smithi046.stdout:MKFS_OPTIONS -- 172.21.15.46:6789:/scratch 2023-07-06T00:50:11.592 INFO:teuthology.orchestra.run.smithi046.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCbvKVkpp1TIhAAvJTELoeH8wkIFqjtppg17w== -o context=system_u:object_r:root_t:s0 172.21.15.46:6789:/scratch /tmp/tmp.KrMG67MsYpscratch 2023-07-06T00:50:11.593 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-06T00:50:12.404 INFO:teuthology.orchestra.run.smithi046.stdout:generic/562 [not run] Reflink not supported by scratch filesystem type: ceph 2023-07-06T00:50:12.414 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/562 2023-07-06T00:50:12.414 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/562 2023-07-06T00:50:12.415 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-07-06T00:50:12.499 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-06T00:50:12.592 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-06T00:50:12.593 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.rlt8E1h3iVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/563) 2023-07-06T00:50:12.798 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-06T00:50:12.800 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-06T00:50:12.825 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph 2023-07-06T00:50:12.829 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-06T00:50:12.830 INFO:teuthology.orchestra.run.smithi046.stdout:MKFS_OPTIONS -- 172.21.15.46:6789:/scratch 2023-07-06T00:50:12.831 INFO:teuthology.orchestra.run.smithi046.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCbvKVkpp1TIhAAvJTELoeH8wkIFqjtppg17w== -o context=system_u:object_r:root_t:s0 172.21.15.46:6789:/scratch /tmp/tmp.KrMG67MsYpscratch 2023-07-06T00:50:12.831 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-06T00:50:13.226 INFO:teuthology.orchestra.run.smithi046.stdout:generic/563 [not run] cgroup2 not mounted on /sys/fs/cgroup 2023-07-06T00:50:13.230 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/563 2023-07-06T00:50:13.231 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/563 2023-07-06T00:50:13.231 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-07-06T00:50:13.233 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-06T00:50:13.262 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-06T00:50:13.263 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.rlt8E1h3iVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/564) 2023-07-06T00:50:13.486 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph 2023-07-06T00:50:13.492 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-06T00:50:13.493 INFO:teuthology.orchestra.run.smithi046.stdout:MKFS_OPTIONS -- 172.21.15.46:6789:/scratch 2023-07-06T00:50:13.493 INFO:teuthology.orchestra.run.smithi046.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCbvKVkpp1TIhAAvJTELoeH8wkIFqjtppg17w== -o context=system_u:object_r:root_t:s0 172.21.15.46:6789:/scratch /tmp/tmp.KrMG67MsYpscratch 2023-07-06T00:50:13.493 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-06T00:50:13.904 INFO:teuthology.orchestra.run.smithi046.stdout:generic/564 [not run] xfs_io copy_range doesn't support -f 2023-07-06T00:50:13.908 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/564 2023-07-06T00:50:13.908 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/564 2023-07-06T00:50:13.909 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-07-06T00:50:13.910 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-06T00:50:14.281 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-06T00:50:14.281 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.rlt8E1h3iVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/565) 2023-07-06T00:50:14.577 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph 2023-07-06T00:50:14.581 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-06T00:50:14.582 INFO:teuthology.orchestra.run.smithi046.stdout:MKFS_OPTIONS -- 172.21.15.46:6789:/scratch 2023-07-06T00:50:14.583 INFO:teuthology.orchestra.run.smithi046.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCbvKVkpp1TIhAAvJTELoeH8wkIFqjtppg17w== -o context=system_u:object_r:root_t:s0 172.21.15.46:6789:/scratch /tmp/tmp.KrMG67MsYpscratch 2023-07-06T00:50:14.583 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-06T00:50:15.222 INFO:teuthology.orchestra.run.smithi046.stdout:generic/565 1s 2023-07-06T00:50:15.227 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/565 2023-07-06T00:50:15.227 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-07-06T00:50:15.229 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-06T00:50:15.606 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-06T00:50:15.607 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.rlt8E1h3iVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/566) 2023-07-06T00:50:15.872 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph 2023-07-06T00:50:15.876 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-06T00:50:15.877 INFO:teuthology.orchestra.run.smithi046.stdout:MKFS_OPTIONS -- 172.21.15.46:6789:/scratch 2023-07-06T00:50:15.877 INFO:teuthology.orchestra.run.smithi046.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCbvKVkpp1TIhAAvJTELoeH8wkIFqjtppg17w== -o context=system_u:object_r:root_t:s0 172.21.15.46:6789:/scratch /tmp/tmp.KrMG67MsYpscratch 2023-07-06T00:50:15.878 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-06T00:50:16.243 INFO:teuthology.orchestra.run.smithi046.stdout:generic/566 [not run] disk quotas not supported by this filesystem type: ceph 2023-07-06T00:50:16.247 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/566 2023-07-06T00:50:16.247 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/566 2023-07-06T00:50:16.247 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-07-06T00:50:16.249 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-06T00:50:16.281 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-06T00:50:16.282 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.rlt8E1h3iVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/567) 2023-07-06T00:50:16.514 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph 2023-07-06T00:50:16.518 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-06T00:50:16.518 INFO:teuthology.orchestra.run.smithi046.stdout:MKFS_OPTIONS -- 172.21.15.46:6789:/scratch 2023-07-06T00:50:16.519 INFO:teuthology.orchestra.run.smithi046.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCbvKVkpp1TIhAAvJTELoeH8wkIFqjtppg17w== -o context=system_u:object_r:root_t:s0 172.21.15.46:6789:/scratch /tmp/tmp.KrMG67MsYpscratch 2023-07-06T00:50:16.520 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-06T00:50:17.372 INFO:teuthology.orchestra.run.smithi046.stdout:generic/567 1s 2023-07-06T00:50:17.377 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/567 2023-07-06T00:50:17.378 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-07-06T00:50:17.379 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-06T00:50:17.388 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-06T00:50:17.389 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.rlt8E1h3iVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/568) 2023-07-06T00:50:17.623 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph 2023-07-06T00:50:17.628 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-06T00:50:17.628 INFO:teuthology.orchestra.run.smithi046.stdout:MKFS_OPTIONS -- 172.21.15.46:6789:/scratch 2023-07-06T00:50:17.629 INFO:teuthology.orchestra.run.smithi046.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCbvKVkpp1TIhAAvJTELoeH8wkIFqjtppg17w== -o context=system_u:object_r:root_t:s0 172.21.15.46:6789:/scratch /tmp/tmp.KrMG67MsYpscratch 2023-07-06T00:50:17.629 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-06T00:50:17.993 INFO:teuthology.orchestra.run.smithi046.stdout:generic/568 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-07-06T00:50:17.997 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/568 2023-07-06T00:50:17.997 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/568 2023-07-06T00:50:17.997 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-07-06T00:50:17.999 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-06T00:50:18.038 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-06T00:50:18.039 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.rlt8E1h3iVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/569) 2023-07-06T00:50:18.284 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph 2023-07-06T00:50:18.288 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-06T00:50:18.289 INFO:teuthology.orchestra.run.smithi046.stdout:MKFS_OPTIONS -- 172.21.15.46:6789:/scratch 2023-07-06T00:50:18.290 INFO:teuthology.orchestra.run.smithi046.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCbvKVkpp1TIhAAvJTELoeH8wkIFqjtppg17w== -o context=system_u:object_r:root_t:s0 172.21.15.46:6789:/scratch /tmp/tmp.KrMG67MsYpscratch 2023-07-06T00:50:18.290 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-06T00:50:18.652 INFO:teuthology.orchestra.run.smithi046.stdout:generic/569 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-07-06T00:50:18.656 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/569 2023-07-06T00:50:18.657 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/569 2023-07-06T00:50:18.657 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-07-06T00:50:18.659 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-06T00:50:18.699 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-06T00:50:18.700 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.rlt8E1h3iVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/570) 2023-07-06T00:50:18.929 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph 2023-07-06T00:50:18.933 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-06T00:50:18.934 INFO:teuthology.orchestra.run.smithi046.stdout:MKFS_OPTIONS -- 172.21.15.46:6789:/scratch 2023-07-06T00:50:18.934 INFO:teuthology.orchestra.run.smithi046.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCbvKVkpp1TIhAAvJTELoeH8wkIFqjtppg17w== -o context=system_u:object_r:root_t:s0 172.21.15.46:6789:/scratch /tmp/tmp.KrMG67MsYpscratch 2023-07-06T00:50:18.935 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-06T00:50:19.282 INFO:teuthology.orchestra.run.smithi046.stdout:generic/570 [not run] require 172.21.15.46:6789:/scratch to be valid block disk 2023-07-06T00:50:19.286 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/570 2023-07-06T00:50:19.286 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/570 2023-07-06T00:50:19.286 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-07-06T00:50:19.288 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-06T00:50:19.321 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-06T00:50:19.321 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.rlt8E1h3iVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/571) 2023-07-06T00:50:19.555 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph 2023-07-06T00:50:19.559 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-06T00:50:19.560 INFO:teuthology.orchestra.run.smithi046.stdout:MKFS_OPTIONS -- 172.21.15.46:6789:/scratch 2023-07-06T00:50:19.560 INFO:teuthology.orchestra.run.smithi046.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCbvKVkpp1TIhAAvJTELoeH8wkIFqjtppg17w== -o context=system_u:object_r:root_t:s0 172.21.15.46:6789:/scratch /tmp/tmp.KrMG67MsYpscratch 2023-07-06T00:50:19.561 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-06T00:50:19.956 INFO:teuthology.orchestra.run.smithi046.stdout:generic/571 [not run] Require fcntl setlease support 2023-07-06T00:50:19.960 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/571 2023-07-06T00:50:19.960 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/571 2023-07-06T00:50:19.960 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-07-06T00:50:19.962 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-06T00:50:19.993 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-06T00:50:19.994 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.rlt8E1h3iVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/572) 2023-07-06T00:50:20.218 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph 2023-07-06T00:50:20.223 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-06T00:50:20.223 INFO:teuthology.orchestra.run.smithi046.stdout:MKFS_OPTIONS -- 172.21.15.46:6789:/scratch 2023-07-06T00:50:20.224 INFO:teuthology.orchestra.run.smithi046.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCbvKVkpp1TIhAAvJTELoeH8wkIFqjtppg17w== -o context=system_u:object_r:root_t:s0 172.21.15.46:6789:/scratch /tmp/tmp.KrMG67MsYpscratch 2023-07-06T00:50:20.224 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-06T00:50:20.597 INFO:teuthology.orchestra.run.smithi046.stdout:generic/572 [not run] fsverity utility required, skipped this test 2023-07-06T00:50:20.601 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/572 2023-07-06T00:50:20.601 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/572 2023-07-06T00:50:20.602 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-07-06T00:50:20.603 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-06T00:50:20.625 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-06T00:50:20.625 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.rlt8E1h3iVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/573) 2023-07-06T00:50:20.851 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph 2023-07-06T00:50:20.855 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-06T00:50:20.855 INFO:teuthology.orchestra.run.smithi046.stdout:MKFS_OPTIONS -- 172.21.15.46:6789:/scratch 2023-07-06T00:50:20.856 INFO:teuthology.orchestra.run.smithi046.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCbvKVkpp1TIhAAvJTELoeH8wkIFqjtppg17w== -o context=system_u:object_r:root_t:s0 172.21.15.46:6789:/scratch /tmp/tmp.KrMG67MsYpscratch 2023-07-06T00:50:20.856 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-06T00:50:21.217 INFO:teuthology.orchestra.run.smithi046.stdout:generic/573 [not run] fsverity utility required, skipped this test 2023-07-06T00:50:21.221 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/573 2023-07-06T00:50:21.221 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/573 2023-07-06T00:50:21.221 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-07-06T00:50:21.223 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-06T00:50:21.260 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-06T00:50:21.260 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.rlt8E1h3iVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/574) 2023-07-06T00:50:21.488 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph 2023-07-06T00:50:21.492 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-06T00:50:21.493 INFO:teuthology.orchestra.run.smithi046.stdout:MKFS_OPTIONS -- 172.21.15.46:6789:/scratch 2023-07-06T00:50:21.493 INFO:teuthology.orchestra.run.smithi046.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCbvKVkpp1TIhAAvJTELoeH8wkIFqjtppg17w== -o context=system_u:object_r:root_t:s0 172.21.15.46:6789:/scratch /tmp/tmp.KrMG67MsYpscratch 2023-07-06T00:50:21.494 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-06T00:50:21.848 INFO:teuthology.orchestra.run.smithi046.stdout:generic/574 [not run] fsverity utility required, skipped this test 2023-07-06T00:50:21.852 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/574 2023-07-06T00:50:21.853 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/574 2023-07-06T00:50:21.853 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-07-06T00:50:21.855 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-06T00:50:21.885 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-06T00:50:21.885 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.rlt8E1h3iVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/575) 2023-07-06T00:50:22.127 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph 2023-07-06T00:50:22.131 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-06T00:50:22.131 INFO:teuthology.orchestra.run.smithi046.stdout:MKFS_OPTIONS -- 172.21.15.46:6789:/scratch 2023-07-06T00:50:22.132 INFO:teuthology.orchestra.run.smithi046.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCbvKVkpp1TIhAAvJTELoeH8wkIFqjtppg17w== -o context=system_u:object_r:root_t:s0 172.21.15.46:6789:/scratch /tmp/tmp.KrMG67MsYpscratch 2023-07-06T00:50:22.132 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-06T00:50:22.471 INFO:teuthology.orchestra.run.smithi046.stdout:generic/575 [not run] fsverity utility required, skipped this test 2023-07-06T00:50:22.475 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/575 2023-07-06T00:50:22.476 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/575 2023-07-06T00:50:22.476 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-07-06T00:50:22.478 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-06T00:50:22.511 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-06T00:50:22.512 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.rlt8E1h3iVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/576) 2023-07-06T00:50:22.756 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph 2023-07-06T00:50:22.760 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-06T00:50:22.760 INFO:teuthology.orchestra.run.smithi046.stdout:MKFS_OPTIONS -- 172.21.15.46:6789:/scratch 2023-07-06T00:50:22.761 INFO:teuthology.orchestra.run.smithi046.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCbvKVkpp1TIhAAvJTELoeH8wkIFqjtppg17w== -o context=system_u:object_r:root_t:s0 172.21.15.46:6789:/scratch /tmp/tmp.KrMG67MsYpscratch 2023-07-06T00:50:22.761 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-06T00:50:23.146 INFO:teuthology.orchestra.run.smithi046.stdout:generic/576 [not run] fsverity utility required, skipped this test 2023-07-06T00:50:23.150 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/576 2023-07-06T00:50:23.150 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/576 2023-07-06T00:50:23.151 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-07-06T00:50:23.152 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-06T00:50:23.180 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-06T00:50:23.181 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.rlt8E1h3iVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/577) 2023-07-06T00:50:23.406 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph 2023-07-06T00:50:23.410 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-06T00:50:23.410 INFO:teuthology.orchestra.run.smithi046.stdout:MKFS_OPTIONS -- 172.21.15.46:6789:/scratch 2023-07-06T00:50:23.411 INFO:teuthology.orchestra.run.smithi046.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCbvKVkpp1TIhAAvJTELoeH8wkIFqjtppg17w== -o context=system_u:object_r:root_t:s0 172.21.15.46:6789:/scratch /tmp/tmp.KrMG67MsYpscratch 2023-07-06T00:50:23.411 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-06T00:50:23.777 INFO:teuthology.orchestra.run.smithi046.stdout:generic/577 [not run] fsverity utility required, skipped this test 2023-07-06T00:50:23.781 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/577 2023-07-06T00:50:23.781 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/577 2023-07-06T00:50:23.782 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-07-06T00:50:23.783 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-06T00:50:23.813 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-06T00:50:23.814 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.rlt8E1h3iVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/578) 2023-07-06T00:50:24.049 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph 2023-07-06T00:50:24.054 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-06T00:50:24.054 INFO:teuthology.orchestra.run.smithi046.stdout:MKFS_OPTIONS -- 172.21.15.46:6789:/scratch 2023-07-06T00:50:24.055 INFO:teuthology.orchestra.run.smithi046.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCbvKVkpp1TIhAAvJTELoeH8wkIFqjtppg17w== -o context=system_u:object_r:root_t:s0 172.21.15.46:6789:/scratch /tmp/tmp.KrMG67MsYpscratch 2023-07-06T00:50:24.055 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-06T00:50:24.453 INFO:teuthology.orchestra.run.smithi046.stdout:generic/578 [not run] Reflink not supported by test filesystem type: ceph 2023-07-06T00:50:24.457 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/578 2023-07-06T00:50:24.458 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/578 2023-07-06T00:50:24.458 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-07-06T00:50:24.459 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-06T00:50:24.721 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-06T00:50:24.722 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.rlt8E1h3iVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/579) 2023-07-06T00:50:25.132 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph 2023-07-06T00:50:25.137 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-06T00:50:25.137 INFO:teuthology.orchestra.run.smithi046.stdout:MKFS_OPTIONS -- 172.21.15.46:6789:/scratch 2023-07-06T00:50:25.138 INFO:teuthology.orchestra.run.smithi046.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCbvKVkpp1TIhAAvJTELoeH8wkIFqjtppg17w== -o context=system_u:object_r:root_t:s0 172.21.15.46:6789:/scratch /tmp/tmp.KrMG67MsYpscratch 2023-07-06T00:50:25.138 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-06T00:50:25.507 INFO:teuthology.orchestra.run.smithi046.stdout:generic/579 [not run] fsverity utility required, skipped this test 2023-07-06T00:50:25.511 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/579 2023-07-06T00:50:25.511 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/579 2023-07-06T00:50:25.511 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-07-06T00:50:25.513 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-06T00:50:25.542 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-06T00:50:25.542 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.rlt8E1h3iVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/580) 2023-07-06T00:50:25.790 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph 2023-07-06T00:50:25.791 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-06T00:50:25.791 INFO:teuthology.orchestra.run.smithi046.stdout:MKFS_OPTIONS -- 172.21.15.46:6789:/scratch 2023-07-06T00:50:25.791 INFO:teuthology.orchestra.run.smithi046.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCbvKVkpp1TIhAAvJTELoeH8wkIFqjtppg17w== -o context=system_u:object_r:root_t:s0 172.21.15.46:6789:/scratch /tmp/tmp.KrMG67MsYpscratch 2023-07-06T00:50:25.791 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-06T00:50:26.380 INFO:teuthology.orchestra.run.smithi046.stdout:generic/580 [not run] kernel does not support ceph encryption 2023-07-06T00:50:26.411 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/580 2023-07-06T00:50:26.411 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/580 2023-07-06T00:50:26.411 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-07-06T00:50:26.413 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-06T00:50:26.437 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-06T00:50:26.438 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.rlt8E1h3iVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/581) 2023-07-06T00:50:26.673 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph 2023-07-06T00:50:26.677 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-06T00:50:26.677 INFO:teuthology.orchestra.run.smithi046.stdout:MKFS_OPTIONS -- 172.21.15.46:6789:/scratch 2023-07-06T00:50:26.678 INFO:teuthology.orchestra.run.smithi046.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCbvKVkpp1TIhAAvJTELoeH8wkIFqjtppg17w== -o context=system_u:object_r:root_t:s0 172.21.15.46:6789:/scratch /tmp/tmp.KrMG67MsYpscratch 2023-07-06T00:50:26.678 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-06T00:50:27.530 INFO:teuthology.orchestra.run.smithi046.stdout:generic/581 [not run] kernel does not support ceph encryption 2023-07-06T00:50:27.549 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/581 2023-07-06T00:50:27.550 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/581 2023-07-06T00:50:27.550 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-07-06T00:50:27.552 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-06T00:50:27.576 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-06T00:50:27.577 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.rlt8E1h3iVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/582) 2023-07-06T00:50:27.806 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph 2023-07-06T00:50:27.811 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-06T00:50:27.811 INFO:teuthology.orchestra.run.smithi046.stdout:MKFS_OPTIONS -- 172.21.15.46:6789:/scratch 2023-07-06T00:50:27.812 INFO:teuthology.orchestra.run.smithi046.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCbvKVkpp1TIhAAvJTELoeH8wkIFqjtppg17w== -o context=system_u:object_r:root_t:s0 172.21.15.46:6789:/scratch /tmp/tmp.KrMG67MsYpscratch 2023-07-06T00:50:27.812 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-06T00:50:28.400 INFO:teuthology.orchestra.run.smithi046.stdout:generic/582 [not run] kernel does not support ceph encryption 2023-07-06T00:50:28.431 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/582 2023-07-06T00:50:28.432 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/582 2023-07-06T00:50:28.432 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-07-06T00:50:28.433 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-06T00:50:28.471 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-06T00:50:28.471 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.rlt8E1h3iVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/583) 2023-07-06T00:50:28.702 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph 2023-07-06T00:50:28.706 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-06T00:50:28.707 INFO:teuthology.orchestra.run.smithi046.stdout:MKFS_OPTIONS -- 172.21.15.46:6789:/scratch 2023-07-06T00:50:28.708 INFO:teuthology.orchestra.run.smithi046.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCbvKVkpp1TIhAAvJTELoeH8wkIFqjtppg17w== -o context=system_u:object_r:root_t:s0 172.21.15.46:6789:/scratch /tmp/tmp.KrMG67MsYpscratch 2023-07-06T00:50:28.708 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-06T00:50:29.299 INFO:teuthology.orchestra.run.smithi046.stdout:generic/583 [not run] kernel does not support ceph encryption 2023-07-06T00:50:29.323 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/583 2023-07-06T00:50:29.324 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/583 2023-07-06T00:50:29.324 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-07-06T00:50:29.325 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-06T00:50:29.350 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-06T00:50:29.351 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.rlt8E1h3iVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/584) 2023-07-06T00:50:29.586 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph 2023-07-06T00:50:29.591 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-06T00:50:29.591 INFO:teuthology.orchestra.run.smithi046.stdout:MKFS_OPTIONS -- 172.21.15.46:6789:/scratch 2023-07-06T00:50:29.592 INFO:teuthology.orchestra.run.smithi046.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCbvKVkpp1TIhAAvJTELoeH8wkIFqjtppg17w== -o context=system_u:object_r:root_t:s0 172.21.15.46:6789:/scratch /tmp/tmp.KrMG67MsYpscratch 2023-07-06T00:50:29.592 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-06T00:50:30.210 INFO:teuthology.orchestra.run.smithi046.stdout:generic/584 [not run] kernel does not support ceph encryption 2023-07-06T00:50:30.229 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/584 2023-07-06T00:50:30.230 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/584 2023-07-06T00:50:30.230 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-07-06T00:50:30.231 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-06T00:50:30.262 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-06T00:50:30.262 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.rlt8E1h3iVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/585) 2023-07-06T00:50:30.488 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph 2023-07-06T00:50:30.492 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-06T00:50:30.492 INFO:teuthology.orchestra.run.smithi046.stdout:MKFS_OPTIONS -- 172.21.15.46:6789:/scratch 2023-07-06T00:50:30.493 INFO:teuthology.orchestra.run.smithi046.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCbvKVkpp1TIhAAvJTELoeH8wkIFqjtppg17w== -o context=system_u:object_r:root_t:s0 172.21.15.46:6789:/scratch /tmp/tmp.KrMG67MsYpscratch 2023-07-06T00:50:30.494 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-06T00:50:30.921 INFO:teuthology.orchestra.run.smithi046.stdout:generic/585 [not run] kernel doesn't support renameat2 syscall 2023-07-06T00:50:30.925 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/585 2023-07-06T00:50:30.925 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/585 2023-07-06T00:50:30.926 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-07-06T00:50:30.927 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-06T00:50:31.310 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-06T00:50:31.310 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.rlt8E1h3iVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/586) 2023-07-06T00:50:31.570 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph 2023-07-06T00:50:31.574 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-06T00:50:31.574 INFO:teuthology.orchestra.run.smithi046.stdout:MKFS_OPTIONS -- 172.21.15.46:6789:/scratch 2023-07-06T00:50:31.575 INFO:teuthology.orchestra.run.smithi046.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCbvKVkpp1TIhAAvJTELoeH8wkIFqjtppg17w== -o context=system_u:object_r:root_t:s0 172.21.15.46:6789:/scratch /tmp/tmp.KrMG67MsYpscratch 2023-07-06T00:50:31.575 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-06T00:50:32.000 INFO:teuthology.orchestra.run.smithi046.stdout:generic/586 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-07-06T00:50:32.004 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/586 2023-07-06T00:50:32.005 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/586 2023-07-06T00:50:32.005 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-07-06T00:50:32.006 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-06T00:50:32.401 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-06T00:50:32.402 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.rlt8E1h3iVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/587) 2023-07-06T00:50:32.650 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph 2023-07-06T00:50:32.654 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-06T00:50:32.655 INFO:teuthology.orchestra.run.smithi046.stdout:MKFS_OPTIONS -- 172.21.15.46:6789:/scratch 2023-07-06T00:50:32.656 INFO:teuthology.orchestra.run.smithi046.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCbvKVkpp1TIhAAvJTELoeH8wkIFqjtppg17w== -o context=system_u:object_r:root_t:s0 172.21.15.46:6789:/scratch /tmp/tmp.KrMG67MsYpscratch 2023-07-06T00:50:32.656 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-06T00:50:33.050 INFO:teuthology.orchestra.run.smithi046.stdout:generic/587 [not run] disk quotas not supported by this filesystem type: ceph 2023-07-06T00:50:33.054 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/587 2023-07-06T00:50:33.054 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/587 2023-07-06T00:50:33.054 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-07-06T00:50:33.056 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-06T00:50:33.089 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-06T00:50:33.089 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.rlt8E1h3iVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/588) 2023-07-06T00:50:33.326 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph 2023-07-06T00:50:33.331 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-06T00:50:33.331 INFO:teuthology.orchestra.run.smithi046.stdout:MKFS_OPTIONS -- 172.21.15.46:6789:/scratch 2023-07-06T00:50:33.332 INFO:teuthology.orchestra.run.smithi046.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCbvKVkpp1TIhAAvJTELoeH8wkIFqjtppg17w== -o context=system_u:object_r:root_t:s0 172.21.15.46:6789:/scratch /tmp/tmp.KrMG67MsYpscratch 2023-07-06T00:50:33.332 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-06T00:50:34.240 INFO:teuthology.orchestra.run.smithi046.stdout:generic/588 [not run] Reflink not supported by scratch filesystem type: ceph 2023-07-06T00:50:34.339 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/588 2023-07-06T00:50:34.339 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/588 2023-07-06T00:50:34.339 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-07-06T00:50:34.340 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-06T00:50:34.340 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-06T00:50:34.341 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.rlt8E1h3iVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/589) 2023-07-06T00:50:34.564 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph 2023-07-06T00:50:34.568 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-06T00:50:34.569 INFO:teuthology.orchestra.run.smithi046.stdout:MKFS_OPTIONS -- 172.21.15.46:6789:/scratch 2023-07-06T00:50:34.569 INFO:teuthology.orchestra.run.smithi046.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCbvKVkpp1TIhAAvJTELoeH8wkIFqjtppg17w== -o context=system_u:object_r:root_t:s0 172.21.15.46:6789:/scratch /tmp/tmp.KrMG67MsYpscratch 2023-07-06T00:50:34.570 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-06T00:50:34.925 INFO:teuthology.orchestra.run.smithi046.stdout:generic/589 [not run] require 172.21.15.46:6789:/scratch to be local device 2023-07-06T00:50:34.929 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/589 2023-07-06T00:50:34.929 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/589 2023-07-06T00:50:34.930 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-07-06T00:50:34.931 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-06T00:50:34.961 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-06T00:50:34.962 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.rlt8E1h3iVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/590) 2023-07-06T00:50:35.188 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph 2023-07-06T00:50:35.192 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-06T00:50:35.193 INFO:teuthology.orchestra.run.smithi046.stdout:MKFS_OPTIONS -- 172.21.15.46:6789:/scratch 2023-07-06T00:50:35.194 INFO:teuthology.orchestra.run.smithi046.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCbvKVkpp1TIhAAvJTELoeH8wkIFqjtppg17w== -o context=system_u:object_r:root_t:s0 172.21.15.46:6789:/scratch /tmp/tmp.KrMG67MsYpscratch 2023-07-06T00:50:35.194 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-06T00:50:35.572 INFO:teuthology.orchestra.run.smithi046.stdout:generic/590 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-07-06T00:50:35.576 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/590 2023-07-06T00:50:35.577 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/590 2023-07-06T00:50:35.577 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-07-06T00:50:35.578 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-06T00:50:35.612 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-06T00:50:35.613 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.rlt8E1h3iVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/591) 2023-07-06T00:50:35.857 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph 2023-07-06T00:50:35.861 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-06T00:50:35.862 INFO:teuthology.orchestra.run.smithi046.stdout:MKFS_OPTIONS -- 172.21.15.46:6789:/scratch 2023-07-06T00:50:35.863 INFO:teuthology.orchestra.run.smithi046.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCbvKVkpp1TIhAAvJTELoeH8wkIFqjtppg17w== -o context=system_u:object_r:root_t:s0 172.21.15.46:6789:/scratch /tmp/tmp.KrMG67MsYpscratch 2023-07-06T00:50:35.863 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-06T00:50:36.346 INFO:teuthology.orchestra.run.smithi046.stdout:generic/591 0s 2023-07-06T00:50:36.351 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/591 2023-07-06T00:50:36.351 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-07-06T00:50:36.353 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-06T00:50:36.744 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-06T00:50:36.745 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.rlt8E1h3iVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/592) 2023-07-06T00:50:37.007 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph 2023-07-06T00:50:37.011 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-06T00:50:37.012 INFO:teuthology.orchestra.run.smithi046.stdout:MKFS_OPTIONS -- 172.21.15.46:6789:/scratch 2023-07-06T00:50:37.013 INFO:teuthology.orchestra.run.smithi046.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCbvKVkpp1TIhAAvJTELoeH8wkIFqjtppg17w== -o context=system_u:object_r:root_t:s0 172.21.15.46:6789:/scratch /tmp/tmp.KrMG67MsYpscratch 2023-07-06T00:50:37.013 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-06T00:50:37.617 INFO:teuthology.orchestra.run.smithi046.stdout:generic/592 [not run] kernel does not support ceph encryption 2023-07-06T00:50:37.645 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/592 2023-07-06T00:50:37.645 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/592 2023-07-06T00:50:37.646 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-07-06T00:50:37.647 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-06T00:50:37.673 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-06T00:50:37.673 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.rlt8E1h3iVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/593) 2023-07-06T00:50:37.917 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph 2023-07-06T00:50:37.921 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-06T00:50:37.922 INFO:teuthology.orchestra.run.smithi046.stdout:MKFS_OPTIONS -- 172.21.15.46:6789:/scratch 2023-07-06T00:50:37.923 INFO:teuthology.orchestra.run.smithi046.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCbvKVkpp1TIhAAvJTELoeH8wkIFqjtppg17w== -o context=system_u:object_r:root_t:s0 172.21.15.46:6789:/scratch /tmp/tmp.KrMG67MsYpscratch 2023-07-06T00:50:37.923 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-06T00:50:38.514 INFO:teuthology.orchestra.run.smithi046.stdout:generic/593 [not run] kernel does not support ceph encryption 2023-07-06T00:50:38.537 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/593 2023-07-06T00:50:38.538 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/593 2023-07-06T00:50:38.538 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-07-06T00:50:38.539 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-06T00:50:38.568 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-06T00:50:38.569 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.rlt8E1h3iVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/594) 2023-07-06T00:50:38.795 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph 2023-07-06T00:50:38.799 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-06T00:50:38.800 INFO:teuthology.orchestra.run.smithi046.stdout:MKFS_OPTIONS -- 172.21.15.46:6789:/scratch 2023-07-06T00:50:38.801 INFO:teuthology.orchestra.run.smithi046.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCbvKVkpp1TIhAAvJTELoeH8wkIFqjtppg17w== -o context=system_u:object_r:root_t:s0 172.21.15.46:6789:/scratch /tmp/tmp.KrMG67MsYpscratch 2023-07-06T00:50:38.801 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-06T00:50:39.175 INFO:teuthology.orchestra.run.smithi046.stdout:generic/594 [not run] disk quotas not supported by this filesystem type: ceph 2023-07-06T00:50:39.180 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/594 2023-07-06T00:50:39.180 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/594 2023-07-06T00:50:39.180 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-07-06T00:50:39.182 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-06T00:50:39.208 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-06T00:50:39.209 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.rlt8E1h3iVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/595) 2023-07-06T00:50:39.456 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph 2023-07-06T00:50:39.460 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-06T00:50:39.461 INFO:teuthology.orchestra.run.smithi046.stdout:MKFS_OPTIONS -- 172.21.15.46:6789:/scratch 2023-07-06T00:50:39.461 INFO:teuthology.orchestra.run.smithi046.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCbvKVkpp1TIhAAvJTELoeH8wkIFqjtppg17w== -o context=system_u:object_r:root_t:s0 172.21.15.46:6789:/scratch /tmp/tmp.KrMG67MsYpscratch 2023-07-06T00:50:39.462 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-06T00:50:40.055 INFO:teuthology.orchestra.run.smithi046.stdout:generic/595 [not run] kernel does not support ceph encryption 2023-07-06T00:50:40.075 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/595 2023-07-06T00:50:40.075 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/595 2023-07-06T00:50:40.076 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-07-06T00:50:40.077 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-06T00:50:40.110 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-06T00:50:40.110 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.rlt8E1h3iVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/596) 2023-07-06T00:50:40.347 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph 2023-07-06T00:50:40.351 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-06T00:50:40.352 INFO:teuthology.orchestra.run.smithi046.stdout:MKFS_OPTIONS -- 172.21.15.46:6789:/scratch 2023-07-06T00:50:40.353 INFO:teuthology.orchestra.run.smithi046.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCbvKVkpp1TIhAAvJTELoeH8wkIFqjtppg17w== -o context=system_u:object_r:root_t:s0 172.21.15.46:6789:/scratch /tmp/tmp.KrMG67MsYpscratch 2023-07-06T00:50:40.353 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-06T00:50:40.786 INFO:teuthology.orchestra.run.smithi046.stdout:generic/596 [not run] file system doesn't support chattr +S 2023-07-06T00:50:40.790 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/596 2023-07-06T00:50:40.791 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/596 2023-07-06T00:50:40.791 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-07-06T00:50:40.793 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-06T00:50:40.830 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-06T00:50:40.830 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.rlt8E1h3iVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/597) 2023-07-06T00:50:41.055 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph 2023-07-06T00:50:41.059 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-06T00:50:41.060 INFO:teuthology.orchestra.run.smithi046.stdout:MKFS_OPTIONS -- 172.21.15.46:6789:/scratch 2023-07-06T00:50:41.061 INFO:teuthology.orchestra.run.smithi046.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCbvKVkpp1TIhAAvJTELoeH8wkIFqjtppg17w== -o context=system_u:object_r:root_t:s0 172.21.15.46:6789:/scratch /tmp/tmp.KrMG67MsYpscratch 2023-07-06T00:50:41.061 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-06T00:50:41.758 INFO:teuthology.orchestra.run.smithi046.stdout:generic/597 0s 2023-07-06T00:50:41.762 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/597 2023-07-06T00:50:41.762 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-07-06T00:50:41.764 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-06T00:50:42.106 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-06T00:50:42.106 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.rlt8E1h3iVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/598) 2023-07-06T00:50:42.435 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph 2023-07-06T00:50:42.438 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-06T00:50:42.438 INFO:teuthology.orchestra.run.smithi046.stdout:MKFS_OPTIONS -- 172.21.15.46:6789:/scratch 2023-07-06T00:50:42.439 INFO:teuthology.orchestra.run.smithi046.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCbvKVkpp1TIhAAvJTELoeH8wkIFqjtppg17w== -o context=system_u:object_r:root_t:s0 172.21.15.46:6789:/scratch /tmp/tmp.KrMG67MsYpscratch 2023-07-06T00:50:42.439 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-06T00:50:42.929 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-06T00:50:42.932 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-06T00:50:43.034 INFO:tasks.ceph.osd.6.smithi073.stderr:2023-07-06T00:50:43.031+0000 7f2582084700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 126977) UID: 0 2023-07-06T00:50:43.034 INFO:tasks.ceph.osd.7.smithi073.stderr:2023-07-06T00:50:43.031+0000 7fe6067a5700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 126977) UID: 0 2023-07-06T00:50:43.035 INFO:tasks.ceph.osd.4.smithi073.stderr:2023-07-06T00:50:43.031+0000 7fb7867e9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 126977) UID: 0 2023-07-06T00:50:43.036 INFO:tasks.ceph.osd.5.smithi073.stderr:2023-07-06T00:50:43.031+0000 7f1dead60700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 126977) UID: 0 2023-07-06T00:50:43.153 INFO:teuthology.orchestra.run.smithi046.stdout:generic/598 1s 2023-07-06T00:50:43.158 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/598 2023-07-06T00:50:43.159 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-07-06T00:50:43.161 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-06T00:50:43.509 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-06T00:50:43.510 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.rlt8E1h3iVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/599) 2023-07-06T00:50:43.792 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph 2023-07-06T00:50:43.797 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-06T00:50:43.797 INFO:teuthology.orchestra.run.smithi046.stdout:MKFS_OPTIONS -- 172.21.15.46:6789:/scratch 2023-07-06T00:50:43.798 INFO:teuthology.orchestra.run.smithi046.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCbvKVkpp1TIhAAvJTELoeH8wkIFqjtppg17w== -o context=system_u:object_r:root_t:s0 172.21.15.46:6789:/scratch /tmp/tmp.KrMG67MsYpscratch 2023-07-06T00:50:43.798 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-06T00:50:44.343 INFO:teuthology.orchestra.run.smithi046.stdout:generic/599 [not run] ceph does not support shutdown 2023-07-06T00:50:44.362 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/599 2023-07-06T00:50:44.362 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/599 2023-07-06T00:50:44.362 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-07-06T00:50:44.364 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-06T00:50:44.388 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-06T00:50:44.389 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.rlt8E1h3iVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/600) 2023-07-06T00:50:44.612 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph 2023-07-06T00:50:44.616 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-06T00:50:44.617 INFO:teuthology.orchestra.run.smithi046.stdout:MKFS_OPTIONS -- 172.21.15.46:6789:/scratch 2023-07-06T00:50:44.618 INFO:teuthology.orchestra.run.smithi046.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCbvKVkpp1TIhAAvJTELoeH8wkIFqjtppg17w== -o context=system_u:object_r:root_t:s0 172.21.15.46:6789:/scratch /tmp/tmp.KrMG67MsYpscratch 2023-07-06T00:50:44.618 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-06T00:50:44.974 INFO:teuthology.orchestra.run.smithi046.stdout:generic/600 [not run] disk quotas not supported by this filesystem type: ceph 2023-07-06T00:50:44.978 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/600 2023-07-06T00:50:44.978 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/600 2023-07-06T00:50:44.978 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-07-06T00:50:44.980 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-06T00:50:45.013 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-06T00:50:45.013 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.rlt8E1h3iVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/601) 2023-07-06T00:50:45.235 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph 2023-07-06T00:50:45.239 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-06T00:50:45.240 INFO:teuthology.orchestra.run.smithi046.stdout:MKFS_OPTIONS -- 172.21.15.46:6789:/scratch 2023-07-06T00:50:45.241 INFO:teuthology.orchestra.run.smithi046.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCbvKVkpp1TIhAAvJTELoeH8wkIFqjtppg17w== -o context=system_u:object_r:root_t:s0 172.21.15.46:6789:/scratch /tmp/tmp.KrMG67MsYpscratch 2023-07-06T00:50:45.241 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-06T00:50:45.598 INFO:teuthology.orchestra.run.smithi046.stdout:generic/601 [not run] disk quotas not supported by this filesystem type: ceph 2023-07-06T00:50:45.602 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/601 2023-07-06T00:50:45.602 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/601 2023-07-06T00:50:45.603 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-07-06T00:50:45.604 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-06T00:50:45.629 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-06T00:50:45.630 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.rlt8E1h3iVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/602) 2023-07-06T00:50:45.853 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph 2023-07-06T00:50:45.857 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-06T00:50:45.858 INFO:teuthology.orchestra.run.smithi046.stdout:MKFS_OPTIONS -- 172.21.15.46:6789:/scratch 2023-07-06T00:50:45.859 INFO:teuthology.orchestra.run.smithi046.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCbvKVkpp1TIhAAvJTELoeH8wkIFqjtppg17w== -o context=system_u:object_r:root_t:s0 172.21.15.46:6789:/scratch /tmp/tmp.KrMG67MsYpscratch 2023-07-06T00:50:45.859 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-06T00:50:46.425 INFO:teuthology.orchestra.run.smithi046.stdout:generic/602 [not run] kernel does not support ceph encryption 2023-07-06T00:50:46.447 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/602 2023-07-06T00:50:46.447 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/602 2023-07-06T00:50:46.448 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-07-06T00:50:46.449 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-06T00:50:46.483 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-06T00:50:46.484 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.rlt8E1h3iVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/603) 2023-07-06T00:50:46.708 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph 2023-07-06T00:50:46.712 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-06T00:50:46.713 INFO:teuthology.orchestra.run.smithi046.stdout:MKFS_OPTIONS -- 172.21.15.46:6789:/scratch 2023-07-06T00:50:46.714 INFO:teuthology.orchestra.run.smithi046.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCbvKVkpp1TIhAAvJTELoeH8wkIFqjtppg17w== -o context=system_u:object_r:root_t:s0 172.21.15.46:6789:/scratch /tmp/tmp.KrMG67MsYpscratch 2023-07-06T00:50:46.714 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-06T00:50:47.074 INFO:teuthology.orchestra.run.smithi046.stdout:generic/603 [not run] disk quotas not supported by this filesystem type: ceph 2023-07-06T00:50:47.078 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/603 2023-07-06T00:50:47.078 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/603 2023-07-06T00:50:47.078 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-07-06T00:50:47.080 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-06T00:50:47.113 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-06T00:50:47.114 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.rlt8E1h3iVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/604) 2023-07-06T00:50:47.360 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph 2023-07-06T00:50:47.364 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-06T00:50:47.364 INFO:teuthology.orchestra.run.smithi046.stdout:MKFS_OPTIONS -- 172.21.15.46:6789:/scratch 2023-07-06T00:50:47.365 INFO:teuthology.orchestra.run.smithi046.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCbvKVkpp1TIhAAvJTELoeH8wkIFqjtppg17w== -o context=system_u:object_r:root_t:s0 172.21.15.46:6789:/scratch /tmp/tmp.KrMG67MsYpscratch 2023-07-06T00:50:47.365 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-06T00:50:51.317 INFO:teuthology.orchestra.run.smithi046.stdout:generic/604 4s 2023-07-06T00:50:51.322 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/604 2023-07-06T00:50:51.322 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-07-06T00:50:51.324 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-06T00:50:51.333 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-06T00:50:51.333 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.rlt8E1h3iVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/605) 2023-07-06T00:50:51.576 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph 2023-07-06T00:50:51.581 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-06T00:50:51.582 INFO:teuthology.orchestra.run.smithi046.stdout:MKFS_OPTIONS -- 172.21.15.46:6789:/scratch 2023-07-06T00:50:51.583 INFO:teuthology.orchestra.run.smithi046.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCbvKVkpp1TIhAAvJTELoeH8wkIFqjtppg17w== -o context=system_u:object_r:root_t:s0 172.21.15.46:6789:/scratch /tmp/tmp.KrMG67MsYpscratch 2023-07-06T00:50:51.583 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-06T00:50:53.164 INFO:teuthology.orchestra.run.smithi046.stdout:generic/605 [not run] mount 172.21.15.46:6789:/scratch with dax=always failed 2023-07-06T00:50:53.169 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/605 2023-07-06T00:50:53.170 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/605 2023-07-06T00:50:53.170 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-07-06T00:50:53.171 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-06T00:50:53.201 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-06T00:50:53.202 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.rlt8E1h3iVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/606) 2023-07-06T00:50:53.789 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph 2023-07-06T00:50:53.794 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-06T00:50:53.794 INFO:teuthology.orchestra.run.smithi046.stdout:MKFS_OPTIONS -- 172.21.15.46:6789:/scratch 2023-07-06T00:50:53.795 INFO:teuthology.orchestra.run.smithi046.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCbvKVkpp1TIhAAvJTELoeH8wkIFqjtppg17w== -o context=system_u:object_r:root_t:s0 172.21.15.46:6789:/scratch /tmp/tmp.KrMG67MsYpscratch 2023-07-06T00:50:53.796 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-06T00:50:54.334 INFO:teuthology.orchestra.run.smithi046.stdout:generic/606 [not run] mount 172.21.15.46:6789:/scratch with dax=always failed 2023-07-06T00:50:54.338 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/606 2023-07-06T00:50:54.339 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/606 2023-07-06T00:50:54.339 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-07-06T00:50:54.341 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-06T00:50:54.372 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-06T00:50:54.373 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.rlt8E1h3iVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/607) 2023-07-06T00:50:54.601 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph 2023-07-06T00:50:54.605 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-06T00:50:54.605 INFO:teuthology.orchestra.run.smithi046.stdout:MKFS_OPTIONS -- 172.21.15.46:6789:/scratch 2023-07-06T00:50:54.606 INFO:teuthology.orchestra.run.smithi046.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCbvKVkpp1TIhAAvJTELoeH8wkIFqjtppg17w== -o context=system_u:object_r:root_t:s0 172.21.15.46:6789:/scratch /tmp/tmp.KrMG67MsYpscratch 2023-07-06T00:50:54.606 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-06T00:50:54.998 INFO:teuthology.orchestra.run.smithi046.stdout:generic/607 [not run] xfs_io chattr +x failed (old kernel/wrong fs?) 2023-07-06T00:50:55.002 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/607 2023-07-06T00:50:55.002 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/607 2023-07-06T00:50:55.003 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-07-06T00:50:55.004 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-06T00:50:55.335 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-06T00:50:55.336 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.rlt8E1h3iVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/608) 2023-07-06T00:50:55.624 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph 2023-07-06T00:50:55.629 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-06T00:50:55.629 INFO:teuthology.orchestra.run.smithi046.stdout:MKFS_OPTIONS -- 172.21.15.46:6789:/scratch 2023-07-06T00:50:55.630 INFO:teuthology.orchestra.run.smithi046.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCbvKVkpp1TIhAAvJTELoeH8wkIFqjtppg17w== -o context=system_u:object_r:root_t:s0 172.21.15.46:6789:/scratch /tmp/tmp.KrMG67MsYpscratch 2023-07-06T00:50:55.630 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-06T00:50:56.128 INFO:teuthology.orchestra.run.smithi046.stdout:generic/608 [not run] mount 172.21.15.46:6789:/scratch with dax=always failed 2023-07-06T00:50:56.132 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/608 2023-07-06T00:50:56.133 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/608 2023-07-06T00:50:56.133 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-07-06T00:50:56.134 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-06T00:50:56.155 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-06T00:50:56.156 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.rlt8E1h3iVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/609) 2023-07-06T00:50:56.401 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph 2023-07-06T00:50:56.406 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-06T00:50:56.406 INFO:teuthology.orchestra.run.smithi046.stdout:MKFS_OPTIONS -- 172.21.15.46:6789:/scratch 2023-07-06T00:50:56.407 INFO:teuthology.orchestra.run.smithi046.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCbvKVkpp1TIhAAvJTELoeH8wkIFqjtppg17w== -o context=system_u:object_r:root_t:s0 172.21.15.46:6789:/scratch /tmp/tmp.KrMG67MsYpscratch 2023-07-06T00:50:56.407 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-06T00:50:56.951 INFO:teuthology.orchestra.run.smithi046.stdout:generic/609 0s 2023-07-06T00:50:56.956 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/609 2023-07-06T00:50:56.956 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-07-06T00:50:56.958 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-06T00:50:57.353 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-06T00:50:57.354 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.rlt8E1h3iVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/610) 2023-07-06T00:50:57.604 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph 2023-07-06T00:50:57.608 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-06T00:50:57.608 INFO:teuthology.orchestra.run.smithi046.stdout:MKFS_OPTIONS -- 172.21.15.46:6789:/scratch 2023-07-06T00:50:57.609 INFO:teuthology.orchestra.run.smithi046.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCbvKVkpp1TIhAAvJTELoeH8wkIFqjtppg17w== -o context=system_u:object_r:root_t:s0 172.21.15.46:6789:/scratch /tmp/tmp.KrMG67MsYpscratch 2023-07-06T00:50:57.609 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-06T00:50:58.046 INFO:teuthology.orchestra.run.smithi046.stdout:generic/610 [not run] xfs_io fzero failed (old kernel/wrong fs?) 2023-07-06T00:50:58.050 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/610 2023-07-06T00:50:58.050 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/610 2023-07-06T00:50:58.050 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-07-06T00:50:58.052 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-06T00:50:58.083 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-06T00:50:58.084 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.rlt8E1h3iVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/611) 2023-07-06T00:50:58.327 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph 2023-07-06T00:50:58.331 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-06T00:50:58.332 INFO:teuthology.orchestra.run.smithi046.stdout:MKFS_OPTIONS -- 172.21.15.46:6789:/scratch 2023-07-06T00:50:58.332 INFO:teuthology.orchestra.run.smithi046.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCbvKVkpp1TIhAAvJTELoeH8wkIFqjtppg17w== -o context=system_u:object_r:root_t:s0 172.21.15.46:6789:/scratch /tmp/tmp.KrMG67MsYpscratch 2023-07-06T00:50:58.333 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-06T00:50:59.089 INFO:teuthology.orchestra.run.smithi046.stdout:generic/611 1s 2023-07-06T00:50:59.094 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/611 2023-07-06T00:50:59.095 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-07-06T00:50:59.096 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-06T00:50:59.105 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-06T00:50:59.105 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.rlt8E1h3iVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/612) 2023-07-06T00:50:59.332 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph 2023-07-06T00:50:59.337 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-06T00:50:59.337 INFO:teuthology.orchestra.run.smithi046.stdout:MKFS_OPTIONS -- 172.21.15.46:6789:/scratch 2023-07-06T00:50:59.338 INFO:teuthology.orchestra.run.smithi046.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCbvKVkpp1TIhAAvJTELoeH8wkIFqjtppg17w== -o context=system_u:object_r:root_t:s0 172.21.15.46:6789:/scratch /tmp/tmp.KrMG67MsYpscratch 2023-07-06T00:50:59.338 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-06T00:50:59.746 INFO:teuthology.orchestra.run.smithi046.stdout:generic/612 [not run] Reflink not supported by test filesystem type: ceph 2023-07-06T00:50:59.751 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/612 2023-07-06T00:50:59.751 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/612 2023-07-06T00:50:59.751 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-07-06T00:50:59.753 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-06T00:51:00.042 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-06T00:51:00.043 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.rlt8E1h3iVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/613) 2023-07-06T00:51:00.404 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph 2023-07-06T00:51:00.408 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-06T00:51:00.409 INFO:teuthology.orchestra.run.smithi046.stdout:MKFS_OPTIONS -- 172.21.15.46:6789:/scratch 2023-07-06T00:51:00.410 INFO:teuthology.orchestra.run.smithi046.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCbvKVkpp1TIhAAvJTELoeH8wkIFqjtppg17w== -o context=system_u:object_r:root_t:s0 172.21.15.46:6789:/scratch /tmp/tmp.KrMG67MsYpscratch 2023-07-06T00:51:00.410 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-06T00:51:00.983 INFO:teuthology.orchestra.run.smithi046.stdout:generic/613 [not run] kernel does not support ceph encryption 2023-07-06T00:51:01.005 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/613 2023-07-06T00:51:01.005 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/613 2023-07-06T00:51:01.005 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-07-06T00:51:01.008 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-06T00:51:01.043 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-06T00:51:01.044 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.rlt8E1h3iVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/614) 2023-07-06T00:51:01.269 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph 2023-07-06T00:51:01.274 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-06T00:51:01.274 INFO:teuthology.orchestra.run.smithi046.stdout:MKFS_OPTIONS -- 172.21.15.46:6789:/scratch 2023-07-06T00:51:01.275 INFO:teuthology.orchestra.run.smithi046.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCbvKVkpp1TIhAAvJTELoeH8wkIFqjtppg17w== -o context=system_u:object_r:root_t:s0 172.21.15.46:6789:/scratch /tmp/tmp.KrMG67MsYpscratch 2023-07-06T00:51:01.275 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-06T00:51:01.824 INFO:teuthology.orchestra.run.smithi046.stdout:generic/614 [not run] test requires delayed allocation buffered writes 2023-07-06T00:51:01.857 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/614 2023-07-06T00:51:01.858 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/614 2023-07-06T00:51:01.858 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-07-06T00:51:01.859 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-06T00:51:01.892 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-06T00:51:01.892 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.rlt8E1h3iVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/615) 2023-07-06T00:51:02.119 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph 2023-07-06T00:51:02.123 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-06T00:51:02.124 INFO:teuthology.orchestra.run.smithi046.stdout:MKFS_OPTIONS -- 172.21.15.46:6789:/scratch 2023-07-06T00:51:02.125 INFO:teuthology.orchestra.run.smithi046.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCbvKVkpp1TIhAAvJTELoeH8wkIFqjtppg17w== -o context=system_u:object_r:root_t:s0 172.21.15.46:6789:/scratch /tmp/tmp.KrMG67MsYpscratch 2023-07-06T00:51:02.125 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-06T00:51:39.939 INFO:teuthology.orchestra.run.smithi046.stdout:generic/615 37s 2023-07-06T00:51:39.944 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/615 2023-07-06T00:51:39.944 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-07-06T00:51:39.946 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-06T00:51:39.954 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-06T00:51:39.955 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.rlt8E1h3iVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/616) 2023-07-06T00:51:40.200 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph 2023-07-06T00:51:40.204 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-06T00:51:40.205 INFO:teuthology.orchestra.run.smithi046.stdout:MKFS_OPTIONS -- 172.21.15.46:6789:/scratch 2023-07-06T00:51:40.205 INFO:teuthology.orchestra.run.smithi046.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCbvKVkpp1TIhAAvJTELoeH8wkIFqjtppg17w== -o context=system_u:object_r:root_t:s0 172.21.15.46:6789:/scratch /tmp/tmp.KrMG67MsYpscratch 2023-07-06T00:51:40.206 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-06T00:51:40.561 INFO:teuthology.orchestra.run.smithi046.stdout:generic/616 [not run] kernel does not support IO_URING 2023-07-06T00:51:40.621 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/616 2023-07-06T00:51:40.621 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/616 2023-07-06T00:51:40.622 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-07-06T00:51:40.622 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-06T00:51:40.622 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-06T00:51:40.622 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.rlt8E1h3iVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/617) 2023-07-06T00:51:40.857 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph 2023-07-06T00:51:40.861 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-06T00:51:40.862 INFO:teuthology.orchestra.run.smithi046.stdout:MKFS_OPTIONS -- 172.21.15.46:6789:/scratch 2023-07-06T00:51:40.863 INFO:teuthology.orchestra.run.smithi046.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCbvKVkpp1TIhAAvJTELoeH8wkIFqjtppg17w== -o context=system_u:object_r:root_t:s0 172.21.15.46:6789:/scratch /tmp/tmp.KrMG67MsYpscratch 2023-07-06T00:51:40.863 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-06T00:51:41.256 INFO:teuthology.orchestra.run.smithi046.stdout:generic/617 [not run] kernel does not support IO_URING 2023-07-06T00:51:41.260 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/617 2023-07-06T00:51:41.260 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/617 2023-07-06T00:51:41.260 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-07-06T00:51:41.262 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-06T00:51:41.301 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-06T00:51:41.302 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.rlt8E1h3iVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/618) 2023-07-06T00:51:41.529 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph 2023-07-06T00:51:41.533 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-06T00:51:41.533 INFO:teuthology.orchestra.run.smithi046.stdout:MKFS_OPTIONS -- 172.21.15.46:6789:/scratch 2023-07-06T00:51:41.534 INFO:teuthology.orchestra.run.smithi046.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCbvKVkpp1TIhAAvJTELoeH8wkIFqjtppg17w== -o context=system_u:object_r:root_t:s0 172.21.15.46:6789:/scratch /tmp/tmp.KrMG67MsYpscratch 2023-07-06T00:51:41.534 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-06T00:51:42.265 INFO:teuthology.orchestra.run.smithi046.stdout:generic/618 1s 2023-07-06T00:51:42.270 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/618 2023-07-06T00:51:42.271 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-07-06T00:51:42.273 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-06T00:51:42.281 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-06T00:51:42.282 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.rlt8E1h3iVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/619) 2023-07-06T00:51:42.510 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph 2023-07-06T00:51:42.514 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-06T00:51:42.514 INFO:teuthology.orchestra.run.smithi046.stdout:MKFS_OPTIONS -- 172.21.15.46:6789:/scratch 2023-07-06T00:51:42.515 INFO:teuthology.orchestra.run.smithi046.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCbvKVkpp1TIhAAvJTELoeH8wkIFqjtppg17w== -o context=system_u:object_r:root_t:s0 172.21.15.46:6789:/scratch /tmp/tmp.KrMG67MsYpscratch 2023-07-06T00:51:42.515 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-06T00:51:42.875 INFO:teuthology.orchestra.run.smithi046.stdout:generic/619 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-07-06T00:51:42.879 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/619 2023-07-06T00:51:42.880 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/619 2023-07-06T00:51:42.880 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-07-06T00:51:42.882 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-06T00:51:42.915 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-06T00:51:42.916 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.rlt8E1h3iVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/620) 2023-07-06T00:51:43.144 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph 2023-07-06T00:51:43.148 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-06T00:51:43.149 INFO:teuthology.orchestra.run.smithi046.stdout:MKFS_OPTIONS -- 172.21.15.46:6789:/scratch 2023-07-06T00:51:43.150 INFO:teuthology.orchestra.run.smithi046.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCbvKVkpp1TIhAAvJTELoeH8wkIFqjtppg17w== -o context=system_u:object_r:root_t:s0 172.21.15.46:6789:/scratch /tmp/tmp.KrMG67MsYpscratch 2023-07-06T00:51:43.150 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-06T00:51:43.544 INFO:teuthology.orchestra.run.smithi046.stdout:generic/620 [not run] require 172.21.15.46:6789:/scratch to be valid block disk 2023-07-06T00:51:43.548 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/620 2023-07-06T00:51:43.549 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/620 2023-07-06T00:51:43.549 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-07-06T00:51:43.551 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-06T00:51:43.581 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-06T00:51:43.582 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.rlt8E1h3iVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/621) 2023-07-06T00:51:43.805 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph 2023-07-06T00:51:43.809 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-06T00:51:43.811 INFO:teuthology.orchestra.run.smithi046.stdout:MKFS_OPTIONS -- 172.21.15.46:6789:/scratch 2023-07-06T00:51:43.811 INFO:teuthology.orchestra.run.smithi046.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCbvKVkpp1TIhAAvJTELoeH8wkIFqjtppg17w== -o context=system_u:object_r:root_t:s0 172.21.15.46:6789:/scratch /tmp/tmp.KrMG67MsYpscratch 2023-07-06T00:51:43.811 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-06T00:51:44.395 INFO:teuthology.orchestra.run.smithi046.stdout:generic/621 [not run] kernel does not support ceph encryption 2023-07-06T00:51:44.421 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/621 2023-07-06T00:51:44.421 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/621 2023-07-06T00:51:44.422 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-07-06T00:51:44.423 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-06T00:51:44.451 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-06T00:51:44.452 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.rlt8E1h3iVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/622) 2023-07-06T00:51:44.686 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph 2023-07-06T00:51:44.690 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-06T00:51:44.691 INFO:teuthology.orchestra.run.smithi046.stdout:MKFS_OPTIONS -- 172.21.15.46:6789:/scratch 2023-07-06T00:51:44.691 INFO:teuthology.orchestra.run.smithi046.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCbvKVkpp1TIhAAvJTELoeH8wkIFqjtppg17w== -o context=system_u:object_r:root_t:s0 172.21.15.46:6789:/scratch /tmp/tmp.KrMG67MsYpscratch 2023-07-06T00:51:44.692 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-06T00:51:45.228 INFO:teuthology.orchestra.run.smithi046.stdout:generic/622 [not run] ceph does not support shutdown 2023-07-06T00:51:45.252 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/622 2023-07-06T00:51:45.252 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/622 2023-07-06T00:51:45.253 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-07-06T00:51:45.254 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-06T00:51:45.280 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-06T00:51:45.281 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.rlt8E1h3iVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/623) 2023-07-06T00:51:45.509 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph 2023-07-06T00:51:45.514 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-06T00:51:45.515 INFO:teuthology.orchestra.run.smithi046.stdout:MKFS_OPTIONS -- 172.21.15.46:6789:/scratch 2023-07-06T00:51:45.515 INFO:teuthology.orchestra.run.smithi046.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCbvKVkpp1TIhAAvJTELoeH8wkIFqjtppg17w== -o context=system_u:object_r:root_t:s0 172.21.15.46:6789:/scratch /tmp/tmp.KrMG67MsYpscratch 2023-07-06T00:51:45.515 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-06T00:51:46.033 INFO:teuthology.orchestra.run.smithi046.stdout:generic/623 [not run] ceph does not support shutdown 2023-07-06T00:51:46.054 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/623 2023-07-06T00:51:46.055 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/623 2023-07-06T00:51:46.055 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-07-06T00:51:46.056 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-06T00:51:46.090 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-06T00:51:46.091 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.rlt8E1h3iVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/624) 2023-07-06T00:51:46.317 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph 2023-07-06T00:51:46.321 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-06T00:51:46.321 INFO:teuthology.orchestra.run.smithi046.stdout:MKFS_OPTIONS -- 172.21.15.46:6789:/scratch 2023-07-06T00:51:46.322 INFO:teuthology.orchestra.run.smithi046.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCbvKVkpp1TIhAAvJTELoeH8wkIFqjtppg17w== -o context=system_u:object_r:root_t:s0 172.21.15.46:6789:/scratch /tmp/tmp.KrMG67MsYpscratch 2023-07-06T00:51:46.322 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-06T00:51:46.668 INFO:teuthology.orchestra.run.smithi046.stdout:generic/624 [not run] fsverity utility required, skipped this test 2023-07-06T00:51:46.672 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/624 2023-07-06T00:51:46.673 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/624 2023-07-06T00:51:46.673 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-07-06T00:51:46.675 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-06T00:51:46.706 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-06T00:51:46.707 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.rlt8E1h3iVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/625) 2023-07-06T00:51:46.930 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph 2023-07-06T00:51:46.934 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-06T00:51:46.934 INFO:teuthology.orchestra.run.smithi046.stdout:MKFS_OPTIONS -- 172.21.15.46:6789:/scratch 2023-07-06T00:51:46.935 INFO:teuthology.orchestra.run.smithi046.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCbvKVkpp1TIhAAvJTELoeH8wkIFqjtppg17w== -o context=system_u:object_r:root_t:s0 172.21.15.46:6789:/scratch /tmp/tmp.KrMG67MsYpscratch 2023-07-06T00:51:46.935 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-06T00:51:47.299 INFO:teuthology.orchestra.run.smithi046.stdout:generic/625 [not run] fsverity utility required, skipped this test 2023-07-06T00:51:47.303 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/625 2023-07-06T00:51:47.304 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/625 2023-07-06T00:51:47.304 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-07-06T00:51:47.305 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-06T00:51:47.336 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-06T00:51:47.336 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.rlt8E1h3iVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/626) 2023-07-06T00:51:47.563 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph 2023-07-06T00:51:47.567 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-06T00:51:47.567 INFO:teuthology.orchestra.run.smithi046.stdout:MKFS_OPTIONS -- 172.21.15.46:6789:/scratch 2023-07-06T00:51:47.569 INFO:teuthology.orchestra.run.smithi046.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCbvKVkpp1TIhAAvJTELoeH8wkIFqjtppg17w== -o context=system_u:object_r:root_t:s0 172.21.15.46:6789:/scratch /tmp/tmp.KrMG67MsYpscratch 2023-07-06T00:51:47.569 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-06T00:51:47.952 INFO:teuthology.orchestra.run.smithi046.stdout:generic/626 [not run] kernel doesn't support renameat2 syscall 2023-07-06T00:51:47.956 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/626 2023-07-06T00:51:47.956 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/626 2023-07-06T00:51:47.957 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-07-06T00:51:47.958 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-06T00:51:48.250 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-06T00:51:48.251 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.rlt8E1h3iVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/627) 2023-07-06T00:51:48.590 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph 2023-07-06T00:51:48.594 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-06T00:51:48.595 INFO:teuthology.orchestra.run.smithi046.stdout:MKFS_OPTIONS -- 172.21.15.46:6789:/scratch 2023-07-06T00:51:48.595 INFO:teuthology.orchestra.run.smithi046.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCbvKVkpp1TIhAAvJTELoeH8wkIFqjtppg17w== -o context=system_u:object_r:root_t:s0 172.21.15.46:6789:/scratch /tmp/tmp.KrMG67MsYpscratch 2023-07-06T00:51:48.595 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-06T00:51:49.023 INFO:teuthology.orchestra.run.smithi046.stdout:generic/627 [not run] require 172.21.15.46:6789:/scratch to be valid block disk 2023-07-06T00:51:49.027 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/627 2023-07-06T00:51:49.027 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/627 2023-07-06T00:51:49.027 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-07-06T00:51:49.029 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-06T00:51:49.064 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-06T00:51:49.066 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.rlt8E1h3iVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/628) 2023-07-06T00:51:49.300 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph 2023-07-06T00:51:49.305 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-06T00:51:49.305 INFO:teuthology.orchestra.run.smithi046.stdout:MKFS_OPTIONS -- 172.21.15.46:6789:/scratch 2023-07-06T00:51:49.306 INFO:teuthology.orchestra.run.smithi046.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCbvKVkpp1TIhAAvJTELoeH8wkIFqjtppg17w== -o context=system_u:object_r:root_t:s0 172.21.15.46:6789:/scratch /tmp/tmp.KrMG67MsYpscratch 2023-07-06T00:51:49.306 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-06T00:51:50.225 INFO:teuthology.orchestra.run.smithi046.stdout:generic/628 [not run] Reflink not supported by scratch filesystem type: ceph 2023-07-06T00:51:50.243 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/628 2023-07-06T00:51:50.244 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/628 2023-07-06T00:51:50.244 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-07-06T00:51:50.246 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-06T00:51:50.331 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-06T00:51:50.332 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.rlt8E1h3iVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/629) 2023-07-06T00:51:50.567 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph 2023-07-06T00:51:50.571 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-06T00:51:50.572 INFO:teuthology.orchestra.run.smithi046.stdout:MKFS_OPTIONS -- 172.21.15.46:6789:/scratch 2023-07-06T00:51:50.573 INFO:teuthology.orchestra.run.smithi046.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCbvKVkpp1TIhAAvJTELoeH8wkIFqjtppg17w== -o context=system_u:object_r:root_t:s0 172.21.15.46:6789:/scratch /tmp/tmp.KrMG67MsYpscratch 2023-07-06T00:51:50.573 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-06T00:51:50.964 INFO:teuthology.orchestra.run.smithi046.stdout:generic/629 [not run] require 172.21.15.46:6789:/scratch to be valid block disk 2023-07-06T00:51:50.968 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/629 2023-07-06T00:51:50.968 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/629 2023-07-06T00:51:50.968 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-07-06T00:51:50.970 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-06T00:51:50.997 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-06T00:51:50.998 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.rlt8E1h3iVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/630) 2023-07-06T00:51:51.240 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph 2023-07-06T00:51:51.244 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-06T00:51:51.245 INFO:teuthology.orchestra.run.smithi046.stdout:MKFS_OPTIONS -- 172.21.15.46:6789:/scratch 2023-07-06T00:51:51.245 INFO:teuthology.orchestra.run.smithi046.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCbvKVkpp1TIhAAvJTELoeH8wkIFqjtppg17w== -o context=system_u:object_r:root_t:s0 172.21.15.46:6789:/scratch /tmp/tmp.KrMG67MsYpscratch 2023-07-06T00:51:51.246 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-06T00:51:51.809 INFO:teuthology.orchestra.run.smithi046.stdout:generic/630 [not run] Dedupe not supported by scratch filesystem type: ceph 2023-07-06T00:51:52.104 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/630 2023-07-06T00:51:52.104 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/630 2023-07-06T00:51:52.105 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-07-06T00:51:52.186 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-06T00:51:52.280 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-06T00:51:52.281 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.rlt8E1h3iVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/631) 2023-07-06T00:51:52.507 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph 2023-07-06T00:51:52.511 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-06T00:51:52.512 INFO:teuthology.orchestra.run.smithi046.stdout:MKFS_OPTIONS -- 172.21.15.46:6789:/scratch 2023-07-06T00:51:52.513 INFO:teuthology.orchestra.run.smithi046.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCbvKVkpp1TIhAAvJTELoeH8wkIFqjtppg17w== -o context=system_u:object_r:root_t:s0 172.21.15.46:6789:/scratch /tmp/tmp.KrMG67MsYpscratch 2023-07-06T00:51:52.513 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-06T00:52:24.400 INFO:teuthology.orchestra.run.smithi046.stdout:generic/631 - output mismatch (see /tmp/tmp.rlt8E1h3iVxfstests-dev/results//generic/631.out.bad) 2023-07-06T00:52:24.410 INFO:teuthology.orchestra.run.smithi046.stdout: --- tests/generic/631.out 2023-07-05 18:57:23.281780086 +0000 2023-07-06T00:52:24.410 INFO:teuthology.orchestra.run.smithi046.stdout: +++ /tmp/tmp.rlt8E1h3iVxfstests-dev/results//generic/631.out.bad 2023-07-06 00:52:24.300752294 +0000 2023-07-06T00:52:24.410 INFO:teuthology.orchestra.run.smithi046.stdout: @@ -1,2 +1,3158 @@ 2023-07-06T00:52:24.411 INFO:teuthology.orchestra.run.smithi046.stdout: QA output created by 631 2023-07-06T00:52:24.411 INFO:teuthology.orchestra.run.smithi046.stdout: +mount: /tmp/tmp.KrMG67MsYpscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-07-06T00:52:24.411 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged5/etc/access.conf': No such file or directory 2023-07-06T00:52:24.411 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged5/etc/access.conf': No such file or directory 2023-07-06T00:52:24.411 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged5/etc/access.conf': No such file or directory 2023-07-06T00:52:24.412 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged5/etc/access.conf': No such file or directory 2023-07-06T00:52:24.412 INFO:teuthology.orchestra.run.smithi046.stdout: +umount: /tmp/tmp.KrMG67MsYpscratch/merged5: not mounted. 2023-07-06T00:52:24.412 INFO:teuthology.orchestra.run.smithi046.stdout: +mount: /tmp/tmp.KrMG67MsYpscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-07-06T00:52:24.412 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged1/etc/access.conf': No such file or directory 2023-07-06T00:52:24.412 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged1/etc/access.conf': No such file or directory 2023-07-06T00:52:24.412 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged1/etc/access.conf': No such file or directory 2023-07-06T00:52:24.412 INFO:teuthology.orchestra.run.smithi046.stdout: +mount: /tmp/tmp.KrMG67MsYpscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-07-06T00:52:24.413 INFO:teuthology.orchestra.run.smithi046.stdout: +mount: mount: /tmp/tmp.KrMG67MsYpscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error./tmp/tmp.KrMG67MsYpscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-07-06T00:52:24.413 INFO:teuthology.orchestra.run.smithi046.stdout: + 2023-07-06T00:52:24.413 INFO:teuthology.orchestra.run.smithi046.stdout: +mount: /tmp/tmp.KrMG67MsYpscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-07-06T00:52:24.413 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged1/etc/access.conf': No such file or directory 2023-07-06T00:52:24.413 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged3/etc/access.conf'cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged0/etc/access.conf': No such file or directory 2023-07-06T00:52:24.413 INFO:teuthology.orchestra.run.smithi046.stdout: +: No such file or directory 2023-07-06T00:52:24.413 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged4/etc/access.conf': No such file or directory 2023-07-06T00:52:24.414 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged0/etc/access.conf': No such file or directory 2023-07-06T00:52:24.414 INFO:teuthology.orchestra.run.smithi046.stdout: +umount: /tmp/tmp.KrMG67MsYpscratch/merged1: not mounted. 2023-07-06T00:52:24.414 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged3/etc/access.conf': No such file or directory 2023-07-06T00:52:24.414 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged4/etc/access.conf': No such file or directory 2023-07-06T00:52:24.414 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged0/etc/access.conf'mv: : No such file or directorycannot stat '/tmp/tmp.KrMG67MsYpscratch/merged3/etc/access.conf' 2023-07-06T00:52:24.414 INFO:teuthology.orchestra.run.smithi046.stdout: +: No such file or directory 2023-07-06T00:52:24.414 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged4/etc/access.conf': No such file or directory 2023-07-06T00:52:24.414 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged2/etc/access.conf': No such file or directory 2023-07-06T00:52:24.415 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged0/etc/access.conf': No such file or directory 2023-07-06T00:52:24.415 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged3/etc/access.conf': No such file or directory 2023-07-06T00:52:24.415 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged2/etc/access.conf': No such file or directory 2023-07-06T00:52:24.415 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged4/etc/access.conf': No such file or directory 2023-07-06T00:52:24.415 INFO:teuthology.orchestra.run.smithi046.stdout: +umount: /tmp/tmp.KrMG67MsYpscratch/merged0: not mounted. 2023-07-06T00:52:24.415 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged2/etc/access.conf': No such file or directory 2023-07-06T00:52:24.415 INFO:teuthology.orchestra.run.smithi046.stdout: +umount: /tmp/tmp.KrMG67MsYpscratch/merged3: not mounted. 2023-07-06T00:52:24.415 INFO:teuthology.orchestra.run.smithi046.stdout: +umount: /tmp/tmp.KrMG67MsYpscratch/merged4: not mounted. 2023-07-06T00:52:24.416 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged2/etc/access.conf': No such file or directory 2023-07-06T00:52:24.416 INFO:teuthology.orchestra.run.smithi046.stdout: +umount: /tmp/tmp.KrMG67MsYpscratch/merged2: not mounted. 2023-07-06T00:52:24.416 INFO:teuthology.orchestra.run.smithi046.stdout: +mount: /tmp/tmp.KrMG67MsYpscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-07-06T00:52:24.416 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged5/etc/access.conf': No such file or directory 2023-07-06T00:52:24.416 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged5/etc/access.conf': No such file or directory 2023-07-06T00:52:24.417 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged5/etc/access.conf': No such file or directory 2023-07-06T00:52:24.417 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged5/etc/access.conf': No such file or directory 2023-07-06T00:52:24.417 INFO:teuthology.orchestra.run.smithi046.stdout: +umount: /tmp/tmp.KrMG67MsYpscratch/merged5: not mounted. 2023-07-06T00:52:24.417 INFO:teuthology.orchestra.run.smithi046.stdout: +mount: /tmp/tmp.KrMG67MsYpscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-07-06T00:52:24.417 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged4/etc/access.conf': No such file or directory 2023-07-06T00:52:24.417 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged4/etc/access.conf': No such file or directory 2023-07-06T00:52:24.417 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged4/etc/access.conf': No such file or directory 2023-07-06T00:52:24.418 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged4/etc/access.conf': No such file or directory 2023-07-06T00:52:24.418 INFO:teuthology.orchestra.run.smithi046.stdout: +umount: /tmp/tmp.KrMG67MsYpscratch/merged4: not mounted. 2023-07-06T00:52:24.418 INFO:teuthology.orchestra.run.smithi046.stdout: +mount: /tmp/tmp.KrMG67MsYpscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-07-06T00:52:24.418 INFO:teuthology.orchestra.run.smithi046.stdout: +mount: /tmp/tmp.KrMG67MsYpscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-07-06T00:52:24.418 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged1/etc/access.conf': No such file or directory 2023-07-06T00:52:24.418 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged3/etc/access.conf': No such file or directory 2023-07-06T00:52:24.418 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged1/etc/access.conf': No such file or directory 2023-07-06T00:52:24.419 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged3/etc/access.conf': No such file or directory 2023-07-06T00:52:24.419 INFO:teuthology.orchestra.run.smithi046.stdout: +mount: /tmp/tmp.KrMG67MsYpscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-07-06T00:52:24.419 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged1/etc/access.conf': No such file or directory 2023-07-06T00:52:24.419 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged3/etc/access.conf': No such file or directory 2023-07-06T00:52:24.419 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged0/etc/access.conf': No such file or directory 2023-07-06T00:52:24.419 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged1/etc/access.conf': No such file or directory 2023-07-06T00:52:24.419 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged3/etc/access.conf': No such file or directory 2023-07-06T00:52:24.420 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged0/etc/access.conf': No such file or directory 2023-07-06T00:52:24.420 INFO:teuthology.orchestra.run.smithi046.stdout: +umount: /tmp/tmp.KrMG67MsYpscratch/merged1: not mounted. 2023-07-06T00:52:24.420 INFO:teuthology.orchestra.run.smithi046.stdout: +umount: /tmp/tmp.KrMG67MsYpscratch/merged3: not mounted. 2023-07-06T00:52:24.420 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged0/etc/access.conf': No such file or directory 2023-07-06T00:52:24.420 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged0/etc/access.conf': No such file or directory 2023-07-06T00:52:24.420 INFO:teuthology.orchestra.run.smithi046.stdout: +umount: /tmp/tmp.KrMG67MsYpscratch/merged0: not mounted. 2023-07-06T00:52:24.420 INFO:teuthology.orchestra.run.smithi046.stdout: +mount: /tmp/tmp.KrMG67MsYpscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-07-06T00:52:24.421 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged2/etc/access.conf': No such file or directory 2023-07-06T00:52:24.421 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged2/etc/access.conf': No such file or directory 2023-07-06T00:52:24.421 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged2/etc/access.conf': No such file or directory 2023-07-06T00:52:24.421 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged2/etc/access.conf': No such file or directory 2023-07-06T00:52:24.421 INFO:teuthology.orchestra.run.smithi046.stdout: +umount: /tmp/tmp.KrMG67MsYpscratch/merged2: not mounted. 2023-07-06T00:52:24.421 INFO:teuthology.orchestra.run.smithi046.stdout: +mount: /tmp/tmp.KrMG67MsYpscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-07-06T00:52:24.421 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged5/etc/access.conf': No such file or directory 2023-07-06T00:52:24.421 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged5/etc/access.conf': No such file or directory 2023-07-06T00:52:24.422 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged5/etc/access.conf': No such file or directory 2023-07-06T00:52:24.422 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged5/etc/access.conf': No such file or directory 2023-07-06T00:52:24.422 INFO:teuthology.orchestra.run.smithi046.stdout: +umount: /tmp/tmp.KrMG67MsYpscratch/merged5: not mounted. 2023-07-06T00:52:24.422 INFO:teuthology.orchestra.run.smithi046.stdout: +mount: /tmp/tmp.KrMG67MsYpscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-07-06T00:52:24.422 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged1/etc/access.conf': No such file or directory 2023-07-06T00:52:24.422 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged1/etc/access.conf': No such file or directory 2023-07-06T00:52:24.423 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged1/etc/access.conf': No such file or directory 2023-07-06T00:52:24.423 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged1/etc/access.conf': No such file or directory 2023-07-06T00:52:24.423 INFO:teuthology.orchestra.run.smithi046.stdout: +umount: /tmp/tmp.KrMG67MsYpscratch/merged1: not mounted. 2023-07-06T00:52:24.423 INFO:teuthology.orchestra.run.smithi046.stdout: +mount: /tmp/tmp.KrMG67MsYpscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-07-06T00:52:24.423 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged4/etc/access.conf': No such file or directory 2023-07-06T00:52:24.423 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged4/etc/access.conf': No such file or directory 2023-07-06T00:52:24.423 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged4/etc/access.conf': No such file or directory 2023-07-06T00:52:24.423 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged4/etc/access.conf': No such file or directory 2023-07-06T00:52:24.424 INFO:teuthology.orchestra.run.smithi046.stdout: +umount: /tmp/tmp.KrMG67MsYpscratch/merged4: not mounted. 2023-07-06T00:52:24.424 INFO:teuthology.orchestra.run.smithi046.stdout: +mount: /tmp/tmp.KrMG67MsYpscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-07-06T00:52:24.424 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged3/etc/access.conf': No such file or directory 2023-07-06T00:52:24.424 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged3/etc/access.conf': No such file or directory 2023-07-06T00:52:24.424 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged3/etc/access.conf': No such file or directory 2023-07-06T00:52:24.424 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged3/etc/access.conf': No such file or directory 2023-07-06T00:52:24.425 INFO:teuthology.orchestra.run.smithi046.stdout: +umount: /tmp/tmp.KrMG67MsYpscratch/merged3: not mounted. 2023-07-06T00:52:24.425 INFO:teuthology.orchestra.run.smithi046.stdout: +mount: /tmp/tmp.KrMG67MsYpscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-07-06T00:52:24.425 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged0/etc/access.conf': No such file or directory 2023-07-06T00:52:24.425 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged0/etc/access.conf': No such file or directory 2023-07-06T00:52:24.425 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged0/etc/access.conf': No such file or directory 2023-07-06T00:52:24.425 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged0/etc/access.conf': No such file or directory 2023-07-06T00:52:24.425 INFO:teuthology.orchestra.run.smithi046.stdout: +umount: /tmp/tmp.KrMG67MsYpscratch/merged0: not mounted. 2023-07-06T00:52:24.425 INFO:teuthology.orchestra.run.smithi046.stdout: +mount: /tmp/tmp.KrMG67MsYpscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-07-06T00:52:24.426 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged2/etc/access.conf': No such file or directory 2023-07-06T00:52:24.426 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged2/etc/access.conf': No such file or directory 2023-07-06T00:52:24.426 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged2/etc/access.conf': No such file or directory 2023-07-06T00:52:24.426 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged2/etc/access.conf': No such file or directory 2023-07-06T00:52:24.426 INFO:teuthology.orchestra.run.smithi046.stdout: +mount: /tmp/tmp.KrMG67MsYpscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-07-06T00:52:24.426 INFO:teuthology.orchestra.run.smithi046.stdout: +umount: /tmp/tmp.KrMG67MsYpscratch/merged2: not mounted. 2023-07-06T00:52:24.426 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged5/etc/access.conf': No such file or directory 2023-07-06T00:52:24.426 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged5/etc/access.conf': No such file or directory 2023-07-06T00:52:24.427 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged5/etc/access.conf': No such file or directory 2023-07-06T00:52:24.427 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged5/etc/access.conf': No such file or directory 2023-07-06T00:52:24.427 INFO:teuthology.orchestra.run.smithi046.stdout: +umount: /tmp/tmp.KrMG67MsYpscratch/merged5: not mounted. 2023-07-06T00:52:24.427 INFO:teuthology.orchestra.run.smithi046.stdout: +mount: /tmp/tmp.KrMG67MsYpscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-07-06T00:52:24.427 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged1/etc/access.conf': No such file or directory 2023-07-06T00:52:24.427 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged1/etc/access.conf': No such file or directory 2023-07-06T00:52:24.427 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged1/etc/access.conf': No such file or directory 2023-07-06T00:52:24.428 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged1/etc/access.conf': No such file or directory 2023-07-06T00:52:24.428 INFO:teuthology.orchestra.run.smithi046.stdout: +umount: /tmp/tmp.KrMG67MsYpscratch/merged1: not mounted. 2023-07-06T00:52:24.428 INFO:teuthology.orchestra.run.smithi046.stdout: +mount: /tmp/tmp.KrMG67MsYpscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-07-06T00:52:24.428 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged0/etc/access.conf': No such file or directory 2023-07-06T00:52:24.428 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged0/etc/access.conf': No such file or directory 2023-07-06T00:52:24.428 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged0/etc/access.conf': No such file or directory 2023-07-06T00:52:24.429 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged0/etc/access.conf': No such file or directory 2023-07-06T00:52:24.429 INFO:teuthology.orchestra.run.smithi046.stdout: +umount: /tmp/tmp.KrMG67MsYpscratch/merged0: not mounted. 2023-07-06T00:52:24.429 INFO:teuthology.orchestra.run.smithi046.stdout: +mount: /tmp/tmp.KrMG67MsYpscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-07-06T00:52:24.429 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged2/etc/access.conf': No such file or directory 2023-07-06T00:52:24.430 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged2/etc/access.conf': No such file or directory 2023-07-06T00:52:24.430 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged2/etc/access.conf': No such file or directory 2023-07-06T00:52:24.430 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged2/etc/access.conf': No such file or directory 2023-07-06T00:52:24.430 INFO:teuthology.orchestra.run.smithi046.stdout: +umount: /tmp/tmp.KrMG67MsYpscratch/merged2: not mounted. 2023-07-06T00:52:24.430 INFO:teuthology.orchestra.run.smithi046.stdout: +mount: /tmp/tmp.KrMG67MsYpscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-07-06T00:52:24.430 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged5/etc/access.conf': No such file or directory 2023-07-06T00:52:24.430 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged5/etc/access.conf': No such file or directory 2023-07-06T00:52:24.431 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged5/etc/access.conf': No such file or directory 2023-07-06T00:52:24.431 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged5/etc/access.conf': No such file or directory 2023-07-06T00:52:24.431 INFO:teuthology.orchestra.run.smithi046.stdout: +umount: /tmp/tmp.KrMG67MsYpscratch/merged5: not mounted. 2023-07-06T00:52:24.431 INFO:teuthology.orchestra.run.smithi046.stdout: +mount: /tmp/tmp.KrMG67MsYpscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-07-06T00:52:24.431 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged3/etc/access.conf': No such file or directory 2023-07-06T00:52:24.431 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged3/etc/access.conf': No such file or directory 2023-07-06T00:52:24.431 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged3/etc/access.conf': No such file or directory 2023-07-06T00:52:24.432 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged3/etc/access.conf': No such file or directory 2023-07-06T00:52:24.432 INFO:teuthology.orchestra.run.smithi046.stdout: +umount: /tmp/tmp.KrMG67MsYpscratch/merged3: not mounted. 2023-07-06T00:52:24.432 INFO:teuthology.orchestra.run.smithi046.stdout: +mount: /tmp/tmp.KrMG67MsYpscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-07-06T00:52:24.432 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged4/etc/access.conf': No such file or directory 2023-07-06T00:52:24.432 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged4/etc/access.conf': No such file or directory 2023-07-06T00:52:24.432 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged4/etc/access.conf': No such file or directory 2023-07-06T00:52:24.433 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged4/etc/access.conf': No such file or directory 2023-07-06T00:52:24.433 INFO:teuthology.orchestra.run.smithi046.stdout: +umount: /tmp/tmp.KrMG67MsYpscratch/merged4: not mounted. 2023-07-06T00:52:24.433 INFO:teuthology.orchestra.run.smithi046.stdout: +mount: /tmp/tmp.KrMG67MsYpscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-07-06T00:52:24.433 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged1/etc/access.conf': No such file or directory 2023-07-06T00:52:24.433 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged1/etc/access.conf': No such file or directory 2023-07-06T00:52:24.433 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged1/etc/access.conf': No such file or directory 2023-07-06T00:52:24.433 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged1/etc/access.conf': No such file or directory 2023-07-06T00:52:24.434 INFO:teuthology.orchestra.run.smithi046.stdout: +umount: /tmp/tmp.KrMG67MsYpscratch/merged1: not mounted. 2023-07-06T00:52:24.434 INFO:teuthology.orchestra.run.smithi046.stdout: +mount: /tmp/tmp.KrMG67MsYpscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-07-06T00:52:24.434 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged4/etc/access.conf': No such file or directory 2023-07-06T00:52:24.434 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged4/etc/access.conf': No such file or directory 2023-07-06T00:52:24.434 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged4/etc/access.conf': No such file or directory 2023-07-06T00:52:24.434 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged4/etc/access.conf': No such file or directory 2023-07-06T00:52:24.434 INFO:teuthology.orchestra.run.smithi046.stdout: +mount: mount: /tmp/tmp.KrMG67MsYpscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error./tmp/tmp.KrMG67MsYpscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-07-06T00:52:24.434 INFO:teuthology.orchestra.run.smithi046.stdout: + 2023-07-06T00:52:24.435 INFO:teuthology.orchestra.run.smithi046.stdout: +umount: /tmp/tmp.KrMG67MsYpscratch/merged4: not mounted. 2023-07-06T00:52:24.435 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged5/etc/access.conf': No such file or directory 2023-07-06T00:52:24.435 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged5/etc/access.conf': No such file or directory 2023-07-06T00:52:24.435 INFO:teuthology.orchestra.run.smithi046.stdout: +mount: mount: /tmp/tmp.KrMG67MsYpscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error./tmp/tmp.KrMG67MsYpscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-07-06T00:52:24.435 INFO:teuthology.orchestra.run.smithi046.stdout: + 2023-07-06T00:52:24.435 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged5/etc/access.conf': No such file or directory 2023-07-06T00:52:24.435 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged5/etc/access.conf': No such file or directory 2023-07-06T00:52:24.435 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged2/etc/access.conf': No such file or directory 2023-07-06T00:52:24.436 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged0/etc/access.conf': No such file or directory 2023-07-06T00:52:24.436 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged2/etc/access.conf': No such file or directory 2023-07-06T00:52:24.436 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: mv: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged0/etc/access.conf': No such file or directory 2023-07-06T00:52:24.436 INFO:teuthology.orchestra.run.smithi046.stdout: +cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged3/etc/access.conf': No such file or directory 2023-07-06T00:52:24.436 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged0/etc/access.conf': No such file or directory 2023-07-06T00:52:24.436 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged2/etc/access.conf': No such file or directory 2023-07-06T00:52:24.436 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged3/etc/access.conf': No such file or directory 2023-07-06T00:52:24.437 INFO:teuthology.orchestra.run.smithi046.stdout: +umount: /tmp/tmp.KrMG67MsYpscratch/merged5: not mounted. 2023-07-06T00:52:24.437 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged2/etc/access.conf': No such file or directory 2023-07-06T00:52:24.437 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: mv: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged0/etc/access.conf'cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged3/etc/access.conf': No such file or directory: No such file or directory 2023-07-06T00:52:24.437 INFO:teuthology.orchestra.run.smithi046.stdout: + 2023-07-06T00:52:24.437 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged3/etc/access.conf': No such file or directory 2023-07-06T00:52:24.437 INFO:teuthology.orchestra.run.smithi046.stdout: +umount: /tmp/tmp.KrMG67MsYpscratch/merged0: not mounted. 2023-07-06T00:52:24.437 INFO:teuthology.orchestra.run.smithi046.stdout: +umount: /tmp/tmp.KrMG67MsYpscratch/merged2: not mounted. 2023-07-06T00:52:24.437 INFO:teuthology.orchestra.run.smithi046.stdout: +umount: /tmp/tmp.KrMG67MsYpscratch/merged3: not mounted. 2023-07-06T00:52:24.438 INFO:teuthology.orchestra.run.smithi046.stdout: +mount: /tmp/tmp.KrMG67MsYpscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-07-06T00:52:24.438 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged1/etc/access.conf': No such file or directory 2023-07-06T00:52:24.438 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged1/etc/access.conf': No such file or directory 2023-07-06T00:52:24.438 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged1/etc/access.conf': No such file or directory 2023-07-06T00:52:24.438 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged1/etc/access.conf': No such file or directory 2023-07-06T00:52:24.438 INFO:teuthology.orchestra.run.smithi046.stdout: +umount: /tmp/tmp.KrMG67MsYpscratch/merged1: not mounted. 2023-07-06T00:52:24.438 INFO:teuthology.orchestra.run.smithi046.stdout: +mount: mount: /tmp/tmp.KrMG67MsYpscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error./tmp/tmp.KrMG67MsYpscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-07-06T00:52:24.439 INFO:teuthology.orchestra.run.smithi046.stdout: + 2023-07-06T00:52:24.439 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged3/etc/access.conf': No such file or directory 2023-07-06T00:52:24.439 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged0/etc/access.conf': No such file or directory 2023-07-06T00:52:24.439 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged3/etc/access.conf': No such file or directory 2023-07-06T00:52:24.440 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged0/etc/access.conf': No such file or directory 2023-07-06T00:52:24.440 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged3/etc/access.conf': No such file or directory 2023-07-06T00:52:24.440 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged0/etc/access.conf': No such file or directory 2023-07-06T00:52:24.440 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged3/etc/access.conf': No such file or directory 2023-07-06T00:52:24.441 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged0/etc/access.conf': No such file or directory 2023-07-06T00:52:24.441 INFO:teuthology.orchestra.run.smithi046.stdout: +umount: umount: /tmp/tmp.KrMG67MsYpscratch/merged0: not mounted./tmp/tmp.KrMG67MsYpscratch/merged3: not mounted. 2023-07-06T00:52:24.441 INFO:teuthology.orchestra.run.smithi046.stdout: + 2023-07-06T00:52:24.441 INFO:teuthology.orchestra.run.smithi046.stdout: +mount: /tmp/tmp.KrMG67MsYpscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-07-06T00:52:24.442 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged5/etc/access.conf': No such file or directory 2023-07-06T00:52:24.442 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged5/etc/access.conf': No such file or directory 2023-07-06T00:52:24.442 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged5/etc/access.conf': No such file or directory 2023-07-06T00:52:24.443 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged5/etc/access.conf': No such file or directory 2023-07-06T00:52:24.443 INFO:teuthology.orchestra.run.smithi046.stdout: +umount: /tmp/tmp.KrMG67MsYpscratch/merged5: not mounted. 2023-07-06T00:52:24.443 INFO:teuthology.orchestra.run.smithi046.stdout: +mount: /tmp/tmp.KrMG67MsYpscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-07-06T00:52:24.443 INFO:teuthology.orchestra.run.smithi046.stdout: +mount: /tmp/tmp.KrMG67MsYpscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-07-06T00:52:24.444 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged2/etc/access.conf': No such file or directory 2023-07-06T00:52:24.444 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged2/etc/access.conf': No such file or directory 2023-07-06T00:52:24.444 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged4/etc/access.conf': No such file or directory 2023-07-06T00:52:24.445 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged4/etc/access.conf': No such file or directory 2023-07-06T00:52:24.445 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged4/etc/access.conf': No such file or directory 2023-07-06T00:52:24.445 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged2/etc/access.conf': No such file or directory 2023-07-06T00:52:24.445 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged4/etc/access.conf': No such file or directory 2023-07-06T00:52:24.446 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged2/etc/access.conf': No such file or directory 2023-07-06T00:52:24.446 INFO:teuthology.orchestra.run.smithi046.stdout: +umount: /tmp/tmp.KrMG67MsYpscratch/merged4: not mounted. 2023-07-06T00:52:24.446 INFO:teuthology.orchestra.run.smithi046.stdout: +umount: /tmp/tmp.KrMG67MsYpscratch/merged2: not mounted. 2023-07-06T00:52:24.447 INFO:teuthology.orchestra.run.smithi046.stdout: +mount: /tmp/tmp.KrMG67MsYpscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-07-06T00:52:24.447 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged1/etc/access.conf': No such file or directory 2023-07-06T00:52:24.447 INFO:teuthology.orchestra.run.smithi046.stdout: +mount: /tmp/tmp.KrMG67MsYpscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-07-06T00:52:24.447 INFO:teuthology.orchestra.run.smithi046.stdout: +mount: mount: /tmp/tmp.KrMG67MsYpscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error./tmp/tmp.KrMG67MsYpscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-07-06T00:52:24.448 INFO:teuthology.orchestra.run.smithi046.stdout: + 2023-07-06T00:52:24.448 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged1/etc/access.conf': No such file or directory 2023-07-06T00:52:24.448 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged5/etc/access.conf': No such file or directory 2023-07-06T00:52:24.448 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged4/etc/access.conf'mv: : No such file or directorycannot stat '/tmp/tmp.KrMG67MsYpscratch/merged0/etc/access.conf' 2023-07-06T00:52:24.448 INFO:teuthology.orchestra.run.smithi046.stdout: +: No such file or directory 2023-07-06T00:52:24.449 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged4/etc/access.conf'cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged0/etc/access.conf': No such file or directory: No such file or directory 2023-07-06T00:52:24.449 INFO:teuthology.orchestra.run.smithi046.stdout: + 2023-07-06T00:52:24.449 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged5/etc/access.conf': No such file or directory 2023-07-06T00:52:24.450 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged0/etc/access.conf': No such file or directory 2023-07-06T00:52:24.450 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged5/etc/access.conf': No such file or directory 2023-07-06T00:52:24.450 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged4/etc/access.conf': No such file or directory 2023-07-06T00:52:24.450 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged5/etc/access.conf': No such file or directory 2023-07-06T00:52:24.451 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged0/etc/access.conf': No such file or directory 2023-07-06T00:52:24.451 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged4/etc/access.conf': No such file or directory 2023-07-06T00:52:24.451 INFO:teuthology.orchestra.run.smithi046.stdout: +umount: /tmp/tmp.KrMG67MsYpscratch/merged0: not mounted. 2023-07-06T00:52:24.451 INFO:teuthology.orchestra.run.smithi046.stdout: +umount: /tmp/tmp.KrMG67MsYpscratch/merged4: not mounted. 2023-07-06T00:52:24.451 INFO:teuthology.orchestra.run.smithi046.stdout: +umount: /tmp/tmp.KrMG67MsYpscratch/merged5: not mounted. 2023-07-06T00:52:24.451 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged1/etc/access.conf': No such file or directory 2023-07-06T00:52:24.451 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged1/etc/access.conf': No such file or directory 2023-07-06T00:52:24.451 INFO:teuthology.orchestra.run.smithi046.stdout: +umount: /tmp/tmp.KrMG67MsYpscratch/merged1: not mounted. 2023-07-06T00:52:24.452 INFO:teuthology.orchestra.run.smithi046.stdout: +mount: /tmp/tmp.KrMG67MsYpscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-07-06T00:52:24.452 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged2/etc/access.conf': No such file or directory 2023-07-06T00:52:24.452 INFO:teuthology.orchestra.run.smithi046.stdout: +mount: /tmp/tmp.KrMG67MsYpscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-07-06T00:52:24.452 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged2/etc/access.conf': No such file or directory 2023-07-06T00:52:24.452 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged3/etc/access.conf': No such file or directory 2023-07-06T00:52:24.452 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged3/etc/access.conf': No such file or directory 2023-07-06T00:52:24.452 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged2/etc/access.conf': No such file or directory 2023-07-06T00:52:24.453 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged3/etc/access.conf': No such file or directory 2023-07-06T00:52:24.453 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged2/etc/access.conf': No such file or directory 2023-07-06T00:52:24.453 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged3/etc/access.conf': No such file or directory 2023-07-06T00:52:24.453 INFO:teuthology.orchestra.run.smithi046.stdout: +umount: /tmp/tmp.KrMG67MsYpscratch/merged2: not mounted. 2023-07-06T00:52:24.453 INFO:teuthology.orchestra.run.smithi046.stdout: +umount: /tmp/tmp.KrMG67MsYpscratch/merged3: not mounted. 2023-07-06T00:52:24.453 INFO:teuthology.orchestra.run.smithi046.stdout: +mount: /tmp/tmp.KrMG67MsYpscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-07-06T00:52:24.453 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged5/etc/access.conf': No such file or directory 2023-07-06T00:52:24.454 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged5/etc/access.conf': No such file or directory 2023-07-06T00:52:24.454 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged5/etc/access.conf': No such file or directory 2023-07-06T00:52:24.454 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged5/etc/access.conf': No such file or directory 2023-07-06T00:52:24.454 INFO:teuthology.orchestra.run.smithi046.stdout: +umount: /tmp/tmp.KrMG67MsYpscratch/merged5: not mounted. 2023-07-06T00:52:24.454 INFO:teuthology.orchestra.run.smithi046.stdout: +mount: /tmp/tmp.KrMG67MsYpscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error.mount: 2023-07-06T00:52:24.454 INFO:teuthology.orchestra.run.smithi046.stdout: +/tmp/tmp.KrMG67MsYpscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-07-06T00:52:24.454 INFO:teuthology.orchestra.run.smithi046.stdout: +mount: /tmp/tmp.KrMG67MsYpscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-07-06T00:52:24.454 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged2/etc/access.conf': No such file or directory 2023-07-06T00:52:24.455 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged3/etc/access.conf': No such file or directory 2023-07-06T00:52:24.455 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged4/etc/access.conf': No such file or directory 2023-07-06T00:52:24.455 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged4/etc/access.conf': No such file or directory 2023-07-06T00:52:24.455 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged2/etc/access.conf': No such file or directory 2023-07-06T00:52:24.455 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged3/etc/access.conf': No such file or directory 2023-07-06T00:52:24.455 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged4/etc/access.conf': No such file or directory 2023-07-06T00:52:24.455 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged2/etc/access.conf': No such file or directory 2023-07-06T00:52:24.455 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged2/etc/access.conf': No such file or directory 2023-07-06T00:52:24.456 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged4/etc/access.conf': No such file or directory 2023-07-06T00:52:24.456 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged3/etc/access.conf': No such file or directory 2023-07-06T00:52:24.456 INFO:teuthology.orchestra.run.smithi046.stdout: +mount: /tmp/tmp.KrMG67MsYpscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-07-06T00:52:24.456 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged3/etc/access.conf': No such file or directory 2023-07-06T00:52:24.456 INFO:teuthology.orchestra.run.smithi046.stdout: +umount: /tmp/tmp.KrMG67MsYpscratch/merged2: not mounted. 2023-07-06T00:52:24.456 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged1/etc/access.conf': No such file or directory 2023-07-06T00:52:24.456 INFO:teuthology.orchestra.run.smithi046.stdout: +umount: /tmp/tmp.KrMG67MsYpscratch/merged4: not mounted. 2023-07-06T00:52:24.457 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged1/etc/access.conf': No such file or directory 2023-07-06T00:52:24.457 INFO:teuthology.orchestra.run.smithi046.stdout: +umount: /tmp/tmp.KrMG67MsYpscratch/merged3: not mounted. 2023-07-06T00:52:24.457 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged1/etc/access.conf': No such file or directory 2023-07-06T00:52:24.457 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged1/etc/access.conf': No such file or directory 2023-07-06T00:52:24.457 INFO:teuthology.orchestra.run.smithi046.stdout: +umount: /tmp/tmp.KrMG67MsYpscratch/merged1: not mounted. 2023-07-06T00:52:24.457 INFO:teuthology.orchestra.run.smithi046.stdout: +mount: /tmp/tmp.KrMG67MsYpscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-07-06T00:52:24.458 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged0/etc/access.conf': No such file or directory 2023-07-06T00:52:24.458 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged0/etc/access.conf': No such file or directory 2023-07-06T00:52:24.458 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged0/etc/access.conf': No such file or directory 2023-07-06T00:52:24.458 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged0/etc/access.conf': No such file or directory 2023-07-06T00:52:24.458 INFO:teuthology.orchestra.run.smithi046.stdout: +umount: /tmp/tmp.KrMG67MsYpscratch/merged0: not mounted. 2023-07-06T00:52:24.458 INFO:teuthology.orchestra.run.smithi046.stdout: +mount: /tmp/tmp.KrMG67MsYpscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-07-06T00:52:24.458 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged4/etc/access.conf': No such file or directory 2023-07-06T00:52:24.458 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged4/etc/access.conf': No such file or directory 2023-07-06T00:52:24.459 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged4/etc/access.conf': No such file or directory 2023-07-06T00:52:24.459 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged4/etc/access.conf': No such file or directory 2023-07-06T00:52:24.459 INFO:teuthology.orchestra.run.smithi046.stdout: +mount: mount: mount: /tmp/tmp.KrMG67MsYpscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error./tmp/tmp.KrMG67MsYpscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error./tmp/tmp.KrMG67MsYpscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-07-06T00:52:24.459 INFO:teuthology.orchestra.run.smithi046.stdout: + 2023-07-06T00:52:24.459 INFO:teuthology.orchestra.run.smithi046.stdout: + 2023-07-06T00:52:24.459 INFO:teuthology.orchestra.run.smithi046.stdout: +umount: /tmp/tmp.KrMG67MsYpscratch/merged4: not mounted. 2023-07-06T00:52:24.459 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged2/etc/access.conf': No such file or directory 2023-07-06T00:52:24.460 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged5/etc/access.conf': No such file or directory 2023-07-06T00:52:24.460 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged2/etc/access.conf': No such file or directory 2023-07-06T00:52:24.460 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged5/etc/access.conf': No such file or directory 2023-07-06T00:52:24.460 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged2/etc/access.conf': No such file or directory 2023-07-06T00:52:24.460 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged5/etc/access.conf': No such file or directory 2023-07-06T00:52:24.460 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged2/etc/access.conf': No such file or directory 2023-07-06T00:52:24.461 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged5/etc/access.conf': No such file or directory 2023-07-06T00:52:24.461 INFO:teuthology.orchestra.run.smithi046.stdout: +umount: /tmp/tmp.KrMG67MsYpscratch/merged2: not mounted. 2023-07-06T00:52:24.461 INFO:teuthology.orchestra.run.smithi046.stdout: +umount: /tmp/tmp.KrMG67MsYpscratch/merged5: not mounted. 2023-07-06T00:52:24.461 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged0/etc/access.conf': No such file or directory 2023-07-06T00:52:24.461 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged0/etc/access.conf': No such file or directory 2023-07-06T00:52:24.461 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged0/etc/access.conf': No such file or directory 2023-07-06T00:52:24.461 INFO:teuthology.orchestra.run.smithi046.stdout: +mount: /tmp/tmp.KrMG67MsYpscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-07-06T00:52:24.462 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged0/etc/access.conf': No such file or directory 2023-07-06T00:52:24.462 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged1/etc/access.conf': No such file or directory 2023-07-06T00:52:24.462 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged1/etc/access.conf': No such file or directory 2023-07-06T00:52:24.462 INFO:teuthology.orchestra.run.smithi046.stdout: +mount: /tmp/tmp.KrMG67MsYpscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-07-06T00:52:24.462 INFO:teuthology.orchestra.run.smithi046.stdout: +umount: /tmp/tmp.KrMG67MsYpscratch/merged0: not mounted. 2023-07-06T00:52:24.462 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged3/etc/access.conf': No such file or directory 2023-07-06T00:52:24.462 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged3/etc/access.conf': No such file or directory 2023-07-06T00:52:24.462 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged3/etc/access.conf': No such file or directory 2023-07-06T00:52:24.463 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged3/etc/access.conf': No such file or directory 2023-07-06T00:52:24.463 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged1/etc/access.conf': No such file or directory 2023-07-06T00:52:24.463 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged1/etc/access.conf': No such file or directory 2023-07-06T00:52:24.463 INFO:teuthology.orchestra.run.smithi046.stdout: +umount: /tmp/tmp.KrMG67MsYpscratch/merged3: not mounted. 2023-07-06T00:52:24.463 INFO:teuthology.orchestra.run.smithi046.stdout: +umount: /tmp/tmp.KrMG67MsYpscratch/merged1: not mounted. 2023-07-06T00:52:24.463 INFO:teuthology.orchestra.run.smithi046.stdout: +mount: /tmp/tmp.KrMG67MsYpscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-07-06T00:52:24.463 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged4/etc/access.conf': No such file or directory 2023-07-06T00:52:24.464 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged4/etc/access.conf': No such file or directory 2023-07-06T00:52:24.464 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged4/etc/access.conf': No such file or directory 2023-07-06T00:52:24.464 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged4/etc/access.conf': No such file or directory 2023-07-06T00:52:24.464 INFO:teuthology.orchestra.run.smithi046.stdout: +umount: /tmp/tmp.KrMG67MsYpscratch/merged4: not mounted. 2023-07-06T00:52:24.464 INFO:teuthology.orchestra.run.smithi046.stdout: +mount: mount: /tmp/tmp.KrMG67MsYpscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error./tmp/tmp.KrMG67MsYpscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-07-06T00:52:24.464 INFO:teuthology.orchestra.run.smithi046.stdout: + 2023-07-06T00:52:24.464 INFO:teuthology.orchestra.run.smithi046.stdout: +mount: /tmp/tmp.KrMG67MsYpscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-07-06T00:52:24.465 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged0/etc/access.conf': No such file or directory 2023-07-06T00:52:24.465 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged5/etc/access.conf': No such file or directory 2023-07-06T00:52:24.465 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged0/etc/access.conf': No such file or directory 2023-07-06T00:52:24.465 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged5/etc/access.conf': No such file or directory 2023-07-06T00:52:24.465 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged2/etc/access.conf': No such file or directory 2023-07-06T00:52:24.465 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged0/etc/access.conf': No such file or directory 2023-07-06T00:52:24.465 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged5/etc/access.conf': No such file or directory 2023-07-06T00:52:24.465 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged2/etc/access.conf': No such file or directory 2023-07-06T00:52:24.466 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged0/etc/access.conf': No such file or directory 2023-07-06T00:52:24.466 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged2/etc/access.conf': No such file or directory 2023-07-06T00:52:24.466 INFO:teuthology.orchestra.run.smithi046.stdout: +mount: /tmp/tmp.KrMG67MsYpscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-07-06T00:52:24.466 INFO:teuthology.orchestra.run.smithi046.stdout: +mount: /tmp/tmp.KrMG67MsYpscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-07-06T00:52:24.466 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged5/etc/access.conf': No such file or directory 2023-07-06T00:52:24.466 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged2/etc/access.conf': No such file or directory 2023-07-06T00:52:24.466 INFO:teuthology.orchestra.run.smithi046.stdout: +umount: /tmp/tmp.KrMG67MsYpscratch/merged0: not mounted. 2023-07-06T00:52:24.467 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged1/etc/access.conf': No such file or directory 2023-07-06T00:52:24.467 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged3/etc/access.conf': No such file or directory 2023-07-06T00:52:24.467 INFO:teuthology.orchestra.run.smithi046.stdout: +umount: /tmp/tmp.KrMG67MsYpscratch/merged2: not mounted. 2023-07-06T00:52:24.467 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged3/etc/access.conf': No such file or directory 2023-07-06T00:52:24.467 INFO:teuthology.orchestra.run.smithi046.stdout: +umount: /tmp/tmp.KrMG67MsYpscratch/merged5: not mounted. 2023-07-06T00:52:24.467 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged3/etc/access.conf': No such file or directory 2023-07-06T00:52:24.467 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged3/etc/access.conf': No such file or directory 2023-07-06T00:52:24.468 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged1/etc/access.conf': No such file or directory 2023-07-06T00:52:24.468 INFO:teuthology.orchestra.run.smithi046.stdout: +umount: /tmp/tmp.KrMG67MsYpscratch/merged3: not mounted. 2023-07-06T00:52:24.468 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged1/etc/access.conf': No such file or directory 2023-07-06T00:52:24.468 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged1/etc/access.conf': No such file or directory 2023-07-06T00:52:24.468 INFO:teuthology.orchestra.run.smithi046.stdout: +umount: /tmp/tmp.KrMG67MsYpscratch/merged1: not mounted. 2023-07-06T00:52:24.468 INFO:teuthology.orchestra.run.smithi046.stdout: +mount: /tmp/tmp.KrMG67MsYpscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-07-06T00:52:24.468 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged4/etc/access.conf': No such file or directory 2023-07-06T00:52:24.469 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged4/etc/access.conf': No such file or directory 2023-07-06T00:52:24.469 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged4/etc/access.conf': No such file or directory 2023-07-06T00:52:24.469 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged4/etc/access.conf': No such file or directory 2023-07-06T00:52:24.469 INFO:teuthology.orchestra.run.smithi046.stdout: +umount: /tmp/tmp.KrMG67MsYpscratch/merged4: not mounted. 2023-07-06T00:52:24.469 INFO:teuthology.orchestra.run.smithi046.stdout: +mount: /tmp/tmp.KrMG67MsYpscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-07-06T00:52:24.469 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged2/etc/access.conf': No such file or directory 2023-07-06T00:52:24.470 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged2/etc/access.conf': No such file or directory 2023-07-06T00:52:24.470 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged2/etc/access.conf': No such file or directory 2023-07-06T00:52:24.470 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged2/etc/access.conf': No such file or directory 2023-07-06T00:52:24.470 INFO:teuthology.orchestra.run.smithi046.stdout: +mount: /tmp/tmp.KrMG67MsYpscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-07-06T00:52:24.471 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged0/etc/access.conf': No such file or directory 2023-07-06T00:52:24.471 INFO:teuthology.orchestra.run.smithi046.stdout: +umount: /tmp/tmp.KrMG67MsYpscratch/merged2: not mounted. 2023-07-06T00:52:24.471 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged0/etc/access.conf': No such file or directory 2023-07-06T00:52:24.471 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged0/etc/access.conf': No such file or directory 2023-07-06T00:52:24.472 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged0/etc/access.conf': No such file or directory 2023-07-06T00:52:24.472 INFO:teuthology.orchestra.run.smithi046.stdout: +umount: /tmp/tmp.KrMG67MsYpscratch/merged0: not mounted. 2023-07-06T00:52:24.472 INFO:teuthology.orchestra.run.smithi046.stdout: +mount: /tmp/tmp.KrMG67MsYpscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-07-06T00:52:24.473 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged3/etc/access.conf': No such file or directory 2023-07-06T00:52:24.473 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged3/etc/access.conf': No such file or directory 2023-07-06T00:52:24.473 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged3/etc/access.conf': No such file or directory 2023-07-06T00:52:24.474 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged3/etc/access.conf': No such file or directory 2023-07-06T00:52:24.474 INFO:teuthology.orchestra.run.smithi046.stdout: +umount: /tmp/tmp.KrMG67MsYpscratch/merged3: not mounted. 2023-07-06T00:52:24.474 INFO:teuthology.orchestra.run.smithi046.stdout: +mount: /tmp/tmp.KrMG67MsYpscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-07-06T00:52:24.475 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged5/etc/access.conf': No such file or directory 2023-07-06T00:52:24.475 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged5/etc/access.conf': No such file or directory 2023-07-06T00:52:24.475 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged5/etc/access.conf': No such file or directory 2023-07-06T00:52:24.475 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged5/etc/access.conf': No such file or directory 2023-07-06T00:52:24.475 INFO:teuthology.orchestra.run.smithi046.stdout: +umount: /tmp/tmp.KrMG67MsYpscratch/merged5: not mounted. 2023-07-06T00:52:24.476 INFO:teuthology.orchestra.run.smithi046.stdout: +mount: /tmp/tmp.KrMG67MsYpscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-07-06T00:52:24.476 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged1/etc/access.conf': No such file or directory 2023-07-06T00:52:24.476 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged1/etc/access.conf': No such file or directory 2023-07-06T00:52:24.476 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged1/etc/access.conf': No such file or directory 2023-07-06T00:52:24.477 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged1/etc/access.conf': No such file or directory 2023-07-06T00:52:24.477 INFO:teuthology.orchestra.run.smithi046.stdout: +umount: /tmp/tmp.KrMG67MsYpscratch/merged1: not mounted. 2023-07-06T00:52:24.477 INFO:teuthology.orchestra.run.smithi046.stdout: +mount: /tmp/tmp.KrMG67MsYpscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-07-06T00:52:24.478 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged4/etc/access.conf': No such file or directory 2023-07-06T00:52:24.478 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged4/etc/access.conf': No such file or directory 2023-07-06T00:52:24.478 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged4/etc/access.conf': No such file or directory 2023-07-06T00:52:24.478 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged4/etc/access.conf': No such file or directory 2023-07-06T00:52:24.478 INFO:teuthology.orchestra.run.smithi046.stdout: +umount: /tmp/tmp.KrMG67MsYpscratch/merged4: not mounted. 2023-07-06T00:52:24.478 INFO:teuthology.orchestra.run.smithi046.stdout: +mount: /tmp/tmp.KrMG67MsYpscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-07-06T00:52:24.479 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged2/etc/access.conf': No such file or directory 2023-07-06T00:52:24.479 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged2/etc/access.conf': No such file or directory 2023-07-06T00:52:24.479 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged2/etc/access.conf': No such file or directory 2023-07-06T00:52:24.479 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged2/etc/access.conf': No such file or directory 2023-07-06T00:52:24.479 INFO:teuthology.orchestra.run.smithi046.stdout: +umount: /tmp/tmp.KrMG67MsYpscratch/merged2: not mounted. 2023-07-06T00:52:24.479 INFO:teuthology.orchestra.run.smithi046.stdout: +mount: /tmp/tmp.KrMG67MsYpscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-07-06T00:52:24.480 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged0/etc/access.conf': No such file or directory 2023-07-06T00:52:24.480 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged0/etc/access.conf': No such file or directory 2023-07-06T00:52:24.480 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged0/etc/access.conf': No such file or directory 2023-07-06T00:52:24.480 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged0/etc/access.conf': No such file or directory 2023-07-06T00:52:24.480 INFO:teuthology.orchestra.run.smithi046.stdout: +umount: /tmp/tmp.KrMG67MsYpscratch/merged0: not mounted. 2023-07-06T00:52:24.480 INFO:teuthology.orchestra.run.smithi046.stdout: +mount: /tmp/tmp.KrMG67MsYpscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-07-06T00:52:24.481 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged3/etc/access.conf': No such file or directory 2023-07-06T00:52:24.481 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged3/etc/access.conf': No such file or directory 2023-07-06T00:52:24.481 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged3/etc/access.conf': No such file or directory 2023-07-06T00:52:24.481 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged3/etc/access.conf': No such file or directory 2023-07-06T00:52:24.481 INFO:teuthology.orchestra.run.smithi046.stdout: +umount: /tmp/tmp.KrMG67MsYpscratch/merged3: not mounted. 2023-07-06T00:52:24.481 INFO:teuthology.orchestra.run.smithi046.stdout: +mount: /tmp/tmp.KrMG67MsYpscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-07-06T00:52:24.482 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged5/etc/access.conf': No such file or directory 2023-07-06T00:52:24.482 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged5/etc/access.conf': No such file or directory 2023-07-06T00:52:24.482 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged5/etc/access.conf': No such file or directory 2023-07-06T00:52:24.482 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged5/etc/access.conf': No such file or directory 2023-07-06T00:52:24.482 INFO:teuthology.orchestra.run.smithi046.stdout: +umount: /tmp/tmp.KrMG67MsYpscratch/merged5: not mounted. 2023-07-06T00:52:24.482 INFO:teuthology.orchestra.run.smithi046.stdout: +mount: /tmp/tmp.KrMG67MsYpscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-07-06T00:52:24.482 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged1/etc/access.conf': No such file or directory 2023-07-06T00:52:24.482 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged1/etc/access.conf': No such file or directory 2023-07-06T00:52:24.483 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged1/etc/access.conf': No such file or directory 2023-07-06T00:52:24.483 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged1/etc/access.conf': No such file or directory 2023-07-06T00:52:24.483 INFO:teuthology.orchestra.run.smithi046.stdout: +umount: /tmp/tmp.KrMG67MsYpscratch/merged1: not mounted. 2023-07-06T00:52:24.483 INFO:teuthology.orchestra.run.smithi046.stdout: +mount: /tmp/tmp.KrMG67MsYpscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-07-06T00:52:24.483 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged4/etc/access.conf': No such file or directory 2023-07-06T00:52:24.483 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged4/etc/access.conf': No such file or directory 2023-07-06T00:52:24.483 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged4/etc/access.conf': No such file or directory 2023-07-06T00:52:24.483 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged4/etc/access.conf': No such file or directory 2023-07-06T00:52:24.484 INFO:teuthology.orchestra.run.smithi046.stdout: +umount: /tmp/tmp.KrMG67MsYpscratch/merged4: not mounted. 2023-07-06T00:52:24.484 INFO:teuthology.orchestra.run.smithi046.stdout: +mount: /tmp/tmp.KrMG67MsYpscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-07-06T00:52:24.484 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged2/etc/access.conf': No such file or directory 2023-07-06T00:52:24.484 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged2/etc/access.conf': No such file or directory 2023-07-06T00:52:24.484 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged2/etc/access.conf': No such file or directory 2023-07-06T00:52:24.484 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged2/etc/access.conf': No such file or directory 2023-07-06T00:52:24.484 INFO:teuthology.orchestra.run.smithi046.stdout: +umount: /tmp/tmp.KrMG67MsYpscratch/merged2: not mounted. 2023-07-06T00:52:24.485 INFO:teuthology.orchestra.run.smithi046.stdout: +mount: /tmp/tmp.KrMG67MsYpscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-07-06T00:52:24.485 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged0/etc/access.conf': No such file or directory 2023-07-06T00:52:24.485 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged0/etc/access.conf': No such file or directory 2023-07-06T00:52:24.485 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged0/etc/access.conf': No such file or directory 2023-07-06T00:52:24.485 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged0/etc/access.conf': No such file or directory 2023-07-06T00:52:24.485 INFO:teuthology.orchestra.run.smithi046.stdout: +umount: /tmp/tmp.KrMG67MsYpscratch/merged0: not mounted. 2023-07-06T00:52:24.485 INFO:teuthology.orchestra.run.smithi046.stdout: +mount: /tmp/tmp.KrMG67MsYpscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-07-06T00:52:24.486 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged3/etc/access.conf': No such file or directory 2023-07-06T00:52:24.486 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged3/etc/access.conf': No such file or directory 2023-07-06T00:52:24.486 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged3/etc/access.conf': No such file or directory 2023-07-06T00:52:24.486 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged3/etc/access.conf': No such file or directory 2023-07-06T00:52:24.486 INFO:teuthology.orchestra.run.smithi046.stdout: +umount: /tmp/tmp.KrMG67MsYpscratch/merged3: not mounted. 2023-07-06T00:52:24.486 INFO:teuthology.orchestra.run.smithi046.stdout: +mount: /tmp/tmp.KrMG67MsYpscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-07-06T00:52:24.487 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged5/etc/access.conf': No such file or directory 2023-07-06T00:52:24.487 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged5/etc/access.conf': No such file or directory 2023-07-06T00:52:24.487 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged5/etc/access.conf': No such file or directory 2023-07-06T00:52:24.487 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged5/etc/access.conf': No such file or directory 2023-07-06T00:52:24.487 INFO:teuthology.orchestra.run.smithi046.stdout: +umount: /tmp/tmp.KrMG67MsYpscratch/merged5: not mounted. 2023-07-06T00:52:24.487 INFO:teuthology.orchestra.run.smithi046.stdout: +mount: /tmp/tmp.KrMG67MsYpscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-07-06T00:52:24.488 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged1/etc/access.conf': No such file or directory 2023-07-06T00:52:24.488 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged1/etc/access.conf': No such file or directory 2023-07-06T00:52:24.488 INFO:teuthology.orchestra.run.smithi046.stdout: +mount: /tmp/tmp.KrMG67MsYpscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-07-06T00:52:24.488 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged1/etc/access.conf': No such file or directory 2023-07-06T00:52:24.488 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged4/etc/access.conf': No such file or directory 2023-07-06T00:52:24.488 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged1/etc/access.conf': No such file or directory 2023-07-06T00:52:24.488 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged4/etc/access.conf': No such file or directory 2023-07-06T00:52:24.489 INFO:teuthology.orchestra.run.smithi046.stdout: +umount: /tmp/tmp.KrMG67MsYpscratch/merged1: not mounted. 2023-07-06T00:52:24.489 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged4/etc/access.conf': No such file or directory 2023-07-06T00:52:24.489 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged4/etc/access.conf': No such file or directory 2023-07-06T00:52:24.489 INFO:teuthology.orchestra.run.smithi046.stdout: +umount: /tmp/tmp.KrMG67MsYpscratch/merged4: not mounted. 2023-07-06T00:52:24.489 INFO:teuthology.orchestra.run.smithi046.stdout: +mount: /tmp/tmp.KrMG67MsYpscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-07-06T00:52:24.489 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged2/etc/access.conf': No such file or directory 2023-07-06T00:52:24.489 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged2/etc/access.conf': No such file or directory 2023-07-06T00:52:24.490 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged2/etc/access.conf': No such file or directory 2023-07-06T00:52:24.490 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged2/etc/access.conf': No such file or directory 2023-07-06T00:52:24.490 INFO:teuthology.orchestra.run.smithi046.stdout: +umount: /tmp/tmp.KrMG67MsYpscratch/merged2: not mounted. 2023-07-06T00:52:24.490 INFO:teuthology.orchestra.run.smithi046.stdout: +mount: mount: /tmp/tmp.KrMG67MsYpscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-07-06T00:52:24.490 INFO:teuthology.orchestra.run.smithi046.stdout: +/tmp/tmp.KrMG67MsYpscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-07-06T00:52:24.490 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged3/etc/access.conf': No such file or directory 2023-07-06T00:52:24.490 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged0/etc/access.conf': No such file or directory 2023-07-06T00:52:24.490 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged3/etc/access.conf'cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged0/etc/access.conf': No such file or directory: No such file or directory 2023-07-06T00:52:24.491 INFO:teuthology.orchestra.run.smithi046.stdout: + 2023-07-06T00:52:24.491 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged3/etc/access.conf': No such file or directory 2023-07-06T00:52:24.491 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged3/etc/access.conf': No such file or directory 2023-07-06T00:52:24.491 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged0/etc/access.conf': No such file or directory 2023-07-06T00:52:24.491 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged0/etc/access.conf': No such file or directory 2023-07-06T00:52:24.491 INFO:teuthology.orchestra.run.smithi046.stdout: +umount: /tmp/tmp.KrMG67MsYpscratch/merged3: not mounted. 2023-07-06T00:52:24.492 INFO:teuthology.orchestra.run.smithi046.stdout: +umount: /tmp/tmp.KrMG67MsYpscratch/merged0: not mounted. 2023-07-06T00:52:24.492 INFO:teuthology.orchestra.run.smithi046.stdout: +mount: /tmp/tmp.KrMG67MsYpscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-07-06T00:52:24.492 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged1/etc/access.conf': No such file or directory 2023-07-06T00:52:24.492 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged1/etc/access.conf': No such file or directory 2023-07-06T00:52:24.492 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged1/etc/access.conf': No such file or directory 2023-07-06T00:52:24.492 INFO:teuthology.orchestra.run.smithi046.stdout: +mount: /tmp/tmp.KrMG67MsYpscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-07-06T00:52:24.492 INFO:teuthology.orchestra.run.smithi046.stdout: +mount: /tmp/tmp.KrMG67MsYpscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-07-06T00:52:24.493 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged1/etc/access.conf': No such file or directory 2023-07-06T00:52:24.493 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged5/etc/access.conf': No such file or directory 2023-07-06T00:52:24.493 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged4/etc/access.conf': No such file or directory 2023-07-06T00:52:24.493 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged5/etc/access.conf'cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged4/etc/access.conf': No such file or directory: No such file or directory 2023-07-06T00:52:24.493 INFO:teuthology.orchestra.run.smithi046.stdout: + 2023-07-06T00:52:24.493 INFO:teuthology.orchestra.run.smithi046.stdout: +umount: /tmp/tmp.KrMG67MsYpscratch/merged1: not mounted. 2023-07-06T00:52:24.493 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged4/etc/access.conf': No such file or directory 2023-07-06T00:52:24.493 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged5/etc/access.conf': No such file or directory 2023-07-06T00:52:24.494 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged4/etc/access.conf': No such file or directory 2023-07-06T00:52:24.494 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged5/etc/access.conf': No such file or directory 2023-07-06T00:52:24.494 INFO:teuthology.orchestra.run.smithi046.stdout: +umount: /tmp/tmp.KrMG67MsYpscratch/merged4: not mounted. 2023-07-06T00:52:24.494 INFO:teuthology.orchestra.run.smithi046.stdout: +umount: /tmp/tmp.KrMG67MsYpscratch/merged5: not mounted. 2023-07-06T00:52:24.494 INFO:teuthology.orchestra.run.smithi046.stdout: +mount: /tmp/tmp.KrMG67MsYpscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-07-06T00:52:24.494 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged2/etc/access.conf': No such file or directory 2023-07-06T00:52:24.495 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged2/etc/access.conf': No such file or directory 2023-07-06T00:52:24.495 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged2/etc/access.conf': No such file or directory 2023-07-06T00:52:24.495 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged2/etc/access.conf': No such file or directory 2023-07-06T00:52:24.495 INFO:teuthology.orchestra.run.smithi046.stdout: +umount: /tmp/tmp.KrMG67MsYpscratch/merged2: not mounted. 2023-07-06T00:52:24.495 INFO:teuthology.orchestra.run.smithi046.stdout: +mount: /tmp/tmp.KrMG67MsYpscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-07-06T00:52:24.495 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged3/etc/access.conf': No such file or directory 2023-07-06T00:52:24.495 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged3/etc/access.conf': No such file or directory 2023-07-06T00:52:24.495 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged3/etc/access.conf': No such file or directory 2023-07-06T00:52:24.496 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged3/etc/access.conf': No such file or directory 2023-07-06T00:52:24.496 INFO:teuthology.orchestra.run.smithi046.stdout: +umount: /tmp/tmp.KrMG67MsYpscratch/merged3: not mounted. 2023-07-06T00:52:24.496 INFO:teuthology.orchestra.run.smithi046.stdout: +mount: /tmp/tmp.KrMG67MsYpscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-07-06T00:52:24.496 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged0/etc/access.conf': No such file or directory 2023-07-06T00:52:24.496 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged0/etc/access.conf': No such file or directory 2023-07-06T00:52:24.496 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged0/etc/access.conf': No such file or directory 2023-07-06T00:52:24.496 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged0/etc/access.conf': No such file or directory 2023-07-06T00:52:24.497 INFO:teuthology.orchestra.run.smithi046.stdout: +umount: /tmp/tmp.KrMG67MsYpscratch/merged0: not mounted. 2023-07-06T00:52:24.497 INFO:teuthology.orchestra.run.smithi046.stdout: +mount: /tmp/tmp.KrMG67MsYpscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-07-06T00:52:24.497 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged4/etc/access.conf': No such file or directory 2023-07-06T00:52:24.497 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged4/etc/access.conf': No such file or directory 2023-07-06T00:52:24.497 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged4/etc/access.conf': No such file or directory 2023-07-06T00:52:24.497 INFO:teuthology.orchestra.run.smithi046.stdout: +mount: /tmp/tmp.KrMG67MsYpscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-07-06T00:52:24.497 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged4/etc/access.conf': No such file or directory 2023-07-06T00:52:24.497 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged1/etc/access.conf': No such file or directory 2023-07-06T00:52:24.498 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged1/etc/access.conf': No such file or directory 2023-07-06T00:52:24.498 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged1/etc/access.conf': No such file or directory 2023-07-06T00:52:24.498 INFO:teuthology.orchestra.run.smithi046.stdout: +umount: /tmp/tmp.KrMG67MsYpscratch/merged4: not mounted. 2023-07-06T00:52:24.498 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged1/etc/access.conf': No such file or directory 2023-07-06T00:52:24.498 INFO:teuthology.orchestra.run.smithi046.stdout: +umount: /tmp/tmp.KrMG67MsYpscratch/merged1: not mounted. 2023-07-06T00:52:24.498 INFO:teuthology.orchestra.run.smithi046.stdout: +mount: /tmp/tmp.KrMG67MsYpscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-07-06T00:52:24.498 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged5/etc/access.conf': No such file or directory 2023-07-06T00:52:24.499 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged5/etc/access.conf': No such file or directory 2023-07-06T00:52:24.499 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged5/etc/access.conf': No such file or directory 2023-07-06T00:52:24.499 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged5/etc/access.conf': No such file or directory 2023-07-06T00:52:24.499 INFO:teuthology.orchestra.run.smithi046.stdout: +umount: /tmp/tmp.KrMG67MsYpscratch/merged5: not mounted. 2023-07-06T00:52:24.499 INFO:teuthology.orchestra.run.smithi046.stdout: +mount: /tmp/tmp.KrMG67MsYpscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-07-06T00:52:24.499 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged2/etc/access.conf': No such file or directory 2023-07-06T00:52:24.499 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged2/etc/access.conf': No such file or directory 2023-07-06T00:52:24.499 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged2/etc/access.conf': No such file or directory 2023-07-06T00:52:24.500 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged2/etc/access.conf': No such file or directory 2023-07-06T00:52:24.500 INFO:teuthology.orchestra.run.smithi046.stdout: +umount: /tmp/tmp.KrMG67MsYpscratch/merged2: not mounted. 2023-07-06T00:52:24.500 INFO:teuthology.orchestra.run.smithi046.stdout: +mount: /tmp/tmp.KrMG67MsYpscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-07-06T00:52:24.500 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged3/etc/access.conf': No such file or directory 2023-07-06T00:52:24.500 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged3/etc/access.conf': No such file or directory 2023-07-06T00:52:24.500 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged3/etc/access.conf': No such file or directory 2023-07-06T00:52:24.500 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged3/etc/access.conf': No such file or directory 2023-07-06T00:52:24.501 INFO:teuthology.orchestra.run.smithi046.stdout: +mount: /tmp/tmp.KrMG67MsYpscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-07-06T00:52:24.501 INFO:teuthology.orchestra.run.smithi046.stdout: +umount: /tmp/tmp.KrMG67MsYpscratch/merged3: not mounted. 2023-07-06T00:52:24.501 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged0/etc/access.conf': No such file or directory 2023-07-06T00:52:24.501 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged0/etc/access.conf': No such file or directory 2023-07-06T00:52:24.501 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged0/etc/access.conf': No such file or directory 2023-07-06T00:52:24.501 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged0/etc/access.conf': No such file or directory 2023-07-06T00:52:24.501 INFO:teuthology.orchestra.run.smithi046.stdout: +umount: /tmp/tmp.KrMG67MsYpscratch/merged0: not mounted. 2023-07-06T00:52:24.501 INFO:teuthology.orchestra.run.smithi046.stdout: +mount: /tmp/tmp.KrMG67MsYpscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-07-06T00:52:24.502 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged4/etc/access.conf': No such file or directory 2023-07-06T00:52:24.502 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged4/etc/access.conf': No such file or directory 2023-07-06T00:52:24.502 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged4/etc/access.conf': No such file or directory 2023-07-06T00:52:24.502 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged4/etc/access.conf': No such file or directory 2023-07-06T00:52:24.502 INFO:teuthology.orchestra.run.smithi046.stdout: +umount: /tmp/tmp.KrMG67MsYpscratch/merged4: not mounted. 2023-07-06T00:52:24.502 INFO:teuthology.orchestra.run.smithi046.stdout: +mount: /tmp/tmp.KrMG67MsYpscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-07-06T00:52:24.502 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged1/etc/access.conf': No such file or directory 2023-07-06T00:52:24.502 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged1/etc/access.conf': No such file or directory 2023-07-06T00:52:24.503 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged1/etc/access.conf': No such file or directory 2023-07-06T00:52:24.503 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged1/etc/access.conf': No such file or directory 2023-07-06T00:52:24.503 INFO:teuthology.orchestra.run.smithi046.stdout: +umount: /tmp/tmp.KrMG67MsYpscratch/merged1: not mounted. 2023-07-06T00:52:24.503 INFO:teuthology.orchestra.run.smithi046.stdout: +mount: /tmp/tmp.KrMG67MsYpscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-07-06T00:52:24.503 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged5/etc/access.conf': No such file or directory 2023-07-06T00:52:24.504 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged5/etc/access.conf': No such file or directory 2023-07-06T00:52:24.504 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged5/etc/access.conf': No such file or directory 2023-07-06T00:52:24.504 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged5/etc/access.conf': No such file or directory 2023-07-06T00:52:24.504 INFO:teuthology.orchestra.run.smithi046.stdout: +umount: /tmp/tmp.KrMG67MsYpscratch/merged5: not mounted. 2023-07-06T00:52:24.504 INFO:teuthology.orchestra.run.smithi046.stdout: +mount: /tmp/tmp.KrMG67MsYpscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-07-06T00:52:24.505 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged2/etc/access.conf': No such file or directory 2023-07-06T00:52:24.505 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged2/etc/access.conf': No such file or directory 2023-07-06T00:52:24.505 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged2/etc/access.conf': No such file or directory 2023-07-06T00:52:24.505 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged2/etc/access.conf': No such file or directory 2023-07-06T00:52:24.505 INFO:teuthology.orchestra.run.smithi046.stdout: +umount: /tmp/tmp.KrMG67MsYpscratch/merged2: not mounted. 2023-07-06T00:52:24.506 INFO:teuthology.orchestra.run.smithi046.stdout: +mount: /tmp/tmp.KrMG67MsYpscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-07-06T00:52:24.506 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged0/etc/access.conf': No such file or directory 2023-07-06T00:52:24.506 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged0/etc/access.conf': No such file or directory 2023-07-06T00:52:24.506 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged0/etc/access.conf': No such file or directory 2023-07-06T00:52:24.507 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged0/etc/access.conf': No such file or directory 2023-07-06T00:52:24.507 INFO:teuthology.orchestra.run.smithi046.stdout: +umount: /tmp/tmp.KrMG67MsYpscratch/merged0: not mounted. 2023-07-06T00:52:24.507 INFO:teuthology.orchestra.run.smithi046.stdout: +mount: /tmp/tmp.KrMG67MsYpscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-07-06T00:52:24.507 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged3/etc/access.conf': No such file or directory 2023-07-06T00:52:24.507 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged3/etc/access.conf': No such file or directory 2023-07-06T00:52:24.508 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged3/etc/access.conf': No such file or directory 2023-07-06T00:52:24.508 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged3/etc/access.conf': No such file or directory 2023-07-06T00:52:24.508 INFO:teuthology.orchestra.run.smithi046.stdout: +umount: /tmp/tmp.KrMG67MsYpscratch/merged3: not mounted. 2023-07-06T00:52:24.508 INFO:teuthology.orchestra.run.smithi046.stdout: +mount: /tmp/tmp.KrMG67MsYpscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-07-06T00:52:24.508 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged4/etc/access.conf': No such file or directory 2023-07-06T00:52:24.509 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged4/etc/access.conf': No such file or directory 2023-07-06T00:52:24.509 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged4/etc/access.conf': No such file or directory 2023-07-06T00:52:24.509 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged4/etc/access.conf': No such file or directory 2023-07-06T00:52:24.509 INFO:teuthology.orchestra.run.smithi046.stdout: +umount: /tmp/tmp.KrMG67MsYpscratch/merged4: not mounted. 2023-07-06T00:52:24.510 INFO:teuthology.orchestra.run.smithi046.stdout: +mount: /tmp/tmp.KrMG67MsYpscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-07-06T00:52:24.510 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged1/etc/access.conf': No such file or directory 2023-07-06T00:52:24.510 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged1/etc/access.conf': No such file or directory 2023-07-06T00:52:24.510 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged1/etc/access.conf': No such file or directory 2023-07-06T00:52:24.510 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged1/etc/access.conf': No such file or directory 2023-07-06T00:52:24.511 INFO:teuthology.orchestra.run.smithi046.stdout: +umount: /tmp/tmp.KrMG67MsYpscratch/merged1: not mounted. 2023-07-06T00:52:24.511 INFO:teuthology.orchestra.run.smithi046.stdout: +mount: /tmp/tmp.KrMG67MsYpscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-07-06T00:52:24.511 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged5/etc/access.conf': No such file or directory 2023-07-06T00:52:24.511 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged5/etc/access.conf': No such file or directory 2023-07-06T00:52:24.511 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged5/etc/access.conf': No such file or directory 2023-07-06T00:52:24.512 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged5/etc/access.conf': No such file or directory 2023-07-06T00:52:24.512 INFO:teuthology.orchestra.run.smithi046.stdout: +umount: /tmp/tmp.KrMG67MsYpscratch/merged5: not mounted. 2023-07-06T00:52:24.512 INFO:teuthology.orchestra.run.smithi046.stdout: +mount: /tmp/tmp.KrMG67MsYpscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-07-06T00:52:24.512 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged0/etc/access.conf': No such file or directory 2023-07-06T00:52:24.513 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged0/etc/access.conf': No such file or directory 2023-07-06T00:52:24.513 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged0/etc/access.conf': No such file or directory 2023-07-06T00:52:24.513 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged0/etc/access.conf': No such file or directory 2023-07-06T00:52:24.513 INFO:teuthology.orchestra.run.smithi046.stdout: +umount: /tmp/tmp.KrMG67MsYpscratch/merged0: not mounted. 2023-07-06T00:52:24.514 INFO:teuthology.orchestra.run.smithi046.stdout: +mount: /tmp/tmp.KrMG67MsYpscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-07-06T00:52:24.514 INFO:teuthology.orchestra.run.smithi046.stdout: +mount: /tmp/tmp.KrMG67MsYpscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-07-06T00:52:24.514 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged2/etc/access.conf': No such file or directory 2023-07-06T00:52:24.514 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged2/etc/access.conf': No such file or directory 2023-07-06T00:52:24.514 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged3/etc/access.conf': No such file or directory 2023-07-06T00:52:24.514 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged2/etc/access.conf': No such file or directorytouch: 2023-07-06T00:52:24.515 INFO:teuthology.orchestra.run.smithi046.stdout: +cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged3/etc/access.conf': No such file or directory 2023-07-06T00:52:24.515 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged2/etc/access.conf': No such file or directory 2023-07-06T00:52:24.515 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged3/etc/access.conf': No such file or directory 2023-07-06T00:52:24.515 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged3/etc/access.conf': No such file or directory 2023-07-06T00:52:24.515 INFO:teuthology.orchestra.run.smithi046.stdout: +umount: /tmp/tmp.KrMG67MsYpscratch/merged2: not mounted. 2023-07-06T00:52:24.515 INFO:teuthology.orchestra.run.smithi046.stdout: +umount: /tmp/tmp.KrMG67MsYpscratch/merged3: not mounted. 2023-07-06T00:52:24.515 INFO:teuthology.orchestra.run.smithi046.stdout: +mount: /tmp/tmp.KrMG67MsYpscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-07-06T00:52:24.516 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged4/etc/access.conf': No such file or directory 2023-07-06T00:52:24.516 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged4/etc/access.conf': No such file or directory 2023-07-06T00:52:24.516 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged4/etc/access.conf': No such file or directory 2023-07-06T00:52:24.516 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged4/etc/access.conf': No such file or directory 2023-07-06T00:52:24.516 INFO:teuthology.orchestra.run.smithi046.stdout: +umount: /tmp/tmp.KrMG67MsYpscratch/merged4: not mounted. 2023-07-06T00:52:24.516 INFO:teuthology.orchestra.run.smithi046.stdout: +mount: /tmp/tmp.KrMG67MsYpscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-07-06T00:52:24.516 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged1/etc/access.conf': No such file or directory 2023-07-06T00:52:24.516 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged1/etc/access.conf': No such file or directory 2023-07-06T00:52:24.517 INFO:teuthology.orchestra.run.smithi046.stdout: +mount: /tmp/tmp.KrMG67MsYpscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-07-06T00:52:24.517 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged1/etc/access.conf': No such file or directory 2023-07-06T00:52:24.517 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged5/etc/access.conf': No such file or directory 2023-07-06T00:52:24.517 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged1/etc/access.conf': No such file or directory 2023-07-06T00:52:24.517 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged5/etc/access.conf': No such file or directory 2023-07-06T00:52:24.517 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged5/etc/access.conf': No such file or directory 2023-07-06T00:52:24.517 INFO:teuthology.orchestra.run.smithi046.stdout: +umount: /tmp/tmp.KrMG67MsYpscratch/merged1: not mounted. 2023-07-06T00:52:24.517 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged5/etc/access.conf': No such file or directory 2023-07-06T00:52:24.518 INFO:teuthology.orchestra.run.smithi046.stdout: +umount: /tmp/tmp.KrMG67MsYpscratch/merged5: not mounted. 2023-07-06T00:52:24.518 INFO:teuthology.orchestra.run.smithi046.stdout: +mount: /tmp/tmp.KrMG67MsYpscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-07-06T00:52:24.518 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged0/etc/access.conf': No such file or directory 2023-07-06T00:52:24.518 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged0/etc/access.conf': No such file or directory 2023-07-06T00:52:24.518 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged0/etc/access.conf': No such file or directory 2023-07-06T00:52:24.518 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged0/etc/access.conf': No such file or directory 2023-07-06T00:52:24.518 INFO:teuthology.orchestra.run.smithi046.stdout: +umount: /tmp/tmp.KrMG67MsYpscratch/merged0: not mounted. 2023-07-06T00:52:24.518 INFO:teuthology.orchestra.run.smithi046.stdout: +mount: /tmp/tmp.KrMG67MsYpscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-07-06T00:52:24.519 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged2/etc/access.conf': No such file or directory 2023-07-06T00:52:24.519 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged2/etc/access.conf': No such file or directory 2023-07-06T00:52:24.519 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged2/etc/access.conf': No such file or directory 2023-07-06T00:52:24.519 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged2/etc/access.conf': No such file or directory 2023-07-06T00:52:24.519 INFO:teuthology.orchestra.run.smithi046.stdout: +umount: /tmp/tmp.KrMG67MsYpscratch/merged2: not mounted. 2023-07-06T00:52:24.519 INFO:teuthology.orchestra.run.smithi046.stdout: +mount: /tmp/tmp.KrMG67MsYpscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-07-06T00:52:24.519 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged4/etc/access.conf': No such file or directory 2023-07-06T00:52:24.520 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged4/etc/access.conf': No such file or directory 2023-07-06T00:52:24.520 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged4/etc/access.conf': No such file or directory 2023-07-06T00:52:24.520 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged4/etc/access.conf': No such file or directory 2023-07-06T00:52:24.520 INFO:teuthology.orchestra.run.smithi046.stdout: +mount: /tmp/tmp.KrMG67MsYpscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-07-06T00:52:24.520 INFO:teuthology.orchestra.run.smithi046.stdout: +umount: /tmp/tmp.KrMG67MsYpscratch/merged4: not mounted. 2023-07-06T00:52:24.520 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged3/etc/access.conf': No such file or directory 2023-07-06T00:52:24.520 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged3/etc/access.conf': No such file or directory 2023-07-06T00:52:24.520 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged3/etc/access.conf': No such file or directory 2023-07-06T00:52:24.521 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged3/etc/access.conf': No such file or directory 2023-07-06T00:52:24.521 INFO:teuthology.orchestra.run.smithi046.stdout: +umount: /tmp/tmp.KrMG67MsYpscratch/merged3: not mounted. 2023-07-06T00:52:24.521 INFO:teuthology.orchestra.run.smithi046.stdout: +mount: /tmp/tmp.KrMG67MsYpscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-07-06T00:52:24.521 INFO:teuthology.orchestra.run.smithi046.stdout: +mount: /tmp/tmp.KrMG67MsYpscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-07-06T00:52:24.521 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged1/etc/access.conf': No such file or directory 2023-07-06T00:52:24.521 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged5/etc/access.conf': No such file or directory 2023-07-06T00:52:24.521 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged1/etc/access.conf': No such file or directory 2023-07-06T00:52:24.521 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged5/etc/access.conf': No such file or directory 2023-07-06T00:52:24.522 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged1/etc/access.conf': No such file or directory 2023-07-06T00:52:24.522 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged5/etc/access.conf': No such file or directory 2023-07-06T00:52:24.522 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged1/etc/access.conf': No such file or directory 2023-07-06T00:52:24.522 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged5/etc/access.conf': No such file or directory 2023-07-06T00:52:24.522 INFO:teuthology.orchestra.run.smithi046.stdout: +umount: /tmp/tmp.KrMG67MsYpscratch/merged1: not mounted. 2023-07-06T00:52:24.522 INFO:teuthology.orchestra.run.smithi046.stdout: +umount: /tmp/tmp.KrMG67MsYpscratch/merged5: not mounted. 2023-07-06T00:52:24.522 INFO:teuthology.orchestra.run.smithi046.stdout: +mount: /tmp/tmp.KrMG67MsYpscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-07-06T00:52:24.522 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged0/etc/access.conf': No such file or directory 2023-07-06T00:52:24.523 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged0/etc/access.conf': No such file or directory 2023-07-06T00:52:24.523 INFO:teuthology.orchestra.run.smithi046.stdout: +mount: /tmp/tmp.KrMG67MsYpscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-07-06T00:52:24.523 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged0/etc/access.conf': No such file or directory 2023-07-06T00:52:24.523 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged0/etc/access.conf': No such file or directory 2023-07-06T00:52:24.523 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged2/etc/access.conf': No such file or directory 2023-07-06T00:52:24.523 INFO:teuthology.orchestra.run.smithi046.stdout: +umount: /tmp/tmp.KrMG67MsYpscratch/merged0: not mounted. 2023-07-06T00:52:24.523 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged2/etc/access.conf': No such file or directory 2023-07-06T00:52:24.524 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged2/etc/access.conf': No such file or directory 2023-07-06T00:52:24.524 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged2/etc/access.conf': No such file or directory 2023-07-06T00:52:24.524 INFO:teuthology.orchestra.run.smithi046.stdout: +umount: /tmp/tmp.KrMG67MsYpscratch/merged2: not mounted. 2023-07-06T00:52:24.524 INFO:teuthology.orchestra.run.smithi046.stdout: +mount: /tmp/tmp.KrMG67MsYpscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-07-06T00:52:24.524 INFO:teuthology.orchestra.run.smithi046.stdout: +mount: /tmp/tmp.KrMG67MsYpscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-07-06T00:52:24.524 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged4/etc/access.conf': No such file or directory 2023-07-06T00:52:24.524 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged3/etc/access.conf': No such file or directory 2023-07-06T00:52:24.524 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged3/etc/access.conf': No such file or directory 2023-07-06T00:52:24.525 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged4/etc/access.conf': No such file or directory 2023-07-06T00:52:24.525 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged3/etc/access.conf': No such file or directory 2023-07-06T00:52:24.525 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged4/etc/access.conf': No such file or directory 2023-07-06T00:52:24.525 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged3/etc/access.conf': No such file or directory 2023-07-06T00:52:24.525 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged4/etc/access.conf': No such file or directory 2023-07-06T00:52:24.525 INFO:teuthology.orchestra.run.smithi046.stdout: +umount: umount: /tmp/tmp.KrMG67MsYpscratch/merged3: not mounted./tmp/tmp.KrMG67MsYpscratch/merged4: not mounted. 2023-07-06T00:52:24.525 INFO:teuthology.orchestra.run.smithi046.stdout: + 2023-07-06T00:52:24.526 INFO:teuthology.orchestra.run.smithi046.stdout: +mount: /tmp/tmp.KrMG67MsYpscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error.mount: 2023-07-06T00:52:24.526 INFO:teuthology.orchestra.run.smithi046.stdout: +/tmp/tmp.KrMG67MsYpscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-07-06T00:52:24.526 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged1/etc/access.conf'cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged5/etc/access.conf': No such file or directory: No such file or directory 2023-07-06T00:52:24.526 INFO:teuthology.orchestra.run.smithi046.stdout: + 2023-07-06T00:52:24.526 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged5/etc/access.conf': No such file or directory 2023-07-06T00:52:24.526 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged1/etc/access.conf': No such file or directory 2023-07-06T00:52:24.526 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged5/etc/access.conf': No such file or directory 2023-07-06T00:52:24.526 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged1/etc/access.conf': No such file or directory 2023-07-06T00:52:24.527 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged1/etc/access.conf': No such file or directory 2023-07-06T00:52:24.527 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged5/etc/access.conf': No such file or directory 2023-07-06T00:52:24.527 INFO:teuthology.orchestra.run.smithi046.stdout: +umount: umount: /tmp/tmp.KrMG67MsYpscratch/merged1: not mounted./tmp/tmp.KrMG67MsYpscratch/merged5: not mounted. 2023-07-06T00:52:24.527 INFO:teuthology.orchestra.run.smithi046.stdout: + 2023-07-06T00:52:24.527 INFO:teuthology.orchestra.run.smithi046.stdout: +mount: /tmp/tmp.KrMG67MsYpscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-07-06T00:52:24.527 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged0/etc/access.conf': No such file or directory 2023-07-06T00:52:24.527 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged0/etc/access.conf': No such file or directory 2023-07-06T00:52:24.527 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged0/etc/access.conf': No such file or directory 2023-07-06T00:52:24.528 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged0/etc/access.conf': No such file or directory 2023-07-06T00:52:24.528 INFO:teuthology.orchestra.run.smithi046.stdout: +umount: /tmp/tmp.KrMG67MsYpscratch/merged0: not mounted. 2023-07-06T00:52:24.528 INFO:teuthology.orchestra.run.smithi046.stdout: +mount: /tmp/tmp.KrMG67MsYpscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-07-06T00:52:24.528 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged2/etc/access.conf': No such file or directory 2023-07-06T00:52:24.528 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged2/etc/access.conf': No such file or directory 2023-07-06T00:52:24.528 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged2/etc/access.conf': No such file or directory 2023-07-06T00:52:24.528 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged2/etc/access.conf': No such file or directory 2023-07-06T00:52:24.528 INFO:teuthology.orchestra.run.smithi046.stdout: +umount: /tmp/tmp.KrMG67MsYpscratch/merged2: not mounted. 2023-07-06T00:52:24.529 INFO:teuthology.orchestra.run.smithi046.stdout: +mount: /tmp/tmp.KrMG67MsYpscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-07-06T00:52:24.529 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged4/etc/access.conf': No such file or directory 2023-07-06T00:52:24.529 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged4/etc/access.conf': No such file or directory 2023-07-06T00:52:24.529 INFO:teuthology.orchestra.run.smithi046.stdout: +mount: /tmp/tmp.KrMG67MsYpscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-07-06T00:52:24.529 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged4/etc/access.conf': No such file or directory 2023-07-06T00:52:24.529 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged4/etc/access.conf': No such file or directory 2023-07-06T00:52:24.529 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged3/etc/access.conf': No such file or directory 2023-07-06T00:52:24.529 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged3/etc/access.conf': No such file or directory 2023-07-06T00:52:24.530 INFO:teuthology.orchestra.run.smithi046.stdout: +umount: /tmp/tmp.KrMG67MsYpscratch/merged4: not mounted. 2023-07-06T00:52:24.530 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged3/etc/access.conf': No such file or directory 2023-07-06T00:52:24.530 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged3/etc/access.conf': No such file or directory 2023-07-06T00:52:24.530 INFO:teuthology.orchestra.run.smithi046.stdout: +umount: /tmp/tmp.KrMG67MsYpscratch/merged3: not mounted. 2023-07-06T00:52:24.530 INFO:teuthology.orchestra.run.smithi046.stdout: +mount: /tmp/tmp.KrMG67MsYpscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-07-06T00:52:24.530 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged1/etc/access.conf': No such file or directory 2023-07-06T00:52:24.530 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged1/etc/access.conf': No such file or directory 2023-07-06T00:52:24.530 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged1/etc/access.conf': No such file or directory 2023-07-06T00:52:24.531 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged1/etc/access.conf': No such file or directory 2023-07-06T00:52:24.531 INFO:teuthology.orchestra.run.smithi046.stdout: +umount: /tmp/tmp.KrMG67MsYpscratch/merged1: not mounted. 2023-07-06T00:52:24.531 INFO:teuthology.orchestra.run.smithi046.stdout: +mount: /tmp/tmp.KrMG67MsYpscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-07-06T00:52:24.531 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged5/etc/access.conf': No such file or directory 2023-07-06T00:52:24.531 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged5/etc/access.conf': No such file or directory 2023-07-06T00:52:24.531 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged5/etc/access.conf': No such file or directory 2023-07-06T00:52:24.531 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged5/etc/access.conf': No such file or directory 2023-07-06T00:52:24.532 INFO:teuthology.orchestra.run.smithi046.stdout: +umount: /tmp/tmp.KrMG67MsYpscratch/merged5: not mounted. 2023-07-06T00:52:24.532 INFO:teuthology.orchestra.run.smithi046.stdout: +mount: /tmp/tmp.KrMG67MsYpscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-07-06T00:52:24.532 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged0/etc/access.conf': No such file or directory 2023-07-06T00:52:24.532 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged0/etc/access.conf': No such file or directory 2023-07-06T00:52:24.532 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged0/etc/access.conf': No such file or directory 2023-07-06T00:52:24.532 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged0/etc/access.conf': No such file or directory 2023-07-06T00:52:24.532 INFO:teuthology.orchestra.run.smithi046.stdout: +umount: /tmp/tmp.KrMG67MsYpscratch/merged0: not mounted. 2023-07-06T00:52:24.535 INFO:teuthology.orchestra.run.smithi046.stdout: +mount: /tmp/tmp.KrMG67MsYpscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-07-06T00:52:24.536 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged2/etc/access.conf': No such file or directory 2023-07-06T00:52:24.536 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged2/etc/access.conf': No such file or directory 2023-07-06T00:52:24.536 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged2/etc/access.conf': No such file or directory 2023-07-06T00:52:24.536 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged2/etc/access.conf': No such file or directory 2023-07-06T00:52:24.536 INFO:teuthology.orchestra.run.smithi046.stdout: +umount: /tmp/tmp.KrMG67MsYpscratch/merged2: not mounted. 2023-07-06T00:52:24.536 INFO:teuthology.orchestra.run.smithi046.stdout: +mount: /tmp/tmp.KrMG67MsYpscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-07-06T00:52:24.536 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged3/etc/access.conf': No such file or directory 2023-07-06T00:52:24.537 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged3/etc/access.conf': No such file or directory 2023-07-06T00:52:24.537 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged3/etc/access.conf': No such file or directory 2023-07-06T00:52:24.537 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged3/etc/access.conf': No such file or directory 2023-07-06T00:52:24.537 INFO:teuthology.orchestra.run.smithi046.stdout: +umount: /tmp/tmp.KrMG67MsYpscratch/merged3: not mounted. 2023-07-06T00:52:24.537 INFO:teuthology.orchestra.run.smithi046.stdout: +mount: /tmp/tmp.KrMG67MsYpscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-07-06T00:52:24.537 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged4/etc/access.conf': No such file or directory 2023-07-06T00:52:24.537 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged4/etc/access.conf': No such file or directory 2023-07-06T00:52:24.537 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged4/etc/access.conf': No such file or directory 2023-07-06T00:52:24.538 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged4/etc/access.conf': No such file or directory 2023-07-06T00:52:24.538 INFO:teuthology.orchestra.run.smithi046.stdout: +umount: /tmp/tmp.KrMG67MsYpscratch/merged4: not mounted. 2023-07-06T00:52:24.538 INFO:teuthology.orchestra.run.smithi046.stdout: +mount: /tmp/tmp.KrMG67MsYpscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-07-06T00:52:24.538 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged5/etc/access.conf': No such file or directory 2023-07-06T00:52:24.538 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged5/etc/access.conf': No such file or directory 2023-07-06T00:52:24.538 INFO:teuthology.orchestra.run.smithi046.stdout: +mount: mount: /tmp/tmp.KrMG67MsYpscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error./tmp/tmp.KrMG67MsYpscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-07-06T00:52:24.538 INFO:teuthology.orchestra.run.smithi046.stdout: + 2023-07-06T00:52:24.538 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged5/etc/access.conf': No such file or directory 2023-07-06T00:52:24.539 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged5/etc/access.conf': No such file or directory 2023-07-06T00:52:24.539 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged1/etc/access.conf': No such file or directory 2023-07-06T00:52:24.539 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged1/etc/access.conf': No such file or directory 2023-07-06T00:52:24.539 INFO:teuthology.orchestra.run.smithi046.stdout: +umount: /tmp/tmp.KrMG67MsYpscratch/merged5: not mounted. 2023-07-06T00:52:24.539 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged0/etc/access.conf': No such file or directory 2023-07-06T00:52:24.539 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged1/etc/access.conf': No such file or directory 2023-07-06T00:52:24.539 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged0/etc/access.conf': No such file or directory 2023-07-06T00:52:24.539 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged1/etc/access.conf': No such file or directory 2023-07-06T00:52:24.540 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged0/etc/access.conf': No such file or directory 2023-07-06T00:52:24.540 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged0/etc/access.conf': No such file or directory 2023-07-06T00:52:24.540 INFO:teuthology.orchestra.run.smithi046.stdout: +umount: /tmp/tmp.KrMG67MsYpscratch/merged1: not mounted. 2023-07-06T00:52:24.540 INFO:teuthology.orchestra.run.smithi046.stdout: +umount: /tmp/tmp.KrMG67MsYpscratch/merged0: not mounted. 2023-07-06T00:52:24.540 INFO:teuthology.orchestra.run.smithi046.stdout: +mount: /tmp/tmp.KrMG67MsYpscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-07-06T00:52:24.540 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged2/etc/access.conf': No such file or directory 2023-07-06T00:52:24.540 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged2/etc/access.conf': No such file or directory 2023-07-06T00:52:24.541 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged2/etc/access.conf': No such file or directory 2023-07-06T00:52:24.541 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged2/etc/access.conf': No such file or directory 2023-07-06T00:52:24.541 INFO:teuthology.orchestra.run.smithi046.stdout: +umount: /tmp/tmp.KrMG67MsYpscratch/merged2: not mounted. 2023-07-06T00:52:24.541 INFO:teuthology.orchestra.run.smithi046.stdout: +mount: /tmp/tmp.KrMG67MsYpscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-07-06T00:52:24.541 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged4/etc/access.conf': No such file or directory 2023-07-06T00:52:24.541 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged4/etc/access.conf': No such file or directory 2023-07-06T00:52:24.541 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged4/etc/access.conf': No such file or directory 2023-07-06T00:52:24.541 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged4/etc/access.conf': No such file or directory 2023-07-06T00:52:24.542 INFO:teuthology.orchestra.run.smithi046.stdout: +umount: /tmp/tmp.KrMG67MsYpscratch/merged4: not mounted. 2023-07-06T00:52:24.542 INFO:teuthology.orchestra.run.smithi046.stdout: +mount: /tmp/tmp.KrMG67MsYpscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-07-06T00:52:24.542 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged3/etc/access.conf': No such file or directory 2023-07-06T00:52:24.542 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged3/etc/access.conf': No such file or directory 2023-07-06T00:52:24.542 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged3/etc/access.conf': No such file or directory 2023-07-06T00:52:24.542 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged3/etc/access.conf': No such file or directory 2023-07-06T00:52:24.542 INFO:teuthology.orchestra.run.smithi046.stdout: +umount: /tmp/tmp.KrMG67MsYpscratch/merged3: not mounted. 2023-07-06T00:52:24.542 INFO:teuthology.orchestra.run.smithi046.stdout: +mount: mount: /tmp/tmp.KrMG67MsYpscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error./tmp/tmp.KrMG67MsYpscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-07-06T00:52:24.543 INFO:teuthology.orchestra.run.smithi046.stdout: + 2023-07-06T00:52:24.543 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged5/etc/access.conf': No such file or directory 2023-07-06T00:52:24.543 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged1/etc/access.conf': No such file or directory 2023-07-06T00:52:24.543 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged5/etc/access.conf': No such file or directory 2023-07-06T00:52:24.543 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged1/etc/access.conf': No such file or directory 2023-07-06T00:52:24.543 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged5/etc/access.conf': No such file or directory 2023-07-06T00:52:24.543 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged1/etc/access.conf': No such file or directory 2023-07-06T00:52:24.543 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged1/etc/access.conf': No such file or directory 2023-07-06T00:52:24.544 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged5/etc/access.conf': No such file or directory 2023-07-06T00:52:24.544 INFO:teuthology.orchestra.run.smithi046.stdout: +umount: /tmp/tmp.KrMG67MsYpscratch/merged1: not mounted. 2023-07-06T00:52:24.544 INFO:teuthology.orchestra.run.smithi046.stdout: +mount: /tmp/tmp.KrMG67MsYpscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-07-06T00:52:24.544 INFO:teuthology.orchestra.run.smithi046.stdout: +umount: /tmp/tmp.KrMG67MsYpscratch/merged5: not mounted. 2023-07-06T00:52:24.544 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged0/etc/access.conf': No such file or directory 2023-07-06T00:52:24.544 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged0/etc/access.conf': No such file or directory 2023-07-06T00:52:24.544 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged0/etc/access.conf': No such file or directory 2023-07-06T00:52:24.544 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged0/etc/access.conf': No such file or directory 2023-07-06T00:52:24.545 INFO:teuthology.orchestra.run.smithi046.stdout: +umount: /tmp/tmp.KrMG67MsYpscratch/merged0: not mounted. 2023-07-06T00:52:24.545 INFO:teuthology.orchestra.run.smithi046.stdout: +mount: /tmp/tmp.KrMG67MsYpscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-07-06T00:52:24.545 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged2/etc/access.conf': No such file or directory 2023-07-06T00:52:24.545 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged2/etc/access.conf': No such file or directory 2023-07-06T00:52:24.545 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged2/etc/access.conf': No such file or directory 2023-07-06T00:52:24.545 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged2/etc/access.conf': No such file or directory 2023-07-06T00:52:24.545 INFO:teuthology.orchestra.run.smithi046.stdout: +umount: /tmp/tmp.KrMG67MsYpscratch/merged2: not mounted. 2023-07-06T00:52:24.545 INFO:teuthology.orchestra.run.smithi046.stdout: +mount: /tmp/tmp.KrMG67MsYpscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-07-06T00:52:24.546 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged4/etc/access.conf': No such file or directory 2023-07-06T00:52:24.546 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged4/etc/access.conf': No such file or directory 2023-07-06T00:52:24.546 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged4/etc/access.conf': No such file or directory 2023-07-06T00:52:24.546 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged4/etc/access.conf': No such file or directory 2023-07-06T00:52:24.546 INFO:teuthology.orchestra.run.smithi046.stdout: +umount: /tmp/tmp.KrMG67MsYpscratch/merged4: not mounted. 2023-07-06T00:52:24.546 INFO:teuthology.orchestra.run.smithi046.stdout: +mount: /tmp/tmp.KrMG67MsYpscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-07-06T00:52:24.546 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged3/etc/access.conf': No such file or directory 2023-07-06T00:52:24.547 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged3/etc/access.conf': No such file or directory 2023-07-06T00:52:24.547 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged3/etc/access.conf': No such file or directory 2023-07-06T00:52:24.547 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged3/etc/access.conf': No such file or directory 2023-07-06T00:52:24.547 INFO:teuthology.orchestra.run.smithi046.stdout: +umount: /tmp/tmp.KrMG67MsYpscratch/merged3: not mounted. 2023-07-06T00:52:24.547 INFO:teuthology.orchestra.run.smithi046.stdout: +mount: /tmp/tmp.KrMG67MsYpscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-07-06T00:52:24.547 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged0/etc/access.conf': No such file or directory 2023-07-06T00:52:24.547 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged0/etc/access.conf': No such file or directory 2023-07-06T00:52:24.547 INFO:teuthology.orchestra.run.smithi046.stdout: +mount: mount: /tmp/tmp.KrMG67MsYpscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error./tmp/tmp.KrMG67MsYpscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-07-06T00:52:24.548 INFO:teuthology.orchestra.run.smithi046.stdout: + 2023-07-06T00:52:24.548 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged0/etc/access.conf': No such file or directory 2023-07-06T00:52:24.548 INFO:teuthology.orchestra.run.smithi046.stdout: +mount: /tmp/tmp.KrMG67MsYpscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-07-06T00:52:24.548 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged0/etc/access.conf': No such file or directory 2023-07-06T00:52:24.548 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged2/etc/access.conf': No such file or directory 2023-07-06T00:52:24.548 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged5/etc/access.conf': No such file or directory 2023-07-06T00:52:24.548 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged2/etc/access.conf': No such file or directory 2023-07-06T00:52:24.549 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged5/etc/access.conf': No such file or directory 2023-07-06T00:52:24.549 INFO:teuthology.orchestra.run.smithi046.stdout: +umount: /tmp/tmp.KrMG67MsYpscratch/merged0: not mounted. 2023-07-06T00:52:24.549 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged2/etc/access.conf': No such file or directory 2023-07-06T00:52:24.549 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged5/etc/access.conf': No such file or directory 2023-07-06T00:52:24.549 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged2/etc/access.conf': No such file or directory 2023-07-06T00:52:24.549 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged5/etc/access.conf': No such file or directory 2023-07-06T00:52:24.549 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged1/etc/access.conf': No such file or directory 2023-07-06T00:52:24.549 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged1/etc/access.conf': No such file or directory 2023-07-06T00:52:24.550 INFO:teuthology.orchestra.run.smithi046.stdout: +umount: /tmp/tmp.KrMG67MsYpscratch/merged2: not mounted. 2023-07-06T00:52:24.550 INFO:teuthology.orchestra.run.smithi046.stdout: +umount: /tmp/tmp.KrMG67MsYpscratch/merged5: not mounted. 2023-07-06T00:52:24.550 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged1/etc/access.conf': No such file or directory 2023-07-06T00:52:24.550 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged1/etc/access.conf': No such file or directory 2023-07-06T00:52:24.550 INFO:teuthology.orchestra.run.smithi046.stdout: +umount: /tmp/tmp.KrMG67MsYpscratch/merged1: not mounted. 2023-07-06T00:52:24.550 INFO:teuthology.orchestra.run.smithi046.stdout: +mount: /tmp/tmp.KrMG67MsYpscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-07-06T00:52:24.550 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged0/etc/access.conf': No such file or directory 2023-07-06T00:52:24.550 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged0/etc/access.conf': No such file or directory 2023-07-06T00:52:24.551 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged0/etc/access.conf': No such file or directory 2023-07-06T00:52:24.551 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged0/etc/access.conf': No such file or directory 2023-07-06T00:52:24.551 INFO:teuthology.orchestra.run.smithi046.stdout: +umount: /tmp/tmp.KrMG67MsYpscratch/merged0: not mounted. 2023-07-06T00:52:24.551 INFO:teuthology.orchestra.run.smithi046.stdout: +mount: /tmp/tmp.KrMG67MsYpscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-07-06T00:52:24.551 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged2/etc/access.conf': No such file or directory 2023-07-06T00:52:24.551 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged2/etc/access.conf': No such file or directory 2023-07-06T00:52:24.551 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged2/etc/access.conf': No such file or directory 2023-07-06T00:52:24.552 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged2/etc/access.conf': No such file or directory 2023-07-06T00:52:24.552 INFO:teuthology.orchestra.run.smithi046.stdout: +umount: /tmp/tmp.KrMG67MsYpscratch/merged2: not mounted. 2023-07-06T00:52:24.552 INFO:teuthology.orchestra.run.smithi046.stdout: +mount: /tmp/tmp.KrMG67MsYpscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-07-06T00:52:24.552 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged3/etc/access.conf': No such file or directory 2023-07-06T00:52:24.552 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged3/etc/access.conf': No such file or directory 2023-07-06T00:52:24.552 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged3/etc/access.conf': No such file or directory 2023-07-06T00:52:24.552 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged3/etc/access.conf': No such file or directory 2023-07-06T00:52:24.552 INFO:teuthology.orchestra.run.smithi046.stdout: +umount: /tmp/tmp.KrMG67MsYpscratch/merged3: not mounted. 2023-07-06T00:52:24.553 INFO:teuthology.orchestra.run.smithi046.stdout: +mount: /tmp/tmp.KrMG67MsYpscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-07-06T00:52:24.553 INFO:teuthology.orchestra.run.smithi046.stdout: +mount: /tmp/tmp.KrMG67MsYpscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-07-06T00:52:24.553 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged1/etc/access.conf': No such file or directory 2023-07-06T00:52:24.553 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged1/etc/access.conf': No such file or directory 2023-07-06T00:52:24.553 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged5/etc/access.conf': No such file or directory 2023-07-06T00:52:24.553 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged1/etc/access.conf': No such file or directory 2023-07-06T00:52:24.553 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged1/etc/access.conf': No such file or directory 2023-07-06T00:52:24.553 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged5/etc/access.conf': No such file or directory 2023-07-06T00:52:24.554 INFO:teuthology.orchestra.run.smithi046.stdout: +umount: /tmp/tmp.KrMG67MsYpscratch/merged1: not mounted. 2023-07-06T00:52:24.554 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged5/etc/access.conf': No such file or directory 2023-07-06T00:52:24.554 INFO:teuthology.orchestra.run.smithi046.stdout: +mount: /tmp/tmp.KrMG67MsYpscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-07-06T00:52:24.554 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged5/etc/access.conf': No such file or directory 2023-07-06T00:52:24.554 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged4/etc/access.conf': No such file or directory 2023-07-06T00:52:24.554 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged4/etc/access.conf': No such file or directory 2023-07-06T00:52:24.554 INFO:teuthology.orchestra.run.smithi046.stdout: +umount: /tmp/tmp.KrMG67MsYpscratch/merged5: not mounted. 2023-07-06T00:52:24.554 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged4/etc/access.conf': No such file or directory 2023-07-06T00:52:24.555 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged4/etc/access.conf': No such file or directory 2023-07-06T00:52:24.555 INFO:teuthology.orchestra.run.smithi046.stdout: +umount: /tmp/tmp.KrMG67MsYpscratch/merged4: not mounted. 2023-07-06T00:52:24.555 INFO:teuthology.orchestra.run.smithi046.stdout: +mount: /tmp/tmp.KrMG67MsYpscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-07-06T00:52:24.555 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged0/etc/access.conf': No such file or directory 2023-07-06T00:52:24.555 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged0/etc/access.conf': No such file or directory 2023-07-06T00:52:24.555 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged0/etc/access.conf': No such file or directory 2023-07-06T00:52:24.555 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged0/etc/access.conf': No such file or directory 2023-07-06T00:52:24.556 INFO:teuthology.orchestra.run.smithi046.stdout: +umount: /tmp/tmp.KrMG67MsYpscratch/merged0: not mounted. 2023-07-06T00:52:24.556 INFO:teuthology.orchestra.run.smithi046.stdout: +mount: /tmp/tmp.KrMG67MsYpscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-07-06T00:52:24.556 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged2/etc/access.conf': No such file or directory 2023-07-06T00:52:24.556 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged2/etc/access.conf': No such file or directory 2023-07-06T00:52:24.556 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged2/etc/access.conf': No such file or directory 2023-07-06T00:52:24.556 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged2/etc/access.conf': No such file or directory 2023-07-06T00:52:24.556 INFO:teuthology.orchestra.run.smithi046.stdout: +umount: /tmp/tmp.KrMG67MsYpscratch/merged2: not mounted. 2023-07-06T00:52:24.556 INFO:teuthology.orchestra.run.smithi046.stdout: +mount: /tmp/tmp.KrMG67MsYpscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-07-06T00:52:24.557 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged5/etc/access.conf': No such file or directory 2023-07-06T00:52:24.557 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged5/etc/access.conf': No such file or directory 2023-07-06T00:52:24.557 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged5/etc/access.conf': No such file or directory 2023-07-06T00:52:24.557 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged5/etc/access.conf': No such file or directory 2023-07-06T00:52:24.557 INFO:teuthology.orchestra.run.smithi046.stdout: +umount: /tmp/tmp.KrMG67MsYpscratch/merged5: not mounted. 2023-07-06T00:52:24.557 INFO:teuthology.orchestra.run.smithi046.stdout: +mount: /tmp/tmp.KrMG67MsYpscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-07-06T00:52:24.557 INFO:teuthology.orchestra.run.smithi046.stdout: +mount: /tmp/tmp.KrMG67MsYpscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-07-06T00:52:24.558 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged3/etc/access.conf': No such file or directory 2023-07-06T00:52:24.558 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged3/etc/access.conf': No such file or directory 2023-07-06T00:52:24.558 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged3/etc/access.conf': No such file or directory 2023-07-06T00:52:24.558 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged3/etc/access.conf': No such file or directory 2023-07-06T00:52:24.558 INFO:teuthology.orchestra.run.smithi046.stdout: +umount: /tmp/tmp.KrMG67MsYpscratch/merged3: not mounted. 2023-07-06T00:52:24.558 INFO:teuthology.orchestra.run.smithi046.stdout: +mount: /tmp/tmp.KrMG67MsYpscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-07-06T00:52:24.558 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged1/etc/access.conf': No such file or directory 2023-07-06T00:52:24.558 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged1/etc/access.conf': No such file or directory 2023-07-06T00:52:24.559 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged4/etc/access.conf': No such file or directory 2023-07-06T00:52:24.559 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged4/etc/access.conf': No such file or directory 2023-07-06T00:52:24.559 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged1/etc/access.conf': No such file or directory 2023-07-06T00:52:24.559 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged1/etc/access.conf': No such file or directory 2023-07-06T00:52:24.559 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged4/etc/access.conf': No such file or directory 2023-07-06T00:52:24.559 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged4/etc/access.conf': No such file or directory 2023-07-06T00:52:24.559 INFO:teuthology.orchestra.run.smithi046.stdout: +umount: /tmp/tmp.KrMG67MsYpscratch/merged1: not mounted. 2023-07-06T00:52:24.559 INFO:teuthology.orchestra.run.smithi046.stdout: +umount: /tmp/tmp.KrMG67MsYpscratch/merged4: not mounted. 2023-07-06T00:52:24.560 INFO:teuthology.orchestra.run.smithi046.stdout: +mount: /tmp/tmp.KrMG67MsYpscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-07-06T00:52:24.560 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged0/etc/access.conf': No such file or directory 2023-07-06T00:52:24.560 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged0/etc/access.conf': No such file or directory 2023-07-06T00:52:24.560 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged0/etc/access.conf': No such file or directory 2023-07-06T00:52:24.560 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged0/etc/access.conf': No such file or directory 2023-07-06T00:52:24.560 INFO:teuthology.orchestra.run.smithi046.stdout: +umount: /tmp/tmp.KrMG67MsYpscratch/merged0: not mounted. 2023-07-06T00:52:24.560 INFO:teuthology.orchestra.run.smithi046.stdout: +mount: /tmp/tmp.KrMG67MsYpscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-07-06T00:52:24.560 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged2/etc/access.conf': No such file or directory 2023-07-06T00:52:24.561 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged2/etc/access.conf': No such file or directory 2023-07-06T00:52:24.561 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged2/etc/access.conf': No such file or directory 2023-07-06T00:52:24.561 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged2/etc/access.conf': No such file or directory 2023-07-06T00:52:24.561 INFO:teuthology.orchestra.run.smithi046.stdout: +umount: /tmp/tmp.KrMG67MsYpscratch/merged2: not mounted. 2023-07-06T00:52:24.561 INFO:teuthology.orchestra.run.smithi046.stdout: +mount: /tmp/tmp.KrMG67MsYpscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-07-06T00:52:24.561 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged5/etc/access.conf': No such file or directory 2023-07-06T00:52:24.561 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged5/etc/access.conf': No such file or directory 2023-07-06T00:52:24.561 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged5/etc/access.conf': No such file or directory 2023-07-06T00:52:24.562 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged5/etc/access.conf': No such file or directory 2023-07-06T00:52:24.562 INFO:teuthology.orchestra.run.smithi046.stdout: +umount: /tmp/tmp.KrMG67MsYpscratch/merged5: not mounted. 2023-07-06T00:52:24.562 INFO:teuthology.orchestra.run.smithi046.stdout: +mount: /tmp/tmp.KrMG67MsYpscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-07-06T00:52:24.562 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged3/etc/access.conf': No such file or directory 2023-07-06T00:52:24.562 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged3/etc/access.conf': No such file or directory 2023-07-06T00:52:24.562 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged3/etc/access.conf': No such file or directory 2023-07-06T00:52:24.562 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged3/etc/access.conf': No such file or directory 2023-07-06T00:52:24.563 INFO:teuthology.orchestra.run.smithi046.stdout: +umount: /tmp/tmp.KrMG67MsYpscratch/merged3: not mounted. 2023-07-06T00:52:24.563 INFO:teuthology.orchestra.run.smithi046.stdout: +mount: /tmp/tmp.KrMG67MsYpscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-07-06T00:52:24.563 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged1/etc/access.conf': No such file or directory 2023-07-06T00:52:24.563 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged1/etc/access.conf': No such file or directory 2023-07-06T00:52:24.563 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged1/etc/access.conf': No such file or directory 2023-07-06T00:52:24.563 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged1/etc/access.conf': No such file or directory 2023-07-06T00:52:24.563 INFO:teuthology.orchestra.run.smithi046.stdout: +mount: /tmp/tmp.KrMG67MsYpscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-07-06T00:52:24.563 INFO:teuthology.orchestra.run.smithi046.stdout: +umount: /tmp/tmp.KrMG67MsYpscratch/merged1: not mounted. 2023-07-06T00:52:24.564 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged4/etc/access.conf': No such file or directory 2023-07-06T00:52:24.564 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged4/etc/access.conf': No such file or directory 2023-07-06T00:52:24.564 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged4/etc/access.conf': No such file or directory 2023-07-06T00:52:24.564 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged4/etc/access.conf': No such file or directory 2023-07-06T00:52:24.564 INFO:teuthology.orchestra.run.smithi046.stdout: +mount: /tmp/tmp.KrMG67MsYpscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-07-06T00:52:24.564 INFO:teuthology.orchestra.run.smithi046.stdout: +umount: /tmp/tmp.KrMG67MsYpscratch/merged4: not mounted. 2023-07-06T00:52:24.564 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged0/etc/access.conf': No such file or directory 2023-07-06T00:52:24.564 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged0/etc/access.conf': No such file or directory 2023-07-06T00:52:24.565 INFO:teuthology.orchestra.run.smithi046.stdout: +mount: /tmp/tmp.KrMG67MsYpscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-07-06T00:52:24.565 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged0/etc/access.conf': No such file or directory 2023-07-06T00:52:24.565 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged0/etc/access.conf': No such file or directory 2023-07-06T00:52:24.565 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged2/etc/access.conf': No such file or directory 2023-07-06T00:52:24.565 INFO:teuthology.orchestra.run.smithi046.stdout: +umount: /tmp/tmp.KrMG67MsYpscratch/merged0: not mounted. 2023-07-06T00:52:24.565 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged2/etc/access.conf': No such file or directory 2023-07-06T00:52:24.565 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged2/etc/access.conf': No such file or directory 2023-07-06T00:52:24.565 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged2/etc/access.conf': No such file or directory 2023-07-06T00:52:24.566 INFO:teuthology.orchestra.run.smithi046.stdout: +umount: /tmp/tmp.KrMG67MsYpscratch/merged2: not mounted. 2023-07-06T00:52:24.566 INFO:teuthology.orchestra.run.smithi046.stdout: +mount: /tmp/tmp.KrMG67MsYpscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-07-06T00:52:24.566 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged5/etc/access.conf': No such file or directory 2023-07-06T00:52:24.566 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged5/etc/access.conf': No such file or directory 2023-07-06T00:52:24.566 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged5/etc/access.conf': No such file or directory 2023-07-06T00:52:24.566 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged5/etc/access.conf': No such file or directory 2023-07-06T00:52:24.566 INFO:teuthology.orchestra.run.smithi046.stdout: +umount: /tmp/tmp.KrMG67MsYpscratch/merged5: not mounted. 2023-07-06T00:52:24.567 INFO:teuthology.orchestra.run.smithi046.stdout: +mount: /tmp/tmp.KrMG67MsYpscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-07-06T00:52:24.567 INFO:teuthology.orchestra.run.smithi046.stdout: +mount: mount: /tmp/tmp.KrMG67MsYpscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error./tmp/tmp.KrMG67MsYpscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-07-06T00:52:24.567 INFO:teuthology.orchestra.run.smithi046.stdout: + 2023-07-06T00:52:24.567 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged1/etc/access.conf': No such file or directory 2023-07-06T00:52:24.567 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged3/etc/access.conf': No such file or directory 2023-07-06T00:52:24.567 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged3/etc/access.conf': No such file or directory 2023-07-06T00:52:24.567 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged1/etc/access.conf': No such file or directory 2023-07-06T00:52:24.567 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged3/etc/access.conf': No such file or directory 2023-07-06T00:52:24.568 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged1/etc/access.conf': No such file or directory 2023-07-06T00:52:24.568 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged4/etc/access.conf': No such file or directory 2023-07-06T00:52:24.568 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged4/etc/access.conf': No such file or directory 2023-07-06T00:52:24.568 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged4/etc/access.conf': No such file or directory 2023-07-06T00:52:24.568 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged4/etc/access.conf': No such file or directory 2023-07-06T00:52:24.568 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged1/etc/access.conf': No such file or directory 2023-07-06T00:52:24.568 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged3/etc/access.conf': No such file or directory 2023-07-06T00:52:24.568 INFO:teuthology.orchestra.run.smithi046.stdout: +mount: /tmp/tmp.KrMG67MsYpscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-07-06T00:52:24.569 INFO:teuthology.orchestra.run.smithi046.stdout: +mount: /tmp/tmp.KrMG67MsYpscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-07-06T00:52:24.569 INFO:teuthology.orchestra.run.smithi046.stdout: +umount: umount: /tmp/tmp.KrMG67MsYpscratch/merged1: not mounted./tmp/tmp.KrMG67MsYpscratch/merged3: not mounted. 2023-07-06T00:52:24.569 INFO:teuthology.orchestra.run.smithi046.stdout: + 2023-07-06T00:52:24.569 INFO:teuthology.orchestra.run.smithi046.stdout: +umount: /tmp/tmp.KrMG67MsYpscratch/merged4: not mounted. 2023-07-06T00:52:24.569 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged2/etc/access.conf': No such file or directory 2023-07-06T00:52:24.569 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged2/etc/access.conf': No such file or directory 2023-07-06T00:52:24.569 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged0/etc/access.conf': No such file or directory 2023-07-06T00:52:24.569 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged2/etc/access.conf': No such file or directory 2023-07-06T00:52:24.570 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged0/etc/access.conf': No such file or directory 2023-07-06T00:52:24.570 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged0/etc/access.conf': No such file or directory 2023-07-06T00:52:24.570 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged0/etc/access.conf': No such file or directory 2023-07-06T00:52:24.570 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged2/etc/access.conf': No such file or directory 2023-07-06T00:52:24.570 INFO:teuthology.orchestra.run.smithi046.stdout: +umount: /tmp/tmp.KrMG67MsYpscratch/merged0: not mounted. 2023-07-06T00:52:24.570 INFO:teuthology.orchestra.run.smithi046.stdout: +umount: /tmp/tmp.KrMG67MsYpscratch/merged2: not mounted. 2023-07-06T00:52:24.570 INFO:teuthology.orchestra.run.smithi046.stdout: +mount: /tmp/tmp.KrMG67MsYpscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-07-06T00:52:24.570 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged5/etc/access.conf': No such file or directory 2023-07-06T00:52:24.571 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged5/etc/access.conf': No such file or directory 2023-07-06T00:52:24.571 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged5/etc/access.conf': No such file or directory 2023-07-06T00:52:24.571 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged5/etc/access.conf': No such file or directory 2023-07-06T00:52:24.571 INFO:teuthology.orchestra.run.smithi046.stdout: +umount: /tmp/tmp.KrMG67MsYpscratch/merged5: not mounted. 2023-07-06T00:52:24.571 INFO:teuthology.orchestra.run.smithi046.stdout: +mount: /tmp/tmp.KrMG67MsYpscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-07-06T00:52:24.571 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged4/etc/access.conf': No such file or directory 2023-07-06T00:52:24.571 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged4/etc/access.conf': No such file or directory 2023-07-06T00:52:24.571 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged4/etc/access.conf': No such file or directory 2023-07-06T00:52:24.572 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged4/etc/access.conf': No such file or directory 2023-07-06T00:52:24.572 INFO:teuthology.orchestra.run.smithi046.stdout: +umount: /tmp/tmp.KrMG67MsYpscratch/merged4: not mounted. 2023-07-06T00:52:24.572 INFO:teuthology.orchestra.run.smithi046.stdout: +mount: /tmp/tmp.KrMG67MsYpscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-07-06T00:52:24.572 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged0/etc/access.conf': No such file or directory 2023-07-06T00:52:24.572 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged0/etc/access.conf': No such file or directory 2023-07-06T00:52:24.572 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged0/etc/access.conf': No such file or directory 2023-07-06T00:52:24.572 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged0/etc/access.conf': No such file or directory 2023-07-06T00:52:24.572 INFO:teuthology.orchestra.run.smithi046.stdout: +umount: /tmp/tmp.KrMG67MsYpscratch/merged0: not mounted. 2023-07-06T00:52:24.573 INFO:teuthology.orchestra.run.smithi046.stdout: +mount: /tmp/tmp.KrMG67MsYpscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-07-06T00:52:24.573 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged2/etc/access.conf': No such file or directory 2023-07-06T00:52:24.573 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged2/etc/access.conf': No such file or directory 2023-07-06T00:52:24.573 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged2/etc/access.conf': No such file or directory 2023-07-06T00:52:24.573 INFO:teuthology.orchestra.run.smithi046.stdout: +mount: /tmp/tmp.KrMG67MsYpscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-07-06T00:52:24.573 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged2/etc/access.conf': No such file or directory 2023-07-06T00:52:24.573 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged1/etc/access.conf': No such file or directory 2023-07-06T00:52:24.574 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged1/etc/access.conf': No such file or directory 2023-07-06T00:52:24.574 INFO:teuthology.orchestra.run.smithi046.stdout: +umount: /tmp/tmp.KrMG67MsYpscratch/merged2: not mounted. 2023-07-06T00:52:24.574 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged1/etc/access.conf': No such file or directory 2023-07-06T00:52:24.574 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged1/etc/access.conf': No such file or directory 2023-07-06T00:52:24.574 INFO:teuthology.orchestra.run.smithi046.stdout: +umount: /tmp/tmp.KrMG67MsYpscratch/merged1: not mounted. 2023-07-06T00:52:24.574 INFO:teuthology.orchestra.run.smithi046.stdout: +mount: /tmp/tmp.KrMG67MsYpscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-07-06T00:52:24.574 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged5/etc/access.conf': No such file or directory 2023-07-06T00:52:24.574 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged5/etc/access.conf': No such file or directory 2023-07-06T00:52:24.574 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged5/etc/access.conf': No such file or directory 2023-07-06T00:52:24.575 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged5/etc/access.conf': No such file or directory 2023-07-06T00:52:24.575 INFO:teuthology.orchestra.run.smithi046.stdout: +umount: /tmp/tmp.KrMG67MsYpscratch/merged5: not mounted. 2023-07-06T00:52:24.575 INFO:teuthology.orchestra.run.smithi046.stdout: +mount: /tmp/tmp.KrMG67MsYpscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-07-06T00:52:24.575 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged3/etc/access.conf': No such file or directory 2023-07-06T00:52:24.575 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged3/etc/access.conf': No such file or directory 2023-07-06T00:52:24.575 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged3/etc/access.conf': No such file or directory 2023-07-06T00:52:24.575 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged3/etc/access.conf': No such file or directory 2023-07-06T00:52:24.576 INFO:teuthology.orchestra.run.smithi046.stdout: +umount: /tmp/tmp.KrMG67MsYpscratch/merged3: not mounted. 2023-07-06T00:52:24.576 INFO:teuthology.orchestra.run.smithi046.stdout: +mount: /tmp/tmp.KrMG67MsYpscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-07-06T00:52:24.576 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged4/etc/access.conf': No such file or directory 2023-07-06T00:52:24.576 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged4/etc/access.conf': No such file or directory 2023-07-06T00:52:24.576 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged4/etc/access.conf': No such file or directory 2023-07-06T00:52:24.576 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged4/etc/access.conf': No such file or directory 2023-07-06T00:52:24.576 INFO:teuthology.orchestra.run.smithi046.stdout: +umount: /tmp/tmp.KrMG67MsYpscratch/merged4: not mounted. 2023-07-06T00:52:24.576 INFO:teuthology.orchestra.run.smithi046.stdout: +mount: /tmp/tmp.KrMG67MsYpscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-07-06T00:52:24.577 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged0/etc/access.conf': No such file or directory 2023-07-06T00:52:24.577 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged0/etc/access.conf': No such file or directory 2023-07-06T00:52:24.577 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged0/etc/access.conf': No such file or directory 2023-07-06T00:52:24.577 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged0/etc/access.conf': No such file or directory 2023-07-06T00:52:24.577 INFO:teuthology.orchestra.run.smithi046.stdout: +umount: /tmp/tmp.KrMG67MsYpscratch/merged0: not mounted. 2023-07-06T00:52:24.577 INFO:teuthology.orchestra.run.smithi046.stdout: +mount: /tmp/tmp.KrMG67MsYpscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-07-06T00:52:24.577 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged5/etc/access.conf': No such file or directory 2023-07-06T00:52:24.577 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged5/etc/access.conf': No such file or directory 2023-07-06T00:52:24.578 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged5/etc/access.conf': No such file or directory 2023-07-06T00:52:24.578 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged5/etc/access.conf': No such file or directory 2023-07-06T00:52:24.578 INFO:teuthology.orchestra.run.smithi046.stdout: +mount: /tmp/tmp.KrMG67MsYpscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-07-06T00:52:24.578 INFO:teuthology.orchestra.run.smithi046.stdout: +mount: /tmp/tmp.KrMG67MsYpscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-07-06T00:52:24.578 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged3/etc/access.conf': No such file or directory 2023-07-06T00:52:24.578 INFO:teuthology.orchestra.run.smithi046.stdout: +umount: /tmp/tmp.KrMG67MsYpscratch/merged5: not mounted. 2023-07-06T00:52:24.578 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged3/etc/access.conf': No such file or directory 2023-07-06T00:52:24.578 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged3/etc/access.conf': No such file or directory 2023-07-06T00:52:24.579 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged3/etc/access.conf': No such file or directory 2023-07-06T00:52:24.579 INFO:teuthology.orchestra.run.smithi046.stdout: +umount: /tmp/tmp.KrMG67MsYpscratch/merged3: not mounted. 2023-07-06T00:52:24.579 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged2/etc/access.conf': No such file or directory 2023-07-06T00:52:24.579 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged2/etc/access.conf': No such file or directory 2023-07-06T00:52:24.579 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged2/etc/access.conf': No such file or directory 2023-07-06T00:52:24.579 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged2/etc/access.conf': No such file or directory 2023-07-06T00:52:24.579 INFO:teuthology.orchestra.run.smithi046.stdout: +umount: /tmp/tmp.KrMG67MsYpscratch/merged2: not mounted. 2023-07-06T00:52:24.580 INFO:teuthology.orchestra.run.smithi046.stdout: +mount: /tmp/tmp.KrMG67MsYpscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-07-06T00:52:24.580 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged1/etc/access.conf': No such file or directory 2023-07-06T00:52:24.580 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged1/etc/access.conf': No such file or directory 2023-07-06T00:52:24.580 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged1/etc/access.conf': No such file or directory 2023-07-06T00:52:24.580 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged1/etc/access.conf': No such file or directory 2023-07-06T00:52:24.580 INFO:teuthology.orchestra.run.smithi046.stdout: +umount: /tmp/tmp.KrMG67MsYpscratch/merged1: not mounted. 2023-07-06T00:52:24.580 INFO:teuthology.orchestra.run.smithi046.stdout: +mount: /tmp/tmp.KrMG67MsYpscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-07-06T00:52:24.580 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged0/etc/access.conf': No such file or directory 2023-07-06T00:52:24.581 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged0/etc/access.conf': No such file or directory 2023-07-06T00:52:24.581 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged0/etc/access.conf': No such file or directory 2023-07-06T00:52:24.581 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged0/etc/access.conf': No such file or directory 2023-07-06T00:52:24.581 INFO:teuthology.orchestra.run.smithi046.stdout: +mount: /tmp/tmp.KrMG67MsYpscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-07-06T00:52:24.581 INFO:teuthology.orchestra.run.smithi046.stdout: +umount: /tmp/tmp.KrMG67MsYpscratch/merged0: not mounted. 2023-07-06T00:52:24.581 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged4/etc/access.conf': No such file or directory 2023-07-06T00:52:24.581 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged4/etc/access.conf': No such file or directory 2023-07-06T00:52:24.581 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged4/etc/access.conf': No such file or directory 2023-07-06T00:52:24.582 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged4/etc/access.conf': No such file or directory 2023-07-06T00:52:24.582 INFO:teuthology.orchestra.run.smithi046.stdout: +umount: /tmp/tmp.KrMG67MsYpscratch/merged4: not mounted. 2023-07-06T00:52:24.582 INFO:teuthology.orchestra.run.smithi046.stdout: +mount: /tmp/tmp.KrMG67MsYpscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-07-06T00:52:24.582 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged5/etc/access.conf': No such file or directory 2023-07-06T00:52:24.582 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged5/etc/access.conf': No such file or directory 2023-07-06T00:52:24.582 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged5/etc/access.conf': No such file or directory 2023-07-06T00:52:24.582 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged5/etc/access.conf': No such file or directory 2023-07-06T00:52:24.582 INFO:teuthology.orchestra.run.smithi046.stdout: +umount: /tmp/tmp.KrMG67MsYpscratch/merged5: not mounted. 2023-07-06T00:52:24.583 INFO:teuthology.orchestra.run.smithi046.stdout: +mount: /tmp/tmp.KrMG67MsYpscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-07-06T00:52:24.583 INFO:teuthology.orchestra.run.smithi046.stdout: +mount: mount: /tmp/tmp.KrMG67MsYpscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error./tmp/tmp.KrMG67MsYpscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-07-06T00:52:24.583 INFO:teuthology.orchestra.run.smithi046.stdout: + 2023-07-06T00:52:24.583 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged1/etc/access.conf': No such file or directory 2023-07-06T00:52:24.583 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged2/etc/access.conf': No such file or directory 2023-07-06T00:52:24.583 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged3/etc/access.conf': No such file or directory 2023-07-06T00:52:24.583 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged1/etc/access.conf': No such file or directory 2023-07-06T00:52:24.584 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged2/etc/access.conf': No such file or directory 2023-07-06T00:52:24.584 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged3/etc/access.conf': No such file or directory 2023-07-06T00:52:24.584 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged1/etc/access.conf': No such file or directory 2023-07-06T00:52:24.584 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged2/etc/access.conf': No such file or directory 2023-07-06T00:52:24.584 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged3/etc/access.conf': No such file or directory 2023-07-06T00:52:24.584 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged1/etc/access.conf': No such file or directory 2023-07-06T00:52:24.584 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged2/etc/access.conf': No such file or directory 2023-07-06T00:52:24.584 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged3/etc/access.conf': No such file or directory 2023-07-06T00:52:24.585 INFO:teuthology.orchestra.run.smithi046.stdout: +umount: /tmp/tmp.KrMG67MsYpscratch/merged1: not mounted. 2023-07-06T00:52:24.585 INFO:teuthology.orchestra.run.smithi046.stdout: +umount: /tmp/tmp.KrMG67MsYpscratch/merged2: not mounted. 2023-07-06T00:52:24.585 INFO:teuthology.orchestra.run.smithi046.stdout: +umount: /tmp/tmp.KrMG67MsYpscratch/merged3: not mounted. 2023-07-06T00:52:24.585 INFO:teuthology.orchestra.run.smithi046.stdout: +mount: /tmp/tmp.KrMG67MsYpscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-07-06T00:52:24.585 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged0/etc/access.conf': No such file or directory 2023-07-06T00:52:24.585 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged0/etc/access.conf': No such file or directory 2023-07-06T00:52:24.585 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged0/etc/access.conf': No such file or directory 2023-07-06T00:52:24.585 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged0/etc/access.conf': No such file or directory 2023-07-06T00:52:24.586 INFO:teuthology.orchestra.run.smithi046.stdout: +mount: /tmp/tmp.KrMG67MsYpscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-07-06T00:52:24.586 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged4/etc/access.conf': No such file or directory 2023-07-06T00:52:24.586 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged4/etc/access.conf': No such file or directory 2023-07-06T00:52:24.586 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged4/etc/access.conf': No such file or directory 2023-07-06T00:52:24.586 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged4/etc/access.conf': No such file or directory 2023-07-06T00:52:24.586 INFO:teuthology.orchestra.run.smithi046.stdout: +umount: /tmp/tmp.KrMG67MsYpscratch/merged4: not mounted. 2023-07-06T00:52:24.586 INFO:teuthology.orchestra.run.smithi046.stdout: +umount: /tmp/tmp.KrMG67MsYpscratch/merged0: not mounted. 2023-07-06T00:52:24.586 INFO:teuthology.orchestra.run.smithi046.stdout: +mount: /tmp/tmp.KrMG67MsYpscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-07-06T00:52:24.587 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged3/etc/access.conf': No such file or directory 2023-07-06T00:52:24.587 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged3/etc/access.conf': No such file or directory 2023-07-06T00:52:24.587 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged3/etc/access.conf': No such file or directory 2023-07-06T00:52:24.587 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged3/etc/access.conf': No such file or directory 2023-07-06T00:52:24.587 INFO:teuthology.orchestra.run.smithi046.stdout: +umount: /tmp/tmp.KrMG67MsYpscratch/merged3: not mounted. 2023-07-06T00:52:24.587 INFO:teuthology.orchestra.run.smithi046.stdout: +mount: mount: mount: /tmp/tmp.KrMG67MsYpscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error./tmp/tmp.KrMG67MsYpscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error./tmp/tmp.KrMG67MsYpscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-07-06T00:52:24.587 INFO:teuthology.orchestra.run.smithi046.stdout: + 2023-07-06T00:52:24.588 INFO:teuthology.orchestra.run.smithi046.stdout: + 2023-07-06T00:52:24.588 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged1/etc/access.conf': No such file or directory 2023-07-06T00:52:24.588 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged2/etc/access.conf': No such file or directory 2023-07-06T00:52:24.588 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged5/etc/access.conf': No such file or directory 2023-07-06T00:52:24.588 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged1/etc/access.conf': No such file or directory 2023-07-06T00:52:24.588 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged2/etc/access.conf': No such file or directory 2023-07-06T00:52:24.588 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged5/etc/access.conf': No such file or directory 2023-07-06T00:52:24.588 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged2/etc/access.conf': No such file or directory 2023-07-06T00:52:24.589 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged5/etc/access.conf': No such file or directory 2023-07-06T00:52:24.589 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged1/etc/access.conf': No such file or directory 2023-07-06T00:52:24.589 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged2/etc/access.conf': No such file or directory 2023-07-06T00:52:24.589 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged5/etc/access.conf': No such file or directory 2023-07-06T00:52:24.589 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged1/etc/access.conf': No such file or directory 2023-07-06T00:52:24.589 INFO:teuthology.orchestra.run.smithi046.stdout: +umount: /tmp/tmp.KrMG67MsYpscratch/merged2: not mounted. 2023-07-06T00:52:24.589 INFO:teuthology.orchestra.run.smithi046.stdout: +umount: /tmp/tmp.KrMG67MsYpscratch/merged5: not mounted. 2023-07-06T00:52:24.589 INFO:teuthology.orchestra.run.smithi046.stdout: +umount: /tmp/tmp.KrMG67MsYpscratch/merged1: not mounted. 2023-07-06T00:52:24.590 INFO:teuthology.orchestra.run.smithi046.stdout: +mount: /tmp/tmp.KrMG67MsYpscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-07-06T00:52:24.590 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged4/etc/access.conf': No such file or directory 2023-07-06T00:52:24.590 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged4/etc/access.conf': No such file or directory 2023-07-06T00:52:24.590 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged4/etc/access.conf': No such file or directory 2023-07-06T00:52:24.590 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged4/etc/access.conf': No such file or directory 2023-07-06T00:52:24.590 INFO:teuthology.orchestra.run.smithi046.stdout: +umount: /tmp/tmp.KrMG67MsYpscratch/merged4: not mounted. 2023-07-06T00:52:24.590 INFO:teuthology.orchestra.run.smithi046.stdout: +mount: /tmp/tmp.KrMG67MsYpscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-07-06T00:52:24.590 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged0/etc/access.conf': No such file or directory 2023-07-06T00:52:24.591 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged0/etc/access.conf': No such file or directory 2023-07-06T00:52:24.591 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged0/etc/access.conf': No such file or directory 2023-07-06T00:52:24.591 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged0/etc/access.conf': No such file or directory 2023-07-06T00:52:24.591 INFO:teuthology.orchestra.run.smithi046.stdout: +umount: /tmp/tmp.KrMG67MsYpscratch/merged0: not mounted. 2023-07-06T00:52:24.591 INFO:teuthology.orchestra.run.smithi046.stdout: +mount: /tmp/tmp.KrMG67MsYpscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-07-06T00:52:24.591 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged3/etc/access.conf': No such file or directory 2023-07-06T00:52:24.591 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged3/etc/access.conf': No such file or directory 2023-07-06T00:52:24.592 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged3/etc/access.conf': No such file or directory 2023-07-06T00:52:24.592 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged3/etc/access.conf': No such file or directory 2023-07-06T00:52:24.592 INFO:teuthology.orchestra.run.smithi046.stdout: +mount: /tmp/tmp.KrMG67MsYpscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-07-06T00:52:24.592 INFO:teuthology.orchestra.run.smithi046.stdout: +umount: /tmp/tmp.KrMG67MsYpscratch/merged3: not mounted. 2023-07-06T00:52:24.592 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged2/etc/access.conf': No such file or directory 2023-07-06T00:52:24.592 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged2/etc/access.conf': No such file or directory 2023-07-06T00:52:24.592 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged2/etc/access.conf': No such file or directory 2023-07-06T00:52:24.592 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged2/etc/access.conf': No such file or directory 2023-07-06T00:52:24.593 INFO:teuthology.orchestra.run.smithi046.stdout: +umount: /tmp/tmp.KrMG67MsYpscratch/merged2: not mounted. 2023-07-06T00:52:24.593 INFO:teuthology.orchestra.run.smithi046.stdout: +mount: /tmp/tmp.KrMG67MsYpscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-07-06T00:52:24.593 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged5/etc/access.conf': No such file or directory 2023-07-06T00:52:24.593 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged5/etc/access.conf': No such file or directory 2023-07-06T00:52:24.593 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged5/etc/access.conf': No such file or directory 2023-07-06T00:52:24.593 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged5/etc/access.conf': No such file or directory 2023-07-06T00:52:24.593 INFO:teuthology.orchestra.run.smithi046.stdout: +umount: /tmp/tmp.KrMG67MsYpscratch/merged5: not mounted. 2023-07-06T00:52:24.593 INFO:teuthology.orchestra.run.smithi046.stdout: +mount: /tmp/tmp.KrMG67MsYpscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-07-06T00:52:24.594 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged1/etc/access.conf': No such file or directory 2023-07-06T00:52:24.594 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged1/etc/access.conf': No such file or directory 2023-07-06T00:52:24.594 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged1/etc/access.conf': No such file or directory 2023-07-06T00:52:24.594 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged1/etc/access.conf': No such file or directory 2023-07-06T00:52:24.594 INFO:teuthology.orchestra.run.smithi046.stdout: +umount: /tmp/tmp.KrMG67MsYpscratch/merged1: not mounted. 2023-07-06T00:52:24.594 INFO:teuthology.orchestra.run.smithi046.stdout: +mount: /tmp/tmp.KrMG67MsYpscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-07-06T00:52:24.594 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged4/etc/access.conf': No such file or directory 2023-07-06T00:52:24.595 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged4/etc/access.conf': No such file or directory 2023-07-06T00:52:24.595 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged4/etc/access.conf': No such file or directory 2023-07-06T00:52:24.595 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged4/etc/access.conf': No such file or directory 2023-07-06T00:52:24.595 INFO:teuthology.orchestra.run.smithi046.stdout: +mount: /tmp/tmp.KrMG67MsYpscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-07-06T00:52:24.595 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged0/etc/access.conf': No such file or directory 2023-07-06T00:52:24.595 INFO:teuthology.orchestra.run.smithi046.stdout: +umount: /tmp/tmp.KrMG67MsYpscratch/merged4: not mounted. 2023-07-06T00:52:24.595 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged0/etc/access.conf': No such file or directory 2023-07-06T00:52:24.595 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged0/etc/access.conf': No such file or directory 2023-07-06T00:52:24.596 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged0/etc/access.conf': No such file or directory 2023-07-06T00:52:24.596 INFO:teuthology.orchestra.run.smithi046.stdout: +umount: /tmp/tmp.KrMG67MsYpscratch/merged0: not mounted. 2023-07-06T00:52:24.596 INFO:teuthology.orchestra.run.smithi046.stdout: +mount: /tmp/tmp.KrMG67MsYpscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-07-06T00:52:24.596 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged5/etc/access.conf': No such file or directory 2023-07-06T00:52:24.596 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged5/etc/access.conf': No such file or directory 2023-07-06T00:52:24.596 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged5/etc/access.conf': No such file or directory 2023-07-06T00:52:24.596 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged5/etc/access.conf': No such file or directory 2023-07-06T00:52:24.596 INFO:teuthology.orchestra.run.smithi046.stdout: +umount: /tmp/tmp.KrMG67MsYpscratch/merged5: not mounted. 2023-07-06T00:52:24.597 INFO:teuthology.orchestra.run.smithi046.stdout: +mount: /tmp/tmp.KrMG67MsYpscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-07-06T00:52:24.597 INFO:teuthology.orchestra.run.smithi046.stdout: +mount: /tmp/tmp.KrMG67MsYpscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-07-06T00:52:24.597 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged2/etc/access.conf': No such file or directory 2023-07-06T00:52:24.597 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged2/etc/access.conf': No such file or directory 2023-07-06T00:52:24.597 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged2/etc/access.conf': No such file or directory 2023-07-06T00:52:24.597 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged2/etc/access.conf': No such file or directory 2023-07-06T00:52:24.597 INFO:teuthology.orchestra.run.smithi046.stdout: +mount: /tmp/tmp.KrMG67MsYpscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-07-06T00:52:24.598 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged1/etc/access.conf': No such file or directory 2023-07-06T00:52:24.598 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged3/etc/access.conf': No such file or directory 2023-07-06T00:52:24.598 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged1/etc/access.conf': No such file or directory 2023-07-06T00:52:24.598 INFO:teuthology.orchestra.run.smithi046.stdout: +umount: /tmp/tmp.KrMG67MsYpscratch/merged2: not mounted. 2023-07-06T00:52:24.598 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged1/etc/access.conf': No such file or directory 2023-07-06T00:52:24.598 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged1/etc/access.conf': No such file or directory 2023-07-06T00:52:24.598 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged3/etc/access.conf': No such file or directory 2023-07-06T00:52:24.598 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged3/etc/access.conf': No such file or directory 2023-07-06T00:52:24.599 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged3/etc/access.conf': No such file or directory 2023-07-06T00:52:24.599 INFO:teuthology.orchestra.run.smithi046.stdout: +umount: /tmp/tmp.KrMG67MsYpscratch/merged3: not mounted. 2023-07-06T00:52:24.599 INFO:teuthology.orchestra.run.smithi046.stdout: +umount: /tmp/tmp.KrMG67MsYpscratch/merged1: not mounted. 2023-07-06T00:52:24.599 INFO:teuthology.orchestra.run.smithi046.stdout: +mount: /tmp/tmp.KrMG67MsYpscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-07-06T00:52:24.599 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged4/etc/access.conf': No such file or directory 2023-07-06T00:52:24.599 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged4/etc/access.conf': No such file or directory 2023-07-06T00:52:24.599 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged4/etc/access.conf': No such file or directory 2023-07-06T00:52:24.599 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged4/etc/access.conf': No such file or directory 2023-07-06T00:52:24.600 INFO:teuthology.orchestra.run.smithi046.stdout: +umount: /tmp/tmp.KrMG67MsYpscratch/merged4: not mounted. 2023-07-06T00:52:24.600 INFO:teuthology.orchestra.run.smithi046.stdout: +mount: /tmp/tmp.KrMG67MsYpscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-07-06T00:52:24.600 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged0/etc/access.conf': No such file or directory 2023-07-06T00:52:24.600 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged0/etc/access.conf': No such file or directory 2023-07-06T00:52:24.600 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged0/etc/access.conf': No such file or directory 2023-07-06T00:52:24.600 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged0/etc/access.conf': No such file or directory 2023-07-06T00:52:24.600 INFO:teuthology.orchestra.run.smithi046.stdout: +umount: /tmp/tmp.KrMG67MsYpscratch/merged0: not mounted. 2023-07-06T00:52:24.600 INFO:teuthology.orchestra.run.smithi046.stdout: +mount: /tmp/tmp.KrMG67MsYpscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-07-06T00:52:24.601 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged5/etc/access.conf': No such file or directory 2023-07-06T00:52:24.601 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged5/etc/access.conf': No such file or directory 2023-07-06T00:52:24.601 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged5/etc/access.conf': No such file or directory 2023-07-06T00:52:24.601 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged5/etc/access.conf': No such file or directory 2023-07-06T00:52:24.601 INFO:teuthology.orchestra.run.smithi046.stdout: +umount: /tmp/tmp.KrMG67MsYpscratch/merged5: not mounted. 2023-07-06T00:52:24.601 INFO:teuthology.orchestra.run.smithi046.stdout: +mount: /tmp/tmp.KrMG67MsYpscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-07-06T00:52:24.601 INFO:teuthology.orchestra.run.smithi046.stdout: +mount: /tmp/tmp.KrMG67MsYpscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-07-06T00:52:24.601 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged2/etc/access.conf'cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged1/etc/access.conf': No such file or directory: No such file or directory 2023-07-06T00:52:24.602 INFO:teuthology.orchestra.run.smithi046.stdout: + 2023-07-06T00:52:24.602 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged2/etc/access.conf': No such file or directory 2023-07-06T00:52:24.602 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged1/etc/access.conf': No such file or directory 2023-07-06T00:52:24.602 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged2/etc/access.conf': No such file or directory 2023-07-06T00:52:24.602 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged1/etc/access.conf': No such file or directory 2023-07-06T00:52:24.602 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged2/etc/access.conf': No such file or directory 2023-07-06T00:52:24.602 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged1/etc/access.conf': No such file or directory 2023-07-06T00:52:24.602 INFO:teuthology.orchestra.run.smithi046.stdout: +umount: /tmp/tmp.KrMG67MsYpscratch/merged2: not mounted. 2023-07-06T00:52:24.603 INFO:teuthology.orchestra.run.smithi046.stdout: +umount: /tmp/tmp.KrMG67MsYpscratch/merged1: not mounted. 2023-07-06T00:52:24.603 INFO:teuthology.orchestra.run.smithi046.stdout: +mount: /tmp/tmp.KrMG67MsYpscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-07-06T00:52:24.603 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged4/etc/access.conf': No such file or directory 2023-07-06T00:52:24.603 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged4/etc/access.conf': No such file or directory 2023-07-06T00:52:24.603 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged4/etc/access.conf': No such file or directory 2023-07-06T00:52:24.603 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged4/etc/access.conf': No such file or directory 2023-07-06T00:52:24.603 INFO:teuthology.orchestra.run.smithi046.stdout: +umount: /tmp/tmp.KrMG67MsYpscratch/merged4: not mounted. 2023-07-06T00:52:24.603 INFO:teuthology.orchestra.run.smithi046.stdout: +mount: /tmp/tmp.KrMG67MsYpscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-07-06T00:52:24.604 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged3/etc/access.conf': No such file or directory 2023-07-06T00:52:24.604 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged3/etc/access.conf': No such file or directory 2023-07-06T00:52:24.604 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged3/etc/access.conf': No such file or directory 2023-07-06T00:52:24.604 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged3/etc/access.conf': No such file or directory 2023-07-06T00:52:24.604 INFO:teuthology.orchestra.run.smithi046.stdout: +umount: /tmp/tmp.KrMG67MsYpscratch/merged3: not mounted. 2023-07-06T00:52:24.604 INFO:teuthology.orchestra.run.smithi046.stdout: +mount: /tmp/tmp.KrMG67MsYpscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-07-06T00:52:24.604 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged0/etc/access.conf': No such file or directory 2023-07-06T00:52:24.604 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged0/etc/access.conf': No such file or directory 2023-07-06T00:52:24.605 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged0/etc/access.conf': No such file or directory 2023-07-06T00:52:24.605 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged0/etc/access.conf': No such file or directory 2023-07-06T00:52:24.605 INFO:teuthology.orchestra.run.smithi046.stdout: +umount: /tmp/tmp.KrMG67MsYpscratch/merged0: not mounted. 2023-07-06T00:52:24.605 INFO:teuthology.orchestra.run.smithi046.stdout: +mount: /tmp/tmp.KrMG67MsYpscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-07-06T00:52:24.605 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged5/etc/access.conf': No such file or directory 2023-07-06T00:52:24.605 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged5/etc/access.conf': No such file or directory 2023-07-06T00:52:24.605 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged5/etc/access.conf': No such file or directory 2023-07-06T00:52:24.606 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged5/etc/access.conf': No such file or directory 2023-07-06T00:52:24.606 INFO:teuthology.orchestra.run.smithi046.stdout: +umount: /tmp/tmp.KrMG67MsYpscratch/merged5: not mounted. 2023-07-06T00:52:24.606 INFO:teuthology.orchestra.run.smithi046.stdout: +mount: /tmp/tmp.KrMG67MsYpscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-07-06T00:52:24.606 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged2/etc/access.conf': No such file or directory 2023-07-06T00:52:24.606 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged2/etc/access.conf': No such file or directory 2023-07-06T00:52:24.606 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged2/etc/access.conf': No such file or directory 2023-07-06T00:52:24.606 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged2/etc/access.conf': No such file or directory 2023-07-06T00:52:24.606 INFO:teuthology.orchestra.run.smithi046.stdout: +umount: /tmp/tmp.KrMG67MsYpscratch/merged2: not mounted. 2023-07-06T00:52:24.607 INFO:teuthology.orchestra.run.smithi046.stdout: +mount: /tmp/tmp.KrMG67MsYpscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-07-06T00:52:24.607 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged1/etc/access.conf': No such file or directory 2023-07-06T00:52:24.607 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged1/etc/access.conf': No such file or directory 2023-07-06T00:52:24.607 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged1/etc/access.conf': No such file or directory 2023-07-06T00:52:24.607 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged1/etc/access.conf': No such file or directory 2023-07-06T00:52:24.607 INFO:teuthology.orchestra.run.smithi046.stdout: +umount: /tmp/tmp.KrMG67MsYpscratch/merged1: not mounted. 2023-07-06T00:52:24.607 INFO:teuthology.orchestra.run.smithi046.stdout: +mount: /tmp/tmp.KrMG67MsYpscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-07-06T00:52:24.607 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged3/etc/access.conf': No such file or directory 2023-07-06T00:52:24.608 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged3/etc/access.conf': No such file or directory 2023-07-06T00:52:24.608 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged3/etc/access.conf': No such file or directory 2023-07-06T00:52:24.608 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged3/etc/access.conf': No such file or directory 2023-07-06T00:52:24.608 INFO:teuthology.orchestra.run.smithi046.stdout: +umount: /tmp/tmp.KrMG67MsYpscratch/merged3: not mounted. 2023-07-06T00:52:24.608 INFO:teuthology.orchestra.run.smithi046.stdout: +mount: /tmp/tmp.KrMG67MsYpscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-07-06T00:52:24.608 INFO:teuthology.orchestra.run.smithi046.stdout: +mount: /tmp/tmp.KrMG67MsYpscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-07-06T00:52:24.608 INFO:teuthology.orchestra.run.smithi046.stdout: +mount: /tmp/tmp.KrMG67MsYpscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-07-06T00:52:24.609 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged0/etc/access.conf': No such file or directory 2023-07-06T00:52:24.609 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged5/etc/access.conf': No such file or directory 2023-07-06T00:52:24.609 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged0/etc/access.conf': No such file or directory 2023-07-06T00:52:24.609 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged5/etc/access.conf': No such file or directory 2023-07-06T00:52:24.609 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged0/etc/access.conf': No such file or directory 2023-07-06T00:52:24.609 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged5/etc/access.conf': No such file or directory 2023-07-06T00:52:24.609 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged0/etc/access.conf': No such file or directory 2023-07-06T00:52:24.609 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged5/etc/access.conf': No such file or directory 2023-07-06T00:52:24.610 INFO:teuthology.orchestra.run.smithi046.stdout: +umount: /tmp/tmp.KrMG67MsYpscratch/merged0: not mounted. 2023-07-06T00:52:24.610 INFO:teuthology.orchestra.run.smithi046.stdout: +umount: /tmp/tmp.KrMG67MsYpscratch/merged5: not mounted. 2023-07-06T00:52:24.610 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged4/etc/access.conf': No such file or directory 2023-07-06T00:52:24.610 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged4/etc/access.conf': No such file or directory 2023-07-06T00:52:24.610 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged4/etc/access.conf': No such file or directory 2023-07-06T00:52:24.610 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged4/etc/access.conf': No such file or directory 2023-07-06T00:52:24.610 INFO:teuthology.orchestra.run.smithi046.stdout: +umount: /tmp/tmp.KrMG67MsYpscratch/merged4: not mounted. 2023-07-06T00:52:24.610 INFO:teuthology.orchestra.run.smithi046.stdout: +mount: /tmp/tmp.KrMG67MsYpscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-07-06T00:52:24.611 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged2/etc/access.conf': No such file or directory 2023-07-06T00:52:24.611 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged2/etc/access.conf': No such file or directory 2023-07-06T00:52:24.611 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged2/etc/access.conf': No such file or directory 2023-07-06T00:52:24.611 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged2/etc/access.conf': No such file or directory 2023-07-06T00:52:24.611 INFO:teuthology.orchestra.run.smithi046.stdout: +umount: /tmp/tmp.KrMG67MsYpscratch/merged2: not mounted. 2023-07-06T00:52:24.611 INFO:teuthology.orchestra.run.smithi046.stdout: +mount: /tmp/tmp.KrMG67MsYpscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-07-06T00:52:24.611 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged1/etc/access.conf': No such file or directory 2023-07-06T00:52:24.611 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged1/etc/access.conf': No such file or directory 2023-07-06T00:52:24.612 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged1/etc/access.conf': No such file or directory 2023-07-06T00:52:24.612 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged1/etc/access.conf': No such file or directory 2023-07-06T00:52:24.612 INFO:teuthology.orchestra.run.smithi046.stdout: +umount: /tmp/tmp.KrMG67MsYpscratch/merged1: not mounted. 2023-07-06T00:52:24.612 INFO:teuthology.orchestra.run.smithi046.stdout: +mount: /tmp/tmp.KrMG67MsYpscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-07-06T00:52:24.612 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged0/etc/access.conf': No such file or directory 2023-07-06T00:52:24.612 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged0/etc/access.conf': No such file or directory 2023-07-06T00:52:24.612 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged0/etc/access.conf': No such file or directory 2023-07-06T00:52:24.613 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged0/etc/access.conf': No such file or directory 2023-07-06T00:52:24.613 INFO:teuthology.orchestra.run.smithi046.stdout: +umount: /tmp/tmp.KrMG67MsYpscratch/merged0: not mounted. 2023-07-06T00:52:24.613 INFO:teuthology.orchestra.run.smithi046.stdout: +mount: /tmp/tmp.KrMG67MsYpscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error.mount: 2023-07-06T00:52:24.613 INFO:teuthology.orchestra.run.smithi046.stdout: +/tmp/tmp.KrMG67MsYpscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-07-06T00:52:24.613 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged3/etc/access.conf': No such file or directory 2023-07-06T00:52:24.613 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged5/etc/access.conf': No such file or directory 2023-07-06T00:52:24.613 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged3/etc/access.conf': No such file or directory 2023-07-06T00:52:24.613 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged5/etc/access.conf': No such file or directory 2023-07-06T00:52:24.614 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged3/etc/access.conf': No such file or directory 2023-07-06T00:52:24.614 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged5/etc/access.conf': No such file or directory 2023-07-06T00:52:24.614 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged5/etc/access.conf': No such file or directory 2023-07-06T00:52:24.614 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged3/etc/access.conf': No such file or directory 2023-07-06T00:52:24.614 INFO:teuthology.orchestra.run.smithi046.stdout: +mount: /tmp/tmp.KrMG67MsYpscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-07-06T00:52:24.614 INFO:teuthology.orchestra.run.smithi046.stdout: +umount: /tmp/tmp.KrMG67MsYpscratch/merged5: not mounted. 2023-07-06T00:52:24.614 INFO:teuthology.orchestra.run.smithi046.stdout: +umount: /tmp/tmp.KrMG67MsYpscratch/merged3: not mounted. 2023-07-06T00:52:24.614 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged4/etc/access.conf': No such file or directory 2023-07-06T00:52:24.615 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged4/etc/access.conf': No such file or directory 2023-07-06T00:52:24.615 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged4/etc/access.conf': No such file or directory 2023-07-06T00:52:24.615 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged4/etc/access.conf': No such file or directory 2023-07-06T00:52:24.615 INFO:teuthology.orchestra.run.smithi046.stdout: +umount: /tmp/tmp.KrMG67MsYpscratch/merged4: not mounted. 2023-07-06T00:52:24.615 INFO:teuthology.orchestra.run.smithi046.stdout: +mount: /tmp/tmp.KrMG67MsYpscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-07-06T00:52:24.615 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged2/etc/access.conf': No such file or directory 2023-07-06T00:52:24.615 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged2/etc/access.conf': No such file or directory 2023-07-06T00:52:24.615 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged2/etc/access.conf': No such file or directory 2023-07-06T00:52:24.616 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged2/etc/access.conf': No such file or directory 2023-07-06T00:52:24.616 INFO:teuthology.orchestra.run.smithi046.stdout: +umount: /tmp/tmp.KrMG67MsYpscratch/merged2: not mounted. 2023-07-06T00:52:24.616 INFO:teuthology.orchestra.run.smithi046.stdout: +mount: /tmp/tmp.KrMG67MsYpscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-07-06T00:52:24.616 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged1/etc/access.conf': No such file or directory 2023-07-06T00:52:24.616 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged1/etc/access.conf': No such file or directory 2023-07-06T00:52:24.616 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged1/etc/access.conf': No such file or directory 2023-07-06T00:52:24.616 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged1/etc/access.conf': No such file or directory 2023-07-06T00:52:24.617 INFO:teuthology.orchestra.run.smithi046.stdout: +umount: /tmp/tmp.KrMG67MsYpscratch/merged1: not mounted. 2023-07-06T00:52:24.617 INFO:teuthology.orchestra.run.smithi046.stdout: +mount: /tmp/tmp.KrMG67MsYpscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-07-06T00:52:24.617 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged0/etc/access.conf': No such file or directory 2023-07-06T00:52:24.617 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged0/etc/access.conf': No such file or directory 2023-07-06T00:52:24.617 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged0/etc/access.conf': No such file or directory 2023-07-06T00:52:24.617 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged0/etc/access.conf': No such file or directory 2023-07-06T00:52:24.617 INFO:teuthology.orchestra.run.smithi046.stdout: +umount: /tmp/tmp.KrMG67MsYpscratch/merged0: not mounted. 2023-07-06T00:52:24.617 INFO:teuthology.orchestra.run.smithi046.stdout: +mount: /tmp/tmp.KrMG67MsYpscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-07-06T00:52:24.618 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged4/etc/access.conf': No such file or directory 2023-07-06T00:52:24.618 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged4/etc/access.conf': No such file or directory 2023-07-06T00:52:24.618 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged4/etc/access.conf': No such file or directory 2023-07-06T00:52:24.618 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged4/etc/access.conf': No such file or directory 2023-07-06T00:52:24.618 INFO:teuthology.orchestra.run.smithi046.stdout: +mount: /tmp/tmp.KrMG67MsYpscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-07-06T00:52:24.618 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged3/etc/access.conf': No such file or directory 2023-07-06T00:52:24.618 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged3/etc/access.conf': No such file or directory 2023-07-06T00:52:24.619 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged3/etc/access.conf': No such file or directory 2023-07-06T00:52:24.619 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged3/etc/access.conf': No such file or directory 2023-07-06T00:52:24.619 INFO:teuthology.orchestra.run.smithi046.stdout: +mount: /tmp/tmp.KrMG67MsYpscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-07-06T00:52:24.619 INFO:teuthology.orchestra.run.smithi046.stdout: +mount: /tmp/tmp.KrMG67MsYpscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-07-06T00:52:24.619 INFO:teuthology.orchestra.run.smithi046.stdout: +umount: /tmp/tmp.KrMG67MsYpscratch/merged4: not mounted. 2023-07-06T00:52:24.619 INFO:teuthology.orchestra.run.smithi046.stdout: +umount: /tmp/tmp.KrMG67MsYpscratch/merged3: not mounted. 2023-07-06T00:52:24.619 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged5/etc/access.conf': No such file or directory 2023-07-06T00:52:24.619 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged5/etc/access.conf': No such file or directory 2023-07-06T00:52:24.620 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged2/etc/access.conf': No such file or directory 2023-07-06T00:52:24.620 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged2/etc/access.conf': No such file or directory 2023-07-06T00:52:24.620 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged5/etc/access.conf': No such file or directory 2023-07-06T00:52:24.620 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged5/etc/access.conf': No such file or directory 2023-07-06T00:52:24.620 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged2/etc/access.conf': No such file or directory 2023-07-06T00:52:24.620 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged2/etc/access.conf': No such file or directory 2023-07-06T00:52:24.620 INFO:teuthology.orchestra.run.smithi046.stdout: +umount: /tmp/tmp.KrMG67MsYpscratch/merged5: not mounted. 2023-07-06T00:52:24.620 INFO:teuthology.orchestra.run.smithi046.stdout: +umount: /tmp/tmp.KrMG67MsYpscratch/merged2: not mounted. 2023-07-06T00:52:24.621 INFO:teuthology.orchestra.run.smithi046.stdout: +mount: /tmp/tmp.KrMG67MsYpscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-07-06T00:52:24.621 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged1/etc/access.conf': No such file or directory 2023-07-06T00:52:24.621 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged1/etc/access.conf': No such file or directory 2023-07-06T00:52:24.621 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged1/etc/access.conf': No such file or directory 2023-07-06T00:52:24.621 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged1/etc/access.conf': No such file or directory 2023-07-06T00:52:24.621 INFO:teuthology.orchestra.run.smithi046.stdout: +umount: /tmp/tmp.KrMG67MsYpscratch/merged1: not mounted. 2023-07-06T00:52:24.621 INFO:teuthology.orchestra.run.smithi046.stdout: +mount: /tmp/tmp.KrMG67MsYpscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-07-06T00:52:24.621 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged0/etc/access.conf': No such file or directory 2023-07-06T00:52:24.622 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged0/etc/access.conf': No such file or directory 2023-07-06T00:52:24.622 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged0/etc/access.conf': No such file or directory 2023-07-06T00:52:24.622 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged0/etc/access.conf': No such file or directory 2023-07-06T00:52:24.622 INFO:teuthology.orchestra.run.smithi046.stdout: +umount: /tmp/tmp.KrMG67MsYpscratch/merged0: not mounted. 2023-07-06T00:52:24.622 INFO:teuthology.orchestra.run.smithi046.stdout: +mount: mount: /tmp/tmp.KrMG67MsYpscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error./tmp/tmp.KrMG67MsYpscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-07-06T00:52:24.622 INFO:teuthology.orchestra.run.smithi046.stdout: + 2023-07-06T00:52:24.622 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged5/etc/access.conf': No such file or directory 2023-07-06T00:52:24.622 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged3/etc/access.conf': No such file or directory 2023-07-06T00:52:24.623 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged3/etc/access.conf': No such file or directory 2023-07-06T00:52:24.623 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged5/etc/access.conf': No such file or directory 2023-07-06T00:52:24.623 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged5/etc/access.conf': No such file or directory 2023-07-06T00:52:24.623 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged3/etc/access.conf': No such file or directory 2023-07-06T00:52:24.623 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged5/etc/access.conf': No such file or directory 2023-07-06T00:52:24.623 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged3/etc/access.conf': No such file or directory 2023-07-06T00:52:24.623 INFO:teuthology.orchestra.run.smithi046.stdout: +umount: /tmp/tmp.KrMG67MsYpscratch/merged5: not mounted. 2023-07-06T00:52:24.623 INFO:teuthology.orchestra.run.smithi046.stdout: +mount: /tmp/tmp.KrMG67MsYpscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-07-06T00:52:24.624 INFO:teuthology.orchestra.run.smithi046.stdout: +mount: /tmp/tmp.KrMG67MsYpscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-07-06T00:52:24.624 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged2/etc/access.conf': No such file or directory 2023-07-06T00:52:24.624 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged4/etc/access.conf': No such file or directory 2023-07-06T00:52:24.624 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged2/etc/access.conf': No such file or directory 2023-07-06T00:52:24.624 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged4/etc/access.conf': No such file or directory 2023-07-06T00:52:24.624 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged2/etc/access.conf': No such file or directory 2023-07-06T00:52:24.624 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged4/etc/access.conf': No such file or directory 2023-07-06T00:52:24.625 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged4/etc/access.conf': No such file or directory 2023-07-06T00:52:24.625 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged2/etc/access.conf': No such file or directory 2023-07-06T00:52:24.625 INFO:teuthology.orchestra.run.smithi046.stdout: +umount: /tmp/tmp.KrMG67MsYpscratch/merged2: not mounted. 2023-07-06T00:52:24.625 INFO:teuthology.orchestra.run.smithi046.stdout: +umount: /tmp/tmp.KrMG67MsYpscratch/merged4: not mounted. 2023-07-06T00:52:24.625 INFO:teuthology.orchestra.run.smithi046.stdout: +umount: /tmp/tmp.KrMG67MsYpscratch/merged3: not mounted. 2023-07-06T00:52:24.625 INFO:teuthology.orchestra.run.smithi046.stdout: +mount: /tmp/tmp.KrMG67MsYpscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-07-06T00:52:24.625 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged1/etc/access.conf': No such file or directory 2023-07-06T00:52:24.625 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged1/etc/access.conf': No such file or directory 2023-07-06T00:52:24.626 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged1/etc/access.conf': No such file or directory 2023-07-06T00:52:24.626 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged1/etc/access.conf': No such file or directory 2023-07-06T00:52:24.626 INFO:teuthology.orchestra.run.smithi046.stdout: +umount: /tmp/tmp.KrMG67MsYpscratch/merged1: not mounted. 2023-07-06T00:52:24.626 INFO:teuthology.orchestra.run.smithi046.stdout: +mount: /tmp/tmp.KrMG67MsYpscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-07-06T00:52:24.626 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged0/etc/access.conf': No such file or directory 2023-07-06T00:52:24.626 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged0/etc/access.conf': No such file or directory 2023-07-06T00:52:24.626 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged0/etc/access.conf': No such file or directory 2023-07-06T00:52:24.626 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged0/etc/access.conf': No such file or directory 2023-07-06T00:52:24.627 INFO:teuthology.orchestra.run.smithi046.stdout: +umount: /tmp/tmp.KrMG67MsYpscratch/merged0: not mounted. 2023-07-06T00:52:24.627 INFO:teuthology.orchestra.run.smithi046.stdout: +mount: /tmp/tmp.KrMG67MsYpscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-07-06T00:52:24.627 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged4/etc/access.conf': No such file or directory 2023-07-06T00:52:24.627 INFO:teuthology.orchestra.run.smithi046.stdout: +mount: /tmp/tmp.KrMG67MsYpscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-07-06T00:52:24.627 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged4/etc/access.conf': No such file or directory 2023-07-06T00:52:24.627 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged5/etc/access.conf': No such file or directory 2023-07-06T00:52:24.627 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged5/etc/access.conf': No such file or directory 2023-07-06T00:52:24.627 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged4/etc/access.conf': No such file or directory 2023-07-06T00:52:24.628 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged5/etc/access.conf': No such file or directory 2023-07-06T00:52:24.628 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged5/etc/access.conf': No such file or directory 2023-07-06T00:52:24.628 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged4/etc/access.conf': No such file or directory 2023-07-06T00:52:24.628 INFO:teuthology.orchestra.run.smithi046.stdout: +umount: /tmp/tmp.KrMG67MsYpscratch/merged5: not mounted. 2023-07-06T00:52:24.628 INFO:teuthology.orchestra.run.smithi046.stdout: +umount: /tmp/tmp.KrMG67MsYpscratch/merged4: not mounted. 2023-07-06T00:52:24.628 INFO:teuthology.orchestra.run.smithi046.stdout: +mount: /tmp/tmp.KrMG67MsYpscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-07-06T00:52:24.628 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged3/etc/access.conf': No such file or directory 2023-07-06T00:52:24.628 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged3/etc/access.conf': No such file or directory 2023-07-06T00:52:24.629 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged3/etc/access.conf': No such file or directory 2023-07-06T00:52:24.629 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged3/etc/access.conf': No such file or directory 2023-07-06T00:52:24.629 INFO:teuthology.orchestra.run.smithi046.stdout: +umount: /tmp/tmp.KrMG67MsYpscratch/merged3: not mounted. 2023-07-06T00:52:24.629 INFO:teuthology.orchestra.run.smithi046.stdout: +mount: /tmp/tmp.KrMG67MsYpscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-07-06T00:52:24.629 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged2/etc/access.conf': No such file or directory 2023-07-06T00:52:24.629 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged2/etc/access.conf': No such file or directory 2023-07-06T00:52:24.629 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged2/etc/access.conf': No such file or directory 2023-07-06T00:52:24.630 INFO:teuthology.orchestra.run.smithi046.stdout: +mount: /tmp/tmp.KrMG67MsYpscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-07-06T00:52:24.630 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged2/etc/access.conf': No such file or directory 2023-07-06T00:52:24.630 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged1/etc/access.conf': No such file or directory 2023-07-06T00:52:24.630 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged1/etc/access.conf': No such file or directory 2023-07-06T00:52:24.630 INFO:teuthology.orchestra.run.smithi046.stdout: +umount: /tmp/tmp.KrMG67MsYpscratch/merged2: not mounted. 2023-07-06T00:52:24.630 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged1/etc/access.conf': No such file or directory 2023-07-06T00:52:24.630 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged1/etc/access.conf': No such file or directory 2023-07-06T00:52:24.630 INFO:teuthology.orchestra.run.smithi046.stdout: +umount: /tmp/tmp.KrMG67MsYpscratch/merged1: not mounted. 2023-07-06T00:52:24.631 INFO:teuthology.orchestra.run.smithi046.stdout: +mount: /tmp/tmp.KrMG67MsYpscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-07-06T00:52:24.631 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged0/etc/access.conf': No such file or directory 2023-07-06T00:52:24.631 INFO:teuthology.orchestra.run.smithi046.stdout: +mount: mount: /tmp/tmp.KrMG67MsYpscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error./tmp/tmp.KrMG67MsYpscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-07-06T00:52:24.631 INFO:teuthology.orchestra.run.smithi046.stdout: + 2023-07-06T00:52:24.631 INFO:teuthology.orchestra.run.smithi046.stdout: +mount: /tmp/tmp.KrMG67MsYpscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-07-06T00:52:24.631 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged3/etc/access.conf': No such file or directory 2023-07-06T00:52:24.631 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged5/etc/access.conf': No such file or directory 2023-07-06T00:52:24.631 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged3/etc/access.conf': No such file or directory 2023-07-06T00:52:24.632 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged5/etc/access.conf': No such file or directory 2023-07-06T00:52:24.632 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged4/etc/access.conf': No such file or directory 2023-07-06T00:52:24.632 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged0/etc/access.conf': No such file or directory 2023-07-06T00:52:24.632 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged3/etc/access.conf': No such file or directory 2023-07-06T00:52:24.632 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged5/etc/access.conf': No such file or directory 2023-07-06T00:52:24.632 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged4/etc/access.conf': No such file or directory 2023-07-06T00:52:24.632 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged5/etc/access.conf': No such file or directory 2023-07-06T00:52:24.632 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged4/etc/access.conf': No such file or directory 2023-07-06T00:52:24.633 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged3/etc/access.conf': No such file or directory 2023-07-06T00:52:24.633 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged0/etc/access.conf': No such file or directory 2023-07-06T00:52:24.633 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged4/etc/access.conf': No such file or directory 2023-07-06T00:52:24.633 INFO:teuthology.orchestra.run.smithi046.stdout: +umount: /tmp/tmp.KrMG67MsYpscratch/merged5: not mounted. 2023-07-06T00:52:24.633 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged0/etc/access.conf': No such file or directory 2023-07-06T00:52:24.633 INFO:teuthology.orchestra.run.smithi046.stdout: +umount: /tmp/tmp.KrMG67MsYpscratch/merged3: not mounted. 2023-07-06T00:52:24.633 INFO:teuthology.orchestra.run.smithi046.stdout: +mount: /tmp/tmp.KrMG67MsYpscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-07-06T00:52:24.633 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged2/etc/access.conf': No such file or directory 2023-07-06T00:52:24.634 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged2/etc/access.conf': No such file or directory 2023-07-06T00:52:24.634 INFO:teuthology.orchestra.run.smithi046.stdout: +mount: /tmp/tmp.KrMG67MsYpscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-07-06T00:52:24.634 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged1/etc/access.conf': No such file or directory 2023-07-06T00:52:24.634 INFO:teuthology.orchestra.run.smithi046.stdout: +umount: /tmp/tmp.KrMG67MsYpscratch/merged4: not mounted. 2023-07-06T00:52:24.634 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged2/etc/access.conf': No such file or directory 2023-07-06T00:52:24.634 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged2/etc/access.conf': No such file or directory 2023-07-06T00:52:24.634 INFO:teuthology.orchestra.run.smithi046.stdout: +umount: /tmp/tmp.KrMG67MsYpscratch/merged0: not mounted. 2023-07-06T00:52:24.634 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged1/etc/access.conf': No such file or directory 2023-07-06T00:52:24.635 INFO:teuthology.orchestra.run.smithi046.stdout: +umount: /tmp/tmp.KrMG67MsYpscratch/merged2: not mounted. 2023-07-06T00:52:24.635 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged1/etc/access.conf': No such file or directory 2023-07-06T00:52:24.635 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged1/etc/access.conf': No such file or directory 2023-07-06T00:52:24.635 INFO:teuthology.orchestra.run.smithi046.stdout: +umount: /tmp/tmp.KrMG67MsYpscratch/merged1: not mounted. 2023-07-06T00:52:24.635 INFO:teuthology.orchestra.run.smithi046.stdout: +mount: /tmp/tmp.KrMG67MsYpscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-07-06T00:52:24.635 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged2/etc/access.conf': No such file or directory 2023-07-06T00:52:24.635 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged2/etc/access.conf': No such file or directory 2023-07-06T00:52:24.635 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged2/etc/access.conf': No such file or directory 2023-07-06T00:52:24.636 INFO:teuthology.orchestra.run.smithi046.stdout: +mount: touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged2/etc/access.conf': No such file or directory 2023-07-06T00:52:24.636 INFO:teuthology.orchestra.run.smithi046.stdout: +/tmp/tmp.KrMG67MsYpscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-07-06T00:52:24.636 INFO:teuthology.orchestra.run.smithi046.stdout: +umount: /tmp/tmp.KrMG67MsYpscratch/merged2: not mounted. 2023-07-06T00:52:24.636 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged0/etc/access.conf': No such file or directory 2023-07-06T00:52:24.636 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged0/etc/access.conf': No such file or directory 2023-07-06T00:52:24.636 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged0/etc/access.conf': No such file or directory 2023-07-06T00:52:24.636 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged0/etc/access.conf': No such file or directory 2023-07-06T00:52:24.637 INFO:teuthology.orchestra.run.smithi046.stdout: +umount: /tmp/tmp.KrMG67MsYpscratch/merged0: not mounted. 2023-07-06T00:52:24.637 INFO:teuthology.orchestra.run.smithi046.stdout: +mount: mount: /tmp/tmp.KrMG67MsYpscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error./tmp/tmp.KrMG67MsYpscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-07-06T00:52:24.637 INFO:teuthology.orchestra.run.smithi046.stdout: + 2023-07-06T00:52:24.637 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged1/etc/access.conf': No such file or directory 2023-07-06T00:52:24.637 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged1/etc/access.conf': No such file or directory 2023-07-06T00:52:24.637 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged1/etc/access.conf': No such file or directory 2023-07-06T00:52:24.637 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged1/etc/access.conf': No such file or directory 2023-07-06T00:52:24.637 INFO:teuthology.orchestra.run.smithi046.stdout: +umount: /tmp/tmp.KrMG67MsYpscratch/merged1: not mounted. 2023-07-06T00:52:24.638 INFO:teuthology.orchestra.run.smithi046.stdout: +mount: /tmp/tmp.KrMG67MsYpscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-07-06T00:52:24.638 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged3/etc/access.conf': No such file or directory 2023-07-06T00:52:24.638 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged5/etc/access.conf': No such file or directory 2023-07-06T00:52:24.638 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged3/etc/access.conf': No such file or directory 2023-07-06T00:52:24.638 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged3/etc/access.conf': No such file or directory 2023-07-06T00:52:24.638 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged5/etc/access.conf': No such file or directory 2023-07-06T00:52:24.638 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged3/etc/access.conf': No such file or directory 2023-07-06T00:52:24.638 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged5/etc/access.conf': No such file or directory 2023-07-06T00:52:24.639 INFO:teuthology.orchestra.run.smithi046.stdout: +umount: /tmp/tmp.KrMG67MsYpscratch/merged3: not mounted. 2023-07-06T00:52:24.639 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged5/etc/access.conf': No such file or directory 2023-07-06T00:52:24.639 INFO:teuthology.orchestra.run.smithi046.stdout: +umount: /tmp/tmp.KrMG67MsYpscratch/merged5: not mounted. 2023-07-06T00:52:24.639 INFO:teuthology.orchestra.run.smithi046.stdout: +mount: /tmp/tmp.KrMG67MsYpscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-07-06T00:52:24.639 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged4/etc/access.conf': No such file or directory 2023-07-06T00:52:24.639 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged4/etc/access.conf': No such file or directory 2023-07-06T00:52:24.639 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged4/etc/access.conf': No such file or directory 2023-07-06T00:52:24.639 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged4/etc/access.conf': No such file or directory 2023-07-06T00:52:24.640 INFO:teuthology.orchestra.run.smithi046.stdout: +umount: /tmp/tmp.KrMG67MsYpscratch/merged4: not mounted. 2023-07-06T00:52:24.640 INFO:teuthology.orchestra.run.smithi046.stdout: +mount: /tmp/tmp.KrMG67MsYpscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-07-06T00:52:24.640 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged1/etc/access.conf': No such file or directory 2023-07-06T00:52:24.640 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged1/etc/access.conf': No such file or directory 2023-07-06T00:52:24.640 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged1/etc/access.conf': No such file or directory 2023-07-06T00:52:24.640 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged1/etc/access.conf': No such file or directory 2023-07-06T00:52:24.640 INFO:teuthology.orchestra.run.smithi046.stdout: +umount: /tmp/tmp.KrMG67MsYpscratch/merged1: not mounted. 2023-07-06T00:52:24.641 INFO:teuthology.orchestra.run.smithi046.stdout: +mount: mount: mount: /tmp/tmp.KrMG67MsYpscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error./tmp/tmp.KrMG67MsYpscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error./tmp/tmp.KrMG67MsYpscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-07-06T00:52:24.641 INFO:teuthology.orchestra.run.smithi046.stdout: + 2023-07-06T00:52:24.641 INFO:teuthology.orchestra.run.smithi046.stdout: + 2023-07-06T00:52:24.641 INFO:teuthology.orchestra.run.smithi046.stdout: +mount: /tmp/tmp.KrMG67MsYpscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-07-06T00:52:24.641 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged5/etc/access.conf'mv: : No such file or directorycannot stat '/tmp/tmp.KrMG67MsYpscratch/merged4/etc/access.conf' 2023-07-06T00:52:24.641 INFO:teuthology.orchestra.run.smithi046.stdout: +: No such file or directory 2023-07-06T00:52:24.641 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged2/etc/access.conf': No such file or directory 2023-07-06T00:52:24.641 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged5/etc/access.conf': No such file or directory 2023-07-06T00:52:24.642 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged4/etc/access.conf': No such file or directory 2023-07-06T00:52:24.642 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged5/etc/access.conf': No such file or directory 2023-07-06T00:52:24.642 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged0/etc/access.conf': No such file or directory 2023-07-06T00:52:24.642 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged4/etc/access.conf': No such file or directory 2023-07-06T00:52:24.642 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged0/etc/access.conf': No such file or directory 2023-07-06T00:52:24.642 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged5/etc/access.conf'touch: : No such file or directorycannot touch '/tmp/tmp.KrMG67MsYpscratch/merged4/etc/access.conf' 2023-07-06T00:52:24.642 INFO:teuthology.orchestra.run.smithi046.stdout: +: No such file or directory 2023-07-06T00:52:24.642 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged0/etc/access.conf': No such file or directory 2023-07-06T00:52:24.643 INFO:teuthology.orchestra.run.smithi046.stdout: +umount: /tmp/tmp.KrMG67MsYpscratch/merged5: not mounted. 2023-07-06T00:52:24.643 INFO:teuthology.orchestra.run.smithi046.stdout: +umount: /tmp/tmp.KrMG67MsYpscratch/merged4: not mounted. 2023-07-06T00:52:24.643 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged0/etc/access.conf': No such file or directory 2023-07-06T00:52:24.643 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged2/etc/access.conf': No such file or directory 2023-07-06T00:52:24.643 INFO:teuthology.orchestra.run.smithi046.stdout: +mount: /tmp/tmp.KrMG67MsYpscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-07-06T00:52:24.643 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged3/etc/access.conf': No such file or directory 2023-07-06T00:52:24.643 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged2/etc/access.conf': No such file or directory 2023-07-06T00:52:24.643 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged3/etc/access.conf': No such file or directory 2023-07-06T00:52:24.644 INFO:teuthology.orchestra.run.smithi046.stdout: +umount: /tmp/tmp.KrMG67MsYpscratch/merged0: not mounted. 2023-07-06T00:52:24.644 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged2/etc/access.conf': No such file or directory 2023-07-06T00:52:24.644 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged3/etc/access.conf': No such file or directory 2023-07-06T00:52:24.644 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged3/etc/access.conf': No such file or directory 2023-07-06T00:52:24.644 INFO:teuthology.orchestra.run.smithi046.stdout: +umount: /tmp/tmp.KrMG67MsYpscratch/merged2: not mounted. 2023-07-06T00:52:24.644 INFO:teuthology.orchestra.run.smithi046.stdout: +umount: /tmp/tmp.KrMG67MsYpscratch/merged3: not mounted. 2023-07-06T00:52:24.644 INFO:teuthology.orchestra.run.smithi046.stdout: +mount: /tmp/tmp.KrMG67MsYpscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-07-06T00:52:24.644 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged4/etc/access.conf': No such file or directory 2023-07-06T00:52:24.645 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged4/etc/access.conf': No such file or directory 2023-07-06T00:52:24.645 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged4/etc/access.conf': No such file or directory 2023-07-06T00:52:24.645 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged4/etc/access.conf': No such file or directory 2023-07-06T00:52:24.645 INFO:teuthology.orchestra.run.smithi046.stdout: +umount: /tmp/tmp.KrMG67MsYpscratch/merged4: not mounted. 2023-07-06T00:52:24.645 INFO:teuthology.orchestra.run.smithi046.stdout: +mount: mount: /tmp/tmp.KrMG67MsYpscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error./tmp/tmp.KrMG67MsYpscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-07-06T00:52:24.645 INFO:teuthology.orchestra.run.smithi046.stdout: + 2023-07-06T00:52:24.645 INFO:teuthology.orchestra.run.smithi046.stdout: +mount: /tmp/tmp.KrMG67MsYpscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-07-06T00:52:24.645 INFO:teuthology.orchestra.run.smithi046.stdout: +mount: mount: /tmp/tmp.KrMG67MsYpscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error./tmp/tmp.KrMG67MsYpscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-07-06T00:52:24.646 INFO:teuthology.orchestra.run.smithi046.stdout: + 2023-07-06T00:52:24.646 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged3/etc/access.conf'mv: : No such file or directorycannot stat '/tmp/tmp.KrMG67MsYpscratch/merged0/etc/access.conf' 2023-07-06T00:52:24.646 INFO:teuthology.orchestra.run.smithi046.stdout: +: No such file or directory 2023-07-06T00:52:24.646 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged2/etc/access.conf': No such file or directory 2023-07-06T00:52:24.646 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged0/etc/access.conf'cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged3/etc/access.conf': No such file or directory: No such file or directory 2023-07-06T00:52:24.646 INFO:teuthology.orchestra.run.smithi046.stdout: + 2023-07-06T00:52:24.646 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged5/etc/access.conf': No such file or directory 2023-07-06T00:52:24.647 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged0/etc/access.conf'touch: : No such file or directorycannot touch '/tmp/tmp.KrMG67MsYpscratch/merged5/etc/access.conf' 2023-07-06T00:52:24.647 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: : No such file or directorycannot touch '/tmp/tmp.KrMG67MsYpscratch/merged2/etc/access.conf' 2023-07-06T00:52:24.647 INFO:teuthology.orchestra.run.smithi046.stdout: +: No such file or directory 2023-07-06T00:52:24.647 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged3/etc/access.conf': No such file or directory 2023-07-06T00:52:24.647 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged0/etc/access.conf': No such file or directory 2023-07-06T00:52:24.647 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged3/etc/access.conf': No such file or directory 2023-07-06T00:52:24.647 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged2/etc/access.conf': No such file or directory 2023-07-06T00:52:24.647 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged5/etc/access.conf': No such file or directory 2023-07-06T00:52:24.648 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged2/etc/access.conf': No such file or directory 2023-07-06T00:52:24.648 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged5/etc/access.conf': No such file or directory 2023-07-06T00:52:24.648 INFO:teuthology.orchestra.run.smithi046.stdout: +umount: /tmp/tmp.KrMG67MsYpscratch/merged0: not mounted. 2023-07-06T00:52:24.648 INFO:teuthology.orchestra.run.smithi046.stdout: +umount: /tmp/tmp.KrMG67MsYpscratch/merged3: not mounted. 2023-07-06T00:52:24.648 INFO:teuthology.orchestra.run.smithi046.stdout: +umount: /tmp/tmp.KrMG67MsYpscratch/merged2: not mounted. 2023-07-06T00:52:24.648 INFO:teuthology.orchestra.run.smithi046.stdout: +umount: /tmp/tmp.KrMG67MsYpscratch/merged5: not mounted. 2023-07-06T00:52:24.648 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged1/etc/access.conf': No such file or directory 2023-07-06T00:52:24.648 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged1/etc/access.conf': No such file or directory 2023-07-06T00:52:24.649 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged1/etc/access.conf': No such file or directory 2023-07-06T00:52:24.649 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged1/etc/access.conf': No such file or directory 2023-07-06T00:52:24.649 INFO:teuthology.orchestra.run.smithi046.stdout: +umount: /tmp/tmp.KrMG67MsYpscratch/merged1: not mounted. 2023-07-06T00:52:24.649 INFO:teuthology.orchestra.run.smithi046.stdout: +mount: /tmp/tmp.KrMG67MsYpscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-07-06T00:52:24.649 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged5/etc/access.conf': No such file or directory 2023-07-06T00:52:24.649 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged5/etc/access.conf': No such file or directory 2023-07-06T00:52:24.649 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged5/etc/access.conf': No such file or directory 2023-07-06T00:52:24.650 INFO:teuthology.orchestra.run.smithi046.stdout: +mount: /tmp/tmp.KrMG67MsYpscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-07-06T00:52:24.650 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged5/etc/access.conf': No such file or directory 2023-07-06T00:52:24.650 INFO:teuthology.orchestra.run.smithi046.stdout: +umount: /tmp/tmp.KrMG67MsYpscratch/merged5: not mounted. 2023-07-06T00:52:24.650 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged4/etc/access.conf': No such file or directory 2023-07-06T00:52:24.650 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged4/etc/access.conf': No such file or directory 2023-07-06T00:52:24.650 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged4/etc/access.conf': No such file or directory 2023-07-06T00:52:24.650 INFO:teuthology.orchestra.run.smithi046.stdout: +mount: /tmp/tmp.KrMG67MsYpscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-07-06T00:52:24.650 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged2/etc/access.conf': No such file or directory 2023-07-06T00:52:24.651 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged4/etc/access.conf': No such file or directory 2023-07-06T00:52:24.651 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged2/etc/access.conf': No such file or directory 2023-07-06T00:52:24.651 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged2/etc/access.conf': No such file or directory 2023-07-06T00:52:24.651 INFO:teuthology.orchestra.run.smithi046.stdout: +umount: /tmp/tmp.KrMG67MsYpscratch/merged4: not mounted. 2023-07-06T00:52:24.651 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged2/etc/access.conf': No such file or directory 2023-07-06T00:52:24.651 INFO:teuthology.orchestra.run.smithi046.stdout: +umount: /tmp/tmp.KrMG67MsYpscratch/merged2: not mounted. 2023-07-06T00:52:24.651 INFO:teuthology.orchestra.run.smithi046.stdout: +mount: /tmp/tmp.KrMG67MsYpscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-07-06T00:52:24.651 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged1/etc/access.conf': No such file or directory 2023-07-06T00:52:24.652 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged1/etc/access.conf': No such file or directory 2023-07-06T00:52:24.652 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged1/etc/access.conf': No such file or directory 2023-07-06T00:52:24.652 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged1/etc/access.conf': No such file or directory 2023-07-06T00:52:24.652 INFO:teuthology.orchestra.run.smithi046.stdout: +mount: mount: /tmp/tmp.KrMG67MsYpscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error./tmp/tmp.KrMG67MsYpscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-07-06T00:52:24.652 INFO:teuthology.orchestra.run.smithi046.stdout: + 2023-07-06T00:52:24.652 INFO:teuthology.orchestra.run.smithi046.stdout: +umount: /tmp/tmp.KrMG67MsYpscratch/merged1: not mounted. 2023-07-06T00:52:24.652 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged0/etc/access.conf': No such file or directory 2023-07-06T00:52:24.652 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged3/etc/access.conf': No such file or directorytouch: 2023-07-06T00:52:24.653 INFO:teuthology.orchestra.run.smithi046.stdout: +cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged0/etc/access.conf': No such file or directory 2023-07-06T00:52:24.653 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged0/etc/access.conf': No such file or directory 2023-07-06T00:52:24.653 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged3/etc/access.conf': No such file or directory 2023-07-06T00:52:24.653 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged0/etc/access.conf': No such file or directory 2023-07-06T00:52:24.653 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged3/etc/access.conf': No such file or directory 2023-07-06T00:52:24.653 INFO:teuthology.orchestra.run.smithi046.stdout: +umount: /tmp/tmp.KrMG67MsYpscratch/merged0: not mounted. 2023-07-06T00:52:24.653 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged3/etc/access.conf': No such file or directory 2023-07-06T00:52:24.653 INFO:teuthology.orchestra.run.smithi046.stdout: +umount: /tmp/tmp.KrMG67MsYpscratch/merged3: not mounted. 2023-07-06T00:52:24.654 INFO:teuthology.orchestra.run.smithi046.stdout: +mount: /tmp/tmp.KrMG67MsYpscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-07-06T00:52:24.654 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged4/etc/access.conf': No such file or directory 2023-07-06T00:52:24.654 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged4/etc/access.conf': No such file or directory 2023-07-06T00:52:24.654 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged4/etc/access.conf': No such file or directory 2023-07-06T00:52:24.654 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged4/etc/access.conf': No such file or directory 2023-07-06T00:52:24.654 INFO:teuthology.orchestra.run.smithi046.stdout: +umount: /tmp/tmp.KrMG67MsYpscratch/merged4: not mounted. 2023-07-06T00:52:24.654 INFO:teuthology.orchestra.run.smithi046.stdout: +mount: /tmp/tmp.KrMG67MsYpscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-07-06T00:52:24.654 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged2/etc/access.conf': No such file or directory 2023-07-06T00:52:24.655 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged2/etc/access.conf': No such file or directory 2023-07-06T00:52:24.655 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged2/etc/access.conf': No such file or directory 2023-07-06T00:52:24.655 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged2/etc/access.conf': No such file or directory 2023-07-06T00:52:24.655 INFO:teuthology.orchestra.run.smithi046.stdout: +umount: /tmp/tmp.KrMG67MsYpscratch/merged2: not mounted. 2023-07-06T00:52:24.655 INFO:teuthology.orchestra.run.smithi046.stdout: +mount: /tmp/tmp.KrMG67MsYpscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-07-06T00:52:24.655 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged5/etc/access.conf': No such file or directory 2023-07-06T00:52:24.655 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged5/etc/access.conf': No such file or directory 2023-07-06T00:52:24.655 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged5/etc/access.conf': No such file or directory 2023-07-06T00:52:24.656 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged5/etc/access.conf': No such file or directory 2023-07-06T00:52:24.656 INFO:teuthology.orchestra.run.smithi046.stdout: +umount: /tmp/tmp.KrMG67MsYpscratch/merged5: not mounted. 2023-07-06T00:52:24.656 INFO:teuthology.orchestra.run.smithi046.stdout: +mount: /tmp/tmp.KrMG67MsYpscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-07-06T00:52:24.656 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged1/etc/access.conf': No such file or directory 2023-07-06T00:52:24.656 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged1/etc/access.conf': No such file or directory 2023-07-06T00:52:24.656 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged1/etc/access.conf': No such file or directory 2023-07-06T00:52:24.656 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged1/etc/access.conf': No such file or directory 2023-07-06T00:52:24.657 INFO:teuthology.orchestra.run.smithi046.stdout: +umount: /tmp/tmp.KrMG67MsYpscratch/merged1: not mounted. 2023-07-06T00:52:24.657 INFO:teuthology.orchestra.run.smithi046.stdout: +mount: /tmp/tmp.KrMG67MsYpscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-07-06T00:52:24.657 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged0/etc/access.conf': No such file or directory 2023-07-06T00:52:24.657 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged0/etc/access.conf': No such file or directory 2023-07-06T00:52:24.657 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged0/etc/access.conf': No such file or directory 2023-07-06T00:52:24.657 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged0/etc/access.conf': No such file or directory 2023-07-06T00:52:24.657 INFO:teuthology.orchestra.run.smithi046.stdout: +umount: /tmp/tmp.KrMG67MsYpscratch/merged0: not mounted. 2023-07-06T00:52:24.657 INFO:teuthology.orchestra.run.smithi046.stdout: +mount: /tmp/tmp.KrMG67MsYpscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-07-06T00:52:24.658 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged3/etc/access.conf': No such file or directory 2023-07-06T00:52:24.658 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged3/etc/access.conf': No such file or directory 2023-07-06T00:52:24.658 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged3/etc/access.conf': No such file or directory 2023-07-06T00:52:24.658 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged3/etc/access.conf': No such file or directory 2023-07-06T00:52:24.658 INFO:teuthology.orchestra.run.smithi046.stdout: +umount: /tmp/tmp.KrMG67MsYpscratch/merged3: not mounted. 2023-07-06T00:52:24.658 INFO:teuthology.orchestra.run.smithi046.stdout: +mount: /tmp/tmp.KrMG67MsYpscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-07-06T00:52:24.658 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged5/etc/access.conf': No such file or directory 2023-07-06T00:52:24.658 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged5/etc/access.conf': No such file or directory 2023-07-06T00:52:24.659 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged5/etc/access.conf': No such file or directory 2023-07-06T00:52:24.659 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged5/etc/access.conf': No such file or directory 2023-07-06T00:52:24.659 INFO:teuthology.orchestra.run.smithi046.stdout: +mount: /tmp/tmp.KrMG67MsYpscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-07-06T00:52:24.659 INFO:teuthology.orchestra.run.smithi046.stdout: +umount: /tmp/tmp.KrMG67MsYpscratch/merged5: not mounted. 2023-07-06T00:52:24.659 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged4/etc/access.conf': No such file or directory 2023-07-06T00:52:24.659 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged4/etc/access.conf': No such file or directory 2023-07-06T00:52:24.659 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged4/etc/access.conf': No such file or directory 2023-07-06T00:52:24.660 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged4/etc/access.conf': No such file or directory 2023-07-06T00:52:24.660 INFO:teuthology.orchestra.run.smithi046.stdout: +umount: /tmp/tmp.KrMG67MsYpscratch/merged4: not mounted. 2023-07-06T00:52:24.660 INFO:teuthology.orchestra.run.smithi046.stdout: +mount: /tmp/tmp.KrMG67MsYpscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-07-06T00:52:24.660 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged2/etc/access.conf': No such file or directory 2023-07-06T00:52:24.660 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged2/etc/access.conf': No such file or directory 2023-07-06T00:52:24.660 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged2/etc/access.conf': No such file or directory 2023-07-06T00:52:24.660 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged2/etc/access.conf': No such file or directory 2023-07-06T00:52:24.660 INFO:teuthology.orchestra.run.smithi046.stdout: +umount: /tmp/tmp.KrMG67MsYpscratch/merged2: not mounted. 2023-07-06T00:52:24.661 INFO:teuthology.orchestra.run.smithi046.stdout: +mount: /tmp/tmp.KrMG67MsYpscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-07-06T00:52:24.661 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged3/etc/access.conf': No such file or directory 2023-07-06T00:52:24.661 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged3/etc/access.conf': No such file or directory 2023-07-06T00:52:24.661 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged3/etc/access.conf': No such file or directory 2023-07-06T00:52:24.661 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged3/etc/access.conf': No such file or directory 2023-07-06T00:52:24.661 INFO:teuthology.orchestra.run.smithi046.stdout: +umount: /tmp/tmp.KrMG67MsYpscratch/merged3: not mounted. 2023-07-06T00:52:24.661 INFO:teuthology.orchestra.run.smithi046.stdout: +mount: /tmp/tmp.KrMG67MsYpscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-07-06T00:52:24.661 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged1/etc/access.conf': No such file or directory 2023-07-06T00:52:24.662 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged1/etc/access.conf': No such file or directory 2023-07-06T00:52:24.662 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged1/etc/access.conf': No such file or directory 2023-07-06T00:52:24.662 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged1/etc/access.conf': No such file or directory 2023-07-06T00:52:24.662 INFO:teuthology.orchestra.run.smithi046.stdout: +umount: /tmp/tmp.KrMG67MsYpscratch/merged1: not mounted. 2023-07-06T00:52:24.662 INFO:teuthology.orchestra.run.smithi046.stdout: +mount: /tmp/tmp.KrMG67MsYpscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-07-06T00:52:24.662 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged0/etc/access.conf': No such file or directory 2023-07-06T00:52:24.662 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged0/etc/access.conf': No such file or directory 2023-07-06T00:52:24.662 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged0/etc/access.conf': No such file or directory 2023-07-06T00:52:24.663 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged0/etc/access.conf': No such file or directory 2023-07-06T00:52:24.663 INFO:teuthology.orchestra.run.smithi046.stdout: +umount: /tmp/tmp.KrMG67MsYpscratch/merged0: not mounted. 2023-07-06T00:52:24.663 INFO:teuthology.orchestra.run.smithi046.stdout: +mount: /tmp/tmp.KrMG67MsYpscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-07-06T00:52:24.663 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged4/etc/access.conf': No such file or directory 2023-07-06T00:52:24.663 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged4/etc/access.conf': No such file or directory 2023-07-06T00:52:24.663 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged4/etc/access.conf': No such file or directory 2023-07-06T00:52:24.663 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged4/etc/access.conf': No such file or directory 2023-07-06T00:52:24.663 INFO:teuthology.orchestra.run.smithi046.stdout: +umount: /tmp/tmp.KrMG67MsYpscratch/merged4: not mounted. 2023-07-06T00:52:24.664 INFO:teuthology.orchestra.run.smithi046.stdout: +mount: /tmp/tmp.KrMG67MsYpscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-07-06T00:52:24.664 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged0/etc/access.conf': No such file or directory 2023-07-06T00:52:24.664 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged0/etc/access.conf': No such file or directory 2023-07-06T00:52:24.664 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged0/etc/access.conf': No such file or directory 2023-07-06T00:52:24.664 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged0/etc/access.conf': No such file or directory 2023-07-06T00:52:24.664 INFO:teuthology.orchestra.run.smithi046.stdout: +umount: /tmp/tmp.KrMG67MsYpscratch/merged0: not mounted. 2023-07-06T00:52:24.664 INFO:teuthology.orchestra.run.smithi046.stdout: +mount: /tmp/tmp.KrMG67MsYpscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-07-06T00:52:24.664 INFO:teuthology.orchestra.run.smithi046.stdout: +mount: /tmp/tmp.KrMG67MsYpscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-07-06T00:52:24.665 INFO:teuthology.orchestra.run.smithi046.stdout: +mount: /tmp/tmp.KrMG67MsYpscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-07-06T00:52:24.665 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged5/etc/access.conf': No such file or directory 2023-07-06T00:52:24.665 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged2/etc/access.conf': No such file or directory 2023-07-06T00:52:24.665 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged5/etc/access.conf': No such file or directory 2023-07-06T00:52:24.665 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged2/etc/access.conf': No such file or directory 2023-07-06T00:52:24.665 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged1/etc/access.conf': No such file or directory 2023-07-06T00:52:24.665 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged5/etc/access.conf': No such file or directory 2023-07-06T00:52:24.665 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged1/etc/access.conf': No such file or directory 2023-07-06T00:52:24.666 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged5/etc/access.conf': No such file or directory 2023-07-06T00:52:24.666 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged1/etc/access.conf': No such file or directorymv: 2023-07-06T00:52:24.666 INFO:teuthology.orchestra.run.smithi046.stdout: +cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged2/etc/access.conf': No such file or directory 2023-07-06T00:52:24.666 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged1/etc/access.conf': No such file or directory 2023-07-06T00:52:24.666 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged2/etc/access.conf': No such file or directory 2023-07-06T00:52:24.666 INFO:teuthology.orchestra.run.smithi046.stdout: +umount: /tmp/tmp.KrMG67MsYpscratch/merged5: not mounted. 2023-07-06T00:52:24.666 INFO:teuthology.orchestra.run.smithi046.stdout: +umount: /tmp/tmp.KrMG67MsYpscratch/merged1: not mounted. 2023-07-06T00:52:24.666 INFO:teuthology.orchestra.run.smithi046.stdout: +mount: /tmp/tmp.KrMG67MsYpscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-07-06T00:52:24.667 INFO:teuthology.orchestra.run.smithi046.stdout: +umount: /tmp/tmp.KrMG67MsYpscratch/merged2: not mounted. 2023-07-06T00:52:24.667 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged3/etc/access.conf': No such file or directory 2023-07-06T00:52:24.667 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged3/etc/access.conf': No such file or directory 2023-07-06T00:52:24.667 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged3/etc/access.conf': No such file or directory 2023-07-06T00:52:24.667 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged3/etc/access.conf': No such file or directory 2023-07-06T00:52:24.667 INFO:teuthology.orchestra.run.smithi046.stdout: +umount: /tmp/tmp.KrMG67MsYpscratch/merged3: not mounted. 2023-07-06T00:52:24.667 INFO:teuthology.orchestra.run.smithi046.stdout: +mount: /tmp/tmp.KrMG67MsYpscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-07-06T00:52:24.667 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged5/etc/access.conf': No such file or directory 2023-07-06T00:52:24.668 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged5/etc/access.conf': No such file or directory 2023-07-06T00:52:24.668 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged5/etc/access.conf': No such file or directory 2023-07-06T00:52:24.668 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged5/etc/access.conf': No such file or directory 2023-07-06T00:52:24.668 INFO:teuthology.orchestra.run.smithi046.stdout: +umount: /tmp/tmp.KrMG67MsYpscratch/merged5: not mounted. 2023-07-06T00:52:24.668 INFO:teuthology.orchestra.run.smithi046.stdout: +mount: /tmp/tmp.KrMG67MsYpscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-07-06T00:52:24.668 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged2/etc/access.conf': No such file or directory 2023-07-06T00:52:24.668 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged2/etc/access.conf': No such file or directory 2023-07-06T00:52:24.669 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged2/etc/access.conf': No such file or directory 2023-07-06T00:52:24.669 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged2/etc/access.conf': No such file or directory 2023-07-06T00:52:24.669 INFO:teuthology.orchestra.run.smithi046.stdout: +umount: /tmp/tmp.KrMG67MsYpscratch/merged2: not mounted. 2023-07-06T00:52:24.669 INFO:teuthology.orchestra.run.smithi046.stdout: +mount: /tmp/tmp.KrMG67MsYpscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-07-06T00:52:24.669 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged1/etc/access.conf': No such file or directory 2023-07-06T00:52:24.669 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged1/etc/access.conf': No such file or directory 2023-07-06T00:52:24.669 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged1/etc/access.conf': No such file or directory 2023-07-06T00:52:24.669 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged1/etc/access.conf': No such file or directory 2023-07-06T00:52:24.670 INFO:teuthology.orchestra.run.smithi046.stdout: +umount: /tmp/tmp.KrMG67MsYpscratch/merged1: not mounted. 2023-07-06T00:52:24.670 INFO:teuthology.orchestra.run.smithi046.stdout: +mount: /tmp/tmp.KrMG67MsYpscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-07-06T00:52:24.670 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged0/etc/access.conf': No such file or directory 2023-07-06T00:52:24.670 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged0/etc/access.conf': No such file or directory 2023-07-06T00:52:24.670 INFO:teuthology.orchestra.run.smithi046.stdout: +mount: /tmp/tmp.KrMG67MsYpscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-07-06T00:52:24.670 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged0/etc/access.conf': No such file or directory 2023-07-06T00:52:24.670 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged0/etc/access.conf': No such file or directory 2023-07-06T00:52:24.670 INFO:teuthology.orchestra.run.smithi046.stdout: +umount: /tmp/tmp.KrMG67MsYpscratch/merged0: not mounted. 2023-07-06T00:52:24.671 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged4/etc/access.conf': No such file or directory 2023-07-06T00:52:24.671 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged4/etc/access.conf': No such file or directory 2023-07-06T00:52:24.671 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged4/etc/access.conf': No such file or directory 2023-07-06T00:52:24.671 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged4/etc/access.conf': No such file or directory 2023-07-06T00:52:24.671 INFO:teuthology.orchestra.run.smithi046.stdout: +umount: /tmp/tmp.KrMG67MsYpscratch/merged4: not mounted. 2023-07-06T00:52:24.671 INFO:teuthology.orchestra.run.smithi046.stdout: +mount: /tmp/tmp.KrMG67MsYpscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-07-06T00:52:24.671 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged3/etc/access.conf': No such file or directory 2023-07-06T00:52:24.671 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged3/etc/access.conf': No such file or directory 2023-07-06T00:52:24.672 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged3/etc/access.conf': No such file or directory 2023-07-06T00:52:24.672 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged3/etc/access.conf': No such file or directory 2023-07-06T00:52:24.672 INFO:teuthology.orchestra.run.smithi046.stdout: +umount: /tmp/tmp.KrMG67MsYpscratch/merged3: not mounted. 2023-07-06T00:52:24.672 INFO:teuthology.orchestra.run.smithi046.stdout: +mount: /tmp/tmp.KrMG67MsYpscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-07-06T00:52:24.672 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged2/etc/access.conf': No such file or directory 2023-07-06T00:52:24.672 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged2/etc/access.conf': No such file or directory 2023-07-06T00:52:24.672 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged2/etc/access.conf': No such file or directory 2023-07-06T00:52:24.672 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged2/etc/access.conf': No such file or directory 2023-07-06T00:52:24.673 INFO:teuthology.orchestra.run.smithi046.stdout: +umount: /tmp/tmp.KrMG67MsYpscratch/merged2: not mounted. 2023-07-06T00:52:24.673 INFO:teuthology.orchestra.run.smithi046.stdout: +mount: /tmp/tmp.KrMG67MsYpscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-07-06T00:52:24.673 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged5/etc/access.conf': No such file or directory 2023-07-06T00:52:24.673 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged5/etc/access.conf': No such file or directory 2023-07-06T00:52:24.673 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged5/etc/access.conf': No such file or directory 2023-07-06T00:52:24.673 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged5/etc/access.conf': No such file or directory 2023-07-06T00:52:24.673 INFO:teuthology.orchestra.run.smithi046.stdout: +umount: /tmp/tmp.KrMG67MsYpscratch/merged5: not mounted. 2023-07-06T00:52:24.673 INFO:teuthology.orchestra.run.smithi046.stdout: +mount: /tmp/tmp.KrMG67MsYpscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-07-06T00:52:24.674 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged1/etc/access.conf': No such file or directory 2023-07-06T00:52:24.674 INFO:teuthology.orchestra.run.smithi046.stdout: +mount: /tmp/tmp.KrMG67MsYpscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-07-06T00:52:24.674 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged3/etc/access.conf': No such file or directory 2023-07-06T00:52:24.674 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged1/etc/access.conf': No such file or directory 2023-07-06T00:52:24.674 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged3/etc/access.conf': No such file or directory 2023-07-06T00:52:24.674 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged1/etc/access.conf': No such file or directory 2023-07-06T00:52:24.674 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged1/etc/access.conf': No such file or directory 2023-07-06T00:52:24.674 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged3/etc/access.conf': No such file or directory 2023-07-06T00:52:24.675 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged3/etc/access.conf': No such file or directory 2023-07-06T00:52:24.675 INFO:teuthology.orchestra.run.smithi046.stdout: +umount: /tmp/tmp.KrMG67MsYpscratch/merged1: not mounted. 2023-07-06T00:52:24.675 INFO:teuthology.orchestra.run.smithi046.stdout: +umount: /tmp/tmp.KrMG67MsYpscratch/merged3: not mounted. 2023-07-06T00:52:24.675 INFO:teuthology.orchestra.run.smithi046.stdout: +mount: /tmp/tmp.KrMG67MsYpscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-07-06T00:52:24.675 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged4/etc/access.conf': No such file or directory 2023-07-06T00:52:24.675 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged4/etc/access.conf': No such file or directory 2023-07-06T00:52:24.675 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged4/etc/access.conf': No such file or directory 2023-07-06T00:52:24.675 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged4/etc/access.conf': No such file or directory 2023-07-06T00:52:24.676 INFO:teuthology.orchestra.run.smithi046.stdout: +umount: /tmp/tmp.KrMG67MsYpscratch/merged4: not mounted. 2023-07-06T00:52:24.676 INFO:teuthology.orchestra.run.smithi046.stdout: +mount: /tmp/tmp.KrMG67MsYpscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-07-06T00:52:24.676 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged0/etc/access.conf': No such file or directory 2023-07-06T00:52:24.676 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged0/etc/access.conf': No such file or directory 2023-07-06T00:52:24.676 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged0/etc/access.conf': No such file or directory 2023-07-06T00:52:24.676 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged0/etc/access.conf': No such file or directory 2023-07-06T00:52:24.676 INFO:teuthology.orchestra.run.smithi046.stdout: +umount: /tmp/tmp.KrMG67MsYpscratch/merged0: not mounted. 2023-07-06T00:52:24.677 INFO:teuthology.orchestra.run.smithi046.stdout: +mount: /tmp/tmp.KrMG67MsYpscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-07-06T00:52:24.677 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged4/etc/access.conf': No such file or directory 2023-07-06T00:52:24.677 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged4/etc/access.conf': No such file or directory 2023-07-06T00:52:24.677 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged4/etc/access.conf': No such file or directory 2023-07-06T00:52:24.677 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged4/etc/access.conf': No such file or directory 2023-07-06T00:52:24.677 INFO:teuthology.orchestra.run.smithi046.stdout: +umount: /tmp/tmp.KrMG67MsYpscratch/merged4: not mounted. 2023-07-06T00:52:24.677 INFO:teuthology.orchestra.run.smithi046.stdout: +mount: /tmp/tmp.KrMG67MsYpscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-07-06T00:52:24.677 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged2/etc/access.conf': No such file or directory 2023-07-06T00:52:24.678 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged2/etc/access.conf': No such file or directory 2023-07-06T00:52:24.678 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged2/etc/access.conf': No such file or directory 2023-07-06T00:52:24.678 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged2/etc/access.conf': No such file or directory 2023-07-06T00:52:24.678 INFO:teuthology.orchestra.run.smithi046.stdout: +umount: /tmp/tmp.KrMG67MsYpscratch/merged2: not mounted. 2023-07-06T00:52:24.678 INFO:teuthology.orchestra.run.smithi046.stdout: +mount: /tmp/tmp.KrMG67MsYpscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-07-06T00:52:24.678 INFO:teuthology.orchestra.run.smithi046.stdout: +mount: /tmp/tmp.KrMG67MsYpscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-07-06T00:52:24.678 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged5/etc/access.conf': No such file or directory 2023-07-06T00:52:24.678 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged3/etc/access.conf': No such file or directory 2023-07-06T00:52:24.679 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged5/etc/access.conf': No such file or directory 2023-07-06T00:52:24.679 INFO:teuthology.orchestra.run.smithi046.stdout: +mount: /tmp/tmp.KrMG67MsYpscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-07-06T00:52:24.679 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged3/etc/access.conf': No such file or directory 2023-07-06T00:52:24.679 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged5/etc/access.conf': No such file or directory 2023-07-06T00:52:24.679 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged3/etc/access.conf': No such file or directory 2023-07-06T00:52:24.679 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged5/etc/access.conf': No such file or directory 2023-07-06T00:52:24.679 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged1/etc/access.conf': No such file or directory 2023-07-06T00:52:24.680 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged3/etc/access.conf': No such file or directory 2023-07-06T00:52:24.680 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged1/etc/access.conf': No such file or directory 2023-07-06T00:52:24.680 INFO:teuthology.orchestra.run.smithi046.stdout: +umount: /tmp/tmp.KrMG67MsYpscratch/merged5: not mounted. 2023-07-06T00:52:24.680 INFO:teuthology.orchestra.run.smithi046.stdout: +umount: /tmp/tmp.KrMG67MsYpscratch/merged3: not mounted. 2023-07-06T00:52:24.680 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged1/etc/access.conf': No such file or directory 2023-07-06T00:52:24.680 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged1/etc/access.conf': No such file or directory 2023-07-06T00:52:24.680 INFO:teuthology.orchestra.run.smithi046.stdout: +umount: /tmp/tmp.KrMG67MsYpscratch/merged1: not mounted. 2023-07-06T00:52:24.680 INFO:teuthology.orchestra.run.smithi046.stdout: +mount: /tmp/tmp.KrMG67MsYpscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-07-06T00:52:24.681 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged0/etc/access.conf': No such file or directory 2023-07-06T00:52:24.681 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged0/etc/access.conf': No such file or directory 2023-07-06T00:52:24.681 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged0/etc/access.conf': No such file or directory 2023-07-06T00:52:24.681 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged0/etc/access.conf': No such file or directory 2023-07-06T00:52:24.681 INFO:teuthology.orchestra.run.smithi046.stdout: +mount: /tmp/tmp.KrMG67MsYpscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-07-06T00:52:24.681 INFO:teuthology.orchestra.run.smithi046.stdout: +umount: /tmp/tmp.KrMG67MsYpscratch/merged0: not mounted. 2023-07-06T00:52:24.681 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged4/etc/access.conf': No such file or directory 2023-07-06T00:52:24.681 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged4/etc/access.conf': No such file or directory 2023-07-06T00:52:24.682 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged4/etc/access.conf': No such file or directory 2023-07-06T00:52:24.682 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged4/etc/access.conf': No such file or directory 2023-07-06T00:52:24.682 INFO:teuthology.orchestra.run.smithi046.stdout: +umount: /tmp/tmp.KrMG67MsYpscratch/merged4: not mounted. 2023-07-06T00:52:24.682 INFO:teuthology.orchestra.run.smithi046.stdout: +mount: /tmp/tmp.KrMG67MsYpscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-07-06T00:52:24.682 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged2/etc/access.conf': No such file or directory 2023-07-06T00:52:24.682 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged2/etc/access.conf': No such file or directory 2023-07-06T00:52:24.682 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged2/etc/access.conf': No such file or directory 2023-07-06T00:52:24.682 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged2/etc/access.conf': No such file or directory 2023-07-06T00:52:24.683 INFO:teuthology.orchestra.run.smithi046.stdout: +umount: /tmp/tmp.KrMG67MsYpscratch/merged2: not mounted. 2023-07-06T00:52:24.683 INFO:teuthology.orchestra.run.smithi046.stdout: +mount: /tmp/tmp.KrMG67MsYpscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-07-06T00:52:24.683 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged3/etc/access.conf': No such file or directory 2023-07-06T00:52:24.683 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged3/etc/access.conf': No such file or directory 2023-07-06T00:52:24.683 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged3/etc/access.conf': No such file or directory 2023-07-06T00:52:24.683 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged3/etc/access.conf': No such file or directory 2023-07-06T00:52:24.683 INFO:teuthology.orchestra.run.smithi046.stdout: +umount: /tmp/tmp.KrMG67MsYpscratch/merged3: not mounted. 2023-07-06T00:52:24.683 INFO:teuthology.orchestra.run.smithi046.stdout: +mount: /tmp/tmp.KrMG67MsYpscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-07-06T00:52:24.684 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged0/etc/access.conf': No such file or directory 2023-07-06T00:52:24.684 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged0/etc/access.conf': No such file or directory 2023-07-06T00:52:24.684 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged0/etc/access.conf': No such file or directory 2023-07-06T00:52:24.684 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged0/etc/access.conf': No such file or directory 2023-07-06T00:52:24.684 INFO:teuthology.orchestra.run.smithi046.stdout: +umount: /tmp/tmp.KrMG67MsYpscratch/merged0: not mounted. 2023-07-06T00:52:24.684 INFO:teuthology.orchestra.run.smithi046.stdout: +mount: /tmp/tmp.KrMG67MsYpscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-07-06T00:52:24.684 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged4/etc/access.conf': No such file or directory 2023-07-06T00:52:24.685 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged4/etc/access.conf': No such file or directory 2023-07-06T00:52:24.685 INFO:teuthology.orchestra.run.smithi046.stdout: +mount: /tmp/tmp.KrMG67MsYpscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-07-06T00:52:24.685 INFO:teuthology.orchestra.run.smithi046.stdout: +mount: /tmp/tmp.KrMG67MsYpscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-07-06T00:52:24.685 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged4/etc/access.conf': No such file or directory 2023-07-06T00:52:24.685 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged4/etc/access.conf': No such file or directory 2023-07-06T00:52:24.685 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged1/etc/access.conf': No such file or directory 2023-07-06T00:52:24.685 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged1/etc/access.conf': No such file or directory 2023-07-06T00:52:24.685 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged5/etc/access.conf': No such file or directory 2023-07-06T00:52:24.686 INFO:teuthology.orchestra.run.smithi046.stdout: +umount: /tmp/tmp.KrMG67MsYpscratch/merged4: not mounted. 2023-07-06T00:52:24.686 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged1/etc/access.conf': No such file or directory 2023-07-06T00:52:24.686 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged1/etc/access.conf': No such file or directory 2023-07-06T00:52:24.686 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged5/etc/access.conf': No such file or directory 2023-07-06T00:52:24.686 INFO:teuthology.orchestra.run.smithi046.stdout: +umount: /tmp/tmp.KrMG67MsYpscratch/merged1: not mounted. 2023-07-06T00:52:24.686 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged5/etc/access.conf': No such file or directory 2023-07-06T00:52:24.686 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged5/etc/access.conf': No such file or directory 2023-07-06T00:52:24.686 INFO:teuthology.orchestra.run.smithi046.stdout: +umount: /tmp/tmp.KrMG67MsYpscratch/merged5: not mounted. 2023-07-06T00:52:24.687 INFO:teuthology.orchestra.run.smithi046.stdout: +mount: /tmp/tmp.KrMG67MsYpscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-07-06T00:52:24.687 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged2/etc/access.conf': No such file or directory 2023-07-06T00:52:24.687 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged2/etc/access.conf': No such file or directory 2023-07-06T00:52:24.687 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged2/etc/access.conf': No such file or directory 2023-07-06T00:52:24.687 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged2/etc/access.conf': No such file or directory 2023-07-06T00:52:24.687 INFO:teuthology.orchestra.run.smithi046.stdout: +umount: /tmp/tmp.KrMG67MsYpscratch/merged2: not mounted. 2023-07-06T00:52:24.688 INFO:teuthology.orchestra.run.smithi046.stdout: +mount: /tmp/tmp.KrMG67MsYpscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-07-06T00:52:24.688 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged4/etc/access.conf': No such file or directory 2023-07-06T00:52:24.688 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged4/etc/access.conf': No such file or directory 2023-07-06T00:52:24.688 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged4/etc/access.conf': No such file or directory 2023-07-06T00:52:24.688 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged4/etc/access.conf': No such file or directory 2023-07-06T00:52:24.688 INFO:teuthology.orchestra.run.smithi046.stdout: +umount: /tmp/tmp.KrMG67MsYpscratch/merged4: not mounted. 2023-07-06T00:52:24.688 INFO:teuthology.orchestra.run.smithi046.stdout: +mount: /tmp/tmp.KrMG67MsYpscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-07-06T00:52:24.689 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged0/etc/access.conf': No such file or directory 2023-07-06T00:52:24.689 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged0/etc/access.conf': No such file or directory 2023-07-06T00:52:24.689 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged0/etc/access.conf': No such file or directory 2023-07-06T00:52:24.689 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged0/etc/access.conf': No such file or directory 2023-07-06T00:52:24.689 INFO:teuthology.orchestra.run.smithi046.stdout: +umount: /tmp/tmp.KrMG67MsYpscratch/merged0: not mounted. 2023-07-06T00:52:24.689 INFO:teuthology.orchestra.run.smithi046.stdout: +mount: /tmp/tmp.KrMG67MsYpscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-07-06T00:52:24.689 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged5/etc/access.conf': No such file or directory 2023-07-06T00:52:24.689 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged5/etc/access.conf': No such file or directory 2023-07-06T00:52:24.690 INFO:teuthology.orchestra.run.smithi046.stdout: +mount: /tmp/tmp.KrMG67MsYpscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-07-06T00:52:24.690 INFO:teuthology.orchestra.run.smithi046.stdout: +mount: /tmp/tmp.KrMG67MsYpscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-07-06T00:52:24.690 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged5/etc/access.conf': No such file or directory 2023-07-06T00:52:24.690 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged3/etc/access.conf': No such file or directory 2023-07-06T00:52:24.690 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged5/etc/access.conf': No such file or directory 2023-07-06T00:52:24.690 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged3/etc/access.conf': No such file or directory 2023-07-06T00:52:24.690 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged1/etc/access.conf': No such file or directory 2023-07-06T00:52:24.690 INFO:teuthology.orchestra.run.smithi046.stdout: +umount: /tmp/tmp.KrMG67MsYpscratch/merged5: not mounted. 2023-07-06T00:52:24.691 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged1/etc/access.conf': No such file or directory 2023-07-06T00:52:24.691 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged3/etc/access.conf': No such file or directory 2023-07-06T00:52:24.691 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged1/etc/access.conf': No such file or directory 2023-07-06T00:52:24.691 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged3/etc/access.conf': No such file or directory 2023-07-06T00:52:24.691 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged1/etc/access.conf': No such file or directory 2023-07-06T00:52:24.691 INFO:teuthology.orchestra.run.smithi046.stdout: +umount: /tmp/tmp.KrMG67MsYpscratch/merged3: not mounted. 2023-07-06T00:52:24.691 INFO:teuthology.orchestra.run.smithi046.stdout: +umount: /tmp/tmp.KrMG67MsYpscratch/merged1: not mounted. 2023-07-06T00:52:24.691 INFO:teuthology.orchestra.run.smithi046.stdout: +mount: /tmp/tmp.KrMG67MsYpscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-07-06T00:52:24.692 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged3/etc/access.conf': No such file or directory 2023-07-06T00:52:24.692 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged3/etc/access.conf': No such file or directory 2023-07-06T00:52:24.692 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged3/etc/access.conf': No such file or directory 2023-07-06T00:52:24.692 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged3/etc/access.conf': No such file or directory 2023-07-06T00:52:24.692 INFO:teuthology.orchestra.run.smithi046.stdout: +umount: /tmp/tmp.KrMG67MsYpscratch/merged3: not mounted. 2023-07-06T00:52:24.692 INFO:teuthology.orchestra.run.smithi046.stdout: +mount: mount: mount: /tmp/tmp.KrMG67MsYpscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error./tmp/tmp.KrMG67MsYpscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error./tmp/tmp.KrMG67MsYpscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-07-06T00:52:24.692 INFO:teuthology.orchestra.run.smithi046.stdout: + 2023-07-06T00:52:24.692 INFO:teuthology.orchestra.run.smithi046.stdout: + 2023-07-06T00:52:24.693 INFO:teuthology.orchestra.run.smithi046.stdout: +mount: /tmp/tmp.KrMG67MsYpscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-07-06T00:52:24.693 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged2/etc/access.conf'cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged1/etc/access.conf': No such file or directory: No such file or directory 2023-07-06T00:52:24.693 INFO:teuthology.orchestra.run.smithi046.stdout: + 2023-07-06T00:52:24.693 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged4/etc/access.conf': No such file or directory 2023-07-06T00:52:24.693 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged2/etc/access.conf': No such file or directory 2023-07-06T00:52:24.693 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged4/etc/access.conf': No such file or directory 2023-07-06T00:52:24.693 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged1/etc/access.conf': No such file or directory 2023-07-06T00:52:24.694 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged2/etc/access.conf': No such file or directory 2023-07-06T00:52:24.694 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged4/etc/access.conf': No such file or directory 2023-07-06T00:52:24.694 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged1/etc/access.conf': No such file or directory 2023-07-06T00:52:24.694 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged2/etc/access.conf': No such file or directory 2023-07-06T00:52:24.694 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged4/etc/access.conf': No such file or directory 2023-07-06T00:52:24.694 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged0/etc/access.conf': No such file or directory 2023-07-06T00:52:24.694 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged1/etc/access.conf': No such file or directory 2023-07-06T00:52:24.694 INFO:teuthology.orchestra.run.smithi046.stdout: +umount: /tmp/tmp.KrMG67MsYpscratch/merged2: not mounted. 2023-07-06T00:52:24.695 INFO:teuthology.orchestra.run.smithi046.stdout: +umount: /tmp/tmp.KrMG67MsYpscratch/merged4: not mounted. 2023-07-06T00:52:24.695 INFO:teuthology.orchestra.run.smithi046.stdout: +umount: /tmp/tmp.KrMG67MsYpscratch/merged1: not mounted. 2023-07-06T00:52:24.695 INFO:teuthology.orchestra.run.smithi046.stdout: +mount: /tmp/tmp.KrMG67MsYpscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-07-06T00:52:24.695 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged0/etc/access.conf': No such file or directory 2023-07-06T00:52:24.695 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged5/etc/access.conf': No such file or directory 2023-07-06T00:52:24.695 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged0/etc/access.conf': No such file or directory 2023-07-06T00:52:24.695 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged5/etc/access.conf': No such file or directory 2023-07-06T00:52:24.695 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged0/etc/access.conf': No such file or directory 2023-07-06T00:52:24.696 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged5/etc/access.conf': No such file or directory 2023-07-06T00:52:24.696 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged5/etc/access.conf': No such file or directory 2023-07-06T00:52:24.696 INFO:teuthology.orchestra.run.smithi046.stdout: +umount: /tmp/tmp.KrMG67MsYpscratch/merged0: not mounted. 2023-07-06T00:52:24.696 INFO:teuthology.orchestra.run.smithi046.stdout: +umount: /tmp/tmp.KrMG67MsYpscratch/merged5: not mounted. 2023-07-06T00:52:24.696 INFO:teuthology.orchestra.run.smithi046.stdout: +mount: /tmp/tmp.KrMG67MsYpscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-07-06T00:52:24.696 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged3/etc/access.conf': No such file or directory 2023-07-06T00:52:24.696 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged3/etc/access.conf': No such file or directory 2023-07-06T00:52:24.696 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged3/etc/access.conf': No such file or directory 2023-07-06T00:52:24.697 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged3/etc/access.conf': No such file or directory 2023-07-06T00:52:24.697 INFO:teuthology.orchestra.run.smithi046.stdout: +umount: /tmp/tmp.KrMG67MsYpscratch/merged3: not mounted. 2023-07-06T00:52:24.697 INFO:teuthology.orchestra.run.smithi046.stdout: +mount: /tmp/tmp.KrMG67MsYpscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-07-06T00:52:24.697 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged4/etc/access.conf': No such file or directory 2023-07-06T00:52:24.697 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged4/etc/access.conf': No such file or directory 2023-07-06T00:52:24.697 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged4/etc/access.conf': No such file or directory 2023-07-06T00:52:24.697 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged4/etc/access.conf': No such file or directory 2023-07-06T00:52:24.697 INFO:teuthology.orchestra.run.smithi046.stdout: +mount: mount: /tmp/tmp.KrMG67MsYpscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-07-06T00:52:24.698 INFO:teuthology.orchestra.run.smithi046.stdout: +/tmp/tmp.KrMG67MsYpscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-07-06T00:52:24.698 INFO:teuthology.orchestra.run.smithi046.stdout: +umount: /tmp/tmp.KrMG67MsYpscratch/merged4: not mounted. 2023-07-06T00:52:24.698 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged1/etc/access.conf': No such file or directory 2023-07-06T00:52:24.698 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged0/etc/access.conf': No such file or directory 2023-07-06T00:52:24.698 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged1/etc/access.conf': No such file or directory 2023-07-06T00:52:24.698 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged0/etc/access.conf': No such file or directory 2023-07-06T00:52:24.698 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged1/etc/access.conf': No such file or directory 2023-07-06T00:52:24.699 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged0/etc/access.conf': No such file or directory 2023-07-06T00:52:24.699 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged1/etc/access.conf': No such file or directory 2023-07-06T00:52:24.699 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged0/etc/access.conf': No such file or directory 2023-07-06T00:52:24.699 INFO:teuthology.orchestra.run.smithi046.stdout: +umount: /tmp/tmp.KrMG67MsYpscratch/merged1: not mounted. 2023-07-06T00:52:24.699 INFO:teuthology.orchestra.run.smithi046.stdout: +umount: /tmp/tmp.KrMG67MsYpscratch/merged0: not mounted. 2023-07-06T00:52:24.699 INFO:teuthology.orchestra.run.smithi046.stdout: +mount: mount: /tmp/tmp.KrMG67MsYpscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error./tmp/tmp.KrMG67MsYpscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-07-06T00:52:24.699 INFO:teuthology.orchestra.run.smithi046.stdout: + 2023-07-06T00:52:24.699 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged2/etc/access.conf': No such file or directory 2023-07-06T00:52:24.700 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged5/etc/access.conf': No such file or directory 2023-07-06T00:52:24.700 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged2/etc/access.conf': No such file or directory 2023-07-06T00:52:24.700 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged5/etc/access.conf': No such file or directory 2023-07-06T00:52:24.700 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged2/etc/access.conf': No such file or directory 2023-07-06T00:52:24.700 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged5/etc/access.conf': No such file or directory 2023-07-06T00:52:24.700 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged2/etc/access.conf': No such file or directory 2023-07-06T00:52:24.700 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged5/etc/access.conf': No such file or directory 2023-07-06T00:52:24.700 INFO:teuthology.orchestra.run.smithi046.stdout: +umount: /tmp/tmp.KrMG67MsYpscratch/merged5: not mounted. 2023-07-06T00:52:24.701 INFO:teuthology.orchestra.run.smithi046.stdout: +umount: /tmp/tmp.KrMG67MsYpscratch/merged2: not mounted. 2023-07-06T00:52:24.701 INFO:teuthology.orchestra.run.smithi046.stdout: +mount: /tmp/tmp.KrMG67MsYpscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-07-06T00:52:24.701 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged3/etc/access.conf': No such file or directory 2023-07-06T00:52:24.701 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged3/etc/access.conf': No such file or directory 2023-07-06T00:52:24.701 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged3/etc/access.conf': No such file or directory 2023-07-06T00:52:24.701 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged3/etc/access.conf': No such file or directory 2023-07-06T00:52:24.701 INFO:teuthology.orchestra.run.smithi046.stdout: +umount: /tmp/tmp.KrMG67MsYpscratch/merged3: not mounted. 2023-07-06T00:52:24.701 INFO:teuthology.orchestra.run.smithi046.stdout: +mount: /tmp/tmp.KrMG67MsYpscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-07-06T00:52:24.702 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged4/etc/access.conf': No such file or directory 2023-07-06T00:52:24.702 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged4/etc/access.conf': No such file or directory 2023-07-06T00:52:24.702 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged4/etc/access.conf': No such file or directory 2023-07-06T00:52:24.702 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged4/etc/access.conf': No such file or directory 2023-07-06T00:52:24.702 INFO:teuthology.orchestra.run.smithi046.stdout: +umount: /tmp/tmp.KrMG67MsYpscratch/merged4: not mounted. 2023-07-06T00:52:24.702 INFO:teuthology.orchestra.run.smithi046.stdout: +mount: /tmp/tmp.KrMG67MsYpscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-07-06T00:52:24.702 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged0/etc/access.conf': No such file or directory 2023-07-06T00:52:24.702 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged0/etc/access.conf': No such file or directory 2023-07-06T00:52:24.703 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged0/etc/access.conf': No such file or directory 2023-07-06T00:52:24.703 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged0/etc/access.conf': No such file or directory 2023-07-06T00:52:24.703 INFO:teuthology.orchestra.run.smithi046.stdout: +umount: /tmp/tmp.KrMG67MsYpscratch/merged0: not mounted. 2023-07-06T00:52:24.703 INFO:teuthology.orchestra.run.smithi046.stdout: +mount: /tmp/tmp.KrMG67MsYpscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-07-06T00:52:24.703 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged1/etc/access.conf': No such file or directory 2023-07-06T00:52:24.703 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged1/etc/access.conf': No such file or directory 2023-07-06T00:52:24.703 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged1/etc/access.conf': No such file or directory 2023-07-06T00:52:24.703 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged1/etc/access.conf': No such file or directory 2023-07-06T00:52:24.704 INFO:teuthology.orchestra.run.smithi046.stdout: +umount: /tmp/tmp.KrMG67MsYpscratch/merged1: not mounted. 2023-07-06T00:52:24.704 INFO:teuthology.orchestra.run.smithi046.stdout: +mount: /tmp/tmp.KrMG67MsYpscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-07-06T00:52:24.704 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged5/etc/access.conf': No such file or directory 2023-07-06T00:52:24.704 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged5/etc/access.conf': No such file or directory 2023-07-06T00:52:24.704 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged5/etc/access.conf': No such file or directory 2023-07-06T00:52:24.704 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged5/etc/access.conf': No such file or directory 2023-07-06T00:52:24.704 INFO:teuthology.orchestra.run.smithi046.stdout: +mount: /tmp/tmp.KrMG67MsYpscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-07-06T00:52:24.705 INFO:teuthology.orchestra.run.smithi046.stdout: +umount: /tmp/tmp.KrMG67MsYpscratch/merged5: not mounted. 2023-07-06T00:52:24.705 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged2/etc/access.conf': No such file or directory 2023-07-06T00:52:24.705 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged2/etc/access.conf': No such file or directory 2023-07-06T00:52:24.705 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged2/etc/access.conf': No such file or directory 2023-07-06T00:52:24.705 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged2/etc/access.conf': No such file or directory 2023-07-06T00:52:24.705 INFO:teuthology.orchestra.run.smithi046.stdout: +umount: /tmp/tmp.KrMG67MsYpscratch/merged2: not mounted. 2023-07-06T00:52:24.705 INFO:teuthology.orchestra.run.smithi046.stdout: +mount: /tmp/tmp.KrMG67MsYpscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-07-06T00:52:24.705 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged3/etc/access.conf': No such file or directory 2023-07-06T00:52:24.706 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged3/etc/access.conf': No such file or directory 2023-07-06T00:52:24.706 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged3/etc/access.conf': No such file or directory 2023-07-06T00:52:24.706 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged3/etc/access.conf': No such file or directory 2023-07-06T00:52:24.706 INFO:teuthology.orchestra.run.smithi046.stdout: +umount: /tmp/tmp.KrMG67MsYpscratch/merged3: not mounted. 2023-07-06T00:52:24.706 INFO:teuthology.orchestra.run.smithi046.stdout: +mount: /tmp/tmp.KrMG67MsYpscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-07-06T00:52:24.706 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged4/etc/access.conf': No such file or directory 2023-07-06T00:52:24.706 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged4/etc/access.conf': No such file or directory 2023-07-06T00:52:24.706 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged4/etc/access.conf': No such file or directory 2023-07-06T00:52:24.707 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged4/etc/access.conf': No such file or directory 2023-07-06T00:52:24.707 INFO:teuthology.orchestra.run.smithi046.stdout: +umount: /tmp/tmp.KrMG67MsYpscratch/merged4: not mounted. 2023-07-06T00:52:24.707 INFO:teuthology.orchestra.run.smithi046.stdout: +mount: /tmp/tmp.KrMG67MsYpscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-07-06T00:52:24.707 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged0/etc/access.conf': No such file or directory 2023-07-06T00:52:24.707 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged0/etc/access.conf': No such file or directory 2023-07-06T00:52:24.707 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged0/etc/access.conf': No such file or directory 2023-07-06T00:52:24.707 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged0/etc/access.conf': No such file or directory 2023-07-06T00:52:24.707 INFO:teuthology.orchestra.run.smithi046.stdout: +umount: /tmp/tmp.KrMG67MsYpscratch/merged0: not mounted. 2023-07-06T00:52:24.708 INFO:teuthology.orchestra.run.smithi046.stdout: +mount: /tmp/tmp.KrMG67MsYpscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-07-06T00:52:24.708 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged5/etc/access.conf': No such file or directory 2023-07-06T00:52:24.708 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged5/etc/access.conf': No such file or directory 2023-07-06T00:52:24.708 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged5/etc/access.conf': No such file or directory 2023-07-06T00:52:24.708 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged5/etc/access.conf': No such file or directory 2023-07-06T00:52:24.708 INFO:teuthology.orchestra.run.smithi046.stdout: +umount: /tmp/tmp.KrMG67MsYpscratch/merged5: not mounted. 2023-07-06T00:52:24.708 INFO:teuthology.orchestra.run.smithi046.stdout: +mount: /tmp/tmp.KrMG67MsYpscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-07-06T00:52:24.709 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged3/etc/access.conf': No such file or directory 2023-07-06T00:52:24.709 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged3/etc/access.conf': No such file or directory 2023-07-06T00:52:24.709 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged3/etc/access.conf': No such file or directory 2023-07-06T00:52:24.709 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged3/etc/access.conf': No such file or directory 2023-07-06T00:52:24.709 INFO:teuthology.orchestra.run.smithi046.stdout: +mount: mount: /tmp/tmp.KrMG67MsYpscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-07-06T00:52:24.709 INFO:teuthology.orchestra.run.smithi046.stdout: +/tmp/tmp.KrMG67MsYpscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-07-06T00:52:24.709 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged2/etc/access.conf': No such file or directory 2023-07-06T00:52:24.709 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged1/etc/access.conf': No such file or directory 2023-07-06T00:52:24.710 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged1/etc/access.conf': No such file or directory 2023-07-06T00:52:24.710 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged2/etc/access.conf': No such file or directory 2023-07-06T00:52:24.710 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: umount: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged1/etc/access.conf'/tmp/tmp.KrMG67MsYpscratch/merged3: not mounted.: No such file or directory 2023-07-06T00:52:24.710 INFO:teuthology.orchestra.run.smithi046.stdout: + 2023-07-06T00:52:24.710 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged2/etc/access.conf': No such file or directory 2023-07-06T00:52:24.710 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged1/etc/access.conf': No such file or directory 2023-07-06T00:52:24.710 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged2/etc/access.conf': No such file or directory 2023-07-06T00:52:24.710 INFO:teuthology.orchestra.run.smithi046.stdout: +umount: /tmp/tmp.KrMG67MsYpscratch/merged2: not mounted. 2023-07-06T00:52:24.711 INFO:teuthology.orchestra.run.smithi046.stdout: +umount: /tmp/tmp.KrMG67MsYpscratch/merged1: not mounted. 2023-07-06T00:52:24.711 INFO:teuthology.orchestra.run.smithi046.stdout: +mount: /tmp/tmp.KrMG67MsYpscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-07-06T00:52:24.711 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged0/etc/access.conf': No such file or directory 2023-07-06T00:52:24.711 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged0/etc/access.conf': No such file or directory 2023-07-06T00:52:24.711 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged0/etc/access.conf': No such file or directory 2023-07-06T00:52:24.711 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged0/etc/access.conf': No such file or directory 2023-07-06T00:52:24.711 INFO:teuthology.orchestra.run.smithi046.stdout: +umount: /tmp/tmp.KrMG67MsYpscratch/merged0: not mounted. 2023-07-06T00:52:24.711 INFO:teuthology.orchestra.run.smithi046.stdout: +mount: /tmp/tmp.KrMG67MsYpscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-07-06T00:52:24.712 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged4/etc/access.conf': No such file or directory 2023-07-06T00:52:24.712 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged4/etc/access.conf': No such file or directory 2023-07-06T00:52:24.712 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged4/etc/access.conf': No such file or directory 2023-07-06T00:52:24.712 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged4/etc/access.conf': No such file or directory 2023-07-06T00:52:24.712 INFO:teuthology.orchestra.run.smithi046.stdout: +umount: /tmp/tmp.KrMG67MsYpscratch/merged4: not mounted. 2023-07-06T00:52:24.712 INFO:teuthology.orchestra.run.smithi046.stdout: +mount: /tmp/tmp.KrMG67MsYpscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-07-06T00:52:24.712 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged5/etc/access.conf': No such file or directory 2023-07-06T00:52:24.713 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged5/etc/access.conf': No such file or directory 2023-07-06T00:52:24.713 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged5/etc/access.conf': No such file or directory 2023-07-06T00:52:24.713 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged5/etc/access.conf': No such file or directory 2023-07-06T00:52:24.713 INFO:teuthology.orchestra.run.smithi046.stdout: +umount: /tmp/tmp.KrMG67MsYpscratch/merged5: not mounted. 2023-07-06T00:52:24.713 INFO:teuthology.orchestra.run.smithi046.stdout: +mount: /tmp/tmp.KrMG67MsYpscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-07-06T00:52:24.713 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged2/etc/access.conf': No such file or directory 2023-07-06T00:52:24.713 INFO:teuthology.orchestra.run.smithi046.stdout: +mount: /tmp/tmp.KrMG67MsYpscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-07-06T00:52:24.713 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged3/etc/access.conf': No such file or directory 2023-07-06T00:52:24.714 INFO:teuthology.orchestra.run.smithi046.stdout: +cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged2/etc/access.conf': No such file or directory 2023-07-06T00:52:24.714 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged3/etc/access.conf': No such file or directory 2023-07-06T00:52:24.714 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged3/etc/access.conf': No such file or directory 2023-07-06T00:52:24.714 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged2/etc/access.conf': No such file or directory 2023-07-06T00:52:24.714 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged3/etc/access.conf': No such file or directory 2023-07-06T00:52:24.714 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged2/etc/access.conf': No such file or directory 2023-07-06T00:52:24.714 INFO:teuthology.orchestra.run.smithi046.stdout: +umount: /tmp/tmp.KrMG67MsYpscratch/merged2: not mounted. 2023-07-06T00:52:24.714 INFO:teuthology.orchestra.run.smithi046.stdout: +mount: /tmp/tmp.KrMG67MsYpscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-07-06T00:52:24.715 INFO:teuthology.orchestra.run.smithi046.stdout: +umount: /tmp/tmp.KrMG67MsYpscratch/merged3: not mounted. 2023-07-06T00:52:24.715 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged1/etc/access.conf': No such file or directory 2023-07-06T00:52:24.715 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged1/etc/access.conf': No such file or directory 2023-07-06T00:52:24.715 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged1/etc/access.conf': No such file or directory 2023-07-06T00:52:24.715 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged1/etc/access.conf': No such file or directory 2023-07-06T00:52:24.715 INFO:teuthology.orchestra.run.smithi046.stdout: +umount: /tmp/tmp.KrMG67MsYpscratch/merged1: not mounted. 2023-07-06T00:52:24.715 INFO:teuthology.orchestra.run.smithi046.stdout: +mount: /tmp/tmp.KrMG67MsYpscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-07-06T00:52:24.715 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged0/etc/access.conf': No such file or directory 2023-07-06T00:52:24.716 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged0/etc/access.conf': No such file or directory 2023-07-06T00:52:24.716 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged0/etc/access.conf': No such file or directory 2023-07-06T00:52:24.716 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged0/etc/access.conf': No such file or directory 2023-07-06T00:52:24.716 INFO:teuthology.orchestra.run.smithi046.stdout: +mount: /tmp/tmp.KrMG67MsYpscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-07-06T00:52:24.716 INFO:teuthology.orchestra.run.smithi046.stdout: +umount: /tmp/tmp.KrMG67MsYpscratch/merged0: not mounted. 2023-07-06T00:52:24.716 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged4/etc/access.conf': No such file or directory 2023-07-06T00:52:24.716 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged4/etc/access.conf': No such file or directory 2023-07-06T00:52:24.716 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged4/etc/access.conf': No such file or directory 2023-07-06T00:52:24.717 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged4/etc/access.conf': No such file or directory 2023-07-06T00:52:24.717 INFO:teuthology.orchestra.run.smithi046.stdout: +umount: /tmp/tmp.KrMG67MsYpscratch/merged4: not mounted. 2023-07-06T00:52:24.717 INFO:teuthology.orchestra.run.smithi046.stdout: +mount: /tmp/tmp.KrMG67MsYpscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-07-06T00:52:24.717 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged5/etc/access.conf': No such file or directory 2023-07-06T00:52:24.717 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged5/etc/access.conf': No such file or directory 2023-07-06T00:52:24.717 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged5/etc/access.conf': No such file or directory 2023-07-06T00:52:24.717 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged5/etc/access.conf': No such file or directory 2023-07-06T00:52:24.718 INFO:teuthology.orchestra.run.smithi046.stdout: +umount: /tmp/tmp.KrMG67MsYpscratch/merged5: not mounted. 2023-07-06T00:52:24.718 INFO:teuthology.orchestra.run.smithi046.stdout: +mount: /tmp/tmp.KrMG67MsYpscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-07-06T00:52:24.718 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged2/etc/access.conf': No such file or directory 2023-07-06T00:52:24.718 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged2/etc/access.conf': No such file or directory 2023-07-06T00:52:24.718 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged2/etc/access.conf': No such file or directory 2023-07-06T00:52:24.718 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged2/etc/access.conf': No such file or directory 2023-07-06T00:52:24.718 INFO:teuthology.orchestra.run.smithi046.stdout: +umount: /tmp/tmp.KrMG67MsYpscratch/merged2: not mounted. 2023-07-06T00:52:24.718 INFO:teuthology.orchestra.run.smithi046.stdout: +mount: mount: /tmp/tmp.KrMG67MsYpscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error./tmp/tmp.KrMG67MsYpscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-07-06T00:52:24.719 INFO:teuthology.orchestra.run.smithi046.stdout: + 2023-07-06T00:52:24.719 INFO:teuthology.orchestra.run.smithi046.stdout: +mount: /tmp/tmp.KrMG67MsYpscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-07-06T00:52:24.719 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged0/etc/access.conf': No such file or directory 2023-07-06T00:52:24.719 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged3/etc/access.conf': No such file or directory 2023-07-06T00:52:24.719 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged0/etc/access.conf': No such file or directory 2023-07-06T00:52:24.719 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged3/etc/access.conf': No such file or directory 2023-07-06T00:52:24.719 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged0/etc/access.conf': No such file or directory 2023-07-06T00:52:24.719 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged3/etc/access.conf': No such file or directory 2023-07-06T00:52:24.720 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged0/etc/access.conf': No such file or directory 2023-07-06T00:52:24.720 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged3/etc/access.conf': No such file or directory 2023-07-06T00:52:24.720 INFO:teuthology.orchestra.run.smithi046.stdout: +umount: /tmp/tmp.KrMG67MsYpscratch/merged0: not mounted. 2023-07-06T00:52:24.720 INFO:teuthology.orchestra.run.smithi046.stdout: +umount: /tmp/tmp.KrMG67MsYpscratch/merged3: not mounted. 2023-07-06T00:52:24.720 INFO:teuthology.orchestra.run.smithi046.stdout: +mount: /tmp/tmp.KrMG67MsYpscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-07-06T00:52:24.720 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged1/etc/access.conf': No such file or directory 2023-07-06T00:52:24.720 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged1/etc/access.conf': No such file or directory 2023-07-06T00:52:24.721 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged4/etc/access.conf': No such file or directory 2023-07-06T00:52:24.721 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged1/etc/access.conf': No such file or directory 2023-07-06T00:52:24.721 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged1/etc/access.conf': No such file or directory 2023-07-06T00:52:24.721 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged4/etc/access.conf': No such file or directory 2023-07-06T00:52:24.721 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged4/etc/access.conf': No such file or directory 2023-07-06T00:52:24.721 INFO:teuthology.orchestra.run.smithi046.stdout: +umount: /tmp/tmp.KrMG67MsYpscratch/merged1: not mounted. 2023-07-06T00:52:24.721 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged4/etc/access.conf': No such file or directory 2023-07-06T00:52:24.721 INFO:teuthology.orchestra.run.smithi046.stdout: +umount: /tmp/tmp.KrMG67MsYpscratch/merged4: not mounted. 2023-07-06T00:52:24.722 INFO:teuthology.orchestra.run.smithi046.stdout: +mount: /tmp/tmp.KrMG67MsYpscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-07-06T00:52:24.722 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged5/etc/access.conf': No such file or directory 2023-07-06T00:52:24.722 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged5/etc/access.conf': No such file or directory 2023-07-06T00:52:24.722 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged5/etc/access.conf': No such file or directory 2023-07-06T00:52:24.722 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged5/etc/access.conf': No such file or directory 2023-07-06T00:52:24.722 INFO:teuthology.orchestra.run.smithi046.stdout: +umount: /tmp/tmp.KrMG67MsYpscratch/merged5: not mounted. 2023-07-06T00:52:24.722 INFO:teuthology.orchestra.run.smithi046.stdout: +mount: /tmp/tmp.KrMG67MsYpscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-07-06T00:52:24.722 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged0/etc/access.conf': No such file or directory 2023-07-06T00:52:24.723 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged0/etc/access.conf': No such file or directory 2023-07-06T00:52:24.723 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged0/etc/access.conf': No such file or directory 2023-07-06T00:52:24.723 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged0/etc/access.conf': No such file or directory 2023-07-06T00:52:24.723 INFO:teuthology.orchestra.run.smithi046.stdout: +umount: /tmp/tmp.KrMG67MsYpscratch/merged0: not mounted. 2023-07-06T00:52:24.723 INFO:teuthology.orchestra.run.smithi046.stdout: +mount: /tmp/tmp.KrMG67MsYpscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-07-06T00:52:24.723 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged2/etc/access.conf': No such file or directory 2023-07-06T00:52:24.723 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged2/etc/access.conf': No such file or directory 2023-07-06T00:52:24.723 INFO:teuthology.orchestra.run.smithi046.stdout: +mount: mount: mount: /tmp/tmp.KrMG67MsYpscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error.mount: /tmp/tmp.KrMG67MsYpscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error./tmp/tmp.KrMG67MsYpscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-07-06T00:52:24.724 INFO:teuthology.orchestra.run.smithi046.stdout: +/tmp/tmp.KrMG67MsYpscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-07-06T00:52:24.724 INFO:teuthology.orchestra.run.smithi046.stdout: + 2023-07-06T00:52:24.724 INFO:teuthology.orchestra.run.smithi046.stdout: + 2023-07-06T00:52:24.724 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged2/etc/access.conf': No such file or directory 2023-07-06T00:52:24.724 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged5/etc/access.conf': No such file or directory 2023-07-06T00:52:24.724 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged1/etc/access.conf': No such file or directory 2023-07-06T00:52:24.724 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: mv: mv: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged2/etc/access.conf'cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged4/etc/access.conf'cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged3/etc/access.conf': No such file or directory: No such file or directory: No such file or directory 2023-07-06T00:52:24.724 INFO:teuthology.orchestra.run.smithi046.stdout: + 2023-07-06T00:52:24.725 INFO:teuthology.orchestra.run.smithi046.stdout: + 2023-07-06T00:52:24.725 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged5/etc/access.conf': No such file or directory 2023-07-06T00:52:24.725 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged1/etc/access.conf': No such file or directory 2023-07-06T00:52:24.725 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged3/etc/access.conf'touch: : No such file or directorycannot touch '/tmp/tmp.KrMG67MsYpscratch/merged4/etc/access.conf' 2023-07-06T00:52:24.725 INFO:teuthology.orchestra.run.smithi046.stdout: +: No such file or directory 2023-07-06T00:52:24.725 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged5/etc/access.conf': No such file or directory 2023-07-06T00:52:24.725 INFO:teuthology.orchestra.run.smithi046.stdout: +umount: /tmp/tmp.KrMG67MsYpscratch/merged2: not mounted. 2023-07-06T00:52:24.726 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged1/etc/access.conf': No such file or directory 2023-07-06T00:52:24.726 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged3/etc/access.conf': No such file or directory 2023-07-06T00:52:24.726 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged4/etc/access.conf': No such file or directory 2023-07-06T00:52:24.726 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged5/etc/access.conf': No such file or directory 2023-07-06T00:52:24.726 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged1/etc/access.conf': No such file or directory 2023-07-06T00:52:24.726 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged3/etc/access.conf': No such file or directory 2023-07-06T00:52:24.726 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged4/etc/access.conf': No such file or directory 2023-07-06T00:52:24.726 INFO:teuthology.orchestra.run.smithi046.stdout: +umount: /tmp/tmp.KrMG67MsYpscratch/merged5: not mounted. 2023-07-06T00:52:24.727 INFO:teuthology.orchestra.run.smithi046.stdout: +umount: /tmp/tmp.KrMG67MsYpscratch/merged3: not mounted. 2023-07-06T00:52:24.727 INFO:teuthology.orchestra.run.smithi046.stdout: +umount: /tmp/tmp.KrMG67MsYpscratch/merged1: not mounted. 2023-07-06T00:52:24.727 INFO:teuthology.orchestra.run.smithi046.stdout: +umount: /tmp/tmp.KrMG67MsYpscratch/merged4: not mounted. 2023-07-06T00:52:24.727 INFO:teuthology.orchestra.run.smithi046.stdout: +mount: /tmp/tmp.KrMG67MsYpscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-07-06T00:52:24.727 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged0/etc/access.conf': No such file or directory 2023-07-06T00:52:24.727 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged0/etc/access.conf': No such file or directory 2023-07-06T00:52:24.727 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged0/etc/access.conf': No such file or directory 2023-07-06T00:52:24.727 INFO:teuthology.orchestra.run.smithi046.stdout: +mount: /tmp/tmp.KrMG67MsYpscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-07-06T00:52:24.728 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged0/etc/access.conf': No such file or directory 2023-07-06T00:52:24.728 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged2/etc/access.conf': No such file or directory 2023-07-06T00:52:24.728 INFO:teuthology.orchestra.run.smithi046.stdout: +umount: /tmp/tmp.KrMG67MsYpscratch/merged0: not mounted. 2023-07-06T00:52:24.728 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged2/etc/access.conf': No such file or directory 2023-07-06T00:52:24.728 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged2/etc/access.conf': No such file or directory 2023-07-06T00:52:24.728 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged2/etc/access.conf': No such file or directory 2023-07-06T00:52:24.728 INFO:teuthology.orchestra.run.smithi046.stdout: +umount: /tmp/tmp.KrMG67MsYpscratch/merged2: not mounted. 2023-07-06T00:52:24.728 INFO:teuthology.orchestra.run.smithi046.stdout: +mount: /tmp/tmp.KrMG67MsYpscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-07-06T00:52:24.729 INFO:teuthology.orchestra.run.smithi046.stdout: +mount: /tmp/tmp.KrMG67MsYpscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-07-06T00:52:24.729 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged5/etc/access.conf': No such file or directory 2023-07-06T00:52:24.729 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged5/etc/access.conf': No such file or directory 2023-07-06T00:52:24.729 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged1/etc/access.conf': No such file or directory 2023-07-06T00:52:24.729 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged5/etc/access.conf': No such file or directory 2023-07-06T00:52:24.729 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged1/etc/access.conf': No such file or directory 2023-07-06T00:52:24.729 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged5/etc/access.conf': No such file or directory 2023-07-06T00:52:24.729 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged1/etc/access.conf': No such file or directory 2023-07-06T00:52:24.730 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged1/etc/access.conf': No such file or directory 2023-07-06T00:52:24.730 INFO:teuthology.orchestra.run.smithi046.stdout: +umount: /tmp/tmp.KrMG67MsYpscratch/merged5: not mounted. 2023-07-06T00:52:24.730 INFO:teuthology.orchestra.run.smithi046.stdout: +umount: /tmp/tmp.KrMG67MsYpscratch/merged1: not mounted. 2023-07-06T00:52:24.730 INFO:teuthology.orchestra.run.smithi046.stdout: +mount: /tmp/tmp.KrMG67MsYpscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-07-06T00:52:24.730 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged4/etc/access.conf': No such file or directory 2023-07-06T00:52:24.730 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged4/etc/access.conf': No such file or directory 2023-07-06T00:52:24.730 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged4/etc/access.conf': No such file or directory 2023-07-06T00:52:24.730 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged4/etc/access.conf': No such file or directory 2023-07-06T00:52:24.731 INFO:teuthology.orchestra.run.smithi046.stdout: +umount: /tmp/tmp.KrMG67MsYpscratch/merged4: not mounted. 2023-07-06T00:52:24.731 INFO:teuthology.orchestra.run.smithi046.stdout: +mount: /tmp/tmp.KrMG67MsYpscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-07-06T00:52:24.731 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged3/etc/access.conf': No such file or directory 2023-07-06T00:52:24.731 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged3/etc/access.conf': No such file or directory 2023-07-06T00:52:24.731 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged3/etc/access.conf': No such file or directory 2023-07-06T00:52:24.731 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged3/etc/access.conf': No such file or directory 2023-07-06T00:52:24.731 INFO:teuthology.orchestra.run.smithi046.stdout: +umount: /tmp/tmp.KrMG67MsYpscratch/merged3: not mounted. 2023-07-06T00:52:24.731 INFO:teuthology.orchestra.run.smithi046.stdout: +mount: /tmp/tmp.KrMG67MsYpscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-07-06T00:52:24.732 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged0/etc/access.conf': No such file or directory 2023-07-06T00:52:24.732 INFO:teuthology.orchestra.run.smithi046.stdout: +mount: /tmp/tmp.KrMG67MsYpscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-07-06T00:52:24.732 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged0/etc/access.conf': No such file or directory 2023-07-06T00:52:24.732 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged1/etc/access.conf': No such file or directory 2023-07-06T00:52:24.732 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged0/etc/access.conf': No such file or directory 2023-07-06T00:52:24.732 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged0/etc/access.conf': No such file or directory 2023-07-06T00:52:24.732 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged1/etc/access.conf': No such file or directory 2023-07-06T00:52:24.733 INFO:teuthology.orchestra.run.smithi046.stdout: +mount: /tmp/tmp.KrMG67MsYpscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-07-06T00:52:24.733 INFO:teuthology.orchestra.run.smithi046.stdout: +mount: /tmp/tmp.KrMG67MsYpscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-07-06T00:52:24.733 INFO:teuthology.orchestra.run.smithi046.stdout: +umount: /tmp/tmp.KrMG67MsYpscratch/merged0: not mounted. 2023-07-06T00:52:24.733 INFO:teuthology.orchestra.run.smithi046.stdout: +mount: /tmp/tmp.KrMG67MsYpscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-07-06T00:52:24.733 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged1/etc/access.conf': No such file or directory 2023-07-06T00:52:24.733 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged5/etc/access.conf': No such file or directory 2023-07-06T00:52:24.733 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged2/etc/access.conf': No such file or directory 2023-07-06T00:52:24.733 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged1/etc/access.conf': No such file or directory 2023-07-06T00:52:24.734 INFO:teuthology.orchestra.run.smithi046.stdout: +mount: /tmp/tmp.KrMG67MsYpscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-07-06T00:52:24.734 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged5/etc/access.conf': No such file or directory 2023-07-06T00:52:24.734 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged2/etc/access.conf': No such file or directory 2023-07-06T00:52:24.734 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged4/etc/access.conf': No such file or directory 2023-07-06T00:52:24.734 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged5/etc/access.conf': No such file or directory 2023-07-06T00:52:24.734 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged4/etc/access.conf': No such file or directory 2023-07-06T00:52:24.734 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged5/etc/access.conf': No such file or directory 2023-07-06T00:52:24.734 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged2/etc/access.conf': No such file or directory 2023-07-06T00:52:24.735 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged4/etc/access.conf': No such file or directory 2023-07-06T00:52:24.735 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged2/etc/access.conf': No such file or directory 2023-07-06T00:52:24.735 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged4/etc/access.conf': No such file or directory 2023-07-06T00:52:24.735 INFO:teuthology.orchestra.run.smithi046.stdout: +umount: /tmp/tmp.KrMG67MsYpscratch/merged1: not mounted. 2023-07-06T00:52:24.735 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged3/etc/access.conf': No such file or directory 2023-07-06T00:52:24.735 INFO:teuthology.orchestra.run.smithi046.stdout: +umount: /tmp/tmp.KrMG67MsYpscratch/merged2: not mounted. 2023-07-06T00:52:24.735 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged3/etc/access.conf': No such file or directory 2023-07-06T00:52:24.735 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged3/etc/access.conf': No such file or directory 2023-07-06T00:52:24.736 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged3/etc/access.conf': No such file or directory 2023-07-06T00:52:24.736 INFO:teuthology.orchestra.run.smithi046.stdout: +umount: /tmp/tmp.KrMG67MsYpscratch/merged4: not mounted. 2023-07-06T00:52:24.736 INFO:teuthology.orchestra.run.smithi046.stdout: +umount: umount: /tmp/tmp.KrMG67MsYpscratch/merged3: not mounted./tmp/tmp.KrMG67MsYpscratch/merged5: not mounted. 2023-07-06T00:52:24.736 INFO:teuthology.orchestra.run.smithi046.stdout: + 2023-07-06T00:52:24.736 INFO:teuthology.orchestra.run.smithi046.stdout: +mount: /tmp/tmp.KrMG67MsYpscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-07-06T00:52:24.736 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged4/etc/access.conf': No such file or directory 2023-07-06T00:52:24.736 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged4/etc/access.conf': No such file or directory 2023-07-06T00:52:24.736 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged4/etc/access.conf': No such file or directory 2023-07-06T00:52:24.737 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged4/etc/access.conf': No such file or directory 2023-07-06T00:52:24.737 INFO:teuthology.orchestra.run.smithi046.stdout: +umount: /tmp/tmp.KrMG67MsYpscratch/merged4: not mounted. 2023-07-06T00:52:24.737 INFO:teuthology.orchestra.run.smithi046.stdout: +mount: mount: /tmp/tmp.KrMG67MsYpscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error./tmp/tmp.KrMG67MsYpscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-07-06T00:52:24.737 INFO:teuthology.orchestra.run.smithi046.stdout: + 2023-07-06T00:52:24.737 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged3/etc/access.conf': No such file or directory 2023-07-06T00:52:24.737 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged0/etc/access.conf': No such file or directory 2023-07-06T00:52:24.737 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged3/etc/access.conf': No such file or directory 2023-07-06T00:52:24.738 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged0/etc/access.conf': No such file or directory 2023-07-06T00:52:24.738 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged3/etc/access.conf': No such file or directory 2023-07-06T00:52:24.738 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged0/etc/access.conf': No such file or directory 2023-07-06T00:52:24.738 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged3/etc/access.conf': No such file or directory 2023-07-06T00:52:24.738 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged0/etc/access.conf': No such file or directory 2023-07-06T00:52:24.738 INFO:teuthology.orchestra.run.smithi046.stdout: +umount: umount: /tmp/tmp.KrMG67MsYpscratch/merged0: not mounted./tmp/tmp.KrMG67MsYpscratch/merged3: not mounted. 2023-07-06T00:52:24.738 INFO:teuthology.orchestra.run.smithi046.stdout: + 2023-07-06T00:52:24.738 INFO:teuthology.orchestra.run.smithi046.stdout: +mount: mount: mount: /tmp/tmp.KrMG67MsYpscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error./tmp/tmp.KrMG67MsYpscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error./tmp/tmp.KrMG67MsYpscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-07-06T00:52:24.739 INFO:teuthology.orchestra.run.smithi046.stdout: + 2023-07-06T00:52:24.739 INFO:teuthology.orchestra.run.smithi046.stdout: + 2023-07-06T00:52:24.739 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged2/etc/access.conf': No such file or directory 2023-07-06T00:52:24.739 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged5/etc/access.conf': No such file or directory 2023-07-06T00:52:24.739 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged1/etc/access.conf': No such file or directory 2023-07-06T00:52:24.739 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged2/etc/access.conf': No such file or directory 2023-07-06T00:52:24.739 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged5/etc/access.conf': No such file or directory 2023-07-06T00:52:24.739 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged1/etc/access.conf': No such file or directory 2023-07-06T00:52:24.740 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged5/etc/access.conf': No such file or directory 2023-07-06T00:52:24.740 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged2/etc/access.conf': No such file or directory 2023-07-06T00:52:24.740 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged1/etc/access.conf': No such file or directory 2023-07-06T00:52:24.740 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged5/etc/access.conf': No such file or directory 2023-07-06T00:52:24.740 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged2/etc/access.conf': No such file or directory 2023-07-06T00:52:24.740 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged1/etc/access.conf': No such file or directory 2023-07-06T00:52:24.740 INFO:teuthology.orchestra.run.smithi046.stdout: +umount: /tmp/tmp.KrMG67MsYpscratch/merged5: not mounted. 2023-07-06T00:52:24.741 INFO:teuthology.orchestra.run.smithi046.stdout: +umount: /tmp/tmp.KrMG67MsYpscratch/merged2: not mounted. 2023-07-06T00:52:24.741 INFO:teuthology.orchestra.run.smithi046.stdout: +umount: /tmp/tmp.KrMG67MsYpscratch/merged1: not mounted. 2023-07-06T00:52:24.741 INFO:teuthology.orchestra.run.smithi046.stdout: +mount: /tmp/tmp.KrMG67MsYpscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-07-06T00:52:24.741 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged3/etc/access.conf': No such file or directory 2023-07-06T00:52:24.741 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged3/etc/access.conf': No such file or directory 2023-07-06T00:52:24.741 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged3/etc/access.conf': No such file or directory 2023-07-06T00:52:24.741 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged3/etc/access.conf': No such file or directory 2023-07-06T00:52:24.741 INFO:teuthology.orchestra.run.smithi046.stdout: +umount: /tmp/tmp.KrMG67MsYpscratch/merged3: not mounted. 2023-07-06T00:52:24.742 INFO:teuthology.orchestra.run.smithi046.stdout: +mount: /tmp/tmp.KrMG67MsYpscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-07-06T00:52:24.742 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged5/etc/access.conf': No such file or directory 2023-07-06T00:52:24.742 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged5/etc/access.conf': No such file or directory 2023-07-06T00:52:24.742 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged5/etc/access.conf': No such file or directory 2023-07-06T00:52:24.742 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged5/etc/access.conf': No such file or directory 2023-07-06T00:52:24.742 INFO:teuthology.orchestra.run.smithi046.stdout: +umount: /tmp/tmp.KrMG67MsYpscratch/merged5: not mounted. 2023-07-06T00:52:24.742 INFO:teuthology.orchestra.run.smithi046.stdout: +mount: /tmp/tmp.KrMG67MsYpscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-07-06T00:52:24.742 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged0/etc/access.conf': No such file or directory 2023-07-06T00:52:24.743 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged0/etc/access.conf': No such file or directory 2023-07-06T00:52:24.743 INFO:teuthology.orchestra.run.smithi046.stdout: +mount: /tmp/tmp.KrMG67MsYpscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-07-06T00:52:24.743 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged4/etc/access.conf': No such file or directory 2023-07-06T00:52:24.743 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged4/etc/access.conf': No such file or directory 2023-07-06T00:52:24.743 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged4/etc/access.conf': No such file or directory 2023-07-06T00:52:24.743 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged0/etc/access.conf': No such file or directory 2023-07-06T00:52:24.743 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged4/etc/access.conf': No such file or directory 2023-07-06T00:52:24.743 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged0/etc/access.conf': No such file or directory 2023-07-06T00:52:24.744 INFO:teuthology.orchestra.run.smithi046.stdout: +mount: mount: /tmp/tmp.KrMG67MsYpscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error./tmp/tmp.KrMG67MsYpscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-07-06T00:52:24.744 INFO:teuthology.orchestra.run.smithi046.stdout: + 2023-07-06T00:52:24.744 INFO:teuthology.orchestra.run.smithi046.stdout: +umount: /tmp/tmp.KrMG67MsYpscratch/merged4: not mounted. 2023-07-06T00:52:24.744 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged2/etc/access.conf': No such file or directory 2023-07-06T00:52:24.744 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged2/etc/access.conf': No such file or directory 2023-07-06T00:52:24.744 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged1/etc/access.conf': No such file or directory 2023-07-06T00:52:24.744 INFO:teuthology.orchestra.run.smithi046.stdout: +umount: /tmp/tmp.KrMG67MsYpscratch/merged0: not mounted. 2023-07-06T00:52:24.745 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged2/etc/access.conf': No such file or directory 2023-07-06T00:52:24.745 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged1/etc/access.conf': No such file or directory 2023-07-06T00:52:24.745 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged1/etc/access.conf': No such file or directory 2023-07-06T00:52:24.745 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged2/etc/access.conf': No such file or directory 2023-07-06T00:52:24.745 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged1/etc/access.conf': No such file or directory 2023-07-06T00:52:24.745 INFO:teuthology.orchestra.run.smithi046.stdout: +umount: /tmp/tmp.KrMG67MsYpscratch/merged2: not mounted. 2023-07-06T00:52:24.745 INFO:teuthology.orchestra.run.smithi046.stdout: +umount: /tmp/tmp.KrMG67MsYpscratch/merged1: not mounted. 2023-07-06T00:52:24.745 INFO:teuthology.orchestra.run.smithi046.stdout: +mount: /tmp/tmp.KrMG67MsYpscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-07-06T00:52:24.746 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged3/etc/access.conf': No such file or directory 2023-07-06T00:52:24.746 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged3/etc/access.conf': No such file or directory 2023-07-06T00:52:24.746 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged3/etc/access.conf': No such file or directory 2023-07-06T00:52:24.746 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged3/etc/access.conf': No such file or directory 2023-07-06T00:52:24.746 INFO:teuthology.orchestra.run.smithi046.stdout: +mount: /tmp/tmp.KrMG67MsYpscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-07-06T00:52:24.746 INFO:teuthology.orchestra.run.smithi046.stdout: +umount: /tmp/tmp.KrMG67MsYpscratch/merged3: not mounted. 2023-07-06T00:52:24.746 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged0/etc/access.conf': No such file or directory 2023-07-06T00:52:24.746 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged0/etc/access.conf': No such file or directory 2023-07-06T00:52:24.747 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged0/etc/access.conf': No such file or directory 2023-07-06T00:52:24.747 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged0/etc/access.conf': No such file or directory 2023-07-06T00:52:24.747 INFO:teuthology.orchestra.run.smithi046.stdout: +mount: /tmp/tmp.KrMG67MsYpscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-07-06T00:52:24.747 INFO:teuthology.orchestra.run.smithi046.stdout: +umount: /tmp/tmp.KrMG67MsYpscratch/merged0: not mounted. 2023-07-06T00:52:24.747 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged4/etc/access.conf': No such file or directory 2023-07-06T00:52:24.747 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged4/etc/access.conf': No such file or directory 2023-07-06T00:52:24.747 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged4/etc/access.conf': No such file or directory 2023-07-06T00:52:24.747 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged4/etc/access.conf': No such file or directory 2023-07-06T00:52:24.748 INFO:teuthology.orchestra.run.smithi046.stdout: +umount: /tmp/tmp.KrMG67MsYpscratch/merged4: not mounted. 2023-07-06T00:52:24.748 INFO:teuthology.orchestra.run.smithi046.stdout: +mount: /tmp/tmp.KrMG67MsYpscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-07-06T00:52:24.748 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged1/etc/access.conf': No such file or directory 2023-07-06T00:52:24.748 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged1/etc/access.conf': No such file or directory 2023-07-06T00:52:24.748 INFO:teuthology.orchestra.run.smithi046.stdout: +mount: mount: /tmp/tmp.KrMG67MsYpscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error./tmp/tmp.KrMG67MsYpscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-07-06T00:52:24.748 INFO:teuthology.orchestra.run.smithi046.stdout: + 2023-07-06T00:52:24.748 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged1/etc/access.conf': No such file or directory 2023-07-06T00:52:24.749 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged2/etc/access.conf': No such file or directory 2023-07-06T00:52:24.749 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged1/etc/access.conf': No such file or directory 2023-07-06T00:52:24.749 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged2/etc/access.conf': No such file or directory 2023-07-06T00:52:24.749 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged5/etc/access.conf': No such file or directory 2023-07-06T00:52:24.749 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged2/etc/access.conf': No such file or directory 2023-07-06T00:52:24.749 INFO:teuthology.orchestra.run.smithi046.stdout: +umount: /tmp/tmp.KrMG67MsYpscratch/merged1: not mounted. 2023-07-06T00:52:24.749 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged2/etc/access.conf': No such file or directory 2023-07-06T00:52:24.749 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged5/etc/access.conf': No such file or directory 2023-07-06T00:52:24.750 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged5/etc/access.conf': No such file or directory 2023-07-06T00:52:24.750 INFO:teuthology.orchestra.run.smithi046.stdout: +umount: /tmp/tmp.KrMG67MsYpscratch/merged2: not mounted. 2023-07-06T00:52:24.750 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged5/etc/access.conf': No such file or directory 2023-07-06T00:52:24.750 INFO:teuthology.orchestra.run.smithi046.stdout: +umount: /tmp/tmp.KrMG67MsYpscratch/merged5: not mounted. 2023-07-06T00:52:24.750 INFO:teuthology.orchestra.run.smithi046.stdout: +mount: /tmp/tmp.KrMG67MsYpscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-07-06T00:52:24.750 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged3/etc/access.conf': No such file or directory 2023-07-06T00:52:24.750 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged3/etc/access.conf': No such file or directory 2023-07-06T00:52:24.750 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged3/etc/access.conf': No such file or directory 2023-07-06T00:52:24.751 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged3/etc/access.conf': No such file or directory 2023-07-06T00:52:24.751 INFO:teuthology.orchestra.run.smithi046.stdout: +umount: /tmp/tmp.KrMG67MsYpscratch/merged3: not mounted. 2023-07-06T00:52:24.751 INFO:teuthology.orchestra.run.smithi046.stdout: +mount: /tmp/tmp.KrMG67MsYpscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-07-06T00:52:24.751 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged0/etc/access.conf': No such file or directory 2023-07-06T00:52:24.751 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged0/etc/access.conf': No such file or directory 2023-07-06T00:52:24.751 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged0/etc/access.conf': No such file or directory 2023-07-06T00:52:24.751 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged0/etc/access.conf': No such file or directory 2023-07-06T00:52:24.751 INFO:teuthology.orchestra.run.smithi046.stdout: +umount: /tmp/tmp.KrMG67MsYpscratch/merged0: not mounted. 2023-07-06T00:52:24.752 INFO:teuthology.orchestra.run.smithi046.stdout: +mount: /tmp/tmp.KrMG67MsYpscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-07-06T00:52:24.752 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged4/etc/access.conf': No such file or directory 2023-07-06T00:52:24.752 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged4/etc/access.conf': No such file or directory 2023-07-06T00:52:24.752 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged4/etc/access.conf': No such file or directory 2023-07-06T00:52:24.752 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged4/etc/access.conf': No such file or directory 2023-07-06T00:52:24.752 INFO:teuthology.orchestra.run.smithi046.stdout: +umount: /tmp/tmp.KrMG67MsYpscratch/merged4: not mounted. 2023-07-06T00:52:24.752 INFO:teuthology.orchestra.run.smithi046.stdout: +mount: /tmp/tmp.KrMG67MsYpscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-07-06T00:52:24.753 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged1/etc/access.conf': No such file or directory 2023-07-06T00:52:24.753 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged1/etc/access.conf': No such file or directory 2023-07-06T00:52:24.753 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged1/etc/access.conf': No such file or directory 2023-07-06T00:52:24.753 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged1/etc/access.conf': No such file or directory 2023-07-06T00:52:24.753 INFO:teuthology.orchestra.run.smithi046.stdout: +umount: /tmp/tmp.KrMG67MsYpscratch/merged1: not mounted. 2023-07-06T00:52:24.753 INFO:teuthology.orchestra.run.smithi046.stdout: +mount: /tmp/tmp.KrMG67MsYpscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-07-06T00:52:24.753 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged2/etc/access.conf': No such file or directory 2023-07-06T00:52:24.753 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged2/etc/access.conf': No such file or directory 2023-07-06T00:52:24.754 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged2/etc/access.conf': No such file or directory 2023-07-06T00:52:24.754 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged2/etc/access.conf': No such file or directory 2023-07-06T00:52:24.754 INFO:teuthology.orchestra.run.smithi046.stdout: +mount: /tmp/tmp.KrMG67MsYpscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-07-06T00:52:24.754 INFO:teuthology.orchestra.run.smithi046.stdout: +umount: /tmp/tmp.KrMG67MsYpscratch/merged2: not mounted. 2023-07-06T00:52:24.754 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged5/etc/access.conf': No such file or directory 2023-07-06T00:52:24.754 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged5/etc/access.conf': No such file or directory 2023-07-06T00:52:24.754 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged5/etc/access.conf': No such file or directory 2023-07-06T00:52:24.754 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged5/etc/access.conf': No such file or directory 2023-07-06T00:52:24.755 INFO:teuthology.orchestra.run.smithi046.stdout: +umount: /tmp/tmp.KrMG67MsYpscratch/merged5: not mounted. 2023-07-06T00:52:24.755 INFO:teuthology.orchestra.run.smithi046.stdout: +mount: /tmp/tmp.KrMG67MsYpscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-07-06T00:52:24.755 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged3/etc/access.conf': No such file or directory 2023-07-06T00:52:24.755 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged3/etc/access.conf': No such file or directory 2023-07-06T00:52:24.755 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged3/etc/access.conf': No such file or directory 2023-07-06T00:52:24.755 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged3/etc/access.conf': No such file or directory 2023-07-06T00:52:24.755 INFO:teuthology.orchestra.run.smithi046.stdout: +umount: /tmp/tmp.KrMG67MsYpscratch/merged3: not mounted. 2023-07-06T00:52:24.755 INFO:teuthology.orchestra.run.smithi046.stdout: +mount: /tmp/tmp.KrMG67MsYpscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-07-06T00:52:24.756 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged4/etc/access.conf': No such file or directory 2023-07-06T00:52:24.756 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged4/etc/access.conf': No such file or directory 2023-07-06T00:52:24.756 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged4/etc/access.conf': No such file or directory 2023-07-06T00:52:24.756 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged4/etc/access.conf': No such file or directory 2023-07-06T00:52:24.756 INFO:teuthology.orchestra.run.smithi046.stdout: +umount: /tmp/tmp.KrMG67MsYpscratch/merged4: not mounted. 2023-07-06T00:52:24.756 INFO:teuthology.orchestra.run.smithi046.stdout: +mount: /tmp/tmp.KrMG67MsYpscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-07-06T00:52:24.756 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged0/etc/access.conf': No such file or directory 2023-07-06T00:52:24.756 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged0/etc/access.conf': No such file or directory 2023-07-06T00:52:24.757 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged0/etc/access.conf': No such file or directory 2023-07-06T00:52:24.757 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged0/etc/access.conf': No such file or directory 2023-07-06T00:52:24.757 INFO:teuthology.orchestra.run.smithi046.stdout: +umount: /tmp/tmp.KrMG67MsYpscratch/merged0: not mounted. 2023-07-06T00:52:24.757 INFO:teuthology.orchestra.run.smithi046.stdout: +mount: /tmp/tmp.KrMG67MsYpscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-07-06T00:52:24.757 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged5/etc/access.conf': No such file or directory 2023-07-06T00:52:24.757 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged5/etc/access.conf': No such file or directory 2023-07-06T00:52:24.757 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged5/etc/access.conf': No such file or directory 2023-07-06T00:52:24.757 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged5/etc/access.conf': No such file or directory 2023-07-06T00:52:24.758 INFO:teuthology.orchestra.run.smithi046.stdout: +umount: /tmp/tmp.KrMG67MsYpscratch/merged5: not mounted. 2023-07-06T00:52:24.758 INFO:teuthology.orchestra.run.smithi046.stdout: +mount: /tmp/tmp.KrMG67MsYpscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-07-06T00:52:24.758 INFO:teuthology.orchestra.run.smithi046.stdout: +mount: /tmp/tmp.KrMG67MsYpscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-07-06T00:52:24.758 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged2/etc/access.conf': No such file or directory 2023-07-06T00:52:24.758 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged1/etc/access.conf': No such file or directory 2023-07-06T00:52:24.758 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged2/etc/access.conf': No such file or directory 2023-07-06T00:52:24.758 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged1/etc/access.conf': No such file or directory 2023-07-06T00:52:24.759 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged2/etc/access.conf': No such file or directory 2023-07-06T00:52:24.759 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged1/etc/access.conf': No such file or directory 2023-07-06T00:52:24.759 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged2/etc/access.conf': No such file or directory 2023-07-06T00:52:24.759 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged1/etc/access.conf': No such file or directory 2023-07-06T00:52:24.759 INFO:teuthology.orchestra.run.smithi046.stdout: +umount: /tmp/tmp.KrMG67MsYpscratch/merged2: not mounted. 2023-07-06T00:52:24.759 INFO:teuthology.orchestra.run.smithi046.stdout: +umount: /tmp/tmp.KrMG67MsYpscratch/merged1: not mounted. 2023-07-06T00:52:24.759 INFO:teuthology.orchestra.run.smithi046.stdout: +mount: /tmp/tmp.KrMG67MsYpscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-07-06T00:52:24.759 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged3/etc/access.conf': No such file or directory 2023-07-06T00:52:24.760 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged3/etc/access.conf': No such file or directory 2023-07-06T00:52:24.760 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged3/etc/access.conf': No such file or directory 2023-07-06T00:52:24.760 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged3/etc/access.conf': No such file or directory 2023-07-06T00:52:24.760 INFO:teuthology.orchestra.run.smithi046.stdout: +umount: /tmp/tmp.KrMG67MsYpscratch/merged3: not mounted. 2023-07-06T00:52:24.760 INFO:teuthology.orchestra.run.smithi046.stdout: +mount: /tmp/tmp.KrMG67MsYpscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-07-06T00:52:24.760 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged4/etc/access.conf': No such file or directory 2023-07-06T00:52:24.760 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged4/etc/access.conf': No such file or directory 2023-07-06T00:52:24.760 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged4/etc/access.conf': No such file or directory 2023-07-06T00:52:24.761 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged4/etc/access.conf': No such file or directory 2023-07-06T00:52:24.761 INFO:teuthology.orchestra.run.smithi046.stdout: +umount: /tmp/tmp.KrMG67MsYpscratch/merged4: not mounted. 2023-07-06T00:52:24.761 INFO:teuthology.orchestra.run.smithi046.stdout: +mount: /tmp/tmp.KrMG67MsYpscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-07-06T00:52:24.761 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged5/etc/access.conf': No such file or directory 2023-07-06T00:52:24.761 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged5/etc/access.conf': No such file or directory 2023-07-06T00:52:24.761 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged5/etc/access.conf': No such file or directory 2023-07-06T00:52:24.761 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged5/etc/access.conf': No such file or directory 2023-07-06T00:52:24.762 INFO:teuthology.orchestra.run.smithi046.stdout: +umount: /tmp/tmp.KrMG67MsYpscratch/merged5: not mounted. 2023-07-06T00:52:24.762 INFO:teuthology.orchestra.run.smithi046.stdout: +mount: /tmp/tmp.KrMG67MsYpscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-07-06T00:52:24.762 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged2/etc/access.conf': No such file or directory 2023-07-06T00:52:24.762 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged2/etc/access.conf': No such file or directory 2023-07-06T00:52:24.762 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged2/etc/access.conf': No such file or directory 2023-07-06T00:52:24.762 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged2/etc/access.conf': No such file or directory 2023-07-06T00:52:24.762 INFO:teuthology.orchestra.run.smithi046.stdout: +umount: /tmp/tmp.KrMG67MsYpscratch/merged2: not mounted. 2023-07-06T00:52:24.762 INFO:teuthology.orchestra.run.smithi046.stdout: +mount: /tmp/tmp.KrMG67MsYpscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-07-06T00:52:24.763 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged0/etc/access.conf': No such file or directory 2023-07-06T00:52:24.763 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged0/etc/access.conf': No such file or directory 2023-07-06T00:52:24.763 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged0/etc/access.conf': No such file or directory 2023-07-06T00:52:24.763 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged0/etc/access.conf': No such file or directory 2023-07-06T00:52:24.763 INFO:teuthology.orchestra.run.smithi046.stdout: +umount: /tmp/tmp.KrMG67MsYpscratch/merged0: not mounted. 2023-07-06T00:52:24.763 INFO:teuthology.orchestra.run.smithi046.stdout: +mount: /tmp/tmp.KrMG67MsYpscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-07-06T00:52:24.763 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged1/etc/access.conf': No such file or directory 2023-07-06T00:52:24.763 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged1/etc/access.conf': No such file or directory 2023-07-06T00:52:24.764 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged1/etc/access.conf': No such file or directory 2023-07-06T00:52:24.764 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged1/etc/access.conf': No such file or directory 2023-07-06T00:52:24.764 INFO:teuthology.orchestra.run.smithi046.stdout: +umount: /tmp/tmp.KrMG67MsYpscratch/merged1: not mounted. 2023-07-06T00:52:24.764 INFO:teuthology.orchestra.run.smithi046.stdout: +mount: /tmp/tmp.KrMG67MsYpscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-07-06T00:52:24.764 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged3/etc/access.conf': No such file or directory 2023-07-06T00:52:24.764 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged3/etc/access.conf': No such file or directory 2023-07-06T00:52:24.764 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged3/etc/access.conf': No such file or directory 2023-07-06T00:52:24.764 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged3/etc/access.conf': No such file or directory 2023-07-06T00:52:24.765 INFO:teuthology.orchestra.run.smithi046.stdout: +umount: /tmp/tmp.KrMG67MsYpscratch/merged3: not mounted. 2023-07-06T00:52:24.765 INFO:teuthology.orchestra.run.smithi046.stdout: +mount: /tmp/tmp.KrMG67MsYpscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-07-06T00:52:24.765 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged2/etc/access.conf': No such file or directory 2023-07-06T00:52:24.765 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged2/etc/access.conf': No such file or directory 2023-07-06T00:52:24.765 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged2/etc/access.conf': No such file or directory 2023-07-06T00:52:24.765 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged2/etc/access.conf': No such file or directory 2023-07-06T00:52:24.765 INFO:teuthology.orchestra.run.smithi046.stdout: +umount: /tmp/tmp.KrMG67MsYpscratch/merged2: not mounted. 2023-07-06T00:52:24.766 INFO:teuthology.orchestra.run.smithi046.stdout: +mount: /tmp/tmp.KrMG67MsYpscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-07-06T00:52:24.766 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged0/etc/access.conf': No such file or directory 2023-07-06T00:52:24.766 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged0/etc/access.conf': No such file or directory 2023-07-06T00:52:24.766 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged0/etc/access.conf': No such file or directory 2023-07-06T00:52:24.766 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged0/etc/access.conf': No such file or directory 2023-07-06T00:52:24.766 INFO:teuthology.orchestra.run.smithi046.stdout: +umount: /tmp/tmp.KrMG67MsYpscratch/merged0: not mounted. 2023-07-06T00:52:24.766 INFO:teuthology.orchestra.run.smithi046.stdout: +mount: /tmp/tmp.KrMG67MsYpscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-07-06T00:52:24.767 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged4/etc/access.conf': No such file or directory 2023-07-06T00:52:24.767 INFO:teuthology.orchestra.run.smithi046.stdout: +mount: /tmp/tmp.KrMG67MsYpscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-07-06T00:52:24.767 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged4/etc/access.conf': No such file or directory 2023-07-06T00:52:24.767 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged5/etc/access.conf': No such file or directory 2023-07-06T00:52:24.767 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged4/etc/access.conf': No such file or directory 2023-07-06T00:52:24.768 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged5/etc/access.conf': No such file or directory 2023-07-06T00:52:24.768 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged4/etc/access.conf': No such file or directory 2023-07-06T00:52:24.768 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged5/etc/access.conf': No such file or directory 2023-07-06T00:52:24.768 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged5/etc/access.conf': No such file or directory 2023-07-06T00:52:24.769 INFO:teuthology.orchestra.run.smithi046.stdout: +umount: /tmp/tmp.KrMG67MsYpscratch/merged4: not mounted. 2023-07-06T00:52:24.769 INFO:teuthology.orchestra.run.smithi046.stdout: +umount: /tmp/tmp.KrMG67MsYpscratch/merged5: not mounted. 2023-07-06T00:52:24.769 INFO:teuthology.orchestra.run.smithi046.stdout: +mount: /tmp/tmp.KrMG67MsYpscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-07-06T00:52:24.769 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged1/etc/access.conf': No such file or directory 2023-07-06T00:52:24.769 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged1/etc/access.conf': No such file or directory 2023-07-06T00:52:24.769 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged1/etc/access.conf': No such file or directory 2023-07-06T00:52:24.769 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged1/etc/access.conf': No such file or directory 2023-07-06T00:52:24.769 INFO:teuthology.orchestra.run.smithi046.stdout: +umount: /tmp/tmp.KrMG67MsYpscratch/merged1: not mounted. 2023-07-06T00:52:24.770 INFO:teuthology.orchestra.run.smithi046.stdout: +mount: /tmp/tmp.KrMG67MsYpscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-07-06T00:52:24.770 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged3/etc/access.conf': No such file or directory 2023-07-06T00:52:24.770 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged3/etc/access.conf': No such file or directory 2023-07-06T00:52:24.770 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged3/etc/access.conf': No such file or directory 2023-07-06T00:52:24.770 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged3/etc/access.conf': No such file or directory 2023-07-06T00:52:24.770 INFO:teuthology.orchestra.run.smithi046.stdout: +umount: /tmp/tmp.KrMG67MsYpscratch/merged3: not mounted. 2023-07-06T00:52:24.770 INFO:teuthology.orchestra.run.smithi046.stdout: +mount: /tmp/tmp.KrMG67MsYpscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-07-06T00:52:24.771 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged2/etc/access.conf': No such file or directory 2023-07-06T00:52:24.771 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged2/etc/access.conf': No such file or directory 2023-07-06T00:52:24.771 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged2/etc/access.conf': No such file or directory 2023-07-06T00:52:24.771 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged2/etc/access.conf': No such file or directory 2023-07-06T00:52:24.771 INFO:teuthology.orchestra.run.smithi046.stdout: +umount: /tmp/tmp.KrMG67MsYpscratch/merged2: not mounted. 2023-07-06T00:52:24.771 INFO:teuthology.orchestra.run.smithi046.stdout: +mount: /tmp/tmp.KrMG67MsYpscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-07-06T00:52:24.771 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged0/etc/access.conf': No such file or directory 2023-07-06T00:52:24.771 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged0/etc/access.conf': No such file or directory 2023-07-06T00:52:24.772 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged0/etc/access.conf': No such file or directory 2023-07-06T00:52:24.772 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged0/etc/access.conf': No such file or directory 2023-07-06T00:52:24.772 INFO:teuthology.orchestra.run.smithi046.stdout: +umount: /tmp/tmp.KrMG67MsYpscratch/merged0: not mounted. 2023-07-06T00:52:24.772 INFO:teuthology.orchestra.run.smithi046.stdout: +mount: /tmp/tmp.KrMG67MsYpscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-07-06T00:52:24.772 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged4/etc/access.conf': No such file or directory 2023-07-06T00:52:24.772 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged4/etc/access.conf': No such file or directory 2023-07-06T00:52:24.772 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged4/etc/access.conf': No such file or directory 2023-07-06T00:52:24.772 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged4/etc/access.conf': No such file or directory 2023-07-06T00:52:24.773 INFO:teuthology.orchestra.run.smithi046.stdout: +mount: /tmp/tmp.KrMG67MsYpscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-07-06T00:52:24.773 INFO:teuthology.orchestra.run.smithi046.stdout: +umount: /tmp/tmp.KrMG67MsYpscratch/merged4: not mounted. 2023-07-06T00:52:24.773 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged1/etc/access.conf': No such file or directory 2023-07-06T00:52:24.773 INFO:teuthology.orchestra.run.smithi046.stdout: +mount: /tmp/tmp.KrMG67MsYpscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-07-06T00:52:24.773 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged5/etc/access.conf': No such file or directory 2023-07-06T00:52:24.773 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged1/etc/access.conf': No such file or directory 2023-07-06T00:52:24.773 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged5/etc/access.conf': No such file or directory 2023-07-06T00:52:24.773 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged5/etc/access.conf': No such file or directory 2023-07-06T00:52:24.774 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged1/etc/access.conf': No such file or directory 2023-07-06T00:52:24.774 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged5/etc/access.conf': No such file or directory 2023-07-06T00:52:24.774 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged1/etc/access.conf': No such file or directory 2023-07-06T00:52:24.774 INFO:teuthology.orchestra.run.smithi046.stdout: +umount: /tmp/tmp.KrMG67MsYpscratch/merged1: not mounted. 2023-07-06T00:52:24.774 INFO:teuthology.orchestra.run.smithi046.stdout: +umount: /tmp/tmp.KrMG67MsYpscratch/merged5: not mounted. 2023-07-06T00:52:24.774 INFO:teuthology.orchestra.run.smithi046.stdout: +mount: /tmp/tmp.KrMG67MsYpscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-07-06T00:52:24.774 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged3/etc/access.conf': No such file or directory 2023-07-06T00:52:24.774 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged3/etc/access.conf': No such file or directory 2023-07-06T00:52:24.775 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged3/etc/access.conf': No such file or directory 2023-07-06T00:52:24.775 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged3/etc/access.conf': No such file or directory 2023-07-06T00:52:24.775 INFO:teuthology.orchestra.run.smithi046.stdout: +umount: /tmp/tmp.KrMG67MsYpscratch/merged3: not mounted. 2023-07-06T00:52:24.775 INFO:teuthology.orchestra.run.smithi046.stdout: +mount: /tmp/tmp.KrMG67MsYpscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-07-06T00:52:24.775 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged2/etc/access.conf': No such file or directory 2023-07-06T00:52:24.775 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged2/etc/access.conf': No such file or directory 2023-07-06T00:52:24.775 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged2/etc/access.conf': No such file or directory 2023-07-06T00:52:24.775 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged2/etc/access.conf': No such file or directory 2023-07-06T00:52:24.776 INFO:teuthology.orchestra.run.smithi046.stdout: +umount: /tmp/tmp.KrMG67MsYpscratch/merged2: not mounted. 2023-07-06T00:52:24.776 INFO:teuthology.orchestra.run.smithi046.stdout: +mount: /tmp/tmp.KrMG67MsYpscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-07-06T00:52:24.776 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged0/etc/access.conf': No such file or directory 2023-07-06T00:52:24.776 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged0/etc/access.conf': No such file or directory 2023-07-06T00:52:24.776 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged0/etc/access.conf': No such file or directory 2023-07-06T00:52:24.776 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged0/etc/access.conf': No such file or directory 2023-07-06T00:52:24.776 INFO:teuthology.orchestra.run.smithi046.stdout: +umount: /tmp/tmp.KrMG67MsYpscratch/merged0: not mounted. 2023-07-06T00:52:24.777 INFO:teuthology.orchestra.run.smithi046.stdout: +mount: /tmp/tmp.KrMG67MsYpscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-07-06T00:52:24.777 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged4/etc/access.conf': No such file or directory 2023-07-06T00:52:24.777 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged4/etc/access.conf': No such file or directory 2023-07-06T00:52:24.777 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged4/etc/access.conf': No such file or directory 2023-07-06T00:52:24.777 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged4/etc/access.conf': No such file or directory 2023-07-06T00:52:24.777 INFO:teuthology.orchestra.run.smithi046.stdout: +umount: /tmp/tmp.KrMG67MsYpscratch/merged4: not mounted. 2023-07-06T00:52:24.777 INFO:teuthology.orchestra.run.smithi046.stdout: +mount: /tmp/tmp.KrMG67MsYpscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-07-06T00:52:24.777 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged1/etc/access.conf': No such file or directory 2023-07-06T00:52:24.778 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged1/etc/access.conf': No such file or directory 2023-07-06T00:52:24.778 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged1/etc/access.conf': No such file or directory 2023-07-06T00:52:24.778 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged1/etc/access.conf': No such file or directory 2023-07-06T00:52:24.778 INFO:teuthology.orchestra.run.smithi046.stdout: +umount: /tmp/tmp.KrMG67MsYpscratch/merged1: not mounted. 2023-07-06T00:52:24.778 INFO:teuthology.orchestra.run.smithi046.stdout: +mount: /tmp/tmp.KrMG67MsYpscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-07-06T00:52:24.778 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged5/etc/access.conf': No such file or directory 2023-07-06T00:52:24.778 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged5/etc/access.conf': No such file or directory 2023-07-06T00:52:24.778 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged5/etc/access.conf': No such file or directory 2023-07-06T00:52:24.779 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged5/etc/access.conf': No such file or directory 2023-07-06T00:52:24.779 INFO:teuthology.orchestra.run.smithi046.stdout: +umount: /tmp/tmp.KrMG67MsYpscratch/merged5: not mounted. 2023-07-06T00:52:24.779 INFO:teuthology.orchestra.run.smithi046.stdout: +mount: /tmp/tmp.KrMG67MsYpscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-07-06T00:52:24.779 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged2/etc/access.conf': No such file or directory 2023-07-06T00:52:24.779 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged2/etc/access.conf': No such file or directory 2023-07-06T00:52:24.779 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged2/etc/access.conf': No such file or directory 2023-07-06T00:52:24.779 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged2/etc/access.conf': No such file or directory 2023-07-06T00:52:24.780 INFO:teuthology.orchestra.run.smithi046.stdout: +umount: /tmp/tmp.KrMG67MsYpscratch/merged2: not mounted. 2023-07-06T00:52:24.780 INFO:teuthology.orchestra.run.smithi046.stdout: +mount: /tmp/tmp.KrMG67MsYpscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-07-06T00:52:24.780 INFO:teuthology.orchestra.run.smithi046.stdout: +mount: /tmp/tmp.KrMG67MsYpscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-07-06T00:52:24.780 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged0/etc/access.conf'cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged3/etc/access.conf': No such file or directory: No such file or directory 2023-07-06T00:52:24.780 INFO:teuthology.orchestra.run.smithi046.stdout: + 2023-07-06T00:52:24.780 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged3/etc/access.conf': No such file or directory 2023-07-06T00:52:24.780 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged0/etc/access.conf': No such file or directory 2023-07-06T00:52:24.780 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged3/etc/access.conf': No such file or directory 2023-07-06T00:52:24.781 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged0/etc/access.conf': No such file or directory 2023-07-06T00:52:24.781 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged3/etc/access.conf'cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged0/etc/access.conf': No such file or directory: No such file or directory 2023-07-06T00:52:24.781 INFO:teuthology.orchestra.run.smithi046.stdout: + 2023-07-06T00:52:24.781 INFO:teuthology.orchestra.run.smithi046.stdout: +umount: umount: /tmp/tmp.KrMG67MsYpscratch/merged0: not mounted./tmp/tmp.KrMG67MsYpscratch/merged3: not mounted. 2023-07-06T00:52:24.781 INFO:teuthology.orchestra.run.smithi046.stdout: + 2023-07-06T00:52:24.781 INFO:teuthology.orchestra.run.smithi046.stdout: +mount: /tmp/tmp.KrMG67MsYpscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-07-06T00:52:24.781 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged4/etc/access.conf': No such file or directory 2023-07-06T00:52:24.781 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged4/etc/access.conf': No such file or directory 2023-07-06T00:52:24.782 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged4/etc/access.conf': No such file or directory 2023-07-06T00:52:24.782 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged4/etc/access.conf': No such file or directory 2023-07-06T00:52:24.782 INFO:teuthology.orchestra.run.smithi046.stdout: +umount: /tmp/tmp.KrMG67MsYpscratch/merged4: not mounted. 2023-07-06T00:52:24.782 INFO:teuthology.orchestra.run.smithi046.stdout: +mount: /tmp/tmp.KrMG67MsYpscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-07-06T00:52:24.782 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged5/etc/access.conf': No such file or directory 2023-07-06T00:52:24.782 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged5/etc/access.conf': No such file or directory 2023-07-06T00:52:24.782 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged5/etc/access.conf': No such file or directory 2023-07-06T00:52:24.782 INFO:teuthology.orchestra.run.smithi046.stdout: +mount: /tmp/tmp.KrMG67MsYpscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-07-06T00:52:24.783 INFO:teuthology.orchestra.run.smithi046.stdout: +mount: touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged5/etc/access.conf': No such file or directory 2023-07-06T00:52:24.783 INFO:teuthology.orchestra.run.smithi046.stdout: +/tmp/tmp.KrMG67MsYpscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-07-06T00:52:24.783 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged2/etc/access.conf': No such file or directory 2023-07-06T00:52:24.783 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged2/etc/access.conf': No such file or directory 2023-07-06T00:52:24.783 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged1/etc/access.conf': No such file or directory 2023-07-06T00:52:24.783 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged2/etc/access.conf': No such file or directory 2023-07-06T00:52:24.783 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged1/etc/access.conf': No such file or directory 2023-07-06T00:52:24.784 INFO:teuthology.orchestra.run.smithi046.stdout: +umount: /tmp/tmp.KrMG67MsYpscratch/merged5: not mounted. 2023-07-06T00:52:24.784 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged2/etc/access.conf': No such file or directory 2023-07-06T00:52:24.784 INFO:teuthology.orchestra.run.smithi046.stdout: +umount: /tmp/tmp.KrMG67MsYpscratch/merged2: not mounted. 2023-07-06T00:52:24.784 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged1/etc/access.conf': No such file or directory 2023-07-06T00:52:24.784 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged1/etc/access.conf': No such file or directory 2023-07-06T00:52:24.784 INFO:teuthology.orchestra.run.smithi046.stdout: +mount: /tmp/tmp.KrMG67MsYpscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-07-06T00:52:24.784 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged3/etc/access.conf': No such file or directory 2023-07-06T00:52:24.784 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged3/etc/access.conf': No such file or directory 2023-07-06T00:52:24.785 INFO:teuthology.orchestra.run.smithi046.stdout: +umount: /tmp/tmp.KrMG67MsYpscratch/merged1: not mounted. 2023-07-06T00:52:24.785 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged3/etc/access.conf': No such file or directory 2023-07-06T00:52:24.785 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged3/etc/access.conf': No such file or directory 2023-07-06T00:52:24.785 INFO:teuthology.orchestra.run.smithi046.stdout: +umount: /tmp/tmp.KrMG67MsYpscratch/merged3: not mounted. 2023-07-06T00:52:24.785 INFO:teuthology.orchestra.run.smithi046.stdout: +mount: /tmp/tmp.KrMG67MsYpscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-07-06T00:52:24.785 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged0/etc/access.conf': No such file or directory 2023-07-06T00:52:24.785 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged0/etc/access.conf': No such file or directory 2023-07-06T00:52:24.785 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged0/etc/access.conf': No such file or directory 2023-07-06T00:52:24.786 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged0/etc/access.conf': No such file or directory 2023-07-06T00:52:24.786 INFO:teuthology.orchestra.run.smithi046.stdout: +umount: /tmp/tmp.KrMG67MsYpscratch/merged0: not mounted. 2023-07-06T00:52:24.786 INFO:teuthology.orchestra.run.smithi046.stdout: +mount: /tmp/tmp.KrMG67MsYpscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-07-06T00:52:24.786 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged4/etc/access.conf': No such file or directory 2023-07-06T00:52:24.786 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged4/etc/access.conf': No such file or directory 2023-07-06T00:52:24.786 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged4/etc/access.conf': No such file or directory 2023-07-06T00:52:24.786 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged4/etc/access.conf': No such file or directory 2023-07-06T00:52:24.786 INFO:teuthology.orchestra.run.smithi046.stdout: +umount: /tmp/tmp.KrMG67MsYpscratch/merged4: not mounted. 2023-07-06T00:52:24.787 INFO:teuthology.orchestra.run.smithi046.stdout: +mount: /tmp/tmp.KrMG67MsYpscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-07-06T00:52:24.787 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged2/etc/access.conf': No such file or directory 2023-07-06T00:52:24.787 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged2/etc/access.conf': No such file or directory 2023-07-06T00:52:24.787 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged2/etc/access.conf': No such file or directory 2023-07-06T00:52:24.787 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged2/etc/access.conf': No such file or directory 2023-07-06T00:52:24.787 INFO:teuthology.orchestra.run.smithi046.stdout: +umount: /tmp/tmp.KrMG67MsYpscratch/merged2: not mounted. 2023-07-06T00:52:24.787 INFO:teuthology.orchestra.run.smithi046.stdout: +mount: /tmp/tmp.KrMG67MsYpscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-07-06T00:52:24.787 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged5/etc/access.conf': No such file or directory 2023-07-06T00:52:24.788 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged5/etc/access.conf': No such file or directory 2023-07-06T00:52:24.788 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged5/etc/access.conf': No such file or directory 2023-07-06T00:52:24.788 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged5/etc/access.conf': No such file or directory 2023-07-06T00:52:24.788 INFO:teuthology.orchestra.run.smithi046.stdout: +umount: /tmp/tmp.KrMG67MsYpscratch/merged5: not mounted. 2023-07-06T00:52:24.788 INFO:teuthology.orchestra.run.smithi046.stdout: +mount: /tmp/tmp.KrMG67MsYpscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-07-06T00:52:24.788 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged3/etc/access.conf': No such file or directory 2023-07-06T00:52:24.788 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged3/etc/access.conf': No such file or directory 2023-07-06T00:52:24.789 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged3/etc/access.conf': No such file or directory 2023-07-06T00:52:24.789 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged3/etc/access.conf': No such file or directory 2023-07-06T00:52:24.789 INFO:teuthology.orchestra.run.smithi046.stdout: +mount: /tmp/tmp.KrMG67MsYpscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-07-06T00:52:24.789 INFO:teuthology.orchestra.run.smithi046.stdout: +umount: /tmp/tmp.KrMG67MsYpscratch/merged3: not mounted. 2023-07-06T00:52:24.789 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged1/etc/access.conf': No such file or directory 2023-07-06T00:52:24.789 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged1/etc/access.conf': No such file or directory 2023-07-06T00:52:24.789 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged1/etc/access.conf': No such file or directory 2023-07-06T00:52:24.789 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged1/etc/access.conf': No such file or directory 2023-07-06T00:52:24.790 INFO:teuthology.orchestra.run.smithi046.stdout: +umount: /tmp/tmp.KrMG67MsYpscratch/merged1: not mounted. 2023-07-06T00:52:24.790 INFO:teuthology.orchestra.run.smithi046.stdout: +mount: /tmp/tmp.KrMG67MsYpscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-07-06T00:52:24.790 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged0/etc/access.conf': No such file or directory 2023-07-06T00:52:24.790 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged0/etc/access.conf': No such file or directory 2023-07-06T00:52:24.790 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged0/etc/access.conf': No such file or directory 2023-07-06T00:52:24.790 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged0/etc/access.conf': No such file or directory 2023-07-06T00:52:24.790 INFO:teuthology.orchestra.run.smithi046.stdout: +umount: /tmp/tmp.KrMG67MsYpscratch/merged0: not mounted. 2023-07-06T00:52:24.790 INFO:teuthology.orchestra.run.smithi046.stdout: +mount: /tmp/tmp.KrMG67MsYpscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-07-06T00:52:24.791 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged4/etc/access.conf': No such file or directory 2023-07-06T00:52:24.791 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged4/etc/access.conf': No such file or directory 2023-07-06T00:52:24.791 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged4/etc/access.conf': No such file or directory 2023-07-06T00:52:24.791 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged4/etc/access.conf': No such file or directory 2023-07-06T00:52:24.791 INFO:teuthology.orchestra.run.smithi046.stdout: +umount: /tmp/tmp.KrMG67MsYpscratch/merged4: not mounted. 2023-07-06T00:52:24.791 INFO:teuthology.orchestra.run.smithi046.stdout: +mount: /tmp/tmp.KrMG67MsYpscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-07-06T00:52:24.791 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged2/etc/access.conf': No such file or directory 2023-07-06T00:52:24.791 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged2/etc/access.conf': No such file or directory 2023-07-06T00:52:24.792 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged2/etc/access.conf': No such file or directory 2023-07-06T00:52:24.792 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged2/etc/access.conf': No such file or directory 2023-07-06T00:52:24.792 INFO:teuthology.orchestra.run.smithi046.stdout: +umount: /tmp/tmp.KrMG67MsYpscratch/merged2: not mounted. 2023-07-06T00:52:24.792 INFO:teuthology.orchestra.run.smithi046.stdout: +mount: /tmp/tmp.KrMG67MsYpscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-07-06T00:52:24.792 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged5/etc/access.conf': No such file or directory 2023-07-06T00:52:24.792 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged5/etc/access.conf': No such file or directory 2023-07-06T00:52:24.792 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged5/etc/access.conf': No such file or directory 2023-07-06T00:52:24.793 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged5/etc/access.conf': No such file or directory 2023-07-06T00:52:24.793 INFO:teuthology.orchestra.run.smithi046.stdout: +umount: /tmp/tmp.KrMG67MsYpscratch/merged5: not mounted. 2023-07-06T00:52:24.793 INFO:teuthology.orchestra.run.smithi046.stdout: +mount: /tmp/tmp.KrMG67MsYpscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-07-06T00:52:24.793 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged3/etc/access.conf': No such file or directory 2023-07-06T00:52:24.793 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged3/etc/access.conf': No such file or directory 2023-07-06T00:52:24.793 INFO:teuthology.orchestra.run.smithi046.stdout: +mount: mv: /tmp/tmp.KrMG67MsYpscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error.cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged3/etc/access.conf' 2023-07-06T00:52:24.793 INFO:teuthology.orchestra.run.smithi046.stdout: +: No such file or directory 2023-07-06T00:52:24.793 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged3/etc/access.conf': No such file or directory 2023-07-06T00:52:24.794 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged0/etc/access.conf': No such file or directory 2023-07-06T00:52:24.794 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged0/etc/access.conf': No such file or directory 2023-07-06T00:52:24.794 INFO:teuthology.orchestra.run.smithi046.stdout: +umount: /tmp/tmp.KrMG67MsYpscratch/merged3: not mounted. 2023-07-06T00:52:24.794 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged0/etc/access.conf': No such file or directory 2023-07-06T00:52:24.794 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged0/etc/access.conf': No such file or directory 2023-07-06T00:52:24.794 INFO:teuthology.orchestra.run.smithi046.stdout: +umount: /tmp/tmp.KrMG67MsYpscratch/merged0: not mounted. 2023-07-06T00:52:24.794 INFO:teuthology.orchestra.run.smithi046.stdout: +mount: /tmp/tmp.KrMG67MsYpscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-07-06T00:52:24.794 INFO:teuthology.orchestra.run.smithi046.stdout: +mount: /tmp/tmp.KrMG67MsYpscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-07-06T00:52:24.795 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged1/etc/access.conf': No such file or directory 2023-07-06T00:52:24.795 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged4/etc/access.conf': No such file or directory 2023-07-06T00:52:24.795 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged4/etc/access.conf': No such file or directory 2023-07-06T00:52:24.795 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged1/etc/access.conf': No such file or directory 2023-07-06T00:52:24.795 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged4/etc/access.conf': No such file or directory 2023-07-06T00:52:24.795 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged1/etc/access.conf': No such file or directory 2023-07-06T00:52:24.795 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged4/etc/access.conf': No such file or directory 2023-07-06T00:52:24.795 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged1/etc/access.conf': No such file or directory 2023-07-06T00:52:24.796 INFO:teuthology.orchestra.run.smithi046.stdout: +umount: /tmp/tmp.KrMG67MsYpscratch/merged4: not mounted. 2023-07-06T00:52:24.796 INFO:teuthology.orchestra.run.smithi046.stdout: +umount: /tmp/tmp.KrMG67MsYpscratch/merged1: not mounted. 2023-07-06T00:52:24.796 INFO:teuthology.orchestra.run.smithi046.stdout: +mount: /tmp/tmp.KrMG67MsYpscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-07-06T00:52:24.796 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged2/etc/access.conf': No such file or directory 2023-07-06T00:52:24.796 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged2/etc/access.conf': No such file or directory 2023-07-06T00:52:24.796 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged2/etc/access.conf': No such file or directory 2023-07-06T00:52:24.796 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged2/etc/access.conf': No such file or directory 2023-07-06T00:52:24.796 INFO:teuthology.orchestra.run.smithi046.stdout: +umount: /tmp/tmp.KrMG67MsYpscratch/merged2: not mounted. 2023-07-06T00:52:24.797 INFO:teuthology.orchestra.run.smithi046.stdout: +mount: /tmp/tmp.KrMG67MsYpscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-07-06T00:52:24.797 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged5/etc/access.conf': No such file or directory 2023-07-06T00:52:24.797 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged5/etc/access.conf': No such file or directory 2023-07-06T00:52:24.797 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged5/etc/access.conf': No such file or directory 2023-07-06T00:52:24.797 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged5/etc/access.conf': No such file or directory 2023-07-06T00:52:24.797 INFO:teuthology.orchestra.run.smithi046.stdout: +umount: /tmp/tmp.KrMG67MsYpscratch/merged5: not mounted. 2023-07-06T00:52:24.797 INFO:teuthology.orchestra.run.smithi046.stdout: +mount: /tmp/tmp.KrMG67MsYpscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-07-06T00:52:24.797 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged3/etc/access.conf': No such file or directory 2023-07-06T00:52:24.798 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged3/etc/access.conf': No such file or directory 2023-07-06T00:52:24.798 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged3/etc/access.conf': No such file or directory 2023-07-06T00:52:24.798 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged3/etc/access.conf': No such file or directory 2023-07-06T00:52:24.798 INFO:teuthology.orchestra.run.smithi046.stdout: +umount: /tmp/tmp.KrMG67MsYpscratch/merged3: not mounted. 2023-07-06T00:52:24.798 INFO:teuthology.orchestra.run.smithi046.stdout: +mount: /tmp/tmp.KrMG67MsYpscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-07-06T00:52:24.798 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged0/etc/access.conf': No such file or directory 2023-07-06T00:52:24.798 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged0/etc/access.conf': No such file or directory 2023-07-06T00:52:24.798 INFO:teuthology.orchestra.run.smithi046.stdout: +mount: /tmp/tmp.KrMG67MsYpscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-07-06T00:52:24.799 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged4/etc/access.conf': No such file or directory 2023-07-06T00:52:24.799 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged0/etc/access.conf': No such file or directory 2023-07-06T00:52:24.799 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged4/etc/access.conf': No such file or directory 2023-07-06T00:52:24.799 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged0/etc/access.conf': No such file or directory 2023-07-06T00:52:24.799 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged4/etc/access.conf': No such file or directory 2023-07-06T00:52:24.799 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged4/etc/access.conf': No such file or directory 2023-07-06T00:52:24.799 INFO:teuthology.orchestra.run.smithi046.stdout: +umount: /tmp/tmp.KrMG67MsYpscratch/merged0: not mounted. 2023-07-06T00:52:24.800 INFO:teuthology.orchestra.run.smithi046.stdout: +umount: /tmp/tmp.KrMG67MsYpscratch/merged4: not mounted. 2023-07-06T00:52:24.800 INFO:teuthology.orchestra.run.smithi046.stdout: +mount: /tmp/tmp.KrMG67MsYpscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-07-06T00:52:24.800 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged1/etc/access.conf': No such file or directory 2023-07-06T00:52:24.800 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged1/etc/access.conf': No such file or directory 2023-07-06T00:52:24.800 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged1/etc/access.conf': No such file or directory 2023-07-06T00:52:24.800 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged1/etc/access.conf': No such file or directory 2023-07-06T00:52:24.800 INFO:teuthology.orchestra.run.smithi046.stdout: +umount: /tmp/tmp.KrMG67MsYpscratch/merged1: not mounted. 2023-07-06T00:52:24.800 INFO:teuthology.orchestra.run.smithi046.stdout: +mount: /tmp/tmp.KrMG67MsYpscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-07-06T00:52:24.801 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged2/etc/access.conf': No such file or directory 2023-07-06T00:52:24.801 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged2/etc/access.conf': No such file or directory 2023-07-06T00:52:24.801 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged2/etc/access.conf': No such file or directory 2023-07-06T00:52:24.801 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged2/etc/access.conf': No such file or directory 2023-07-06T00:52:24.801 INFO:teuthology.orchestra.run.smithi046.stdout: +umount: /tmp/tmp.KrMG67MsYpscratch/merged2: not mounted. 2023-07-06T00:52:24.801 INFO:teuthology.orchestra.run.smithi046.stdout: +mount: /tmp/tmp.KrMG67MsYpscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-07-06T00:52:24.801 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged5/etc/access.conf': No such file or directory 2023-07-06T00:52:24.801 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged5/etc/access.conf': No such file or directory 2023-07-06T00:52:24.802 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged5/etc/access.conf': No such file or directory 2023-07-06T00:52:24.802 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged5/etc/access.conf': No such file or directory 2023-07-06T00:52:24.802 INFO:teuthology.orchestra.run.smithi046.stdout: +umount: /tmp/tmp.KrMG67MsYpscratch/merged5: not mounted. 2023-07-06T00:52:24.802 INFO:teuthology.orchestra.run.smithi046.stdout: +mount: /tmp/tmp.KrMG67MsYpscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-07-06T00:52:24.802 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged3/etc/access.conf': No such file or directory 2023-07-06T00:52:24.802 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged3/etc/access.conf': No such file or directory 2023-07-06T00:52:24.802 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged3/etc/access.conf': No such file or directory 2023-07-06T00:52:24.802 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged3/etc/access.conf': No such file or directory 2023-07-06T00:52:24.803 INFO:teuthology.orchestra.run.smithi046.stdout: +umount: /tmp/tmp.KrMG67MsYpscratch/merged3: not mounted. 2023-07-06T00:52:24.803 INFO:teuthology.orchestra.run.smithi046.stdout: +mount: /tmp/tmp.KrMG67MsYpscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-07-06T00:52:24.803 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged2/etc/access.conf': No such file or directory 2023-07-06T00:52:24.803 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged2/etc/access.conf': No such file or directory 2023-07-06T00:52:24.803 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged2/etc/access.conf': No such file or directory 2023-07-06T00:52:24.803 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged2/etc/access.conf': No such file or directory 2023-07-06T00:52:24.803 INFO:teuthology.orchestra.run.smithi046.stdout: +umount: /tmp/tmp.KrMG67MsYpscratch/merged2: not mounted. 2023-07-06T00:52:24.803 INFO:teuthology.orchestra.run.smithi046.stdout: +mount: /tmp/tmp.KrMG67MsYpscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-07-06T00:52:24.804 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged4/etc/access.conf': No such file or directory 2023-07-06T00:52:24.804 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged4/etc/access.conf': No such file or directory 2023-07-06T00:52:24.804 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged4/etc/access.conf': No such file or directory 2023-07-06T00:52:24.804 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged4/etc/access.conf': No such file or directory 2023-07-06T00:52:24.804 INFO:teuthology.orchestra.run.smithi046.stdout: +umount: /tmp/tmp.KrMG67MsYpscratch/merged4: not mounted. 2023-07-06T00:52:24.804 INFO:teuthology.orchestra.run.smithi046.stdout: +mount: /tmp/tmp.KrMG67MsYpscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-07-06T00:52:24.804 INFO:teuthology.orchestra.run.smithi046.stdout: +mount: /tmp/tmp.KrMG67MsYpscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-07-06T00:52:24.804 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged1/etc/access.conf': No such file or directory 2023-07-06T00:52:24.805 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged1/etc/access.conf': No such file or directory 2023-07-06T00:52:24.805 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged0/etc/access.conf': No such file or directory 2023-07-06T00:52:24.805 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: mv: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged0/etc/access.conf'cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged1/etc/access.conf': No such file or directory 2023-07-06T00:52:24.805 INFO:teuthology.orchestra.run.smithi046.stdout: +: No such file or directory 2023-07-06T00:52:24.805 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged1/etc/access.conf': No such file or directory 2023-07-06T00:52:24.805 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged0/etc/access.conf': No such file or directory 2023-07-06T00:52:24.805 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged0/etc/access.conf': No such file or directory 2023-07-06T00:52:24.805 INFO:teuthology.orchestra.run.smithi046.stdout: +umount: /tmp/tmp.KrMG67MsYpscratch/merged1: not mounted. 2023-07-06T00:52:24.806 INFO:teuthology.orchestra.run.smithi046.stdout: +umount: /tmp/tmp.KrMG67MsYpscratch/merged0: not mounted. 2023-07-06T00:52:24.806 INFO:teuthology.orchestra.run.smithi046.stdout: +mount: /tmp/tmp.KrMG67MsYpscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-07-06T00:52:24.806 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged5/etc/access.conf': No such file or directory 2023-07-06T00:52:24.806 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged5/etc/access.conf': No such file or directory 2023-07-06T00:52:24.806 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged5/etc/access.conf': No such file or directory 2023-07-06T00:52:24.806 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged5/etc/access.conf': No such file or directory 2023-07-06T00:52:24.806 INFO:teuthology.orchestra.run.smithi046.stdout: +umount: /tmp/tmp.KrMG67MsYpscratch/merged5: not mounted. 2023-07-06T00:52:24.806 INFO:teuthology.orchestra.run.smithi046.stdout: +mount: /tmp/tmp.KrMG67MsYpscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-07-06T00:52:24.807 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged2/etc/access.conf': No such file or directory 2023-07-06T00:52:24.807 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged2/etc/access.conf': No such file or directory 2023-07-06T00:52:24.807 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged2/etc/access.conf': No such file or directory 2023-07-06T00:52:24.807 INFO:teuthology.orchestra.run.smithi046.stdout: +mount: /tmp/tmp.KrMG67MsYpscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-07-06T00:52:24.807 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged3/etc/access.conf': No such file or directory 2023-07-06T00:52:24.807 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged3/etc/access.conf': No such file or directory 2023-07-06T00:52:24.807 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged3/etc/access.conf': No such file or directory 2023-07-06T00:52:24.807 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged3/etc/access.conf': No such file or directory 2023-07-06T00:52:24.808 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged2/etc/access.conf': No such file or directory 2023-07-06T00:52:24.808 INFO:teuthology.orchestra.run.smithi046.stdout: +mount: /tmp/tmp.KrMG67MsYpscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-07-06T00:52:24.808 INFO:teuthology.orchestra.run.smithi046.stdout: +umount: /tmp/tmp.KrMG67MsYpscratch/merged3: not mounted. 2023-07-06T00:52:24.808 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged0/etc/access.conf': No such file or directory 2023-07-06T00:52:24.808 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged0/etc/access.conf': No such file or directory 2023-07-06T00:52:24.808 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged0/etc/access.conf': No such file or directory 2023-07-06T00:52:24.808 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged0/etc/access.conf': No such file or directory 2023-07-06T00:52:24.809 INFO:teuthology.orchestra.run.smithi046.stdout: +umount: /tmp/tmp.KrMG67MsYpscratch/merged0: not mounted. 2023-07-06T00:52:24.809 INFO:teuthology.orchestra.run.smithi046.stdout: +umount: /tmp/tmp.KrMG67MsYpscratch/merged2: not mounted. 2023-07-06T00:52:24.809 INFO:teuthology.orchestra.run.smithi046.stdout: +mount: /tmp/tmp.KrMG67MsYpscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-07-06T00:52:24.809 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged5/etc/access.conf': No such file or directory 2023-07-06T00:52:24.809 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged5/etc/access.conf': No such file or directory 2023-07-06T00:52:24.809 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged5/etc/access.conf': No such file or directory 2023-07-06T00:52:24.809 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged5/etc/access.conf': No such file or directory 2023-07-06T00:52:24.809 INFO:teuthology.orchestra.run.smithi046.stdout: +mount: /tmp/tmp.KrMG67MsYpscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-07-06T00:52:24.810 INFO:teuthology.orchestra.run.smithi046.stdout: +umount: /tmp/tmp.KrMG67MsYpscratch/merged5: not mounted. 2023-07-06T00:52:24.810 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged4/etc/access.conf': No such file or directory 2023-07-06T00:52:24.810 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged4/etc/access.conf': No such file or directory 2023-07-06T00:52:24.810 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged4/etc/access.conf': No such file or directory 2023-07-06T00:52:24.810 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged4/etc/access.conf': No such file or directory 2023-07-06T00:52:24.810 INFO:teuthology.orchestra.run.smithi046.stdout: +umount: /tmp/tmp.KrMG67MsYpscratch/merged4: not mounted. 2023-07-06T00:52:24.810 INFO:teuthology.orchestra.run.smithi046.stdout: +mount: /tmp/tmp.KrMG67MsYpscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-07-06T00:52:24.810 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged1/etc/access.conf': No such file or directory 2023-07-06T00:52:24.811 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged1/etc/access.conf': No such file or directory 2023-07-06T00:52:24.811 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged1/etc/access.conf': No such file or directory 2023-07-06T00:52:24.811 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged1/etc/access.conf': No such file or directory 2023-07-06T00:52:24.811 INFO:teuthology.orchestra.run.smithi046.stdout: +umount: /tmp/tmp.KrMG67MsYpscratch/merged1: not mounted. 2023-07-06T00:52:24.811 INFO:teuthology.orchestra.run.smithi046.stdout: +mount: /tmp/tmp.KrMG67MsYpscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-07-06T00:52:24.811 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged0/etc/access.conf': No such file or directory 2023-07-06T00:52:24.811 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged0/etc/access.conf': No such file or directory 2023-07-06T00:52:24.811 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged0/etc/access.conf': No such file or directory 2023-07-06T00:52:24.812 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged0/etc/access.conf': No such file or directory 2023-07-06T00:52:24.812 INFO:teuthology.orchestra.run.smithi046.stdout: +umount: /tmp/tmp.KrMG67MsYpscratch/merged0: not mounted. 2023-07-06T00:52:24.812 INFO:teuthology.orchestra.run.smithi046.stdout: +mount: /tmp/tmp.KrMG67MsYpscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-07-06T00:52:24.812 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged2/etc/access.conf': No such file or directory 2023-07-06T00:52:24.812 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged2/etc/access.conf': No such file or directory 2023-07-06T00:52:24.812 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged2/etc/access.conf': No such file or directory 2023-07-06T00:52:24.812 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged2/etc/access.conf': No such file or directory 2023-07-06T00:52:24.813 INFO:teuthology.orchestra.run.smithi046.stdout: +umount: /tmp/tmp.KrMG67MsYpscratch/merged2: not mounted. 2023-07-06T00:52:24.813 INFO:teuthology.orchestra.run.smithi046.stdout: +mount: mount: mount: mount: /tmp/tmp.KrMG67MsYpscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error./tmp/tmp.KrMG67MsYpscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error./tmp/tmp.KrMG67MsYpscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error./tmp/tmp.KrMG67MsYpscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-07-06T00:52:24.813 INFO:teuthology.orchestra.run.smithi046.stdout: + 2023-07-06T00:52:24.813 INFO:teuthology.orchestra.run.smithi046.stdout: + 2023-07-06T00:52:24.813 INFO:teuthology.orchestra.run.smithi046.stdout: + 2023-07-06T00:52:24.813 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged3/etc/access.conf': No such file or directory 2023-07-06T00:52:24.813 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged5/etc/access.conf': No such file or directory 2023-07-06T00:52:24.813 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged1/etc/access.conf': No such file or directory 2023-07-06T00:52:24.814 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged4/etc/access.conf': No such file or directory 2023-07-06T00:52:24.814 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged3/etc/access.conf': No such file or directory 2023-07-06T00:52:24.814 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged5/etc/access.conf': No such file or directory 2023-07-06T00:52:24.814 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged1/etc/access.conf': No such file or directory 2023-07-06T00:52:24.814 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged4/etc/access.conf': No such file or directory 2023-07-06T00:52:24.814 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged3/etc/access.conf': No such file or directory 2023-07-06T00:52:24.814 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged5/etc/access.conf': No such file or directory 2023-07-06T00:52:24.814 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged1/etc/access.conf': No such file or directory 2023-07-06T00:52:24.815 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged3/etc/access.conf': No such file or directory 2023-07-06T00:52:24.815 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged4/etc/access.conf': No such file or directory 2023-07-06T00:52:24.815 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged5/etc/access.conf': No such file or directory 2023-07-06T00:52:24.815 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged1/etc/access.conf': No such file or directory 2023-07-06T00:52:24.815 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged4/etc/access.conf': No such file or directory 2023-07-06T00:52:24.815 INFO:teuthology.orchestra.run.smithi046.stdout: +umount: /tmp/tmp.KrMG67MsYpscratch/merged3: not mounted. 2023-07-06T00:52:24.815 INFO:teuthology.orchestra.run.smithi046.stdout: +umount: /tmp/tmp.KrMG67MsYpscratch/merged5: not mounted. 2023-07-06T00:52:24.815 INFO:teuthology.orchestra.run.smithi046.stdout: +umount: /tmp/tmp.KrMG67MsYpscratch/merged1: not mounted. 2023-07-06T00:52:24.816 INFO:teuthology.orchestra.run.smithi046.stdout: +umount: /tmp/tmp.KrMG67MsYpscratch/merged4: not mounted. 2023-07-06T00:52:24.816 INFO:teuthology.orchestra.run.smithi046.stdout: +mount: /tmp/tmp.KrMG67MsYpscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-07-06T00:52:24.816 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged3/etc/access.conf': No such file or directory 2023-07-06T00:52:24.816 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged3/etc/access.conf': No such file or directory 2023-07-06T00:52:24.816 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged3/etc/access.conf': No such file or directory 2023-07-06T00:52:24.816 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged3/etc/access.conf': No such file or directory 2023-07-06T00:52:24.816 INFO:teuthology.orchestra.run.smithi046.stdout: +umount: /tmp/tmp.KrMG67MsYpscratch/merged3: not mounted. 2023-07-06T00:52:24.817 INFO:teuthology.orchestra.run.smithi046.stdout: +mount: /tmp/tmp.KrMG67MsYpscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-07-06T00:52:24.817 INFO:teuthology.orchestra.run.smithi046.stdout: +mount: mount: mount: /tmp/tmp.KrMG67MsYpscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error./tmp/tmp.KrMG67MsYpscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error./tmp/tmp.KrMG67MsYpscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-07-06T00:52:24.817 INFO:teuthology.orchestra.run.smithi046.stdout: + 2023-07-06T00:52:24.817 INFO:teuthology.orchestra.run.smithi046.stdout: + 2023-07-06T00:52:24.817 INFO:teuthology.orchestra.run.smithi046.stdout: +mount: /tmp/tmp.KrMG67MsYpscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-07-06T00:52:24.817 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged0/etc/access.conf': No such file or directory 2023-07-06T00:52:24.817 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged4/etc/access.conf': No such file or directory 2023-07-06T00:52:24.817 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged2/etc/access.conf': No such file or directory 2023-07-06T00:52:24.818 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged5/etc/access.conf': No such file or directory 2023-07-06T00:52:24.818 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged0/etc/access.conf': No such file or directory 2023-07-06T00:52:24.818 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged2/etc/access.conf': No such file or directory 2023-07-06T00:52:24.818 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged1/etc/access.conf': No such file or directory 2023-07-06T00:52:24.818 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged5/etc/access.conf': No such file or directory 2023-07-06T00:52:24.818 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: touch: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged0/etc/access.conf'cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged4/etc/access.conf': No such file or directory: No such file or directory 2023-07-06T00:52:24.818 INFO:teuthology.orchestra.run.smithi046.stdout: + 2023-07-06T00:52:24.818 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged1/etc/access.conf': No such file or directory 2023-07-06T00:52:24.819 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged2/etc/access.conf': No such file or directory 2023-07-06T00:52:24.819 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged5/etc/access.conf': No such file or directory 2023-07-06T00:52:24.819 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged0/etc/access.conf': No such file or directory 2023-07-06T00:52:24.819 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged2/etc/access.conf': No such file or directory 2023-07-06T00:52:24.819 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged1/etc/access.conf': No such file or directory 2023-07-06T00:52:24.819 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged5/etc/access.conf': No such file or directory 2023-07-06T00:52:24.819 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged4/etc/access.conf': No such file or directory 2023-07-06T00:52:24.820 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged1/etc/access.conf': No such file or directory 2023-07-06T00:52:24.820 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged4/etc/access.conf': No such file or directory 2023-07-06T00:52:24.820 INFO:teuthology.orchestra.run.smithi046.stdout: +umount: /tmp/tmp.KrMG67MsYpscratch/merged0: not mounted.umount: 2023-07-06T00:52:24.820 INFO:teuthology.orchestra.run.smithi046.stdout: +/tmp/tmp.KrMG67MsYpscratch/merged5: not mounted. 2023-07-06T00:52:24.820 INFO:teuthology.orchestra.run.smithi046.stdout: +umount: /tmp/tmp.KrMG67MsYpscratch/merged1: not mounted. 2023-07-06T00:52:24.820 INFO:teuthology.orchestra.run.smithi046.stdout: +umount: /tmp/tmp.KrMG67MsYpscratch/merged4: not mounted. 2023-07-06T00:52:24.820 INFO:teuthology.orchestra.run.smithi046.stdout: +umount: /tmp/tmp.KrMG67MsYpscratch/merged2: not mounted. 2023-07-06T00:52:24.820 INFO:teuthology.orchestra.run.smithi046.stdout: +mount: /tmp/tmp.KrMG67MsYpscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-07-06T00:52:24.821 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged5/etc/access.conf': No such file or directory 2023-07-06T00:52:24.821 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged5/etc/access.conf': No such file or directory 2023-07-06T00:52:24.821 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged5/etc/access.conf': No such file or directory 2023-07-06T00:52:24.821 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged5/etc/access.conf': No such file or directory 2023-07-06T00:52:24.821 INFO:teuthology.orchestra.run.smithi046.stdout: +umount: /tmp/tmp.KrMG67MsYpscratch/merged5: not mounted. 2023-07-06T00:52:24.821 INFO:teuthology.orchestra.run.smithi046.stdout: +mount: mount: /tmp/tmp.KrMG67MsYpscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error.mount: /tmp/tmp.KrMG67MsYpscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-07-06T00:52:24.822 INFO:teuthology.orchestra.run.smithi046.stdout: +/tmp/tmp.KrMG67MsYpscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-07-06T00:52:24.822 INFO:teuthology.orchestra.run.smithi046.stdout: + 2023-07-06T00:52:24.822 INFO:teuthology.orchestra.run.smithi046.stdout: +mount: /tmp/tmp.KrMG67MsYpscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-07-06T00:52:24.822 INFO:teuthology.orchestra.run.smithi046.stdout: +mount: /tmp/tmp.KrMG67MsYpscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-07-06T00:52:24.822 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged4/etc/access.conf': No such file or directory 2023-07-06T00:52:24.822 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged2/etc/access.conf'mv: : No such file or directorymv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged0/etc/access.conf' 2023-07-06T00:52:24.823 INFO:teuthology.orchestra.run.smithi046.stdout: +cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged3/etc/access.conf': No such file or directory: No such file or directory 2023-07-06T00:52:24.823 INFO:teuthology.orchestra.run.smithi046.stdout: + 2023-07-06T00:52:24.823 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged4/etc/access.conf': No such file or directory 2023-07-06T00:52:24.823 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged2/etc/access.conf': No such file or directory 2023-07-06T00:52:24.823 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged3/etc/access.conf': No such file or directory 2023-07-06T00:52:24.823 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged0/etc/access.conf': No such file or directory 2023-07-06T00:52:24.823 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged2/etc/access.conf': No such file or directory 2023-07-06T00:52:24.824 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged4/etc/access.conf': No such file or directory 2023-07-06T00:52:24.824 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged3/etc/access.conf': No such file or directory 2023-07-06T00:52:24.824 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged0/etc/access.conf': No such file or directory 2023-07-06T00:52:24.824 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged2/etc/access.conf': No such file or directory 2023-07-06T00:52:24.824 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged4/etc/access.conf': No such file or directory 2023-07-06T00:52:24.824 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged3/etc/access.conf': No such file or directory 2023-07-06T00:52:24.824 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged0/etc/access.conf': No such file or directory 2023-07-06T00:52:24.824 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged1/etc/access.conf': No such file or directory 2023-07-06T00:52:24.825 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged1/etc/access.conf': No such file or directory 2023-07-06T00:52:24.825 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged1/etc/access.conf': No such file or directory 2023-07-06T00:52:24.825 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged1/etc/access.conf': No such file or directory 2023-07-06T00:52:24.825 INFO:teuthology.orchestra.run.smithi046.stdout: +umount: /tmp/tmp.KrMG67MsYpscratch/merged2: not mounted. 2023-07-06T00:52:24.825 INFO:teuthology.orchestra.run.smithi046.stdout: +umount: /tmp/tmp.KrMG67MsYpscratch/merged3: not mounted. 2023-07-06T00:52:24.825 INFO:teuthology.orchestra.run.smithi046.stdout: +umount: /tmp/tmp.KrMG67MsYpscratch/merged1: not mounted. 2023-07-06T00:52:24.825 INFO:teuthology.orchestra.run.smithi046.stdout: +umount: /tmp/tmp.KrMG67MsYpscratch/merged0: not mounted. 2023-07-06T00:52:24.825 INFO:teuthology.orchestra.run.smithi046.stdout: +umount: /tmp/tmp.KrMG67MsYpscratch/merged4: not mounted. 2023-07-06T00:52:24.826 INFO:teuthology.orchestra.run.smithi046.stdout: +mount: /tmp/tmp.KrMG67MsYpscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-07-06T00:52:24.826 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged1/etc/access.conf': No such file or directory 2023-07-06T00:52:24.826 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged1/etc/access.conf': No such file or directory 2023-07-06T00:52:24.826 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged1/etc/access.conf': No such file or directory 2023-07-06T00:52:24.826 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged1/etc/access.conf': No such file or directory 2023-07-06T00:52:24.826 INFO:teuthology.orchestra.run.smithi046.stdout: +umount: /tmp/tmp.KrMG67MsYpscratch/merged1: not mounted. 2023-07-06T00:52:24.826 INFO:teuthology.orchestra.run.smithi046.stdout: +mount: mount: /tmp/tmp.KrMG67MsYpscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error./tmp/tmp.KrMG67MsYpscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-07-06T00:52:24.827 INFO:teuthology.orchestra.run.smithi046.stdout: + 2023-07-06T00:52:24.827 INFO:teuthology.orchestra.run.smithi046.stdout: +mount: /tmp/tmp.KrMG67MsYpscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-07-06T00:52:24.827 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged2/etc/access.conf': No such file or directory 2023-07-06T00:52:24.827 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged0/etc/access.conf': No such file or directory 2023-07-06T00:52:24.827 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged2/etc/access.conf': No such file or directory 2023-07-06T00:52:24.827 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged0/etc/access.conf': No such file or directory 2023-07-06T00:52:24.827 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged3/etc/access.conf': No such file or directory 2023-07-06T00:52:24.827 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged0/etc/access.conf': No such file or directory 2023-07-06T00:52:24.828 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged3/etc/access.conf': No such file or directory 2023-07-06T00:52:24.828 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged0/etc/access.conf': No such file or directory 2023-07-06T00:52:24.828 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged2/etc/access.conf': No such file or directory 2023-07-06T00:52:24.828 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged3/etc/access.conf': No such file or directory 2023-07-06T00:52:24.828 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged2/etc/access.conf': No such file or directory 2023-07-06T00:52:24.828 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged3/etc/access.conf': No such file or directory 2023-07-06T00:52:24.828 INFO:teuthology.orchestra.run.smithi046.stdout: +mount: /tmp/tmp.KrMG67MsYpscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-07-06T00:52:24.828 INFO:teuthology.orchestra.run.smithi046.stdout: +umount: /tmp/tmp.KrMG67MsYpscratch/merged0: not mounted. 2023-07-06T00:52:24.829 INFO:teuthology.orchestra.run.smithi046.stdout: +umount: /tmp/tmp.KrMG67MsYpscratch/merged2: not mounted. 2023-07-06T00:52:24.829 INFO:teuthology.orchestra.run.smithi046.stdout: +umount: /tmp/tmp.KrMG67MsYpscratch/merged3: not mounted. 2023-07-06T00:52:24.829 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged5/etc/access.conf': No such file or directory 2023-07-06T00:52:24.829 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged5/etc/access.conf': No such file or directory 2023-07-06T00:52:24.829 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged5/etc/access.conf': No such file or directory 2023-07-06T00:52:24.829 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged5/etc/access.conf': No such file or directory 2023-07-06T00:52:24.829 INFO:teuthology.orchestra.run.smithi046.stdout: +umount: /tmp/tmp.KrMG67MsYpscratch/merged5: not mounted. 2023-07-06T00:52:24.829 INFO:teuthology.orchestra.run.smithi046.stdout: +mount: /tmp/tmp.KrMG67MsYpscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-07-06T00:52:24.830 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged4/etc/access.conf': No such file or directory 2023-07-06T00:52:24.830 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged4/etc/access.conf': No such file or directory 2023-07-06T00:52:24.830 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged4/etc/access.conf': No such file or directory 2023-07-06T00:52:24.830 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged4/etc/access.conf': No such file or directory 2023-07-06T00:52:24.830 INFO:teuthology.orchestra.run.smithi046.stdout: +umount: /tmp/tmp.KrMG67MsYpscratch/merged4: not mounted. 2023-07-06T00:52:24.830 INFO:teuthology.orchestra.run.smithi046.stdout: +mount: /tmp/tmp.KrMG67MsYpscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-07-06T00:52:24.830 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged1/etc/access.conf': No such file or directory 2023-07-06T00:52:24.831 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged1/etc/access.conf': No such file or directory 2023-07-06T00:52:24.831 INFO:teuthology.orchestra.run.smithi046.stdout: +mount: mount: /tmp/tmp.KrMG67MsYpscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error./tmp/tmp.KrMG67MsYpscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-07-06T00:52:24.831 INFO:teuthology.orchestra.run.smithi046.stdout: + 2023-07-06T00:52:24.831 INFO:teuthology.orchestra.run.smithi046.stdout: +mount: /tmp/tmp.KrMG67MsYpscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-07-06T00:52:24.831 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged3/etc/access.conf'cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged5/etc/access.conf': No such file or directory: No such file or directory 2023-07-06T00:52:24.831 INFO:teuthology.orchestra.run.smithi046.stdout: + 2023-07-06T00:52:24.831 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged2/etc/access.conf': No such file or directory 2023-07-06T00:52:24.831 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged5/etc/access.conf': No such file or directory 2023-07-06T00:52:24.832 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged1/etc/access.conf': No such file or directory 2023-07-06T00:52:24.832 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged2/etc/access.conf': No such file or directory 2023-07-06T00:52:24.832 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged1/etc/access.conf': No such file or directory 2023-07-06T00:52:24.832 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged3/etc/access.conf': No such file or directory 2023-07-06T00:52:24.832 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged5/etc/access.conf': No such file or directory 2023-07-06T00:52:24.832 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged2/etc/access.conf': No such file or directory 2023-07-06T00:52:24.832 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged5/etc/access.conf': No such file or directory 2023-07-06T00:52:24.833 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged3/etc/access.conf': No such file or directory 2023-07-06T00:52:24.833 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged2/etc/access.conf': No such file or directory 2023-07-06T00:52:24.833 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged3/etc/access.conf': No such file or directory 2023-07-06T00:52:24.833 INFO:teuthology.orchestra.run.smithi046.stdout: +umount: /tmp/tmp.KrMG67MsYpscratch/merged1: not mounted. 2023-07-06T00:52:24.833 INFO:teuthology.orchestra.run.smithi046.stdout: +umount: /tmp/tmp.KrMG67MsYpscratch/merged5: not mounted. 2023-07-06T00:52:24.833 INFO:teuthology.orchestra.run.smithi046.stdout: +umount: /tmp/tmp.KrMG67MsYpscratch/merged2: not mounted. 2023-07-06T00:52:24.833 INFO:teuthology.orchestra.run.smithi046.stdout: +umount: /tmp/tmp.KrMG67MsYpscratch/merged3: not mounted. 2023-07-06T00:52:24.833 INFO:teuthology.orchestra.run.smithi046.stdout: +mount: /tmp/tmp.KrMG67MsYpscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-07-06T00:52:24.834 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged0/etc/access.conf': No such file or directory 2023-07-06T00:52:24.834 INFO:teuthology.orchestra.run.smithi046.stdout: +mount: /tmp/tmp.KrMG67MsYpscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-07-06T00:52:24.834 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged0/etc/access.conf': No such file or directory 2023-07-06T00:52:24.834 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged0/etc/access.conf': No such file or directory 2023-07-06T00:52:24.834 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged0/etc/access.conf': No such file or directory 2023-07-06T00:52:24.834 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged4/etc/access.conf': No such file or directory 2023-07-06T00:52:24.834 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged4/etc/access.conf': No such file or directory 2023-07-06T00:52:24.834 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged4/etc/access.conf': No such file or directory 2023-07-06T00:52:24.835 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged4/etc/access.conf': No such file or directory 2023-07-06T00:52:24.835 INFO:teuthology.orchestra.run.smithi046.stdout: +umount: /tmp/tmp.KrMG67MsYpscratch/merged0: not mounted. 2023-07-06T00:52:24.835 INFO:teuthology.orchestra.run.smithi046.stdout: +umount: /tmp/tmp.KrMG67MsYpscratch/merged4: not mounted. 2023-07-06T00:52:24.835 INFO:teuthology.orchestra.run.smithi046.stdout: +mount: /tmp/tmp.KrMG67MsYpscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-07-06T00:52:24.835 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged4/etc/access.conf': No such file or directory 2023-07-06T00:52:24.835 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged4/etc/access.conf': No such file or directory 2023-07-06T00:52:24.835 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged4/etc/access.conf': No such file or directory 2023-07-06T00:52:24.835 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged4/etc/access.conf': No such file or directory 2023-07-06T00:52:24.836 INFO:teuthology.orchestra.run.smithi046.stdout: +umount: /tmp/tmp.KrMG67MsYpscratch/merged4: not mounted. 2023-07-06T00:52:24.836 INFO:teuthology.orchestra.run.smithi046.stdout: +mount: /tmp/tmp.KrMG67MsYpscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-07-06T00:52:24.836 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged0/etc/access.conf': No such file or directory 2023-07-06T00:52:24.836 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged0/etc/access.conf': No such file or directory 2023-07-06T00:52:24.836 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged0/etc/access.conf': No such file or directory 2023-07-06T00:52:24.836 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged0/etc/access.conf': No such file or directory 2023-07-06T00:52:24.836 INFO:teuthology.orchestra.run.smithi046.stdout: +umount: /tmp/tmp.KrMG67MsYpscratch/merged0: not mounted. 2023-07-06T00:52:24.837 INFO:teuthology.orchestra.run.smithi046.stdout: +mount: /tmp/tmp.KrMG67MsYpscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-07-06T00:52:24.837 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged3/etc/access.conf': No such file or directory 2023-07-06T00:52:24.837 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged3/etc/access.conf': No such file or directory 2023-07-06T00:52:24.837 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged3/etc/access.conf': No such file or directory 2023-07-06T00:52:24.837 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged3/etc/access.conf': No such file or directory 2023-07-06T00:52:24.837 INFO:teuthology.orchestra.run.smithi046.stdout: +umount: /tmp/tmp.KrMG67MsYpscratch/merged3: not mounted. 2023-07-06T00:52:24.837 INFO:teuthology.orchestra.run.smithi046.stdout: +mount: mount: /tmp/tmp.KrMG67MsYpscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error./tmp/tmp.KrMG67MsYpscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-07-06T00:52:24.837 INFO:teuthology.orchestra.run.smithi046.stdout: + 2023-07-06T00:52:24.838 INFO:teuthology.orchestra.run.smithi046.stdout: +mount: /tmp/tmp.KrMG67MsYpscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-07-06T00:52:24.838 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged1/etc/access.conf'mv: : No such file or directorycannot stat '/tmp/tmp.KrMG67MsYpscratch/merged5/etc/access.conf' 2023-07-06T00:52:24.838 INFO:teuthology.orchestra.run.smithi046.stdout: +: No such file or directory 2023-07-06T00:52:24.838 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged1/etc/access.conf': No such file or directory 2023-07-06T00:52:24.838 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged5/etc/access.conf': No such file or directory 2023-07-06T00:52:24.838 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged1/etc/access.conf': No such file or directory 2023-07-06T00:52:24.838 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged5/etc/access.conf': No such file or directory 2023-07-06T00:52:24.839 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged1/etc/access.conf': No such file or directory 2023-07-06T00:52:24.839 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged5/etc/access.conf': No such file or directory 2023-07-06T00:52:24.839 INFO:teuthology.orchestra.run.smithi046.stdout: +umount: /tmp/tmp.KrMG67MsYpscratch/merged1: not mounted. 2023-07-06T00:52:24.839 INFO:teuthology.orchestra.run.smithi046.stdout: +umount: /tmp/tmp.KrMG67MsYpscratch/merged5: not mounted. 2023-07-06T00:52:24.839 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged2/etc/access.conf': No such file or directory 2023-07-06T00:52:24.839 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged2/etc/access.conf': No such file or directory 2023-07-06T00:52:24.839 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged2/etc/access.conf': No such file or directory 2023-07-06T00:52:24.839 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged2/etc/access.conf': No such file or directory 2023-07-06T00:52:24.840 INFO:teuthology.orchestra.run.smithi046.stdout: +umount: /tmp/tmp.KrMG67MsYpscratch/merged2: not mounted. 2023-07-06T00:52:24.840 INFO:teuthology.orchestra.run.smithi046.stdout: +mount: /tmp/tmp.KrMG67MsYpscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-07-06T00:52:24.840 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged0/etc/access.conf': No such file or directory 2023-07-06T00:52:24.840 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged0/etc/access.conf': No such file or directory 2023-07-06T00:52:24.840 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged0/etc/access.conf': No such file or directory 2023-07-06T00:52:24.840 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged0/etc/access.conf': No such file or directory 2023-07-06T00:52:24.840 INFO:teuthology.orchestra.run.smithi046.stdout: +umount: /tmp/tmp.KrMG67MsYpscratch/merged0: not mounted. 2023-07-06T00:52:24.841 INFO:teuthology.orchestra.run.smithi046.stdout: +mount: /tmp/tmp.KrMG67MsYpscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-07-06T00:52:24.841 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged4/etc/access.conf': No such file or directory 2023-07-06T00:52:24.841 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged4/etc/access.conf': No such file or directory 2023-07-06T00:52:24.841 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged4/etc/access.conf': No such file or directory 2023-07-06T00:52:24.841 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged4/etc/access.conf': No such file or directory 2023-07-06T00:52:24.841 INFO:teuthology.orchestra.run.smithi046.stdout: +umount: /tmp/tmp.KrMG67MsYpscratch/merged4: not mounted. 2023-07-06T00:52:24.841 INFO:teuthology.orchestra.run.smithi046.stdout: +mount: /tmp/tmp.KrMG67MsYpscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-07-06T00:52:24.841 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged1/etc/access.conf': No such file or directory 2023-07-06T00:52:24.842 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged1/etc/access.conf': No such file or directory 2023-07-06T00:52:24.842 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged1/etc/access.conf': No such file or directory 2023-07-06T00:52:24.842 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged1/etc/access.conf': No such file or directory 2023-07-06T00:52:24.842 INFO:teuthology.orchestra.run.smithi046.stdout: +umount: /tmp/tmp.KrMG67MsYpscratch/merged1: not mounted. 2023-07-06T00:52:24.842 INFO:teuthology.orchestra.run.smithi046.stdout: +mount: /tmp/tmp.KrMG67MsYpscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-07-06T00:52:24.842 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged5/etc/access.conf': No such file or directory 2023-07-06T00:52:24.842 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged5/etc/access.conf': No such file or directory 2023-07-06T00:52:24.842 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged5/etc/access.conf': No such file or directory 2023-07-06T00:52:24.843 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged5/etc/access.conf': No such file or directory 2023-07-06T00:52:24.843 INFO:teuthology.orchestra.run.smithi046.stdout: +umount: /tmp/tmp.KrMG67MsYpscratch/merged5: not mounted. 2023-07-06T00:52:24.843 INFO:teuthology.orchestra.run.smithi046.stdout: +mount: /tmp/tmp.KrMG67MsYpscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-07-06T00:52:24.843 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged3/etc/access.conf': No such file or directory 2023-07-06T00:52:24.843 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged3/etc/access.conf': No such file or directory 2023-07-06T00:52:24.843 INFO:teuthology.orchestra.run.smithi046.stdout: +mv: cannot stat '/tmp/tmp.KrMG67MsYpscratch/merged3/etc/access.conf': No such file or directory 2023-07-06T00:52:24.843 INFO:teuthology.orchestra.run.smithi046.stdout: +touch: cannot touch '/tmp/tmp.KrMG67MsYpscratch/merged3/etc/access.conf': No such file or directory 2023-07-06T00:52:24.843 INFO:teuthology.orchestra.run.smithi046.stdout: +umount: /tmp/tmp.KrMG67MsYpscratch/merged3: not mounted. 2023-07-06T00:52:24.844 INFO:teuthology.orchestra.run.smithi046.stdout: Silence is golden. 2023-07-06T00:52:24.844 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-06T00:52:24.844 INFO:teuthology.orchestra.run.smithi046.stdout:HINT: You _MAY_ be missing kernel fix: 2023-07-06T00:52:24.844 INFO:teuthology.orchestra.run.smithi046.stdout: 6da1b4b1ab36 xfs: fix an ABBA deadlock in xfs_rename 2023-07-06T00:52:24.844 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-06T00:52:24.844 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/631 2023-07-06T00:52:24.844 INFO:teuthology.orchestra.run.smithi046.stdout:Failures: generic/631 2023-07-06T00:52:24.845 INFO:teuthology.orchestra.run.smithi046.stdout:Failed 1 of 1 tests 2023-07-06T00:52:24.845 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-06T00:52:24.846 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-07-06T00:52:24.846 INFO:tasks.cephfs.xfstests_dev:Command failed 2023-07-06T00:52:24.847 INFO:tasks.cephfs.xfstests_dev:Command return value: 1 2023-07-06T00:52:24.847 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.rlt8E1h3iVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/632) 2023-07-06T00:52:25.095 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph 2023-07-06T00:52:25.099 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-06T00:52:25.100 INFO:teuthology.orchestra.run.smithi046.stdout:MKFS_OPTIONS -- 172.21.15.46:6789:/scratch 2023-07-06T00:52:25.100 INFO:teuthology.orchestra.run.smithi046.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCbvKVkpp1TIhAAvJTELoeH8wkIFqjtppg17w== -o context=system_u:object_r:root_t:s0 172.21.15.46:6789:/scratch /tmp/tmp.KrMG67MsYpscratch 2023-07-06T00:52:25.101 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-06T00:53:07.797 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-06T00:53:07.800 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-06T00:53:37.918 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-06T00:53:37.921 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-06T00:53:54.605 INFO:teuthology.orchestra.run.smithi046.stdout:generic/632 89s 2023-07-06T00:53:54.611 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/632 2023-07-06T00:53:54.611 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-07-06T00:53:54.614 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-06T00:53:54.647 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-06T00:53:54.648 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.rlt8E1h3iVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/633) 2023-07-06T00:53:54.878 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph 2023-07-06T00:53:54.882 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-06T00:53:54.883 INFO:teuthology.orchestra.run.smithi046.stdout:MKFS_OPTIONS -- 172.21.15.46:6789:/scratch 2023-07-06T00:53:54.883 INFO:teuthology.orchestra.run.smithi046.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCbvKVkpp1TIhAAvJTELoeH8wkIFqjtppg17w== -o context=system_u:object_r:root_t:s0 172.21.15.46:6789:/scratch /tmp/tmp.KrMG67MsYpscratch 2023-07-06T00:53:54.884 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-06T00:53:55.617 INFO:teuthology.orchestra.run.smithi046.stdout:generic/633 0s 2023-07-06T00:53:55.622 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/633 2023-07-06T00:53:55.622 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-07-06T00:53:55.624 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-06T00:53:55.958 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-06T00:53:55.959 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.rlt8E1h3iVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/634) 2023-07-06T00:53:56.276 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph 2023-07-06T00:53:56.280 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-06T00:53:56.281 INFO:teuthology.orchestra.run.smithi046.stdout:MKFS_OPTIONS -- 172.21.15.46:6789:/scratch 2023-07-06T00:53:56.282 INFO:teuthology.orchestra.run.smithi046.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCbvKVkpp1TIhAAvJTELoeH8wkIFqjtppg17w== -o context=system_u:object_r:root_t:s0 172.21.15.46:6789:/scratch /tmp/tmp.KrMG67MsYpscratch 2023-07-06T00:53:56.282 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-06T00:53:57.521 INFO:teuthology.orchestra.run.smithi046.stdout:generic/634 1s 2023-07-06T00:53:57.526 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/634 2023-07-06T00:53:57.527 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-07-06T00:53:57.529 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-06T00:53:57.537 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-06T00:53:57.538 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.rlt8E1h3iVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/635) 2023-07-06T00:53:57.773 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph 2023-07-06T00:53:57.778 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-06T00:53:57.778 INFO:teuthology.orchestra.run.smithi046.stdout:MKFS_OPTIONS -- 172.21.15.46:6789:/scratch 2023-07-06T00:53:57.779 INFO:teuthology.orchestra.run.smithi046.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCbvKVkpp1TIhAAvJTELoeH8wkIFqjtppg17w== -o context=system_u:object_r:root_t:s0 172.21.15.46:6789:/scratch /tmp/tmp.KrMG67MsYpscratch 2023-07-06T00:53:57.779 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-06T00:53:58.333 INFO:teuthology.orchestra.run.smithi046.stdout:generic/635 [not run] ceph does not support shutdown 2023-07-06T00:53:58.353 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/635 2023-07-06T00:53:58.353 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/635 2023-07-06T00:53:58.354 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-07-06T00:53:58.355 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-06T00:53:58.390 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-06T00:53:58.391 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.rlt8E1h3iVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/636) 2023-07-06T00:53:58.625 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph 2023-07-06T00:53:58.629 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-06T00:53:58.630 INFO:teuthology.orchestra.run.smithi046.stdout:MKFS_OPTIONS -- 172.21.15.46:6789:/scratch 2023-07-06T00:53:58.631 INFO:teuthology.orchestra.run.smithi046.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCbvKVkpp1TIhAAvJTELoeH8wkIFqjtppg17w== -o context=system_u:object_r:root_t:s0 172.21.15.46:6789:/scratch /tmp/tmp.KrMG67MsYpscratch 2023-07-06T00:53:58.631 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-06T00:53:59.254 INFO:teuthology.orchestra.run.smithi046.stdout:generic/636 [not run] swapfiles are not supported 2023-07-06T00:53:59.258 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/636 2023-07-06T00:53:59.259 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/636 2023-07-06T00:53:59.259 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-07-06T00:53:59.260 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-06T00:53:59.297 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-06T00:53:59.328 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.rlt8E1h3iVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/637) 2023-07-06T00:53:59.564 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph 2023-07-06T00:53:59.569 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-06T00:53:59.569 INFO:teuthology.orchestra.run.smithi046.stdout:MKFS_OPTIONS -- 172.21.15.46:6789:/scratch 2023-07-06T00:53:59.570 INFO:teuthology.orchestra.run.smithi046.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCbvKVkpp1TIhAAvJTELoeH8wkIFqjtppg17w== -o context=system_u:object_r:root_t:s0 172.21.15.46:6789:/scratch /tmp/tmp.KrMG67MsYpscratch 2023-07-06T00:53:59.570 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-06T00:54:00.283 INFO:teuthology.orchestra.run.smithi046.stdout:generic/637 1s 2023-07-06T00:54:00.288 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/637 2023-07-06T00:54:00.289 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-07-06T00:54:00.291 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-06T00:54:00.759 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-06T00:54:00.760 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.rlt8E1h3iVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/638) 2023-07-06T00:54:01.020 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph 2023-07-06T00:54:01.024 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-06T00:54:01.024 INFO:teuthology.orchestra.run.smithi046.stdout:MKFS_OPTIONS -- 172.21.15.46:6789:/scratch 2023-07-06T00:54:01.025 INFO:teuthology.orchestra.run.smithi046.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCbvKVkpp1TIhAAvJTELoeH8wkIFqjtppg17w== -o context=system_u:object_r:root_t:s0 172.21.15.46:6789:/scratch /tmp/tmp.KrMG67MsYpscratch 2023-07-06T00:54:01.025 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-06T00:54:01.433 INFO:teuthology.orchestra.run.smithi046.stdout:generic/638 0s 2023-07-06T00:54:01.438 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/638 2023-07-06T00:54:01.438 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-07-06T00:54:01.440 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-06T00:54:01.474 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-06T00:54:01.475 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.rlt8E1h3iVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/639) 2023-07-06T00:54:01.699 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph 2023-07-06T00:54:01.703 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-06T00:54:01.703 INFO:teuthology.orchestra.run.smithi046.stdout:MKFS_OPTIONS -- 172.21.15.46:6789:/scratch 2023-07-06T00:54:01.704 INFO:teuthology.orchestra.run.smithi046.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCbvKVkpp1TIhAAvJTELoeH8wkIFqjtppg17w== -o context=system_u:object_r:root_t:s0 172.21.15.46:6789:/scratch /tmp/tmp.KrMG67MsYpscratch 2023-07-06T00:54:01.704 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-06T00:54:02.249 INFO:teuthology.orchestra.run.smithi046.stdout:generic/639 1s 2023-07-06T00:54:02.254 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/639 2023-07-06T00:54:02.255 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-07-06T00:54:02.258 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-06T00:54:02.300 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-06T00:54:02.301 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.rlt8E1h3iVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/640) 2023-07-06T00:54:02.522 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph 2023-07-06T00:54:02.526 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-06T00:54:02.527 INFO:teuthology.orchestra.run.smithi046.stdout:MKFS_OPTIONS -- 172.21.15.46:6789:/scratch 2023-07-06T00:54:02.527 INFO:teuthology.orchestra.run.smithi046.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCbvKVkpp1TIhAAvJTELoeH8wkIFqjtppg17w== -o context=system_u:object_r:root_t:s0 172.21.15.46:6789:/scratch /tmp/tmp.KrMG67MsYpscratch 2023-07-06T00:54:02.528 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-06T00:54:02.885 INFO:teuthology.orchestra.run.smithi046.stdout:generic/640 [not run] require 172.21.15.46:6789:/scratch to be valid block disk 2023-07-06T00:54:02.889 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/640 2023-07-06T00:54:02.889 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/640 2023-07-06T00:54:02.889 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-07-06T00:54:02.891 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-06T00:54:02.916 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-06T00:54:02.917 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.rlt8E1h3iVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/641) 2023-07-06T00:54:03.156 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph 2023-07-06T00:54:03.161 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-06T00:54:03.161 INFO:teuthology.orchestra.run.smithi046.stdout:MKFS_OPTIONS -- 172.21.15.46:6789:/scratch 2023-07-06T00:54:03.162 INFO:teuthology.orchestra.run.smithi046.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCbvKVkpp1TIhAAvJTELoeH8wkIFqjtppg17w== -o context=system_u:object_r:root_t:s0 172.21.15.46:6789:/scratch /tmp/tmp.KrMG67MsYpscratch 2023-07-06T00:54:03.162 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-06T00:54:03.760 INFO:teuthology.orchestra.run.smithi046.stdout:generic/641 [not run] swapfiles are not supported 2023-07-06T00:54:03.764 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/641 2023-07-06T00:54:03.765 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/641 2023-07-06T00:54:03.765 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-07-06T00:54:03.766 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-06T00:54:03.800 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-06T00:54:03.801 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.rlt8E1h3iVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/642) 2023-07-06T00:54:04.038 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph 2023-07-06T00:54:04.042 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-06T00:54:04.043 INFO:teuthology.orchestra.run.smithi046.stdout:MKFS_OPTIONS -- 172.21.15.46:6789:/scratch 2023-07-06T00:54:04.044 INFO:teuthology.orchestra.run.smithi046.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCbvKVkpp1TIhAAvJTELoeH8wkIFqjtppg17w== -o context=system_u:object_r:root_t:s0 172.21.15.46:6789:/scratch /tmp/tmp.KrMG67MsYpscratch 2023-07-06T00:54:04.044 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-06T00:54:08.065 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-06T00:54:08.068 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-06T00:54:38.215 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-06T00:54:38.218 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-06T00:55:08.642 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-06T00:55:08.644 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-06T00:55:08.687 INFO:tasks.ceph.mds.b.smithi073.stderr:2023-07-06T00:55:08.685+0000 7f1ff165c700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 127120) UID: 0 2023-07-06T00:55:08.687 INFO:tasks.ceph.mds.d.smithi073.stderr:2023-07-06T00:55:08.685+0000 7f07b5126700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 127120) UID: 0 2023-07-06T00:58:39.750 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-06T00:58:39.753 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-06T00:59:09.952 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-06T00:59:09.955 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-06T00:59:40.041 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-06T00:59:40.044 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-06T00:59:40.079 INFO:tasks.ceph.mds.d.smithi073.stderr:2023-07-06T00:59:40.077+0000 7f07b5126700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 127228) UID: 0 2023-07-06T00:59:40.080 INFO:tasks.ceph.mds.b.smithi073.stderr:2023-07-06T00:59:40.077+0000 7f1ff165c700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 127228) UID: 0 2023-07-06T01:02:55.453 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-06T01:02:55.457 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-06T01:03:01.247 INFO:teuthology.orchestra.run.smithi046.stdout:generic/642 537s 2023-07-06T01:03:01.253 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/642 2023-07-06T01:03:01.253 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-07-06T01:03:01.254 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-06T01:03:01.264 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-06T01:03:01.264 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.rlt8E1h3iVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/643) 2023-07-06T01:03:05.151 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph 2023-07-06T01:03:05.156 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-06T01:03:05.157 INFO:teuthology.orchestra.run.smithi046.stdout:MKFS_OPTIONS -- 172.21.15.46:6789:/scratch 2023-07-06T01:03:05.158 INFO:teuthology.orchestra.run.smithi046.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCbvKVkpp1TIhAAvJTELoeH8wkIFqjtppg17w== -o context=system_u:object_r:root_t:s0 172.21.15.46:6789:/scratch /tmp/tmp.KrMG67MsYpscratch 2023-07-06T01:03:05.159 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-06T01:03:25.995 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-06T01:03:25.998 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-06T01:03:56.280 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-06T01:03:56.282 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-06T01:04:26.348 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-06T01:04:26.350 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-06T01:04:26.384 INFO:tasks.ceph.mds.b.smithi073.stderr:2023-07-06T01:04:26.382+0000 7f1ff165c700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 127373) UID: 0 2023-07-06T01:04:26.385 INFO:tasks.ceph.mds.d.smithi073.stderr:2023-07-06T01:04:26.382+0000 7f07b5126700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 127373) UID: 0 2023-07-06T01:06:42.342 INFO:teuthology.orchestra.run.smithi046.stdout:generic/643 [not run] swapfiles are not supported 2023-07-06T01:06:42.346 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/643 2023-07-06T01:06:42.346 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/643 2023-07-06T01:06:42.346 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-07-06T01:06:42.348 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-06T01:06:42.389 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-06T01:06:42.390 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.rlt8E1h3iVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/644) 2023-07-06T01:06:42.622 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph 2023-07-06T01:06:42.626 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-06T01:06:42.627 INFO:teuthology.orchestra.run.smithi046.stdout:MKFS_OPTIONS -- 172.21.15.46:6789:/scratch 2023-07-06T01:06:42.628 INFO:teuthology.orchestra.run.smithi046.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCbvKVkpp1TIhAAvJTELoeH8wkIFqjtppg17w== -o context=system_u:object_r:root_t:s0 172.21.15.46:6789:/scratch /tmp/tmp.KrMG67MsYpscratch 2023-07-06T01:06:42.628 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-06T01:06:42.982 INFO:teuthology.orchestra.run.smithi046.stdout:generic/644 [not run] kernel does not support mount_setattr syscall 2023-07-06T01:06:42.986 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/644 2023-07-06T01:06:42.986 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/644 2023-07-06T01:06:42.986 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-07-06T01:06:42.988 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-06T01:06:43.023 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-06T01:06:43.023 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.rlt8E1h3iVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/645) 2023-07-06T01:06:43.252 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph 2023-07-06T01:06:43.257 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-06T01:06:43.257 INFO:teuthology.orchestra.run.smithi046.stdout:MKFS_OPTIONS -- 172.21.15.46:6789:/scratch 2023-07-06T01:06:43.258 INFO:teuthology.orchestra.run.smithi046.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCbvKVkpp1TIhAAvJTELoeH8wkIFqjtppg17w== -o context=system_u:object_r:root_t:s0 172.21.15.46:6789:/scratch /tmp/tmp.KrMG67MsYpscratch 2023-07-06T01:06:43.258 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-06T01:06:43.594 INFO:teuthology.orchestra.run.smithi046.stdout:generic/645 [not run] kernel does not support mount_setattr syscall 2023-07-06T01:06:43.598 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/645 2023-07-06T01:06:43.599 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/645 2023-07-06T01:06:43.599 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-07-06T01:06:43.601 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-06T01:06:43.633 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-06T01:06:43.634 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.rlt8E1h3iVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/646) 2023-07-06T01:06:43.856 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph 2023-07-06T01:06:43.861 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-06T01:06:43.861 INFO:teuthology.orchestra.run.smithi046.stdout:MKFS_OPTIONS -- 172.21.15.46:6789:/scratch 2023-07-06T01:06:43.862 INFO:teuthology.orchestra.run.smithi046.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCbvKVkpp1TIhAAvJTELoeH8wkIFqjtppg17w== -o context=system_u:object_r:root_t:s0 172.21.15.46:6789:/scratch /tmp/tmp.KrMG67MsYpscratch 2023-07-06T01:06:43.862 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-06T01:06:44.398 INFO:teuthology.orchestra.run.smithi046.stdout:generic/646 [not run] ceph does not support shutdown 2023-07-06T01:06:44.427 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/646 2023-07-06T01:06:44.427 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/646 2023-07-06T01:06:44.427 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-07-06T01:06:44.429 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-06T01:06:44.451 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-06T01:06:44.452 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.rlt8E1h3iVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/647) 2023-07-06T01:06:44.688 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph 2023-07-06T01:06:44.692 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-06T01:06:44.693 INFO:teuthology.orchestra.run.smithi046.stdout:MKFS_OPTIONS -- 172.21.15.46:6789:/scratch 2023-07-06T01:06:44.694 INFO:teuthology.orchestra.run.smithi046.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCbvKVkpp1TIhAAvJTELoeH8wkIFqjtppg17w== -o context=system_u:object_r:root_t:s0 172.21.15.46:6789:/scratch /tmp/tmp.KrMG67MsYpscratch 2023-07-06T01:06:44.694 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-06T01:06:45.259 INFO:teuthology.orchestra.run.smithi046.stdout:generic/647 1s 2023-07-06T01:06:45.264 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/647 2023-07-06T01:06:45.264 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-07-06T01:06:45.266 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-06T01:06:45.631 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-06T01:06:45.632 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.rlt8E1h3iVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/648) 2023-07-06T01:06:45.922 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph 2023-07-06T01:06:45.926 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-06T01:06:45.927 INFO:teuthology.orchestra.run.smithi046.stdout:MKFS_OPTIONS -- 172.21.15.46:6789:/scratch 2023-07-06T01:06:45.927 INFO:teuthology.orchestra.run.smithi046.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCbvKVkpp1TIhAAvJTELoeH8wkIFqjtppg17w== -o context=system_u:object_r:root_t:s0 172.21.15.46:6789:/scratch /tmp/tmp.KrMG67MsYpscratch 2023-07-06T01:06:45.928 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-06T01:06:46.805 INFO:teuthology.orchestra.run.smithi046.stdout:generic/648 [not run] Reflink not supported by scratch filesystem type: ceph 2023-07-06T01:06:46.857 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/648 2023-07-06T01:06:46.857 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/648 2023-07-06T01:06:46.857 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-07-06T01:06:46.860 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-06T01:06:46.924 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-06T01:06:46.925 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.rlt8E1h3iVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/649) 2023-07-06T01:06:47.157 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph 2023-07-06T01:06:47.161 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-06T01:06:47.162 INFO:teuthology.orchestra.run.smithi046.stdout:MKFS_OPTIONS -- 172.21.15.46:6789:/scratch 2023-07-06T01:06:47.163 INFO:teuthology.orchestra.run.smithi046.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCbvKVkpp1TIhAAvJTELoeH8wkIFqjtppg17w== -o context=system_u:object_r:root_t:s0 172.21.15.46:6789:/scratch /tmp/tmp.KrMG67MsYpscratch 2023-07-06T01:06:47.163 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-06T01:06:47.568 INFO:teuthology.orchestra.run.smithi046.stdout:generic/649 [not run] Reflink not supported by test filesystem type: ceph 2023-07-06T01:06:47.572 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/649 2023-07-06T01:06:47.572 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/649 2023-07-06T01:06:47.572 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-07-06T01:06:47.574 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-06T01:06:47.938 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-06T01:06:47.938 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.rlt8E1h3iVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/650) 2023-07-06T01:06:48.229 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph 2023-07-06T01:06:48.234 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-06T01:06:48.234 INFO:teuthology.orchestra.run.smithi046.stdout:MKFS_OPTIONS -- 172.21.15.46:6789:/scratch 2023-07-06T01:06:48.235 INFO:teuthology.orchestra.run.smithi046.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCbvKVkpp1TIhAAvJTELoeH8wkIFqjtppg17w== -o context=system_u:object_r:root_t:s0 172.21.15.46:6789:/scratch /tmp/tmp.KrMG67MsYpscratch 2023-07-06T01:06:48.235 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-06T01:06:54.997 INFO:tasks.ceph.osd.6.smithi073.stderr:2023-07-06T01:06:54.995+0000 7f2582084700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 127393) UID: 0 2023-07-06T01:06:54.997 INFO:tasks.ceph.osd.5.smithi073.stderr:2023-07-06T01:06:54.995+0000 7f1dead60700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 127393) UID: 0 2023-07-06T01:06:54.998 INFO:tasks.ceph.osd.7.smithi073.stderr:2023-07-06T01:06:54.995+0000 7fe6067a5700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 127393) UID: 0 2023-07-06T01:06:55.000 INFO:tasks.ceph.osd.4.smithi073.stderr:2023-07-06T01:06:54.998+0000 7fb7867e9700 -1 received signal: Hangup from (PID: 127393) UID: 0 2023-07-06T01:10:13.383 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-06T01:10:13.397 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-06T01:10:43.787 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-06T01:10:43.797 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-06T01:11:14.399 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-06T01:11:14.596 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-06T01:11:44.865 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-06T01:11:44.872 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-06T01:12:15.092 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-06T01:12:15.143 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-06T01:12:45.447 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-06T01:12:45.593 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-06T01:13:16.924 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-06T01:13:17.076 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-06T01:13:48.597 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-06T01:13:48.690 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-06T01:14:19.283 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-06T01:14:19.374 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-06T01:14:49.692 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-06T01:14:49.770 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-06T01:15:20.428 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-06T01:15:20.465 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-06T01:15:50.610 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-06T01:15:50.819 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-06T01:16:21.977 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-06T01:16:21.992 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-06T01:16:52.500 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-06T01:16:52.543 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-06T01:16:52.588 INFO:tasks.ceph.osd.7.smithi073.stderr:2023-07-06T01:16:52.586+0000 7fe6067a5700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 127972) UID: 0 2023-07-06T01:16:52.589 INFO:tasks.ceph.osd.5.smithi073.stderr:2023-07-06T01:16:52.586+0000 7f1dead60700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 127972) UID: 0 2023-07-06T01:16:52.589 INFO:tasks.ceph.osd.4.smithi073.stderr:2023-07-06T01:16:52.586+0000 7fb7867e9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 127972) UID: 0 2023-07-06T01:16:52.592 INFO:tasks.ceph.osd.6.smithi073.stderr:2023-07-06T01:16:52.586+0000 7f2582084700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 127972) UID: 0 2023-07-06T01:19:57.011 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-06T01:19:57.090 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-06T01:19:57.165 INFO:tasks.ceph.osd.4.smithi073.stderr:2023-07-06T01:19:57.163+0000 7fb7867e9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 128021) UID: 0 2023-07-06T01:19:57.165 INFO:tasks.ceph.osd.5.smithi073.stderr:2023-07-06T01:19:57.164+0000 7f1dead60700 -1 received signal: Hangup from (PID: 128021) UID: 0 2023-07-06T01:19:57.166 INFO:tasks.ceph.osd.6.smithi073.stderr:2023-07-06T01:19:57.164+0000 7f2582084700 -1 received signal: Hangup from (PID: 128021) UID: 0 2023-07-06T01:19:57.173 INFO:tasks.ceph.osd.7.smithi073.stderr:2023-07-06T01:19:57.165+0000 7fe6067a5700 -1 Fail to open '/proc/128021/cmdline' error = (2) No such file or directory 2023-07-06T01:19:57.173 INFO:tasks.ceph.osd.7.smithi073.stderr:2023-07-06T01:19:57.165+0000 7fe6067a5700 -1 received signal: Hangup from (PID: 128021) UID: 0 2023-07-06T01:23:10.882 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-06T01:23:10.892 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-06T01:23:10.945 INFO:tasks.ceph.mds.d.smithi073.stderr:2023-07-06T01:23:10.942+0000 7f07b5126700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 128073) UID: 0 2023-07-06T01:23:10.946 INFO:tasks.ceph.mds.b.smithi073.stderr:2023-07-06T01:23:10.942+0000 7f1ff165c700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 128073) UID: 0 2023-07-06T01:26:23.774 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-06T01:26:23.876 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-06T01:26:54.253 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-06T01:26:54.321 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-06T01:27:24.779 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-06T01:27:24.909 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-06T01:27:56.919 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-06T01:27:56.934 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-06T01:28:27.089 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-06T01:28:27.097 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-06T01:28:57.466 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-06T01:28:57.530 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-06T01:29:27.639 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-06T01:29:27.660 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-06T01:29:28.328 INFO:tasks.ceph.osd.3.smithi046.stderr:2023-07-06T01:29:28.325+0000 7f1104079700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 783873) UID: 0 2023-07-06T01:29:28.329 INFO:tasks.ceph.osd.0.smithi046.stderr:2023-07-06T01:29:28.327+0000 7f77d1dc1700 -1 Fail to open '/proc/783873/cmdline' error = (2) No such file or directory 2023-07-06T01:29:28.329 INFO:tasks.ceph.osd.0.smithi046.stderr:2023-07-06T01:29:28.327+0000 7f77d1dc1700 -1 received signal: Hangup from (PID: 783873) UID: 0 2023-07-06T01:29:28.329 INFO:tasks.ceph.osd.1.smithi046.stderr:2023-07-06T01:29:28.327+0000 7f2fc7c11700 -1 Fail to open '/proc/783873/cmdline' error = (2) No such file or directory 2023-07-06T01:29:28.330 INFO:tasks.ceph.osd.1.smithi046.stderr:2023-07-06T01:29:28.327+0000 7f2fc7c11700 -1 received signal: Hangup from (PID: 783873) UID: 0 2023-07-06T01:29:28.345 INFO:tasks.ceph.osd.2.smithi046.stderr:2023-07-06T01:29:28.327+0000 7f5a7ef99700 -1 Fail to open '/proc/783873/cmdline' error = (2) No such file or directory 2023-07-06T01:29:28.345 INFO:tasks.ceph.osd.2.smithi046.stderr:2023-07-06T01:29:28.327+0000 7f5a7ef99700 -1 received signal: Hangup from (PID: 783873) UID: 0 2023-07-06T01:37:13.242 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-06T01:37:13.499 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-06T01:37:15.328 INFO:tasks.ceph.osd.2.smithi046.stderr:2023-07-06T01:37:15.322+0000 7f5a7ef99700 -1 Fail to open '/proc/786327/cmdline' error = (2) No such file or directory 2023-07-06T01:37:15.328 INFO:tasks.ceph.osd.2.smithi046.stderr:2023-07-06T01:37:15.322+0000 7f5a7ef99700 -1 received signal: Hangup from (PID: 786327) UID: 0 2023-07-06T01:37:15.329 INFO:tasks.ceph.osd.0.smithi046.stderr:2023-07-06T01:37:15.322+0000 7f77d1dc1700 -1 Fail to open '/proc/786327/cmdline' error = (2) No such file or directory 2023-07-06T01:37:15.329 INFO:tasks.ceph.osd.0.smithi046.stderr:2023-07-06T01:37:15.322+0000 7f77d1dc1700 -1 received signal: Hangup from (PID: 786327) UID: 0 2023-07-06T01:37:15.329 INFO:tasks.ceph.osd.3.smithi046.stderr:2023-07-06T01:37:15.322+0000 7f1104079700 -1 Fail to open '/proc/786327/cmdline' error = (2) No such file or directory 2023-07-06T01:37:15.330 INFO:tasks.ceph.osd.3.smithi046.stderr:2023-07-06T01:37:15.322+0000 7f1104079700 -1 received signal: Hangup from (PID: 786327) UID: 0 2023-07-06T01:37:15.330 INFO:tasks.ceph.osd.1.smithi046.stderr:2023-07-06T01:37:15.322+0000 7f2fc7c11700 -1 Fail to open '/proc/786327/cmdline' error = (2) No such file or directory 2023-07-06T01:37:15.330 INFO:tasks.ceph.osd.1.smithi046.stderr:2023-07-06T01:37:15.322+0000 7f2fc7c11700 -1 received signal: Hangup from (PID: 786327) UID: 0 2023-07-06T01:45:13.272 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-06T01:45:13.303 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-06T01:45:13.965 INFO:tasks.ceph.osd.1.smithi046.stderr:2023-07-06T01:45:13.963+0000 7f2fc7c11700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 788784) UID: 0 2023-07-06T01:45:13.970 INFO:tasks.ceph.osd.3.smithi046.stderr:2023-07-06T01:45:13.963+0000 7f1104079700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 788784) UID: 0 2023-07-06T01:45:13.974 INFO:tasks.ceph.osd.0.smithi046.stderr:2023-07-06T01:45:13.963+0000 7f77d1dc1700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 788784) UID: 0 2023-07-06T01:45:13.974 INFO:tasks.ceph.osd.2.smithi046.stderr:2023-07-06T01:45:13.963+0000 7f5a7ef99700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 788784) UID: 0 2023-07-06T01:45:14.114 INFO:tasks.ceph.mds.d.smithi073.stderr:2023-07-06T01:45:14.112+0000 7f07b5126700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 128459) UID: 0 2023-07-06T01:45:14.115 INFO:tasks.ceph.mds.b.smithi073.stderr:2023-07-06T01:45:14.112+0000 7f1ff165c700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 128459) UID: 0 2023-07-06T01:48:44.165 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-06T01:48:44.167 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-06T01:49:14.271 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-06T01:49:14.274 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-06T01:49:44.376 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-06T01:49:44.379 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-06T01:50:14.504 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-06T01:50:14.506 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-06T01:50:44.664 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-06T01:50:44.667 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-06T01:50:51.476 INFO:teuthology.orchestra.run.smithi046.stdout:generic/650 2643s 2023-07-06T01:50:51.496 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/650 2023-07-06T01:50:51.496 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-07-06T01:50:51.500 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-06T01:50:51.997 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-06T01:50:52.051 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.rlt8E1h3iVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/651) 2023-07-06T01:50:52.628 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph 2023-07-06T01:50:52.637 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-06T01:50:52.637 INFO:teuthology.orchestra.run.smithi046.stdout:MKFS_OPTIONS -- 172.21.15.46:6789:/scratch 2023-07-06T01:50:52.638 INFO:teuthology.orchestra.run.smithi046.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCbvKVkpp1TIhAAvJTELoeH8wkIFqjtppg17w== -o context=system_u:object_r:root_t:s0 172.21.15.46:6789:/scratch /tmp/tmp.KrMG67MsYpscratch 2023-07-06T01:50:52.639 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-06T01:50:53.890 INFO:teuthology.orchestra.run.smithi046.stdout:generic/651 [not run] Reflink not supported by scratch filesystem type: ceph 2023-07-06T01:50:53.988 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/651 2023-07-06T01:50:53.989 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/651 2023-07-06T01:50:53.989 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-07-06T01:50:53.992 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-06T01:50:54.050 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-06T01:50:54.050 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.rlt8E1h3iVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/652) 2023-07-06T01:50:54.465 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph 2023-07-06T01:50:54.469 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-06T01:50:54.470 INFO:teuthology.orchestra.run.smithi046.stdout:MKFS_OPTIONS -- 172.21.15.46:6789:/scratch 2023-07-06T01:50:54.471 INFO:teuthology.orchestra.run.smithi046.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCbvKVkpp1TIhAAvJTELoeH8wkIFqjtppg17w== -o context=system_u:object_r:root_t:s0 172.21.15.46:6789:/scratch /tmp/tmp.KrMG67MsYpscratch 2023-07-06T01:50:54.471 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-06T01:50:55.683 INFO:teuthology.orchestra.run.smithi046.stdout:generic/652 [not run] Reflink not supported by scratch filesystem type: ceph 2023-07-06T01:50:55.690 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/652 2023-07-06T01:50:55.690 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/652 2023-07-06T01:50:55.690 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-07-06T01:50:55.707 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-06T01:50:55.840 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-06T01:50:55.841 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.rlt8E1h3iVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/653) 2023-07-06T01:50:56.216 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph 2023-07-06T01:50:56.221 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-06T01:50:56.222 INFO:teuthology.orchestra.run.smithi046.stdout:MKFS_OPTIONS -- 172.21.15.46:6789:/scratch 2023-07-06T01:50:56.223 INFO:teuthology.orchestra.run.smithi046.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCbvKVkpp1TIhAAvJTELoeH8wkIFqjtppg17w== -o context=system_u:object_r:root_t:s0 172.21.15.46:6789:/scratch /tmp/tmp.KrMG67MsYpscratch 2023-07-06T01:50:56.223 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-06T01:50:57.298 INFO:teuthology.orchestra.run.smithi046.stdout:generic/653 [not run] Reflink not supported by scratch filesystem type: ceph 2023-07-06T01:50:57.305 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/653 2023-07-06T01:50:57.305 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/653 2023-07-06T01:50:57.305 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-07-06T01:50:57.308 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-06T01:50:57.573 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-06T01:50:57.574 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.rlt8E1h3iVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/654) 2023-07-06T01:50:57.975 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph 2023-07-06T01:50:57.990 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-06T01:50:57.990 INFO:teuthology.orchestra.run.smithi046.stdout:MKFS_OPTIONS -- 172.21.15.46:6789:/scratch 2023-07-06T01:50:57.993 INFO:teuthology.orchestra.run.smithi046.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCbvKVkpp1TIhAAvJTELoeH8wkIFqjtppg17w== -o context=system_u:object_r:root_t:s0 172.21.15.46:6789:/scratch /tmp/tmp.KrMG67MsYpscratch 2023-07-06T01:50:57.993 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-06T01:50:59.363 INFO:teuthology.orchestra.run.smithi046.stdout:generic/654 [not run] Reflink not supported by scratch filesystem type: ceph 2023-07-06T01:50:59.371 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/654 2023-07-06T01:50:59.371 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/654 2023-07-06T01:50:59.372 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-07-06T01:50:59.376 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-06T01:50:59.438 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-06T01:50:59.438 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.rlt8E1h3iVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/655) 2023-07-06T01:50:59.820 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph 2023-07-06T01:50:59.827 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-06T01:50:59.828 INFO:teuthology.orchestra.run.smithi046.stdout:MKFS_OPTIONS -- 172.21.15.46:6789:/scratch 2023-07-06T01:50:59.829 INFO:teuthology.orchestra.run.smithi046.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCbvKVkpp1TIhAAvJTELoeH8wkIFqjtppg17w== -o context=system_u:object_r:root_t:s0 172.21.15.46:6789:/scratch /tmp/tmp.KrMG67MsYpscratch 2023-07-06T01:50:59.829 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-06T01:51:01.171 INFO:teuthology.orchestra.run.smithi046.stdout:generic/655 [not run] Reflink not supported by scratch filesystem type: ceph 2023-07-06T01:51:01.209 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/655 2023-07-06T01:51:01.209 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/655 2023-07-06T01:51:01.209 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-07-06T01:51:01.212 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-06T01:51:01.276 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-06T01:51:01.276 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.rlt8E1h3iVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/656) 2023-07-06T01:51:01.676 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph 2023-07-06T01:51:01.681 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-06T01:51:01.682 INFO:teuthology.orchestra.run.smithi046.stdout:MKFS_OPTIONS -- 172.21.15.46:6789:/scratch 2023-07-06T01:51:01.687 INFO:teuthology.orchestra.run.smithi046.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCbvKVkpp1TIhAAvJTELoeH8wkIFqjtppg17w== -o context=system_u:object_r:root_t:s0 172.21.15.46:6789:/scratch /tmp/tmp.KrMG67MsYpscratch 2023-07-06T01:51:01.687 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-06T01:51:02.246 INFO:teuthology.orchestra.run.smithi046.stdout:generic/656 [not run] kernel does not support mount_setattr syscall 2023-07-06T01:51:02.252 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/656 2023-07-06T01:51:02.252 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/656 2023-07-06T01:51:02.252 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-07-06T01:51:02.254 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-06T01:51:02.290 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-06T01:51:02.291 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.rlt8E1h3iVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/657) 2023-07-06T01:51:02.683 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph 2023-07-06T01:51:02.695 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-06T01:51:02.695 INFO:teuthology.orchestra.run.smithi046.stdout:MKFS_OPTIONS -- 172.21.15.46:6789:/scratch 2023-07-06T01:51:02.696 INFO:teuthology.orchestra.run.smithi046.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCbvKVkpp1TIhAAvJTELoeH8wkIFqjtppg17w== -o context=system_u:object_r:root_t:s0 172.21.15.46:6789:/scratch /tmp/tmp.KrMG67MsYpscratch 2023-07-06T01:51:02.696 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-06T01:51:03.976 INFO:teuthology.orchestra.run.smithi046.stdout:generic/657 [not run] Reflink not supported by scratch filesystem type: ceph 2023-07-06T01:51:03.984 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/657 2023-07-06T01:51:03.984 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/657 2023-07-06T01:51:03.984 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-07-06T01:51:04.015 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-06T01:51:04.170 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-06T01:51:04.170 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.rlt8E1h3iVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/658) 2023-07-06T01:51:04.574 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph 2023-07-06T01:51:04.579 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-06T01:51:04.579 INFO:teuthology.orchestra.run.smithi046.stdout:MKFS_OPTIONS -- 172.21.15.46:6789:/scratch 2023-07-06T01:51:04.580 INFO:teuthology.orchestra.run.smithi046.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCbvKVkpp1TIhAAvJTELoeH8wkIFqjtppg17w== -o context=system_u:object_r:root_t:s0 172.21.15.46:6789:/scratch /tmp/tmp.KrMG67MsYpscratch 2023-07-06T01:51:04.581 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-06T01:51:05.753 INFO:teuthology.orchestra.run.smithi046.stdout:generic/658 [not run] Reflink not supported by scratch filesystem type: ceph 2023-07-06T01:51:05.766 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/658 2023-07-06T01:51:05.767 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/658 2023-07-06T01:51:05.767 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-07-06T01:51:05.941 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-06T01:51:06.030 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-06T01:51:06.030 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.rlt8E1h3iVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/659) 2023-07-06T01:51:06.417 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph 2023-07-06T01:51:06.423 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-06T01:51:06.423 INFO:teuthology.orchestra.run.smithi046.stdout:MKFS_OPTIONS -- 172.21.15.46:6789:/scratch 2023-07-06T01:51:06.424 INFO:teuthology.orchestra.run.smithi046.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCbvKVkpp1TIhAAvJTELoeH8wkIFqjtppg17w== -o context=system_u:object_r:root_t:s0 172.21.15.46:6789:/scratch /tmp/tmp.KrMG67MsYpscratch 2023-07-06T01:51:06.424 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-06T01:51:07.674 INFO:teuthology.orchestra.run.smithi046.stdout:generic/659 [not run] Reflink not supported by scratch filesystem type: ceph 2023-07-06T01:51:07.681 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/659 2023-07-06T01:51:07.681 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/659 2023-07-06T01:51:07.681 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-07-06T01:51:07.684 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-06T01:51:07.841 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-06T01:51:07.841 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.rlt8E1h3iVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/660) 2023-07-06T01:51:08.257 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph 2023-07-06T01:51:08.261 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-06T01:51:08.262 INFO:teuthology.orchestra.run.smithi046.stdout:MKFS_OPTIONS -- 172.21.15.46:6789:/scratch 2023-07-06T01:51:08.264 INFO:teuthology.orchestra.run.smithi046.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCbvKVkpp1TIhAAvJTELoeH8wkIFqjtppg17w== -o context=system_u:object_r:root_t:s0 172.21.15.46:6789:/scratch /tmp/tmp.KrMG67MsYpscratch 2023-07-06T01:51:08.264 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-06T01:51:09.375 INFO:teuthology.orchestra.run.smithi046.stdout:generic/660 [not run] Reflink not supported by scratch filesystem type: ceph 2023-07-06T01:51:09.421 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/660 2023-07-06T01:51:09.422 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/660 2023-07-06T01:51:09.422 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-07-06T01:51:09.425 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-06T01:51:09.709 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-06T01:51:09.710 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.rlt8E1h3iVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/661) 2023-07-06T01:51:10.076 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph 2023-07-06T01:51:10.081 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-06T01:51:10.081 INFO:teuthology.orchestra.run.smithi046.stdout:MKFS_OPTIONS -- 172.21.15.46:6789:/scratch 2023-07-06T01:51:10.082 INFO:teuthology.orchestra.run.smithi046.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCbvKVkpp1TIhAAvJTELoeH8wkIFqjtppg17w== -o context=system_u:object_r:root_t:s0 172.21.15.46:6789:/scratch /tmp/tmp.KrMG67MsYpscratch 2023-07-06T01:51:10.083 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-06T01:51:11.525 INFO:teuthology.orchestra.run.smithi046.stdout:generic/661 [not run] Reflink not supported by scratch filesystem type: ceph 2023-07-06T01:51:11.533 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/661 2023-07-06T01:51:11.534 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/661 2023-07-06T01:51:11.534 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-07-06T01:51:11.536 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-06T01:51:11.590 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-06T01:51:11.591 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.rlt8E1h3iVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/662) 2023-07-06T01:51:11.999 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph 2023-07-06T01:51:12.011 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-06T01:51:12.011 INFO:teuthology.orchestra.run.smithi046.stdout:MKFS_OPTIONS -- 172.21.15.46:6789:/scratch 2023-07-06T01:51:12.014 INFO:teuthology.orchestra.run.smithi046.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCbvKVkpp1TIhAAvJTELoeH8wkIFqjtppg17w== -o context=system_u:object_r:root_t:s0 172.21.15.46:6789:/scratch /tmp/tmp.KrMG67MsYpscratch 2023-07-06T01:51:12.014 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-06T01:51:13.310 INFO:teuthology.orchestra.run.smithi046.stdout:generic/662 [not run] Reflink not supported by scratch filesystem type: ceph 2023-07-06T01:51:13.346 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/662 2023-07-06T01:51:13.346 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/662 2023-07-06T01:51:13.346 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-07-06T01:51:13.410 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-06T01:51:13.469 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-06T01:51:13.470 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.rlt8E1h3iVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/663) 2023-07-06T01:51:13.904 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph 2023-07-06T01:51:13.917 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-06T01:51:13.917 INFO:teuthology.orchestra.run.smithi046.stdout:MKFS_OPTIONS -- 172.21.15.46:6789:/scratch 2023-07-06T01:51:13.918 INFO:teuthology.orchestra.run.smithi046.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCbvKVkpp1TIhAAvJTELoeH8wkIFqjtppg17w== -o context=system_u:object_r:root_t:s0 172.21.15.46:6789:/scratch /tmp/tmp.KrMG67MsYpscratch 2023-07-06T01:51:13.918 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-06T01:51:14.753 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-06T01:51:14.761 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-06T01:51:15.005 INFO:teuthology.orchestra.run.smithi046.stdout:generic/663 [not run] Reflink not supported by scratch filesystem type: ceph 2023-07-06T01:51:15.028 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/663 2023-07-06T01:51:15.028 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/663 2023-07-06T01:51:15.028 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-07-06T01:51:15.032 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-06T01:51:15.377 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-06T01:51:15.378 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.rlt8E1h3iVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/664) 2023-07-06T01:51:15.776 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph 2023-07-06T01:51:15.782 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-06T01:51:15.782 INFO:teuthology.orchestra.run.smithi046.stdout:MKFS_OPTIONS -- 172.21.15.46:6789:/scratch 2023-07-06T01:51:15.783 INFO:teuthology.orchestra.run.smithi046.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCbvKVkpp1TIhAAvJTELoeH8wkIFqjtppg17w== -o context=system_u:object_r:root_t:s0 172.21.15.46:6789:/scratch /tmp/tmp.KrMG67MsYpscratch 2023-07-06T01:51:15.784 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-06T01:51:17.007 INFO:teuthology.orchestra.run.smithi046.stdout:generic/664 [not run] Reflink not supported by scratch filesystem type: ceph 2023-07-06T01:51:17.080 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/664 2023-07-06T01:51:17.081 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/664 2023-07-06T01:51:17.081 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-07-06T01:51:17.101 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-06T01:51:17.176 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-06T01:51:17.176 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.rlt8E1h3iVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/665) 2023-07-06T01:51:17.599 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph 2023-07-06T01:51:17.605 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-06T01:51:17.606 INFO:teuthology.orchestra.run.smithi046.stdout:MKFS_OPTIONS -- 172.21.15.46:6789:/scratch 2023-07-06T01:51:17.607 INFO:teuthology.orchestra.run.smithi046.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCbvKVkpp1TIhAAvJTELoeH8wkIFqjtppg17w== -o context=system_u:object_r:root_t:s0 172.21.15.46:6789:/scratch /tmp/tmp.KrMG67MsYpscratch 2023-07-06T01:51:17.607 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-06T01:51:18.933 INFO:teuthology.orchestra.run.smithi046.stdout:generic/665 [not run] Reflink not supported by scratch filesystem type: ceph 2023-07-06T01:51:18.941 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/665 2023-07-06T01:51:18.941 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/665 2023-07-06T01:51:18.941 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-07-06T01:51:18.947 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-06T01:51:18.995 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-06T01:51:18.996 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.rlt8E1h3iVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/666) 2023-07-06T01:51:19.373 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph 2023-07-06T01:51:19.379 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-06T01:51:19.380 INFO:teuthology.orchestra.run.smithi046.stdout:MKFS_OPTIONS -- 172.21.15.46:6789:/scratch 2023-07-06T01:51:19.381 INFO:teuthology.orchestra.run.smithi046.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCbvKVkpp1TIhAAvJTELoeH8wkIFqjtppg17w== -o context=system_u:object_r:root_t:s0 172.21.15.46:6789:/scratch /tmp/tmp.KrMG67MsYpscratch 2023-07-06T01:51:19.381 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-06T01:51:20.653 INFO:teuthology.orchestra.run.smithi046.stdout:generic/666 [not run] Reflink not supported by scratch filesystem type: ceph 2023-07-06T01:51:20.729 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/666 2023-07-06T01:51:20.730 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/666 2023-07-06T01:51:20.730 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-07-06T01:51:20.738 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-06T01:51:20.782 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-06T01:51:20.782 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.rlt8E1h3iVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/667) 2023-07-06T01:51:21.201 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph 2023-07-06T01:51:21.207 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-06T01:51:21.207 INFO:teuthology.orchestra.run.smithi046.stdout:MKFS_OPTIONS -- 172.21.15.46:6789:/scratch 2023-07-06T01:51:21.208 INFO:teuthology.orchestra.run.smithi046.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCbvKVkpp1TIhAAvJTELoeH8wkIFqjtppg17w== -o context=system_u:object_r:root_t:s0 172.21.15.46:6789:/scratch /tmp/tmp.KrMG67MsYpscratch 2023-07-06T01:51:21.209 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-06T01:51:22.521 INFO:teuthology.orchestra.run.smithi046.stdout:generic/667 [not run] Reflink not supported by scratch filesystem type: ceph 2023-07-06T01:51:22.531 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/667 2023-07-06T01:51:22.532 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/667 2023-07-06T01:51:22.532 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-07-06T01:51:22.642 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-06T01:51:22.695 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-06T01:51:22.696 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.rlt8E1h3iVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/668) 2023-07-06T01:51:23.102 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph 2023-07-06T01:51:23.116 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-06T01:51:23.117 INFO:teuthology.orchestra.run.smithi046.stdout:MKFS_OPTIONS -- 172.21.15.46:6789:/scratch 2023-07-06T01:51:23.118 INFO:teuthology.orchestra.run.smithi046.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCbvKVkpp1TIhAAvJTELoeH8wkIFqjtppg17w== -o context=system_u:object_r:root_t:s0 172.21.15.46:6789:/scratch /tmp/tmp.KrMG67MsYpscratch 2023-07-06T01:51:23.119 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-06T01:51:24.317 INFO:teuthology.orchestra.run.smithi046.stdout:generic/668 [not run] Reflink not supported by scratch filesystem type: ceph 2023-07-06T01:51:24.323 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/668 2023-07-06T01:51:24.323 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/668 2023-07-06T01:51:24.323 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-07-06T01:51:24.425 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-06T01:51:24.542 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-06T01:51:24.542 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.rlt8E1h3iVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/669) 2023-07-06T01:51:24.921 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph 2023-07-06T01:51:24.926 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-06T01:51:24.926 INFO:teuthology.orchestra.run.smithi046.stdout:MKFS_OPTIONS -- 172.21.15.46:6789:/scratch 2023-07-06T01:51:24.928 INFO:teuthology.orchestra.run.smithi046.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCbvKVkpp1TIhAAvJTELoeH8wkIFqjtppg17w== -o context=system_u:object_r:root_t:s0 172.21.15.46:6789:/scratch /tmp/tmp.KrMG67MsYpscratch 2023-07-06T01:51:24.928 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-06T01:51:26.107 INFO:teuthology.orchestra.run.smithi046.stdout:generic/669 [not run] Reflink not supported by scratch filesystem type: ceph 2023-07-06T01:51:26.121 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/669 2023-07-06T01:51:26.122 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/669 2023-07-06T01:51:26.122 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-07-06T01:51:26.188 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-06T01:51:26.383 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-06T01:51:26.384 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.rlt8E1h3iVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/670) 2023-07-06T01:51:26.791 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph 2023-07-06T01:51:26.798 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-06T01:51:26.799 INFO:teuthology.orchestra.run.smithi046.stdout:MKFS_OPTIONS -- 172.21.15.46:6789:/scratch 2023-07-06T01:51:26.803 INFO:teuthology.orchestra.run.smithi046.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCbvKVkpp1TIhAAvJTELoeH8wkIFqjtppg17w== -o context=system_u:object_r:root_t:s0 172.21.15.46:6789:/scratch /tmp/tmp.KrMG67MsYpscratch 2023-07-06T01:51:26.803 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-06T01:51:28.069 INFO:teuthology.orchestra.run.smithi046.stdout:generic/670 [not run] Reflink not supported by scratch filesystem type: ceph 2023-07-06T01:51:28.183 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/670 2023-07-06T01:51:28.183 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/670 2023-07-06T01:51:28.184 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-07-06T01:51:28.188 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-06T01:51:28.223 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-06T01:51:28.223 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.rlt8E1h3iVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/671) 2023-07-06T01:51:28.611 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph 2023-07-06T01:51:28.617 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-06T01:51:28.617 INFO:teuthology.orchestra.run.smithi046.stdout:MKFS_OPTIONS -- 172.21.15.46:6789:/scratch 2023-07-06T01:51:28.618 INFO:teuthology.orchestra.run.smithi046.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCbvKVkpp1TIhAAvJTELoeH8wkIFqjtppg17w== -o context=system_u:object_r:root_t:s0 172.21.15.46:6789:/scratch /tmp/tmp.KrMG67MsYpscratch 2023-07-06T01:51:28.619 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-06T01:51:29.788 INFO:teuthology.orchestra.run.smithi046.stdout:generic/671 [not run] Reflink not supported by scratch filesystem type: ceph 2023-07-06T01:51:29.914 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/671 2023-07-06T01:51:29.914 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/671 2023-07-06T01:51:29.915 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-07-06T01:51:29.957 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-06T01:51:30.011 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-06T01:51:30.012 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.rlt8E1h3iVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/672) 2023-07-06T01:51:30.399 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph 2023-07-06T01:51:30.406 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-06T01:51:30.406 INFO:teuthology.orchestra.run.smithi046.stdout:MKFS_OPTIONS -- 172.21.15.46:6789:/scratch 2023-07-06T01:51:30.407 INFO:teuthology.orchestra.run.smithi046.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCbvKVkpp1TIhAAvJTELoeH8wkIFqjtppg17w== -o context=system_u:object_r:root_t:s0 172.21.15.46:6789:/scratch /tmp/tmp.KrMG67MsYpscratch 2023-07-06T01:51:30.407 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-06T01:51:31.705 INFO:teuthology.orchestra.run.smithi046.stdout:generic/672 [not run] Reflink not supported by scratch filesystem type: ceph 2023-07-06T01:51:31.791 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/672 2023-07-06T01:51:31.791 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/672 2023-07-06T01:51:31.792 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-07-06T01:51:31.806 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-06T01:51:31.857 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-06T01:51:31.858 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.rlt8E1h3iVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/673) 2023-07-06T01:51:32.255 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph 2023-07-06T01:51:32.258 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-06T01:51:32.259 INFO:teuthology.orchestra.run.smithi046.stdout:MKFS_OPTIONS -- 172.21.15.46:6789:/scratch 2023-07-06T01:51:32.260 INFO:teuthology.orchestra.run.smithi046.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCbvKVkpp1TIhAAvJTELoeH8wkIFqjtppg17w== -o context=system_u:object_r:root_t:s0 172.21.15.46:6789:/scratch /tmp/tmp.KrMG67MsYpscratch 2023-07-06T01:51:32.261 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-06T01:51:34.902 INFO:teuthology.orchestra.run.smithi046.stdout:generic/673 [not run] Reflink not supported by scratch filesystem type: ceph 2023-07-06T01:51:34.928 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/673 2023-07-06T01:51:34.928 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/673 2023-07-06T01:51:34.928 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-07-06T01:51:34.931 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-06T01:51:35.019 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-06T01:51:35.020 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.rlt8E1h3iVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/674) 2023-07-06T01:51:35.417 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph 2023-07-06T01:51:35.423 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-06T01:51:35.423 INFO:teuthology.orchestra.run.smithi046.stdout:MKFS_OPTIONS -- 172.21.15.46:6789:/scratch 2023-07-06T01:51:35.424 INFO:teuthology.orchestra.run.smithi046.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCbvKVkpp1TIhAAvJTELoeH8wkIFqjtppg17w== -o context=system_u:object_r:root_t:s0 172.21.15.46:6789:/scratch /tmp/tmp.KrMG67MsYpscratch 2023-07-06T01:51:35.425 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-06T01:51:36.392 INFO:teuthology.orchestra.run.smithi046.stdout:generic/674 [not run] Dedupe not supported by scratch filesystem type: ceph 2023-07-06T01:51:36.638 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/674 2023-07-06T01:51:36.639 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/674 2023-07-06T01:51:36.639 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-07-06T01:51:36.642 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-06T01:51:36.901 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-06T01:51:36.901 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.rlt8E1h3iVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/675) 2023-07-06T01:51:37.313 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph 2023-07-06T01:51:37.318 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-06T01:51:37.319 INFO:teuthology.orchestra.run.smithi046.stdout:MKFS_OPTIONS -- 172.21.15.46:6789:/scratch 2023-07-06T01:51:37.320 INFO:teuthology.orchestra.run.smithi046.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCbvKVkpp1TIhAAvJTELoeH8wkIFqjtppg17w== -o context=system_u:object_r:root_t:s0 172.21.15.46:6789:/scratch /tmp/tmp.KrMG67MsYpscratch 2023-07-06T01:51:37.320 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-06T01:51:38.661 INFO:teuthology.orchestra.run.smithi046.stdout:generic/675 [not run] Reflink not supported by scratch filesystem type: ceph 2023-07-06T01:51:38.688 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/675 2023-07-06T01:51:38.688 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/675 2023-07-06T01:51:38.688 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-07-06T01:51:38.691 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-06T01:51:38.814 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-06T01:51:38.815 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.rlt8E1h3iVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/676) 2023-07-06T01:51:39.179 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph 2023-07-06T01:51:39.184 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-06T01:51:39.185 INFO:teuthology.orchestra.run.smithi046.stdout:MKFS_OPTIONS -- 172.21.15.46:6789:/scratch 2023-07-06T01:51:39.185 INFO:teuthology.orchestra.run.smithi046.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCbvKVkpp1TIhAAvJTELoeH8wkIFqjtppg17w== -o context=system_u:object_r:root_t:s0 172.21.15.46:6789:/scratch /tmp/tmp.KrMG67MsYpscratch 2023-07-06T01:51:39.186 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-06T01:51:45.207 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-06T01:51:45.210 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-06T01:52:15.282 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-06T01:52:15.284 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-06T01:52:45.666 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-06T01:52:45.673 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-06T01:52:45.733 INFO:tasks.ceph.mds.d.smithi073.stderr:2023-07-06T01:52:45.731+0000 7f07b5126700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 128724) UID: 0 2023-07-06T01:52:45.734 INFO:tasks.ceph.mds.b.smithi073.stderr:2023-07-06T01:52:45.732+0000 7f1ff165c700 -1 Fail to open '/proc/128724/cmdline' error = (2) No such file or directory 2023-07-06T01:52:45.734 INFO:tasks.ceph.mds.b.smithi073.stderr:2023-07-06T01:52:45.732+0000 7f1ff165c700 -1 received signal: Hangup from (PID: 128724) UID: 0 2023-07-06T01:55:48.133 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-06T01:55:48.137 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-06T01:56:18.543 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-06T01:56:18.547 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-06T01:56:18.621 INFO:tasks.ceph.mds.b.smithi073.stderr:2023-07-06T01:56:18.618+0000 7f1ff165c700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 128804) UID: 0 2023-07-06T01:56:18.622 INFO:tasks.ceph.mds.d.smithi073.stderr:2023-07-06T01:56:18.618+0000 7f07b5126700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 128804) UID: 0 2023-07-06T01:59:28.614 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-06T01:59:28.618 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-06T01:59:28.662 INFO:tasks.ceph.mds.d.smithi073.stderr:2023-07-06T01:59:28.660+0000 7f07b5126700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 128853) UID: 0 2023-07-06T01:59:28.664 INFO:tasks.ceph.mds.b.smithi073.stderr:2023-07-06T01:59:28.661+0000 7f1ff165c700 -1 Fail to open '/proc/128853/cmdline' error = (2) No such file or directory 2023-07-06T01:59:28.665 INFO:tasks.ceph.mds.b.smithi073.stderr:2023-07-06T01:59:28.661+0000 7f1ff165c700 -1 received signal: Hangup from (PID: 128853) UID: 0 2023-07-06T02:02:26.243 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-06T02:02:26.249 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-06T02:02:26.323 INFO:tasks.ceph.osd.0.smithi046.stderr:2023-07-06T02:02:26.321+0000 7f77d1dc1700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 802804) UID: 0 2023-07-06T02:02:26.324 INFO:tasks.ceph.osd.2.smithi046.stderr:2023-07-06T02:02:26.321+0000 7f5a7ef99700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 802804) UID: 0 2023-07-06T02:02:26.324 INFO:tasks.ceph.osd.3.smithi046.stderr:2023-07-06T02:02:26.322+0000 7f1104079700 -1 Fail to open '/proc/802804/cmdline' error = (2) No such file or directory 2023-07-06T02:02:26.325 INFO:tasks.ceph.osd.3.smithi046.stderr:2023-07-06T02:02:26.322+0000 7f1104079700 -1 received signal: Hangup from (PID: 802804) UID: 0 2023-07-06T02:02:26.326 INFO:tasks.ceph.osd.1.smithi046.stderr:2023-07-06T02:02:26.324+0000 7f2fc7c11700 -1 Fail to open '/proc/802804/cmdline' error = (2) No such file or directory 2023-07-06T02:02:26.327 INFO:tasks.ceph.osd.1.smithi046.stderr:2023-07-06T02:02:26.324+0000 7f2fc7c11700 -1 received signal: Hangup from (PID: 802804) UID: 0 2023-07-06T02:03:48.418 INFO:teuthology.orchestra.run.smithi046.stdout:generic/676 729s 2023-07-06T02:03:48.428 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/676 2023-07-06T02:03:48.428 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-07-06T02:03:48.432 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-06T02:03:48.869 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-06T02:03:48.869 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.rlt8E1h3iVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/677) 2023-07-06T02:03:49.510 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph 2023-07-06T02:03:49.514 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-06T02:03:49.515 INFO:teuthology.orchestra.run.smithi046.stdout:MKFS_OPTIONS -- 172.21.15.46:6789:/scratch 2023-07-06T02:03:49.516 INFO:teuthology.orchestra.run.smithi046.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCbvKVkpp1TIhAAvJTELoeH8wkIFqjtppg17w== -o context=system_u:object_r:root_t:s0 172.21.15.46:6789:/scratch /tmp/tmp.KrMG67MsYpscratch 2023-07-06T02:03:49.517 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-06T02:03:50.325 INFO:teuthology.orchestra.run.smithi046.stdout:generic/677 [not run] require 172.21.15.46:6789:/scratch to be valid block disk 2023-07-06T02:03:50.330 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/677 2023-07-06T02:03:50.331 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/677 2023-07-06T02:03:50.331 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-07-06T02:03:50.336 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-06T02:03:50.377 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-06T02:03:50.377 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.rlt8E1h3iVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/678) 2023-07-06T02:03:50.917 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph 2023-07-06T02:03:50.926 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-06T02:03:50.931 INFO:teuthology.orchestra.run.smithi046.stdout:MKFS_OPTIONS -- 172.21.15.46:6789:/scratch 2023-07-06T02:03:50.932 INFO:teuthology.orchestra.run.smithi046.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCbvKVkpp1TIhAAvJTELoeH8wkIFqjtppg17w== -o context=system_u:object_r:root_t:s0 172.21.15.46:6789:/scratch /tmp/tmp.KrMG67MsYpscratch 2023-07-06T02:03:50.933 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-06T02:03:51.653 INFO:teuthology.orchestra.run.smithi046.stdout:generic/678 [not run] kernel does not support IO_URING 2023-07-06T02:03:51.659 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/678 2023-07-06T02:03:51.660 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/678 2023-07-06T02:03:51.660 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-07-06T02:03:51.672 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-06T02:03:51.735 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-06T02:03:51.735 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.rlt8E1h3iVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/679) 2023-07-06T02:03:52.193 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph 2023-07-06T02:03:52.214 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-06T02:03:52.215 INFO:teuthology.orchestra.run.smithi046.stdout:MKFS_OPTIONS -- 172.21.15.46:6789:/scratch 2023-07-06T02:03:52.216 INFO:teuthology.orchestra.run.smithi046.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCbvKVkpp1TIhAAvJTELoeH8wkIFqjtppg17w== -o context=system_u:object_r:root_t:s0 172.21.15.46:6789:/scratch /tmp/tmp.KrMG67MsYpscratch 2023-07-06T02:03:52.216 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-06T02:03:52.838 INFO:teuthology.orchestra.run.smithi046.stdout:generic/679 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-07-06T02:03:52.844 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/679 2023-07-06T02:03:52.845 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/679 2023-07-06T02:03:52.845 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-07-06T02:03:52.858 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-06T02:03:52.926 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-06T02:03:52.926 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.rlt8E1h3iVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/680) 2023-07-06T02:03:53.429 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph 2023-07-06T02:03:53.438 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-06T02:03:53.439 INFO:teuthology.orchestra.run.smithi046.stdout:MKFS_OPTIONS -- 172.21.15.46:6789:/scratch 2023-07-06T02:03:53.440 INFO:teuthology.orchestra.run.smithi046.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCbvKVkpp1TIhAAvJTELoeH8wkIFqjtppg17w== -o context=system_u:object_r:root_t:s0 172.21.15.46:6789:/scratch /tmp/tmp.KrMG67MsYpscratch 2023-07-06T02:03:53.440 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-06T02:03:54.522 INFO:teuthology.orchestra.run.smithi046.stdout:generic/680 1s 2023-07-06T02:03:54.528 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/680 2023-07-06T02:03:54.529 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-07-06T02:03:54.531 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-06T02:03:54.758 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-06T02:03:54.759 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.rlt8E1h3iVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/681) 2023-07-06T02:03:55.479 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph 2023-07-06T02:03:55.484 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-06T02:03:55.485 INFO:teuthology.orchestra.run.smithi046.stdout:MKFS_OPTIONS -- 172.21.15.46:6789:/scratch 2023-07-06T02:03:55.485 INFO:teuthology.orchestra.run.smithi046.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCbvKVkpp1TIhAAvJTELoeH8wkIFqjtppg17w== -o context=system_u:object_r:root_t:s0 172.21.15.46:6789:/scratch /tmp/tmp.KrMG67MsYpscratch 2023-07-06T02:03:55.486 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-06T02:03:56.077 INFO:teuthology.orchestra.run.smithi046.stdout:generic/681 [not run] disk quotas not supported by this filesystem type: ceph 2023-07-06T02:03:56.082 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/681 2023-07-06T02:03:56.083 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/681 2023-07-06T02:03:56.083 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-07-06T02:03:56.093 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-06T02:03:56.128 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-06T02:03:56.129 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.rlt8E1h3iVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/682) 2023-07-06T02:03:56.639 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph 2023-07-06T02:03:56.644 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-06T02:03:56.645 INFO:teuthology.orchestra.run.smithi046.stdout:MKFS_OPTIONS -- 172.21.15.46:6789:/scratch 2023-07-06T02:03:56.646 INFO:teuthology.orchestra.run.smithi046.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCbvKVkpp1TIhAAvJTELoeH8wkIFqjtppg17w== -o context=system_u:object_r:root_t:s0 172.21.15.46:6789:/scratch /tmp/tmp.KrMG67MsYpscratch 2023-07-06T02:03:56.646 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-06T02:03:57.305 INFO:teuthology.orchestra.run.smithi046.stdout:generic/682 [not run] disk quotas not supported by this filesystem type: ceph 2023-07-06T02:03:57.312 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/682 2023-07-06T02:03:57.312 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/682 2023-07-06T02:03:57.312 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-07-06T02:03:57.323 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-06T02:03:57.364 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-06T02:03:57.365 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.rlt8E1h3iVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/683) 2023-07-06T02:03:57.821 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph 2023-07-06T02:03:57.832 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-06T02:03:57.833 INFO:teuthology.orchestra.run.smithi046.stdout:MKFS_OPTIONS -- 172.21.15.46:6789:/scratch 2023-07-06T02:03:57.834 INFO:teuthology.orchestra.run.smithi046.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCbvKVkpp1TIhAAvJTELoeH8wkIFqjtppg17w== -o context=system_u:object_r:root_t:s0 172.21.15.46:6789:/scratch /tmp/tmp.KrMG67MsYpscratch 2023-07-06T02:03:57.834 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-06T02:03:58.533 INFO:teuthology.orchestra.run.smithi046.stdout:generic/683 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-07-06T02:03:58.538 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/683 2023-07-06T02:03:58.538 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/683 2023-07-06T02:03:58.538 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-07-06T02:03:58.545 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-06T02:03:58.631 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-06T02:03:58.632 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.rlt8E1h3iVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/684) 2023-07-06T02:03:59.133 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph 2023-07-06T02:03:59.140 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-06T02:03:59.140 INFO:teuthology.orchestra.run.smithi046.stdout:MKFS_OPTIONS -- 172.21.15.46:6789:/scratch 2023-07-06T02:03:59.142 INFO:teuthology.orchestra.run.smithi046.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCbvKVkpp1TIhAAvJTELoeH8wkIFqjtppg17w== -o context=system_u:object_r:root_t:s0 172.21.15.46:6789:/scratch /tmp/tmp.KrMG67MsYpscratch 2023-07-06T02:03:59.142 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-06T02:04:05.996 INFO:teuthology.orchestra.run.smithi046.stdout:generic/684 - output mismatch (see /tmp/tmp.rlt8E1h3iVxfstests-dev/results//generic/684.out.bad) 2023-07-06T02:04:05.999 INFO:teuthology.orchestra.run.smithi046.stdout: --- tests/generic/684.out 2023-07-05 18:57:23.284780052 +0000 2023-07-06T02:04:05.999 INFO:teuthology.orchestra.run.smithi046.stdout: +++ /tmp/tmp.rlt8E1h3iVxfstests-dev/results//generic/684.out.bad 2023-07-06 02:04:05.974478079 +0000 2023-07-06T02:04:05.999 INFO:teuthology.orchestra.run.smithi046.stdout: @@ -1,19 +1,19 @@ 2023-07-06T02:04:06.000 INFO:teuthology.orchestra.run.smithi046.stdout: QA output created by 684 2023-07-06T02:04:06.000 INFO:teuthology.orchestra.run.smithi046.stdout: Test 1 - qa_user, non-exec file fpunch 2023-07-06T02:04:06.000 INFO:teuthology.orchestra.run.smithi046.stdout: 6666 -rwSrwSrw- TEST_DIR/684/a 2023-07-06T02:04:06.000 INFO:teuthology.orchestra.run.smithi046.stdout: -666 -rw-rw-rw- TEST_DIR/684/a 2023-07-06T02:04:06.000 INFO:teuthology.orchestra.run.smithi046.stdout: +6666 -rwSrwSrw- TEST_DIR/684/a 2023-07-06T02:04:06.000 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-06T02:04:06.000 INFO:teuthology.orchestra.run.smithi046.stdout: Test 2 - qa_user, group-exec file fpunch 2023-07-06T02:04:06.001 INFO:teuthology.orchestra.run.smithi046.stdout: 6676 -rwSrwsrw- TEST_DIR/684/a 2023-07-06T02:04:06.001 INFO:teuthology.orchestra.run.smithi046.stdout: -676 -rw-rwxrw- TEST_DIR/684/a 2023-07-06T02:04:06.001 INFO:teuthology.orchestra.run.smithi046.stdout: +6676 -rwSrwsrw- TEST_DIR/684/a 2023-07-06T02:04:06.001 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-06T02:04:06.001 INFO:teuthology.orchestra.run.smithi046.stdout: Test 3 - qa_user, user-exec file fpunch 2023-07-06T02:04:06.001 INFO:teuthology.orchestra.run.smithi046.stdout: 6766 -rwsrwSrw- TEST_DIR/684/a 2023-07-06T02:04:06.001 INFO:teuthology.orchestra.run.smithi046.stdout: -766 -rwxrw-rw- TEST_DIR/684/a 2023-07-06T02:04:06.001 INFO:teuthology.orchestra.run.smithi046.stdout: +6766 -rwsrwSrw- TEST_DIR/684/a 2023-07-06T02:04:06.002 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-06T02:04:06.002 INFO:teuthology.orchestra.run.smithi046.stdout: Test 4 - qa_user, all-exec file fpunch 2023-07-06T02:04:06.002 INFO:teuthology.orchestra.run.smithi046.stdout: 6777 -rwsrwsrwx TEST_DIR/684/a 2023-07-06T02:04:06.002 INFO:teuthology.orchestra.run.smithi046.stdout: -777 -rwxrwxrwx TEST_DIR/684/a 2023-07-06T02:04:06.002 INFO:teuthology.orchestra.run.smithi046.stdout: +6777 -rwsrwsrwx TEST_DIR/684/a 2023-07-06T02:04:06.002 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-06T02:04:06.002 INFO:teuthology.orchestra.run.smithi046.stdout: Test 5 - root, non-exec file fpunch 2023-07-06T02:04:06.002 INFO:teuthology.orchestra.run.smithi046.stdout: 6666 -rwSrwSrw- TEST_DIR/684/a 2023-07-06T02:04:06.003 INFO:teuthology.orchestra.run.smithi046.stdout: @@ -33,9 +33,9 @@ 2023-07-06T02:04:06.003 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-06T02:04:06.003 INFO:teuthology.orchestra.run.smithi046.stdout: Test 9 - qa_user, group-exec file fpunch, only sgid 2023-07-06T02:04:06.003 INFO:teuthology.orchestra.run.smithi046.stdout: 2676 -rw-rwsrw- TEST_DIR/684/a 2023-07-06T02:04:06.003 INFO:teuthology.orchestra.run.smithi046.stdout: -676 -rw-rwxrw- TEST_DIR/684/a 2023-07-06T02:04:06.004 INFO:teuthology.orchestra.run.smithi046.stdout: +2676 -rw-rwsrw- TEST_DIR/684/a 2023-07-06T02:04:06.004 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-06T02:04:06.004 INFO:teuthology.orchestra.run.smithi046.stdout: Test 10 - qa_user, all-exec file fpunch, only sgid 2023-07-06T02:04:06.004 INFO:teuthology.orchestra.run.smithi046.stdout: 2777 -rwxrwsrwx TEST_DIR/684/a 2023-07-06T02:04:06.004 INFO:teuthology.orchestra.run.smithi046.stdout: -777 -rwxrwxrwx TEST_DIR/684/a 2023-07-06T02:04:06.004 INFO:teuthology.orchestra.run.smithi046.stdout: +2777 -rwxrwsrwx TEST_DIR/684/a 2023-07-06T02:04:06.004 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-06T02:04:06.005 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/684 2023-07-06T02:04:06.005 INFO:teuthology.orchestra.run.smithi046.stdout:Failures: generic/684 2023-07-06T02:04:06.005 INFO:teuthology.orchestra.run.smithi046.stdout:Failed 1 of 1 tests 2023-07-06T02:04:06.006 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-06T02:04:06.436 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-07-06T02:04:06.437 INFO:tasks.cephfs.xfstests_dev:Command failed 2023-07-06T02:04:06.438 INFO:tasks.cephfs.xfstests_dev:Command return value: 1 2023-07-06T02:04:06.438 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.rlt8E1h3iVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/685) 2023-07-06T02:04:07.045 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph 2023-07-06T02:04:07.066 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-06T02:04:07.067 INFO:teuthology.orchestra.run.smithi046.stdout:MKFS_OPTIONS -- 172.21.15.46:6789:/scratch 2023-07-06T02:04:07.068 INFO:teuthology.orchestra.run.smithi046.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCbvKVkpp1TIhAAvJTELoeH8wkIFqjtppg17w== -o context=system_u:object_r:root_t:s0 172.21.15.46:6789:/scratch /tmp/tmp.KrMG67MsYpscratch 2023-07-06T02:04:07.068 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-06T02:04:07.898 INFO:teuthology.orchestra.run.smithi046.stdout:generic/685 [not run] xfs_io fzero failed (old kernel/wrong fs?) 2023-07-06T02:04:07.903 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/685 2023-07-06T02:04:07.904 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/685 2023-07-06T02:04:07.904 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-07-06T02:04:07.906 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-06T02:04:07.963 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-06T02:04:07.963 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.rlt8E1h3iVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/686) 2023-07-06T02:04:08.437 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph 2023-07-06T02:04:08.445 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-06T02:04:08.446 INFO:teuthology.orchestra.run.smithi046.stdout:MKFS_OPTIONS -- 172.21.15.46:6789:/scratch 2023-07-06T02:04:08.447 INFO:teuthology.orchestra.run.smithi046.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCbvKVkpp1TIhAAvJTELoeH8wkIFqjtppg17w== -o context=system_u:object_r:root_t:s0 172.21.15.46:6789:/scratch /tmp/tmp.KrMG67MsYpscratch 2023-07-06T02:04:08.447 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-06T02:04:09.191 INFO:teuthology.orchestra.run.smithi046.stdout:generic/686 [not run] xfs_io finsert failed (old kernel/wrong fs?) 2023-07-06T02:04:09.196 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/686 2023-07-06T02:04:09.196 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/686 2023-07-06T02:04:09.197 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-07-06T02:04:09.201 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-06T02:04:09.249 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-06T02:04:09.249 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.rlt8E1h3iVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/687) 2023-07-06T02:04:09.768 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph 2023-07-06T02:04:09.782 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-06T02:04:09.782 INFO:teuthology.orchestra.run.smithi046.stdout:MKFS_OPTIONS -- 172.21.15.46:6789:/scratch 2023-07-06T02:04:09.784 INFO:teuthology.orchestra.run.smithi046.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCbvKVkpp1TIhAAvJTELoeH8wkIFqjtppg17w== -o context=system_u:object_r:root_t:s0 172.21.15.46:6789:/scratch /tmp/tmp.KrMG67MsYpscratch 2023-07-06T02:04:09.785 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-06T02:04:10.599 INFO:teuthology.orchestra.run.smithi046.stdout:generic/687 [not run] xfs_io fcollapse failed (old kernel/wrong fs?) 2023-07-06T02:04:10.608 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/687 2023-07-06T02:04:10.608 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/687 2023-07-06T02:04:10.608 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-07-06T02:04:10.611 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-06T02:04:10.661 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-06T02:04:10.661 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.rlt8E1h3iVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/688) 2023-07-06T02:04:11.102 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph 2023-07-06T02:04:11.114 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-06T02:04:11.114 INFO:teuthology.orchestra.run.smithi046.stdout:MKFS_OPTIONS -- 172.21.15.46:6789:/scratch 2023-07-06T02:04:11.114 INFO:teuthology.orchestra.run.smithi046.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCbvKVkpp1TIhAAvJTELoeH8wkIFqjtppg17w== -o context=system_u:object_r:root_t:s0 172.21.15.46:6789:/scratch /tmp/tmp.KrMG67MsYpscratch 2023-07-06T02:04:11.114 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-06T02:04:11.793 INFO:teuthology.orchestra.run.smithi046.stdout:generic/688 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-07-06T02:04:11.800 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/688 2023-07-06T02:04:11.800 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/688 2023-07-06T02:04:11.801 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-07-06T02:04:11.804 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-06T02:04:11.850 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-06T02:04:11.850 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.rlt8E1h3iVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/689) 2023-07-06T02:04:12.300 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph 2023-07-06T02:04:12.307 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-06T02:04:12.307 INFO:teuthology.orchestra.run.smithi046.stdout:MKFS_OPTIONS -- 172.21.15.46:6789:/scratch 2023-07-06T02:04:12.309 INFO:teuthology.orchestra.run.smithi046.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCbvKVkpp1TIhAAvJTELoeH8wkIFqjtppg17w== -o context=system_u:object_r:root_t:s0 172.21.15.46:6789:/scratch /tmp/tmp.KrMG67MsYpscratch 2023-07-06T02:04:12.310 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-06T02:04:12.950 INFO:teuthology.orchestra.run.smithi046.stdout:generic/689 [not run] kernel does not support mount_setattr syscall 2023-07-06T02:04:12.958 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/689 2023-07-06T02:04:12.959 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/689 2023-07-06T02:04:12.959 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-07-06T02:04:12.966 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-06T02:04:13.013 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-06T02:04:13.014 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.rlt8E1h3iVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/690) 2023-07-06T02:04:13.492 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph 2023-07-06T02:04:13.506 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-06T02:04:13.506 INFO:teuthology.orchestra.run.smithi046.stdout:MKFS_OPTIONS -- 172.21.15.46:6789:/scratch 2023-07-06T02:04:13.507 INFO:teuthology.orchestra.run.smithi046.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCbvKVkpp1TIhAAvJTELoeH8wkIFqjtppg17w== -o context=system_u:object_r:root_t:s0 172.21.15.46:6789:/scratch /tmp/tmp.KrMG67MsYpscratch 2023-07-06T02:04:13.507 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-06T02:04:14.241 INFO:teuthology.orchestra.run.smithi046.stdout:generic/690 [not run] require 172.21.15.46:6789:/scratch to be valid block disk 2023-07-06T02:04:14.246 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/690 2023-07-06T02:04:14.246 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/690 2023-07-06T02:04:14.247 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-07-06T02:04:14.249 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-06T02:04:14.321 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-06T02:04:14.321 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.rlt8E1h3iVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/691) 2023-07-06T02:04:14.776 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph 2023-07-06T02:04:14.787 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-06T02:04:14.787 INFO:teuthology.orchestra.run.smithi046.stdout:MKFS_OPTIONS -- 172.21.15.46:6789:/scratch 2023-07-06T02:04:14.789 INFO:teuthology.orchestra.run.smithi046.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCbvKVkpp1TIhAAvJTELoeH8wkIFqjtppg17w== -o context=system_u:object_r:root_t:s0 172.21.15.46:6789:/scratch /tmp/tmp.KrMG67MsYpscratch 2023-07-06T02:04:14.789 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-06T02:04:15.372 INFO:teuthology.orchestra.run.smithi046.stdout:generic/691 [not run] disk quotas not supported by this filesystem type: ceph 2023-07-06T02:04:15.377 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/691 2023-07-06T02:04:15.378 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/691 2023-07-06T02:04:15.378 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-07-06T02:04:15.381 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-06T02:04:15.423 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-06T02:04:15.424 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.rlt8E1h3iVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/692) 2023-07-06T02:04:15.955 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph 2023-07-06T02:04:15.992 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-06T02:04:15.992 INFO:teuthology.orchestra.run.smithi046.stdout:MKFS_OPTIONS -- 172.21.15.46:6789:/scratch 2023-07-06T02:04:15.993 INFO:teuthology.orchestra.run.smithi046.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCbvKVkpp1TIhAAvJTELoeH8wkIFqjtppg17w== -o context=system_u:object_r:root_t:s0 172.21.15.46:6789:/scratch /tmp/tmp.KrMG67MsYpscratch 2023-07-06T02:04:15.994 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-06T02:04:16.642 INFO:teuthology.orchestra.run.smithi046.stdout:generic/692 [not run] fsverity utility required, skipped this test 2023-07-06T02:04:16.650 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/692 2023-07-06T02:04:16.650 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/692 2023-07-06T02:04:16.650 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-07-06T02:04:16.653 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-06T02:04:16.701 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-06T02:04:16.701 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.rlt8E1h3iVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/693) 2023-07-06T02:04:17.185 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph 2023-07-06T02:04:17.203 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-06T02:04:17.203 INFO:teuthology.orchestra.run.smithi046.stdout:MKFS_OPTIONS -- 172.21.15.46:6789:/scratch 2023-07-06T02:04:17.203 INFO:teuthology.orchestra.run.smithi046.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCbvKVkpp1TIhAAvJTELoeH8wkIFqjtppg17w== -o context=system_u:object_r:root_t:s0 172.21.15.46:6789:/scratch /tmp/tmp.KrMG67MsYpscratch 2023-07-06T02:04:17.203 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-06T02:04:18.212 INFO:teuthology.orchestra.run.smithi046.stdout:generic/693 [not run] kernel does not support ceph encryption 2023-07-06T02:04:18.256 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/693 2023-07-06T02:04:18.257 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/693 2023-07-06T02:04:18.257 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-07-06T02:04:18.263 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-06T02:04:18.306 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-06T02:04:18.307 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.rlt8E1h3iVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/694) 2023-07-06T02:04:18.743 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph 2023-07-06T02:04:18.760 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-06T02:04:18.761 INFO:teuthology.orchestra.run.smithi046.stdout:MKFS_OPTIONS -- 172.21.15.46:6789:/scratch 2023-07-06T02:04:18.762 INFO:teuthology.orchestra.run.smithi046.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCbvKVkpp1TIhAAvJTELoeH8wkIFqjtppg17w== -o context=system_u:object_r:root_t:s0 172.21.15.46:6789:/scratch /tmp/tmp.KrMG67MsYpscratch 2023-07-06T02:04:18.762 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-06T02:04:26.456 INFO:teuthology.orchestra.run.smithi046.stdout:generic/694 7s 2023-07-06T02:04:26.465 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/694 2023-07-06T02:04:26.466 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-07-06T02:04:26.470 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-06T02:04:26.506 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-06T02:04:26.507 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.rlt8E1h3iVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/695) 2023-07-06T02:04:27.014 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph 2023-07-06T02:04:27.030 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-06T02:04:27.030 INFO:teuthology.orchestra.run.smithi046.stdout:MKFS_OPTIONS -- 172.21.15.46:6789:/scratch 2023-07-06T02:04:27.032 INFO:teuthology.orchestra.run.smithi046.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCbvKVkpp1TIhAAvJTELoeH8wkIFqjtppg17w== -o context=system_u:object_r:root_t:s0 172.21.15.46:6789:/scratch /tmp/tmp.KrMG67MsYpscratch 2023-07-06T02:04:27.032 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-06T02:04:27.677 INFO:teuthology.orchestra.run.smithi046.stdout:generic/695 [not run] require 172.21.15.46:6789:/scratch to be valid block disk 2023-07-06T02:04:27.682 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/695 2023-07-06T02:04:27.683 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/695 2023-07-06T02:04:27.683 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-07-06T02:04:27.690 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-06T02:04:27.718 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-06T02:04:27.719 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.rlt8E1h3iVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/696) 2023-07-06T02:04:28.210 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph 2023-07-06T02:04:28.225 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-06T02:04:28.225 INFO:teuthology.orchestra.run.smithi046.stdout:MKFS_OPTIONS -- 172.21.15.46:6789:/scratch 2023-07-06T02:04:28.226 INFO:teuthology.orchestra.run.smithi046.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCbvKVkpp1TIhAAvJTELoeH8wkIFqjtppg17w== -o context=system_u:object_r:root_t:s0 172.21.15.46:6789:/scratch /tmp/tmp.KrMG67MsYpscratch 2023-07-06T02:04:28.227 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-06T02:04:29.403 INFO:teuthology.orchestra.run.smithi046.stdout:generic/696 1s 2023-07-06T02:04:29.412 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/696 2023-07-06T02:04:29.413 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-07-06T02:04:29.415 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-06T02:04:29.457 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-06T02:04:29.458 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.rlt8E1h3iVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/697) 2023-07-06T02:04:29.932 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph 2023-07-06T02:04:29.937 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-06T02:04:29.938 INFO:teuthology.orchestra.run.smithi046.stdout:MKFS_OPTIONS -- 172.21.15.46:6789:/scratch 2023-07-06T02:04:29.939 INFO:teuthology.orchestra.run.smithi046.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCbvKVkpp1TIhAAvJTELoeH8wkIFqjtppg17w== -o context=system_u:object_r:root_t:s0 172.21.15.46:6789:/scratch /tmp/tmp.KrMG67MsYpscratch 2023-07-06T02:04:29.939 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-06T02:04:30.793 INFO:teuthology.orchestra.run.smithi046.stdout:generic/697 0s 2023-07-06T02:04:30.811 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/697 2023-07-06T02:04:30.811 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-07-06T02:04:30.815 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-06T02:04:30.901 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-06T02:04:30.902 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.rlt8E1h3iVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/698) 2023-07-06T02:04:31.446 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph 2023-07-06T02:04:31.477 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-06T02:04:31.478 INFO:teuthology.orchestra.run.smithi046.stdout:MKFS_OPTIONS -- 172.21.15.46:6789:/scratch 2023-07-06T02:04:31.479 INFO:teuthology.orchestra.run.smithi046.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCbvKVkpp1TIhAAvJTELoeH8wkIFqjtppg17w== -o context=system_u:object_r:root_t:s0 172.21.15.46:6789:/scratch /tmp/tmp.KrMG67MsYpscratch 2023-07-06T02:04:31.479 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-06T02:04:32.192 INFO:teuthology.orchestra.run.smithi046.stdout:generic/698 [not run] kernel does not support mount_setattr syscall 2023-07-06T02:04:32.198 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/698 2023-07-06T02:04:32.198 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/698 2023-07-06T02:04:32.199 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-07-06T02:04:32.201 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-06T02:04:32.285 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-06T02:04:32.285 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.rlt8E1h3iVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/699) 2023-07-06T02:04:32.839 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph 2023-07-06T02:04:32.845 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-06T02:04:32.846 INFO:teuthology.orchestra.run.smithi046.stdout:MKFS_OPTIONS -- 172.21.15.46:6789:/scratch 2023-07-06T02:04:32.847 INFO:teuthology.orchestra.run.smithi046.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCbvKVkpp1TIhAAvJTELoeH8wkIFqjtppg17w== -o context=system_u:object_r:root_t:s0 172.21.15.46:6789:/scratch /tmp/tmp.KrMG67MsYpscratch 2023-07-06T02:04:32.847 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-06T02:04:33.491 INFO:teuthology.orchestra.run.smithi046.stdout:generic/699 [not run] kernel does not support mount_setattr syscall 2023-07-06T02:04:33.504 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/699 2023-07-06T02:04:33.504 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/699 2023-07-06T02:04:33.504 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-07-06T02:04:33.514 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-06T02:04:33.568 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-06T02:04:33.568 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.rlt8E1h3iVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/700) 2023-07-06T02:04:34.019 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph 2023-07-06T02:04:34.032 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-06T02:04:34.033 INFO:teuthology.orchestra.run.smithi046.stdout:MKFS_OPTIONS -- 172.21.15.46:6789:/scratch 2023-07-06T02:04:34.038 INFO:teuthology.orchestra.run.smithi046.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCbvKVkpp1TIhAAvJTELoeH8wkIFqjtppg17w== -o context=system_u:object_r:root_t:s0 172.21.15.46:6789:/scratch /tmp/tmp.KrMG67MsYpscratch 2023-07-06T02:04:34.038 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-06T02:04:34.769 INFO:teuthology.orchestra.run.smithi046.stdout:generic/700 [not run] kernel doesn't support renameat2 syscall 2023-07-06T02:04:34.775 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/700 2023-07-06T02:04:34.776 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/700 2023-07-06T02:04:34.776 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-07-06T02:04:34.779 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-06T02:04:35.087 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-06T02:04:35.087 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.rlt8E1h3iVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/701) 2023-07-06T02:04:35.782 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph 2023-07-06T02:04:35.796 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-06T02:04:35.797 INFO:teuthology.orchestra.run.smithi046.stdout:MKFS_OPTIONS -- 172.21.15.46:6789:/scratch 2023-07-06T02:04:35.798 INFO:teuthology.orchestra.run.smithi046.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCbvKVkpp1TIhAAvJTELoeH8wkIFqjtppg17w== -o context=system_u:object_r:root_t:s0 172.21.15.46:6789:/scratch /tmp/tmp.KrMG67MsYpscratch 2023-07-06T02:04:35.798 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-06T02:04:44.529 INFO:teuthology.orchestra.run.smithi046.stdout:generic/701 8s 2023-07-06T02:04:44.540 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/701 2023-07-06T02:04:44.540 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-07-06T02:04:44.542 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-06T02:04:44.823 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-06T02:04:44.823 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.rlt8E1h3iVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/702) 2023-07-06T02:04:45.484 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph 2023-07-06T02:04:45.490 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-06T02:04:45.490 INFO:teuthology.orchestra.run.smithi046.stdout:MKFS_OPTIONS -- 172.21.15.46:6789:/scratch 2023-07-06T02:04:45.491 INFO:teuthology.orchestra.run.smithi046.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCbvKVkpp1TIhAAvJTELoeH8wkIFqjtppg17w== -o context=system_u:object_r:root_t:s0 172.21.15.46:6789:/scratch /tmp/tmp.KrMG67MsYpscratch 2023-07-06T02:04:45.491 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-06T02:04:46.807 INFO:teuthology.orchestra.run.smithi046.stdout:generic/702 [not run] Reflink not supported by scratch filesystem type: ceph 2023-07-06T02:04:46.905 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/702 2023-07-06T02:04:46.906 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/702 2023-07-06T02:04:46.906 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-07-06T02:04:46.920 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-06T02:04:47.050 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-06T02:04:47.051 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.rlt8E1h3iVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/703) 2023-07-06T02:04:47.521 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph 2023-07-06T02:04:47.537 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-06T02:04:47.538 INFO:teuthology.orchestra.run.smithi046.stdout:MKFS_OPTIONS -- 172.21.15.46:6789:/scratch 2023-07-06T02:04:47.538 INFO:teuthology.orchestra.run.smithi046.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCbvKVkpp1TIhAAvJTELoeH8wkIFqjtppg17w== -o context=system_u:object_r:root_t:s0 172.21.15.46:6789:/scratch /tmp/tmp.KrMG67MsYpscratch 2023-07-06T02:04:47.539 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-06T02:04:48.610 INFO:teuthology.orchestra.run.smithi046.stdout:generic/703 [not run] kernel does not support IO_URING 2023-07-06T02:04:48.615 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/703 2023-07-06T02:04:48.615 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/703 2023-07-06T02:04:48.615 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-07-06T02:04:48.618 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-06T02:04:48.690 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-06T02:04:48.690 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.rlt8E1h3iVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/704) 2023-07-06T02:04:49.148 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph 2023-07-06T02:04:49.156 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-06T02:04:49.157 INFO:teuthology.orchestra.run.smithi046.stdout:MKFS_OPTIONS -- 172.21.15.46:6789:/scratch 2023-07-06T02:04:49.159 INFO:teuthology.orchestra.run.smithi046.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCbvKVkpp1TIhAAvJTELoeH8wkIFqjtppg17w== -o context=system_u:object_r:root_t:s0 172.21.15.46:6789:/scratch /tmp/tmp.KrMG67MsYpscratch 2023-07-06T02:04:49.159 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-06T02:04:49.882 INFO:teuthology.orchestra.run.smithi046.stdout:generic/704 [not run] require 172.21.15.46:6789:/test to be valid block disk 2023-07-06T02:04:49.893 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/704 2023-07-06T02:04:49.893 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/704 2023-07-06T02:04:49.893 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-07-06T02:04:49.897 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-06T02:04:49.937 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-06T02:04:49.938 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.rlt8E1h3iVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/705) 2023-07-06T02:04:50.326 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph 2023-07-06T02:04:50.344 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-06T02:04:50.352 INFO:teuthology.orchestra.run.smithi046.stdout:MKFS_OPTIONS -- 172.21.15.46:6789:/scratch 2023-07-06T02:04:50.352 INFO:teuthology.orchestra.run.smithi046.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCbvKVkpp1TIhAAvJTELoeH8wkIFqjtppg17w== -o context=system_u:object_r:root_t:s0 172.21.15.46:6789:/scratch /tmp/tmp.KrMG67MsYpscratch 2023-07-06T02:04:50.352 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-06T02:04:51.234 INFO:teuthology.orchestra.run.smithi046.stdout:generic/705 [not run] ceph does not support shutdown 2023-07-06T02:04:51.266 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/705 2023-07-06T02:04:51.267 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/705 2023-07-06T02:04:51.267 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-07-06T02:04:51.269 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-06T02:04:51.297 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-06T02:04:51.297 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.rlt8E1h3iVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/706) 2023-07-06T02:04:51.796 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph 2023-07-06T02:04:51.803 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-06T02:04:51.804 INFO:teuthology.orchestra.run.smithi046.stdout:MKFS_OPTIONS -- 172.21.15.46:6789:/scratch 2023-07-06T02:04:51.815 INFO:teuthology.orchestra.run.smithi046.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCbvKVkpp1TIhAAvJTELoeH8wkIFqjtppg17w== -o context=system_u:object_r:root_t:s0 172.21.15.46:6789:/scratch /tmp/tmp.KrMG67MsYpscratch 2023-07-06T02:04:51.816 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-06T02:04:54.418 INFO:teuthology.orchestra.run.smithi046.stdout:generic/706 2s 2023-07-06T02:04:54.445 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/706 2023-07-06T02:04:54.446 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-07-06T02:04:54.453 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-06T02:04:54.935 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-06T02:04:54.936 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.rlt8E1h3iVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/707) 2023-07-06T02:04:55.387 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph 2023-07-06T02:04:55.393 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-06T02:04:55.393 INFO:teuthology.orchestra.run.smithi046.stdout:MKFS_OPTIONS -- 172.21.15.46:6789:/scratch 2023-07-06T02:04:55.395 INFO:teuthology.orchestra.run.smithi046.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCbvKVkpp1TIhAAvJTELoeH8wkIFqjtppg17w== -o context=system_u:object_r:root_t:s0 172.21.15.46:6789:/scratch /tmp/tmp.KrMG67MsYpscratch 2023-07-06T02:04:55.395 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-06T02:05:32.923 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-06T02:05:32.926 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-06T02:05:33.064 INFO:tasks.ceph.mds.d.smithi073.stderr:2023-07-06T02:05:33.061+0000 7f07b5126700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 129337) UID: 0 2023-07-06T02:05:33.064 INFO:tasks.ceph.mds.b.smithi073.stderr:2023-07-06T02:05:33.063+0000 7f1ff165c700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 129337) UID: 0 2023-07-06T02:09:18.151 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-06T02:09:18.155 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-06T02:09:48.545 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-06T02:09:48.548 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-06T02:10:19.084 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-06T02:10:19.087 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-06T02:10:49.411 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-06T02:10:49.414 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-06T02:10:49.483 INFO:tasks.ceph.osd.5.smithi073.stderr:2023-07-06T02:10:49.480+0000 7f1dead60700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 129473) UID: 0 2023-07-06T02:10:49.483 INFO:tasks.ceph.osd.6.smithi073.stderr:2023-07-06T02:10:49.480+0000 7f2582084700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 129473) UID: 0 2023-07-06T02:10:49.487 INFO:tasks.ceph.osd.7.smithi073.stderr:2023-07-06T02:10:49.480+0000 7fe6067a5700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 129473) UID: 0 2023-07-06T02:10:49.487 INFO:tasks.ceph.osd.4.smithi073.stderr:2023-07-06T02:10:49.478+0000 7fb7867e9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 129473) UID: 0 2023-07-06T02:13:48.059 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-06T02:13:48.062 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-06T02:14:18.130 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-06T02:14:18.133 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-06T02:14:48.214 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-06T02:14:48.229 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-06T02:14:48.309 INFO:tasks.ceph.osd.4.smithi073.stderr:2023-07-06T02:14:48.306+0000 7fb7867e9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 129571) UID: 0 2023-07-06T02:14:48.309 INFO:tasks.ceph.osd.7.smithi073.stderr:2023-07-06T02:14:48.306+0000 7fe6067a5700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 129571) UID: 0 2023-07-06T02:14:48.310 INFO:tasks.ceph.osd.5.smithi073.stderr:2023-07-06T02:14:48.306+0000 7f1dead60700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 129571) UID: 0 2023-07-06T02:14:48.310 INFO:tasks.ceph.osd.6.smithi073.stderr:2023-07-06T02:14:48.306+0000 7f2582084700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 129571) UID: 0 2023-07-06T02:17:46.794 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-06T02:17:46.798 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-06T02:18:16.925 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-06T02:18:16.927 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-06T02:18:47.029 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-06T02:18:47.033 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-06T02:19:17.145 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-06T02:19:17.148 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-06T02:19:47.393 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-06T02:19:47.395 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-06T02:20:17.477 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-06T02:20:17.480 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-06T02:20:17.582 INFO:tasks.ceph.osd.4.smithi073.stderr:2023-07-06T02:20:17.579+0000 7fb7867e9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 129747) UID: 0 2023-07-06T02:20:17.584 INFO:tasks.ceph.osd.6.smithi073.stderr:2023-07-06T02:20:17.579+0000 7f2582084700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 129747) UID: 0 2023-07-06T02:20:17.586 INFO:tasks.ceph.osd.5.smithi073.stderr:2023-07-06T02:20:17.583+0000 7f1dead60700 -1 Fail to open '/proc/129747/cmdline' error = (2) No such file or directory 2023-07-06T02:20:17.586 INFO:tasks.ceph.osd.5.smithi073.stderr:2023-07-06T02:20:17.583+0000 7f1dead60700 -1 received signal: Hangup from (PID: 129747) UID: 0 2023-07-06T02:20:17.587 INFO:tasks.ceph.osd.7.smithi073.stderr:2023-07-06T02:20:17.580+0000 7fe6067a5700 -1 Fail to open '/proc/129747/cmdline' error = (2) No such file or directory 2023-07-06T02:20:17.587 INFO:tasks.ceph.osd.7.smithi073.stderr:2023-07-06T02:20:17.580+0000 7fe6067a5700 -1 received signal: Hangup from (PID: 129747) UID: 0 2023-07-06T02:23:17.775 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-06T02:23:17.778 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-06T02:23:17.819 INFO:tasks.ceph.mds.b.smithi073.stderr:2023-07-06T02:23:17.817+0000 7f1ff165c700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 129798) UID: 0 2023-07-06T02:23:17.820 INFO:tasks.ceph.mds.d.smithi073.stderr:2023-07-06T02:23:17.817+0000 7f07b5126700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 129798) UID: 0 2023-07-06T02:26:30.785 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-06T02:26:30.787 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-06T02:26:30.886 INFO:tasks.ceph.osd.4.smithi073.stderr:2023-07-06T02:26:30.884+0000 7fb7867e9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 129855) UID: 0 2023-07-06T02:26:30.887 INFO:tasks.ceph.osd.7.smithi073.stderr:2023-07-06T02:26:30.885+0000 7fe6067a5700 -1 Fail to open '/proc/129855/cmdline' error = (2) No such file or directory 2023-07-06T02:26:30.887 INFO:tasks.ceph.osd.7.smithi073.stderr:2023-07-06T02:26:30.885+0000 7fe6067a5700 -1 received signal: Hangup from (PID: 129855) UID: 0 2023-07-06T02:26:30.890 INFO:tasks.ceph.osd.5.smithi073.stderr:2023-07-06T02:26:30.885+0000 7f1dead60700 -1 Fail to open '/proc/129855/cmdline' error = (2) No such file or directory 2023-07-06T02:26:30.890 INFO:tasks.ceph.osd.5.smithi073.stderr:2023-07-06T02:26:30.885+0000 7f1dead60700 -1 received signal: Hangup from (PID: 129855) UID: 0 2023-07-06T02:26:30.890 INFO:tasks.ceph.osd.6.smithi073.stderr:2023-07-06T02:26:30.884+0000 7f2582084700 -1 received signal: Hangup from (PID: 129855) UID: 0 2023-07-06T02:29:34.282 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-06T02:29:34.284 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-06T02:30:04.362 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-06T02:30:04.364 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-06T02:30:34.452 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-06T02:30:34.455 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-06T02:31:04.542 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-06T02:31:04.544 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-06T02:31:34.641 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-06T02:31:34.644 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-06T02:32:04.746 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-06T02:32:04.768 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-06T02:32:34.861 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-06T02:32:34.866 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-06T02:32:34.952 INFO:tasks.ceph.osd.2.smithi046.stderr:2023-07-06T02:32:34.950+0000 7f5a7ef99700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 900451) UID: 0 2023-07-06T02:32:34.954 INFO:tasks.ceph.osd.1.smithi046.stderr:2023-07-06T02:32:34.953+0000 7f2fc7c11700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 900451) UID: 0 2023-07-06T02:32:34.956 INFO:tasks.ceph.osd.0.smithi046.stderr:2023-07-06T02:32:34.953+0000 7f77d1dc1700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 900451) UID: 0 2023-07-06T02:32:34.958 INFO:tasks.ceph.osd.3.smithi046.stderr:2023-07-06T02:32:34.957+0000 7f1104079700 -1 Fail to open '/proc/900451/cmdline' error = (2) No such file or directory 2023-07-06T02:32:34.958 INFO:tasks.ceph.osd.3.smithi046.stderr:2023-07-06T02:32:34.957+0000 7f1104079700 -1 received signal: Hangup from (PID: 900451) UID: 0 2023-07-06T02:35:40.724 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-06T02:35:40.727 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-06T02:36:11.115 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-06T02:36:11.120 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-06T02:36:41.202 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-06T02:36:41.204 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-06T02:37:11.293 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-06T02:37:11.295 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-06T02:37:41.399 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-06T02:37:41.402 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-06T02:38:11.510 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-06T02:38:11.512 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-06T02:38:41.721 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-06T02:38:41.727 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-06T02:39:11.809 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-06T02:39:11.812 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-06T02:39:14.220 INFO:teuthology.orchestra.run.smithi046.stdout:generic/707 2059s 2023-07-06T02:39:14.242 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/707 2023-07-06T02:39:14.243 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-07-06T02:39:14.245 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-06T02:39:14.259 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-06T02:39:14.260 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.rlt8E1h3iVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/708) 2023-07-06T02:39:14.859 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph 2023-07-06T02:39:14.864 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-06T02:39:14.865 INFO:teuthology.orchestra.run.smithi046.stdout:MKFS_OPTIONS -- 172.21.15.46:6789:/scratch 2023-07-06T02:39:14.866 INFO:teuthology.orchestra.run.smithi046.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCbvKVkpp1TIhAAvJTELoeH8wkIFqjtppg17w== -o context=system_u:object_r:root_t:s0 172.21.15.46:6789:/scratch /tmp/tmp.KrMG67MsYpscratch 2023-07-06T02:39:14.866 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-06T02:39:20.458 INFO:teuthology.orchestra.run.smithi046.stdout:generic/708 1s 2023-07-06T02:39:20.464 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/708 2023-07-06T02:39:20.464 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-07-06T02:39:20.478 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-06T02:39:20.945 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-06T02:39:20.946 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.rlt8E1h3iVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/709) 2023-07-06T02:39:21.439 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph 2023-07-06T02:39:21.444 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-06T02:39:21.444 INFO:teuthology.orchestra.run.smithi046.stdout:MKFS_OPTIONS -- 172.21.15.46:6789:/scratch 2023-07-06T02:39:21.445 INFO:teuthology.orchestra.run.smithi046.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCbvKVkpp1TIhAAvJTELoeH8wkIFqjtppg17w== -o context=system_u:object_r:root_t:s0 172.21.15.46:6789:/scratch /tmp/tmp.KrMG67MsYpscratch 2023-07-06T02:39:21.446 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-06T02:39:22.294 INFO:teuthology.orchestra.run.smithi046.stdout:generic/709 [not run] xfs_io swapext -v vfs not supported on ceph 2023-07-06T02:39:22.298 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/709 2023-07-06T02:39:22.298 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/709 2023-07-06T02:39:22.299 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-07-06T02:39:22.301 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-06T02:39:22.705 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-06T02:39:22.706 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.rlt8E1h3iVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/710) 2023-07-06T02:39:23.185 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph 2023-07-06T02:39:23.190 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-06T02:39:23.191 INFO:teuthology.orchestra.run.smithi046.stdout:MKFS_OPTIONS -- 172.21.15.46:6789:/scratch 2023-07-06T02:39:23.192 INFO:teuthology.orchestra.run.smithi046.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCbvKVkpp1TIhAAvJTELoeH8wkIFqjtppg17w== -o context=system_u:object_r:root_t:s0 172.21.15.46:6789:/scratch /tmp/tmp.KrMG67MsYpscratch 2023-07-06T02:39:23.192 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-06T02:39:23.796 INFO:teuthology.orchestra.run.smithi046.stdout:generic/710 [not run] xfs_io swapext -v vfs not supported on ceph 2023-07-06T02:39:23.803 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/710 2023-07-06T02:39:23.804 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/710 2023-07-06T02:39:23.804 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-07-06T02:39:23.806 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-06T02:39:24.204 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-06T02:39:24.205 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.rlt8E1h3iVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/711) 2023-07-06T02:39:24.672 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph 2023-07-06T02:39:24.682 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-06T02:39:24.683 INFO:teuthology.orchestra.run.smithi046.stdout:MKFS_OPTIONS -- 172.21.15.46:6789:/scratch 2023-07-06T02:39:24.684 INFO:teuthology.orchestra.run.smithi046.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCbvKVkpp1TIhAAvJTELoeH8wkIFqjtppg17w== -o context=system_u:object_r:root_t:s0 172.21.15.46:6789:/scratch /tmp/tmp.KrMG67MsYpscratch 2023-07-06T02:39:24.684 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-06T02:39:25.239 INFO:teuthology.orchestra.run.smithi046.stdout:generic/711 [not run] xfs_io swapext -v vfs not supported on ceph 2023-07-06T02:39:25.245 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/711 2023-07-06T02:39:25.245 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/711 2023-07-06T02:39:25.245 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-07-06T02:39:25.253 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-06T02:39:25.685 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-06T02:39:25.686 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.rlt8E1h3iVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/712) 2023-07-06T02:39:26.153 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph 2023-07-06T02:39:26.161 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-06T02:39:26.162 INFO:teuthology.orchestra.run.smithi046.stdout:MKFS_OPTIONS -- 172.21.15.46:6789:/scratch 2023-07-06T02:39:26.164 INFO:teuthology.orchestra.run.smithi046.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCbvKVkpp1TIhAAvJTELoeH8wkIFqjtppg17w== -o context=system_u:object_r:root_t:s0 172.21.15.46:6789:/scratch /tmp/tmp.KrMG67MsYpscratch 2023-07-06T02:39:26.164 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-06T02:39:26.789 INFO:teuthology.orchestra.run.smithi046.stdout:generic/712 [not run] xfs_io swapext -v vfs not supported on ceph 2023-07-06T02:39:26.799 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/712 2023-07-06T02:39:26.800 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/712 2023-07-06T02:39:26.800 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-07-06T02:39:26.802 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-06T02:39:27.008 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-06T02:39:27.009 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.rlt8E1h3iVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/713) 2023-07-06T02:39:27.682 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph 2023-07-06T02:39:27.687 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-06T02:39:27.687 INFO:teuthology.orchestra.run.smithi046.stdout:MKFS_OPTIONS -- 172.21.15.46:6789:/scratch 2023-07-06T02:39:27.688 INFO:teuthology.orchestra.run.smithi046.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCbvKVkpp1TIhAAvJTELoeH8wkIFqjtppg17w== -o context=system_u:object_r:root_t:s0 172.21.15.46:6789:/scratch /tmp/tmp.KrMG67MsYpscratch 2023-07-06T02:39:27.688 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-06T02:39:28.391 INFO:teuthology.orchestra.run.smithi046.stdout:generic/713 [not run] xfs_io swapext -v vfs -s 64k -l 64k not supported on ceph 2023-07-06T02:39:28.397 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/713 2023-07-06T02:39:28.397 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/713 2023-07-06T02:39:28.397 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-07-06T02:39:28.400 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-06T02:39:28.785 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-06T02:39:28.786 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.rlt8E1h3iVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/714) 2023-07-06T02:39:29.281 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph 2023-07-06T02:39:29.291 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-06T02:39:29.291 INFO:teuthology.orchestra.run.smithi046.stdout:MKFS_OPTIONS -- 172.21.15.46:6789:/scratch 2023-07-06T02:39:29.292 INFO:teuthology.orchestra.run.smithi046.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCbvKVkpp1TIhAAvJTELoeH8wkIFqjtppg17w== -o context=system_u:object_r:root_t:s0 172.21.15.46:6789:/scratch /tmp/tmp.KrMG67MsYpscratch 2023-07-06T02:39:29.293 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-06T02:39:29.943 INFO:teuthology.orchestra.run.smithi046.stdout:generic/714 [not run] xfs_io swapext -v vfs not supported on ceph 2023-07-06T02:39:29.947 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/714 2023-07-06T02:39:29.948 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/714 2023-07-06T02:39:29.948 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-07-06T02:39:29.950 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-06T02:39:30.159 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-06T02:39:30.160 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.rlt8E1h3iVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/715) 2023-07-06T02:39:30.807 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph 2023-07-06T02:39:30.821 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-06T02:39:30.822 INFO:teuthology.orchestra.run.smithi046.stdout:MKFS_OPTIONS -- 172.21.15.46:6789:/scratch 2023-07-06T02:39:30.823 INFO:teuthology.orchestra.run.smithi046.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCbvKVkpp1TIhAAvJTELoeH8wkIFqjtppg17w== -o context=system_u:object_r:root_t:s0 172.21.15.46:6789:/scratch /tmp/tmp.KrMG67MsYpscratch 2023-07-06T02:39:30.823 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-06T02:39:31.476 INFO:teuthology.orchestra.run.smithi046.stdout:generic/715 [not run] xfs_io swapext -v vfs -s 64k -l 64k not supported on ceph 2023-07-06T02:39:31.481 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/715 2023-07-06T02:39:31.481 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/715 2023-07-06T02:39:31.481 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-07-06T02:39:31.484 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-06T02:39:31.916 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-06T02:39:31.916 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.rlt8E1h3iVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/716) 2023-07-06T02:39:32.386 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph 2023-07-06T02:39:32.392 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-06T02:39:32.392 INFO:teuthology.orchestra.run.smithi046.stdout:MKFS_OPTIONS -- 172.21.15.46:6789:/scratch 2023-07-06T02:39:32.394 INFO:teuthology.orchestra.run.smithi046.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCbvKVkpp1TIhAAvJTELoeH8wkIFqjtppg17w== -o context=system_u:object_r:root_t:s0 172.21.15.46:6789:/scratch /tmp/tmp.KrMG67MsYpscratch 2023-07-06T02:39:32.394 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-06T02:39:33.045 INFO:teuthology.orchestra.run.smithi046.stdout:generic/716 [not run] xfs_io swapext -v vfs not supported on ceph 2023-07-06T02:39:33.050 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/716 2023-07-06T02:39:33.050 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/716 2023-07-06T02:39:33.050 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-07-06T02:39:33.053 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-06T02:39:33.482 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-06T02:39:33.482 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.rlt8E1h3iVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/717) 2023-07-06T02:39:33.948 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph 2023-07-06T02:39:33.954 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-06T02:39:33.955 INFO:teuthology.orchestra.run.smithi046.stdout:MKFS_OPTIONS -- 172.21.15.46:6789:/scratch 2023-07-06T02:39:33.956 INFO:teuthology.orchestra.run.smithi046.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCbvKVkpp1TIhAAvJTELoeH8wkIFqjtppg17w== -o context=system_u:object_r:root_t:s0 172.21.15.46:6789:/scratch /tmp/tmp.KrMG67MsYpscratch 2023-07-06T02:39:33.956 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-06T02:39:34.531 INFO:teuthology.orchestra.run.smithi046.stdout:generic/717 [not run] xfs_io swapext -v vfs not supported on ceph 2023-07-06T02:39:34.536 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/717 2023-07-06T02:39:34.537 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/717 2023-07-06T02:39:34.537 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-07-06T02:39:34.543 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-06T02:39:34.938 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-06T02:39:34.939 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.rlt8E1h3iVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/718) 2023-07-06T02:39:35.439 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph 2023-07-06T02:39:35.444 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-06T02:39:35.445 INFO:teuthology.orchestra.run.smithi046.stdout:MKFS_OPTIONS -- 172.21.15.46:6789:/scratch 2023-07-06T02:39:35.446 INFO:teuthology.orchestra.run.smithi046.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCbvKVkpp1TIhAAvJTELoeH8wkIFqjtppg17w== -o context=system_u:object_r:root_t:s0 172.21.15.46:6789:/scratch /tmp/tmp.KrMG67MsYpscratch 2023-07-06T02:39:35.446 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-06T02:39:36.068 INFO:teuthology.orchestra.run.smithi046.stdout:generic/718 [not run] xfs_io swapext -v vfs not supported on ceph 2023-07-06T02:39:36.073 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/718 2023-07-06T02:39:36.073 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/718 2023-07-06T02:39:36.074 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-07-06T02:39:36.077 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-06T02:39:36.438 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-06T02:39:36.438 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.rlt8E1h3iVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/719) 2023-07-06T02:39:37.006 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph 2023-07-06T02:39:37.012 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-06T02:39:37.012 INFO:teuthology.orchestra.run.smithi046.stdout:MKFS_OPTIONS -- 172.21.15.46:6789:/scratch 2023-07-06T02:39:37.016 INFO:teuthology.orchestra.run.smithi046.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCbvKVkpp1TIhAAvJTELoeH8wkIFqjtppg17w== -o context=system_u:object_r:root_t:s0 172.21.15.46:6789:/scratch /tmp/tmp.KrMG67MsYpscratch 2023-07-06T02:39:37.016 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-06T02:39:37.586 INFO:teuthology.orchestra.run.smithi046.stdout:generic/719 [not run] xfs_io swapext -v vfs not supported on ceph 2023-07-06T02:39:37.594 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/719 2023-07-06T02:39:37.594 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/719 2023-07-06T02:39:37.594 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-07-06T02:39:37.596 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-06T02:39:37.859 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-06T02:39:37.860 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.rlt8E1h3iVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/720) 2023-07-06T02:39:38.444 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph 2023-07-06T02:39:38.449 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-06T02:39:38.450 INFO:teuthology.orchestra.run.smithi046.stdout:MKFS_OPTIONS -- 172.21.15.46:6789:/scratch 2023-07-06T02:39:38.451 INFO:teuthology.orchestra.run.smithi046.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCbvKVkpp1TIhAAvJTELoeH8wkIFqjtppg17w== -o context=system_u:object_r:root_t:s0 172.21.15.46:6789:/scratch /tmp/tmp.KrMG67MsYpscratch 2023-07-06T02:39:38.451 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-06T02:39:39.068 INFO:teuthology.orchestra.run.smithi046.stdout:generic/720 [not run] xfs_io swapext -v vfs not supported on ceph 2023-07-06T02:39:39.073 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/720 2023-07-06T02:39:39.074 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/720 2023-07-06T02:39:39.074 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-07-06T02:39:39.077 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-06T02:39:39.563 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-06T02:39:39.564 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.rlt8E1h3iVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/721) 2023-07-06T02:39:39.966 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph 2023-07-06T02:39:39.972 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-06T02:39:39.973 INFO:teuthology.orchestra.run.smithi046.stdout:MKFS_OPTIONS -- 172.21.15.46:6789:/scratch 2023-07-06T02:39:39.974 INFO:teuthology.orchestra.run.smithi046.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCbvKVkpp1TIhAAvJTELoeH8wkIFqjtppg17w== -o context=system_u:object_r:root_t:s0 172.21.15.46:6789:/scratch /tmp/tmp.KrMG67MsYpscratch 2023-07-06T02:39:39.974 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-06T02:39:40.590 INFO:teuthology.orchestra.run.smithi046.stdout:generic/721 [not run] xfs_io startupdate support is missing 2023-07-06T02:39:40.595 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/721 2023-07-06T02:39:40.595 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/721 2023-07-06T02:39:40.596 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-07-06T02:39:40.602 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-06T02:39:40.677 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-06T02:39:40.678 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.rlt8E1h3iVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/722) 2023-07-06T02:39:41.065 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph 2023-07-06T02:39:41.073 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-06T02:39:41.074 INFO:teuthology.orchestra.run.smithi046.stdout:MKFS_OPTIONS -- 172.21.15.46:6789:/scratch 2023-07-06T02:39:41.075 INFO:teuthology.orchestra.run.smithi046.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCbvKVkpp1TIhAAvJTELoeH8wkIFqjtppg17w== -o context=system_u:object_r:root_t:s0 172.21.15.46:6789:/scratch /tmp/tmp.KrMG67MsYpscratch 2023-07-06T02:39:41.075 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-06T02:39:41.744 INFO:teuthology.orchestra.run.smithi046.stdout:generic/722 [not run] xfs_io swapext -v vfs -a not supported on ceph 2023-07-06T02:39:41.749 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/722 2023-07-06T02:39:41.749 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/722 2023-07-06T02:39:41.749 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-07-06T02:39:41.751 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-06T02:39:41.925 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-06T02:39:42.040 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-06T02:39:42.187 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-06T02:39:42.188 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.rlt8E1h3iVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/723) 2023-07-06T02:39:42.661 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph 2023-07-06T02:39:42.666 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-06T02:39:42.667 INFO:teuthology.orchestra.run.smithi046.stdout:MKFS_OPTIONS -- 172.21.15.46:6789:/scratch 2023-07-06T02:39:42.668 INFO:teuthology.orchestra.run.smithi046.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCbvKVkpp1TIhAAvJTELoeH8wkIFqjtppg17w== -o context=system_u:object_r:root_t:s0 172.21.15.46:6789:/scratch /tmp/tmp.KrMG67MsYpscratch 2023-07-06T02:39:42.668 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-06T02:39:43.304 INFO:teuthology.orchestra.run.smithi046.stdout:generic/723 [not run] xfs_io swapext -v vfs not supported on ceph 2023-07-06T02:39:43.310 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/723 2023-07-06T02:39:43.310 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/723 2023-07-06T02:39:43.311 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-07-06T02:39:43.314 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-06T02:39:43.697 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-06T02:39:43.697 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.rlt8E1h3iVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/724) 2023-07-06T02:39:44.198 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph 2023-07-06T02:39:44.209 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-06T02:39:44.210 INFO:teuthology.orchestra.run.smithi046.stdout:MKFS_OPTIONS -- 172.21.15.46:6789:/scratch 2023-07-06T02:39:44.211 INFO:teuthology.orchestra.run.smithi046.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCbvKVkpp1TIhAAvJTELoeH8wkIFqjtppg17w== -o context=system_u:object_r:root_t:s0 172.21.15.46:6789:/scratch /tmp/tmp.KrMG67MsYpscratch 2023-07-06T02:39:44.211 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-06T02:39:44.796 INFO:teuthology.orchestra.run.smithi046.stdout:generic/724 [not run] xfs_io swapext -v vfs -a not supported on ceph 2023-07-06T02:39:44.801 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/724 2023-07-06T02:39:44.802 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/724 2023-07-06T02:39:44.802 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-07-06T02:39:44.805 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-06T02:39:45.272 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-06T02:39:45.272 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.rlt8E1h3iVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/725) 2023-07-06T02:39:45.727 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph 2023-07-06T02:39:45.738 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-06T02:39:45.738 INFO:teuthology.orchestra.run.smithi046.stdout:MKFS_OPTIONS -- 172.21.15.46:6789:/scratch 2023-07-06T02:39:45.739 INFO:teuthology.orchestra.run.smithi046.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCbvKVkpp1TIhAAvJTELoeH8wkIFqjtppg17w== -o context=system_u:object_r:root_t:s0 172.21.15.46:6789:/scratch /tmp/tmp.KrMG67MsYpscratch 2023-07-06T02:39:45.740 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-06T02:39:46.360 INFO:teuthology.orchestra.run.smithi046.stdout:generic/725 [not run] xfs_io swapext -v vfs -a not supported on ceph 2023-07-06T02:39:46.365 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/725 2023-07-06T02:39:46.365 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/725 2023-07-06T02:39:46.365 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-07-06T02:39:46.368 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-06T02:39:46.836 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-06T02:39:46.837 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.rlt8E1h3iVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/726) 2023-07-06T02:39:47.226 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph 2023-07-06T02:39:47.231 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-06T02:39:47.231 INFO:teuthology.orchestra.run.smithi046.stdout:MKFS_OPTIONS -- 172.21.15.46:6789:/scratch 2023-07-06T02:39:47.237 INFO:teuthology.orchestra.run.smithi046.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCbvKVkpp1TIhAAvJTELoeH8wkIFqjtppg17w== -o context=system_u:object_r:root_t:s0 172.21.15.46:6789:/scratch /tmp/tmp.KrMG67MsYpscratch 2023-07-06T02:39:47.237 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-06T02:39:48.114 INFO:teuthology.orchestra.run.smithi046.stdout:generic/726 [not run] xfs_io swapext -v vfs -a not supported on ceph 2023-07-06T02:39:48.119 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/726 2023-07-06T02:39:48.120 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/726 2023-07-06T02:39:48.120 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-07-06T02:39:48.122 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-06T02:39:48.623 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-06T02:39:48.624 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.rlt8E1h3iVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/727) 2023-07-06T02:39:49.051 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph 2023-07-06T02:39:49.063 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-06T02:39:49.064 INFO:teuthology.orchestra.run.smithi046.stdout:MKFS_OPTIONS -- 172.21.15.46:6789:/scratch 2023-07-06T02:39:49.064 INFO:teuthology.orchestra.run.smithi046.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCbvKVkpp1TIhAAvJTELoeH8wkIFqjtppg17w== -o context=system_u:object_r:root_t:s0 172.21.15.46:6789:/scratch /tmp/tmp.KrMG67MsYpscratch 2023-07-06T02:39:49.065 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-06T02:39:49.752 INFO:teuthology.orchestra.run.smithi046.stdout:generic/727 [not run] xfs_io swapext -v vfs -a not supported on ceph 2023-07-06T02:39:49.764 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/727 2023-07-06T02:39:49.764 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/727 2023-07-06T02:39:49.764 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-07-06T02:39:49.767 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-06T02:39:50.219 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-06T02:39:50.219 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.rlt8E1h3iVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/728) 2023-07-06T02:39:50.661 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph 2023-07-06T02:39:50.668 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-06T02:39:50.669 INFO:teuthology.orchestra.run.smithi046.stdout:MKFS_OPTIONS -- 172.21.15.46:6789:/scratch 2023-07-06T02:39:50.669 INFO:teuthology.orchestra.run.smithi046.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCbvKVkpp1TIhAAvJTELoeH8wkIFqjtppg17w== -o context=system_u:object_r:root_t:s0 172.21.15.46:6789:/scratch /tmp/tmp.KrMG67MsYpscratch 2023-07-06T02:39:50.670 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-06T02:39:55.455 INFO:teuthology.orchestra.run.smithi046.stdout:generic/728 5s 2023-07-06T02:39:55.468 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/728 2023-07-06T02:39:55.468 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-07-06T02:39:55.471 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-06T02:39:55.680 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-06T02:39:55.680 INFO:tasks.cephfs.xfstests_dev:=========================================================Total number of tests failed = 2========================================================= 2023-07-06T02:39:55.681 DEBUG:teuthology.orchestra.run.smithi046:> sudo userdel --force --remove fsgqa 2023-07-06T02:39:56.080 INFO:teuthology.orchestra.run.smithi046.stderr:userdel: user fsgqa is currently used by process 929286 2023-07-06T02:39:58.489 DEBUG:teuthology.orchestra.run.smithi046:> sudo userdel --force --remove 123456-fsgqa 2023-07-06T02:39:59.482 DEBUG:teuthology.orchestra.run.smithi046:> sudo groupdel fsgqa 2023-07-06T02:39:59.569 INFO:teuthology.orchestra.run.smithi046.stderr:groupdel: group 'fsgqa' does not exist 2023-07-06T02:39:59.571 DEBUG:teuthology.orchestra.run:got remote process result: 6 2023-07-06T02:39:59.571 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-06T02:39:59.572 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec sudo stat /tmp/tmp.rlt8E1h3iVxfstests-dev/results) 2023-07-06T02:39:59.651 INFO:teuthology.orchestra.run.smithi046.stdout: File: /tmp/tmp.rlt8E1h3iVxfstests-dev/results 2023-07-06T02:39:59.651 INFO:teuthology.orchestra.run.smithi046.stdout: Size: 4096 Blocks: 8 IO Block: 4096 directory 2023-07-06T02:39:59.651 INFO:teuthology.orchestra.run.smithi046.stdout:Device: 801h/2049d Inode: 405666 Links: 3 2023-07-06T02:39:59.651 INFO:teuthology.orchestra.run.smithi046.stdout:Access: (0755/drwxr-xr-x) Uid: ( 0/ root) Gid: ( 0/ root) 2023-07-06T02:39:59.651 INFO:teuthology.orchestra.run.smithi046.stdout:Context: unconfined_u:object_r:user_tmp_t:s0 2023-07-06T02:39:59.652 INFO:teuthology.orchestra.run.smithi046.stdout:Access: 2023-07-05 18:58:45.481858653 +0000 2023-07-06T02:39:59.652 INFO:teuthology.orchestra.run.smithi046.stdout:Modify: 2023-07-06 02:39:55.465063634 +0000 2023-07-06T02:39:59.652 INFO:teuthology.orchestra.run.smithi046.stdout:Change: 2023-07-06 02:39:55.465063634 +0000 2023-07-06T02:39:59.652 INFO:teuthology.orchestra.run.smithi046.stdout: Birth: 2023-07-05 18:58:45.481858653 +0000 2023-07-06T02:39:59.653 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-06T02:39:59.653 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec sudo mkdir -p /var/log/ceph/xfstests-dev-results) 2023-07-06T02:39:59.743 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-06T02:39:59.744 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec sudo cp -r /tmp/tmp.rlt8E1h3iVxfstests-dev/results /var/log/ceph/xfstests-dev-results) 2023-07-06T02:40:00.310 INFO:tasks.cephfs.xfstests_dev:results dir from xfstests-dev has been saved; it was copied from /tmp/tmp.rlt8E1h3iVxfstests-dev to /var/log/ceph. 2023-07-06T02:40:00.310 DEBUG:teuthology.orchestra.run.smithi046:> sudo rm -rf /tmp/tmp.rlt8E1h3iVxfstests-dev 2023-07-06T02:40:00.765 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-07-06T02:40:00.805 DEBUG:teuthology.orchestra.run.smithi046:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-07-06T02:40:01.187 DEBUG:teuthology.orchestra.run.smithi073:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-07-06T02:40:01.454 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-07-06T02:40:01.455 DEBUG:teuthology.orchestra.run.smithi046:> set -ex 2023-07-06T02:40:01.455 DEBUG:teuthology.orchestra.run.smithi046:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-06T02:40:01.587 DEBUG:teuthology.orchestra.run.smithi046:> set -ex 2023-07-06T02:40:01.587 DEBUG:teuthology.orchestra.run.smithi046:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-06T02:40:01.650 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-06T02:40:02.652 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:02.647+0000 7fd3d3e27700 1 Processor -- start 2023-07-06T02:40:02.652 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:02.647+0000 7fd3d3e27700 1 -- start start 2023-07-06T02:40:02.652 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:02.648+0000 7fd3d3e27700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fd3cc06ccf0 0x7fd3cc0cca00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T02:40:02.652 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:02.648+0000 7fd3d3e27700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fd3cc06d190 0x7fd3cc0ccf40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T02:40:02.652 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:02.648+0000 7fd3d3e27700 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd3cc06b9b0 con 0x7fd3cc069e00 2023-07-06T02:40:02.653 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:02.648+0000 7fd3d3e27700 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd3cc0cb120 con 0x7fd3cc06d190 2023-07-06T02:40:02.653 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:02.648+0000 7fd3d3e27700 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd3cc06c630 con 0x7fd3cc06ccf0 2023-07-06T02:40:02.653 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:02.648+0000 7fd3d1bc3700 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7fd3cc069e00 0x7fd3cc06a1d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:44986/0 (socket says 172.21.15.46:44986) 2023-07-06T02:40:02.653 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:02.648+0000 7fd3d1bc3700 1 -- 172.21.15.46:0/4014034431 learned_addr learned my addr 172.21.15.46:0/4014034431 (peer_addr_for_me v1:172.21.15.46:0/0) 2023-07-06T02:40:02.653 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:02.648+0000 7fd3d23c4700 1 --2- 172.21.15.46:0/4014034431 >> v2:172.21.15.46:3300/0 conn(0x7fd3cc06d190 0x7fd3cc0ccf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T02:40:02.653 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:02.649+0000 7fd3d23c4700 1 -- 172.21.15.46:0/4014034431 >> v2:172.21.15.73:3300/0 conn(0x7fd3cc06ccf0 msgr2=0x7fd3cc0cca00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T02:40:02.653 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:02.649+0000 7fd3d23c4700 1 --2- 172.21.15.46:0/4014034431 >> v2:172.21.15.73:3300/0 conn(0x7fd3cc06ccf0 0x7fd3cc0cca00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T02:40:02.653 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:02.649+0000 7fd3d23c4700 1 -- 172.21.15.46:0/4014034431 >> v1:172.21.15.46:6789/0 conn(0x7fd3cc069e00 legacy=0x7fd3cc06a1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T02:40:02.654 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:02.649+0000 7fd3d23c4700 1 -- 172.21.15.46:0/4014034431 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd3cc06bc90 con 0x7fd3cc06d190 2023-07-06T02:40:02.654 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:02.649+0000 7fd3d23c4700 1 --2- 172.21.15.46:0/4014034431 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd3cc06d190 0x7fd3cc0ccf40 secure :-1 s=READY pgs=3201 cs=0 l=1 rev1=1 crypto rx=0x7fd3cc0c8de0 tx=0x7fd3c4009df0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f40b2dc943ad2536 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T02:40:02.654 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:02.652+0000 7fd3d0bc1700 1 -- 172.21.15.46:0/4014034431 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3c400de40 con 0x7fd3cc06d190 2023-07-06T02:40:02.655 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:02.652+0000 7fd3d0bc1700 1 -- 172.21.15.46:0/4014034431 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd3c4010470 con 0x7fd3cc06d190 2023-07-06T02:40:02.655 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:02.652+0000 7fd3d0bc1700 1 -- 172.21.15.46:0/4014034431 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3c4010820 con 0x7fd3cc06d190 2023-07-06T02:40:02.655 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:02.652+0000 7fd3d3e27700 1 -- 172.21.15.46:0/4014034431 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd3cc06d190 msgr2=0x7fd3cc0ccf40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T02:40:02.655 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:02.652+0000 7fd3d3e27700 1 --2- 172.21.15.46:0/4014034431 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd3cc06d190 0x7fd3cc0ccf40 secure :-1 s=READY pgs=3201 cs=0 l=1 rev1=1 crypto rx=0x7fd3cc0c8de0 tx=0x7fd3c4009df0 comp rx=0 tx=0).stop 2023-07-06T02:40:02.656 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:02.654+0000 7fd3d3e27700 1 -- 172.21.15.46:0/4014034431 shutdown_connections 2023-07-06T02:40:02.656 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:02.654+0000 7fd3d3e27700 1 --2- 172.21.15.46:0/4014034431 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd3cc06d190 0x7fd3cc0ccf40 unknown :-1 s=CLOSED pgs=3201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T02:40:02.657 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:02.654+0000 7fd3d3e27700 1 --2- 172.21.15.46:0/4014034431 >> v2:172.21.15.73:3300/0 conn(0x7fd3cc06ccf0 0x7fd3cc0cca00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T02:40:02.657 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:02.654+0000 7fd3d3e27700 1 -- 172.21.15.46:0/4014034431 >> 172.21.15.46:0/4014034431 conn(0x7fd3cc0b0fc0 msgr2=0x7fd3cc0ce860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T02:40:02.662 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:02.660+0000 7fd3d3e27700 1 -- 172.21.15.46:0/4014034431 shutdown_connections 2023-07-06T02:40:02.663 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:02.661+0000 7fd3d3e27700 1 -- 172.21.15.46:0/4014034431 wait complete. 2023-07-06T02:40:02.665 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:02.663+0000 7fd3d3e27700 1 Processor -- start 2023-07-06T02:40:02.666 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:02.663+0000 7fd3d3e27700 1 -- start start 2023-07-06T02:40:02.667 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:02.664+0000 7fd3d3e27700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd3cc069e00 0x7fd3cc15b4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T02:40:02.667 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:02.664+0000 7fd3d3e27700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd3cc06ccf0 0x7fd3cc159350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T02:40:02.667 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:02.664+0000 7fd3d3e27700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fd3cc06d190 0x7fd3cc0c7b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T02:40:02.667 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:02.664+0000 7fd3d3e27700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3cc0acf60 con 0x7fd3cc06ccf0 2023-07-06T02:40:02.667 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:02.664+0000 7fd3d3e27700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3cc1f3e50 con 0x7fd3cc069e00 2023-07-06T02:40:02.668 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:02.664+0000 7fd3d3e27700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd3cc1f4130 con 0x7fd3cc06d190 2023-07-06T02:40:02.668 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:02.664+0000 7fd3d1bc3700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd3cc069e00 0x7fd3cc15b4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T02:40:02.668 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:02.664+0000 7fd3d23c4700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fd3cc06d190 0x7fd3cc0c7b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T02:40:02.668 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:02.664+0000 7fd3d1bc3700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd3cc069e00 0x7fd3cc15b4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.46:45204/0 (socket says 172.21.15.46:45204) 2023-07-06T02:40:02.668 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:02.664+0000 7fd3d23c4700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fd3cc06d190 0x7fd3cc0c7b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3301/0 says I am v2:172.21.15.46:57640/0 (socket says 172.21.15.46:57640) 2023-07-06T02:40:02.668 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:02.664+0000 7fd3d1bc3700 1 -- 172.21.15.46:0/962130053 learned_addr learned my addr 172.21.15.46:0/962130053 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-07-06T02:40:02.669 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:02.664+0000 7fd3d13c2700 1 --2- 172.21.15.46:0/962130053 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd3cc06ccf0 0x7fd3cc159350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T02:40:02.669 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:02.665+0000 7fd3d1bc3700 1 -- 172.21.15.46:0/962130053 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fd3cc06d190 msgr2=0x7fd3cc0c7b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T02:40:02.670 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:02.665+0000 7fd3d1bc3700 1 --2- 172.21.15.46:0/962130053 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fd3cc06d190 0x7fd3cc0c7b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T02:40:02.670 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:02.665+0000 7fd3d1bc3700 1 -- 172.21.15.46:0/962130053 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd3cc06ccf0 msgr2=0x7fd3cc159350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T02:40:02.670 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:02.665+0000 7fd3d1bc3700 1 --2- 172.21.15.46:0/962130053 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd3cc06ccf0 0x7fd3cc159350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T02:40:02.670 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:02.665+0000 7fd3d1bc3700 1 -- 172.21.15.46:0/962130053 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd3c4009770 con 0x7fd3cc069e00 2023-07-06T02:40:02.670 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:02.665+0000 7fd3d23c4700 1 --2- 172.21.15.46:0/962130053 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fd3cc06d190 0x7fd3cc0c7b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-06T02:40:02.670 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:02.665+0000 7fd3d1bc3700 1 --2- 172.21.15.46:0/962130053 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd3cc069e00 0x7fd3cc15b4a0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fd3c800c460 tx=0x7fd3c800c770 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T02:40:02.670 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:02.665+0000 7fd3c27fc700 1 -- 172.21.15.46:0/962130053 <== mon.1 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3c8005b40 con 0x7fd3cc069e00 2023-07-06T02:40:02.670 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:02.665+0000 7fd3d3e27700 1 -- 172.21.15.46:0/962130053 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd3cc1f4410 con 0x7fd3cc069e00 2023-07-06T02:40:02.671 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:02.665+0000 7fd3d3e27700 1 -- 172.21.15.46:0/962130053 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd3cc0c3080 con 0x7fd3cc069e00 2023-07-06T02:40:02.671 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:02.666+0000 7fd3d3e27700 1 -- 172.21.15.46:0/962130053 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd3cc04e1d0 con 0x7fd3cc069e00 2023-07-06T02:40:02.727 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:02.724+0000 7fd3c27fc700 1 -- 172.21.15.46:0/962130053 <== mon.1 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd3c8005ca0 con 0x7fd3cc069e00 2023-07-06T02:40:02.727 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:02.724+0000 7fd3c27fc700 1 -- 172.21.15.46:0/962130053 <== mon.1 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3c8004a90 con 0x7fd3cc069e00 2023-07-06T02:40:02.732 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:02.729+0000 7fd3c27fc700 1 -- 172.21.15.46:0/962130053 <== mon.1 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fd3c8007070 con 0x7fd3cc069e00 2023-07-06T02:40:02.733 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:02.730+0000 7fd3c27fc700 1 --2- 172.21.15.46:0/962130053 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7fd3b006ace0 0x7fd3b006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T02:40:02.733 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:02.730+0000 7fd3d13c2700 1 --2- 172.21.15.46:0/962130053 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7fd3b006ace0 0x7fd3b006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T02:40:02.734 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:02.731+0000 7fd3d13c2700 1 --2- 172.21.15.46:0/962130053 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7fd3b006ace0 0x7fd3b006d190 secure :-1 s=READY pgs=709 cs=0 l=1 rev1=1 crypto rx=0x7fd3cc1edf00 tx=0x7fd3bc009190 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T02:40:02.745 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:02.743+0000 7fd3c27fc700 1 -- 172.21.15.46:0/962130053 <== mon.1 v2:172.21.15.73:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 6091+0+0 (secure 0 0 0) 0x7fd3c80578f0 con 0x7fd3cc069e00 2023-07-06T02:40:02.752 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:02.750+0000 7fd3c27fc700 1 -- 172.21.15.46:0/962130053 <== mon.1 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fd3c8053c30 con 0x7fd3cc069e00 2023-07-06T02:40:03.071 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:03.068+0000 7fd3d3e27700 1 -- 172.21.15.46:0/962130053 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fd3cc0cf670 con 0x7fd3cc069e00 2023-07-06T02:40:03.073 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:03.070+0000 7fd3c27fc700 1 -- 172.21.15.46:0/962130053 <== mon.1 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v37) v1 ==== 74+0+18226 (secure 0 0 0) 0x7fd3c8017090 con 0x7fd3cc069e00 2023-07-06T02:40:03.076 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-06T02:40:03.076 INFO:teuthology.orchestra.run.smithi046.stdout:{"epoch":37,"fsid":"042652d3-d80c-4ad8-9366-3e94f2a0a512","created":"2023-07-05T18:55:56.455710+0000","modified":"2023-07-05T18:58:04.356432+0000","last_up_change":"2023-07-05T18:56:06.594022+0000","last_in_change":"2023-07-05T18:55:58.879340+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-07-05T18:56:07.729620+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2023-07-05T18:56:08.128122+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2023-07-05T18:57:13.640396+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"34","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_data","create_time":"2023-07-05T18:57:14.333267+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"35","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"20009183-9a47-4392-8751-883f88d2bfb1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6813","nonce":4151971443},{"type":"v1","addr":"172.21.15.46:6815","nonce":4151971443}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6817","nonce":4151971443},{"type":"v1","addr":"172.21.15.46:6818","nonce":4151971443}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6822","nonce":4151971443},{"type":"v1","addr":"172.21.15.46:6823","nonce":4151971443}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6820","nonce":4151971443},{"type":"v1","addr":"172.21.15.46:6821","nonce":4151971443}]},"public_addr":"172.21.15.46:6815/4151971443","cluster_addr":"172.21.15.46:6818/4151971443","heartbeat_back_addr":"172.21.15.46:6823/4151971443","heartbeat_front_addr":"172.21.15.46:6821/4151971443","state":["exists","up"]},{"osd":1,"uuid":"91b4a7b0-e4e4-4888-a1fe-9edb0d68004c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6808","nonce":502575881},{"type":"v1","addr":"172.21.15.46:6809","nonce":502575881}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6810","nonce":502575881},{"type":"v1","addr":"172.21.15.46:6811","nonce":502575881}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6816","nonce":502575881},{"type":"v1","addr":"172.21.15.46:6819","nonce":502575881}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6812","nonce":502575881},{"type":"v1","addr":"172.21.15.46:6814","nonce":502575881}]},"public_addr":"172.21.15.46:6809/502575881","cluster_addr":"172.21.15.46:6811/502575881","heartbeat_back_addr":"172.21.15.46:6819/502575881","heartbeat_front_addr":"172.21.15.46:6814/502575881","state":["exists","up"]},{"osd":2,"uuid":"669ff744-1331-47c5-8579-0440731c889a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6800","nonce":2115251461},{"type":"v1","addr":"172.21.15.46:6801","nonce":2115251461}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6802","nonce":2115251461},{"type":"v1","addr":"172.21.15.46:6803","nonce":2115251461}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6806","nonce":2115251461},{"type":"v1","addr":"172.21.15.46:6807","nonce":2115251461}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6804","nonce":2115251461},{"type":"v1","addr":"172.21.15.46:6805","nonce":2115251461}]},"public_addr":"172.21.15.46:6801/2115251461","cluster_addr":"172.21.15.46:6803/2115251461","heartbeat_back_addr":"172.21.15.46:6807/2115251461","heartbeat_front_addr":"172.21.15.46:6805/2115251461","state":["exists","up"]},{"osd":3,"uuid":"34e1b86d-ffad-415d-861c-07a5f08068a6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6824","nonce":2981388766},{"type":"v1","addr":"172.21.15.46:6825","nonce":2981388766}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6826","nonce":2981388766},{"type":"v1","addr":"172.21.15.46:6827","nonce":2981388766}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6830","nonce":2981388766},{"type":"v1","addr":"172.21.15.46:6831","nonce":2981388766}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6828","nonce":2981388766},{"type":"v1","addr":"172.21.15.46:6829","nonce":2981388766}]},"public_addr":"172.21.15.46:6825/2981388766","cluster_addr":"172.21.15.46:6827/2981388766","heartbeat_back_addr":"172.21.15.46:6831/2981388766","heartbeat_front_addr":"172.21.15.46:6829/2981388766","state":["exists","up"]},{"osd":4,"uuid":"57ffcb91-c7dc-4a69-ae71-4d9622a14a05","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6800","nonce":2083655348},{"type":"v1","addr":"172.21.15.73:6801","nonce":2083655348}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6802","nonce":2083655348},{"type":"v1","addr":"172.21.15.73:6803","nonce":2083655348}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6806","nonce":2083655348},{"type":"v1","addr":"172.21.15.73:6807","nonce":2083655348}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6804","nonce":2083655348},{"type":"v1","addr":"172.21.15.73:6805","nonce":2083655348}]},"public_addr":"172.21.15.73:6801/2083655348","cluster_addr":"172.21.15.73:6803/2083655348","heartbeat_back_addr":"172.21.15.73:6807/2083655348","heartbeat_front_addr":"172.21.15.73:6805/2083655348","state":["exists","up"]},{"osd":5,"uuid":"665f41c9-ee20-49cf-bf0e-fbe0c03d3aed","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6824","nonce":2803788401},{"type":"v1","addr":"172.21.15.73:6825","nonce":2803788401}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6826","nonce":2803788401},{"type":"v1","addr":"172.21.15.73:6827","nonce":2803788401}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6830","nonce":2803788401},{"type":"v1","addr":"172.21.15.73:6831","nonce":2803788401}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6828","nonce":2803788401},{"type":"v1","addr":"172.21.15.73:6829","nonce":2803788401}]},"public_addr":"172.21.15.73:6825/2803788401","cluster_addr":"172.21.15.73:6827/2803788401","heartbeat_back_addr":"172.21.15.73:6831/2803788401","heartbeat_front_addr":"172.21.15.73:6829/2803788401","state":["exists","up"]},{"osd":6,"uuid":"5790c6cc-bd56-4ce4-9a7c-0f0c3b59215c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6808","nonce":974108383},{"type":"v1","addr":"172.21.15.73:6809","nonce":974108383}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6810","nonce":974108383},{"type":"v1","addr":"172.21.15.73:6811","nonce":974108383}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6815","nonce":974108383},{"type":"v1","addr":"172.21.15.73:6817","nonce":974108383}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6812","nonce":974108383},{"type":"v1","addr":"172.21.15.73:6813","nonce":974108383}]},"public_addr":"172.21.15.73:6809/974108383","cluster_addr":"172.21.15.73:6811/974108383","heartbeat_back_addr":"172.21.15.73:6817/974108383","heartbeat_front_addr":"172.21.15.73:6813/974108383","state":["exists","up"]},{"osd":7,"uuid":"b66f4d2e-147e-4c9b-97dd-cbd59d33802e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6814","nonce":3772673248},{"type":"v1","addr":"172.21.15.73:6816","nonce":3772673248}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6818","nonce":3772673248},{"type":"v1","addr":"172.21.15.73:6819","nonce":3772673248}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6822","nonce":3772673248},{"type":"v1","addr":"172.21.15.73:6823","nonce":3772673248}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6820","nonce":3772673248},{"type":"v1","addr":"172.21.15.73:6821","nonce":3772673248}]},"public_addr":"172.21.15.73:6816/3772673248","cluster_addr":"172.21.15.73:6819/3772673248","heartbeat_back_addr":"172.21.15.73:6823/3772673248","heartbeat_front_addr":"172.21.15.73:6821/3772673248","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-05T18:56:04.115334+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-05T18:56:04.071250+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-05T18:56:04.044387+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-05T18:56:04.085389+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-05T18:56:04.090726+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-05T18:56:04.074529+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-05T18:56:04.058841+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-05T18:56:04.043054+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"6.24","mappings":[{"from":5,"to":0}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-06T02:40:03.078 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:03.075+0000 7fd3d3e27700 1 -- 172.21.15.46:0/962130053 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7fd3b006ace0 msgr2=0x7fd3b006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T02:40:03.078 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:03.075+0000 7fd3d3e27700 1 --2- 172.21.15.46:0/962130053 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7fd3b006ace0 0x7fd3b006d190 secure :-1 s=READY pgs=709 cs=0 l=1 rev1=1 crypto rx=0x7fd3cc1edf00 tx=0x7fd3bc009190 comp rx=0 tx=0).stop 2023-07-06T02:40:03.078 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:03.075+0000 7fd3d3e27700 1 -- 172.21.15.46:0/962130053 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd3cc069e00 msgr2=0x7fd3cc15b4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T02:40:03.079 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:03.075+0000 7fd3d3e27700 1 --2- 172.21.15.46:0/962130053 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd3cc069e00 0x7fd3cc15b4a0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fd3c800c460 tx=0x7fd3c800c770 comp rx=0 tx=0).stop 2023-07-06T02:40:03.080 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:03.078+0000 7fd3d3e27700 1 -- 172.21.15.46:0/962130053 shutdown_connections 2023-07-06T02:40:03.080 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:03.078+0000 7fd3d3e27700 1 --2- 172.21.15.46:0/962130053 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7fd3b006ace0 0x7fd3b006d190 unknown :-1 s=CLOSED pgs=709 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T02:40:03.081 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:03.078+0000 7fd3d3e27700 1 --2- 172.21.15.46:0/962130053 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fd3cc06d190 0x7fd3cc0c7b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T02:40:03.081 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:03.078+0000 7fd3d3e27700 1 --2- 172.21.15.46:0/962130053 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd3cc069e00 0x7fd3cc15b4a0 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T02:40:03.081 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:03.078+0000 7fd3d3e27700 1 --2- 172.21.15.46:0/962130053 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd3cc06ccf0 0x7fd3cc159350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T02:40:03.081 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:03.078+0000 7fd3d3e27700 1 -- 172.21.15.46:0/962130053 >> 172.21.15.46:0/962130053 conn(0x7fd3cc0b0fc0 msgr2=0x7fd3cc157ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T02:40:03.083 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:03.081+0000 7fd3d3e27700 1 -- 172.21.15.46:0/962130053 shutdown_connections 2023-07-06T02:40:03.083 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:03.081+0000 7fd3d3e27700 1 -- 172.21.15.46:0/962130053 wait complete. 2023-07-06T02:40:03.104 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'rbd', 'create_time': '2023-07-05T18:56:07.729620+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': '.mgr', 'create_time': '2023-07-05T18:56:08.128122+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_metadata', 'create_time': '2023-07-05T18:57:13.640396+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '34', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.25, 'score_stable': 1.25, 'optimal_score': 1, 'raw_score_acting': 1.25, 'raw_score_stable': 1.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 6, 'pool_name': 'cephfs_data', 'create_time': '2023-07-05T18:57:14.333267+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '35', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.25, 'score_stable': 1.25, 'optimal_score': 1, 'raw_score_acting': 1.25, 'raw_score_stable': 1.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-07-06T02:40:03.105 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-07-06T02:40:03.294 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:03.291+0000 7fb6fc70b700 1 Processor -- start 2023-07-06T02:40:03.295 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:03.291+0000 7fb6fc70b700 1 -- start start 2023-07-06T02:40:03.295 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:03.293+0000 7fb6fc70b700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fb6f415dc80 0x7fb6f415bb50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T02:40:03.296 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:03.293+0000 7fb6fc70b700 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb6f415c090 con 0x7fb6f40ce790 2023-07-06T02:40:03.296 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:03.293+0000 7fb6fc70b700 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb6f40d1470 con 0x7fb6f415e050 2023-07-06T02:40:03.296 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:03.293+0000 7fb6fc70b700 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb6f40d1750 con 0x7fb6f415dc80 2023-07-06T02:40:03.297 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:03.293+0000 7fb6faca8700 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7fb6f40ce790 0x7fb6f40ceb90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:45002/0 (socket says 172.21.15.46:45002) 2023-07-06T02:40:03.297 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:03.293+0000 7fb6faca8700 1 -- 172.21.15.46:0/882985028 learned_addr learned my addr 172.21.15.46:0/882985028 (peer_addr_for_me v1:172.21.15.46:0/0) 2023-07-06T02:40:03.297 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:03.293+0000 7fb6fa4a7700 1 --2- 172.21.15.46:0/882985028 >> v2:172.21.15.73:3300/0 conn(0x7fb6f415dc80 0x7fb6f415bb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T02:40:03.297 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:03.293+0000 7fb6f94a5700 1 -- 172.21.15.46:0/882985028 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3656361559 0 0) 0x7fb6f415c090 con 0x7fb6f40ce790 2023-07-06T02:40:03.297 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:03.293+0000 7fb6f94a5700 1 -- 172.21.15.46:0/882985028 --> v1:172.21.15.46:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb6e00035b0 con 0x7fb6f40ce790 2023-07-06T02:40:03.297 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:03.293+0000 7fb6f94a5700 1 -- 172.21.15.46:0/882985028 <== mon.1 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 97613462 0 0) 0x7fb6f40d1470 con 0x7fb6f415e050 2023-07-06T02:40:03.297 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:03.293+0000 7fb6f94a5700 1 -- 172.21.15.46:0/882985028 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb6f415c090 con 0x7fb6f415e050 2023-07-06T02:40:03.298 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:03.294+0000 7fb6fa4a7700 1 -- 172.21.15.46:0/882985028 >> v1:172.21.15.73:6789/0 conn(0x7fb6f415e050 legacy=0x7fb6f40d09b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T02:40:03.299 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:03.294+0000 7fb6fa4a7700 1 -- 172.21.15.46:0/882985028 >> v1:172.21.15.46:6789/0 conn(0x7fb6f40ce790 legacy=0x7fb6f40ceb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T02:40:03.299 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:03.294+0000 7fb6fa4a7700 1 -- 172.21.15.46:0/882985028 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb6f40b05c0 con 0x7fb6f415dc80 2023-07-06T02:40:03.299 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:03.294+0000 7fb6fa4a7700 1 --2- 172.21.15.46:0/882985028 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb6f415dc80 0x7fb6f415bb50 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fb6f0009840 tx=0x7fb6f0009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c18aaaaee76ff8f4 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T02:40:03.299 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:03.294+0000 7fb6f94a5700 1 -- 172.21.15.46:0/882985028 <== mon.1 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6f0011830 con 0x7fb6f415dc80 2023-07-06T02:40:03.299 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:03.294+0000 7fb6f94a5700 1 -- 172.21.15.46:0/882985028 <== mon.1 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb6f0011990 con 0x7fb6f415dc80 2023-07-06T02:40:03.299 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:03.294+0000 7fb6f94a5700 1 -- 172.21.15.46:0/882985028 <== mon.1 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6f0011d20 con 0x7fb6f415dc80 2023-07-06T02:40:03.299 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:03.295+0000 7fb6fc70b700 1 -- 172.21.15.46:0/882985028 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb6f415dc80 msgr2=0x7fb6f415bb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T02:40:03.300 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:03.295+0000 7fb6fc70b700 1 --2- 172.21.15.46:0/882985028 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb6f415dc80 0x7fb6f415bb50 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fb6f0009840 tx=0x7fb6f0009b50 comp rx=0 tx=0).stop 2023-07-06T02:40:03.300 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:03.295+0000 7fb6fc70b700 1 -- 172.21.15.46:0/882985028 shutdown_connections 2023-07-06T02:40:03.300 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:03.295+0000 7fb6fc70b700 1 --2- 172.21.15.46:0/882985028 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb6f415dc80 0x7fb6f415bb50 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T02:40:03.300 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:03.295+0000 7fb6fc70b700 1 -- 172.21.15.46:0/882985028 >> 172.21.15.46:0/882985028 conn(0x7fb6f40664b0 msgr2=0x7fb6f4099e10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T02:40:03.300 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:03.296+0000 7fb6fc70b700 1 -- 172.21.15.46:0/882985028 shutdown_connections 2023-07-06T02:40:03.300 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:03.296+0000 7fb6fc70b700 1 -- 172.21.15.46:0/882985028 wait complete. 2023-07-06T02:40:03.301 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:03.297+0000 7fb6fc70b700 1 Processor -- start 2023-07-06T02:40:03.302 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:03.297+0000 7fb6fc70b700 1 -- start start 2023-07-06T02:40:03.302 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:03.298+0000 7fb6fc70b700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb6f40ce790 0x7fb6f406c560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T02:40:03.302 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:03.298+0000 7fb6fc70b700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fb6f415dc80 0x7fb6f414f590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T02:40:03.302 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:03.298+0000 7fb6fc70b700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb6f4157750 0x7fb6f4157bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T02:40:03.302 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:03.298+0000 7fb6fc70b700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb6f41563e0 con 0x7fb6f40ce790 2023-07-06T02:40:03.302 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:03.298+0000 7fb6fc70b700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb6f4156100 con 0x7fb6f4157750 2023-07-06T02:40:03.302 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:03.298+0000 7fb6fc70b700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb6f406ba80 con 0x7fb6f415dc80 2023-07-06T02:40:03.303 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:03.298+0000 7fb6fa4a7700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb6f40ce790 0x7fb6f406c560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T02:40:03.303 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:03.298+0000 7fb6fa4a7700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb6f40ce790 0x7fb6f406c560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:45734/0 (socket says 172.21.15.46:45734) 2023-07-06T02:40:03.303 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:03.298+0000 7fb6fa4a7700 1 -- 172.21.15.46:0/2682124944 learned_addr learned my addr 172.21.15.46:0/2682124944 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-07-06T02:40:03.303 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:03.298+0000 7fb6faca8700 1 --2- 172.21.15.46:0/2682124944 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb6f4157750 0x7fb6f4157bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T02:40:03.303 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:03.298+0000 7fb6f9ca6700 1 --2- 172.21.15.46:0/2682124944 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fb6f415dc80 0x7fb6f414f590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T02:40:03.303 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:03.299+0000 7fb6fa4a7700 1 -- 172.21.15.46:0/2682124944 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fb6f415dc80 msgr2=0x7fb6f414f590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T02:40:03.303 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:03.299+0000 7fb6fa4a7700 1 --2- 172.21.15.46:0/2682124944 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fb6f415dc80 0x7fb6f414f590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T02:40:03.304 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:03.299+0000 7fb6fa4a7700 1 -- 172.21.15.46:0/2682124944 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb6f4157750 msgr2=0x7fb6f4157bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T02:40:03.304 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:03.299+0000 7fb6fa4a7700 1 --2- 172.21.15.46:0/2682124944 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb6f4157750 0x7fb6f4157bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T02:40:03.304 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:03.299+0000 7fb6fa4a7700 1 -- 172.21.15.46:0/2682124944 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb6f00094a0 con 0x7fb6f40ce790 2023-07-06T02:40:03.304 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:03.299+0000 7fb6fa4a7700 1 --2- 172.21.15.46:0/2682124944 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb6f40ce790 0x7fb6f406c560 secure :-1 s=READY pgs=3203 cs=0 l=1 rev1=1 crypto rx=0x7fb6f00090b0 tx=0x7fb6f0004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T02:40:03.305 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:03.299+0000 7fb6eaffd700 1 -- 172.21.15.46:0/2682124944 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6f001a6e0 con 0x7fb6f40ce790 2023-07-06T02:40:03.305 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:03.299+0000 7fb6eaffd700 1 -- 172.21.15.46:0/2682124944 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb6f001a840 con 0x7fb6f40ce790 2023-07-06T02:40:03.305 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:03.299+0000 7fb6fc70b700 1 -- 172.21.15.46:0/2682124944 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb6f406bd60 con 0x7fb6f40ce790 2023-07-06T02:40:03.305 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:03.299+0000 7fb6eaffd700 1 -- 172.21.15.46:0/2682124944 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6f001abf0 con 0x7fb6f40ce790 2023-07-06T02:40:03.306 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:03.299+0000 7fb6fc70b700 1 -- 172.21.15.46:0/2682124944 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb6f414fad0 con 0x7fb6f40ce790 2023-07-06T02:40:03.306 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:03.300+0000 7fb6fc70b700 1 -- 172.21.15.46:0/2682124944 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb6f414fc60 con 0x7fb6f40ce790 2023-07-06T02:40:03.306 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:03.301+0000 7fb6eaffd700 1 -- 172.21.15.46:0/2682124944 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fb6f0022070 con 0x7fb6f40ce790 2023-07-06T02:40:03.306 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:03.302+0000 7fb6eaffd700 1 --2- 172.21.15.46:0/2682124944 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7fb6d806ace0 0x7fb6d806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T02:40:03.306 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:03.302+0000 7fb6eaffd700 1 -- 172.21.15.46:0/2682124944 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 6091+0+0 (secure 0 0 0) 0x7fb6f008a330 con 0x7fb6f40ce790 2023-07-06T02:40:03.306 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:03.302+0000 7fb6f9ca6700 1 --2- 172.21.15.46:0/2682124944 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7fb6d806ace0 0x7fb6d806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T02:40:03.307 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:03.303+0000 7fb6f9ca6700 1 --2- 172.21.15.46:0/2682124944 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7fb6d806ace0 0x7fb6d806d190 secure :-1 s=READY pgs=710 cs=0 l=1 rev1=1 crypto rx=0x7fb6f4150980 tx=0x7fb6e4009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T02:40:03.313 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:03.310+0000 7fb6eaffd700 1 -- 172.21.15.46:0/2682124944 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fb6f0055450 con 0x7fb6f40ce790 2023-07-06T02:40:03.625 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:03.622+0000 7fb6fc70b700 1 -- 172.21.15.46:0/2682124944 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fb6f40672e0 con 0x7fb6f40ce790 2023-07-06T02:40:03.633 INFO:teuthology.orchestra.run.smithi046.stdout:pg_num: 8 2023-07-06T02:40:03.633 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:03.630+0000 7fb6eaffd700 1 -- 172.21.15.46:0/2682124944 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v37) v1 ==== 92+0+10 (secure 0 0 0) 0x7fb6f0058a70 con 0x7fb6f40ce790 2023-07-06T02:40:03.636 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:03.633+0000 7fb6fc70b700 1 -- 172.21.15.46:0/2682124944 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7fb6d806ace0 msgr2=0x7fb6d806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T02:40:03.636 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:03.633+0000 7fb6fc70b700 1 --2- 172.21.15.46:0/2682124944 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7fb6d806ace0 0x7fb6d806d190 secure :-1 s=READY pgs=710 cs=0 l=1 rev1=1 crypto rx=0x7fb6f4150980 tx=0x7fb6e4009040 comp rx=0 tx=0).stop 2023-07-06T02:40:03.637 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:03.633+0000 7fb6fc70b700 1 -- 172.21.15.46:0/2682124944 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb6f40ce790 msgr2=0x7fb6f406c560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T02:40:03.637 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:03.633+0000 7fb6fc70b700 1 --2- 172.21.15.46:0/2682124944 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb6f40ce790 0x7fb6f406c560 secure :-1 s=READY pgs=3203 cs=0 l=1 rev1=1 crypto rx=0x7fb6f00090b0 tx=0x7fb6f0004750 comp rx=0 tx=0).stop 2023-07-06T02:40:03.637 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:03.635+0000 7fb6fc70b700 1 -- 172.21.15.46:0/2682124944 shutdown_connections 2023-07-06T02:40:03.638 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:03.635+0000 7fb6fc70b700 1 --2- 172.21.15.46:0/2682124944 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7fb6d806ace0 0x7fb6d806d190 unknown :-1 s=CLOSED pgs=710 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T02:40:03.638 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:03.635+0000 7fb6fc70b700 1 --2- 172.21.15.46:0/2682124944 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb6f4157750 0x7fb6f4157bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T02:40:03.638 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:03.635+0000 7fb6fc70b700 1 --2- 172.21.15.46:0/2682124944 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb6f40ce790 0x7fb6f406c560 unknown :-1 s=CLOSED pgs=3203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T02:40:03.638 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:03.635+0000 7fb6fc70b700 1 --2- 172.21.15.46:0/2682124944 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fb6f415dc80 0x7fb6f414f590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T02:40:03.638 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:03.635+0000 7fb6fc70b700 1 -- 172.21.15.46:0/2682124944 >> 172.21.15.46:0/2682124944 conn(0x7fb6f40664b0 msgr2=0x7fb6f40afb90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T02:40:03.638 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:03.635+0000 7fb6fc70b700 1 -- 172.21.15.46:0/2682124944 shutdown_connections 2023-07-06T02:40:03.638 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:03.635+0000 7fb6fc70b700 1 -- 172.21.15.46:0/2682124944 wait complete. 2023-07-06T02:40:03.657 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-07-06T02:40:03.856 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:03.853+0000 7f5e07481700 1 Processor -- start 2023-07-06T02:40:03.856 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:03.853+0000 7f5e07481700 1 -- start start 2023-07-06T02:40:03.857 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:03.854+0000 7f5e07481700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f5e000cb110 0x7f5e0006b0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T02:40:03.857 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:03.854+0000 7f5e07481700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f5e0006c3a0 0x7f5e0006a1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T02:40:03.857 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:03.854+0000 7f5e07481700 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5e0015e260 con 0x7f5e0015a890 2023-07-06T02:40:03.858 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:03.854+0000 7f5e07481700 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5e0015ede0 con 0x7f5e0006c3a0 2023-07-06T02:40:03.858 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:03.854+0000 7f5e07481700 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5e0015e540 con 0x7f5e000cb110 2023-07-06T02:40:03.858 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:03.854+0000 7f5e0521d700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f5e000cb110 0x7f5e0006b0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T02:40:03.858 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:03.854+0000 7f5e0521d700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f5e000cb110 0x7f5e0006b0b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.46:45226/0 (socket says 172.21.15.46:45226) 2023-07-06T02:40:03.858 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:03.854+0000 7f5e0521d700 1 -- 172.21.15.46:0/41461637 learned_addr learned my addr 172.21.15.46:0/41461637 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-07-06T02:40:03.859 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:03.855+0000 7f5e0521d700 1 -- 172.21.15.46:0/41461637 >> v2:172.21.15.46:3300/0 conn(0x7f5e0006c3a0 msgr2=0x7f5e0006a1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T02:40:03.859 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:03.855+0000 7f5e0521d700 1 --2- 172.21.15.46:0/41461637 >> v2:172.21.15.46:3300/0 conn(0x7f5e0006c3a0 0x7f5e0006a1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T02:40:03.859 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:03.855+0000 7f5e0521d700 1 -- 172.21.15.46:0/41461637 >> v1:172.21.15.73:6789/0 conn(0x7f5e0015a890 legacy=0x7f5e0006bc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T02:40:03.859 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:03.855+0000 7f5e0521d700 1 -- 172.21.15.46:0/41461637 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5e0015e820 con 0x7f5e000cb110 2023-07-06T02:40:03.859 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:03.855+0000 7f5e0521d700 1 --2- 172.21.15.46:0/41461637 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5e000cb110 0x7f5e0006b0b0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f5e000cf060 tx=0x7f5dfc009bd0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4fc1a758269dbfd8 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T02:40:03.861 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:03.856+0000 7f5df7fff700 1 -- 172.21.15.46:0/41461637 <== mon.1 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5dfc004230 con 0x7f5e000cb110 2023-07-06T02:40:03.861 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:03.857+0000 7f5df7fff700 1 -- 172.21.15.46:0/41461637 <== mon.1 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5dfc004390 con 0x7f5e000cb110 2023-07-06T02:40:03.861 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:03.857+0000 7f5df7fff700 1 -- 172.21.15.46:0/41461637 <== mon.1 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5dfc0036a0 con 0x7f5e000cb110 2023-07-06T02:40:03.861 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:03.857+0000 7f5e07481700 1 -- 172.21.15.46:0/41461637 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5e000cb110 msgr2=0x7f5e0006b0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T02:40:03.861 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:03.857+0000 7f5e07481700 1 --2- 172.21.15.46:0/41461637 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5e000cb110 0x7f5e0006b0b0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f5e000cf060 tx=0x7f5dfc009bd0 comp rx=0 tx=0).stop 2023-07-06T02:40:03.861 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:03.857+0000 7f5e07481700 1 -- 172.21.15.46:0/41461637 shutdown_connections 2023-07-06T02:40:03.862 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:03.857+0000 7f5e07481700 1 --2- 172.21.15.46:0/41461637 >> v2:172.21.15.46:3300/0 conn(0x7f5e0006c3a0 0x7f5e0006a1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T02:40:03.862 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:03.857+0000 7f5e07481700 1 --2- 172.21.15.46:0/41461637 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5e000cb110 0x7f5e0006b0b0 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T02:40:03.862 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:03.857+0000 7f5e07481700 1 -- 172.21.15.46:0/41461637 >> 172.21.15.46:0/41461637 conn(0x7f5e000b19a0 msgr2=0x7f5e000cf1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T02:40:03.862 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:03.857+0000 7f5e07481700 1 -- 172.21.15.46:0/41461637 shutdown_connections 2023-07-06T02:40:03.862 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:03.857+0000 7f5e07481700 1 -- 172.21.15.46:0/41461637 wait complete. 2023-07-06T02:40:03.864 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:03.859+0000 7f5e07481700 1 Processor -- start 2023-07-06T02:40:03.864 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:03.859+0000 7f5e07481700 1 -- start start 2023-07-06T02:40:03.864 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:03.860+0000 7f5e07481700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5e0006c3a0 0x7f5e000cea50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T02:40:03.864 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:03.860+0000 7f5e07481700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f5e000cb110 0x7f5e001e3ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T02:40:03.864 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:03.860+0000 7f5e07481700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5e0015a890 0x7f5e001466d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T02:40:03.865 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:03.860+0000 7f5e07481700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e001e44d0 con 0x7f5e0015a890 2023-07-06T02:40:03.865 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:03.860+0000 7f5e07481700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e001e47b0 con 0x7f5e0006c3a0 2023-07-06T02:40:03.865 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:03.860+0000 7f5e07481700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5e001e4a90 con 0x7f5e000cb110 2023-07-06T02:40:03.865 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:03.860+0000 7f5e05a1e700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5e0015a890 0x7f5e001466d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T02:40:03.865 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:03.860+0000 7f5e05a1e700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5e0015a890 0x7f5e001466d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:45752/0 (socket says 172.21.15.46:45752) 2023-07-06T02:40:03.865 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:03.860+0000 7f5e05a1e700 1 -- 172.21.15.46:0/1779218527 learned_addr learned my addr 172.21.15.46:0/1779218527 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-07-06T02:40:03.865 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:03.860+0000 7f5e0521d700 1 --2- 172.21.15.46:0/1779218527 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5e0006c3a0 0x7f5e000cea50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T02:40:03.865 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:03.860+0000 7f5e04a1c700 1 --2- 172.21.15.46:0/1779218527 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f5e000cb110 0x7f5e001e3ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T02:40:03.866 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:03.860+0000 7f5e05a1e700 1 -- 172.21.15.46:0/1779218527 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f5e000cb110 msgr2=0x7f5e001e3ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T02:40:03.866 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:03.860+0000 7f5e05a1e700 1 --2- 172.21.15.46:0/1779218527 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f5e000cb110 0x7f5e001e3ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T02:40:03.866 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:03.860+0000 7f5e05a1e700 1 -- 172.21.15.46:0/1779218527 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5e0006c3a0 msgr2=0x7f5e000cea50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T02:40:03.866 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:03.860+0000 7f5e05a1e700 1 --2- 172.21.15.46:0/1779218527 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5e0006c3a0 0x7f5e000cea50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T02:40:03.866 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:03.860+0000 7f5e05a1e700 1 -- 172.21.15.46:0/1779218527 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5dfc009550 con 0x7f5e0015a890 2023-07-06T02:40:03.866 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:03.861+0000 7f5e05a1e700 1 --2- 172.21.15.46:0/1779218527 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5e0015a890 0x7f5e001466d0 secure :-1 s=READY pgs=3204 cs=0 l=1 rev1=1 crypto rx=0x7f5df800b970 tx=0x7f5df800bc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T02:40:03.866 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:03.861+0000 7f5df5ffb700 1 -- 172.21.15.46:0/1779218527 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5df800d860 con 0x7f5e0015a890 2023-07-06T02:40:03.867 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:03.861+0000 7f5df5ffb700 1 -- 172.21.15.46:0/1779218527 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5df800d9e0 con 0x7f5e0015a890 2023-07-06T02:40:03.867 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:03.861+0000 7f5e07481700 1 -- 172.21.15.46:0/1779218527 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5e001e4d70 con 0x7f5e0015a890 2023-07-06T02:40:03.867 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:03.861+0000 7f5df5ffb700 1 -- 172.21.15.46:0/1779218527 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5df800dd90 con 0x7f5e0015a890 2023-07-06T02:40:03.868 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:03.861+0000 7f5e07481700 1 -- 172.21.15.46:0/1779218527 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5e000b2a90 con 0x7f5e0015a890 2023-07-06T02:40:03.868 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:03.863+0000 7f5e07481700 1 -- 172.21.15.46:0/1779218527 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5e000672e0 con 0x7f5e0015a890 2023-07-06T02:40:03.868 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:03.863+0000 7f5df5ffb700 1 -- 172.21.15.46:0/1779218527 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f5df800e430 con 0x7f5e0015a890 2023-07-06T02:40:03.868 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:03.864+0000 7f5df5ffb700 1 --2- 172.21.15.46:0/1779218527 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7f5de406ace0 0x7f5de406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T02:40:03.868 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:03.864+0000 7f5df5ffb700 1 -- 172.21.15.46:0/1779218527 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 6091+0+0 (secure 0 0 0) 0x7f5df8089590 con 0x7f5e0015a890 2023-07-06T02:40:03.868 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:03.864+0000 7f5e0521d700 1 --2- 172.21.15.46:0/1779218527 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7f5de406ace0 0x7f5de406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T02:40:03.868 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:03.865+0000 7f5e0521d700 1 --2- 172.21.15.46:0/1779218527 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7f5de406ace0 0x7f5de406d190 secure :-1 s=READY pgs=711 cs=0 l=1 rev1=1 crypto rx=0x7f5dfc009130 tx=0x7f5dfc008030 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T02:40:03.874 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:03.872+0000 7f5df5ffb700 1 -- 172.21.15.46:0/1779218527 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f5df80546b0 con 0x7f5e0015a890 2023-07-06T02:40:04.159 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:04.156+0000 7f5e07481700 1 -- 172.21.15.46:0/1779218527 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f5e000b2cb0 con 0x7f5e0015a890 2023-07-06T02:40:04.164 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:04.161+0000 7f5df5ffb700 1 -- 172.21.15.46:0/1779218527 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v37) v1 ==== 93+0+10 (secure 0 0 0) 0x7f5df8057cd0 con 0x7f5e0015a890 2023-07-06T02:40:04.166 INFO:teuthology.orchestra.run.smithi046.stdout:pg_num: 1 2023-07-06T02:40:04.169 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:04.166+0000 7f5e07481700 1 -- 172.21.15.46:0/1779218527 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7f5de406ace0 msgr2=0x7f5de406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T02:40:04.169 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:04.166+0000 7f5e07481700 1 --2- 172.21.15.46:0/1779218527 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7f5de406ace0 0x7f5de406d190 secure :-1 s=READY pgs=711 cs=0 l=1 rev1=1 crypto rx=0x7f5dfc009130 tx=0x7f5dfc008030 comp rx=0 tx=0).stop 2023-07-06T02:40:04.169 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:04.166+0000 7f5e07481700 1 -- 172.21.15.46:0/1779218527 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5e0015a890 msgr2=0x7f5e001466d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T02:40:04.169 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:04.166+0000 7f5e07481700 1 --2- 172.21.15.46:0/1779218527 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5e0015a890 0x7f5e001466d0 secure :-1 s=READY pgs=3204 cs=0 l=1 rev1=1 crypto rx=0x7f5df800b970 tx=0x7f5df800bc80 comp rx=0 tx=0).stop 2023-07-06T02:40:04.176 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:04.172+0000 7f5e07481700 1 -- 172.21.15.46:0/1779218527 shutdown_connections 2023-07-06T02:40:04.177 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:04.172+0000 7f5e07481700 1 --2- 172.21.15.46:0/1779218527 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7f5de406ace0 0x7f5de406d190 unknown :-1 s=CLOSED pgs=711 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T02:40:04.177 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:04.172+0000 7f5e07481700 1 --2- 172.21.15.46:0/1779218527 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5e0015a890 0x7f5e001466d0 unknown :-1 s=CLOSED pgs=3204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T02:40:04.177 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:04.172+0000 7f5e07481700 1 --2- 172.21.15.46:0/1779218527 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5e0006c3a0 0x7f5e000cea50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T02:40:04.178 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:04.172+0000 7f5e07481700 1 --2- 172.21.15.46:0/1779218527 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f5e000cb110 0x7f5e001e3ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T02:40:04.178 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:04.172+0000 7f5e07481700 1 -- 172.21.15.46:0/1779218527 >> 172.21.15.46:0/1779218527 conn(0x7f5e000b19a0 msgr2=0x7f5e0006aea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T02:40:04.179 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:04.175+0000 7f5e07481700 1 -- 172.21.15.46:0/1779218527 shutdown_connections 2023-07-06T02:40:04.179 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:04.175+0000 7f5e07481700 1 -- 172.21.15.46:0/1779218527 wait complete. 2023-07-06T02:40:04.194 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-07-06T02:40:04.394 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:04.391+0000 7fd3419ba700 1 Processor -- start 2023-07-06T02:40:04.395 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:04.392+0000 7fd3419ba700 1 -- start start 2023-07-06T02:40:04.395 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:04.392+0000 7fd3419ba700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fd33c1537f0 0x7fd33c0aeec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T02:40:04.397 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:04.393+0000 7fd3419ba700 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd33c0707f0 con 0x7fd33c0cdb00 2023-07-06T02:40:04.397 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:04.393+0000 7fd3419ba700 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd33c159e00 con 0x7fd33c159690 2023-07-06T02:40:04.397 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:04.393+0000 7fd3419ba700 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd33c0af400 con 0x7fd33c1537f0 2023-07-06T02:40:04.397 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:04.393+0000 7fd33b7fe700 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7fd33c0cdb00 0x7fd33c0ca7b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:45032/0 (socket says 172.21.15.46:45032) 2023-07-06T02:40:04.397 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:04.393+0000 7fd33b7fe700 1 -- 172.21.15.46:0/2073026352 learned_addr learned my addr 172.21.15.46:0/2073026352 (peer_addr_for_me v1:172.21.15.46:0/0) 2023-07-06T02:40:04.398 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:04.393+0000 7fd339ffb700 1 -- 172.21.15.46:0/2073026352 <== mon.1 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3186623754 0 0) 0x7fd33c159e00 con 0x7fd33c159690 2023-07-06T02:40:04.398 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:04.393+0000 7fd339ffb700 1 -- 172.21.15.46:0/2073026352 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd3240035b0 con 0x7fd33c159690 2023-07-06T02:40:04.398 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:04.393+0000 7fd339ffb700 1 -- 172.21.15.46:0/2073026352 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1187266063 0 0) 0x7fd33c0707f0 con 0x7fd33c0cdb00 2023-07-06T02:40:04.398 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:04.393+0000 7fd339ffb700 1 -- 172.21.15.46:0/2073026352 --> v1:172.21.15.46:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd33c159e00 con 0x7fd33c0cdb00 2023-07-06T02:40:04.398 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:04.394+0000 7fd339ffb700 1 -- 172.21.15.46:0/2073026352 <== mon.1 v1:172.21.15.73:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2996415891 0 0) 0x7fd3240035b0 con 0x7fd33c159690 2023-07-06T02:40:04.399 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:04.394+0000 7fd339ffb700 1 -- 172.21.15.46:0/2073026352 >> v2:172.21.15.46:3300/0 conn(0x7fd33c1537f0 msgr2=0x7fd33c0aeec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T02:40:04.399 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:04.394+0000 7fd339ffb700 1 --2- 172.21.15.46:0/2073026352 >> v2:172.21.15.46:3300/0 conn(0x7fd33c1537f0 0x7fd33c0aeec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T02:40:04.399 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:04.394+0000 7fd339ffb700 1 -- 172.21.15.46:0/2073026352 >> v1:172.21.15.46:6789/0 conn(0x7fd33c0cdb00 legacy=0x7fd33c0ca7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T02:40:04.399 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:04.394+0000 7fd339ffb700 1 -- 172.21.15.46:0/2073026352 --> v1:172.21.15.73:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd33c15a0e0 con 0x7fd33c159690 2023-07-06T02:40:04.399 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:04.394+0000 7fd339ffb700 1 -- 172.21.15.46:0/2073026352 <== mon.1 v1:172.21.15.73:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2195585215 0 0) 0x7fd3300016b0 con 0x7fd33c159690 2023-07-06T02:40:04.399 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:04.394+0000 7fd339ffb700 1 -- 172.21.15.46:0/2073026352 >> v1:172.21.15.73:6789/0 conn(0x7fd33c159690 legacy=0x7fd33c070c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T02:40:04.399 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:04.394+0000 7fd339ffb700 1 --2- 172.21.15.46:0/2073026352 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd324003b90 0x7fd324003f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T02:40:04.399 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:04.394+0000 7fd339ffb700 1 --2- 172.21.15.46:0/2073026352 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fd324004850 0x7fd324004cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T02:40:04.400 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:04.394+0000 7fd339ffb700 1 --2- 172.21.15.46:0/2073026352 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd324005320 0x7fd32400ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T02:40:04.400 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:04.394+0000 7fd339ffb700 1 -- 172.21.15.46:0/2073026352 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd33c0af400 con 0x7fd324005320 2023-07-06T02:40:04.400 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:04.394+0000 7fd339ffb700 1 -- 172.21.15.46:0/2073026352 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd32400c140 con 0x7fd324003b90 2023-07-06T02:40:04.400 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:04.394+0000 7fd339ffb700 1 -- 172.21.15.46:0/2073026352 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd32400c300 con 0x7fd324004850 2023-07-06T02:40:04.400 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:04.394+0000 7fd33b7fe700 1 --2- 172.21.15.46:0/2073026352 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd324005320 0x7fd32400ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T02:40:04.400 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:04.394+0000 7fd33affd700 1 --2- 172.21.15.46:0/2073026352 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd324003b90 0x7fd324003f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T02:40:04.400 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:04.394+0000 7fd33a7fc700 1 --2- 172.21.15.46:0/2073026352 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fd324004850 0x7fd324004cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T02:40:04.401 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:04.394+0000 7fd33b7fe700 1 -- 172.21.15.46:0/2073026352 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fd324004850 msgr2=0x7fd324004cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T02:40:04.402 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:04.394+0000 7fd33b7fe700 1 --2- 172.21.15.46:0/2073026352 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fd324004850 0x7fd324004cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T02:40:04.402 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:04.394+0000 7fd33b7fe700 1 -- 172.21.15.46:0/2073026352 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd324003b90 msgr2=0x7fd324003f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T02:40:04.402 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:04.394+0000 7fd33b7fe700 1 --2- 172.21.15.46:0/2073026352 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd324003b90 0x7fd324003f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T02:40:04.403 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:04.394+0000 7fd33b7fe700 1 -- 172.21.15.46:0/2073026352 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd3240035b0 con 0x7fd324005320 2023-07-06T02:40:04.403 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:04.394+0000 7fd33affd700 1 --2- 172.21.15.46:0/2073026352 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd324003b90 0x7fd324003f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-06T02:40:04.403 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:04.395+0000 7fd33b7fe700 1 -- 172.21.15.46:0/2073026352 reap_dead start 2023-07-06T02:40:04.403 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:04.395+0000 7fd33b7fe700 1 --2- 172.21.15.46:0/2073026352 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd324005320 0x7fd32400ba10 secure :-1 s=READY pgs=3206 cs=0 l=1 rev1=1 crypto rx=0x7fd33400c320 tx=0x7fd324005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=362df3b1acfd4254 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T02:40:04.403 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:04.395+0000 7fd339ffb700 1 -- 172.21.15.46:0/2073026352 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd334001f00 con 0x7fd324005320 2023-07-06T02:40:04.403 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:04.395+0000 7fd339ffb700 1 -- 172.21.15.46:0/2073026352 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd33400ce60 con 0x7fd324005320 2023-07-06T02:40:04.403 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:04.395+0000 7fd339ffb700 1 -- 172.21.15.46:0/2073026352 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd334012620 con 0x7fd324005320 2023-07-06T02:40:04.404 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:04.396+0000 7fd3419ba700 1 -- 172.21.15.46:0/2073026352 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd324005320 msgr2=0x7fd32400ba10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T02:40:04.404 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:04.396+0000 7fd3419ba700 1 --2- 172.21.15.46:0/2073026352 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd324005320 0x7fd32400ba10 secure :-1 s=READY pgs=3206 cs=0 l=1 rev1=1 crypto rx=0x7fd33400c320 tx=0x7fd324005880 comp rx=0 tx=0).stop 2023-07-06T02:40:04.404 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:04.397+0000 7fd3419ba700 1 -- 172.21.15.46:0/2073026352 shutdown_connections 2023-07-06T02:40:04.404 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:04.397+0000 7fd3419ba700 1 --2- 172.21.15.46:0/2073026352 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd324005320 0x7fd32400ba10 unknown :-1 s=CLOSED pgs=3206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T02:40:04.404 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:04.397+0000 7fd3419ba700 1 -- 172.21.15.46:0/2073026352 >> 172.21.15.46:0/2073026352 conn(0x7fd33c0cf970 msgr2=0x7fd33c0cfd40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T02:40:04.404 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:04.397+0000 7fd3419ba700 1 -- 172.21.15.46:0/2073026352 shutdown_connections 2023-07-06T02:40:04.404 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:04.397+0000 7fd3419ba700 1 -- 172.21.15.46:0/2073026352 wait complete. 2023-07-06T02:40:04.405 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:04.399+0000 7fd3419ba700 1 Processor -- start 2023-07-06T02:40:04.405 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:04.399+0000 7fd3419ba700 1 -- start start 2023-07-06T02:40:04.406 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:04.400+0000 7fd3419ba700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fd324005320 0x7fd33c1404c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T02:40:04.406 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:04.400+0000 7fd3419ba700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd33c145c80 0x7fd33c0b4c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T02:40:04.406 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:04.400+0000 7fd3419ba700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd33c0b5180 0x7fd33c0b0180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T02:40:04.406 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:04.400+0000 7fd3419ba700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd33c0b4820 con 0x7fd33c145c80 2023-07-06T02:40:04.407 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:04.400+0000 7fd3419ba700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd33c0b44d0 con 0x7fd33c0b5180 2023-07-06T02:40:04.407 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:04.400+0000 7fd3419ba700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd33c1467c0 con 0x7fd324005320 2023-07-06T02:40:04.407 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:04.400+0000 7fd33a7fc700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd33c145c80 0x7fd33c0b4c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T02:40:04.407 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:04.400+0000 7fd33a7fc700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd33c145c80 0x7fd33c0b4c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:45770/0 (socket says 172.21.15.46:45770) 2023-07-06T02:40:04.407 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:04.400+0000 7fd33a7fc700 1 -- 172.21.15.46:0/2813409362 learned_addr learned my addr 172.21.15.46:0/2813409362 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-07-06T02:40:04.407 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:04.400+0000 7fd33b7fe700 1 --2- 172.21.15.46:0/2813409362 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd33c0b5180 0x7fd33c0b0180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T02:40:04.408 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:04.400+0000 7fd33affd700 1 --2- 172.21.15.46:0/2813409362 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fd324005320 0x7fd33c1404c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T02:40:04.408 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:04.401+0000 7fd33a7fc700 1 -- 172.21.15.46:0/2813409362 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fd324005320 msgr2=0x7fd33c1404c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T02:40:04.408 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:04.401+0000 7fd33a7fc700 1 --2- 172.21.15.46:0/2813409362 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fd324005320 0x7fd33c1404c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T02:40:04.408 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:04.401+0000 7fd33a7fc700 1 -- 172.21.15.46:0/2813409362 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd33c0b5180 msgr2=0x7fd33c0b0180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T02:40:04.408 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:04.401+0000 7fd33a7fc700 1 --2- 172.21.15.46:0/2813409362 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd33c0b5180 0x7fd33c0b0180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T02:40:04.408 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:04.401+0000 7fd33a7fc700 1 -- 172.21.15.46:0/2813409362 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd33c146aa0 con 0x7fd33c145c80 2023-07-06T02:40:04.409 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:04.401+0000 7fd33a7fc700 1 --2- 172.21.15.46:0/2813409362 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd33c145c80 0x7fd33c0b4c40 secure :-1 s=READY pgs=3207 cs=0 l=1 rev1=1 crypto rx=0x7fd330007fd0 tx=0x7fd33000fb40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T02:40:04.409 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:04.401+0000 7fd323fff700 1 -- 172.21.15.46:0/2813409362 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3300052e0 con 0x7fd33c145c80 2023-07-06T02:40:04.409 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:04.401+0000 7fd323fff700 1 -- 172.21.15.46:0/2813409362 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd330005440 con 0x7fd33c145c80 2023-07-06T02:40:04.409 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:04.401+0000 7fd3419ba700 1 -- 172.21.15.46:0/2813409362 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd33c148e70 con 0x7fd33c145c80 2023-07-06T02:40:04.409 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:04.401+0000 7fd323fff700 1 -- 172.21.15.46:0/2813409362 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3300038c0 con 0x7fd33c145c80 2023-07-06T02:40:04.409 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:04.401+0000 7fd3419ba700 1 -- 172.21.15.46:0/2813409362 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd33c0b06c0 con 0x7fd33c145c80 2023-07-06T02:40:04.410 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:04.403+0000 7fd3419ba700 1 -- 172.21.15.46:0/2813409362 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd33c0b4960 con 0x7fd33c145c80 2023-07-06T02:40:04.410 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:04.403+0000 7fd323fff700 1 -- 172.21.15.46:0/2813409362 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fd330003a20 con 0x7fd33c145c80 2023-07-06T02:40:04.410 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:04.404+0000 7fd323fff700 1 --2- 172.21.15.46:0/2813409362 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7fd32806ace0 0x7fd32806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T02:40:04.410 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:04.404+0000 7fd323fff700 1 -- 172.21.15.46:0/2813409362 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 6091+0+0 (secure 0 0 0) 0x7fd3300892d0 con 0x7fd33c145c80 2023-07-06T02:40:04.411 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:04.404+0000 7fd33affd700 1 --2- 172.21.15.46:0/2813409362 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7fd32806ace0 0x7fd32806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T02:40:04.411 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:04.405+0000 7fd33affd700 1 --2- 172.21.15.46:0/2813409362 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7fd32806ace0 0x7fd32806d190 secure :-1 s=READY pgs=712 cs=0 l=1 rev1=1 crypto rx=0x7fd33c0b57d0 tx=0x7fd32c0090e0 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T02:40:04.414 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:04.411+0000 7fd323fff700 1 -- 172.21.15.46:0/2813409362 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fd33c0b4960 con 0x7fd33c145c80 2023-07-06T02:40:04.734 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:04.731+0000 7fd3419ba700 1 -- 172.21.15.46:0/2813409362 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fd33c0b4960 con 0x7fd33c145c80 2023-07-06T02:40:04.735 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:04.732+0000 7fd323fff700 1 -- 172.21.15.46:0/2813409362 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v37) v1 ==== 104+0+11 (secure 0 0 0) 0x7fd33c0b4960 con 0x7fd33c145c80 2023-07-06T02:40:04.735 INFO:teuthology.orchestra.run.smithi046.stdout:pg_num: 32 2023-07-06T02:40:04.737 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:04.734+0000 7fd3419ba700 1 -- 172.21.15.46:0/2813409362 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7fd32806ace0 msgr2=0x7fd32806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T02:40:04.738 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:04.734+0000 7fd3419ba700 1 --2- 172.21.15.46:0/2813409362 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7fd32806ace0 0x7fd32806d190 secure :-1 s=READY pgs=712 cs=0 l=1 rev1=1 crypto rx=0x7fd33c0b57d0 tx=0x7fd32c0090e0 comp rx=0 tx=0).stop 2023-07-06T02:40:04.738 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:04.734+0000 7fd3419ba700 1 -- 172.21.15.46:0/2813409362 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd33c145c80 msgr2=0x7fd33c0b4c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T02:40:04.738 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:04.734+0000 7fd3419ba700 1 --2- 172.21.15.46:0/2813409362 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd33c145c80 0x7fd33c0b4c40 secure :-1 s=READY pgs=3207 cs=0 l=1 rev1=1 crypto rx=0x7fd330007fd0 tx=0x7fd33000fb40 comp rx=0 tx=0).stop 2023-07-06T02:40:04.738 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:04.734+0000 7fd3419ba700 1 -- 172.21.15.46:0/2813409362 shutdown_connections 2023-07-06T02:40:04.738 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:04.734+0000 7fd3419ba700 1 --2- 172.21.15.46:0/2813409362 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7fd32806ace0 0x7fd32806d190 unknown :-1 s=CLOSED pgs=712 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T02:40:04.738 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:04.734+0000 7fd3419ba700 1 --2- 172.21.15.46:0/2813409362 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd33c0b5180 0x7fd33c0b0180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T02:40:04.738 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:04.734+0000 7fd3419ba700 1 --2- 172.21.15.46:0/2813409362 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fd324005320 0x7fd33c1404c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T02:40:04.739 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:04.734+0000 7fd3419ba700 1 --2- 172.21.15.46:0/2813409362 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd33c145c80 0x7fd33c0b4c40 unknown :-1 s=CLOSED pgs=3207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T02:40:04.739 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:04.734+0000 7fd3419ba700 1 -- 172.21.15.46:0/2813409362 >> 172.21.15.46:0/2813409362 conn(0x7fd33c0cf970 msgr2=0x7fd33c0cedf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T02:40:04.739 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:04.735+0000 7fd3419ba700 1 -- 172.21.15.46:0/2813409362 shutdown_connections 2023-07-06T02:40:04.739 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:04.735+0000 7fd3419ba700 1 -- 172.21.15.46:0/2813409362 wait complete. 2023-07-06T02:40:04.756 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-07-06T02:40:04.959 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:04.956+0000 7f7a5fb91700 1 Processor -- start 2023-07-06T02:40:04.959 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:04.956+0000 7f7a5fb91700 1 -- start start 2023-07-06T02:40:04.962 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:04.957+0000 7f7a5fb91700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f7a5815a890 0x7f7a5806bc90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T02:40:04.963 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:04.957+0000 7f7a5fb91700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f7a5815ace0 0x7f7a5806c1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T02:40:04.963 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:04.957+0000 7f7a5fb91700 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7a5806b7c0 con 0x7f7a580cb110 2023-07-06T02:40:04.963 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:04.957+0000 7f7a5fb91700 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7a5815ede0 con 0x7f7a5815ace0 2023-07-06T02:40:04.963 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:04.957+0000 7f7a5fb91700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7a5815e260 con 0x7f7a5815a890 2023-07-06T02:40:04.963 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:04.957+0000 7f7a5d92d700 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7f7a580cb110 0x7f7a5806b0b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:45048/0 (socket says 172.21.15.46:45048) 2023-07-06T02:40:04.963 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:04.957+0000 7f7a5d92d700 1 -- 172.21.15.46:0/1089692656 learned_addr learned my addr 172.21.15.46:0/1089692656 (peer_addr_for_me v1:172.21.15.46:0/0) 2023-07-06T02:40:04.963 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:04.957+0000 7f7a5d12c700 1 --2- 172.21.15.46:0/1089692656 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f7a5815a890 0x7f7a5806bc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T02:40:04.964 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:04.957+0000 7f7a5e12e700 1 --2- 172.21.15.46:0/1089692656 >> v2:172.21.15.73:3300/0 conn(0x7f7a5815ace0 0x7f7a5806c1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T02:40:04.964 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:04.958+0000 7f7a5d12c700 1 -- 172.21.15.46:0/1089692656 >> v2:172.21.15.73:3300/0 conn(0x7f7a5815ace0 msgr2=0x7f7a5806c1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T02:40:04.964 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:04.958+0000 7f7a5d12c700 1 --2- 172.21.15.46:0/1089692656 >> v2:172.21.15.73:3300/0 conn(0x7f7a5815ace0 0x7f7a5806c1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T02:40:04.964 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:04.958+0000 7f7a5d12c700 1 -- 172.21.15.46:0/1089692656 >> v1:172.21.15.46:6789/0 conn(0x7f7a580cb110 legacy=0x7f7a5806b0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T02:40:04.964 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:04.958+0000 7f7a5c92b700 1 -- 172.21.15.46:0/1089692656 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3287203747 0 0) 0x7f7a48001110 con 0x7f7a580cb110 2023-07-06T02:40:04.964 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:04.958+0000 7f7a5d12c700 1 -- 172.21.15.46:0/1089692656 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7a5815e540 con 0x7f7a5815a890 2023-07-06T02:40:04.964 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:04.958+0000 7f7a5d12c700 1 --2- 172.21.15.46:0/1089692656 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f7a5815a890 0x7f7a5806bc90 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f7a54009840 tx=0x7f7a54009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=24d6da9497f71dd server_cookie=0 in_seq=0 out_seq=0 2023-07-06T02:40:04.965 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:04.958+0000 7f7a5c92b700 1 -- 172.21.15.46:0/1089692656 <== mon.2 v2:172.21.15.73:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a54011830 con 0x7f7a5815a890 2023-07-06T02:40:04.965 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:04.958+0000 7f7a5c92b700 1 -- 172.21.15.46:0/1089692656 <== mon.2 v2:172.21.15.73:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7a54011990 con 0x7f7a5815a890 2023-07-06T02:40:04.965 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:04.958+0000 7f7a5c92b700 1 -- 172.21.15.46:0/1089692656 <== mon.2 v2:172.21.15.73:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a54011d20 con 0x7f7a5815a890 2023-07-06T02:40:04.965 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:04.959+0000 7f7a5fb91700 1 -- 172.21.15.46:0/1089692656 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f7a5815a890 msgr2=0x7f7a5806bc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T02:40:04.965 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:04.959+0000 7f7a5fb91700 1 --2- 172.21.15.46:0/1089692656 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f7a5815a890 0x7f7a5806bc90 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f7a54009840 tx=0x7f7a54009b50 comp rx=0 tx=0).stop 2023-07-06T02:40:04.970 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:04.962+0000 7f7a5fb91700 1 -- 172.21.15.46:0/1089692656 shutdown_connections 2023-07-06T02:40:04.970 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:04.962+0000 7f7a5fb91700 1 --2- 172.21.15.46:0/1089692656 >> v2:172.21.15.73:3300/0 conn(0x7f7a5815ace0 0x7f7a5806c1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T02:40:04.970 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:04.962+0000 7f7a5fb91700 1 --2- 172.21.15.46:0/1089692656 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f7a5815a890 0x7f7a5806bc90 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T02:40:04.970 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:04.962+0000 7f7a5fb91700 1 -- 172.21.15.46:0/1089692656 >> 172.21.15.46:0/1089692656 conn(0x7f7a580b19a0 msgr2=0x7f7a580cf1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T02:40:04.971 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:04.967+0000 7f7a5fb91700 1 -- 172.21.15.46:0/1089692656 shutdown_connections 2023-07-06T02:40:04.971 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:04.969+0000 7f7a5fb91700 1 -- 172.21.15.46:0/1089692656 wait complete. 2023-07-06T02:40:04.973 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:04.971+0000 7f7a5fb91700 1 Processor -- start 2023-07-06T02:40:04.973 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:04.971+0000 7f7a5fb91700 1 -- start start 2023-07-06T02:40:04.975 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:04.972+0000 7f7a5fb91700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7a580cb110 0x7f7a580ce2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T02:40:04.975 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:04.972+0000 7f7a5fb91700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7a5815a890 0x7f7a580ce830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T02:40:04.975 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:04.972+0000 7f7a5fb91700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f7a5815ace0 0x7f7a580afbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T02:40:04.975 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:04.972+0000 7f7a5fb91700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a580c78e0 con 0x7f7a5815a890 2023-07-06T02:40:04.975 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:04.972+0000 7f7a5fb91700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a580c6290 con 0x7f7a580cb110 2023-07-06T02:40:04.976 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:04.972+0000 7f7a5fb91700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7a580c6550 con 0x7f7a5815ace0 2023-07-06T02:40:04.976 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:04.972+0000 7f7a5e12e700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f7a5815ace0 0x7f7a580afbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T02:40:04.976 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:04.972+0000 7f7a5e12e700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f7a5815ace0 0x7f7a580afbc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3301/0 says I am v2:172.21.15.46:57702/0 (socket says 172.21.15.46:57702) 2023-07-06T02:40:04.976 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:04.972+0000 7f7a5e12e700 1 -- 172.21.15.46:0/1449199677 learned_addr learned my addr 172.21.15.46:0/1449199677 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-07-06T02:40:04.977 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:04.972+0000 7f7a5e12e700 1 -- 172.21.15.46:0/1449199677 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7a580cb110 msgr2=0x7f7a580ce2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T02:40:04.977 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:04.972+0000 7f7a5e12e700 1 --2- 172.21.15.46:0/1449199677 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7a580cb110 0x7f7a580ce2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T02:40:04.978 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:04.972+0000 7f7a5e12e700 1 -- 172.21.15.46:0/1449199677 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7a5815a890 msgr2=0x7f7a580ce830 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-07-06T02:40:04.978 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:04.972+0000 7f7a5e12e700 1 --2- 172.21.15.46:0/1449199677 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7a5815a890 0x7f7a580ce830 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T02:40:04.978 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:04.972+0000 7f7a5e12e700 1 -- 172.21.15.46:0/1449199677 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7a540094a0 con 0x7f7a5815ace0 2023-07-06T02:40:04.978 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:04.973+0000 7f7a5e12e700 1 --2- 172.21.15.46:0/1449199677 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f7a5815ace0 0x7f7a580afbc0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f7a5000d350 tx=0x7f7a5000d710 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T02:40:04.978 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:04.973+0000 7f7a4e7fc700 1 -- 172.21.15.46:0/1449199677 <== mon.2 v2:172.21.15.73:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a5000dea0 con 0x7f7a5815ace0 2023-07-06T02:40:04.978 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:04.973+0000 7f7a4e7fc700 1 -- 172.21.15.46:0/1449199677 <== mon.2 v2:172.21.15.73:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7a5000f040 con 0x7f7a5815ace0 2023-07-06T02:40:04.978 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:04.973+0000 7f7a4e7fc700 1 -- 172.21.15.46:0/1449199677 <== mon.2 v2:172.21.15.73:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a50015620 con 0x7f7a5815ace0 2023-07-06T02:40:04.978 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:04.973+0000 7f7a5fb91700 1 -- 172.21.15.46:0/1449199677 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7a580c6830 con 0x7f7a5815ace0 2023-07-06T02:40:04.979 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:04.973+0000 7f7a5fb91700 1 -- 172.21.15.46:0/1449199677 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7a580c6df0 con 0x7f7a5815ace0 2023-07-06T02:40:04.979 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:04.975+0000 7f7a5fb91700 1 -- 172.21.15.46:0/1449199677 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7a580c7010 con 0x7f7a5815ace0 2023-07-06T02:40:04.979 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:04.975+0000 7f7a4e7fc700 1 -- 172.21.15.46:0/1449199677 <== mon.2 v2:172.21.15.73:3301/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f7a500143a0 con 0x7f7a5815ace0 2023-07-06T02:40:04.980 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:04.976+0000 7f7a4e7fc700 1 --2- 172.21.15.46:0/1449199677 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7f7a3c06ad30 0x7f7a3c06d1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T02:40:04.980 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:04.976+0000 7f7a4e7fc700 1 -- 172.21.15.46:0/1449199677 <== mon.2 v2:172.21.15.73:3301/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 6091+0+0 (secure 0 0 0) 0x7f7a50089870 con 0x7f7a5815ace0 2023-07-06T02:40:04.980 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:04.976+0000 7f7a5d92d700 1 --2- 172.21.15.46:0/1449199677 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7f7a3c06ad30 0x7f7a3c06d1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T02:40:04.980 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:04.976+0000 7f7a5d92d700 1 --2- 172.21.15.46:0/1449199677 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7f7a3c06ad30 0x7f7a3c06d1e0 secure :-1 s=READY pgs=713 cs=0 l=1 rev1=1 crypto rx=0x7f7a48001610 tx=0x7f7a480079f0 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T02:40:04.986 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:04.983+0000 7f7a4e7fc700 1 -- 172.21.15.46:0/1449199677 <== mon.2 v2:172.21.15.73:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f7a500549e0 con 0x7f7a5815ace0 2023-07-06T02:40:05.294 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:05.291+0000 7f7a5fb91700 1 -- 172.21.15.46:0/1449199677 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f7a580672e0 con 0x7f7a5815ace0 2023-07-06T02:40:05.383 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:05.381+0000 7f7a4e7fc700 1 -- 172.21.15.46:0/1449199677 <== mon.2 v2:172.21.15.73:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v37) v1 ==== 100+0+11 (secure 0 0 0) 0x7f7a50058000 con 0x7f7a5815ace0 2023-07-06T02:40:05.392 INFO:teuthology.orchestra.run.smithi046.stdout:pg_num: 64 2023-07-06T02:40:05.393 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:05.388+0000 7f7a5fb91700 1 -- 172.21.15.46:0/1449199677 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7f7a3c06ad30 msgr2=0x7f7a3c06d1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T02:40:05.393 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:05.388+0000 7f7a5fb91700 1 --2- 172.21.15.46:0/1449199677 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7f7a3c06ad30 0x7f7a3c06d1e0 secure :-1 s=READY pgs=713 cs=0 l=1 rev1=1 crypto rx=0x7f7a48001610 tx=0x7f7a480079f0 comp rx=0 tx=0).stop 2023-07-06T02:40:05.393 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:05.388+0000 7f7a5fb91700 1 -- 172.21.15.46:0/1449199677 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f7a5815ace0 msgr2=0x7f7a580afbc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T02:40:05.393 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:05.388+0000 7f7a5fb91700 1 --2- 172.21.15.46:0/1449199677 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f7a5815ace0 0x7f7a580afbc0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f7a5000d350 tx=0x7f7a5000d710 comp rx=0 tx=0).stop 2023-07-06T02:40:05.393 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:05.389+0000 7f7a5fb91700 1 -- 172.21.15.46:0/1449199677 shutdown_connections 2023-07-06T02:40:05.393 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:05.389+0000 7f7a5fb91700 1 --2- 172.21.15.46:0/1449199677 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7f7a3c06ad30 0x7f7a3c06d1e0 unknown :-1 s=CLOSED pgs=713 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T02:40:05.393 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:05.389+0000 7f7a5fb91700 1 --2- 172.21.15.46:0/1449199677 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f7a5815ace0 0x7f7a580afbc0 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T02:40:05.394 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:05.389+0000 7f7a5fb91700 1 --2- 172.21.15.46:0/1449199677 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7a580cb110 0x7f7a580ce2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T02:40:05.394 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:05.389+0000 7f7a5fb91700 1 --2- 172.21.15.46:0/1449199677 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7a5815a890 0x7f7a580ce830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T02:40:05.394 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:05.389+0000 7f7a5fb91700 1 -- 172.21.15.46:0/1449199677 >> 172.21.15.46:0/1449199677 conn(0x7f7a580b19a0 msgr2=0x7f7a58158400 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T02:40:05.394 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:05.389+0000 7f7a5fb91700 1 -- 172.21.15.46:0/1449199677 shutdown_connections 2023-07-06T02:40:05.394 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:05.389+0000 7f7a5fb91700 1 -- 172.21.15.46:0/1449199677 wait complete. 2023-07-06T02:40:05.419 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-07-06T02:40:05.630 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:05.627+0000 7effb6dbf700 1 Processor -- start 2023-07-06T02:40:05.630 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:05.627+0000 7effb6dbf700 1 -- start start 2023-07-06T02:40:05.631 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:05.628+0000 7effb6dbf700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7effb00adea0 0x7effb0070eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T02:40:05.631 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:05.628+0000 7effb6dbf700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7effb006fff0 0x7effb006cac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T02:40:05.632 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:05.628+0000 7effb6dbf700 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7effb00cc760 con 0x7effb00713f0 2023-07-06T02:40:05.632 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:05.628+0000 7effb6dbf700 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7effb0070470 con 0x7effb006fff0 2023-07-06T02:40:05.632 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:05.628+0000 7effb6dbf700 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7effb0071860 con 0x7effb00adea0 2023-07-06T02:40:05.632 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:05.629+0000 7effb4b5b700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7effb00adea0 0x7effb0070eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T02:40:05.632 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:05.629+0000 7effaffff700 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7effb00713f0 0x7effb006f8e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:45060/0 (socket says 172.21.15.46:45060) 2023-07-06T02:40:05.632 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:05.629+0000 7effaffff700 1 -- 172.21.15.46:0/960339764 learned_addr learned my addr 172.21.15.46:0/960339764 (peer_addr_for_me v1:172.21.15.46:0/0) 2023-07-06T02:40:05.633 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:05.629+0000 7effaf7fe700 1 -- 172.21.15.46:0/960339764 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1045877644 0 0) 0x7effb00cc760 con 0x7effb00713f0 2023-07-06T02:40:05.633 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:05.629+0000 7effaf7fe700 1 -- 172.21.15.46:0/960339764 --> v1:172.21.15.46:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7effa00035b0 con 0x7effb00713f0 2023-07-06T02:40:05.633 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:05.629+0000 7effaf7fe700 1 -- 172.21.15.46:0/960339764 <== mon.0 v1:172.21.15.46:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 910365282 0 0) 0x7effa00035b0 con 0x7effb00713f0 2023-07-06T02:40:05.633 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:05.629+0000 7effaf7fe700 1 -- 172.21.15.46:0/960339764 >> v2:172.21.15.73:3300/0 conn(0x7effb00adea0 msgr2=0x7effb0070eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T02:40:05.633 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:05.629+0000 7effaf7fe700 1 --2- 172.21.15.46:0/960339764 >> v2:172.21.15.73:3300/0 conn(0x7effb00adea0 0x7effb0070eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T02:40:05.634 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:05.629+0000 7effaf7fe700 1 -- 172.21.15.46:0/960339764 >> v2:172.21.15.46:3300/0 conn(0x7effb006fff0 msgr2=0x7effb006cac0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-07-06T02:40:05.634 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:05.629+0000 7effaf7fe700 1 --2- 172.21.15.46:0/960339764 >> v2:172.21.15.46:3300/0 conn(0x7effb006fff0 0x7effb006cac0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T02:40:05.634 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:05.629+0000 7effaf7fe700 1 -- 172.21.15.46:0/960339764 --> v1:172.21.15.46:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7effb015a890 con 0x7effb00713f0 2023-07-06T02:40:05.634 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:05.629+0000 7effaf7fe700 1 -- 172.21.15.46:0/960339764 <== mon.0 v1:172.21.15.46:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2195585215 0 0) 0x7eff9c001670 con 0x7effb00713f0 2023-07-06T02:40:05.634 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:05.629+0000 7effaf7fe700 1 -- 172.21.15.46:0/960339764 >> v1:172.21.15.46:6789/0 conn(0x7effb00713f0 legacy=0x7effb006f8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T02:40:05.634 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:05.629+0000 7effaf7fe700 1 --2- 172.21.15.46:0/960339764 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7effa0003a30 0x7effa0003e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T02:40:05.634 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:05.629+0000 7effaf7fe700 1 --2- 172.21.15.46:0/960339764 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7effa0004850 0x7effa0004cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T02:40:05.635 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:05.629+0000 7effaf7fe700 1 --2- 172.21.15.46:0/960339764 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7effa0005320 0x7effa000ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T02:40:05.635 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:05.629+0000 7effaf7fe700 1 -- 172.21.15.46:0/960339764 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7effb0071860 con 0x7effa0005320 2023-07-06T02:40:05.635 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:05.629+0000 7effaf7fe700 1 -- 172.21.15.46:0/960339764 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7effa000c200 con 0x7effa0003a30 2023-07-06T02:40:05.635 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:05.630+0000 7effaf7fe700 1 -- 172.21.15.46:0/960339764 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7effa000c3c0 con 0x7effa0004850 2023-07-06T02:40:05.635 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:05.630+0000 7effaffff700 1 --2- 172.21.15.46:0/960339764 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7effa0004850 0x7effa0004cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T02:40:05.635 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:05.630+0000 7effaffff700 1 -- 172.21.15.46:0/960339764 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7effa0003a30 msgr2=0x7effa0003e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T02:40:05.636 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:05.630+0000 7effaffff700 1 --2- 172.21.15.46:0/960339764 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7effa0003a30 0x7effa0003e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T02:40:05.636 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:05.630+0000 7effaffff700 1 -- 172.21.15.46:0/960339764 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7effa0005320 msgr2=0x7effa000ba10 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-07-06T02:40:05.636 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:05.630+0000 7effaffff700 1 --2- 172.21.15.46:0/960339764 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7effa0005320 0x7effa000ba10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T02:40:05.636 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:05.630+0000 7effaffff700 1 -- 172.21.15.46:0/960339764 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7effb015a890 con 0x7effa0004850 2023-07-06T02:40:05.636 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:05.630+0000 7effaffff700 1 --2- 172.21.15.46:0/960339764 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7effa0004850 0x7effa0004cc0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7eff9c00c370 tx=0x7effa0005880 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9ef97b639e444585 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T02:40:05.636 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:05.631+0000 7effb535c700 1 -- 172.21.15.46:0/960339764 reap_dead start 2023-07-06T02:40:05.636 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:05.631+0000 7effaf7fe700 1 -- 172.21.15.46:0/960339764 <== mon.2 v2:172.21.15.73:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff9c005960 con 0x7effa0004850 2023-07-06T02:40:05.637 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:05.631+0000 7effaf7fe700 1 -- 172.21.15.46:0/960339764 <== mon.2 v2:172.21.15.73:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7eff9c005ac0 con 0x7effa0004850 2023-07-06T02:40:05.637 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:05.631+0000 7effaf7fe700 1 -- 172.21.15.46:0/960339764 <== mon.2 v2:172.21.15.73:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff9c005e70 con 0x7effa0004850 2023-07-06T02:40:05.637 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:05.632+0000 7effb6dbf700 1 -- 172.21.15.46:0/960339764 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7effa0004850 msgr2=0x7effa0004cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T02:40:05.637 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:05.632+0000 7effb6dbf700 1 --2- 172.21.15.46:0/960339764 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7effa0004850 0x7effa0004cc0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7eff9c00c370 tx=0x7effa0005880 comp rx=0 tx=0).stop 2023-07-06T02:40:05.637 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:05.632+0000 7effb6dbf700 1 -- 172.21.15.46:0/960339764 shutdown_connections 2023-07-06T02:40:05.637 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:05.632+0000 7effb6dbf700 1 --2- 172.21.15.46:0/960339764 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7effa0004850 0x7effa0004cc0 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T02:40:05.637 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:05.632+0000 7effb6dbf700 1 -- 172.21.15.46:0/960339764 >> 172.21.15.46:0/960339764 conn(0x7effb00ce860 msgr2=0x7effb00cec30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T02:40:05.637 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:05.632+0000 7effb6dbf700 1 -- 172.21.15.46:0/960339764 shutdown_connections 2023-07-06T02:40:05.638 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:05.632+0000 7effb6dbf700 1 -- 172.21.15.46:0/960339764 wait complete. 2023-07-06T02:40:05.638 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:05.634+0000 7effb6dbf700 1 Processor -- start 2023-07-06T02:40:05.638 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:05.634+0000 7effb6dbf700 1 -- start start 2023-07-06T02:40:05.638 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:05.635+0000 7effb6dbf700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7effa0004850 0x7effb00c2860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T02:40:05.639 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:05.635+0000 7effb6dbf700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7effb014dea0 0x7effb014e310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T02:40:05.639 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:05.635+0000 7effb6dbf700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7effb00b26c0 0x7effb00b2b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T02:40:05.639 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:05.635+0000 7effb6dbf700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7effb014e850 con 0x7effb00b26c0 2023-07-06T02:40:05.639 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:05.635+0000 7effb6dbf700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7effb00b3440 con 0x7effa0004850 2023-07-06T02:40:05.639 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:05.635+0000 7effb6dbf700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7effb00b3720 con 0x7effb014dea0 2023-07-06T02:40:05.639 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:05.635+0000 7effb535c700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7effb00b26c0 0x7effb00b2b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T02:40:05.639 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:05.635+0000 7effb535c700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7effb00b26c0 0x7effb00b2b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:45800/0 (socket says 172.21.15.46:45800) 2023-07-06T02:40:05.640 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:05.635+0000 7effb535c700 1 -- 172.21.15.46:0/3134987552 learned_addr learned my addr 172.21.15.46:0/3134987552 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-07-06T02:40:05.645 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:05.635+0000 7effaffff700 1 --2- 172.21.15.46:0/3134987552 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7effb014dea0 0x7effb014e310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T02:40:05.645 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:05.636+0000 7effaffff700 1 -- 172.21.15.46:0/3134987552 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7effa0004850 msgr2=0x7effb00c2860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T02:40:05.645 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:05.636+0000 7effaffff700 1 --2- 172.21.15.46:0/3134987552 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7effa0004850 0x7effb00c2860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T02:40:05.645 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:05.636+0000 7effaffff700 1 -- 172.21.15.46:0/3134987552 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7effb00b26c0 msgr2=0x7effb00b2b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T02:40:05.646 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:05.636+0000 7effaffff700 1 --2- 172.21.15.46:0/3134987552 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7effb00b26c0 0x7effb00b2b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T02:40:05.646 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:05.636+0000 7effaffff700 1 -- 172.21.15.46:0/3134987552 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7effb00b3a00 con 0x7effb014dea0 2023-07-06T02:40:05.646 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:05.636+0000 7effaffff700 1 --2- 172.21.15.46:0/3134987552 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7effb014dea0 0x7effb014e310 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7eff9c00c340 tx=0x7eff9c001930 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T02:40:05.646 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:05.636+0000 7effad7fa700 1 -- 172.21.15.46:0/3134987552 <== mon.2 v2:172.21.15.73:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff9c0072e0 con 0x7effb014dea0 2023-07-06T02:40:05.646 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:05.636+0000 7effad7fa700 1 -- 172.21.15.46:0/3134987552 <== mon.2 v2:172.21.15.73:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7eff9c007460 con 0x7effb014dea0 2023-07-06T02:40:05.646 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:05.636+0000 7effad7fa700 1 -- 172.21.15.46:0/3134987552 <== mon.2 v2:172.21.15.73:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff9c007810 con 0x7effb014dea0 2023-07-06T02:40:05.646 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:05.636+0000 7effb6dbf700 1 -- 172.21.15.46:0/3134987552 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7effb00b3ce0 con 0x7effb014dea0 2023-07-06T02:40:05.646 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:05.636+0000 7effb6dbf700 1 -- 172.21.15.46:0/3134987552 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7effb00b44e0 con 0x7effb014dea0 2023-07-06T02:40:05.647 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:05.638+0000 7effb6dbf700 1 -- 172.21.15.46:0/3134987552 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7effb00b4200 con 0x7effb014dea0 2023-07-06T02:40:05.647 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:05.639+0000 7effad7fa700 1 -- 172.21.15.46:0/3134987552 <== mon.2 v2:172.21.15.73:3301/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7eff9c01e430 con 0x7effb014dea0 2023-07-06T02:40:05.647 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:05.639+0000 7effad7fa700 1 --2- 172.21.15.46:0/3134987552 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7eff9406ad10 0x7eff9406d1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T02:40:05.647 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:05.639+0000 7effad7fa700 1 -- 172.21.15.46:0/3134987552 <== mon.2 v2:172.21.15.73:3301/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 6091+0+0 (secure 0 0 0) 0x7eff9c08ab60 con 0x7effb014dea0 2023-07-06T02:40:05.647 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:05.640+0000 7effb4b5b700 1 --2- 172.21.15.46:0/3134987552 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7eff9406ad10 0x7eff9406d1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T02:40:05.647 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:05.641+0000 7effb4b5b700 1 --2- 172.21.15.46:0/3134987552 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7eff9406ad10 0x7eff9406d1c0 secure :-1 s=READY pgs=714 cs=0 l=1 rev1=1 crypto rx=0x7effa40097d0 tx=0x7effa4008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T02:40:05.648 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:05.645+0000 7effad7fa700 1 -- 172.21.15.46:0/3134987552 <== mon.2 v2:172.21.15.73:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7effb00b4200 con 0x7effb014dea0 2023-07-06T02:40:05.998 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:05.995+0000 7effb6dbf700 1 -- 172.21.15.46:0/3134987552 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7effb00b4200 con 0x7effb014dea0 2023-07-06T02:40:06.002 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:05.999+0000 7effad7fa700 1 -- 172.21.15.46:0/3134987552 <== mon.2 v2:172.21.15.73:3301/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v37) v1 ==== 80+0+0 (secure 0 0 0) 0x7effb00b4200 con 0x7effb014dea0 2023-07-06T02:40:06.005 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:06.002+0000 7effb6dbf700 1 -- 172.21.15.46:0/3134987552 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7eff9406ad10 msgr2=0x7eff9406d1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T02:40:06.005 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:06.002+0000 7effb6dbf700 1 --2- 172.21.15.46:0/3134987552 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7eff9406ad10 0x7eff9406d1c0 secure :-1 s=READY pgs=714 cs=0 l=1 rev1=1 crypto rx=0x7effa40097d0 tx=0x7effa4008040 comp rx=0 tx=0).stop 2023-07-06T02:40:06.006 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:06.002+0000 7effb6dbf700 1 -- 172.21.15.46:0/3134987552 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7effb014dea0 msgr2=0x7effb014e310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T02:40:06.006 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:06.002+0000 7effb6dbf700 1 --2- 172.21.15.46:0/3134987552 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7effb014dea0 0x7effb014e310 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7eff9c00c340 tx=0x7eff9c001930 comp rx=0 tx=0).stop 2023-07-06T02:40:06.006 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:06.002+0000 7effb6dbf700 1 -- 172.21.15.46:0/3134987552 shutdown_connections 2023-07-06T02:40:06.006 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:06.002+0000 7effb6dbf700 1 --2- 172.21.15.46:0/3134987552 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7eff9406ad10 0x7eff9406d1c0 unknown :-1 s=CLOSED pgs=714 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T02:40:06.006 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:06.002+0000 7effb6dbf700 1 --2- 172.21.15.46:0/3134987552 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7effb00b26c0 0x7effb00b2b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T02:40:06.006 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:06.002+0000 7effb6dbf700 1 --2- 172.21.15.46:0/3134987552 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7effa0004850 0x7effb00c2860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T02:40:06.006 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:06.002+0000 7effb6dbf700 1 --2- 172.21.15.46:0/3134987552 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7effb014dea0 0x7effb014e310 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T02:40:06.006 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:06.002+0000 7effb6dbf700 1 -- 172.21.15.46:0/3134987552 >> 172.21.15.46:0/3134987552 conn(0x7effb00ce860 msgr2=0x7effb015d210 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T02:40:06.007 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:06.002+0000 7effb6dbf700 1 -- 172.21.15.46:0/3134987552 shutdown_connections 2023-07-06T02:40:06.007 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:06.002+0000 7effb6dbf700 1 -- 172.21.15.46:0/3134987552 wait complete. 2023-07-06T02:40:06.007 INFO:teuthology.orchestra.run.smithi046.stderr:listed 0 entries 2023-07-06T02:40:06.027 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2023-07-06T02:40:06.027 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-06T02:40:06.027 DEBUG:teuthology.orchestra.run.smithi046:> sudo umount /home/ubuntu/cephtest/mnt.0 2023-07-06T02:40:06.098 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi046.front.sepia.ceph.com 2023-07-06T02:40:06.099 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-06T02:40:06.099 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-07-06T02:40:06.161 DEBUG:teuthology.orchestra.run.smithi073:> set -ex 2023-07-06T02:40:06.162 DEBUG:teuthology.orchestra.run.smithi073:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-06T02:40:06.204 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=16284204k,nr_inodes=4071051,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,mode=755 0 0 tmpfs /sys/fs/cgroup tmpfs ro,seclabel,nosuid,nodev,noexec,mode=755 0 0 cgroup /sys/fs/cgroup/systemd cgroup rw,seclabel,nosuid,nodev,noexec,relatime,xattr,release_agent=/usr/lib/systemd/systemd-cgroups-agent,name=systemd 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 cgroup /sys/fs/cgroup/memory cgroup rw,seclabel,nosuid,nodev,noexec,relatime,memory 0 0 cgroup /sys/fs/cgroup/rdma cgroup rw,seclabel,nosuid,nodev,noexec,relatime,rdma 0 0 cgroup /sys/fs/cgroup/cpu,cpuacct cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpu,cpuacct 0 0 cgroup /sys/fs/cgroup/net_cls,net_prio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,net_cls,net_prio 0 0 cgroup /sys/fs/cgroup/pids cgroup rw,seclabel,nosuid,nodev,noexec,relatime,pids 0 0 cgroup /sys/fs/cgroup/perf_event cgroup rw,seclabel,nosuid,nodev,noexec,relatime,perf_event 0 0 cgroup /sys/fs/cgroup/freezer cgroup rw,seclabel,nosuid,nodev,noexec,relatime,freezer 0 0 cgroup /sys/fs/cgroup/hugetlb cgroup rw,seclabel,nosuid,nodev,noexec,relatime,hugetlb 0 0 cgroup /sys/fs/cgroup/cpuset cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpuset 0 0 cgroup /sys/fs/cgroup/devices cgroup rw,seclabel,nosuid,nodev,noexec,relatime,devices 0 0 cgroup /sys/fs/cgroup/blkio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,blkio 0 0 none /sys/kernel/tracing tracefs rw,seclabel,relatime 0 0 configfs /sys/kernel/config configfs rw,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=28,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=12193 0 0 mqueue /dev/mqueue mqueue rw,seclabel,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,relatime 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3260540k,mode=700,uid=1000,gid=1265 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw,seclabel 0 0 2023-07-06T02:40:06.205 DEBUG:teuthology.orchestra.run.smithi046:> set -ex 2023-07-06T02:40:06.205 DEBUG:teuthology.orchestra.run.smithi046:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-06T02:40:06.225 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=16287360k,nr_inodes=4071840,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,mode=755 0 0 tmpfs /sys/fs/cgroup tmpfs ro,seclabel,nosuid,nodev,noexec,mode=755 0 0 cgroup /sys/fs/cgroup/systemd cgroup rw,seclabel,nosuid,nodev,noexec,relatime,xattr,release_agent=/usr/lib/systemd/systemd-cgroups-agent,name=systemd 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 cgroup /sys/fs/cgroup/freezer cgroup rw,seclabel,nosuid,nodev,noexec,relatime,freezer 0 0 cgroup /sys/fs/cgroup/blkio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,blkio 0 0 cgroup /sys/fs/cgroup/hugetlb cgroup rw,seclabel,nosuid,nodev,noexec,relatime,hugetlb 0 0 cgroup /sys/fs/cgroup/net_cls,net_prio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,net_cls,net_prio 0 0 cgroup /sys/fs/cgroup/cpu,cpuacct cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpu,cpuacct 0 0 cgroup /sys/fs/cgroup/rdma cgroup rw,seclabel,nosuid,nodev,noexec,relatime,rdma 0 0 cgroup /sys/fs/cgroup/perf_event cgroup rw,seclabel,nosuid,nodev,noexec,relatime,perf_event 0 0 cgroup /sys/fs/cgroup/cpuset cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpuset 0 0 cgroup /sys/fs/cgroup/pids cgroup rw,seclabel,nosuid,nodev,noexec,relatime,pids 0 0 cgroup /sys/fs/cgroup/memory cgroup rw,seclabel,nosuid,nodev,noexec,relatime,memory 0 0 cgroup /sys/fs/cgroup/devices cgroup rw,seclabel,nosuid,nodev,noexec,relatime,devices 0 0 none /sys/kernel/tracing tracefs rw,seclabel,relatime 0 0 configfs /sys/kernel/config configfs rw,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=39,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=16105 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,relatime 0 0 mqueue /dev/mqueue mqueue rw,seclabel,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,relatime 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3261172k,mode=700,uid=1000,gid=1265 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw,seclabel 0 0 tmpfs /run/user/10101 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3261172k,mode=700,uid=10101,gid=10101 0 0 2023-07-06T02:40:06.226 DEBUG:teuthology.orchestra.run.smithi073:> set -ex 2023-07-06T02:40:06.226 DEBUG:teuthology.orchestra.run.smithi073:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-06T02:40:06.264 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=16284204k,nr_inodes=4071051,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,mode=755 0 0 tmpfs /sys/fs/cgroup tmpfs ro,seclabel,nosuid,nodev,noexec,mode=755 0 0 cgroup /sys/fs/cgroup/systemd cgroup rw,seclabel,nosuid,nodev,noexec,relatime,xattr,release_agent=/usr/lib/systemd/systemd-cgroups-agent,name=systemd 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 cgroup /sys/fs/cgroup/memory cgroup rw,seclabel,nosuid,nodev,noexec,relatime,memory 0 0 cgroup /sys/fs/cgroup/rdma cgroup rw,seclabel,nosuid,nodev,noexec,relatime,rdma 0 0 cgroup /sys/fs/cgroup/cpu,cpuacct cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpu,cpuacct 0 0 cgroup /sys/fs/cgroup/net_cls,net_prio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,net_cls,net_prio 0 0 cgroup /sys/fs/cgroup/pids cgroup rw,seclabel,nosuid,nodev,noexec,relatime,pids 0 0 cgroup /sys/fs/cgroup/perf_event cgroup rw,seclabel,nosuid,nodev,noexec,relatime,perf_event 0 0 cgroup /sys/fs/cgroup/freezer cgroup rw,seclabel,nosuid,nodev,noexec,relatime,freezer 0 0 cgroup /sys/fs/cgroup/hugetlb cgroup rw,seclabel,nosuid,nodev,noexec,relatime,hugetlb 0 0 cgroup /sys/fs/cgroup/cpuset cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpuset 0 0 cgroup /sys/fs/cgroup/devices cgroup rw,seclabel,nosuid,nodev,noexec,relatime,devices 0 0 cgroup /sys/fs/cgroup/blkio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,blkio 0 0 none /sys/kernel/tracing tracefs rw,seclabel,relatime 0 0 configfs /sys/kernel/config configfs rw,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=28,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=12193 0 0 mqueue /dev/mqueue mqueue rw,seclabel,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,relatime 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3260540k,mode=700,uid=1000,gid=1265 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw,seclabel 0 0 2023-07-06T02:40:06.265 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-06T02:40:06.469 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:06.466+0000 7f028a06c700 1 Processor -- start 2023-07-06T02:40:06.469 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:06.466+0000 7f028a06c700 1 -- start start 2023-07-06T02:40:06.470 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:06.467+0000 7f028a06c700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f02840d00b0 0x7f02840ac860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T02:40:06.471 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:06.467+0000 7f028a06c700 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f02840cf660 con 0x7f02840b4a20 2023-07-06T02:40:06.471 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:06.468+0000 7f028a06c700 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f02840b4750 con 0x7f0284069e00 2023-07-06T02:40:06.471 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:06.468+0000 7f028a06c700 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f02840b3460 con 0x7f02840d00b0 2023-07-06T02:40:06.471 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:06.468+0000 7f0282ffd700 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7f02840b4a20 0x7f028406a1d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:45078/0 (socket says 172.21.15.46:45078) 2023-07-06T02:40:06.471 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:06.468+0000 7f0282ffd700 1 -- 172.21.15.46:0/2386165615 learned_addr learned my addr 172.21.15.46:0/2386165615 (peer_addr_for_me v1:172.21.15.46:0/0) 2023-07-06T02:40:06.473 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:06.468+0000 7f02827fc700 1 -- 172.21.15.46:0/2386165615 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1733540743 0 0) 0x7f02840cf660 con 0x7f02840b4a20 2023-07-06T02:40:06.473 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:06.468+0000 7f02827fc700 1 -- 172.21.15.46:0/2386165615 --> v1:172.21.15.46:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f026c0035b0 con 0x7f02840b4a20 2023-07-06T02:40:06.473 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:06.468+0000 7f02827fc700 1 -- 172.21.15.46:0/2386165615 <== mon.1 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1957569992 0 0) 0x7f02840b4750 con 0x7f0284069e00 2023-07-06T02:40:06.473 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:06.468+0000 7f02827fc700 1 -- 172.21.15.46:0/2386165615 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f02840cf660 con 0x7f0284069e00 2023-07-06T02:40:06.473 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:06.468+0000 7f02827fc700 1 -- 172.21.15.46:0/2386165615 <== mon.0 v1:172.21.15.46:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 847496338 0 0) 0x7f026c0035b0 con 0x7f02840b4a20 2023-07-06T02:40:06.473 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:06.468+0000 7f02827fc700 1 -- 172.21.15.46:0/2386165615 >> v2:172.21.15.73:3300/0 conn(0x7f02840d00b0 msgr2=0x7f02840ac860 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-07-06T02:40:06.474 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:06.468+0000 7f02827fc700 1 --2- 172.21.15.46:0/2386165615 >> v2:172.21.15.73:3300/0 conn(0x7f02840d00b0 0x7f02840ac860 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T02:40:06.474 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:06.468+0000 7f02827fc700 1 -- 172.21.15.46:0/2386165615 >> v1:172.21.15.73:6789/0 conn(0x7f0284069e00 legacy=0x7f028406c7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T02:40:06.474 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:06.468+0000 7f02827fc700 1 -- 172.21.15.46:0/2386165615 --> v1:172.21.15.46:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f02840b3740 con 0x7f02840b4a20 2023-07-06T02:40:06.474 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:06.468+0000 7f02827fc700 1 -- 172.21.15.46:0/2386165615 <== mon.0 v1:172.21.15.46:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2195585215 0 0) 0x7f0278001670 con 0x7f02840b4a20 2023-07-06T02:40:06.474 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:06.468+0000 7f02827fc700 1 -- 172.21.15.46:0/2386165615 >> v1:172.21.15.46:6789/0 conn(0x7f02840b4a20 legacy=0x7f028406a1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T02:40:06.474 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:06.468+0000 7f02827fc700 1 --2- 172.21.15.46:0/2386165615 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f026c004bf0 0x7f026c004fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T02:40:06.474 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:06.469+0000 7f02827fc700 1 --2- 172.21.15.46:0/2386165615 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f026c0037f0 0x7f026c003c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T02:40:06.475 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:06.469+0000 7f02827fc700 1 --2- 172.21.15.46:0/2386165615 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f026c0042c0 0x7f026c00ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T02:40:06.475 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:06.469+0000 7f02827fc700 1 -- 172.21.15.46:0/2386165615 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02840b3460 con 0x7f026c0042c0 2023-07-06T02:40:06.475 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:06.469+0000 7f02827fc700 1 -- 172.21.15.46:0/2386165615 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f026c00c1e0 con 0x7f026c0037f0 2023-07-06T02:40:06.475 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:06.469+0000 7f02827fc700 1 -- 172.21.15.46:0/2386165615 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f026c00c3a0 con 0x7f026c004bf0 2023-07-06T02:40:06.475 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:06.469+0000 7f0282ffd700 1 --2- 172.21.15.46:0/2386165615 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f026c0037f0 0x7f026c003c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T02:40:06.475 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:06.469+0000 7f0282ffd700 1 -- 172.21.15.46:0/2386165615 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f026c004bf0 msgr2=0x7f026c004fe0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-07-06T02:40:06.475 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:06.469+0000 7f0282ffd700 1 --2- 172.21.15.46:0/2386165615 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f026c004bf0 0x7f026c004fe0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T02:40:06.475 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:06.469+0000 7f0282ffd700 1 -- 172.21.15.46:0/2386165615 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f026c0042c0 msgr2=0x7f026c00ba10 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-07-06T02:40:06.476 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:06.469+0000 7f0282ffd700 1 --2- 172.21.15.46:0/2386165615 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f026c0042c0 0x7f026c00ba10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T02:40:06.476 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:06.469+0000 7f0282ffd700 1 -- 172.21.15.46:0/2386165615 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f026c0035b0 con 0x7f026c0037f0 2023-07-06T02:40:06.476 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:06.469+0000 7f0282ffd700 1 --2- 172.21.15.46:0/2386165615 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f026c0037f0 0x7f026c003c60 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f027800c210 tx=0x7f026c005880 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ecd460f42304a798 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T02:40:06.476 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:06.470+0000 7f02827fc700 1 -- 172.21.15.46:0/2386165615 <== mon.1 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f027800cdb0 con 0x7f026c0037f0 2023-07-06T02:40:06.476 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:06.470+0000 7f02827fc700 1 -- 172.21.15.46:0/2386165615 <== mon.1 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0278005960 con 0x7f026c0037f0 2023-07-06T02:40:06.476 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:06.470+0000 7f02827fc700 1 -- 172.21.15.46:0/2386165615 <== mon.1 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0278005cf0 con 0x7f026c0037f0 2023-07-06T02:40:06.477 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:06.470+0000 7f028a06c700 1 -- 172.21.15.46:0/2386165615 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f026c0037f0 msgr2=0x7f026c003c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T02:40:06.477 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:06.470+0000 7f028a06c700 1 --2- 172.21.15.46:0/2386165615 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f026c0037f0 0x7f026c003c60 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f027800c210 tx=0x7f026c005880 comp rx=0 tx=0).stop 2023-07-06T02:40:06.477 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:06.472+0000 7f0283fff700 1 -- 172.21.15.46:0/2386165615 reap_dead start 2023-07-06T02:40:06.477 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:06.472+0000 7f0283fff700 1 -- 172.21.15.46:0/2386165615 reap_dead start 2023-07-06T02:40:06.478 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:06.472+0000 7f028a06c700 1 -- 172.21.15.46:0/2386165615 shutdown_connections 2023-07-06T02:40:06.478 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:06.472+0000 7f028a06c700 1 -- 172.21.15.46:0/2386165615 >> 172.21.15.46:0/2386165615 conn(0x7f028406af10 msgr2=0x7f028406b2e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T02:40:06.481 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:06.479+0000 7f028a06c700 1 -- 172.21.15.46:0/2386165615 shutdown_connections 2023-07-06T02:40:06.492 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:06.483+0000 7f028a06c700 1 -- 172.21.15.46:0/2386165615 wait complete. 2023-07-06T02:40:06.492 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:06.485+0000 7f028a06c700 1 Processor -- start 2023-07-06T02:40:06.492 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:06.486+0000 7f028a06c700 1 -- start start 2023-07-06T02:40:06.492 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:06.487+0000 7f028a06c700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f028408a7a0 0x7f028415dbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T02:40:06.492 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:06.487+0000 7f028a06c700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f028408ab70 0x7f0284206a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T02:40:06.493 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:06.487+0000 7f028a06c700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0284206fa0 0x7f028415e3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T02:40:06.493 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:06.487+0000 7f028a06c700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02842065d0 con 0x7f028408ab70 2023-07-06T02:40:06.493 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:06.487+0000 7f028a06c700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f028415e120 con 0x7f0284206fa0 2023-07-06T02:40:06.493 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:06.487+0000 7f028a06c700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f02841505a0 con 0x7f028408a7a0 2023-07-06T02:40:06.493 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:06.487+0000 7f02837fe700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f028408a7a0 0x7f028415dbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T02:40:06.493 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:06.487+0000 7f02837fe700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f028408a7a0 0x7f028415dbe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3301/0 says I am v2:172.21.15.46:57730/0 (socket says 172.21.15.46:57730) 2023-07-06T02:40:06.493 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:06.487+0000 7f02837fe700 1 -- 172.21.15.46:0/1764316670 learned_addr learned my addr 172.21.15.46:0/1764316670 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-07-06T02:40:06.494 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:06.487+0000 7f0283fff700 1 --2- 172.21.15.46:0/1764316670 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0284206fa0 0x7f028415e3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T02:40:06.494 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:06.488+0000 7f02837fe700 1 -- 172.21.15.46:0/1764316670 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0284206fa0 msgr2=0x7f028415e3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T02:40:06.494 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:06.488+0000 7f02837fe700 1 --2- 172.21.15.46:0/1764316670 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0284206fa0 0x7f028415e3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T02:40:06.494 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:06.488+0000 7f02837fe700 1 -- 172.21.15.46:0/1764316670 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f028408ab70 msgr2=0x7f0284206a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T02:40:06.494 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:06.488+0000 7f02837fe700 1 --2- 172.21.15.46:0/1764316670 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f028408ab70 0x7f0284206a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T02:40:06.494 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:06.488+0000 7f02837fe700 1 -- 172.21.15.46:0/1764316670 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0284150880 con 0x7f028408a7a0 2023-07-06T02:40:06.494 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:06.488+0000 7f0283fff700 1 --2- 172.21.15.46:0/1764316670 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0284206fa0 0x7f028415e3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-06T02:40:06.495 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:06.488+0000 7f02837fe700 1 --2- 172.21.15.46:0/1764316670 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f028408a7a0 0x7f028415dbe0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f027400c700 tx=0x7f027400ca10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T02:40:06.495 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:06.488+0000 7f026bfff700 1 -- 172.21.15.46:0/1764316670 <== mon.2 v2:172.21.15.73:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02740052d0 con 0x7f028408a7a0 2023-07-06T02:40:06.495 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:06.488+0000 7f026bfff700 1 -- 172.21.15.46:0/1764316670 <== mon.2 v2:172.21.15.73:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0274005450 con 0x7f028408a7a0 2023-07-06T02:40:06.495 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:06.488+0000 7f028a06c700 1 -- 172.21.15.46:0/1764316670 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0284150b60 con 0x7f028408a7a0 2023-07-06T02:40:06.495 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:06.488+0000 7f026bfff700 1 -- 172.21.15.46:0/1764316670 <== mon.2 v2:172.21.15.73:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02740038c0 con 0x7f028408a7a0 2023-07-06T02:40:06.495 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:06.488+0000 7f028a06c700 1 -- 172.21.15.46:0/1764316670 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0284151120 con 0x7f028408a7a0 2023-07-06T02:40:06.496 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:06.489+0000 7f028a06c700 1 -- 172.21.15.46:0/1764316670 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f02640052f0 con 0x7f028408a7a0 2023-07-06T02:40:06.496 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:06.491+0000 7f026bfff700 1 -- 172.21.15.46:0/1764316670 <== mon.2 v2:172.21.15.73:3301/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f0274003a20 con 0x7f028408a7a0 2023-07-06T02:40:06.496 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:06.491+0000 7f026bfff700 1 --2- 172.21.15.46:0/1764316670 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7f026c0b0b10 0x7f026c0b2fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T02:40:06.496 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:06.491+0000 7f026bfff700 1 -- 172.21.15.46:0/1764316670 <== mon.2 v2:172.21.15.73:3301/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 6091+0+0 (secure 0 0 0) 0x7f0274088c50 con 0x7f028408a7a0 2023-07-06T02:40:06.497 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:06.491+0000 7f0282ffd700 1 --2- 172.21.15.46:0/1764316670 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7f026c0b0b10 0x7f026c0b2fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T02:40:06.504 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:06.501+0000 7f026bfff700 1 -- 172.21.15.46:0/1764316670 <== mon.2 v2:172.21.15.73:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f0274053dc0 con 0x7f028408a7a0 2023-07-06T02:40:06.506 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:06.504+0000 7f0282ffd700 1 --2- 172.21.15.46:0/1764316670 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7f026c0b0b10 0x7f026c0b2fc0 secure :-1 s=READY pgs=715 cs=0 l=1 rev1=1 crypto rx=0x7f02840b4260 tx=0x7f027800f000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T02:40:06.874 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:06.872+0000 7f028a06c700 1 -- 172.21.15.46:0/1764316670 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f0264005870 con 0x7f028408a7a0 2023-07-06T02:40:06.875 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:06.872+0000 7f026bfff700 1 -- 172.21.15.46:0/1764316670 <== mon.2 v2:172.21.15.73:3301/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 15 v15) v1 ==== 94+0+4665 (secure 0 0 0) 0x7f02740573e0 con 0x7f028408a7a0 2023-07-06T02:40:06.875 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-06T02:40:06.876 INFO:teuthology.orchestra.run.smithi046.stdout:{"epoch":15,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4823,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.73:6837/1783526483","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6835","nonce":1783526483},{"type":"v1","addr":"172.21.15.73:6837","nonce":1783526483}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":4826,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.46:6834/1224451753","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6832","nonce":1224451753},{"type":"v1","addr":"172.21.15.46:6834","nonce":1224451753}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":4829,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.46:6835/549881285","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6833","nonce":549881285},{"type":"v1","addr":"172.21.15.46:6835","nonce":549881285}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":15,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-07-05T18:57:15.279563+0000","modified":"2023-07-05T18:57:18.286904+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5086},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5086":{"gid":5086,"name":"b","rank":0,"incarnation":12,"state":"up:active","state_seq":3,"addr":"172.21.15.73:6836/255434995","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6834","nonce":255434995},{"type":"v1","addr":"172.21.15.73:6836","nonce":255434995}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2023-07-06T02:40:06.884 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:06.882+0000 7f028a06c700 1 -- 172.21.15.46:0/1764316670 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7f026c0b0b10 msgr2=0x7f026c0b2fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T02:40:06.885 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:06.882+0000 7f028a06c700 1 --2- 172.21.15.46:0/1764316670 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7f026c0b0b10 0x7f026c0b2fc0 secure :-1 s=READY pgs=715 cs=0 l=1 rev1=1 crypto rx=0x7f02840b4260 tx=0x7f027800f000 comp rx=0 tx=0).stop 2023-07-06T02:40:06.885 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:06.882+0000 7f028a06c700 1 -- 172.21.15.46:0/1764316670 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f028408a7a0 msgr2=0x7f028415dbe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T02:40:06.885 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:06.882+0000 7f028a06c700 1 --2- 172.21.15.46:0/1764316670 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f028408a7a0 0x7f028415dbe0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f027400c700 tx=0x7f027400ca10 comp rx=0 tx=0).stop 2023-07-06T02:40:06.885 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:06.882+0000 7f028a06c700 1 -- 172.21.15.46:0/1764316670 shutdown_connections 2023-07-06T02:40:06.885 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:06.882+0000 7f028a06c700 1 --2- 172.21.15.46:0/1764316670 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7f026c0b0b10 0x7f026c0b2fc0 unknown :-1 s=CLOSED pgs=715 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T02:40:06.885 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:06.882+0000 7f028a06c700 1 --2- 172.21.15.46:0/1764316670 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0284206fa0 0x7f028415e3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T02:40:06.886 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:06.882+0000 7f028a06c700 1 --2- 172.21.15.46:0/1764316670 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f028408a7a0 0x7f028415dbe0 secure :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f027400c700 tx=0x7f027400ca10 comp rx=0 tx=0).stop 2023-07-06T02:40:06.886 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:06.882+0000 7f028a06c700 1 --2- 172.21.15.46:0/1764316670 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f028408ab70 0x7f0284206a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T02:40:06.886 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:06.882+0000 7f028a06c700 1 -- 172.21.15.46:0/1764316670 >> 172.21.15.46:0/1764316670 conn(0x7f028406af10 msgr2=0x7f028406b2e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T02:40:06.886 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:06.883+0000 7f028a06c700 1 -- 172.21.15.46:0/1764316670 shutdown_connections 2023-07-06T02:40:06.886 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:06.883+0000 7f028a06c700 1 -- 172.21.15.46:0/1764316670 wait complete. 2023-07-06T02:40:06.887 INFO:teuthology.orchestra.run.smithi046.stderr:dumped fsmap epoch 15 2023-07-06T02:40:06.908 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-06T02:40:07.106 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:07.103+0000 7f7934bba700 1 Processor -- start 2023-07-06T02:40:07.106 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:07.103+0000 7f7934bba700 1 -- start start 2023-07-06T02:40:07.107 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:07.104+0000 7f7934bba700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f793015b460 0x7f793015a7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T02:40:07.107 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:07.104+0000 7f7934bba700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f793015ddb0 0x7f79300cccf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T02:40:07.107 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:07.104+0000 7f7934bba700 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f79300ca9b0 con 0x7f793006d360 2023-07-06T02:40:07.107 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:07.104+0000 7f7934bba700 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f793006b5e0 con 0x7f793015ddb0 2023-07-06T02:40:07.107 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:07.104+0000 7f7934bba700 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f793015eda0 con 0x7f793015b460 2023-07-06T02:40:07.107 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:07.104+0000 7f792ed9d700 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7f793006d360 0x7f793006d770 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:45096/0 (socket says 172.21.15.46:45096) 2023-07-06T02:40:07.108 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:07.104+0000 7f792ed9d700 1 -- 172.21.15.46:0/3590276056 learned_addr learned my addr 172.21.15.46:0/3590276056 (peer_addr_for_me v1:172.21.15.46:0/0) 2023-07-06T02:40:07.108 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:07.104+0000 7f792dd9b700 1 --2- 172.21.15.46:0/3590276056 >> v2:172.21.15.46:3300/0 conn(0x7f793015ddb0 0x7f79300cccf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T02:40:07.108 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:07.104+0000 7f792e59c700 1 --2- 172.21.15.46:0/3590276056 >> v2:172.21.15.73:3300/0 conn(0x7f793015b460 0x7f793015a7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T02:40:07.108 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:07.104+0000 7f792e59c700 1 -- 172.21.15.46:0/3590276056 >> v2:172.21.15.46:3300/0 conn(0x7f793015ddb0 msgr2=0x7f79300cccf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T02:40:07.109 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:07.104+0000 7f792e59c700 1 --2- 172.21.15.46:0/3590276056 >> v2:172.21.15.46:3300/0 conn(0x7f793015ddb0 0x7f79300cccf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T02:40:07.109 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:07.104+0000 7f792e59c700 1 -- 172.21.15.46:0/3590276056 >> v1:172.21.15.46:6789/0 conn(0x7f793006d360 legacy=0x7f793006d770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T02:40:07.109 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:07.104+0000 7f792e59c700 1 -- 172.21.15.46:0/3590276056 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f79300ca680 con 0x7f793015b460 2023-07-06T02:40:07.109 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:07.104+0000 7f792d59a700 1 -- 172.21.15.46:0/3590276056 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1553670510 0 0) 0x7f79300ca9b0 con 0x7f793006d360 2023-07-06T02:40:07.109 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:07.104+0000 7f792dd9b700 1 --2- 172.21.15.46:0/3590276056 >> v2:172.21.15.46:3300/0 conn(0x7f793015ddb0 0x7f79300cccf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-06T02:40:07.109 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:07.105+0000 7f792e59c700 1 --2- 172.21.15.46:0/3590276056 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f793015b460 0x7f793015a7c0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f793006d0a0 tx=0x7f7920009b20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ddcfdf13fd412bcb server_cookie=0 in_seq=0 out_seq=0 2023-07-06T02:40:07.111 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:07.108+0000 7f792d59a700 1 -- 172.21.15.46:0/3590276056 <== mon.1 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7920010a90 con 0x7f793015b460 2023-07-06T02:40:07.111 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:07.108+0000 7f792d59a700 1 -- 172.21.15.46:0/3590276056 <== mon.1 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7920010bf0 con 0x7f793015b460 2023-07-06T02:40:07.111 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:07.108+0000 7f792d59a700 1 -- 172.21.15.46:0/3590276056 <== mon.1 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7920018440 con 0x7f793015b460 2023-07-06T02:40:07.111 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:07.109+0000 7f7934bba700 1 -- 172.21.15.46:0/3590276056 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f793015b460 msgr2=0x7f793015a7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T02:40:07.111 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:07.109+0000 7f7934bba700 1 --2- 172.21.15.46:0/3590276056 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f793015b460 0x7f793015a7c0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f793006d0a0 tx=0x7f7920009b20 comp rx=0 tx=0).stop 2023-07-06T02:40:07.112 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:07.110+0000 7f7934bba700 1 -- 172.21.15.46:0/3590276056 shutdown_connections 2023-07-06T02:40:07.112 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:07.110+0000 7f7934bba700 1 --2- 172.21.15.46:0/3590276056 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f793015b460 0x7f793015a7c0 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T02:40:07.113 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:07.110+0000 7f7934bba700 1 --2- 172.21.15.46:0/3590276056 >> v2:172.21.15.46:3300/0 conn(0x7f793015ddb0 0x7f79300cccf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T02:40:07.113 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:07.110+0000 7f7934bba700 1 -- 172.21.15.46:0/3590276056 >> 172.21.15.46:0/3590276056 conn(0x7f79300cbba0 msgr2=0x7f79300cbf70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T02:40:07.115 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:07.113+0000 7f7934bba700 1 -- 172.21.15.46:0/3590276056 shutdown_connections 2023-07-06T02:40:07.115 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:07.113+0000 7f7934bba700 1 -- 172.21.15.46:0/3590276056 wait complete. 2023-07-06T02:40:07.117 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:07.114+0000 7f7934bba700 1 Processor -- start 2023-07-06T02:40:07.117 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:07.114+0000 7f7934bba700 1 -- start start 2023-07-06T02:40:07.119 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:07.115+0000 7f7934bba700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f793006d360 0x7f79300c87a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T02:40:07.119 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:07.115+0000 7f7934bba700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f793015b460 0x7f79300c61f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T02:40:07.119 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:07.115+0000 7f7934bba700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f793015ddb0 0x7f79300c6730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T02:40:07.119 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:07.115+0000 7f7934bba700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79300c7f50 con 0x7f793015ddb0 2023-07-06T02:40:07.119 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:07.115+0000 7f7934bba700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79300c6c70 con 0x7f793015b460 2023-07-06T02:40:07.120 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:07.115+0000 7f7934bba700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f79300c6eb0 con 0x7f793006d360 2023-07-06T02:40:07.120 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:07.115+0000 7f792ed9d700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f793015ddb0 0x7f79300c6730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T02:40:07.120 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:07.115+0000 7f792ed9d700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f793015ddb0 0x7f79300c6730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:45830/0 (socket says 172.21.15.46:45830) 2023-07-06T02:40:07.120 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:07.115+0000 7f792dd9b700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f793015b460 0x7f79300c61f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T02:40:07.120 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:07.115+0000 7f792ed9d700 1 -- 172.21.15.46:0/1709777504 learned_addr learned my addr 172.21.15.46:0/1709777504 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-07-06T02:40:07.120 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:07.115+0000 7f792e59c700 1 --2- 172.21.15.46:0/1709777504 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f793006d360 0x7f79300c87a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T02:40:07.121 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:07.116+0000 7f792dd9b700 1 -- 172.21.15.46:0/1709777504 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f793006d360 msgr2=0x7f79300c87a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T02:40:07.121 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:07.116+0000 7f792dd9b700 1 --2- 172.21.15.46:0/1709777504 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f793006d360 0x7f79300c87a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T02:40:07.121 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:07.116+0000 7f792dd9b700 1 -- 172.21.15.46:0/1709777504 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f793015ddb0 msgr2=0x7f79300c6730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T02:40:07.121 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:07.116+0000 7f792dd9b700 1 --2- 172.21.15.46:0/1709777504 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f793015ddb0 0x7f79300c6730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T02:40:07.121 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:07.116+0000 7f792dd9b700 1 -- 172.21.15.46:0/1709777504 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f79240094a0 con 0x7f793015b460 2023-07-06T02:40:07.121 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:07.116+0000 7f792e59c700 1 --2- 172.21.15.46:0/1709777504 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f793006d360 0x7f79300c87a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-06T02:40:07.123 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:07.120+0000 7f792dd9b700 1 --2- 172.21.15.46:0/1709777504 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f793015b460 0x7f79300c61f0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f792400e930 tx=0x7f792400ec40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T02:40:07.124 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:07.121+0000 7f791effd700 1 -- 172.21.15.46:0/1709777504 <== mon.1 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7924013680 con 0x7f793015b460 2023-07-06T02:40:07.124 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:07.121+0000 7f791effd700 1 -- 172.21.15.46:0/1709777504 <== mon.1 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f79240137e0 con 0x7f793015b460 2023-07-06T02:40:07.124 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:07.121+0000 7f791effd700 1 -- 172.21.15.46:0/1709777504 <== mon.1 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7924013b90 con 0x7f793015b460 2023-07-06T02:40:07.125 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:07.123+0000 7f7934bba700 1 -- 172.21.15.46:0/1709777504 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f79200094a0 con 0x7f793015b460 2023-07-06T02:40:07.126 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:07.123+0000 7f7934bba700 1 -- 172.21.15.46:0/1709777504 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f79300c7470 con 0x7f793015b460 2023-07-06T02:40:07.127 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:07.125+0000 7f791effd700 1 -- 172.21.15.46:0/1709777504 <== mon.1 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f7924013cf0 con 0x7f793015b460 2023-07-06T02:40:07.128 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:07.125+0000 7f791effd700 1 --2- 172.21.15.46:0/1709777504 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7f791006ace0 0x7f791006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T02:40:07.128 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:07.125+0000 7f791effd700 1 -- 172.21.15.46:0/1709777504 <== mon.1 v2:172.21.15.73:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 6091+0+0 (secure 0 0 0) 0x7f79240893d0 con 0x7f793015b460 2023-07-06T02:40:07.129 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:07.126+0000 7f792e59c700 1 --2- 172.21.15.46:0/1709777504 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7f791006ace0 0x7f791006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T02:40:07.129 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:07.126+0000 7f792e59c700 1 --2- 172.21.15.46:0/1709777504 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7f791006ace0 0x7f791006d190 secure :-1 s=READY pgs=716 cs=0 l=1 rev1=1 crypto rx=0x7f79200090b0 tx=0x7f7920014000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T02:40:07.129 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:07.126+0000 7f7934bba700 1 -- 172.21.15.46:0/1709777504 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f79300672e0 con 0x7f793015b460 2023-07-06T02:40:07.135 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:07.132+0000 7f791effd700 1 -- 172.21.15.46:0/1709777504 <== mon.1 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f7924054440 con 0x7f793015b460 2023-07-06T02:40:07.462 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:07.459+0000 7f7934bba700 1 -- 172.21.15.46:0/1709777504 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f793006b090 con 0x7f793015b460 2023-07-06T02:40:07.463 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:07.460+0000 7f791effd700 1 -- 172.21.15.46:0/1709777504 <== mon.1 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v37) v1 ==== 74+0+18226 (secure 0 0 0) 0x7f7924021070 con 0x7f793015b460 2023-07-06T02:40:07.463 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-06T02:40:07.464 INFO:teuthology.orchestra.run.smithi046.stdout:{"epoch":37,"fsid":"042652d3-d80c-4ad8-9366-3e94f2a0a512","created":"2023-07-05T18:55:56.455710+0000","modified":"2023-07-05T18:58:04.356432+0000","last_up_change":"2023-07-05T18:56:06.594022+0000","last_in_change":"2023-07-05T18:55:58.879340+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-07-05T18:56:07.729620+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2023-07-05T18:56:08.128122+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2023-07-05T18:57:13.640396+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"34","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_data","create_time":"2023-07-05T18:57:14.333267+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"35","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"20009183-9a47-4392-8751-883f88d2bfb1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6813","nonce":4151971443},{"type":"v1","addr":"172.21.15.46:6815","nonce":4151971443}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6817","nonce":4151971443},{"type":"v1","addr":"172.21.15.46:6818","nonce":4151971443}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6822","nonce":4151971443},{"type":"v1","addr":"172.21.15.46:6823","nonce":4151971443}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6820","nonce":4151971443},{"type":"v1","addr":"172.21.15.46:6821","nonce":4151971443}]},"public_addr":"172.21.15.46:6815/4151971443","cluster_addr":"172.21.15.46:6818/4151971443","heartbeat_back_addr":"172.21.15.46:6823/4151971443","heartbeat_front_addr":"172.21.15.46:6821/4151971443","state":["exists","up"]},{"osd":1,"uuid":"91b4a7b0-e4e4-4888-a1fe-9edb0d68004c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6808","nonce":502575881},{"type":"v1","addr":"172.21.15.46:6809","nonce":502575881}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6810","nonce":502575881},{"type":"v1","addr":"172.21.15.46:6811","nonce":502575881}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6816","nonce":502575881},{"type":"v1","addr":"172.21.15.46:6819","nonce":502575881}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6812","nonce":502575881},{"type":"v1","addr":"172.21.15.46:6814","nonce":502575881}]},"public_addr":"172.21.15.46:6809/502575881","cluster_addr":"172.21.15.46:6811/502575881","heartbeat_back_addr":"172.21.15.46:6819/502575881","heartbeat_front_addr":"172.21.15.46:6814/502575881","state":["exists","up"]},{"osd":2,"uuid":"669ff744-1331-47c5-8579-0440731c889a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6800","nonce":2115251461},{"type":"v1","addr":"172.21.15.46:6801","nonce":2115251461}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6802","nonce":2115251461},{"type":"v1","addr":"172.21.15.46:6803","nonce":2115251461}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6806","nonce":2115251461},{"type":"v1","addr":"172.21.15.46:6807","nonce":2115251461}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6804","nonce":2115251461},{"type":"v1","addr":"172.21.15.46:6805","nonce":2115251461}]},"public_addr":"172.21.15.46:6801/2115251461","cluster_addr":"172.21.15.46:6803/2115251461","heartbeat_back_addr":"172.21.15.46:6807/2115251461","heartbeat_front_addr":"172.21.15.46:6805/2115251461","state":["exists","up"]},{"osd":3,"uuid":"34e1b86d-ffad-415d-861c-07a5f08068a6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6824","nonce":2981388766},{"type":"v1","addr":"172.21.15.46:6825","nonce":2981388766}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6826","nonce":2981388766},{"type":"v1","addr":"172.21.15.46:6827","nonce":2981388766}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6830","nonce":2981388766},{"type":"v1","addr":"172.21.15.46:6831","nonce":2981388766}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6828","nonce":2981388766},{"type":"v1","addr":"172.21.15.46:6829","nonce":2981388766}]},"public_addr":"172.21.15.46:6825/2981388766","cluster_addr":"172.21.15.46:6827/2981388766","heartbeat_back_addr":"172.21.15.46:6831/2981388766","heartbeat_front_addr":"172.21.15.46:6829/2981388766","state":["exists","up"]},{"osd":4,"uuid":"57ffcb91-c7dc-4a69-ae71-4d9622a14a05","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6800","nonce":2083655348},{"type":"v1","addr":"172.21.15.73:6801","nonce":2083655348}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6802","nonce":2083655348},{"type":"v1","addr":"172.21.15.73:6803","nonce":2083655348}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6806","nonce":2083655348},{"type":"v1","addr":"172.21.15.73:6807","nonce":2083655348}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6804","nonce":2083655348},{"type":"v1","addr":"172.21.15.73:6805","nonce":2083655348}]},"public_addr":"172.21.15.73:6801/2083655348","cluster_addr":"172.21.15.73:6803/2083655348","heartbeat_back_addr":"172.21.15.73:6807/2083655348","heartbeat_front_addr":"172.21.15.73:6805/2083655348","state":["exists","up"]},{"osd":5,"uuid":"665f41c9-ee20-49cf-bf0e-fbe0c03d3aed","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6824","nonce":2803788401},{"type":"v1","addr":"172.21.15.73:6825","nonce":2803788401}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6826","nonce":2803788401},{"type":"v1","addr":"172.21.15.73:6827","nonce":2803788401}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6830","nonce":2803788401},{"type":"v1","addr":"172.21.15.73:6831","nonce":2803788401}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6828","nonce":2803788401},{"type":"v1","addr":"172.21.15.73:6829","nonce":2803788401}]},"public_addr":"172.21.15.73:6825/2803788401","cluster_addr":"172.21.15.73:6827/2803788401","heartbeat_back_addr":"172.21.15.73:6831/2803788401","heartbeat_front_addr":"172.21.15.73:6829/2803788401","state":["exists","up"]},{"osd":6,"uuid":"5790c6cc-bd56-4ce4-9a7c-0f0c3b59215c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6808","nonce":974108383},{"type":"v1","addr":"172.21.15.73:6809","nonce":974108383}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6810","nonce":974108383},{"type":"v1","addr":"172.21.15.73:6811","nonce":974108383}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6815","nonce":974108383},{"type":"v1","addr":"172.21.15.73:6817","nonce":974108383}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6812","nonce":974108383},{"type":"v1","addr":"172.21.15.73:6813","nonce":974108383}]},"public_addr":"172.21.15.73:6809/974108383","cluster_addr":"172.21.15.73:6811/974108383","heartbeat_back_addr":"172.21.15.73:6817/974108383","heartbeat_front_addr":"172.21.15.73:6813/974108383","state":["exists","up"]},{"osd":7,"uuid":"b66f4d2e-147e-4c9b-97dd-cbd59d33802e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6814","nonce":3772673248},{"type":"v1","addr":"172.21.15.73:6816","nonce":3772673248}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6818","nonce":3772673248},{"type":"v1","addr":"172.21.15.73:6819","nonce":3772673248}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6822","nonce":3772673248},{"type":"v1","addr":"172.21.15.73:6823","nonce":3772673248}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6820","nonce":3772673248},{"type":"v1","addr":"172.21.15.73:6821","nonce":3772673248}]},"public_addr":"172.21.15.73:6816/3772673248","cluster_addr":"172.21.15.73:6819/3772673248","heartbeat_back_addr":"172.21.15.73:6823/3772673248","heartbeat_front_addr":"172.21.15.73:6821/3772673248","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-05T18:56:04.115334+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-05T18:56:04.071250+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-05T18:56:04.044387+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-05T18:56:04.085389+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-05T18:56:04.090726+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-05T18:56:04.074529+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-05T18:56:04.058841+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-05T18:56:04.043054+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"6.24","mappings":[{"from":5,"to":0}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-06T02:40:07.467 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:07.464+0000 7f7934bba700 1 -- 172.21.15.46:0/1709777504 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7f791006ace0 msgr2=0x7f791006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T02:40:07.467 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:07.464+0000 7f7934bba700 1 --2- 172.21.15.46:0/1709777504 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7f791006ace0 0x7f791006d190 secure :-1 s=READY pgs=716 cs=0 l=1 rev1=1 crypto rx=0x7f79200090b0 tx=0x7f7920014000 comp rx=0 tx=0).stop 2023-07-06T02:40:07.468 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:07.464+0000 7f7934bba700 1 -- 172.21.15.46:0/1709777504 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f793015b460 msgr2=0x7f79300c61f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T02:40:07.468 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:07.464+0000 7f7934bba700 1 --2- 172.21.15.46:0/1709777504 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f793015b460 0x7f79300c61f0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f792400e930 tx=0x7f792400ec40 comp rx=0 tx=0).stop 2023-07-06T02:40:07.469 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:07.466+0000 7f7934bba700 1 -- 172.21.15.46:0/1709777504 shutdown_connections 2023-07-06T02:40:07.469 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:07.466+0000 7f7934bba700 1 --2- 172.21.15.46:0/1709777504 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7f791006ace0 0x7f791006d190 secure :-1 s=CLOSED pgs=716 cs=0 l=1 rev1=1 crypto rx=0x7f79200090b0 tx=0x7f7920014000 comp rx=0 tx=0).stop 2023-07-06T02:40:07.469 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:07.466+0000 7f7934bba700 1 --2- 172.21.15.46:0/1709777504 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f793015ddb0 0x7f79300c6730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T02:40:07.469 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:07.466+0000 7f7934bba700 1 --2- 172.21.15.46:0/1709777504 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f793006d360 0x7f79300c87a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T02:40:07.469 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:07.466+0000 7f7934bba700 1 --2- 172.21.15.46:0/1709777504 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f793015b460 0x7f79300c61f0 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T02:40:07.470 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:07.466+0000 7f7934bba700 1 -- 172.21.15.46:0/1709777504 >> 172.21.15.46:0/1709777504 conn(0x7f79300cbba0 msgr2=0x7f793015bb60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T02:40:07.470 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:07.468+0000 7f7934bba700 1 -- 172.21.15.46:0/1709777504 shutdown_connections 2023-07-06T02:40:07.471 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:07.468+0000 7f7934bba700 1 -- 172.21.15.46:0/1709777504 wait complete. 2023-07-06T02:40:07.492 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'rbd', 'create_time': '2023-07-05T18:56:07.729620+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': '.mgr', 'create_time': '2023-07-05T18:56:08.128122+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_metadata', 'create_time': '2023-07-05T18:57:13.640396+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '34', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.25, 'score_stable': 1.25, 'optimal_score': 1, 'raw_score_acting': 1.25, 'raw_score_stable': 1.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 6, 'pool_name': 'cephfs_data', 'create_time': '2023-07-05T18:57:14.333267+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '35', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.25, 'score_stable': 1.25, 'optimal_score': 1, 'raw_score_acting': 1.25, 'raw_score_stable': 1.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-07-06T02:40:07.493 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-07-06T02:40:07.702 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:07.697+0000 7fa79eb1c700 1 Processor -- start 2023-07-06T02:40:07.702 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:07.697+0000 7fa79eb1c700 1 -- start start 2023-07-06T02:40:07.702 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:07.698+0000 7fa79eb1c700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fa7980b13f0 0x7fa7980b1840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T02:40:07.703 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:07.698+0000 7fa79eb1c700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fa7980c9fc0 0x7fa7980ca3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T02:40:07.703 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:07.698+0000 7fa79eb1c700 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa79815e040 con 0x7fa7981594f0 2023-07-06T02:40:07.703 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:07.698+0000 7fa79eb1c700 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa7980ce200 con 0x7fa7980c9fc0 2023-07-06T02:40:07.703 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:07.698+0000 7fa79eb1c700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa7980b1d80 con 0x7fa7980b13f0 2023-07-06T02:40:07.703 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:07.698+0000 7fa79c8b8700 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7fa7981594f0 0x7fa7980cd690 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:45106/0 (socket says 172.21.15.46:45106) 2023-07-06T02:40:07.704 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:07.698+0000 7fa79c8b8700 1 -- 172.21.15.46:0/3999100649 learned_addr learned my addr 172.21.15.46:0/3999100649 (peer_addr_for_me v1:172.21.15.46:0/0) 2023-07-06T02:40:07.704 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:07.698+0000 7fa79d0b9700 1 --2- 172.21.15.46:0/3999100649 >> v2:172.21.15.73:3300/0 conn(0x7fa7980c9fc0 0x7fa7980ca3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T02:40:07.704 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:07.699+0000 7fa7977fe700 1 -- 172.21.15.46:0/3999100649 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2206912508 0 0) 0x7fa79815e040 con 0x7fa7981594f0 2023-07-06T02:40:07.705 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:07.699+0000 7fa7977fe700 1 -- 172.21.15.46:0/3999100649 --> v1:172.21.15.46:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa7880035b0 con 0x7fa7981594f0 2023-07-06T02:40:07.705 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:07.699+0000 7fa7977fe700 1 -- 172.21.15.46:0/3999100649 <== mon.0 v1:172.21.15.46:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 840483910 0 0) 0x7fa7880035b0 con 0x7fa7981594f0 2023-07-06T02:40:07.705 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:07.699+0000 7fa7977fe700 1 -- 172.21.15.46:0/3999100649 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fa7980b13f0 msgr2=0x7fa7980b1840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T02:40:07.706 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:07.699+0000 7fa7977fe700 1 --2- 172.21.15.46:0/3999100649 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fa7980b13f0 0x7fa7980b1840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T02:40:07.706 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:07.699+0000 7fa7977fe700 1 -- 172.21.15.46:0/3999100649 >> v2:172.21.15.73:3300/0 conn(0x7fa7980c9fc0 msgr2=0x7fa7980ca3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T02:40:07.706 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:07.699+0000 7fa7977fe700 1 --2- 172.21.15.46:0/3999100649 >> v2:172.21.15.73:3300/0 conn(0x7fa7980c9fc0 0x7fa7980ca3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T02:40:07.706 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:07.699+0000 7fa7977fe700 1 -- 172.21.15.46:0/3999100649 --> v1:172.21.15.46:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa79815dbb0 con 0x7fa7981594f0 2023-07-06T02:40:07.707 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:07.699+0000 7fa7977fe700 1 -- 172.21.15.46:0/3999100649 <== mon.0 v1:172.21.15.46:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2195585215 0 0) 0x7fa784001670 con 0x7fa7981594f0 2023-07-06T02:40:07.707 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:07.699+0000 7fa7977fe700 1 -- 172.21.15.46:0/3999100649 >> v1:172.21.15.46:6789/0 conn(0x7fa7981594f0 legacy=0x7fa7980cd690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T02:40:07.707 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:07.699+0000 7fa7977fe700 1 --2- 172.21.15.46:0/3999100649 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa788003a00 0x7fa788003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T02:40:07.708 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:07.699+0000 7fa7977fe700 1 --2- 172.21.15.46:0/3999100649 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa788004850 0x7fa788004cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T02:40:07.708 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:07.699+0000 7fa7977fe700 1 --2- 172.21.15.46:0/3999100649 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fa7980b13f0 0x7fa788005200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T02:40:07.708 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:07.699+0000 7fa7977fe700 1 -- 172.21.15.46:0/3999100649 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa7980ce200 con 0x7fa788003a00 2023-07-06T02:40:07.709 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:07.699+0000 7fa7977fe700 1 -- 172.21.15.46:0/3999100649 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa7980b1d80 con 0x7fa788004850 2023-07-06T02:40:07.709 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:07.699+0000 7fa7977fe700 1 -- 172.21.15.46:0/3999100649 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa788009ab0 con 0x7fa7980b13f0 2023-07-06T02:40:07.709 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:07.699+0000 7fa79c8b8700 1 --2- 172.21.15.46:0/3999100649 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa788003a00 0x7fa788003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T02:40:07.713 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:07.700+0000 7fa79c8b8700 1 -- 172.21.15.46:0/3999100649 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fa7980b13f0 msgr2=0x7fa788005200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T02:40:07.713 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:07.700+0000 7fa79c8b8700 1 --2- 172.21.15.46:0/3999100649 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fa7980b13f0 0x7fa788005200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T02:40:07.713 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:07.700+0000 7fa79c8b8700 1 -- 172.21.15.46:0/3999100649 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa788004850 msgr2=0x7fa788004cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T02:40:07.714 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:07.700+0000 7fa79c8b8700 1 --2- 172.21.15.46:0/3999100649 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa788004850 0x7fa788004cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T02:40:07.714 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:07.700+0000 7fa79c8b8700 1 -- 172.21.15.46:0/3999100649 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa7880035b0 con 0x7fa788003a00 2023-07-06T02:40:07.714 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:07.700+0000 7fa79c8b8700 1 --2- 172.21.15.46:0/3999100649 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa788003a00 0x7fa788003e10 secure :-1 s=READY pgs=3213 cs=0 l=1 rev1=1 crypto rx=0x7fa78400c2f0 tx=0x7fa788005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ce5c1f7fcac2ff2a server_cookie=0 in_seq=0 out_seq=0 2023-07-06T02:40:07.714 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:07.700+0000 7fa7977fe700 1 -- 172.21.15.46:0/3999100649 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa784007c40 con 0x7fa788003a00 2023-07-06T02:40:07.715 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:07.700+0000 7fa7977fe700 1 -- 172.21.15.46:0/3999100649 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa78400ce30 con 0x7fa788003a00 2023-07-06T02:40:07.715 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:07.700+0000 7fa7977fe700 1 -- 172.21.15.46:0/3999100649 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa784005ba0 con 0x7fa788003a00 2023-07-06T02:40:07.715 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:07.701+0000 7fa79eb1c700 1 -- 172.21.15.46:0/3999100649 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa788003a00 msgr2=0x7fa788003e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T02:40:07.715 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:07.701+0000 7fa79eb1c700 1 --2- 172.21.15.46:0/3999100649 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa788003a00 0x7fa788003e10 secure :-1 s=READY pgs=3213 cs=0 l=1 rev1=1 crypto rx=0x7fa78400c2f0 tx=0x7fa788005880 comp rx=0 tx=0).stop 2023-07-06T02:40:07.715 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:07.701+0000 7fa79d0b9700 1 -- 172.21.15.46:0/3999100649 reap_dead start 2023-07-06T02:40:07.715 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:07.701+0000 7fa79eb1c700 1 -- 172.21.15.46:0/3999100649 shutdown_connections 2023-07-06T02:40:07.716 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:07.701+0000 7fa79eb1c700 1 -- 172.21.15.46:0/3999100649 >> 172.21.15.46:0/3999100649 conn(0x7fa79806bba0 msgr2=0x7fa7980cc3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T02:40:07.716 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:07.701+0000 7fa79eb1c700 1 -- 172.21.15.46:0/3999100649 shutdown_connections 2023-07-06T02:40:07.716 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:07.701+0000 7fa79eb1c700 1 -- 172.21.15.46:0/3999100649 wait complete. 2023-07-06T02:40:07.716 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:07.702+0000 7fa79eb1c700 1 Processor -- start 2023-07-06T02:40:07.716 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:07.703+0000 7fa79eb1c700 1 -- start start 2023-07-06T02:40:07.716 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:07.703+0000 7fa79eb1c700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa788003a00 0x7fa7980b51c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T02:40:07.716 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:07.703+0000 7fa79eb1c700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa7981445b0 0x7fa7980ca5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T02:40:07.717 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:07.703+0000 7fa79eb1c700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fa7980cab20 0x7fa7980c54b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T02:40:07.717 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:07.703+0000 7fa79eb1c700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa7981581e0 con 0x7fa788003a00 2023-07-06T02:40:07.717 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:07.703+0000 7fa79eb1c700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa7980b5700 con 0x7fa7981445b0 2023-07-06T02:40:07.717 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:07.703+0000 7fa79eb1c700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa7980caf90 con 0x7fa7980cab20 2023-07-06T02:40:07.717 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:07.704+0000 7fa79c8b8700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa788003a00 0x7fa7980b51c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T02:40:07.717 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:07.704+0000 7fa797fff700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa7981445b0 0x7fa7980ca5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T02:40:07.717 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:07.704+0000 7fa797fff700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa7981445b0 0x7fa7980ca5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.46:45332/0 (socket says 172.21.15.46:45332) 2023-07-06T02:40:07.717 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:07.704+0000 7fa797fff700 1 -- 172.21.15.46:0/94342507 learned_addr learned my addr 172.21.15.46:0/94342507 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-07-06T02:40:07.718 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:07.704+0000 7fa79d0b9700 1 --2- 172.21.15.46:0/94342507 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fa7980cab20 0x7fa7980c54b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T02:40:07.718 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:07.704+0000 7fa79c8b8700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa788003a00 0x7fa7980b51c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:45846/0 (socket says 172.21.15.46:45846) 2023-07-06T02:40:07.718 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:07.704+0000 7fa79c8b8700 1 -- 172.21.15.46:0/94342507 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fa7980cab20 msgr2=0x7fa7980c54b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T02:40:07.718 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:07.704+0000 7fa79c8b8700 1 --2- 172.21.15.46:0/94342507 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fa7980cab20 0x7fa7980c54b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T02:40:07.718 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:07.704+0000 7fa79c8b8700 1 -- 172.21.15.46:0/94342507 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa7981445b0 msgr2=0x7fa7980ca5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T02:40:07.718 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:07.704+0000 7fa79c8b8700 1 --2- 172.21.15.46:0/94342507 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa7981445b0 0x7fa7980ca5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T02:40:07.718 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:07.704+0000 7fa79c8b8700 1 -- 172.21.15.46:0/94342507 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa798157d50 con 0x7fa788003a00 2023-07-06T02:40:07.719 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:07.705+0000 7fa79c8b8700 1 --2- 172.21.15.46:0/94342507 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa788003a00 0x7fa7980b51c0 secure :-1 s=READY pgs=3214 cs=0 l=1 rev1=1 crypto rx=0x7fa784001050 tx=0x7fa7980cec70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T02:40:07.719 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:07.705+0000 7fa7957fa700 1 -- 172.21.15.46:0/94342507 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7840072d0 con 0x7fa788003a00 2023-07-06T02:40:07.719 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:07.705+0000 7fa79eb1c700 1 -- 172.21.15.46:0/94342507 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa798157140 con 0x7fa788003a00 2023-07-06T02:40:07.719 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:07.705+0000 7fa7957fa700 1 -- 172.21.15.46:0/94342507 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa784007450 con 0x7fa788003a00 2023-07-06T02:40:07.719 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:07.705+0000 7fa7957fa700 1 -- 172.21.15.46:0/94342507 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa784007800 con 0x7fa788003a00 2023-07-06T02:40:07.719 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:07.705+0000 7fa79eb1c700 1 -- 172.21.15.46:0/94342507 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa798157700 con 0x7fa788003a00 2023-07-06T02:40:07.719 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:07.708+0000 7fa7957fa700 1 -- 172.21.15.46:0/94342507 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fa78401e430 con 0x7fa788003a00 2023-07-06T02:40:07.720 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:07.708+0000 7fa79eb1c700 1 -- 172.21.15.46:0/94342507 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa7980672e0 con 0x7fa788003a00 2023-07-06T02:40:07.720 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:07.708+0000 7fa7957fa700 1 --2- 172.21.15.46:0/94342507 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7fa77c06ace0 0x7fa77c06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T02:40:07.720 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:07.708+0000 7fa7957fa700 1 -- 172.21.15.46:0/94342507 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 6091+0+0 (secure 0 0 0) 0x7fa78408a950 con 0x7fa788003a00 2023-07-06T02:40:07.721 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:07.714+0000 7fa7957fa700 1 -- 172.21.15.46:0/94342507 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fa784055b00 con 0x7fa788003a00 2023-07-06T02:40:07.721 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:07.715+0000 7fa797fff700 1 --2- 172.21.15.46:0/94342507 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7fa77c06ace0 0x7fa77c06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T02:40:07.721 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:07.716+0000 7fa797fff700 1 --2- 172.21.15.46:0/94342507 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7fa77c06ace0 0x7fa77c06d190 secure :-1 s=READY pgs=717 cs=0 l=1 rev1=1 crypto rx=0x7fa7980b02a0 tx=0x7fa78c008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T02:40:08.051 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:08.048+0000 7fa79eb1c700 1 -- 172.21.15.46:0/94342507 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fa7980cd210 con 0x7fa788003a00 2023-07-06T02:40:08.051 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:08.048+0000 7fa7957fa700 1 -- 172.21.15.46:0/94342507 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v37) v1 ==== 92+0+10 (secure 0 0 0) 0x7fa784059120 con 0x7fa788003a00 2023-07-06T02:40:08.052 INFO:teuthology.orchestra.run.smithi046.stdout:pg_num: 8 2023-07-06T02:40:08.056 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:08.053+0000 7fa79eb1c700 1 -- 172.21.15.46:0/94342507 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7fa77c06ace0 msgr2=0x7fa77c06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T02:40:08.056 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:08.053+0000 7fa79eb1c700 1 --2- 172.21.15.46:0/94342507 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7fa77c06ace0 0x7fa77c06d190 secure :-1 s=READY pgs=717 cs=0 l=1 rev1=1 crypto rx=0x7fa7980b02a0 tx=0x7fa78c008040 comp rx=0 tx=0).stop 2023-07-06T02:40:08.057 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:08.053+0000 7fa79eb1c700 1 -- 172.21.15.46:0/94342507 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa788003a00 msgr2=0x7fa7980b51c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T02:40:08.057 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:08.053+0000 7fa79eb1c700 1 --2- 172.21.15.46:0/94342507 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa788003a00 0x7fa7980b51c0 secure :-1 s=READY pgs=3214 cs=0 l=1 rev1=1 crypto rx=0x7fa784001050 tx=0x7fa7980cec70 comp rx=0 tx=0).stop 2023-07-06T02:40:08.062 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:08.059+0000 7fa79eb1c700 1 -- 172.21.15.46:0/94342507 shutdown_connections 2023-07-06T02:40:08.062 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:08.059+0000 7fa79eb1c700 1 --2- 172.21.15.46:0/94342507 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7fa77c06ace0 0x7fa77c06d190 unknown :-1 s=CLOSED pgs=717 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T02:40:08.062 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:08.059+0000 7fa79eb1c700 1 --2- 172.21.15.46:0/94342507 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fa7980cab20 0x7fa7980c54b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T02:40:08.063 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:08.059+0000 7fa79eb1c700 1 --2- 172.21.15.46:0/94342507 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa788003a00 0x7fa7980b51c0 unknown :-1 s=CLOSED pgs=3214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T02:40:08.063 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:08.059+0000 7fa79eb1c700 1 --2- 172.21.15.46:0/94342507 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa7981445b0 0x7fa7980ca5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T02:40:08.063 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:08.059+0000 7fa79eb1c700 1 -- 172.21.15.46:0/94342507 >> 172.21.15.46:0/94342507 conn(0x7fa79806bba0 msgr2=0x7fa798071380 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T02:40:08.063 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:08.061+0000 7fa79eb1c700 1 -- 172.21.15.46:0/94342507 shutdown_connections 2023-07-06T02:40:08.069 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:08.066+0000 7fa79eb1c700 1 -- 172.21.15.46:0/94342507 wait complete. 2023-07-06T02:40:08.093 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-07-06T02:40:08.302 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:08.300+0000 7f169a503700 1 Processor -- start 2023-07-06T02:40:08.303 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:08.300+0000 7f169a503700 1 -- start start 2023-07-06T02:40:08.306 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:08.301+0000 7f169a503700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f16940c3fc0 0x7f169406af40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T02:40:08.306 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:08.301+0000 7f169a503700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f169406b480 0x7f169406fd60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T02:40:08.307 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:08.301+0000 7f169a503700 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1694069ea0 con 0x7f169415c7b0 2023-07-06T02:40:08.307 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:08.301+0000 7f169a503700 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f169406a180 con 0x7f16940c3fc0 2023-07-06T02:40:08.307 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:08.301+0000 7f169a503700 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f169406a460 con 0x7f169406b480 2023-07-06T02:40:08.307 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:08.301+0000 7f1698aa0700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f169406b480 0x7f169406fd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T02:40:08.307 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:08.301+0000 7f16937fe700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f16940c3fc0 0x7f169406af40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T02:40:08.307 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:08.301+0000 7f1698aa0700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f169406b480 0x7f169406fd60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.46:45340/0 (socket says 172.21.15.46:45340) 2023-07-06T02:40:08.307 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:08.301+0000 7f1698aa0700 1 -- 172.21.15.46:0/3014154440 learned_addr learned my addr 172.21.15.46:0/3014154440 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-07-06T02:40:08.308 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:08.301+0000 7f16937fe700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f16940c3fc0 0x7f169406af40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:45858/0 (socket says 172.21.15.46:45858) 2023-07-06T02:40:08.308 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:08.302+0000 7f1698aa0700 1 -- 172.21.15.46:0/3014154440 >> v2:172.21.15.46:3300/0 conn(0x7f16940c3fc0 msgr2=0x7f169406af40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T02:40:08.308 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:08.302+0000 7f1698aa0700 1 --2- 172.21.15.46:0/3014154440 >> v2:172.21.15.46:3300/0 conn(0x7f16940c3fc0 0x7f169406af40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T02:40:08.308 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:08.302+0000 7f1698aa0700 1 -- 172.21.15.46:0/3014154440 >> v1:172.21.15.73:6789/0 conn(0x7f169415c7b0 legacy=0x7f16940c4ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T02:40:08.308 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:08.302+0000 7f1698aa0700 1 -- 172.21.15.46:0/3014154440 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f169406a740 con 0x7f169406b480 2023-07-06T02:40:08.308 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:08.302+0000 7f1698aa0700 1 --2- 172.21.15.46:0/3014154440 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f169406b480 0x7f169406fd60 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f16940d01c0 tx=0x7f168c00b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8d22bc259253efa7 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T02:40:08.311 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:08.309+0000 7f1692ffd700 1 -- 172.21.15.46:0/3014154440 <== mon.1 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f168c00e070 con 0x7f169406b480 2023-07-06T02:40:08.312 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:08.309+0000 7f1692ffd700 1 -- 172.21.15.46:0/3014154440 <== mon.1 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f168c00b910 con 0x7f169406b480 2023-07-06T02:40:08.312 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:08.309+0000 7f1692ffd700 1 -- 172.21.15.46:0/3014154440 <== mon.1 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f168c00bcc0 con 0x7f169406b480 2023-07-06T02:40:08.315 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:08.309+0000 7f169a503700 1 -- 172.21.15.46:0/3014154440 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f169406b480 msgr2=0x7f169406fd60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T02:40:08.316 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:08.309+0000 7f169a503700 1 --2- 172.21.15.46:0/3014154440 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f169406b480 0x7f169406fd60 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f16940d01c0 tx=0x7f168c00b330 comp rx=0 tx=0).stop 2023-07-06T02:40:08.317 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:08.315+0000 7f169a503700 1 -- 172.21.15.46:0/3014154440 shutdown_connections 2023-07-06T02:40:08.318 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:08.315+0000 7f169a503700 1 --2- 172.21.15.46:0/3014154440 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f169406b480 0x7f169406fd60 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T02:40:08.318 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:08.315+0000 7f169a503700 1 --2- 172.21.15.46:0/3014154440 >> v2:172.21.15.46:3300/0 conn(0x7f16940c3fc0 0x7f169406af40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T02:40:08.318 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:08.315+0000 7f169a503700 1 -- 172.21.15.46:0/3014154440 >> 172.21.15.46:0/3014154440 conn(0x7f16940b19d0 msgr2=0x7f16940cf120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T02:40:08.320 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:08.318+0000 7f169a503700 1 -- 172.21.15.46:0/3014154440 shutdown_connections 2023-07-06T02:40:08.321 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:08.318+0000 7f169a503700 1 -- 172.21.15.46:0/3014154440 wait complete. 2023-07-06T02:40:08.322 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:08.320+0000 7f169a503700 1 Processor -- start 2023-07-06T02:40:08.323 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:08.320+0000 7f169a503700 1 -- start start 2023-07-06T02:40:08.324 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:08.321+0000 7f169a503700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f169406b480 0x7f16940cf140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T02:40:08.324 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:08.321+0000 7f169a503700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f16940c3fc0 0x7f1694158730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T02:40:08.324 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:08.321+0000 7f169a503700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f169415c7b0 0x7f16940ca700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T02:40:08.325 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:08.321+0000 7f169a503700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16940c9660 con 0x7f169415c7b0 2023-07-06T02:40:08.325 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:08.321+0000 7f169a503700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16940c9940 con 0x7f169406b480 2023-07-06T02:40:08.325 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:08.321+0000 7f169a503700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f16940c9c20 con 0x7f16940c3fc0 2023-07-06T02:40:08.325 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:08.321+0000 7f1698aa0700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f169415c7b0 0x7f16940ca700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T02:40:08.325 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:08.321+0000 7f1698aa0700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f169415c7b0 0x7f16940ca700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:45862/0 (socket says 172.21.15.46:45862) 2023-07-06T02:40:08.325 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:08.321+0000 7f1698aa0700 1 -- 172.21.15.46:0/3157083163 learned_addr learned my addr 172.21.15.46:0/3157083163 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-07-06T02:40:08.325 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:08.321+0000 7f16937fe700 1 --2- 172.21.15.46:0/3157083163 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f16940c3fc0 0x7f1694158730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T02:40:08.326 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:08.321+0000 7f1693fff700 1 --2- 172.21.15.46:0/3157083163 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f169406b480 0x7f16940cf140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T02:40:08.326 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:08.322+0000 7f16937fe700 1 -- 172.21.15.46:0/3157083163 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f169406b480 msgr2=0x7f16940cf140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T02:40:08.326 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:08.322+0000 7f16937fe700 1 --2- 172.21.15.46:0/3157083163 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f169406b480 0x7f16940cf140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T02:40:08.326 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:08.322+0000 7f16937fe700 1 -- 172.21.15.46:0/3157083163 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f169415c7b0 msgr2=0x7f16940ca700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T02:40:08.327 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:08.322+0000 7f16937fe700 1 --2- 172.21.15.46:0/3157083163 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f169415c7b0 0x7f16940ca700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T02:40:08.327 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:08.322+0000 7f16937fe700 1 -- 172.21.15.46:0/3157083163 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f168c009b30 con 0x7f16940c3fc0 2023-07-06T02:40:08.327 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:08.322+0000 7f1693fff700 1 --2- 172.21.15.46:0/3157083163 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f169406b480 0x7f16940cf140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-06T02:40:08.331 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:08.328+0000 7f16937fe700 1 --2- 172.21.15.46:0/3157083163 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f16940c3fc0 0x7f1694158730 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f167c00eb10 tx=0x7f167c00ee20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T02:40:08.331 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:08.328+0000 7f1690ff9700 1 -- 172.21.15.46:0/3157083163 <== mon.2 v2:172.21.15.73:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f167c00dd10 con 0x7f16940c3fc0 2023-07-06T02:40:08.332 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:08.328+0000 7f1690ff9700 1 -- 172.21.15.46:0/3157083163 <== mon.2 v2:172.21.15.73:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f167c00de70 con 0x7f16940c3fc0 2023-07-06T02:40:08.332 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:08.328+0000 7f169a503700 1 -- 172.21.15.46:0/3157083163 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f16940c9f00 con 0x7f16940c3fc0 2023-07-06T02:40:08.332 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:08.329+0000 7f169a503700 1 -- 172.21.15.46:0/3157083163 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f16940cf680 con 0x7f16940c3fc0 2023-07-06T02:40:08.332 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:08.329+0000 7f1690ff9700 1 -- 172.21.15.46:0/3157083163 <== mon.2 v2:172.21.15.73:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f167c010640 con 0x7f16940c3fc0 2023-07-06T02:40:08.333 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:08.330+0000 7f169a503700 1 -- 172.21.15.46:0/3157083163 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f16780052f0 con 0x7f16940c3fc0 2023-07-06T02:40:08.333 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:08.330+0000 7f1690ff9700 1 -- 172.21.15.46:0/3157083163 <== mon.2 v2:172.21.15.73:3301/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f167c0107a0 con 0x7f16940c3fc0 2023-07-06T02:40:08.334 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:08.331+0000 7f1690ff9700 1 --2- 172.21.15.46:0/3157083163 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7f167406ace0 0x7f167406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T02:40:08.334 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:08.331+0000 7f1690ff9700 1 -- 172.21.15.46:0/3157083163 <== mon.2 v2:172.21.15.73:3301/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 6091+0+0 (secure 0 0 0) 0x7f167c014030 con 0x7f16940c3fc0 2023-07-06T02:40:08.337 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:08.334+0000 7f1693fff700 1 --2- 172.21.15.46:0/3157083163 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7f167406ace0 0x7f167406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T02:40:08.337 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:08.335+0000 7f1693fff700 1 --2- 172.21.15.46:0/3157083163 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7f167406ace0 0x7f167406d190 secure :-1 s=READY pgs=718 cs=0 l=1 rev1=1 crypto rx=0x7f1684007fd0 tx=0x7f1684009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T02:40:08.344 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:08.341+0000 7f1690ff9700 1 -- 172.21.15.46:0/3157083163 <== mon.2 v2:172.21.15.73:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f167c054780 con 0x7f16940c3fc0 2023-07-06T02:40:08.656 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:08.653+0000 7f169a503700 1 -- 172.21.15.46:0/3157083163 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f1678005b20 con 0x7f16940c3fc0 2023-07-06T02:40:08.657 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:08.654+0000 7f1690ff9700 1 -- 172.21.15.46:0/3157083163 <== mon.2 v2:172.21.15.73:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v37) v1 ==== 93+0+10 (secure 0 0 0) 0x7f167c057da0 con 0x7f16940c3fc0 2023-07-06T02:40:08.658 INFO:teuthology.orchestra.run.smithi046.stdout:pg_num: 1 2023-07-06T02:40:08.660 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:08.658+0000 7f169a503700 1 -- 172.21.15.46:0/3157083163 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7f167406ace0 msgr2=0x7f167406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T02:40:08.661 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:08.658+0000 7f169a503700 1 --2- 172.21.15.46:0/3157083163 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7f167406ace0 0x7f167406d190 secure :-1 s=READY pgs=718 cs=0 l=1 rev1=1 crypto rx=0x7f1684007fd0 tx=0x7f1684009040 comp rx=0 tx=0).stop 2023-07-06T02:40:08.661 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:08.658+0000 7f169a503700 1 -- 172.21.15.46:0/3157083163 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f16940c3fc0 msgr2=0x7f1694158730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T02:40:08.661 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:08.658+0000 7f169a503700 1 --2- 172.21.15.46:0/3157083163 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f16940c3fc0 0x7f1694158730 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f167c00eb10 tx=0x7f167c00ee20 comp rx=0 tx=0).stop 2023-07-06T02:40:08.666 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:08.664+0000 7f169a503700 1 -- 172.21.15.46:0/3157083163 shutdown_connections 2023-07-06T02:40:08.667 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:08.664+0000 7f169a503700 1 --2- 172.21.15.46:0/3157083163 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7f167406ace0 0x7f167406d190 unknown :-1 s=CLOSED pgs=718 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T02:40:08.667 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:08.664+0000 7f169a503700 1 --2- 172.21.15.46:0/3157083163 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f169415c7b0 0x7f16940ca700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T02:40:08.667 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:08.664+0000 7f169a503700 1 --2- 172.21.15.46:0/3157083163 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f169406b480 0x7f16940cf140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T02:40:08.667 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:08.664+0000 7f169a503700 1 --2- 172.21.15.46:0/3157083163 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f16940c3fc0 0x7f1694158730 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T02:40:08.667 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:08.664+0000 7f169a503700 1 -- 172.21.15.46:0/3157083163 >> 172.21.15.46:0/3157083163 conn(0x7f16940b19d0 msgr2=0x7f1694070da0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T02:40:08.667 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:08.664+0000 7f169a503700 1 -- 172.21.15.46:0/3157083163 shutdown_connections 2023-07-06T02:40:08.667 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:08.664+0000 7f169a503700 1 -- 172.21.15.46:0/3157083163 wait complete. 2023-07-06T02:40:08.689 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-07-06T02:40:08.898 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:08.896+0000 7f0ebecdd700 1 Processor -- start 2023-07-06T02:40:08.899 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:08.896+0000 7f0ebecdd700 1 -- start start 2023-07-06T02:40:08.900 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:08.896+0000 7f0ebecdd700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f0eb815c470 0x7f0eb80cfeb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T02:40:08.900 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:08.896+0000 7f0ebecdd700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f0eb80d18d0 0x7f0eb806a180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T02:40:08.900 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:08.896+0000 7f0ebecdd700 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0eb80cdb30 con 0x7f0eb815c840 2023-07-06T02:40:08.900 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:08.896+0000 7f0ebecdd700 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0eb80d0b10 con 0x7f0eb815c470 2023-07-06T02:40:08.900 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:08.897+0000 7f0ebecdd700 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0eb80d0df0 con 0x7f0eb80d18d0 2023-07-06T02:40:08.901 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:08.897+0000 7f0ebca79700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f0eb815c470 0x7f0eb80cfeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T02:40:08.901 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:08.897+0000 7f0ebca79700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f0eb815c470 0x7f0eb80cfeb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:45868/0 (socket says 172.21.15.46:45868) 2023-07-06T02:40:08.901 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:08.897+0000 7f0ebca79700 1 -- 172.21.15.46:0/655405061 learned_addr learned my addr 172.21.15.46:0/655405061 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-07-06T02:40:08.901 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:08.897+0000 7f0ebd27a700 1 --2- 172.21.15.46:0/655405061 >> v2:172.21.15.73:3300/0 conn(0x7f0eb80d18d0 0x7f0eb806a180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T02:40:08.901 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:08.897+0000 7f0ebca79700 1 -- 172.21.15.46:0/655405061 >> v2:172.21.15.73:3300/0 conn(0x7f0eb80d18d0 msgr2=0x7f0eb806a180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T02:40:08.901 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:08.897+0000 7f0ebca79700 1 --2- 172.21.15.46:0/655405061 >> v2:172.21.15.73:3300/0 conn(0x7f0eb80d18d0 0x7f0eb806a180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T02:40:08.901 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:08.897+0000 7f0ebca79700 1 -- 172.21.15.46:0/655405061 >> v1:172.21.15.73:6789/0 conn(0x7f0eb815c840 legacy=0x7f0eb80cd2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T02:40:08.902 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:08.897+0000 7f0ebca79700 1 -- 172.21.15.46:0/655405061 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0eb80d10d0 con 0x7f0eb815c470 2023-07-06T02:40:08.902 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:08.897+0000 7f0ebca79700 1 --2- 172.21.15.46:0/655405061 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0eb815c470 0x7f0eb80cfeb0 secure :-1 s=READY pgs=3215 cs=0 l=1 rev1=1 crypto rx=0x7f0eb808c0f0 tx=0x7f0eb4009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3aaeae69d9bf6822 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T02:40:08.903 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:08.897+0000 7f0eaf7fe700 1 -- 172.21.15.46:0/655405061 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0eb4005e30 con 0x7f0eb815c470 2023-07-06T02:40:08.903 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:08.897+0000 7f0eaf7fe700 1 -- 172.21.15.46:0/655405061 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0eb4006030 con 0x7f0eb815c470 2023-07-06T02:40:08.903 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:08.898+0000 7f0eaf7fe700 1 -- 172.21.15.46:0/655405061 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0eb40063e0 con 0x7f0eb815c470 2023-07-06T02:40:08.903 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:08.898+0000 7f0ebecdd700 1 -- 172.21.15.46:0/655405061 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0eb815c470 msgr2=0x7f0eb80cfeb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T02:40:08.903 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:08.898+0000 7f0ebecdd700 1 --2- 172.21.15.46:0/655405061 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0eb815c470 0x7f0eb80cfeb0 secure :-1 s=READY pgs=3215 cs=0 l=1 rev1=1 crypto rx=0x7f0eb808c0f0 tx=0x7f0eb4009bd0 comp rx=0 tx=0).stop 2023-07-06T02:40:08.903 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:08.898+0000 7f0ebecdd700 1 -- 172.21.15.46:0/655405061 shutdown_connections 2023-07-06T02:40:08.903 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:08.898+0000 7f0ebecdd700 1 --2- 172.21.15.46:0/655405061 >> v2:172.21.15.73:3300/0 conn(0x7f0eb80d18d0 0x7f0eb806a180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T02:40:08.904 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:08.898+0000 7f0ebecdd700 1 --2- 172.21.15.46:0/655405061 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0eb815c470 0x7f0eb80cfeb0 unknown :-1 s=CLOSED pgs=3215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T02:40:08.904 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:08.898+0000 7f0ebecdd700 1 -- 172.21.15.46:0/655405061 >> 172.21.15.46:0/655405061 conn(0x7f0eb806caf0 msgr2=0x7f0eb80b47e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T02:40:08.904 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:08.898+0000 7f0ebecdd700 1 -- 172.21.15.46:0/655405061 shutdown_connections 2023-07-06T02:40:08.904 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:08.898+0000 7f0ebecdd700 1 -- 172.21.15.46:0/655405061 wait complete. 2023-07-06T02:40:08.904 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:08.900+0000 7f0ebecdd700 1 Processor -- start 2023-07-06T02:40:08.905 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:08.903+0000 7f0ebecdd700 1 -- start start 2023-07-06T02:40:08.907 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:08.904+0000 7f0ebecdd700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0eb80d18d0 0x7f0eb80ccfa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T02:40:08.907 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:08.904+0000 7f0ebecdd700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0eb815c470 0x7f0eb8146690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T02:40:08.907 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:08.904+0000 7f0ebecdd700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f0eb815c840 0x7f0eb80b3870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T02:40:08.907 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:08.904+0000 7f0ebecdd700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0eb80ca180 con 0x7f0eb80d18d0 2023-07-06T02:40:08.907 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:08.904+0000 7f0ebecdd700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0eb8144490 con 0x7f0eb815c470 2023-07-06T02:40:08.907 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:08.904+0000 7f0ebecdd700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0eb815b0a0 con 0x7f0eb815c840 2023-07-06T02:40:08.908 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:08.904+0000 7f0ebd27a700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f0eb815c840 0x7f0eb80b3870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T02:40:08.909 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:08.904+0000 7f0ebd27a700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f0eb815c840 0x7f0eb80b3870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3301/0 says I am v2:172.21.15.46:57794/0 (socket says 172.21.15.46:57794) 2023-07-06T02:40:08.909 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:08.904+0000 7f0ebd27a700 1 -- 172.21.15.46:0/1613895108 learned_addr learned my addr 172.21.15.46:0/1613895108 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-07-06T02:40:08.909 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:08.905+0000 7f0ebd27a700 1 -- 172.21.15.46:0/1613895108 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0eb815c470 msgr2=0x7f0eb8146690 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-07-06T02:40:08.909 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:08.905+0000 7f0ebd27a700 1 --2- 172.21.15.46:0/1613895108 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0eb815c470 0x7f0eb8146690 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T02:40:08.909 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:08.905+0000 7f0ebd27a700 1 -- 172.21.15.46:0/1613895108 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0eb80d18d0 msgr2=0x7f0eb80ccfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T02:40:08.909 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:08.905+0000 7f0ebd27a700 1 --2- 172.21.15.46:0/1613895108 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0eb80d18d0 0x7f0eb80ccfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T02:40:08.909 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:08.905+0000 7f0ebd27a700 1 -- 172.21.15.46:0/1613895108 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0eb4009500 con 0x7f0eb815c840 2023-07-06T02:40:08.909 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:08.905+0000 7f0ebd27a700 1 --2- 172.21.15.46:0/1613895108 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f0eb815c840 0x7f0eb80b3870 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f0eb000efc0 tx=0x7f0eb000c3a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T02:40:08.910 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:08.905+0000 7f0ead7fa700 1 -- 172.21.15.46:0/1613895108 <== mon.2 v2:172.21.15.73:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0eb000cd40 con 0x7f0eb815c840 2023-07-06T02:40:08.910 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:08.905+0000 7f0ebecdd700 1 -- 172.21.15.46:0/1613895108 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0eb80cd4e0 con 0x7f0eb815c840 2023-07-06T02:40:08.910 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:08.905+0000 7f0ebecdd700 1 -- 172.21.15.46:0/1613895108 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0eb8146c20 con 0x7f0eb815c840 2023-07-06T02:40:08.910 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:08.905+0000 7f0ead7fa700 1 -- 172.21.15.46:0/1613895108 <== mon.2 v2:172.21.15.73:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0eb000f040 con 0x7f0eb815c840 2023-07-06T02:40:08.910 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:08.905+0000 7f0ead7fa700 1 -- 172.21.15.46:0/1613895108 <== mon.2 v2:172.21.15.73:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0eb00146c0 con 0x7f0eb815c840 2023-07-06T02:40:08.911 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:08.907+0000 7f0ebecdd700 1 -- 172.21.15.46:0/1613895108 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0e980052f0 con 0x7f0eb815c840 2023-07-06T02:40:08.911 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:08.907+0000 7f0ead7fa700 1 -- 172.21.15.46:0/1613895108 <== mon.2 v2:172.21.15.73:3301/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f0eb0014820 con 0x7f0eb815c840 2023-07-06T02:40:08.911 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:08.908+0000 7f0ead7fa700 1 --2- 172.21.15.46:0/1613895108 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7f0ea406ace0 0x7f0ea406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T02:40:08.911 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:08.908+0000 7f0ead7fa700 1 -- 172.21.15.46:0/1613895108 <== mon.2 v2:172.21.15.73:3301/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 6091+0+0 (secure 0 0 0) 0x7f0eb0089dd0 con 0x7f0eb815c840 2023-07-06T02:40:08.911 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:08.908+0000 7f0ebca79700 1 --2- 172.21.15.46:0/1613895108 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7f0ea406ace0 0x7f0ea406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T02:40:08.912 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:08.909+0000 7f0ebca79700 1 --2- 172.21.15.46:0/1613895108 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7f0ea406ace0 0x7f0ea406d190 secure :-1 s=READY pgs=719 cs=0 l=1 rev1=1 crypto rx=0x7f0eb80c9720 tx=0x7f0eb4010000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T02:40:08.919 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:08.916+0000 7f0ead7fa700 1 -- 172.21.15.46:0/1613895108 <== mon.2 v2:172.21.15.73:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f0eb00588f0 con 0x7f0eb815c840 2023-07-06T02:40:09.227 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:09.224+0000 7f0ebecdd700 1 -- 172.21.15.46:0/1613895108 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f0e98005b20 con 0x7f0eb815c840 2023-07-06T02:40:09.227 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:09.224+0000 7f0ead7fa700 1 -- 172.21.15.46:0/1613895108 <== mon.2 v2:172.21.15.73:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v37) v1 ==== 104+0+11 (secure 0 0 0) 0x7f0eb000cea0 con 0x7f0eb815c840 2023-07-06T02:40:09.228 INFO:teuthology.orchestra.run.smithi046.stdout:pg_num: 32 2023-07-06T02:40:09.230 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:09.227+0000 7f0ebecdd700 1 -- 172.21.15.46:0/1613895108 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7f0ea406ace0 msgr2=0x7f0ea406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T02:40:09.230 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:09.227+0000 7f0ebecdd700 1 --2- 172.21.15.46:0/1613895108 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7f0ea406ace0 0x7f0ea406d190 secure :-1 s=READY pgs=719 cs=0 l=1 rev1=1 crypto rx=0x7f0eb80c9720 tx=0x7f0eb4010000 comp rx=0 tx=0).stop 2023-07-06T02:40:09.231 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:09.227+0000 7f0ebecdd700 1 -- 172.21.15.46:0/1613895108 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f0eb815c840 msgr2=0x7f0eb80b3870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T02:40:09.231 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:09.227+0000 7f0ebecdd700 1 --2- 172.21.15.46:0/1613895108 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f0eb815c840 0x7f0eb80b3870 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f0eb000efc0 tx=0x7f0eb000c3a0 comp rx=0 tx=0).stop 2023-07-06T02:40:09.231 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:09.227+0000 7f0ebecdd700 1 -- 172.21.15.46:0/1613895108 shutdown_connections 2023-07-06T02:40:09.231 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:09.227+0000 7f0ebecdd700 1 --2- 172.21.15.46:0/1613895108 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7f0ea406ace0 0x7f0ea406d190 unknown :-1 s=CLOSED pgs=719 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T02:40:09.231 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:09.227+0000 7f0ebecdd700 1 --2- 172.21.15.46:0/1613895108 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f0eb815c840 0x7f0eb80b3870 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T02:40:09.231 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:09.227+0000 7f0ebecdd700 1 --2- 172.21.15.46:0/1613895108 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0eb80d18d0 0x7f0eb80ccfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T02:40:09.231 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:09.227+0000 7f0ebecdd700 1 --2- 172.21.15.46:0/1613895108 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0eb815c470 0x7f0eb8146690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T02:40:09.232 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:09.227+0000 7f0ebecdd700 1 -- 172.21.15.46:0/1613895108 >> 172.21.15.46:0/1613895108 conn(0x7f0eb806caf0 msgr2=0x7f0eb80b2750 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T02:40:09.232 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:09.227+0000 7f0ebecdd700 1 -- 172.21.15.46:0/1613895108 shutdown_connections 2023-07-06T02:40:09.232 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:09.227+0000 7f0ebecdd700 1 -- 172.21.15.46:0/1613895108 wait complete. 2023-07-06T02:40:09.253 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-07-06T02:40:09.445 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:09.442+0000 7f2c9b844700 1 Processor -- start 2023-07-06T02:40:09.445 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:09.442+0000 7f2c9b844700 1 -- start start 2023-07-06T02:40:09.446 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:09.443+0000 7f2c9b844700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f2c9415c860 0x7f2c94160ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T02:40:09.446 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:09.443+0000 7f2c9b844700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f2c940715c0 0x7f2c94069e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T02:40:09.446 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:09.443+0000 7f2c9b844700 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2c940ce640 con 0x7f2c9406a340 2023-07-06T02:40:09.446 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:09.443+0000 7f2c9b844700 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2c941611e0 con 0x7f2c9415c860 2023-07-06T02:40:09.447 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:09.443+0000 7f2c9b844700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2c940ce870 con 0x7f2c940715c0 2023-07-06T02:40:09.447 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:09.443+0000 7f2c99de1700 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7f2c9406a340 0x7f2c940b13f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:45156/0 (socket says 172.21.15.46:45156) 2023-07-06T02:40:09.447 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:09.443+0000 7f2c99de1700 1 -- 172.21.15.46:0/3430373771 learned_addr learned my addr 172.21.15.46:0/3430373771 (peer_addr_for_me v1:172.21.15.46:0/0) 2023-07-06T02:40:09.447 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:09.443+0000 7f2c98ddf700 1 --2- 172.21.15.46:0/3430373771 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f2c940715c0 0x7f2c94069e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T02:40:09.448 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:09.444+0000 7f2c8bfff700 1 -- 172.21.15.46:0/3430373771 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1791633828 0 0) 0x7f2c940ce640 con 0x7f2c9406a340 2023-07-06T02:40:09.448 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:09.444+0000 7f2c8bfff700 1 -- 172.21.15.46:0/3430373771 --> v1:172.21.15.46:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2c800035b0 con 0x7f2c9406a340 2023-07-06T02:40:09.448 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:09.444+0000 7f2c98ddf700 1 -- 172.21.15.46:0/3430373771 >> v2:172.21.15.46:3300/0 conn(0x7f2c9415c860 msgr2=0x7f2c94160ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T02:40:09.448 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:09.444+0000 7f2c98ddf700 1 --2- 172.21.15.46:0/3430373771 >> v2:172.21.15.46:3300/0 conn(0x7f2c9415c860 0x7f2c94160ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T02:40:09.449 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:09.444+0000 7f2c98ddf700 1 -- 172.21.15.46:0/3430373771 >> v1:172.21.15.46:6789/0 conn(0x7f2c9406a340 legacy=0x7f2c940b13f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T02:40:09.449 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:09.444+0000 7f2c98ddf700 1 -- 172.21.15.46:0/3430373771 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2c9406a7a0 con 0x7f2c940715c0 2023-07-06T02:40:09.449 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:09.444+0000 7f2c98ddf700 1 --2- 172.21.15.46:0/3430373771 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f2c940715c0 0x7f2c94069e00 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f2c90009840 tx=0x7f2c90009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=31e65023c7964ce4 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T02:40:09.449 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:09.444+0000 7f2c8bfff700 1 -- 172.21.15.46:0/3430373771 <== mon.2 v2:172.21.15.73:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c90011830 con 0x7f2c940715c0 2023-07-06T02:40:09.449 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:09.444+0000 7f2c8bfff700 1 -- 172.21.15.46:0/3430373771 <== mon.2 v2:172.21.15.73:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2c90011990 con 0x7f2c940715c0 2023-07-06T02:40:09.449 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:09.444+0000 7f2c8bfff700 1 -- 172.21.15.46:0/3430373771 <== mon.2 v2:172.21.15.73:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c90011d20 con 0x7f2c940715c0 2023-07-06T02:40:09.450 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:09.445+0000 7f2c9b844700 1 -- 172.21.15.46:0/3430373771 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f2c940715c0 msgr2=0x7f2c94069e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T02:40:09.450 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:09.445+0000 7f2c9b844700 1 --2- 172.21.15.46:0/3430373771 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f2c940715c0 0x7f2c94069e00 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f2c90009840 tx=0x7f2c90009b50 comp rx=0 tx=0).stop 2023-07-06T02:40:09.451 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:09.449+0000 7f2c9b844700 1 -- 172.21.15.46:0/3430373771 shutdown_connections 2023-07-06T02:40:09.452 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:09.449+0000 7f2c9b844700 1 --2- 172.21.15.46:0/3430373771 >> v2:172.21.15.46:3300/0 conn(0x7f2c9415c860 0x7f2c94160ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T02:40:09.452 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:09.449+0000 7f2c9b844700 1 --2- 172.21.15.46:0/3430373771 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f2c940715c0 0x7f2c94069e00 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T02:40:09.452 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:09.449+0000 7f2c9b844700 1 -- 172.21.15.46:0/3430373771 >> 172.21.15.46:0/3430373771 conn(0x7f2c9406bba0 msgr2=0x7f2c940cc3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T02:40:09.455 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:09.453+0000 7f2c9b844700 1 -- 172.21.15.46:0/3430373771 shutdown_connections 2023-07-06T02:40:09.456 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:09.453+0000 7f2c9b844700 1 -- 172.21.15.46:0/3430373771 wait complete. 2023-07-06T02:40:09.457 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:09.454+0000 7f2c9b844700 1 Processor -- start 2023-07-06T02:40:09.457 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:09.454+0000 7f2c9b844700 1 -- start start 2023-07-06T02:40:09.458 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:09.455+0000 7f2c9b844700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2c9406a340 0x7f2c94148b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T02:40:09.458 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:09.455+0000 7f2c9b844700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2c940715c0 0x7f2c940b45f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T02:40:09.458 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:09.455+0000 7f2c9b844700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f2c9415c860 0x7f2c940c58e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T02:40:09.459 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:09.455+0000 7f2c9b844700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c940b0490 con 0x7f2c9406a340 2023-07-06T02:40:09.459 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:09.455+0000 7f2c9b844700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c940b06c0 con 0x7f2c940715c0 2023-07-06T02:40:09.459 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:09.455+0000 7f2c9b844700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2c940b0960 con 0x7f2c9415c860 2023-07-06T02:40:09.459 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:09.455+0000 7f2c995e0700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2c9406a340 0x7f2c94148b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T02:40:09.459 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:09.455+0000 7f2c995e0700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2c9406a340 0x7f2c94148b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:45886/0 (socket says 172.21.15.46:45886) 2023-07-06T02:40:09.459 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:09.455+0000 7f2c995e0700 1 -- 172.21.15.46:0/591259487 learned_addr learned my addr 172.21.15.46:0/591259487 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-07-06T02:40:09.459 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:09.455+0000 7f2c98ddf700 1 --2- 172.21.15.46:0/591259487 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2c940715c0 0x7f2c940b45f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T02:40:09.459 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:09.455+0000 7f2c99de1700 1 --2- 172.21.15.46:0/591259487 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f2c9415c860 0x7f2c940c58e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T02:40:09.460 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:09.456+0000 7f2c995e0700 1 -- 172.21.15.46:0/591259487 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f2c9415c860 msgr2=0x7f2c940c58e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T02:40:09.461 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:09.456+0000 7f2c995e0700 1 --2- 172.21.15.46:0/591259487 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f2c9415c860 0x7f2c940c58e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T02:40:09.461 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:09.456+0000 7f2c995e0700 1 -- 172.21.15.46:0/591259487 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2c940715c0 msgr2=0x7f2c940b45f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T02:40:09.461 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:09.456+0000 7f2c995e0700 1 --2- 172.21.15.46:0/591259487 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2c940715c0 0x7f2c940b45f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T02:40:09.461 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:09.456+0000 7f2c995e0700 1 -- 172.21.15.46:0/591259487 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2c900094a0 con 0x7f2c9406a340 2023-07-06T02:40:09.461 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:09.456+0000 7f2c995e0700 1 --2- 172.21.15.46:0/591259487 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2c9406a340 0x7f2c94148b90 secure :-1 s=READY pgs=3217 cs=0 l=1 rev1=1 crypto rx=0x7f2c8400b4a0 tx=0x7f2c8400b7b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T02:40:09.461 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:09.456+0000 7f2c89ffb700 1 -- 172.21.15.46:0/591259487 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c84011830 con 0x7f2c9406a340 2023-07-06T02:40:09.461 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:09.456+0000 7f2c89ffb700 1 -- 172.21.15.46:0/591259487 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2c84011990 con 0x7f2c9406a340 2023-07-06T02:40:09.461 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:09.456+0000 7f2c89ffb700 1 -- 172.21.15.46:0/591259487 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c84011d40 con 0x7f2c9406a340 2023-07-06T02:40:09.462 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:09.456+0000 7f2c9b844700 1 -- 172.21.15.46:0/591259487 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2c940b0c40 con 0x7f2c9406a340 2023-07-06T02:40:09.462 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:09.457+0000 7f2c9b844700 1 -- 172.21.15.46:0/591259487 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2c940b1200 con 0x7f2c9406a340 2023-07-06T02:40:09.462 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:09.458+0000 7f2c9b844700 1 -- 172.21.15.46:0/591259487 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2c94070b10 con 0x7f2c9406a340 2023-07-06T02:40:09.462 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:09.458+0000 7f2c89ffb700 1 -- 172.21.15.46:0/591259487 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f2c8401a400 con 0x7f2c9406a340 2023-07-06T02:40:09.463 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:09.459+0000 7f2c89ffb700 1 --2- 172.21.15.46:0/591259487 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7f2c7806ace0 0x7f2c7806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T02:40:09.463 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:09.459+0000 7f2c89ffb700 1 -- 172.21.15.46:0/591259487 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 6091+0+0 (secure 0 0 0) 0x7f2c84089440 con 0x7f2c9406a340 2023-07-06T02:40:09.463 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:09.460+0000 7f2c98ddf700 1 --2- 172.21.15.46:0/591259487 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7f2c7806ace0 0x7f2c7806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T02:40:09.463 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:09.460+0000 7f2c98ddf700 1 --2- 172.21.15.46:0/591259487 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7f2c7806ace0 0x7f2c7806d190 secure :-1 s=READY pgs=720 cs=0 l=1 rev1=1 crypto rx=0x7f2c90000c00 tx=0x7f2c90008030 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T02:40:09.467 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:09.464+0000 7f2c89ffb700 1 -- 172.21.15.46:0/591259487 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f2c840544e0 con 0x7f2c9406a340 2023-07-06T02:40:09.770 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:09.767+0000 7f2c9b844700 1 -- 172.21.15.46:0/591259487 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f2c940672e0 con 0x7f2c9406a340 2023-07-06T02:40:09.771 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:09.768+0000 7f2c89ffb700 1 -- 172.21.15.46:0/591259487 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v37) v1 ==== 100+0+11 (secure 0 0 0) 0x7f2c84057b00 con 0x7f2c9406a340 2023-07-06T02:40:09.771 INFO:teuthology.orchestra.run.smithi046.stdout:pg_num: 64 2023-07-06T02:40:09.775 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:09.772+0000 7f2c9b844700 1 -- 172.21.15.46:0/591259487 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7f2c7806ace0 msgr2=0x7f2c7806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T02:40:09.775 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:09.772+0000 7f2c9b844700 1 --2- 172.21.15.46:0/591259487 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7f2c7806ace0 0x7f2c7806d190 secure :-1 s=READY pgs=720 cs=0 l=1 rev1=1 crypto rx=0x7f2c90000c00 tx=0x7f2c90008030 comp rx=0 tx=0).stop 2023-07-06T02:40:09.775 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:09.772+0000 7f2c9b844700 1 -- 172.21.15.46:0/591259487 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2c9406a340 msgr2=0x7f2c94148b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T02:40:09.775 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:09.772+0000 7f2c9b844700 1 --2- 172.21.15.46:0/591259487 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2c9406a340 0x7f2c94148b90 secure :-1 s=READY pgs=3217 cs=0 l=1 rev1=1 crypto rx=0x7f2c8400b4a0 tx=0x7f2c8400b7b0 comp rx=0 tx=0).stop 2023-07-06T02:40:09.775 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:09.772+0000 7f2c9b844700 1 -- 172.21.15.46:0/591259487 shutdown_connections 2023-07-06T02:40:09.775 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:09.772+0000 7f2c9b844700 1 --2- 172.21.15.46:0/591259487 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7f2c7806ace0 0x7f2c7806d190 unknown :-1 s=CLOSED pgs=720 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T02:40:09.776 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:09.772+0000 7f2c9b844700 1 --2- 172.21.15.46:0/591259487 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f2c9415c860 0x7f2c940c58e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T02:40:09.776 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:09.772+0000 7f2c9b844700 1 --2- 172.21.15.46:0/591259487 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2c9406a340 0x7f2c94148b90 unknown :-1 s=CLOSED pgs=3217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T02:40:09.776 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:09.772+0000 7f2c9b844700 1 --2- 172.21.15.46:0/591259487 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2c940715c0 0x7f2c940b45f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T02:40:09.776 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:09.772+0000 7f2c9b844700 1 -- 172.21.15.46:0/591259487 >> 172.21.15.46:0/591259487 conn(0x7f2c9406bba0 msgr2=0x7f2c940cd690 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T02:40:09.776 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:09.772+0000 7f2c9b844700 1 -- 172.21.15.46:0/591259487 shutdown_connections 2023-07-06T02:40:09.776 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:09.772+0000 7f2c9b844700 1 -- 172.21.15.46:0/591259487 wait complete. 2023-07-06T02:40:09.796 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-06T02:40:09.984 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:09.981+0000 7f00b909a700 1 Processor -- start 2023-07-06T02:40:09.985 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:09.981+0000 7f00b909a700 1 -- start start 2023-07-06T02:40:09.988 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:09.982+0000 7f00b909a700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f00b40d0ad0 0x7f00b40d0f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T02:40:09.989 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:09.982+0000 7f00b909a700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f00b40cb190 0x7f00b40cb630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T02:40:09.989 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:09.982+0000 7f00b909a700 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f00b40d1460 con 0x7f00b40d0640 2023-07-06T02:40:09.989 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:09.982+0000 7f00b909a700 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f00b40ce710 con 0x7f00b40d0ad0 2023-07-06T02:40:09.989 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:09.982+0000 7f00b909a700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f00b40ce960 con 0x7f00b40cb190 2023-07-06T02:40:09.990 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:09.982+0000 7f00aa59c700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f00b40d0ad0 0x7f00b40d0f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T02:40:09.990 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:09.982+0000 7f00b2d9d700 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7f00b40d0640 0x7f00b406b0d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:45166/0 (socket says 172.21.15.46:45166) 2023-07-06T02:40:09.990 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:09.982+0000 7f00b2d9d700 1 -- 172.21.15.46:0/669488461 learned_addr learned my addr 172.21.15.46:0/669488461 (peer_addr_for_me v1:172.21.15.46:0/0) 2023-07-06T02:40:09.991 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:09.982+0000 7f00aa59c700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f00b40d0ad0 0x7f00b40d0f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:45896/0 (socket says 172.21.15.46:45896) 2023-07-06T02:40:09.991 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:09.982+0000 7f00b359e700 1 --2- 172.21.15.46:0/669488461 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f00b40cb190 0x7f00b40cb630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T02:40:09.991 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:09.983+0000 7f00aa59c700 1 -- 172.21.15.46:0/669488461 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f00b40cb190 msgr2=0x7f00b40cb630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T02:40:09.991 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:09.983+0000 7f00aa59c700 1 --2- 172.21.15.46:0/669488461 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f00b40cb190 0x7f00b40cb630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T02:40:09.992 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:09.983+0000 7f00aa59c700 1 -- 172.21.15.46:0/669488461 >> v1:172.21.15.46:6789/0 conn(0x7f00b40d0640 legacy=0x7f00b406b0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T02:40:09.992 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:09.983+0000 7f00aa59c700 1 -- 172.21.15.46:0/669488461 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f00b40cec40 con 0x7f00b40d0ad0 2023-07-06T02:40:09.992 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:09.983+0000 7f00aa59c700 1 --2- 172.21.15.46:0/669488461 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f00b40d0ad0 0x7f00b40d0f20 secure :-1 s=READY pgs=3219 cs=0 l=1 rev1=1 crypto rx=0x7f009c009840 tx=0x7f009c009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b63dbb91c4d6b654 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T02:40:09.993 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:09.984+0000 7f00b259c700 1 -- 172.21.15.46:0/669488461 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f009c004230 con 0x7f00b40d0ad0 2023-07-06T02:40:09.993 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:09.984+0000 7f00b259c700 1 -- 172.21.15.46:0/669488461 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f009c004390 con 0x7f00b40d0ad0 2023-07-06T02:40:09.993 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:09.984+0000 7f00b259c700 1 -- 172.21.15.46:0/669488461 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f009c0036a0 con 0x7f00b40d0ad0 2023-07-06T02:40:09.994 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:09.985+0000 7f00b909a700 1 -- 172.21.15.46:0/669488461 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f00b40d0ad0 msgr2=0x7f00b40d0f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T02:40:09.994 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:09.985+0000 7f00b909a700 1 --2- 172.21.15.46:0/669488461 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f00b40d0ad0 0x7f00b40d0f20 secure :-1 s=READY pgs=3219 cs=0 l=1 rev1=1 crypto rx=0x7f009c009840 tx=0x7f009c009b50 comp rx=0 tx=0).stop 2023-07-06T02:40:09.994 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:09.985+0000 7f00b909a700 1 -- 172.21.15.46:0/669488461 shutdown_connections 2023-07-06T02:40:09.994 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:09.985+0000 7f00b909a700 1 --2- 172.21.15.46:0/669488461 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f00b40cb190 0x7f00b40cb630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T02:40:09.995 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:09.985+0000 7f00b909a700 1 --2- 172.21.15.46:0/669488461 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f00b40d0ad0 0x7f00b40d0f20 unknown :-1 s=CLOSED pgs=3219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T02:40:09.995 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:09.985+0000 7f00b909a700 1 -- 172.21.15.46:0/669488461 >> 172.21.15.46:0/669488461 conn(0x7f00b4071cf0 msgr2=0x7f00b4099e30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T02:40:09.995 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:09.985+0000 7f00b909a700 1 -- 172.21.15.46:0/669488461 shutdown_connections 2023-07-06T02:40:09.996 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:09.985+0000 7f00b909a700 1 -- 172.21.15.46:0/669488461 wait complete. 2023-07-06T02:40:09.998 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:09.987+0000 7f00b909a700 1 Processor -- start 2023-07-06T02:40:09.999 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:09.987+0000 7f00b909a700 1 -- start start 2023-07-06T02:40:09.999 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:09.988+0000 7f00b909a700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f00b40cb190 0x7f00b41f1f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T02:40:09.999 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:09.988+0000 7f00b909a700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f00b40d0640 0x7f00b40c6ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T02:40:09.999 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:09.988+0000 7f00b909a700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f00b41551d0 0x7f00b4155650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T02:40:10.000 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:09.988+0000 7f00b909a700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00b41f2440 con 0x7f00b40d0640 2023-07-06T02:40:10.000 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:09.988+0000 7f00b909a700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00b4155b90 con 0x7f00b41551d0 2023-07-06T02:40:10.000 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:09.988+0000 7f00b909a700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f00b41e73d0 con 0x7f00b40cb190 2023-07-06T02:40:10.001 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:09.989+0000 7f00b359e700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f00b41551d0 0x7f00b4155650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T02:40:10.001 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:09.989+0000 7f00b359e700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f00b41551d0 0x7f00b4155650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.46:45384/0 (socket says 172.21.15.46:45384) 2023-07-06T02:40:10.001 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:09.989+0000 7f00b359e700 1 -- 172.21.15.46:0/1029319059 learned_addr learned my addr 172.21.15.46:0/1029319059 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-07-06T02:40:10.002 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:09.993+0000 7f00b359e700 1 -- 172.21.15.46:0/1029319059 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f00b40cb190 msgr2=0x7f00b41f1f00 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-07-06T02:40:10.002 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:09.993+0000 7f00b359e700 1 --2- 172.21.15.46:0/1029319059 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f00b40cb190 0x7f00b41f1f00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T02:40:10.002 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:09.993+0000 7f00b359e700 1 -- 172.21.15.46:0/1029319059 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f00b40d0640 msgr2=0x7f00b40c6ab0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-07-06T02:40:10.002 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:09.993+0000 7f00b359e700 1 --2- 172.21.15.46:0/1029319059 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f00b40d0640 0x7f00b40c6ab0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T02:40:10.003 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:09.993+0000 7f00b359e700 1 -- 172.21.15.46:0/1029319059 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f009c0094a0 con 0x7f00b41551d0 2023-07-06T02:40:10.003 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:09.993+0000 7f00b359e700 1 --2- 172.21.15.46:0/1029319059 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f00b41551d0 0x7f00b4155650 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f00ac00efc0 tx=0x7f00ac00c3a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T02:40:10.003 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:09.993+0000 7f00abfff700 1 -- 172.21.15.46:0/1029319059 <== mon.1 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00ac00cd40 con 0x7f00b41551d0 2023-07-06T02:40:10.004 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:09.993+0000 7f00abfff700 1 -- 172.21.15.46:0/1029319059 <== mon.1 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f00ac00f040 con 0x7f00b41551d0 2023-07-06T02:40:10.004 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:09.993+0000 7f00b909a700 1 -- 172.21.15.46:0/1029319059 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f00b40c91d0 con 0x7f00b41551d0 2023-07-06T02:40:10.004 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:09.993+0000 7f00abfff700 1 -- 172.21.15.46:0/1029319059 <== mon.1 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00ac0146c0 con 0x7f00b41551d0 2023-07-06T02:40:10.004 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:09.993+0000 7f00b909a700 1 -- 172.21.15.46:0/1029319059 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f00b40c9790 con 0x7f00b41551d0 2023-07-06T02:40:10.005 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:09.995+0000 7f00abfff700 1 -- 172.21.15.46:0/1029319059 <== mon.1 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f00ac014820 con 0x7f00b41551d0 2023-07-06T02:40:10.006 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:09.996+0000 7f00abfff700 1 --2- 172.21.15.46:0/1029319059 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7f009406ace0 0x7f009406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T02:40:10.006 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:09.996+0000 7f00abfff700 1 -- 172.21.15.46:0/1029319059 <== mon.1 v2:172.21.15.73:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 6091+0+0 (secure 0 0 0) 0x7f00ac089d60 con 0x7f00b41551d0 2023-07-06T02:40:10.007 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:09.996+0000 7f00b2d9d700 1 --2- 172.21.15.46:0/1029319059 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7f009406ace0 0x7f009406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T02:40:10.007 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:09.997+0000 7f00b2d9d700 1 --2- 172.21.15.46:0/1029319059 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7f009406ace0 0x7f009406d190 secure :-1 s=READY pgs=721 cs=0 l=1 rev1=1 crypto rx=0x7f00a40017f0 tx=0x7f00a4007a30 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T02:40:10.007 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:09.998+0000 7f00b909a700 1 -- 172.21.15.46:0/1029319059 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f00b40672e0 con 0x7f00b41551d0 2023-07-06T02:40:10.008 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:10.005+0000 7f00abfff700 1 -- 172.21.15.46:0/1029319059 <== mon.1 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f00ac054df0 con 0x7f00b41551d0 2023-07-06T02:40:10.416 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:10.411+0000 7f00b909a700 1 -- 172.21.15.46:0/1029319059 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f00b4071070 con 0x7f00b41551d0 2023-07-06T02:40:10.418 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-06T02:40:10.418 INFO:teuthology.orchestra.run.smithi046.stdout:{"epoch":15,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4823,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.73:6837/1783526483","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6835","nonce":1783526483},{"type":"v1","addr":"172.21.15.73:6837","nonce":1783526483}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":4826,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.46:6834/1224451753","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6832","nonce":1224451753},{"type":"v1","addr":"172.21.15.46:6834","nonce":1224451753}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":4829,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.46:6835/549881285","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6833","nonce":549881285},{"type":"v1","addr":"172.21.15.46:6835","nonce":549881285}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":15,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-07-05T18:57:15.279563+0000","modified":"2023-07-05T18:57:18.286904+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5086},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5086":{"gid":5086,"name":"b","rank":0,"incarnation":12,"state":"up:active","state_seq":3,"addr":"172.21.15.73:6836/255434995","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6834","nonce":255434995},{"type":"v1","addr":"172.21.15.73:6836","nonce":255434995}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2023-07-06T02:40:10.420 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:10.415+0000 7f00abfff700 1 -- 172.21.15.46:0/1029319059 <== mon.1 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 15 v15) v1 ==== 94+0+4665 (secure 0 0 0) 0x7f00ac018030 con 0x7f00b41551d0 2023-07-06T02:40:10.421 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:10.419+0000 7f00b909a700 1 -- 172.21.15.46:0/1029319059 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7f009406ace0 msgr2=0x7f009406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T02:40:10.422 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:10.419+0000 7f00b909a700 1 --2- 172.21.15.46:0/1029319059 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7f009406ace0 0x7f009406d190 secure :-1 s=READY pgs=721 cs=0 l=1 rev1=1 crypto rx=0x7f00a40017f0 tx=0x7f00a4007a30 comp rx=0 tx=0).stop 2023-07-06T02:40:10.422 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:10.419+0000 7f00b909a700 1 -- 172.21.15.46:0/1029319059 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f00b41551d0 msgr2=0x7f00b4155650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T02:40:10.422 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:10.419+0000 7f00b909a700 1 --2- 172.21.15.46:0/1029319059 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f00b41551d0 0x7f00b4155650 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f00ac00efc0 tx=0x7f00ac00c3a0 comp rx=0 tx=0).stop 2023-07-06T02:40:10.423 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:10.419+0000 7f00b909a700 1 -- 172.21.15.46:0/1029319059 shutdown_connections 2023-07-06T02:40:10.423 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:10.419+0000 7f00b909a700 1 --2- 172.21.15.46:0/1029319059 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7f009406ace0 0x7f009406d190 unknown :-1 s=CLOSED pgs=721 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T02:40:10.423 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:10.419+0000 7f00b909a700 1 --2- 172.21.15.46:0/1029319059 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f00b41551d0 0x7f00b4155650 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T02:40:10.423 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:10.419+0000 7f00b909a700 1 --2- 172.21.15.46:0/1029319059 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f00b40cb190 0x7f00b41f1f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T02:40:10.423 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:10.419+0000 7f00b909a700 1 --2- 172.21.15.46:0/1029319059 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f00b40d0640 0x7f00b40c6ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T02:40:10.423 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:10.419+0000 7f00b909a700 1 -- 172.21.15.46:0/1029319059 >> 172.21.15.46:0/1029319059 conn(0x7f00b4071cf0 msgr2=0x7f00b40ad9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T02:40:10.424 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:10.420+0000 7f00b909a700 1 -- 172.21.15.46:0/1029319059 shutdown_connections 2023-07-06T02:40:10.424 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:10.420+0000 7f00b909a700 1 -- 172.21.15.46:0/1029319059 wait complete. 2023-07-06T02:40:10.429 INFO:teuthology.orchestra.run.smithi046.stderr:dumped fsmap epoch 15 2023-07-06T02:40:10.450 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-06T02:40:10.659 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:10.656+0000 7fc5ca427700 1 Processor -- start 2023-07-06T02:40:10.659 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:10.656+0000 7fc5ca427700 1 -- start start 2023-07-06T02:40:10.660 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:10.658+0000 7fc5ca427700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fc5c40d10c0 0x7fc5c406af00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T02:40:10.661 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:10.658+0000 7fc5ca427700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fc5c406b440 0x7fc5c40cb410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T02:40:10.661 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:10.658+0000 7fc5ca427700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fc5c40cb950 0x7fc5c40cd530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T02:40:10.661 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:10.658+0000 7fc5ca427700 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc5c406b8b0 con 0x7fc5c40d10c0 2023-07-06T02:40:10.661 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:10.658+0000 7fc5ca427700 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc5c40cc180 con 0x7fc5c406b440 2023-07-06T02:40:10.661 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:10.658+0000 7fc5ca427700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc5c40cc460 con 0x7fc5c40cb950 2023-07-06T02:40:10.661 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:10.658+0000 7fc5bb7fe700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fc5c406b440 0x7fc5c40cb410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T02:40:10.661 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:10.658+0000 7fc5bb7fe700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fc5c406b440 0x7fc5c40cb410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.46:45388/0 (socket says 172.21.15.46:45388) 2023-07-06T02:40:10.662 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:10.658+0000 7fc5bb7fe700 1 -- 172.21.15.46:0/884090357 learned_addr learned my addr 172.21.15.46:0/884090357 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-07-06T02:40:10.662 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:10.658+0000 7fc5bb7fe700 1 -- 172.21.15.46:0/884090357 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fc5c40cb950 msgr2=0x7fc5c40cd530 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-07-06T02:40:10.662 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:10.658+0000 7fc5bb7fe700 1 --2- 172.21.15.46:0/884090357 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fc5c40cb950 0x7fc5c40cd530 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T02:40:10.663 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:10.658+0000 7fc5bb7fe700 1 -- 172.21.15.46:0/884090357 >> v2:172.21.15.46:3300/0 conn(0x7fc5c40d10c0 msgr2=0x7fc5c406af00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T02:40:10.663 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:10.658+0000 7fc5bb7fe700 1 --2- 172.21.15.46:0/884090357 >> v2:172.21.15.46:3300/0 conn(0x7fc5c40d10c0 0x7fc5c406af00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T02:40:10.663 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:10.658+0000 7fc5bb7fe700 1 -- 172.21.15.46:0/884090357 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc5c40cc740 con 0x7fc5c406b440 2023-07-06T02:40:10.663 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:10.658+0000 7fc5bb7fe700 1 --2- 172.21.15.46:0/884090357 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc5c406b440 0x7fc5c40cb410 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fc5c40b3680 tx=0x7fc5ac009bd0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=41b0df457f626492 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T02:40:10.663 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:10.659+0000 7fc5c37fe700 1 -- 172.21.15.46:0/884090357 <== mon.1 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5ac00b870 con 0x7fc5c406b440 2023-07-06T02:40:10.663 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:10.659+0000 7fc5c37fe700 1 -- 172.21.15.46:0/884090357 <== mon.1 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc5ac00b9d0 con 0x7fc5c406b440 2023-07-06T02:40:10.664 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:10.659+0000 7fc5c37fe700 1 -- 172.21.15.46:0/884090357 <== mon.1 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5ac00bd60 con 0x7fc5c406b440 2023-07-06T02:40:10.664 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:10.660+0000 7fc5ca427700 1 -- 172.21.15.46:0/884090357 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc5c406b440 msgr2=0x7fc5c40cb410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T02:40:10.664 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:10.660+0000 7fc5ca427700 1 --2- 172.21.15.46:0/884090357 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc5c406b440 0x7fc5c40cb410 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fc5c40b3680 tx=0x7fc5ac009bd0 comp rx=0 tx=0).stop 2023-07-06T02:40:10.667 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:10.665+0000 7fc5ca427700 1 -- 172.21.15.46:0/884090357 shutdown_connections 2023-07-06T02:40:10.668 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:10.665+0000 7fc5ca427700 1 --2- 172.21.15.46:0/884090357 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fc5c40cb950 0x7fc5c40cd530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T02:40:10.668 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:10.665+0000 7fc5ca427700 1 --2- 172.21.15.46:0/884090357 >> v2:172.21.15.46:3300/0 conn(0x7fc5c40d10c0 0x7fc5c406af00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T02:40:10.668 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:10.665+0000 7fc5ca427700 1 --2- 172.21.15.46:0/884090357 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc5c406b440 0x7fc5c40cb410 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T02:40:10.668 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:10.665+0000 7fc5ca427700 1 -- 172.21.15.46:0/884090357 >> 172.21.15.46:0/884090357 conn(0x7fc5c40664b0 msgr2=0x7fc5c4099e10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T02:40:10.673 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:10.667+0000 7fc5ca427700 1 -- 172.21.15.46:0/884090357 shutdown_connections 2023-07-06T02:40:10.673 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:10.668+0000 7fc5ca427700 1 -- 172.21.15.46:0/884090357 wait complete. 2023-07-06T02:40:10.673 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:10.669+0000 7fc5ca427700 1 Processor -- start 2023-07-06T02:40:10.673 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:10.669+0000 7fc5ca427700 1 -- start start 2023-07-06T02:40:10.673 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:10.670+0000 7fc5ca427700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fc5c406b440 0x7fc5c415b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T02:40:10.673 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:10.670+0000 7fc5ca427700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc5c40cb950 0x7fc5c40b1040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T02:40:10.674 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:10.670+0000 7fc5ca427700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc5c40d10c0 0x7fc5c40b1580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T02:40:10.674 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:10.670+0000 7fc5ca427700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc5c41f6470 con 0x7fc5c40d10c0 2023-07-06T02:40:10.674 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:10.670+0000 7fc5ca427700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc5c40c7d90 con 0x7fc5c40cb950 2023-07-06T02:40:10.674 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:10.670+0000 7fc5ca427700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc5c40c8070 con 0x7fc5c406b440 2023-07-06T02:40:10.675 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:10.670+0000 7fc5bb7fe700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc5c40cb950 0x7fc5c40b1040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T02:40:10.675 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:10.670+0000 7fc5c89c4700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc5c40d10c0 0x7fc5c40b1580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T02:40:10.675 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:10.670+0000 7fc5bb7fe700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc5c40cb950 0x7fc5c40b1040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.46:45392/0 (socket says 172.21.15.46:45392) 2023-07-06T02:40:10.675 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:10.670+0000 7fc5bb7fe700 1 -- 172.21.15.46:0/1586664873 learned_addr learned my addr 172.21.15.46:0/1586664873 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-07-06T02:40:10.676 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:10.671+0000 7fc5bb7fe700 1 -- 172.21.15.46:0/1586664873 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fc5c406b440 msgr2=0x7fc5c415b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T02:40:10.676 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:10.671+0000 7fc5bb7fe700 1 --2- 172.21.15.46:0/1586664873 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fc5c406b440 0x7fc5c415b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T02:40:10.676 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:10.671+0000 7fc5bb7fe700 1 -- 172.21.15.46:0/1586664873 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc5c40d10c0 msgr2=0x7fc5c40b1580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T02:40:10.676 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:10.671+0000 7fc5bb7fe700 1 --2- 172.21.15.46:0/1586664873 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc5c40d10c0 0x7fc5c40b1580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T02:40:10.676 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:10.671+0000 7fc5bb7fe700 1 -- 172.21.15.46:0/1586664873 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc5ac009550 con 0x7fc5c40cb950 2023-07-06T02:40:10.676 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:10.671+0000 7fc5bb7fe700 1 --2- 172.21.15.46:0/1586664873 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc5c40cb950 0x7fc5c40b1040 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7fc5ac014040 tx=0x7fc5ac004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T02:40:10.676 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:10.671+0000 7fc5c17fa700 1 -- 172.21.15.46:0/1586664873 <== mon.1 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5ac004220 con 0x7fc5c40cb950 2023-07-06T02:40:10.677 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:10.671+0000 7fc5c17fa700 1 -- 172.21.15.46:0/1586664873 <== mon.1 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc5ac01f070 con 0x7fc5c40cb950 2023-07-06T02:40:10.677 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:10.671+0000 7fc5c17fa700 1 -- 172.21.15.46:0/1586664873 <== mon.1 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5ac01a700 con 0x7fc5c40cb950 2023-07-06T02:40:10.677 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:10.671+0000 7fc5ca427700 1 -- 172.21.15.46:0/1586664873 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc5c40c8350 con 0x7fc5c40cb950 2023-07-06T02:40:10.677 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:10.671+0000 7fc5ca427700 1 -- 172.21.15.46:0/1586664873 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc5c40c8b50 con 0x7fc5c40cb950 2023-07-06T02:40:10.677 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:10.674+0000 7fc5ca427700 1 -- 172.21.15.46:0/1586664873 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc5c404e1d0 con 0x7fc5c40cb950 2023-07-06T02:40:10.678 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:10.675+0000 7fc5c17fa700 1 -- 172.21.15.46:0/1586664873 <== mon.1 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fc5ac01a860 con 0x7fc5c40cb950 2023-07-06T02:40:10.678 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:10.675+0000 7fc5c17fa700 1 --2- 172.21.15.46:0/1586664873 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7fc5a406ace0 0x7fc5a406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T02:40:10.678 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:10.675+0000 7fc5c17fa700 1 -- 172.21.15.46:0/1586664873 <== mon.1 v2:172.21.15.73:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 6091+0+0 (secure 0 0 0) 0x7fc5ac021070 con 0x7fc5c40cb950 2023-07-06T02:40:10.679 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:10.675+0000 7fc5c3fff700 1 --2- 172.21.15.46:0/1586664873 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7fc5a406ace0 0x7fc5a406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T02:40:10.679 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:10.676+0000 7fc5c3fff700 1 --2- 172.21.15.46:0/1586664873 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7fc5a406ace0 0x7fc5a406d190 secure :-1 s=READY pgs=722 cs=0 l=1 rev1=1 crypto rx=0x7fc5b40097b0 tx=0x7fc5b4006d20 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T02:40:10.683 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:10.681+0000 7fc5c17fa700 1 -- 172.21.15.46:0/1586664873 <== mon.1 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fc5ac055b10 con 0x7fc5c40cb950 2023-07-06T02:40:11.006 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:11.002+0000 7fc5ca427700 1 -- 172.21.15.46:0/1586664873 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fc5c40672b0 con 0x7fc5c40cb950 2023-07-06T02:40:11.008 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:11.006+0000 7fc5c17fa700 1 -- 172.21.15.46:0/1586664873 <== mon.1 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v37) v1 ==== 74+0+18226 (secure 0 0 0) 0x7fc5ac02a090 con 0x7fc5c40cb950 2023-07-06T02:40:11.009 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-06T02:40:11.009 INFO:teuthology.orchestra.run.smithi046.stdout:{"epoch":37,"fsid":"042652d3-d80c-4ad8-9366-3e94f2a0a512","created":"2023-07-05T18:55:56.455710+0000","modified":"2023-07-05T18:58:04.356432+0000","last_up_change":"2023-07-05T18:56:06.594022+0000","last_in_change":"2023-07-05T18:55:58.879340+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-07-05T18:56:07.729620+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2023-07-05T18:56:08.128122+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2023-07-05T18:57:13.640396+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"34","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_data","create_time":"2023-07-05T18:57:14.333267+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"35","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"20009183-9a47-4392-8751-883f88d2bfb1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6813","nonce":4151971443},{"type":"v1","addr":"172.21.15.46:6815","nonce":4151971443}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6817","nonce":4151971443},{"type":"v1","addr":"172.21.15.46:6818","nonce":4151971443}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6822","nonce":4151971443},{"type":"v1","addr":"172.21.15.46:6823","nonce":4151971443}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6820","nonce":4151971443},{"type":"v1","addr":"172.21.15.46:6821","nonce":4151971443}]},"public_addr":"172.21.15.46:6815/4151971443","cluster_addr":"172.21.15.46:6818/4151971443","heartbeat_back_addr":"172.21.15.46:6823/4151971443","heartbeat_front_addr":"172.21.15.46:6821/4151971443","state":["exists","up"]},{"osd":1,"uuid":"91b4a7b0-e4e4-4888-a1fe-9edb0d68004c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6808","nonce":502575881},{"type":"v1","addr":"172.21.15.46:6809","nonce":502575881}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6810","nonce":502575881},{"type":"v1","addr":"172.21.15.46:6811","nonce":502575881}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6816","nonce":502575881},{"type":"v1","addr":"172.21.15.46:6819","nonce":502575881}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6812","nonce":502575881},{"type":"v1","addr":"172.21.15.46:6814","nonce":502575881}]},"public_addr":"172.21.15.46:6809/502575881","cluster_addr":"172.21.15.46:6811/502575881","heartbeat_back_addr":"172.21.15.46:6819/502575881","heartbeat_front_addr":"172.21.15.46:6814/502575881","state":["exists","up"]},{"osd":2,"uuid":"669ff744-1331-47c5-8579-0440731c889a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6800","nonce":2115251461},{"type":"v1","addr":"172.21.15.46:6801","nonce":2115251461}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6802","nonce":2115251461},{"type":"v1","addr":"172.21.15.46:6803","nonce":2115251461}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6806","nonce":2115251461},{"type":"v1","addr":"172.21.15.46:6807","nonce":2115251461}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6804","nonce":2115251461},{"type":"v1","addr":"172.21.15.46:6805","nonce":2115251461}]},"public_addr":"172.21.15.46:6801/2115251461","cluster_addr":"172.21.15.46:6803/2115251461","heartbeat_back_addr":"172.21.15.46:6807/2115251461","heartbeat_front_addr":"172.21.15.46:6805/2115251461","state":["exists","up"]},{"osd":3,"uuid":"34e1b86d-ffad-415d-861c-07a5f08068a6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6824","nonce":2981388766},{"type":"v1","addr":"172.21.15.46:6825","nonce":2981388766}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6826","nonce":2981388766},{"type":"v1","addr":"172.21.15.46:6827","nonce":2981388766}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6830","nonce":2981388766},{"type":"v1","addr":"172.21.15.46:6831","nonce":2981388766}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6828","nonce":2981388766},{"type":"v1","addr":"172.21.15.46:6829","nonce":2981388766}]},"public_addr":"172.21.15.46:6825/2981388766","cluster_addr":"172.21.15.46:6827/2981388766","heartbeat_back_addr":"172.21.15.46:6831/2981388766","heartbeat_front_addr":"172.21.15.46:6829/2981388766","state":["exists","up"]},{"osd":4,"uuid":"57ffcb91-c7dc-4a69-ae71-4d9622a14a05","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6800","nonce":2083655348},{"type":"v1","addr":"172.21.15.73:6801","nonce":2083655348}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6802","nonce":2083655348},{"type":"v1","addr":"172.21.15.73:6803","nonce":2083655348}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6806","nonce":2083655348},{"type":"v1","addr":"172.21.15.73:6807","nonce":2083655348}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6804","nonce":2083655348},{"type":"v1","addr":"172.21.15.73:6805","nonce":2083655348}]},"public_addr":"172.21.15.73:6801/2083655348","cluster_addr":"172.21.15.73:6803/2083655348","heartbeat_back_addr":"172.21.15.73:6807/2083655348","heartbeat_front_addr":"172.21.15.73:6805/2083655348","state":["exists","up"]},{"osd":5,"uuid":"665f41c9-ee20-49cf-bf0e-fbe0c03d3aed","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6824","nonce":2803788401},{"type":"v1","addr":"172.21.15.73:6825","nonce":2803788401}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6826","nonce":2803788401},{"type":"v1","addr":"172.21.15.73:6827","nonce":2803788401}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6830","nonce":2803788401},{"type":"v1","addr":"172.21.15.73:6831","nonce":2803788401}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6828","nonce":2803788401},{"type":"v1","addr":"172.21.15.73:6829","nonce":2803788401}]},"public_addr":"172.21.15.73:6825/2803788401","cluster_addr":"172.21.15.73:6827/2803788401","heartbeat_back_addr":"172.21.15.73:6831/2803788401","heartbeat_front_addr":"172.21.15.73:6829/2803788401","state":["exists","up"]},{"osd":6,"uuid":"5790c6cc-bd56-4ce4-9a7c-0f0c3b59215c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6808","nonce":974108383},{"type":"v1","addr":"172.21.15.73:6809","nonce":974108383}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6810","nonce":974108383},{"type":"v1","addr":"172.21.15.73:6811","nonce":974108383}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6815","nonce":974108383},{"type":"v1","addr":"172.21.15.73:6817","nonce":974108383}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6812","nonce":974108383},{"type":"v1","addr":"172.21.15.73:6813","nonce":974108383}]},"public_addr":"172.21.15.73:6809/974108383","cluster_addr":"172.21.15.73:6811/974108383","heartbeat_back_addr":"172.21.15.73:6817/974108383","heartbeat_front_addr":"172.21.15.73:6813/974108383","state":["exists","up"]},{"osd":7,"uuid":"b66f4d2e-147e-4c9b-97dd-cbd59d33802e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6814","nonce":3772673248},{"type":"v1","addr":"172.21.15.73:6816","nonce":3772673248}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6818","nonce":3772673248},{"type":"v1","addr":"172.21.15.73:6819","nonce":3772673248}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6822","nonce":3772673248},{"type":"v1","addr":"172.21.15.73:6823","nonce":3772673248}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6820","nonce":3772673248},{"type":"v1","addr":"172.21.15.73:6821","nonce":3772673248}]},"public_addr":"172.21.15.73:6816/3772673248","cluster_addr":"172.21.15.73:6819/3772673248","heartbeat_back_addr":"172.21.15.73:6823/3772673248","heartbeat_front_addr":"172.21.15.73:6821/3772673248","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-05T18:56:04.115334+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-05T18:56:04.071250+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-05T18:56:04.044387+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-05T18:56:04.085389+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-05T18:56:04.090726+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-05T18:56:04.074529+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-05T18:56:04.058841+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-05T18:56:04.043054+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"6.24","mappings":[{"from":5,"to":0}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-06T02:40:11.013 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:11.010+0000 7fc5ca427700 1 -- 172.21.15.46:0/1586664873 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7fc5a406ace0 msgr2=0x7fc5a406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T02:40:11.013 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:11.010+0000 7fc5ca427700 1 --2- 172.21.15.46:0/1586664873 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7fc5a406ace0 0x7fc5a406d190 secure :-1 s=READY pgs=722 cs=0 l=1 rev1=1 crypto rx=0x7fc5b40097b0 tx=0x7fc5b4006d20 comp rx=0 tx=0).stop 2023-07-06T02:40:11.014 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:11.010+0000 7fc5ca427700 1 -- 172.21.15.46:0/1586664873 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc5c40cb950 msgr2=0x7fc5c40b1040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T02:40:11.014 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:11.010+0000 7fc5ca427700 1 --2- 172.21.15.46:0/1586664873 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc5c40cb950 0x7fc5c40b1040 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7fc5ac014040 tx=0x7fc5ac004750 comp rx=0 tx=0).stop 2023-07-06T02:40:11.014 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:11.010+0000 7fc5ca427700 1 -- 172.21.15.46:0/1586664873 shutdown_connections 2023-07-06T02:40:11.014 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:11.010+0000 7fc5ca427700 1 --2- 172.21.15.46:0/1586664873 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7fc5a406ace0 0x7fc5a406d190 unknown :-1 s=CLOSED pgs=722 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T02:40:11.014 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:11.010+0000 7fc5ca427700 1 --2- 172.21.15.46:0/1586664873 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc5c40d10c0 0x7fc5c40b1580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T02:40:11.014 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:11.010+0000 7fc5ca427700 1 --2- 172.21.15.46:0/1586664873 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fc5c406b440 0x7fc5c415b9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T02:40:11.014 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:11.010+0000 7fc5ca427700 1 --2- 172.21.15.46:0/1586664873 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc5c40cb950 0x7fc5c40b1040 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T02:40:11.015 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:11.010+0000 7fc5ca427700 1 -- 172.21.15.46:0/1586664873 >> 172.21.15.46:0/1586664873 conn(0x7fc5c40664b0 msgr2=0x7fc5c40cd530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T02:40:11.015 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:11.010+0000 7fc5ca427700 1 -- 172.21.15.46:0/1586664873 shutdown_connections 2023-07-06T02:40:11.015 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:11.010+0000 7fc5ca427700 1 -- 172.21.15.46:0/1586664873 wait complete. 2023-07-06T02:40:11.034 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-07-06T02:40:11.035 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-06T02:40:11.219 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:11.216+0000 7fda642f2700 1 Processor -- start 2023-07-06T02:40:11.219 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:11.216+0000 7fda642f2700 1 -- start start 2023-07-06T02:40:11.220 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:11.217+0000 7fda642f2700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fda5c142480 0x7fda5c0b41d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T02:40:11.221 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:11.217+0000 7fda642f2700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fda5c0b4710 0x7fda5c06d140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T02:40:11.221 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:11.217+0000 7fda642f2700 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fda5c06c8d0 con 0x7fda5c13f4c0 2023-07-06T02:40:11.221 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:11.217+0000 7fda642f2700 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fda5c06ce90 con 0x7fda5c0b4710 2023-07-06T02:40:11.221 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:11.217+0000 7fda642f2700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fda5c06cbb0 con 0x7fda5c142480 2023-07-06T02:40:11.221 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:11.218+0000 7fda6288f700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fda5c0b4710 0x7fda5c06d140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T02:40:11.222 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:11.218+0000 7fda6288f700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fda5c0b4710 0x7fda5c06d140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.46:45402/0 (socket says 172.21.15.46:45402) 2023-07-06T02:40:11.222 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:11.218+0000 7fda6288f700 1 -- 172.21.15.46:0/1316500651 learned_addr learned my addr 172.21.15.46:0/1316500651 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-07-06T02:40:11.223 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:11.218+0000 7fda6188d700 1 --2- 172.21.15.46:0/1316500651 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fda5c142480 0x7fda5c0b41d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T02:40:11.223 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:11.218+0000 7fda6108c700 1 -- 172.21.15.46:0/1316500651 <== mon.1 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2506381674 0 0) 0x7fda5c06c8d0 con 0x7fda5c13f4c0 2023-07-06T02:40:11.223 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:11.218+0000 7fda6108c700 1 -- 172.21.15.46:0/1316500651 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fda480035b0 con 0x7fda5c13f4c0 2023-07-06T02:40:11.223 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:11.218+0000 7fda6288f700 1 -- 172.21.15.46:0/1316500651 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fda5c142480 msgr2=0x7fda5c0b41d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T02:40:11.224 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:11.218+0000 7fda6288f700 1 --2- 172.21.15.46:0/1316500651 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fda5c142480 0x7fda5c0b41d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T02:40:11.224 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:11.218+0000 7fda6288f700 1 -- 172.21.15.46:0/1316500651 >> v1:172.21.15.73:6789/0 conn(0x7fda5c13f4c0 legacy=0x7fda5c15d6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T02:40:11.224 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:11.218+0000 7fda6288f700 1 -- 172.21.15.46:0/1316500651 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda5c0b39d0 con 0x7fda5c0b4710 2023-07-06T02:40:11.224 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:11.218+0000 7fda6188d700 1 --2- 172.21.15.46:0/1316500651 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fda5c142480 0x7fda5c0b41d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-06T02:40:11.224 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:11.219+0000 7fda6288f700 1 --2- 172.21.15.46:0/1316500651 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fda5c0b4710 0x7fda5c06d140 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7fda5400d150 tx=0x7fda5400d460 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f179bdb09945f059 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T02:40:11.224 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:11.219+0000 7fda6108c700 1 -- 172.21.15.46:0/1316500651 <== mon.1 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda54010070 con 0x7fda5c0b4710 2023-07-06T02:40:11.224 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:11.219+0000 7fda6108c700 1 -- 172.21.15.46:0/1316500651 <== mon.1 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fda5400dd10 con 0x7fda5c0b4710 2023-07-06T02:40:11.225 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:11.219+0000 7fda6108c700 1 -- 172.21.15.46:0/1316500651 <== mon.1 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda5400b310 con 0x7fda5c0b4710 2023-07-06T02:40:11.225 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:11.220+0000 7fda642f2700 1 -- 172.21.15.46:0/1316500651 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fda5c0b4710 msgr2=0x7fda5c06d140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T02:40:11.225 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:11.220+0000 7fda642f2700 1 --2- 172.21.15.46:0/1316500651 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fda5c0b4710 0x7fda5c06d140 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7fda5400d150 tx=0x7fda5400d460 comp rx=0 tx=0).stop 2023-07-06T02:40:11.225 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:11.220+0000 7fda642f2700 1 -- 172.21.15.46:0/1316500651 shutdown_connections 2023-07-06T02:40:11.225 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:11.220+0000 7fda642f2700 1 --2- 172.21.15.46:0/1316500651 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fda5c0b4710 0x7fda5c06d140 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T02:40:11.225 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:11.220+0000 7fda642f2700 1 --2- 172.21.15.46:0/1316500651 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fda5c142480 0x7fda5c0b41d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T02:40:11.225 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:11.220+0000 7fda642f2700 1 -- 172.21.15.46:0/1316500651 >> 172.21.15.46:0/1316500651 conn(0x7fda5c06af10 msgr2=0x7fda5c06b2e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T02:40:11.225 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:11.220+0000 7fda642f2700 1 -- 172.21.15.46:0/1316500651 shutdown_connections 2023-07-06T02:40:11.226 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:11.220+0000 7fda642f2700 1 -- 172.21.15.46:0/1316500651 wait complete. 2023-07-06T02:40:11.227 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:11.221+0000 7fda642f2700 1 Processor -- start 2023-07-06T02:40:11.227 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:11.222+0000 7fda642f2700 1 -- start start 2023-07-06T02:40:11.227 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:11.223+0000 7fda642f2700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fda5c0b4710 0x7fda5c1559f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T02:40:11.228 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:11.223+0000 7fda642f2700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fda5c13f4c0 0x7fda5c141030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T02:40:11.228 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:11.223+0000 7fda642f2700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fda5c142480 0x7fda5c13d2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T02:40:11.228 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:11.223+0000 7fda642f2700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda5c155f30 con 0x7fda5c13f4c0 2023-07-06T02:40:11.228 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:11.223+0000 7fda642f2700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda5c15af60 con 0x7fda5c142480 2023-07-06T02:40:11.228 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:11.223+0000 7fda642f2700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fda5c15b240 con 0x7fda5c0b4710 2023-07-06T02:40:11.228 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:11.223+0000 7fda6188d700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fda5c13f4c0 0x7fda5c141030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T02:40:11.228 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:11.223+0000 7fda6188d700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fda5c13f4c0 0x7fda5c141030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:45920/0 (socket says 172.21.15.46:45920) 2023-07-06T02:40:11.229 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:11.223+0000 7fda6188d700 1 -- 172.21.15.46:0/2747895899 learned_addr learned my addr 172.21.15.46:0/2747895899 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-07-06T02:40:11.229 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:11.223+0000 7fda6288f700 1 --2- 172.21.15.46:0/2747895899 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fda5c142480 0x7fda5c13d2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T02:40:11.229 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:11.223+0000 7fda6188d700 1 -- 172.21.15.46:0/2747895899 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fda5c0b4710 msgr2=0x7fda5c1559f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T02:40:11.229 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:11.223+0000 7fda6188d700 1 --2- 172.21.15.46:0/2747895899 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fda5c0b4710 0x7fda5c1559f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T02:40:11.229 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:11.223+0000 7fda6188d700 1 -- 172.21.15.46:0/2747895899 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fda5c142480 msgr2=0x7fda5c13d2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T02:40:11.229 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:11.223+0000 7fda6188d700 1 --2- 172.21.15.46:0/2747895899 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fda5c142480 0x7fda5c13d2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T02:40:11.229 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:11.223+0000 7fda6188d700 1 -- 172.21.15.46:0/2747895899 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda580094a0 con 0x7fda5c13f4c0 2023-07-06T02:40:11.230 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:11.223+0000 7fda6288f700 1 --2- 172.21.15.46:0/2747895899 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fda5c142480 0x7fda5c13d2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-06T02:40:11.230 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:11.224+0000 7fda6188d700 1 --2- 172.21.15.46:0/2747895899 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fda5c13f4c0 0x7fda5c141030 secure :-1 s=READY pgs=3220 cs=0 l=1 rev1=1 crypto rx=0x7fda5800ebe0 tx=0x7fda5800eef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T02:40:11.230 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:11.224+0000 7fda52ffd700 1 -- 172.21.15.46:0/2747895899 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda5800c850 con 0x7fda5c13f4c0 2023-07-06T02:40:11.230 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:11.224+0000 7fda52ffd700 1 -- 172.21.15.46:0/2747895899 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fda5800c9b0 con 0x7fda5c13f4c0 2023-07-06T02:40:11.230 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:11.224+0000 7fda52ffd700 1 -- 172.21.15.46:0/2747895899 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda5800cd40 con 0x7fda5c13f4c0 2023-07-06T02:40:11.230 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:11.224+0000 7fda642f2700 1 -- 172.21.15.46:0/2747895899 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fda5400bd40 con 0x7fda5c13f4c0 2023-07-06T02:40:11.230 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:11.224+0000 7fda642f2700 1 -- 172.21.15.46:0/2747895899 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fda5c15b800 con 0x7fda5c13f4c0 2023-07-06T02:40:11.231 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:11.225+0000 7fda642f2700 1 -- 172.21.15.46:0/2747895899 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fda5c15be50 con 0x7fda5c13f4c0 2023-07-06T02:40:11.231 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:11.226+0000 7fda52ffd700 1 -- 172.21.15.46:0/2747895899 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fda58013470 con 0x7fda5c13f4c0 2023-07-06T02:40:11.231 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:11.227+0000 7fda52ffd700 1 --2- 172.21.15.46:0/2747895899 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7fda4006ace0 0x7fda4006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T02:40:11.231 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:11.227+0000 7fda52ffd700 1 -- 172.21.15.46:0/2747895899 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 6091+0+0 (secure 0 0 0) 0x7fda58089530 con 0x7fda5c13f4c0 2023-07-06T02:40:11.232 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:11.227+0000 7fda6208e700 1 --2- 172.21.15.46:0/2747895899 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7fda4006ace0 0x7fda4006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T02:40:11.232 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:11.227+0000 7fda6208e700 1 --2- 172.21.15.46:0/2747895899 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7fda4006ace0 0x7fda4006d190 secure :-1 s=READY pgs=723 cs=0 l=1 rev1=1 crypto rx=0x7fda4c007fd0 tx=0x7fda4c007980 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T02:40:11.234 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:11.231+0000 7fda52ffd700 1 -- 172.21.15.46:0/2747895899 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fda580545c0 con 0x7fda5c13f4c0 2023-07-06T02:40:11.592 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:11.589+0000 7fda642f2700 1 -- 172.21.15.46:0/2747895899 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fda5c0672e0 con 0x7fda5c13f4c0 2023-07-06T02:40:11.594 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:11.592+0000 7fda52ffd700 1 -- 172.21.15.46:0/2747895899 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 15 v15) v1 ==== 94+0+4665 (secure 0 0 0) 0x7fda5800cea0 con 0x7fda5c13f4c0 2023-07-06T02:40:11.595 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-06T02:40:11.595 INFO:teuthology.orchestra.run.smithi046.stdout:{"epoch":15,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4823,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.73:6837/1783526483","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6835","nonce":1783526483},{"type":"v1","addr":"172.21.15.73:6837","nonce":1783526483}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":4826,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.46:6834/1224451753","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6832","nonce":1224451753},{"type":"v1","addr":"172.21.15.46:6834","nonce":1224451753}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":4829,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.46:6835/549881285","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6833","nonce":549881285},{"type":"v1","addr":"172.21.15.46:6835","nonce":549881285}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":15,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-07-05T18:57:15.279563+0000","modified":"2023-07-05T18:57:18.286904+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5086},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5086":{"gid":5086,"name":"b","rank":0,"incarnation":12,"state":"up:active","state_seq":3,"addr":"172.21.15.73:6836/255434995","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6834","nonce":255434995},{"type":"v1","addr":"172.21.15.73:6836","nonce":255434995}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2023-07-06T02:40:11.599 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:11.596+0000 7fda642f2700 1 -- 172.21.15.46:0/2747895899 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7fda4006ace0 msgr2=0x7fda4006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T02:40:11.599 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:11.596+0000 7fda642f2700 1 --2- 172.21.15.46:0/2747895899 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7fda4006ace0 0x7fda4006d190 secure :-1 s=READY pgs=723 cs=0 l=1 rev1=1 crypto rx=0x7fda4c007fd0 tx=0x7fda4c007980 comp rx=0 tx=0).stop 2023-07-06T02:40:11.599 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:11.596+0000 7fda642f2700 1 -- 172.21.15.46:0/2747895899 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fda5c13f4c0 msgr2=0x7fda5c141030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T02:40:11.599 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:11.596+0000 7fda642f2700 1 --2- 172.21.15.46:0/2747895899 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fda5c13f4c0 0x7fda5c141030 secure :-1 s=READY pgs=3220 cs=0 l=1 rev1=1 crypto rx=0x7fda5800ebe0 tx=0x7fda5800eef0 comp rx=0 tx=0).stop 2023-07-06T02:40:11.599 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:11.596+0000 7fda642f2700 1 -- 172.21.15.46:0/2747895899 shutdown_connections 2023-07-06T02:40:11.600 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:11.596+0000 7fda642f2700 1 --2- 172.21.15.46:0/2747895899 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7fda4006ace0 0x7fda4006d190 unknown :-1 s=CLOSED pgs=723 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T02:40:11.600 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:11.596+0000 7fda642f2700 1 --2- 172.21.15.46:0/2747895899 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fda5c142480 0x7fda5c13d2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T02:40:11.600 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:11.596+0000 7fda642f2700 1 --2- 172.21.15.46:0/2747895899 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fda5c0b4710 0x7fda5c1559f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T02:40:11.600 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:11.596+0000 7fda642f2700 1 --2- 172.21.15.46:0/2747895899 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fda5c13f4c0 0x7fda5c141030 unknown :-1 s=CLOSED pgs=3220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T02:40:11.600 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:11.596+0000 7fda642f2700 1 -- 172.21.15.46:0/2747895899 >> 172.21.15.46:0/2747895899 conn(0x7fda5c06af10 msgr2=0x7fda5c0b1690 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T02:40:11.600 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:11.596+0000 7fda642f2700 1 -- 172.21.15.46:0/2747895899 shutdown_connections 2023-07-06T02:40:11.600 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:11.596+0000 7fda642f2700 1 -- 172.21.15.46:0/2747895899 wait complete. 2023-07-06T02:40:11.614 INFO:teuthology.orchestra.run.smithi046.stderr:dumped fsmap epoch 15 2023-07-06T02:40:11.628 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-06T02:40:11.839 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:11.836+0000 7fc6302d9700 1 Processor -- start 2023-07-06T02:40:11.840 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:11.836+0000 7fc6302d9700 1 -- start start 2023-07-06T02:40:11.841 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:11.838+0000 7fc6302d9700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fc6281584b0 0x7fc62815c100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T02:40:11.841 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:11.838+0000 7fc6302d9700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fc6280ade50 0x7fc628069e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T02:40:11.841 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:11.838+0000 7fc6302d9700 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc628071110 con 0x7fc62806da80 2023-07-06T02:40:11.841 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:11.838+0000 7fc6302d9700 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc628071930 con 0x7fc6280ade50 2023-07-06T02:40:11.841 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:11.838+0000 7fc6302d9700 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc6280713b0 con 0x7fc6281584b0 2023-07-06T02:40:11.842 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:11.838+0000 7fc62e075700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fc6281584b0 0x7fc62815c100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T02:40:11.842 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:11.838+0000 7fc62e075700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fc6281584b0 0x7fc62815c100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.46:45412/0 (socket says 172.21.15.46:45412) 2023-07-06T02:40:11.842 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:11.838+0000 7fc62e075700 1 -- 172.21.15.46:0/1727851923 learned_addr learned my addr 172.21.15.46:0/1727851923 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-07-06T02:40:11.842 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:11.838+0000 7fc62e075700 1 -- 172.21.15.46:0/1727851923 >> v2:172.21.15.46:3300/0 conn(0x7fc6280ade50 msgr2=0x7fc628069e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T02:40:11.843 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:11.838+0000 7fc62e075700 1 --2- 172.21.15.46:0/1727851923 >> v2:172.21.15.46:3300/0 conn(0x7fc6280ade50 0x7fc628069e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T02:40:11.843 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:11.838+0000 7fc62e075700 1 -- 172.21.15.46:0/1727851923 >> v1:172.21.15.46:6789/0 conn(0x7fc62806da80 legacy=0x7fc6280ccb40 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-07-06T02:40:11.843 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:11.839+0000 7fc62e075700 1 -- 172.21.15.46:0/1727851923 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc62806fc70 con 0x7fc6281584b0 2023-07-06T02:40:11.843 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:11.839+0000 7fc62e075700 1 --2- 172.21.15.46:0/1727851923 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc6281584b0 0x7fc62815c100 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7fc62806b290 tx=0x7fc62000c770 comp rx=0 tx=0).ready entity=mon.1 client_cookie=11629a43fb71b724 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T02:40:11.843 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:11.839+0000 7fc62d073700 1 -- 172.21.15.46:0/1727851923 <== mon.1 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc620003c20 con 0x7fc6281584b0 2023-07-06T02:40:11.843 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:11.839+0000 7fc62d073700 1 -- 172.21.15.46:0/1727851923 <== mon.1 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc620003d80 con 0x7fc6281584b0 2023-07-06T02:40:11.844 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:11.839+0000 7fc62d073700 1 -- 172.21.15.46:0/1727851923 <== mon.1 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc620004270 con 0x7fc6281584b0 2023-07-06T02:40:11.844 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:11.840+0000 7fc6302d9700 1 -- 172.21.15.46:0/1727851923 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc6281584b0 msgr2=0x7fc62815c100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T02:40:11.844 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:11.840+0000 7fc6302d9700 1 --2- 172.21.15.46:0/1727851923 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc6281584b0 0x7fc62815c100 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7fc62806b290 tx=0x7fc62000c770 comp rx=0 tx=0).stop 2023-07-06T02:40:11.847 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:11.844+0000 7fc6302d9700 1 -- 172.21.15.46:0/1727851923 shutdown_connections 2023-07-06T02:40:11.847 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:11.844+0000 7fc6302d9700 1 --2- 172.21.15.46:0/1727851923 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc6281584b0 0x7fc62815c100 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T02:40:11.847 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:11.844+0000 7fc6302d9700 1 --2- 172.21.15.46:0/1727851923 >> v2:172.21.15.46:3300/0 conn(0x7fc6280ade50 0x7fc628069e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T02:40:11.847 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:11.844+0000 7fc6302d9700 1 -- 172.21.15.46:0/1727851923 >> 172.21.15.46:0/1727851923 conn(0x7fc6280ce860 msgr2=0x7fc6280cec30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T02:40:11.848 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:11.846+0000 7fc6302d9700 1 -- 172.21.15.46:0/1727851923 shutdown_connections 2023-07-06T02:40:11.849 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:11.847+0000 7fc6302d9700 1 -- 172.21.15.46:0/1727851923 wait complete. 2023-07-06T02:40:11.855 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:11.848+0000 7fc6302d9700 1 Processor -- start 2023-07-06T02:40:11.856 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:11.848+0000 7fc6302d9700 1 -- start start 2023-07-06T02:40:11.856 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:11.849+0000 7fc6302d9700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fc62806da80 0x7fc62815b280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T02:40:11.856 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:11.849+0000 7fc6302d9700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc6280ade50 0x7fc6280c2370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T02:40:11.856 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:11.849+0000 7fc6302d9700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc6281584b0 0x7fc6280b3bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T02:40:11.856 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:11.849+0000 7fc6302d9700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6280c28b0 con 0x7fc6281584b0 2023-07-06T02:40:11.856 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:11.849+0000 7fc6302d9700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6280c36d0 con 0x7fc6280ade50 2023-07-06T02:40:11.857 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:11.849+0000 7fc6302d9700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc6280c2ac0 con 0x7fc62806da80 2023-07-06T02:40:11.857 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:11.849+0000 7fc62d874700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc6280ade50 0x7fc6280c2370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T02:40:11.857 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:11.849+0000 7fc62e876700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc6281584b0 0x7fc6280b3bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T02:40:11.857 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:11.849+0000 7fc62d874700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc6280ade50 0x7fc6280c2370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.46:45416/0 (socket says 172.21.15.46:45416) 2023-07-06T02:40:11.857 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:11.849+0000 7fc62e876700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc6281584b0 0x7fc6280b3bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:45936/0 (socket says 172.21.15.46:45936) 2023-07-06T02:40:11.857 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:11.849+0000 7fc62d874700 1 -- 172.21.15.46:0/2541063385 learned_addr learned my addr 172.21.15.46:0/2541063385 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-07-06T02:40:11.857 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:11.849+0000 7fc62e075700 1 --2- 172.21.15.46:0/2541063385 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fc62806da80 0x7fc62815b280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T02:40:11.859 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:11.850+0000 7fc62d874700 1 -- 172.21.15.46:0/2541063385 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fc62806da80 msgr2=0x7fc62815b280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T02:40:11.859 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:11.850+0000 7fc62d874700 1 --2- 172.21.15.46:0/2541063385 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fc62806da80 0x7fc62815b280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T02:40:11.859 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:11.850+0000 7fc62d874700 1 -- 172.21.15.46:0/2541063385 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc6281584b0 msgr2=0x7fc6280b3bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T02:40:11.859 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:11.850+0000 7fc62d874700 1 --2- 172.21.15.46:0/2541063385 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc6281584b0 0x7fc6280b3bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T02:40:11.860 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:11.850+0000 7fc62d874700 1 -- 172.21.15.46:0/2541063385 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc62000c3d0 con 0x7fc6280ade50 2023-07-06T02:40:11.860 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:11.850+0000 7fc62d874700 1 --2- 172.21.15.46:0/2541063385 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc6280ade50 0x7fc6280c2370 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fc61800b500 tx=0x7fc61800b810 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T02:40:11.860 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:11.850+0000 7fc626ffd700 1 -- 172.21.15.46:0/2541063385 <== mon.1 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc618011830 con 0x7fc6280ade50 2023-07-06T02:40:11.860 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:11.850+0000 7fc626ffd700 1 -- 172.21.15.46:0/2541063385 <== mon.1 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc618011990 con 0x7fc6280ade50 2023-07-06T02:40:11.860 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:11.850+0000 7fc626ffd700 1 -- 172.21.15.46:0/2541063385 <== mon.1 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc618011d40 con 0x7fc6280ade50 2023-07-06T02:40:11.860 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:11.850+0000 7fc6302d9700 1 -- 172.21.15.46:0/2541063385 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc6280c2da0 con 0x7fc6280ade50 2023-07-06T02:40:11.861 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:11.851+0000 7fc6302d9700 1 -- 172.21.15.46:0/2541063385 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc6280c3360 con 0x7fc6280ade50 2023-07-06T02:40:11.861 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:11.852+0000 7fc626ffd700 1 -- 172.21.15.46:0/2541063385 <== mon.1 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fc61801a400 con 0x7fc6280ade50 2023-07-06T02:40:11.862 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:11.853+0000 7fc626ffd700 1 --2- 172.21.15.46:0/2541063385 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7fc6100aee70 0x7fc6100b1320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T02:40:11.862 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:11.853+0000 7fc626ffd700 1 -- 172.21.15.46:0/2541063385 <== mon.1 v2:172.21.15.73:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 6091+0+0 (secure 0 0 0) 0x7fc618089490 con 0x7fc6280ade50 2023-07-06T02:40:11.862 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:11.854+0000 7fc62e075700 1 --2- 172.21.15.46:0/2541063385 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7fc6100aee70 0x7fc6100b1320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T02:40:11.862 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:11.854+0000 7fc62e075700 1 --2- 172.21.15.46:0/2541063385 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7fc6100aee70 0x7fc6100b1320 secure :-1 s=READY pgs=724 cs=0 l=1 rev1=1 crypto rx=0x7fc62000c7b0 tx=0x7fc620009000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T02:40:11.862 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:11.855+0000 7fc6302d9700 1 -- 172.21.15.46:0/2541063385 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc6080052f0 con 0x7fc6280ade50 2023-07-06T02:40:11.864 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:11.861+0000 7fc626ffd700 1 -- 172.21.15.46:0/2541063385 <== mon.1 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fc618054480 con 0x7fc6280ade50 2023-07-06T02:40:12.253 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:12.250+0000 7fc6302d9700 1 -- 172.21.15.46:0/2541063385 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fc608005b20 con 0x7fc6280ade50 2023-07-06T02:40:12.254 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:12.251+0000 7fc626ffd700 1 -- 172.21.15.46:0/2541063385 <== mon.1 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 15 v15) v1 ==== 94+0+4665 (secure 0 0 0) 0x7fc618015030 con 0x7fc6280ade50 2023-07-06T02:40:12.254 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-06T02:40:12.254 INFO:teuthology.orchestra.run.smithi046.stdout:{"epoch":15,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4823,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.73:6837/1783526483","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6835","nonce":1783526483},{"type":"v1","addr":"172.21.15.73:6837","nonce":1783526483}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":4826,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.46:6834/1224451753","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6832","nonce":1224451753},{"type":"v1","addr":"172.21.15.46:6834","nonce":1224451753}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":4829,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.46:6835/549881285","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6833","nonce":549881285},{"type":"v1","addr":"172.21.15.46:6835","nonce":549881285}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":15,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-07-05T18:57:15.279563+0000","modified":"2023-07-05T18:57:18.286904+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5086},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5086":{"gid":5086,"name":"b","rank":0,"incarnation":12,"state":"up:active","state_seq":3,"addr":"172.21.15.73:6836/255434995","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6834","nonce":255434995},{"type":"v1","addr":"172.21.15.73:6836","nonce":255434995}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2023-07-06T02:40:12.256 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:12.254+0000 7fc6302d9700 1 -- 172.21.15.46:0/2541063385 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7fc6100aee70 msgr2=0x7fc6100b1320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T02:40:12.257 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:12.254+0000 7fc6302d9700 1 --2- 172.21.15.46:0/2541063385 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7fc6100aee70 0x7fc6100b1320 secure :-1 s=READY pgs=724 cs=0 l=1 rev1=1 crypto rx=0x7fc62000c7b0 tx=0x7fc620009000 comp rx=0 tx=0).stop 2023-07-06T02:40:12.257 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:12.254+0000 7fc6302d9700 1 -- 172.21.15.46:0/2541063385 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc6280ade50 msgr2=0x7fc6280c2370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T02:40:12.257 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:12.254+0000 7fc6302d9700 1 --2- 172.21.15.46:0/2541063385 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc6280ade50 0x7fc6280c2370 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fc61800b500 tx=0x7fc61800b810 comp rx=0 tx=0).stop 2023-07-06T02:40:12.257 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:12.255+0000 7fc6302d9700 1 -- 172.21.15.46:0/2541063385 shutdown_connections 2023-07-06T02:40:12.257 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:12.255+0000 7fc6302d9700 1 --2- 172.21.15.46:0/2541063385 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7fc6100aee70 0x7fc6100b1320 unknown :-1 s=CLOSED pgs=724 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T02:40:12.258 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:12.255+0000 7fc6302d9700 1 --2- 172.21.15.46:0/2541063385 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc6281584b0 0x7fc6280b3bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T02:40:12.258 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:12.255+0000 7fc6302d9700 1 --2- 172.21.15.46:0/2541063385 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fc62806da80 0x7fc62815b280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T02:40:12.258 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:12.255+0000 7fc6302d9700 1 --2- 172.21.15.46:0/2541063385 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc6280ade50 0x7fc6280c2370 secure :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fc61800b500 tx=0x7fc61800b810 comp rx=0 tx=0).stop 2023-07-06T02:40:12.258 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:12.255+0000 7fc6302d9700 1 -- 172.21.15.46:0/2541063385 >> 172.21.15.46:0/2541063385 conn(0x7fc6280ce860 msgr2=0x7fc62806b5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T02:40:12.261 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:12.259+0000 7fc6302d9700 1 -- 172.21.15.46:0/2541063385 shutdown_connections 2023-07-06T02:40:12.261 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:12.259+0000 7fc6302d9700 1 -- 172.21.15.46:0/2541063385 wait complete. 2023-07-06T02:40:12.262 INFO:teuthology.orchestra.run.smithi046.stderr:dumped fsmap epoch 15 2023-07-06T02:40:12.282 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-06T02:40:12.313 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-06T02:40:12.328 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-06T02:40:12.481 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:12.479+0000 7fc6da173700 1 Processor -- start 2023-07-06T02:40:12.482 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:12.479+0000 7fc6da173700 1 -- start start 2023-07-06T02:40:12.482 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:12.480+0000 7fc6da173700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fc6d4142480 0x7fc6d40b41d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T02:40:12.483 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:12.480+0000 7fc6da173700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fc6d40b4710 0x7fc6d406d140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T02:40:12.483 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:12.480+0000 7fc6da173700 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc6d406c8d0 con 0x7fc6d413f4c0 2023-07-06T02:40:12.483 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:12.480+0000 7fc6da173700 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc6d406ce90 con 0x7fc6d4142480 2023-07-06T02:40:12.483 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:12.480+0000 7fc6da173700 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc6d406cbb0 con 0x7fc6d40b4710 2023-07-06T02:40:12.483 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:12.480+0000 7fc6d37fe700 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7fc6d413f4c0 0x7fc6d415d6a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:45212/0 (socket says 172.21.15.46:45212) 2023-07-06T02:40:12.484 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:12.480+0000 7fc6d37fe700 1 -- 172.21.15.46:0/2609441139 learned_addr learned my addr 172.21.15.46:0/2609441139 (peer_addr_for_me v1:172.21.15.46:0/0) 2023-07-06T02:40:12.484 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:12.480+0000 7fc6d2ffd700 1 --2- 172.21.15.46:0/2609441139 >> v2:172.21.15.46:3300/0 conn(0x7fc6d4142480 0x7fc6d40b41d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T02:40:12.485 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:12.480+0000 7fc6d3fff700 1 --2- 172.21.15.46:0/2609441139 >> v2:172.21.15.73:3300/0 conn(0x7fc6d40b4710 0x7fc6d406d140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T02:40:12.485 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:12.480+0000 7fc6d27fc700 1 -- 172.21.15.46:0/2609441139 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2419137239 0 0) 0x7fc6d406c8d0 con 0x7fc6d413f4c0 2023-07-06T02:40:12.485 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:12.480+0000 7fc6d27fc700 1 -- 172.21.15.46:0/2609441139 --> v1:172.21.15.46:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc6bc0035b0 con 0x7fc6d413f4c0 2023-07-06T02:40:12.485 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:12.480+0000 7fc6d2ffd700 1 -- 172.21.15.46:0/2609441139 >> v2:172.21.15.73:3300/0 conn(0x7fc6d40b4710 msgr2=0x7fc6d406d140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T02:40:12.486 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:12.480+0000 7fc6d2ffd700 1 --2- 172.21.15.46:0/2609441139 >> v2:172.21.15.73:3300/0 conn(0x7fc6d40b4710 0x7fc6d406d140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T02:40:12.486 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:12.480+0000 7fc6d2ffd700 1 -- 172.21.15.46:0/2609441139 >> v1:172.21.15.46:6789/0 conn(0x7fc6d413f4c0 legacy=0x7fc6d415d6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T02:40:12.486 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:12.480+0000 7fc6d2ffd700 1 -- 172.21.15.46:0/2609441139 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc6d40b39d0 con 0x7fc6d4142480 2023-07-06T02:40:12.486 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:12.481+0000 7fc6d2ffd700 1 --2- 172.21.15.46:0/2609441139 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc6d4142480 0x7fc6d40b41d0 secure :-1 s=READY pgs=3222 cs=0 l=1 rev1=1 crypto rx=0x7fc6d41428f0 tx=0x7fc6c8009b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=495347064f6beb8b server_cookie=0 in_seq=0 out_seq=0 2023-07-06T02:40:12.486 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:12.481+0000 7fc6d27fc700 1 -- 172.21.15.46:0/2609441139 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6c8011830 con 0x7fc6d4142480 2023-07-06T02:40:12.486 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:12.481+0000 7fc6d27fc700 1 -- 172.21.15.46:0/2609441139 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc6c8011990 con 0x7fc6d4142480 2023-07-06T02:40:12.486 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:12.481+0000 7fc6d27fc700 1 -- 172.21.15.46:0/2609441139 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6c8011d20 con 0x7fc6d4142480 2023-07-06T02:40:12.487 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:12.482+0000 7fc6da173700 1 -- 172.21.15.46:0/2609441139 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc6d4142480 msgr2=0x7fc6d40b41d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T02:40:12.487 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:12.482+0000 7fc6da173700 1 --2- 172.21.15.46:0/2609441139 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc6d4142480 0x7fc6d40b41d0 secure :-1 s=READY pgs=3222 cs=0 l=1 rev1=1 crypto rx=0x7fc6d41428f0 tx=0x7fc6c8009b20 comp rx=0 tx=0).stop 2023-07-06T02:40:12.487 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:12.482+0000 7fc6da173700 1 -- 172.21.15.46:0/2609441139 shutdown_connections 2023-07-06T02:40:12.487 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:12.482+0000 7fc6da173700 1 --2- 172.21.15.46:0/2609441139 >> v2:172.21.15.73:3300/0 conn(0x7fc6d40b4710 0x7fc6d406d140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T02:40:12.487 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:12.482+0000 7fc6da173700 1 --2- 172.21.15.46:0/2609441139 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc6d4142480 0x7fc6d40b41d0 unknown :-1 s=CLOSED pgs=3222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T02:40:12.487 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:12.482+0000 7fc6da173700 1 -- 172.21.15.46:0/2609441139 >> 172.21.15.46:0/2609441139 conn(0x7fc6d406af10 msgr2=0x7fc6d406b2e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T02:40:12.487 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:12.482+0000 7fc6da173700 1 -- 172.21.15.46:0/2609441139 shutdown_connections 2023-07-06T02:40:12.488 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:12.482+0000 7fc6da173700 1 -- 172.21.15.46:0/2609441139 wait complete. 2023-07-06T02:40:12.489 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:12.483+0000 7fc6da173700 1 Processor -- start 2023-07-06T02:40:12.489 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:12.484+0000 7fc6da173700 1 -- start start 2023-07-06T02:40:12.489 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:12.485+0000 7fc6da173700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fc6d40b4710 0x7fc6d416ae20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T02:40:12.489 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:12.485+0000 7fc6da173700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc6d413f4c0 0x7fc6d4069e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T02:40:12.490 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:12.485+0000 7fc6da173700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc6d4142480 0x7fc6d406a340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T02:40:12.490 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:12.485+0000 7fc6da173700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6d413aea0 con 0x7fc6d413f4c0 2023-07-06T02:40:12.490 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:12.485+0000 7fc6da173700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6d415ca10 con 0x7fc6d4142480 2023-07-06T02:40:12.490 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:12.485+0000 7fc6da173700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc6d415cc90 con 0x7fc6d40b4710 2023-07-06T02:40:12.490 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:12.485+0000 7fc6d37fe700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fc6d40b4710 0x7fc6d416ae20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T02:40:12.490 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:12.485+0000 7fc6d37fe700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fc6d40b4710 0x7fc6d416ae20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3301/0 says I am v2:172.21.15.46:57864/0 (socket says 172.21.15.46:57864) 2023-07-06T02:40:12.490 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:12.485+0000 7fc6d37fe700 1 -- 172.21.15.46:0/2682184854 learned_addr learned my addr 172.21.15.46:0/2682184854 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-07-06T02:40:12.491 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:12.485+0000 7fc6d37fe700 1 -- 172.21.15.46:0/2682184854 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc6d4142480 msgr2=0x7fc6d406a340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T02:40:12.491 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:12.485+0000 7fc6d37fe700 1 --2- 172.21.15.46:0/2682184854 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc6d4142480 0x7fc6d406a340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T02:40:12.491 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:12.485+0000 7fc6d37fe700 1 -- 172.21.15.46:0/2682184854 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc6d413f4c0 msgr2=0x7fc6d4069e00 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-07-06T02:40:12.491 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:12.485+0000 7fc6d37fe700 1 --2- 172.21.15.46:0/2682184854 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc6d413f4c0 0x7fc6d4069e00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T02:40:12.491 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:12.485+0000 7fc6d37fe700 1 -- 172.21.15.46:0/2682184854 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc6c80094a0 con 0x7fc6d40b4710 2023-07-06T02:40:12.491 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:12.486+0000 7fc6d37fe700 1 --2- 172.21.15.46:0/2682184854 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fc6d40b4710 0x7fc6d416ae20 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fc6c400c700 tx=0x7fc6c400cac0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T02:40:12.491 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:12.486+0000 7fc6bbfff700 1 -- 172.21.15.46:0/2682184854 <== mon.2 v2:172.21.15.73:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6c4005d70 con 0x7fc6d40b4710 2023-07-06T02:40:12.491 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:12.486+0000 7fc6bbfff700 1 -- 172.21.15.46:0/2682184854 <== mon.2 v2:172.21.15.73:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc6c40070d0 con 0x7fc6d40b4710 2023-07-06T02:40:12.492 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:12.486+0000 7fc6da173700 1 -- 172.21.15.46:0/2682184854 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc6d413ab30 con 0x7fc6d40b4710 2023-07-06T02:40:12.492 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:12.486+0000 7fc6bbfff700 1 -- 172.21.15.46:0/2682184854 <== mon.2 v2:172.21.15.73:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6c4007460 con 0x7fc6d40b4710 2023-07-06T02:40:12.492 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:12.486+0000 7fc6da173700 1 -- 172.21.15.46:0/2682184854 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc6d415d1b0 con 0x7fc6d40b4710 2023-07-06T02:40:12.492 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:12.487+0000 7fc6da173700 1 -- 172.21.15.46:0/2682184854 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc6d40672e0 con 0x7fc6d40b4710 2023-07-06T02:40:12.493 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:12.489+0000 7fc6bbfff700 1 -- 172.21.15.46:0/2682184854 <== mon.2 v2:172.21.15.73:3301/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fc6c40075c0 con 0x7fc6d40b4710 2023-07-06T02:40:12.493 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:12.489+0000 7fc6bbfff700 1 --2- 172.21.15.46:0/2682184854 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7fc6c006ace0 0x7fc6c006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T02:40:12.493 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:12.489+0000 7fc6bbfff700 1 -- 172.21.15.46:0/2682184854 <== mon.2 v2:172.21.15.73:3301/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 6091+0+0 (secure 0 0 0) 0x7fc6c4088a90 con 0x7fc6d40b4710 2023-07-06T02:40:12.493 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:12.490+0000 7fc6d2ffd700 1 --2- 172.21.15.46:0/2682184854 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7fc6c006ace0 0x7fc6c006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T02:40:12.493 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:12.490+0000 7fc6d2ffd700 1 --2- 172.21.15.46:0/2682184854 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7fc6c006ace0 0x7fc6c006d190 secure :-1 s=READY pgs=725 cs=0 l=1 rev1=1 crypto rx=0x7fc6d40b0180 tx=0x7fc6c8008030 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T02:40:12.497 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:12.494+0000 7fc6bbfff700 1 -- 172.21.15.46:0/2682184854 <== mon.2 v2:172.21.15.73:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fc6c4053a90 con 0x7fc6d40b4710 2023-07-06T02:40:12.817 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:12.814+0000 7fc6da173700 1 -- 172.21.15.46:0/2682184854 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fc6d415ce60 con 0x7fc6d40b4710 2023-07-06T02:40:12.819 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:12.816+0000 7fc6bbfff700 1 -- 172.21.15.46:0/2682184854 <== mon.2 v2:172.21.15.73:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v37) v1 ==== 74+0+18226 (secure 0 0 0) 0x7fc6c40570b0 con 0x7fc6d40b4710 2023-07-06T02:40:12.819 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-06T02:40:12.820 INFO:teuthology.orchestra.run.smithi046.stdout:{"epoch":37,"fsid":"042652d3-d80c-4ad8-9366-3e94f2a0a512","created":"2023-07-05T18:55:56.455710+0000","modified":"2023-07-05T18:58:04.356432+0000","last_up_change":"2023-07-05T18:56:06.594022+0000","last_in_change":"2023-07-05T18:55:58.879340+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-07-05T18:56:07.729620+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2023-07-05T18:56:08.128122+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2023-07-05T18:57:13.640396+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"34","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_data","create_time":"2023-07-05T18:57:14.333267+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"35","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"20009183-9a47-4392-8751-883f88d2bfb1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6813","nonce":4151971443},{"type":"v1","addr":"172.21.15.46:6815","nonce":4151971443}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6817","nonce":4151971443},{"type":"v1","addr":"172.21.15.46:6818","nonce":4151971443}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6822","nonce":4151971443},{"type":"v1","addr":"172.21.15.46:6823","nonce":4151971443}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6820","nonce":4151971443},{"type":"v1","addr":"172.21.15.46:6821","nonce":4151971443}]},"public_addr":"172.21.15.46:6815/4151971443","cluster_addr":"172.21.15.46:6818/4151971443","heartbeat_back_addr":"172.21.15.46:6823/4151971443","heartbeat_front_addr":"172.21.15.46:6821/4151971443","state":["exists","up"]},{"osd":1,"uuid":"91b4a7b0-e4e4-4888-a1fe-9edb0d68004c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6808","nonce":502575881},{"type":"v1","addr":"172.21.15.46:6809","nonce":502575881}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6810","nonce":502575881},{"type":"v1","addr":"172.21.15.46:6811","nonce":502575881}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6816","nonce":502575881},{"type":"v1","addr":"172.21.15.46:6819","nonce":502575881}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6812","nonce":502575881},{"type":"v1","addr":"172.21.15.46:6814","nonce":502575881}]},"public_addr":"172.21.15.46:6809/502575881","cluster_addr":"172.21.15.46:6811/502575881","heartbeat_back_addr":"172.21.15.46:6819/502575881","heartbeat_front_addr":"172.21.15.46:6814/502575881","state":["exists","up"]},{"osd":2,"uuid":"669ff744-1331-47c5-8579-0440731c889a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6800","nonce":2115251461},{"type":"v1","addr":"172.21.15.46:6801","nonce":2115251461}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6802","nonce":2115251461},{"type":"v1","addr":"172.21.15.46:6803","nonce":2115251461}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6806","nonce":2115251461},{"type":"v1","addr":"172.21.15.46:6807","nonce":2115251461}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6804","nonce":2115251461},{"type":"v1","addr":"172.21.15.46:6805","nonce":2115251461}]},"public_addr":"172.21.15.46:6801/2115251461","cluster_addr":"172.21.15.46:6803/2115251461","heartbeat_back_addr":"172.21.15.46:6807/2115251461","heartbeat_front_addr":"172.21.15.46:6805/2115251461","state":["exists","up"]},{"osd":3,"uuid":"34e1b86d-ffad-415d-861c-07a5f08068a6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6824","nonce":2981388766},{"type":"v1","addr":"172.21.15.46:6825","nonce":2981388766}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6826","nonce":2981388766},{"type":"v1","addr":"172.21.15.46:6827","nonce":2981388766}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6830","nonce":2981388766},{"type":"v1","addr":"172.21.15.46:6831","nonce":2981388766}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6828","nonce":2981388766},{"type":"v1","addr":"172.21.15.46:6829","nonce":2981388766}]},"public_addr":"172.21.15.46:6825/2981388766","cluster_addr":"172.21.15.46:6827/2981388766","heartbeat_back_addr":"172.21.15.46:6831/2981388766","heartbeat_front_addr":"172.21.15.46:6829/2981388766","state":["exists","up"]},{"osd":4,"uuid":"57ffcb91-c7dc-4a69-ae71-4d9622a14a05","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6800","nonce":2083655348},{"type":"v1","addr":"172.21.15.73:6801","nonce":2083655348}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6802","nonce":2083655348},{"type":"v1","addr":"172.21.15.73:6803","nonce":2083655348}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6806","nonce":2083655348},{"type":"v1","addr":"172.21.15.73:6807","nonce":2083655348}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6804","nonce":2083655348},{"type":"v1","addr":"172.21.15.73:6805","nonce":2083655348}]},"public_addr":"172.21.15.73:6801/2083655348","cluster_addr":"172.21.15.73:6803/2083655348","heartbeat_back_addr":"172.21.15.73:6807/2083655348","heartbeat_front_addr":"172.21.15.73:6805/2083655348","state":["exists","up"]},{"osd":5,"uuid":"665f41c9-ee20-49cf-bf0e-fbe0c03d3aed","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6824","nonce":2803788401},{"type":"v1","addr":"172.21.15.73:6825","nonce":2803788401}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6826","nonce":2803788401},{"type":"v1","addr":"172.21.15.73:6827","nonce":2803788401}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6830","nonce":2803788401},{"type":"v1","addr":"172.21.15.73:6831","nonce":2803788401}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6828","nonce":2803788401},{"type":"v1","addr":"172.21.15.73:6829","nonce":2803788401}]},"public_addr":"172.21.15.73:6825/2803788401","cluster_addr":"172.21.15.73:6827/2803788401","heartbeat_back_addr":"172.21.15.73:6831/2803788401","heartbeat_front_addr":"172.21.15.73:6829/2803788401","state":["exists","up"]},{"osd":6,"uuid":"5790c6cc-bd56-4ce4-9a7c-0f0c3b59215c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6808","nonce":974108383},{"type":"v1","addr":"172.21.15.73:6809","nonce":974108383}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6810","nonce":974108383},{"type":"v1","addr":"172.21.15.73:6811","nonce":974108383}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6815","nonce":974108383},{"type":"v1","addr":"172.21.15.73:6817","nonce":974108383}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6812","nonce":974108383},{"type":"v1","addr":"172.21.15.73:6813","nonce":974108383}]},"public_addr":"172.21.15.73:6809/974108383","cluster_addr":"172.21.15.73:6811/974108383","heartbeat_back_addr":"172.21.15.73:6817/974108383","heartbeat_front_addr":"172.21.15.73:6813/974108383","state":["exists","up"]},{"osd":7,"uuid":"b66f4d2e-147e-4c9b-97dd-cbd59d33802e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6814","nonce":3772673248},{"type":"v1","addr":"172.21.15.73:6816","nonce":3772673248}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6818","nonce":3772673248},{"type":"v1","addr":"172.21.15.73:6819","nonce":3772673248}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6822","nonce":3772673248},{"type":"v1","addr":"172.21.15.73:6823","nonce":3772673248}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6820","nonce":3772673248},{"type":"v1","addr":"172.21.15.73:6821","nonce":3772673248}]},"public_addr":"172.21.15.73:6816/3772673248","cluster_addr":"172.21.15.73:6819/3772673248","heartbeat_back_addr":"172.21.15.73:6823/3772673248","heartbeat_front_addr":"172.21.15.73:6821/3772673248","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-05T18:56:04.115334+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-05T18:56:04.071250+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-05T18:56:04.044387+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-05T18:56:04.085389+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-05T18:56:04.090726+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-05T18:56:04.074529+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-05T18:56:04.058841+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-05T18:56:04.043054+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"6.24","mappings":[{"from":5,"to":0}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-06T02:40:12.822 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:12.820+0000 7fc6da173700 1 -- 172.21.15.46:0/2682184854 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7fc6c006ace0 msgr2=0x7fc6c006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T02:40:12.822 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:12.820+0000 7fc6da173700 1 --2- 172.21.15.46:0/2682184854 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7fc6c006ace0 0x7fc6c006d190 secure :-1 s=READY pgs=725 cs=0 l=1 rev1=1 crypto rx=0x7fc6d40b0180 tx=0x7fc6c8008030 comp rx=0 tx=0).stop 2023-07-06T02:40:12.823 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:12.820+0000 7fc6da173700 1 -- 172.21.15.46:0/2682184854 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fc6d40b4710 msgr2=0x7fc6d416ae20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T02:40:12.823 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:12.820+0000 7fc6da173700 1 --2- 172.21.15.46:0/2682184854 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fc6d40b4710 0x7fc6d416ae20 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fc6c400c700 tx=0x7fc6c400cac0 comp rx=0 tx=0).stop 2023-07-06T02:40:12.830 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:12.824+0000 7fc6da173700 1 -- 172.21.15.46:0/2682184854 shutdown_connections 2023-07-06T02:40:12.830 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:12.824+0000 7fc6da173700 1 --2- 172.21.15.46:0/2682184854 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7fc6c006ace0 0x7fc6c006d190 unknown :-1 s=CLOSED pgs=725 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T02:40:12.830 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:12.824+0000 7fc6da173700 1 --2- 172.21.15.46:0/2682184854 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc6d4142480 0x7fc6d406a340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T02:40:12.830 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:12.824+0000 7fc6da173700 1 --2- 172.21.15.46:0/2682184854 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fc6d40b4710 0x7fc6d416ae20 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T02:40:12.831 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:12.824+0000 7fc6da173700 1 --2- 172.21.15.46:0/2682184854 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc6d413f4c0 0x7fc6d4069e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T02:40:12.831 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:12.824+0000 7fc6da173700 1 -- 172.21.15.46:0/2682184854 >> 172.21.15.46:0/2682184854 conn(0x7fc6d406af10 msgr2=0x7fc6d4158c80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T02:40:12.831 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:12.824+0000 7fc6da173700 1 -- 172.21.15.46:0/2682184854 shutdown_connections 2023-07-06T02:40:12.831 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:12.824+0000 7fc6da173700 1 -- 172.21.15.46:0/2682184854 wait complete. 2023-07-06T02:40:12.859 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-07-06T02:40:13.043 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:13.041+0000 7f9761efc700 1 Processor -- start 2023-07-06T02:40:13.044 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:13.041+0000 7f9761efc700 1 -- start start 2023-07-06T02:40:13.045 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:13.042+0000 7f9761efc700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f975c145e40 0x7f975c0ae520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T02:40:13.045 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:13.042+0000 7f9761efc700 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f975c146210 con 0x7f975c06da70 2023-07-06T02:40:13.046 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:13.042+0000 7f9761efc700 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f975c06a270 con 0x7f975c069e00 2023-07-06T02:40:13.046 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:13.042+0000 7f9761efc700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f975c06a500 con 0x7f975c145e40 2023-07-06T02:40:13.046 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:13.042+0000 7f975b7fe700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f975c145e40 0x7f975c0ae520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T02:40:13.046 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:13.042+0000 7f975bfff700 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7f975c06da70 0x7f975c0c4580 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:45226/0 (socket says 172.21.15.46:45226) 2023-07-06T02:40:13.046 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:13.042+0000 7f975bfff700 1 -- 172.21.15.46:0/1016512282 learned_addr learned my addr 172.21.15.46:0/1016512282 (peer_addr_for_me v1:172.21.15.46:0/0) 2023-07-06T02:40:13.047 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:13.043+0000 7f975a7fc700 1 -- 172.21.15.46:0/1016512282 <== mon.1 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3321341872 0 0) 0x7f975c06a270 con 0x7f975c069e00 2023-07-06T02:40:13.047 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:13.043+0000 7f975a7fc700 1 -- 172.21.15.46:0/1016512282 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f97440035b0 con 0x7f975c069e00 2023-07-06T02:40:13.048 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:13.043+0000 7f975a7fc700 1 -- 172.21.15.46:0/1016512282 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 943903316 0 0) 0x7f97540013c0 con 0x7f975c06da70 2023-07-06T02:40:13.048 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:13.043+0000 7f975b7fe700 1 -- 172.21.15.46:0/1016512282 >> v1:172.21.15.73:6789/0 conn(0x7f975c069e00 legacy=0x7f975c06d360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T02:40:13.048 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:13.043+0000 7f975b7fe700 1 -- 172.21.15.46:0/1016512282 >> v1:172.21.15.46:6789/0 conn(0x7f975c06da70 legacy=0x7f975c0c4580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T02:40:13.048 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:13.043+0000 7f975b7fe700 1 -- 172.21.15.46:0/1016512282 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f975c06a7e0 con 0x7f975c145e40 2023-07-06T02:40:13.048 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:13.043+0000 7f975b7fe700 1 --2- 172.21.15.46:0/1016512282 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f975c145e40 0x7f975c0ae520 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f974c009870 tx=0x7f974c009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=83e2ceed2f756a55 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T02:40:13.048 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:13.043+0000 7f975a7fc700 1 -- 172.21.15.46:0/1016512282 <== mon.2 v2:172.21.15.73:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f974c004230 con 0x7f975c145e40 2023-07-06T02:40:13.049 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:13.043+0000 7f975a7fc700 1 -- 172.21.15.46:0/1016512282 <== mon.2 v2:172.21.15.73:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f974c004390 con 0x7f975c145e40 2023-07-06T02:40:13.049 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:13.043+0000 7f975a7fc700 1 -- 172.21.15.46:0/1016512282 <== mon.2 v2:172.21.15.73:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f974c0036a0 con 0x7f975c145e40 2023-07-06T02:40:13.049 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:13.044+0000 7f9761efc700 1 -- 172.21.15.46:0/1016512282 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f975c145e40 msgr2=0x7f975c0ae520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T02:40:13.049 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:13.044+0000 7f9761efc700 1 --2- 172.21.15.46:0/1016512282 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f975c145e40 0x7f975c0ae520 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f974c009870 tx=0x7f974c009b80 comp rx=0 tx=0).stop 2023-07-06T02:40:13.049 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:13.044+0000 7f9761efc700 1 -- 172.21.15.46:0/1016512282 shutdown_connections 2023-07-06T02:40:13.049 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:13.044+0000 7f9761efc700 1 --2- 172.21.15.46:0/1016512282 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f975c145e40 0x7f975c0ae520 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T02:40:13.049 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:13.044+0000 7f9761efc700 1 -- 172.21.15.46:0/1016512282 >> 172.21.15.46:0/1016512282 conn(0x7f975c0cbba0 msgr2=0x7f975c0cbf70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T02:40:13.049 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:13.044+0000 7f9761efc700 1 -- 172.21.15.46:0/1016512282 shutdown_connections 2023-07-06T02:40:13.050 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:13.044+0000 7f9761efc700 1 -- 172.21.15.46:0/1016512282 wait complete. 2023-07-06T02:40:13.051 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:13.046+0000 7f9761efc700 1 Processor -- start 2023-07-06T02:40:13.051 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:13.046+0000 7f9761efc700 1 -- start start 2023-07-06T02:40:13.051 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:13.047+0000 7f9761efc700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f975c069e00 0x7f975c15be80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T02:40:13.052 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:13.047+0000 7f9761efc700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f975c06da70 0x7f975c15d4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T02:40:13.052 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:13.047+0000 7f9761efc700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f975c145e40 0x7f975c0b4780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T02:40:13.052 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:13.047+0000 7f9761efc700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f975c0b2460 con 0x7f975c069e00 2023-07-06T02:40:13.052 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:13.047+0000 7f9761efc700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f975c15ddb0 con 0x7f975c06da70 2023-07-06T02:40:13.052 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:13.047+0000 7f9761efc700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f975c15e090 con 0x7f975c145e40 2023-07-06T02:40:13.052 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:13.047+0000 7f975b7fe700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f975c069e00 0x7f975c15be80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T02:40:13.052 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:13.047+0000 7f975b7fe700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f975c069e00 0x7f975c15be80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:45956/0 (socket says 172.21.15.46:45956) 2023-07-06T02:40:13.052 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:13.047+0000 7f975b7fe700 1 -- 172.21.15.46:0/3816817104 learned_addr learned my addr 172.21.15.46:0/3816817104 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-07-06T02:40:13.053 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:13.047+0000 7f975affd700 1 --2- 172.21.15.46:0/3816817104 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f975c06da70 0x7f975c15d4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T02:40:13.053 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:13.047+0000 7f975b7fe700 1 -- 172.21.15.46:0/3816817104 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f975c145e40 msgr2=0x7f975c0b4780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T02:40:13.053 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:13.047+0000 7f975b7fe700 1 --2- 172.21.15.46:0/3816817104 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f975c145e40 0x7f975c0b4780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T02:40:13.053 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:13.047+0000 7f975b7fe700 1 -- 172.21.15.46:0/3816817104 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f975c06da70 msgr2=0x7f975c15d4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T02:40:13.053 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:13.047+0000 7f975b7fe700 1 --2- 172.21.15.46:0/3816817104 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f975c06da70 0x7f975c15d4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T02:40:13.053 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:13.047+0000 7f975b7fe700 1 -- 172.21.15.46:0/3816817104 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f974c0094a0 con 0x7f975c069e00 2023-07-06T02:40:13.053 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:13.047+0000 7f975affd700 1 --2- 172.21.15.46:0/3816817104 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f975c06da70 0x7f975c15d4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-06T02:40:13.054 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:13.048+0000 7f975b7fe700 1 --2- 172.21.15.46:0/3816817104 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f975c069e00 0x7f975c15be80 secure :-1 s=READY pgs=3224 cs=0 l=1 rev1=1 crypto rx=0x7f974c0097c0 tx=0x7f974c0047c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T02:40:13.054 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:13.048+0000 7f9743fff700 1 -- 172.21.15.46:0/3816817104 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f974c011630 con 0x7f975c069e00 2023-07-06T02:40:13.054 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:13.048+0000 7f9743fff700 1 -- 172.21.15.46:0/3816817104 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f974c0117b0 con 0x7f975c069e00 2023-07-06T02:40:13.054 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:13.048+0000 7f9761efc700 1 -- 172.21.15.46:0/3816817104 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f975c15e370 con 0x7f975c069e00 2023-07-06T02:40:13.054 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:13.048+0000 7f9743fff700 1 -- 172.21.15.46:0/3816817104 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f974c011b60 con 0x7f975c069e00 2023-07-06T02:40:13.054 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:13.048+0000 7f9761efc700 1 -- 172.21.15.46:0/3816817104 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f975c15d9f0 con 0x7f975c069e00 2023-07-06T02:40:13.055 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:13.049+0000 7f9761efc700 1 -- 172.21.15.46:0/3816817104 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f975c06e600 con 0x7f975c069e00 2023-07-06T02:40:13.055 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:13.050+0000 7f9743fff700 1 -- 172.21.15.46:0/3816817104 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f974c011cc0 con 0x7f975c069e00 2023-07-06T02:40:13.055 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:13.050+0000 7f9743fff700 1 --2- 172.21.15.46:0/3816817104 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7f974806ace0 0x7f974806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T02:40:13.055 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:13.050+0000 7f9743fff700 1 -- 172.21.15.46:0/3816817104 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 6091+0+0 (secure 0 0 0) 0x7f974c08ace0 con 0x7f975c069e00 2023-07-06T02:40:13.061 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:13.058+0000 7f975affd700 1 --2- 172.21.15.46:0/3816817104 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7f974806ace0 0x7f974806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T02:40:13.061 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:13.058+0000 7f9743fff700 1 -- 172.21.15.46:0/3816817104 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f974c055ea0 con 0x7f975c069e00 2023-07-06T02:40:13.063 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:13.061+0000 7f975affd700 1 --2- 172.21.15.46:0/3816817104 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7f974806ace0 0x7f974806d190 secure :-1 s=READY pgs=726 cs=0 l=1 rev1=1 crypto rx=0x7f975c15f000 tx=0x7f9750009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T02:40:13.453 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:13.450+0000 7f9761efc700 1 -- 172.21.15.46:0/3816817104 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f975c06e600 con 0x7f975c069e00 2023-07-06T02:40:13.800 INFO:tasks.ceph.mds.b.smithi073.stderr:2023-07-06T02:40:13.797+0000 7f1feae4f700 -1 mds.0.12 we have been blocklisted (fenced), respawning... 2023-07-06T02:40:13.956 INFO:tasks.ceph.mds.b.smithi073.stderr: -3> 2023-07-06T02:40:13.797+0000 7f1feae4f700 -1 mds.0.12 we have been blocklisted (fenced), respawning... 2023-07-06T02:40:14.084 INFO:tasks.ceph.mds.b.smithi073.stdout:starting mds.b at 2023-07-06T02:40:14.349 INFO:tasks.ceph.mon.a.smithi046.stderr:2023-07-06T02:40:14.346+0000 7f2989e7d700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-07-06T02:40:14.357 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:14.354+0000 7f9743fff700 1 -- 172.21.15.46:0/3816817104 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v16) v1 ==== 161+0+0 (secure 0 0 0) 0x7f974c0594c0 con 0x7f975c069e00 2023-07-06T02:40:14.360 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:14.357+0000 7f9761efc700 1 -- 172.21.15.46:0/3816817104 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7f974806ace0 msgr2=0x7f974806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T02:40:14.360 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:14.357+0000 7f9761efc700 1 --2- 172.21.15.46:0/3816817104 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7f974806ace0 0x7f974806d190 secure :-1 s=READY pgs=726 cs=0 l=1 rev1=1 crypto rx=0x7f975c15f000 tx=0x7f9750009040 comp rx=0 tx=0).stop 2023-07-06T02:40:14.361 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:14.357+0000 7f9761efc700 1 -- 172.21.15.46:0/3816817104 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f975c069e00 msgr2=0x7f975c15be80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T02:40:14.361 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:14.357+0000 7f9761efc700 1 --2- 172.21.15.46:0/3816817104 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f975c069e00 0x7f975c15be80 secure :-1 s=READY pgs=3224 cs=0 l=1 rev1=1 crypto rx=0x7f974c0097c0 tx=0x7f974c0047c0 comp rx=0 tx=0).stop 2023-07-06T02:40:14.361 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:14.357+0000 7f9761efc700 1 -- 172.21.15.46:0/3816817104 shutdown_connections 2023-07-06T02:40:14.361 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:14.357+0000 7f9761efc700 1 --2- 172.21.15.46:0/3816817104 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7f974806ace0 0x7f974806d190 unknown :-1 s=CLOSED pgs=726 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T02:40:14.361 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:14.357+0000 7f9761efc700 1 --2- 172.21.15.46:0/3816817104 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f975c145e40 0x7f975c0b4780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T02:40:14.361 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:14.357+0000 7f9761efc700 1 --2- 172.21.15.46:0/3816817104 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f975c069e00 0x7f975c15be80 unknown :-1 s=CLOSED pgs=3224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T02:40:14.361 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:14.357+0000 7f9761efc700 1 --2- 172.21.15.46:0/3816817104 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f975c06da70 0x7f975c15d4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T02:40:14.362 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:14.357+0000 7f9761efc700 1 -- 172.21.15.46:0/3816817104 >> 172.21.15.46:0/3816817104 conn(0x7f975c0cbba0 msgr2=0x7f975c0affb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T02:40:14.362 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:14.357+0000 7f9761efc700 1 -- 172.21.15.46:0/3816817104 shutdown_connections 2023-07-06T02:40:14.362 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:14.357+0000 7f9761efc700 1 -- 172.21.15.46:0/3816817104 wait complete. 2023-07-06T02:40:14.362 INFO:teuthology.orchestra.run.smithi046.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-07-06T02:40:14.376 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-07-06T02:40:14.519 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:14.516+0000 7ff716a53700 1 Processor -- start 2023-07-06T02:40:14.519 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:14.516+0000 7ff716a53700 1 -- start start 2023-07-06T02:40:14.520 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:14.517+0000 7ff716a53700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7ff71015c2f0 0x7ff7100cd2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T02:40:14.520 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:14.517+0000 7ff716a53700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7ff7100b5ae0 0x7ff7100b5ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T02:40:14.521 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:14.517+0000 7ff716a53700 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff7100cd8c0 con 0x7ff71015c6c0 2023-07-06T02:40:14.521 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:14.517+0000 7ff716a53700 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff7100d0990 con 0x7ff71015c2f0 2023-07-06T02:40:14.521 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:14.517+0000 7ff716a53700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff7100d0c70 con 0x7ff7100b5ae0 2023-07-06T02:40:14.521 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:14.517+0000 7ff70ffff700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7ff71015c2f0 0x7ff7100cd2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T02:40:14.521 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:14.517+0000 7ff70f7fe700 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7ff71015c6c0 0x7ff71006c760 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:45236/0 (socket says 172.21.15.46:45236) 2023-07-06T02:40:14.521 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:14.517+0000 7ff70f7fe700 1 -- 172.21.15.46:0/2874614177 learned_addr learned my addr 172.21.15.46:0/2874614177 (peer_addr_for_me v1:172.21.15.46:0/0) 2023-07-06T02:40:14.521 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:14.517+0000 7ff714ff0700 1 --2- 172.21.15.46:0/2874614177 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7ff7100b5ae0 0x7ff7100b5ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T02:40:14.522 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:14.517+0000 7ff70ffff700 1 -- 172.21.15.46:0/2874614177 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7ff7100b5ae0 msgr2=0x7ff7100b5ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T02:40:14.522 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:14.517+0000 7ff70ffff700 1 --2- 172.21.15.46:0/2874614177 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7ff7100b5ae0 0x7ff7100b5ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T02:40:14.522 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:14.517+0000 7ff70ffff700 1 -- 172.21.15.46:0/2874614177 >> v1:172.21.15.46:6789/0 conn(0x7ff71015c6c0 legacy=0x7ff71006c760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T02:40:14.522 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:14.517+0000 7ff70effd700 1 -- 172.21.15.46:0/2874614177 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4160219126 0 0) 0x7ff7100cd8c0 con 0x7ff71015c6c0 2023-07-06T02:40:14.522 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:14.517+0000 7ff70ffff700 1 -- 172.21.15.46:0/2874614177 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff7100d0f50 con 0x7ff71015c2f0 2023-07-06T02:40:14.522 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:14.517+0000 7ff70ffff700 1 --2- 172.21.15.46:0/2874614177 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff71015c2f0 0x7ff7100cd2e0 secure :-1 s=READY pgs=3227 cs=0 l=1 rev1=1 crypto rx=0x7ff6f8009840 tx=0x7ff6f8009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c156c6ac4ac2c886 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T02:40:14.522 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:14.518+0000 7ff70effd700 1 -- 172.21.15.46:0/2874614177 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6f8011830 con 0x7ff71015c2f0 2023-07-06T02:40:14.522 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:14.518+0000 7ff70effd700 1 -- 172.21.15.46:0/2874614177 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff6f8011990 con 0x7ff71015c2f0 2023-07-06T02:40:14.523 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:14.518+0000 7ff70effd700 1 -- 172.21.15.46:0/2874614177 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6f8011d20 con 0x7ff71015c2f0 2023-07-06T02:40:14.525 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:14.518+0000 7ff716a53700 1 -- 172.21.15.46:0/2874614177 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff71015c2f0 msgr2=0x7ff7100cd2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T02:40:14.525 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:14.518+0000 7ff716a53700 1 --2- 172.21.15.46:0/2874614177 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff71015c2f0 0x7ff7100cd2e0 secure :-1 s=READY pgs=3227 cs=0 l=1 rev1=1 crypto rx=0x7ff6f8009840 tx=0x7ff6f8009b50 comp rx=0 tx=0).stop 2023-07-06T02:40:14.525 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:14.518+0000 7ff716a53700 1 -- 172.21.15.46:0/2874614177 shutdown_connections 2023-07-06T02:40:14.525 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:14.518+0000 7ff716a53700 1 --2- 172.21.15.46:0/2874614177 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7ff7100b5ae0 0x7ff7100b5ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T02:40:14.525 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:14.518+0000 7ff716a53700 1 --2- 172.21.15.46:0/2874614177 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff71015c2f0 0x7ff7100cd2e0 unknown :-1 s=CLOSED pgs=3227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T02:40:14.525 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:14.518+0000 7ff716a53700 1 -- 172.21.15.46:0/2874614177 >> 172.21.15.46:0/2874614177 conn(0x7ff71006afa0 msgr2=0x7ff7100cf710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T02:40:14.525 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:14.518+0000 7ff716a53700 1 -- 172.21.15.46:0/2874614177 shutdown_connections 2023-07-06T02:40:14.526 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:14.518+0000 7ff716a53700 1 -- 172.21.15.46:0/2874614177 wait complete. 2023-07-06T02:40:14.526 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:14.519+0000 7ff716a53700 1 Processor -- start 2023-07-06T02:40:14.526 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:14.519+0000 7ff716a53700 1 -- start start 2023-07-06T02:40:14.526 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:14.520+0000 7ff716a53700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff7100b5ae0 0x7ff7100c8ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T02:40:14.526 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:14.520+0000 7ff716a53700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7ff71015c2f0 0x7ff7100c9d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T02:40:14.526 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:14.520+0000 7ff716a53700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff71015c6c0 0x7ff710159ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T02:40:14.526 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:14.520+0000 7ff716a53700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7100ca7e0 con 0x7ff71015c6c0 2023-07-06T02:40:14.527 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:14.520+0000 7ff716a53700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7100caac0 con 0x7ff7100b5ae0 2023-07-06T02:40:14.527 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:14.520+0000 7ff716a53700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff7100cada0 con 0x7ff71015c2f0 2023-07-06T02:40:14.527 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:14.520+0000 7ff714ff0700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff71015c6c0 0x7ff710159ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T02:40:14.527 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:14.520+0000 7ff70f7fe700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7ff71015c2f0 0x7ff7100c9d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T02:40:14.527 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:14.520+0000 7ff714ff0700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff71015c6c0 0x7ff710159ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:45974/0 (socket says 172.21.15.46:45974) 2023-07-06T02:40:14.527 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:14.520+0000 7ff714ff0700 1 -- 172.21.15.46:0/280913294 learned_addr learned my addr 172.21.15.46:0/280913294 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-07-06T02:40:14.527 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:14.520+0000 7ff70ffff700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff7100b5ae0 0x7ff7100c8ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T02:40:14.527 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:14.521+0000 7ff714ff0700 1 -- 172.21.15.46:0/280913294 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7ff71015c2f0 msgr2=0x7ff7100c9d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T02:40:14.528 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:14.521+0000 7ff714ff0700 1 --2- 172.21.15.46:0/280913294 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7ff71015c2f0 0x7ff7100c9d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T02:40:14.528 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:14.521+0000 7ff714ff0700 1 -- 172.21.15.46:0/280913294 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff7100b5ae0 msgr2=0x7ff7100c8ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T02:40:14.528 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:14.521+0000 7ff714ff0700 1 --2- 172.21.15.46:0/280913294 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff7100b5ae0 0x7ff7100c8ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T02:40:14.528 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:14.521+0000 7ff714ff0700 1 -- 172.21.15.46:0/280913294 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff6f80094a0 con 0x7ff71015c6c0 2023-07-06T02:40:14.528 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:14.521+0000 7ff714ff0700 1 --2- 172.21.15.46:0/280913294 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff71015c6c0 0x7ff710159ce0 secure :-1 s=READY pgs=3228 cs=0 l=1 rev1=1 crypto rx=0x7ff708007e40 tx=0x7ff70800e3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T02:40:14.528 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:14.521+0000 7ff70cff9700 1 -- 172.21.15.46:0/280913294 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff70800ed30 con 0x7ff71015c6c0 2023-07-06T02:40:14.528 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:14.521+0000 7ff70cff9700 1 -- 172.21.15.46:0/280913294 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff708014420 con 0x7ff71015c6c0 2023-07-06T02:40:14.529 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:14.521+0000 7ff70cff9700 1 -- 172.21.15.46:0/280913294 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7080147d0 con 0x7ff71015c6c0 2023-07-06T02:40:14.529 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:14.521+0000 7ff716a53700 1 -- 172.21.15.46:0/280913294 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff7100cb080 con 0x7ff71015c6c0 2023-07-06T02:40:14.529 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:14.521+0000 7ff716a53700 1 -- 172.21.15.46:0/280913294 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff71015ab50 con 0x7ff71015c6c0 2023-07-06T02:40:14.529 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:14.522+0000 7ff716a53700 1 -- 172.21.15.46:0/280913294 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff7100cbcf0 con 0x7ff71015c6c0 2023-07-06T02:40:14.530 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:14.523+0000 7ff70cff9700 1 -- 172.21.15.46:0/280913294 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7ff708014930 con 0x7ff71015c6c0 2023-07-06T02:40:14.530 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:14.523+0000 7ff70cff9700 1 --2- 172.21.15.46:0/280913294 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7ff6f006ace0 0x7ff6f006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T02:40:14.530 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:14.523+0000 7ff70cff9700 1 -- 172.21.15.46:0/280913294 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 6177+0+0 (secure 0 0 0) 0x7ff708089bf0 con 0x7ff71015c6c0 2023-07-06T02:40:14.530 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:14.524+0000 7ff70ffff700 1 --2- 172.21.15.46:0/280913294 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7ff6f006ace0 0x7ff6f006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T02:40:14.530 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:14.524+0000 7ff70ffff700 1 --2- 172.21.15.46:0/280913294 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7ff6f006ace0 0x7ff6f006d190 secure :-1 s=READY pgs=728 cs=0 l=1 rev1=1 crypto rx=0x7ff6f80090b0 tx=0x7ff6f8008030 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T02:40:14.531 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:14.528+0000 7ff70cff9700 1 -- 172.21.15.46:0/280913294 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7ff708054cd0 con 0x7ff71015c6c0 2023-07-06T02:40:14.785 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:14.782+0000 7ff716a53700 1 -- 172.21.15.46:0/280913294 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7ff71004e1d0 con 0x7ff71015c6c0 2023-07-06T02:40:15.464 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:15.461+0000 7ff70cff9700 1 -- 172.21.15.46:0/280913294 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v17) v1 ==== 104+0+0 (secure 0 0 0) 0x7ff7080582f0 con 0x7ff71015c6c0 2023-07-06T02:40:15.467 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:15.464+0000 7ff716a53700 1 -- 172.21.15.46:0/280913294 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7ff6f006ace0 msgr2=0x7ff6f006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T02:40:15.467 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:15.464+0000 7ff716a53700 1 --2- 172.21.15.46:0/280913294 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7ff6f006ace0 0x7ff6f006d190 secure :-1 s=READY pgs=728 cs=0 l=1 rev1=1 crypto rx=0x7ff6f80090b0 tx=0x7ff6f8008030 comp rx=0 tx=0).stop 2023-07-06T02:40:15.467 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:15.464+0000 7ff716a53700 1 -- 172.21.15.46:0/280913294 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff71015c6c0 msgr2=0x7ff710159ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T02:40:15.467 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:15.464+0000 7ff716a53700 1 --2- 172.21.15.46:0/280913294 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff71015c6c0 0x7ff710159ce0 secure :-1 s=READY pgs=3228 cs=0 l=1 rev1=1 crypto rx=0x7ff708007e40 tx=0x7ff70800e3c0 comp rx=0 tx=0).stop 2023-07-06T02:40:15.468 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:15.464+0000 7ff716a53700 1 -- 172.21.15.46:0/280913294 shutdown_connections 2023-07-06T02:40:15.468 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:15.464+0000 7ff716a53700 1 --2- 172.21.15.46:0/280913294 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7ff6f006ace0 0x7ff6f006d190 unknown :-1 s=CLOSED pgs=728 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T02:40:15.468 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:15.464+0000 7ff716a53700 1 --2- 172.21.15.46:0/280913294 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff71015c6c0 0x7ff710159ce0 unknown :-1 s=CLOSED pgs=3228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T02:40:15.468 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:15.464+0000 7ff716a53700 1 --2- 172.21.15.46:0/280913294 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff7100b5ae0 0x7ff7100c8ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T02:40:15.468 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:15.464+0000 7ff716a53700 1 --2- 172.21.15.46:0/280913294 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7ff71015c2f0 0x7ff7100c9d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T02:40:15.468 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:15.464+0000 7ff716a53700 1 -- 172.21.15.46:0/280913294 >> 172.21.15.46:0/280913294 conn(0x7ff71006afa0 msgr2=0x7ff7100b4b10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T02:40:15.469 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:15.464+0000 7ff716a53700 1 -- 172.21.15.46:0/280913294 shutdown_connections 2023-07-06T02:40:15.469 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:15.464+0000 7ff716a53700 1 -- 172.21.15.46:0/280913294 wait complete. 2023-07-06T02:40:15.483 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-07-06T02:40:15.628 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:15.625+0000 7ff1de86a700 1 Processor -- start 2023-07-06T02:40:15.628 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:15.625+0000 7ff1de86a700 1 -- start start 2023-07-06T02:40:15.631 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:15.626+0000 7ff1de86a700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7ff1d80b8540 0x7ff1d80d08b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T02:40:15.631 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:15.626+0000 7ff1de86a700 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff1d80cf1d0 con 0x7ff1d81609f0 2023-07-06T02:40:15.631 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:15.626+0000 7ff1de86a700 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff1d80cd4b0 con 0x7ff1d80cfd70 2023-07-06T02:40:15.631 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:15.626+0000 7ff1de86a700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff1d80cda50 con 0x7ff1d80b8540 2023-07-06T02:40:15.631 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:15.626+0000 7ff1d77fe700 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7ff1d81609f0 0x7ff1d80cf660 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:45252/0 (socket says 172.21.15.46:45252) 2023-07-06T02:40:15.632 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:15.626+0000 7ff1d77fe700 1 -- 172.21.15.46:0/4196387490 learned_addr learned my addr 172.21.15.46:0/4196387490 (peer_addr_for_me v1:172.21.15.46:0/0) 2023-07-06T02:40:15.632 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:15.626+0000 7ff1d7fff700 1 --2- 172.21.15.46:0/4196387490 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7ff1d80b8540 0x7ff1d80d08b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T02:40:15.632 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:15.626+0000 7ff1d6ffd700 1 -- 172.21.15.46:0/4196387490 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1965774294 0 0) 0x7ff1d80cf1d0 con 0x7ff1d81609f0 2023-07-06T02:40:15.632 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:15.626+0000 7ff1d6ffd700 1 -- 172.21.15.46:0/4196387490 --> v1:172.21.15.46:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff1c00035b0 con 0x7ff1d81609f0 2023-07-06T02:40:15.632 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:15.626+0000 7ff1d6ffd700 1 -- 172.21.15.46:0/4196387490 <== mon.1 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2660203855 0 0) 0x7ff1d80cd4b0 con 0x7ff1d80cfd70 2023-07-06T02:40:15.632 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:15.626+0000 7ff1d6ffd700 1 -- 172.21.15.46:0/4196387490 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff1d80cf1d0 con 0x7ff1d80cfd70 2023-07-06T02:40:15.633 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:15.626+0000 7ff1d6ffd700 1 -- 172.21.15.46:0/4196387490 <== mon.0 v1:172.21.15.46:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 82522110 0 0) 0x7ff1c00035b0 con 0x7ff1d81609f0 2023-07-06T02:40:15.633 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:15.626+0000 7ff1d6ffd700 1 -- 172.21.15.46:0/4196387490 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7ff1d80b8540 msgr2=0x7ff1d80d08b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T02:40:15.633 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:15.626+0000 7ff1d6ffd700 1 --2- 172.21.15.46:0/4196387490 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7ff1d80b8540 0x7ff1d80d08b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T02:40:15.633 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:15.626+0000 7ff1d6ffd700 1 -- 172.21.15.46:0/4196387490 >> v1:172.21.15.73:6789/0 conn(0x7ff1d80cfd70 legacy=0x7ff1d815ca10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T02:40:15.633 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:15.626+0000 7ff1d6ffd700 1 -- 172.21.15.46:0/4196387490 --> v1:172.21.15.46:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff1d80cd770 con 0x7ff1d81609f0 2023-07-06T02:40:15.633 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:15.626+0000 7ff1d6ffd700 1 -- 172.21.15.46:0/4196387490 <== mon.0 v1:172.21.15.46:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2195585215 0 0) 0x7ff1cc001670 con 0x7ff1d81609f0 2023-07-06T02:40:15.633 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:15.626+0000 7ff1d6ffd700 1 -- 172.21.15.46:0/4196387490 >> v1:172.21.15.46:6789/0 conn(0x7ff1d81609f0 legacy=0x7ff1d80cf660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T02:40:15.634 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:15.626+0000 7ff1d6ffd700 1 --2- 172.21.15.46:0/4196387490 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff1c0003bc0 0x7ff1c0003fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T02:40:15.634 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:15.627+0000 7ff1d6ffd700 1 --2- 172.21.15.46:0/4196387490 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff1c0004850 0x7ff1c0004cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T02:40:15.634 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:15.627+0000 7ff1d6ffd700 1 --2- 172.21.15.46:0/4196387490 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7ff1d80b8540 0x7ff1c0005200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T02:40:15.634 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:15.627+0000 7ff1d6ffd700 1 -- 172.21.15.46:0/4196387490 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff1d80cda50 con 0x7ff1c0004850 2023-07-06T02:40:15.634 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:15.627+0000 7ff1d6ffd700 1 -- 172.21.15.46:0/4196387490 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff1c000bac0 con 0x7ff1c0003bc0 2023-07-06T02:40:15.634 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:15.627+0000 7ff1d6ffd700 1 -- 172.21.15.46:0/4196387490 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff1c000bc30 con 0x7ff1d80b8540 2023-07-06T02:40:15.634 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:15.627+0000 7ff1d77fe700 1 --2- 172.21.15.46:0/4196387490 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff1c0004850 0x7ff1c0004cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T02:40:15.635 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:15.627+0000 7ff1d7fff700 1 --2- 172.21.15.46:0/4196387490 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff1c0003bc0 0x7ff1c0003fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T02:40:15.635 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:15.627+0000 7ff1dce07700 1 --2- 172.21.15.46:0/4196387490 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7ff1d80b8540 0x7ff1c0005200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T02:40:15.635 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:15.627+0000 7ff1d77fe700 1 -- 172.21.15.46:0/4196387490 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7ff1d80b8540 msgr2=0x7ff1c0005200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T02:40:15.635 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:15.627+0000 7ff1d77fe700 1 --2- 172.21.15.46:0/4196387490 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7ff1d80b8540 0x7ff1c0005200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T02:40:15.635 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:15.627+0000 7ff1d77fe700 1 -- 172.21.15.46:0/4196387490 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff1c0003bc0 msgr2=0x7ff1c0003fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T02:40:15.635 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:15.627+0000 7ff1d77fe700 1 --2- 172.21.15.46:0/4196387490 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff1c0003bc0 0x7ff1c0003fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T02:40:15.635 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:15.627+0000 7ff1d77fe700 1 -- 172.21.15.46:0/4196387490 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff1c00035b0 con 0x7ff1c0004850 2023-07-06T02:40:15.636 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:15.627+0000 7ff1d77fe700 1 --2- 172.21.15.46:0/4196387490 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff1c0004850 0x7ff1c0004cc0 secure :-1 s=READY pgs=3230 cs=0 l=1 rev1=1 crypto rx=0x7ff1cc00c210 tx=0x7ff1c0005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=57fb19496c874c97 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T02:40:15.636 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:15.627+0000 7ff1d6ffd700 1 -- 172.21.15.46:0/4196387490 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1cc00cd50 con 0x7ff1c0004850 2023-07-06T02:40:15.636 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:15.627+0000 7ff1d6ffd700 1 -- 172.21.15.46:0/4196387490 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff1cc005960 con 0x7ff1c0004850 2023-07-06T02:40:15.636 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:15.627+0000 7ff1d6ffd700 1 -- 172.21.15.46:0/4196387490 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1cc005d10 con 0x7ff1c0004850 2023-07-06T02:40:15.636 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:15.628+0000 7ff1de86a700 1 -- 172.21.15.46:0/4196387490 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff1c0004850 msgr2=0x7ff1c0004cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T02:40:15.636 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:15.628+0000 7ff1de86a700 1 --2- 172.21.15.46:0/4196387490 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff1c0004850 0x7ff1c0004cc0 secure :-1 s=READY pgs=3230 cs=0 l=1 rev1=1 crypto rx=0x7ff1cc00c210 tx=0x7ff1c0005880 comp rx=0 tx=0).stop 2023-07-06T02:40:15.636 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:15.628+0000 7ff1dce07700 1 -- 172.21.15.46:0/4196387490 reap_dead start 2023-07-06T02:40:15.637 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:15.628+0000 7ff1de86a700 1 -- 172.21.15.46:0/4196387490 shutdown_connections 2023-07-06T02:40:15.637 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:15.628+0000 7ff1de86a700 1 -- 172.21.15.46:0/4196387490 >> 172.21.15.46:0/4196387490 conn(0x7ff1d806a3a0 msgr2=0x7ff1d806a770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T02:40:15.637 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:15.628+0000 7ff1de86a700 1 -- 172.21.15.46:0/4196387490 shutdown_connections 2023-07-06T02:40:15.637 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:15.628+0000 7ff1de86a700 1 -- 172.21.15.46:0/4196387490 wait complete. 2023-07-06T02:40:15.639 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:15.629+0000 7ff1de86a700 1 Processor -- start 2023-07-06T02:40:15.639 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:15.629+0000 7ff1de86a700 1 -- start start 2023-07-06T02:40:15.640 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:15.630+0000 7ff1de86a700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff1c0004850 0x7ff1d81543b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T02:40:15.640 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:15.630+0000 7ff1de86a700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7ff1d80ca7e0 0x7ff1d80cac50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T02:40:15.640 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:15.630+0000 7ff1de86a700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff1d81f26d0 0x7ff1d81f2b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T02:40:15.640 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:15.630+0000 7ff1de86a700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff1d81f22b0 con 0x7ff1c0004850 2023-07-06T02:40:15.640 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:15.630+0000 7ff1de86a700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff1d80cb560 con 0x7ff1d81f26d0 2023-07-06T02:40:15.640 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:15.630+0000 7ff1de86a700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff1d80cb840 con 0x7ff1d80ca7e0 2023-07-06T02:40:15.640 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:15.630+0000 7ff1d7fff700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff1c0004850 0x7ff1d81543b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T02:40:15.641 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:15.630+0000 7ff1d7fff700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff1c0004850 0x7ff1d81543b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:45990/0 (socket says 172.21.15.46:45990) 2023-07-06T02:40:15.641 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:15.630+0000 7ff1d7fff700 1 -- 172.21.15.46:0/889563934 learned_addr learned my addr 172.21.15.46:0/889563934 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-07-06T02:40:15.641 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:15.630+0000 7ff1d77fe700 1 --2- 172.21.15.46:0/889563934 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7ff1d80ca7e0 0x7ff1d80cac50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T02:40:15.641 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:15.630+0000 7ff1dce07700 1 --2- 172.21.15.46:0/889563934 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff1d81f26d0 0x7ff1d81f2b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T02:40:15.641 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:15.631+0000 7ff1d7fff700 1 -- 172.21.15.46:0/889563934 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7ff1d80ca7e0 msgr2=0x7ff1d80cac50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T02:40:15.641 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:15.631+0000 7ff1d7fff700 1 --2- 172.21.15.46:0/889563934 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7ff1d80ca7e0 0x7ff1d80cac50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T02:40:15.641 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:15.631+0000 7ff1d7fff700 1 -- 172.21.15.46:0/889563934 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff1d81f26d0 msgr2=0x7ff1d81f2b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T02:40:15.642 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:15.631+0000 7ff1d7fff700 1 --2- 172.21.15.46:0/889563934 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff1d81f26d0 0x7ff1d81f2b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T02:40:15.642 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:15.631+0000 7ff1d7fff700 1 -- 172.21.15.46:0/889563934 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff1d80cbb20 con 0x7ff1c0004850 2023-07-06T02:40:15.642 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:15.631+0000 7ff1d77fe700 1 --2- 172.21.15.46:0/889563934 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7ff1d80ca7e0 0x7ff1d80cac50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-06T02:40:15.642 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:15.631+0000 7ff1dce07700 1 --2- 172.21.15.46:0/889563934 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff1d81f26d0 0x7ff1d81f2b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-06T02:40:15.642 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:15.631+0000 7ff1d7fff700 1 --2- 172.21.15.46:0/889563934 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff1c0004850 0x7ff1d81543b0 secure :-1 s=READY pgs=3231 cs=0 l=1 rev1=1 crypto rx=0x7ff1c80119a0 tx=0x7ff1c8011d60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T02:40:15.642 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:15.631+0000 7ff1d4ff9700 1 -- 172.21.15.46:0/889563934 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1c800f940 con 0x7ff1c0004850 2023-07-06T02:40:15.642 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:15.631+0000 7ff1d4ff9700 1 -- 172.21.15.46:0/889563934 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff1c800faa0 con 0x7ff1c0004850 2023-07-06T02:40:15.643 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:15.631+0000 7ff1d4ff9700 1 -- 172.21.15.46:0/889563934 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1c800fe30 con 0x7ff1c0004850 2023-07-06T02:40:15.643 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:15.631+0000 7ff1de86a700 1 -- 172.21.15.46:0/889563934 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff1d80cbe00 con 0x7ff1c0004850 2023-07-06T02:40:15.643 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:15.631+0000 7ff1de86a700 1 -- 172.21.15.46:0/889563934 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff1d81f3080 con 0x7ff1c0004850 2023-07-06T02:40:15.643 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:15.632+0000 7ff1de86a700 1 -- 172.21.15.46:0/889563934 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff1d81f2520 con 0x7ff1c0004850 2023-07-06T02:40:15.643 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:15.632+0000 7ff1d4ff9700 1 -- 172.21.15.46:0/889563934 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7ff1c8014440 con 0x7ff1c0004850 2023-07-06T02:40:15.643 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:15.633+0000 7ff1d4ff9700 1 --2- 172.21.15.46:0/889563934 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7ff1c406ace0 0x7ff1c406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T02:40:15.643 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:15.633+0000 7ff1d4ff9700 1 -- 172.21.15.46:0/889563934 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 6177+0+0 (secure 0 0 0) 0x7ff1c8089a70 con 0x7ff1c0004850 2023-07-06T02:40:15.644 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:15.633+0000 7ff1d77fe700 1 --2- 172.21.15.46:0/889563934 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7ff1c406ace0 0x7ff1c406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T02:40:15.644 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:15.634+0000 7ff1d77fe700 1 --2- 172.21.15.46:0/889563934 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7ff1c406ace0 0x7ff1c406d190 secure :-1 s=READY pgs=729 cs=0 l=1 rev1=1 crypto rx=0x7ff1d80d1920 tx=0x7ff1cc007f90 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T02:40:15.644 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:15.637+0000 7ff1d4ff9700 1 -- 172.21.15.46:0/889563934 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7ff1c8054be0 con 0x7ff1c0004850 2023-07-06T02:40:15.847 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:15.844+0000 7ff1de86a700 1 -- 172.21.15.46:0/889563934 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7ff1d804e1d0 con 0x7ff1c0004850 2023-07-06T02:40:16.468 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:16.466+0000 7ff1d4ff9700 1 -- 172.21.15.46:0/889563934 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v39) v1 ==== 181+0+0 (secure 0 0 0) 0x7ff1c8058200 con 0x7ff1c0004850 2023-07-06T02:40:16.472 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:16.469+0000 7ff1de86a700 1 -- 172.21.15.46:0/889563934 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7ff1c406ace0 msgr2=0x7ff1c406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T02:40:16.472 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:16.469+0000 7ff1de86a700 1 --2- 172.21.15.46:0/889563934 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7ff1c406ace0 0x7ff1c406d190 secure :-1 s=READY pgs=729 cs=0 l=1 rev1=1 crypto rx=0x7ff1d80d1920 tx=0x7ff1cc007f90 comp rx=0 tx=0).stop 2023-07-06T02:40:16.472 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:16.469+0000 7ff1de86a700 1 -- 172.21.15.46:0/889563934 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff1c0004850 msgr2=0x7ff1d81543b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T02:40:16.472 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:16.469+0000 7ff1de86a700 1 --2- 172.21.15.46:0/889563934 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff1c0004850 0x7ff1d81543b0 secure :-1 s=READY pgs=3231 cs=0 l=1 rev1=1 crypto rx=0x7ff1c80119a0 tx=0x7ff1c8011d60 comp rx=0 tx=0).stop 2023-07-06T02:40:16.474 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:16.471+0000 7ff1de86a700 1 -- 172.21.15.46:0/889563934 shutdown_connections 2023-07-06T02:40:16.474 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:16.471+0000 7ff1de86a700 1 --2- 172.21.15.46:0/889563934 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7ff1c406ace0 0x7ff1c406d190 unknown :-1 s=CLOSED pgs=729 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T02:40:16.474 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:16.471+0000 7ff1de86a700 1 --2- 172.21.15.46:0/889563934 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff1d81f26d0 0x7ff1d81f2b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T02:40:16.474 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:16.471+0000 7ff1de86a700 1 --2- 172.21.15.46:0/889563934 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff1c0004850 0x7ff1d81543b0 unknown :-1 s=CLOSED pgs=3231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T02:40:16.474 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:16.471+0000 7ff1de86a700 1 --2- 172.21.15.46:0/889563934 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7ff1d80ca7e0 0x7ff1d80cac50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T02:40:16.474 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:16.471+0000 7ff1de86a700 1 -- 172.21.15.46:0/889563934 >> 172.21.15.46:0/889563934 conn(0x7ff1d806a3a0 msgr2=0x7ff1d806a770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T02:40:16.480 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:16.478+0000 7ff1de86a700 1 -- 172.21.15.46:0/889563934 shutdown_connections 2023-07-06T02:40:16.481 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:16.478+0000 7ff1de86a700 1 -- 172.21.15.46:0/889563934 wait complete. 2023-07-06T02:40:16.482 INFO:teuthology.orchestra.run.smithi046.stderr:pool 'cephfs_metadata' removed 2023-07-06T02:40:16.506 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-07-06T02:40:16.688 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:16.685+0000 7f5bdeb30700 1 Processor -- start 2023-07-06T02:40:16.688 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:16.685+0000 7f5bdeb30700 1 -- start start 2023-07-06T02:40:16.689 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:16.686+0000 7f5bdeb30700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f5bd80cbf00 0x7f5bd806c6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T02:40:16.689 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:16.686+0000 7f5bdeb30700 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5bd80cc2d0 con 0x7f5bd80cdff0 2023-07-06T02:40:16.689 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:16.686+0000 7f5bdeb30700 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5bd806e250 con 0x7f5bd80af060 2023-07-06T02:40:16.689 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:16.686+0000 7f5bdeb30700 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5bd806cc00 con 0x7f5bd80cbf00 2023-07-06T02:40:16.690 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:16.686+0000 7f5bdc8cc700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f5bd80cbf00 0x7f5bd806c6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T02:40:16.690 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:16.686+0000 7f5bdd0cd700 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7f5bd80cdff0 0x7f5bd80ca270 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:45274/0 (socket says 172.21.15.46:45274) 2023-07-06T02:40:16.690 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:16.686+0000 7f5bdd0cd700 1 -- 172.21.15.46:0/4233608788 learned_addr learned my addr 172.21.15.46:0/4233608788 (peer_addr_for_me v1:172.21.15.46:0/0) 2023-07-06T02:40:16.690 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:16.686+0000 7f5bdc8cc700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f5bd80cbf00 0x7f5bd806c6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:45998/0 (socket says 172.21.15.46:45998) 2023-07-06T02:40:16.691 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:16.687+0000 7f5bdc8cc700 1 -- 172.21.15.46:0/4233608788 >> v1:172.21.15.73:6789/0 conn(0x7f5bd80af060 legacy=0x7f5bd80cd8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T02:40:16.691 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:16.687+0000 7f5bdc8cc700 1 -- 172.21.15.46:0/4233608788 >> v1:172.21.15.46:6789/0 conn(0x7f5bd80cdff0 legacy=0x7f5bd80ca270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T02:40:16.691 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:16.687+0000 7f5bdc8cc700 1 -- 172.21.15.46:0/4233608788 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5bd806e530 con 0x7f5bd80cbf00 2023-07-06T02:40:16.692 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:16.687+0000 7f5bd77fe700 1 -- 172.21.15.46:0/4233608788 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 199366166 0 0) 0x7f5bd80cc2d0 con 0x7f5bd80cdff0 2023-07-06T02:40:16.692 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:16.687+0000 7f5bdc8cc700 1 --2- 172.21.15.46:0/4233608788 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5bd80cbf00 0x7f5bd806c6c0 secure :-1 s=READY pgs=3233 cs=0 l=1 rev1=1 crypto rx=0x7f5bcc009840 tx=0x7f5bcc009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=996a2a66ac655faf server_cookie=0 in_seq=0 out_seq=0 2023-07-06T02:40:16.692 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:16.687+0000 7f5bd77fe700 1 -- 172.21.15.46:0/4233608788 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5bcc011830 con 0x7f5bd80cbf00 2023-07-06T02:40:16.692 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:16.687+0000 7f5bd77fe700 1 -- 172.21.15.46:0/4233608788 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5bcc011990 con 0x7f5bd80cbf00 2023-07-06T02:40:16.692 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:16.687+0000 7f5bd77fe700 1 -- 172.21.15.46:0/4233608788 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5bcc011d20 con 0x7f5bd80cbf00 2023-07-06T02:40:16.692 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:16.688+0000 7f5bdeb30700 1 -- 172.21.15.46:0/4233608788 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5bd80cbf00 msgr2=0x7f5bd806c6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T02:40:16.692 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:16.688+0000 7f5bdeb30700 1 --2- 172.21.15.46:0/4233608788 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5bd80cbf00 0x7f5bd806c6c0 secure :-1 s=READY pgs=3233 cs=0 l=1 rev1=1 crypto rx=0x7f5bcc009840 tx=0x7f5bcc009b50 comp rx=0 tx=0).stop 2023-07-06T02:40:16.693 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:16.688+0000 7f5bdeb30700 1 -- 172.21.15.46:0/4233608788 shutdown_connections 2023-07-06T02:40:16.693 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:16.688+0000 7f5bdeb30700 1 --2- 172.21.15.46:0/4233608788 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5bd80cbf00 0x7f5bd806c6c0 unknown :-1 s=CLOSED pgs=3233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T02:40:16.693 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:16.688+0000 7f5bdeb30700 1 -- 172.21.15.46:0/4233608788 >> 172.21.15.46:0/4233608788 conn(0x7f5bd80cf9e0 msgr2=0x7f5bd80cfde0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T02:40:16.693 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:16.688+0000 7f5bdeb30700 1 -- 172.21.15.46:0/4233608788 shutdown_connections 2023-07-06T02:40:16.693 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:16.688+0000 7f5bdeb30700 1 -- 172.21.15.46:0/4233608788 wait complete. 2023-07-06T02:40:16.695 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:16.689+0000 7f5bdeb30700 1 Processor -- start 2023-07-06T02:40:16.695 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:16.689+0000 7f5bdeb30700 1 -- start start 2023-07-06T02:40:16.695 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:16.690+0000 7f5bdeb30700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5bd80af060 0x7f5bd80b52d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T02:40:16.695 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:16.690+0000 7f5bdeb30700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5bd80cbf00 0x7f5bd8157db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T02:40:16.695 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:16.690+0000 7f5bdeb30700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f5bd80cdff0 0x7f5bd815baf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T02:40:16.695 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:16.690+0000 7f5bdeb30700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5bd80c66b0 con 0x7f5bd80cbf00 2023-07-06T02:40:16.695 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:16.690+0000 7f5bdeb30700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5bd80c63d0 con 0x7f5bd80af060 2023-07-06T02:40:16.696 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:16.690+0000 7f5bdeb30700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5bd80a8f30 con 0x7f5bd80cdff0 2023-07-06T02:40:16.696 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:16.690+0000 7f5bd7fff700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5bd80cbf00 0x7f5bd8157db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T02:40:16.696 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:16.690+0000 7f5bd7fff700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5bd80cbf00 0x7f5bd8157db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:46006/0 (socket says 172.21.15.46:46006) 2023-07-06T02:40:16.696 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:16.690+0000 7f5bd7fff700 1 -- 172.21.15.46:0/80848804 learned_addr learned my addr 172.21.15.46:0/80848804 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-07-06T02:40:16.696 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:16.690+0000 7f5bd7fff700 1 -- 172.21.15.46:0/80848804 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f5bd80cdff0 msgr2=0x7f5bd815baf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T02:40:16.696 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:16.690+0000 7f5bd7fff700 1 --2- 172.21.15.46:0/80848804 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f5bd80cdff0 0x7f5bd815baf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T02:40:16.696 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:16.690+0000 7f5bd7fff700 1 -- 172.21.15.46:0/80848804 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5bd80af060 msgr2=0x7f5bd80b52d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T02:40:16.697 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:16.690+0000 7f5bd7fff700 1 --2- 172.21.15.46:0/80848804 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5bd80af060 0x7f5bd80b52d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T02:40:16.697 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:16.690+0000 7f5bd7fff700 1 -- 172.21.15.46:0/80848804 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5bcc0094a0 con 0x7f5bd80cbf00 2023-07-06T02:40:16.697 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:16.691+0000 7f5bd7fff700 1 --2- 172.21.15.46:0/80848804 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5bd80cbf00 0x7f5bd8157db0 secure :-1 s=READY pgs=3234 cs=0 l=1 rev1=1 crypto rx=0x7f5bc800c4e0 tx=0x7f5bc800c8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T02:40:16.697 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:16.691+0000 7f5bd57fa700 1 -- 172.21.15.46:0/80848804 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5bc80052d0 con 0x7f5bd80cbf00 2023-07-06T02:40:16.697 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:16.691+0000 7f5bd57fa700 1 -- 172.21.15.46:0/80848804 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5bc8005430 con 0x7f5bd80cbf00 2023-07-06T02:40:16.697 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:16.691+0000 7f5bdeb30700 1 -- 172.21.15.46:0/80848804 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5bd80a9210 con 0x7f5bd80cbf00 2023-07-06T02:40:16.697 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:16.691+0000 7f5bd57fa700 1 -- 172.21.15.46:0/80848804 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5bc80038c0 con 0x7f5bd80cbf00 2023-07-06T02:40:16.697 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:16.691+0000 7f5bdeb30700 1 -- 172.21.15.46:0/80848804 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5bd80b5810 con 0x7f5bd80cbf00 2023-07-06T02:40:16.698 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:16.692+0000 7f5bdeb30700 1 -- 172.21.15.46:0/80848804 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5bd80a8d90 con 0x7f5bd80cbf00 2023-07-06T02:40:16.699 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:16.693+0000 7f5bd57fa700 1 -- 172.21.15.46:0/80848804 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f5bc8003a20 con 0x7f5bd80cbf00 2023-07-06T02:40:16.699 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:16.693+0000 7f5bd57fa700 1 --2- 172.21.15.46:0/80848804 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7f5bc406ace0 0x7f5bc406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T02:40:16.699 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:16.693+0000 7f5bd57fa700 1 -- 172.21.15.46:0/80848804 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 5739+0+0 (secure 0 0 0) 0x7f5bc80887d0 con 0x7f5bd80cbf00 2023-07-06T02:40:16.699 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:16.693+0000 7f5bdc8cc700 1 --2- 172.21.15.46:0/80848804 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7f5bc406ace0 0x7f5bc406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T02:40:16.699 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:16.694+0000 7f5bdc8cc700 1 --2- 172.21.15.46:0/80848804 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7f5bc406ace0 0x7f5bc406d190 secure :-1 s=READY pgs=730 cs=0 l=1 rev1=1 crypto rx=0x7f5bcc009b90 tx=0x7f5bcc010000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T02:40:16.700 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:16.698+0000 7f5bd57fa700 1 -- 172.21.15.46:0/80848804 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f5bd80a8d90 con 0x7f5bd80cbf00 2023-07-06T02:40:16.934 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:16.931+0000 7f5bdeb30700 1 -- 172.21.15.46:0/80848804 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f5bd80a8d90 con 0x7f5bd80cbf00 2023-07-06T02:40:17.474 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:17.472+0000 7f5bd57fa700 1 -- 172.21.15.46:0/80848804 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v40) v1 ==== 169+0+0 (secure 0 0 0) 0x7f5bd80a8d90 con 0x7f5bd80cbf00 2023-07-06T02:40:17.487 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:17.485+0000 7f5bdeb30700 1 -- 172.21.15.46:0/80848804 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7f5bc406ace0 msgr2=0x7f5bc406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T02:40:17.488 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:17.485+0000 7f5bdeb30700 1 --2- 172.21.15.46:0/80848804 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7f5bc406ace0 0x7f5bc406d190 secure :-1 s=READY pgs=730 cs=0 l=1 rev1=1 crypto rx=0x7f5bcc009b90 tx=0x7f5bcc010000 comp rx=0 tx=0).stop 2023-07-06T02:40:17.488 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:17.485+0000 7f5bdeb30700 1 -- 172.21.15.46:0/80848804 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5bd80cbf00 msgr2=0x7f5bd8157db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T02:40:17.488 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:17.485+0000 7f5bdeb30700 1 --2- 172.21.15.46:0/80848804 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5bd80cbf00 0x7f5bd8157db0 secure :-1 s=READY pgs=3234 cs=0 l=1 rev1=1 crypto rx=0x7f5bc800c4e0 tx=0x7f5bc800c8a0 comp rx=0 tx=0).stop 2023-07-06T02:40:17.492 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:17.489+0000 7f5bdeb30700 1 -- 172.21.15.46:0/80848804 shutdown_connections 2023-07-06T02:40:17.492 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:17.489+0000 7f5bdeb30700 1 --2- 172.21.15.46:0/80848804 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7f5bc406ace0 0x7f5bc406d190 unknown :-1 s=CLOSED pgs=730 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T02:40:17.492 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:17.489+0000 7f5bdeb30700 1 --2- 172.21.15.46:0/80848804 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f5bd80cdff0 0x7f5bd815baf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T02:40:17.492 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:17.489+0000 7f5bdeb30700 1 --2- 172.21.15.46:0/80848804 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5bd80af060 0x7f5bd80b52d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T02:40:17.492 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:17.489+0000 7f5bdeb30700 1 --2- 172.21.15.46:0/80848804 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5bd80cbf00 0x7f5bd8157db0 unknown :-1 s=CLOSED pgs=3234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T02:40:17.492 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:17.489+0000 7f5bdeb30700 1 -- 172.21.15.46:0/80848804 >> 172.21.15.46:0/80848804 conn(0x7f5bd80cf9e0 msgr2=0x7f5bd806b2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T02:40:17.493 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:17.489+0000 7f5bdeb30700 1 -- 172.21.15.46:0/80848804 shutdown_connections 2023-07-06T02:40:17.493 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:17.489+0000 7f5bdeb30700 1 -- 172.21.15.46:0/80848804 wait complete. 2023-07-06T02:40:17.534 INFO:teuthology.orchestra.run.smithi046.stderr:pool 'cephfs_data' removed 2023-07-06T02:40:17.555 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2023-07-06T02:40:17.871 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:17.866+0000 7f05d5eb8700 1 Processor -- start 2023-07-06T02:40:17.872 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:17.866+0000 7f05d5eb8700 1 -- start start 2023-07-06T02:40:17.872 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:17.867+0000 7f05d5eb8700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f05d01609d0 0x7f05d00ad750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T02:40:17.872 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:17.867+0000 7f05d5eb8700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f05d006a510 0x7f05d01646d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T02:40:17.872 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:17.867+0000 7f05d5eb8700 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f05d00c1f00 con 0x7f05d00cdfb0 2023-07-06T02:40:17.872 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:17.867+0000 7f05d5eb8700 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f05d00ae030 con 0x7f05d006a510 2023-07-06T02:40:17.872 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:17.867+0000 7f05d5eb8700 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f05d0070ec0 con 0x7f05d01609d0 2023-07-06T02:40:17.872 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:17.868+0000 7f05cf7fe700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f05d01609d0 0x7f05d00ad750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T02:40:17.873 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:17.868+0000 7f05ceffd700 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7f05d00cdfb0 0x7f05d0069e00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.46:59434/0 (socket says 172.21.15.46:59434) 2023-07-06T02:40:17.873 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:17.868+0000 7f05ceffd700 1 -- 172.21.15.46:0/1558931303 learned_addr learned my addr 172.21.15.46:0/1558931303 (peer_addr_for_me v1:172.21.15.46:0/0) 2023-07-06T02:40:17.873 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:17.868+0000 7f05cffff700 1 --2- 172.21.15.46:0/1558931303 >> v2:172.21.15.46:3300/0 conn(0x7f05d006a510 0x7f05d01646d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T02:40:17.873 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:17.868+0000 7f05cf7fe700 1 -- 172.21.15.46:0/1558931303 >> v2:172.21.15.46:3300/0 conn(0x7f05d006a510 msgr2=0x7f05d01646d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T02:40:17.874 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:17.868+0000 7f05cf7fe700 1 --2- 172.21.15.46:0/1558931303 >> v2:172.21.15.46:3300/0 conn(0x7f05d006a510 0x7f05d01646d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T02:40:17.874 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:17.869+0000 7f05cf7fe700 1 -- 172.21.15.46:0/1558931303 >> v1:172.21.15.73:6789/0 conn(0x7f05d00cdfb0 legacy=0x7f05d0069e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T02:40:17.874 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:17.869+0000 7f05cf7fe700 1 -- 172.21.15.46:0/1558931303 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f05d00711a0 con 0x7f05d01609d0 2023-07-06T02:40:17.874 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:17.869+0000 7f05cf7fe700 1 --2- 172.21.15.46:0/1558931303 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f05d01609d0 0x7f05d00ad750 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f05d00cb240 tx=0x7f05c800b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=31d1f91ad92b8935 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T02:40:17.874 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:17.869+0000 7f05ce7fc700 1 -- 172.21.15.46:0/1558931303 <== mon.1 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05c800e070 con 0x7f05d01609d0 2023-07-06T02:40:17.874 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:17.869+0000 7f05ce7fc700 1 -- 172.21.15.46:0/1558931303 <== mon.1 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f05c800bb20 con 0x7f05d01609d0 2023-07-06T02:40:17.874 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:17.869+0000 7f05ce7fc700 1 -- 172.21.15.46:0/1558931303 <== mon.1 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05c800be90 con 0x7f05d01609d0 2023-07-06T02:40:17.875 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:17.870+0000 7f05d5eb8700 1 -- 172.21.15.46:0/1558931303 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f05d01609d0 msgr2=0x7f05d00ad750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T02:40:17.875 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:17.870+0000 7f05d5eb8700 1 --2- 172.21.15.46:0/1558931303 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f05d01609d0 0x7f05d00ad750 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f05d00cb240 tx=0x7f05c800b330 comp rx=0 tx=0).stop 2023-07-06T02:40:17.875 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:17.871+0000 7f05d5eb8700 1 -- 172.21.15.46:0/1558931303 shutdown_connections 2023-07-06T02:40:17.875 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:17.871+0000 7f05d5eb8700 1 --2- 172.21.15.46:0/1558931303 >> v2:172.21.15.46:3300/0 conn(0x7f05d006a510 0x7f05d01646d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T02:40:17.876 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:17.871+0000 7f05d5eb8700 1 --2- 172.21.15.46:0/1558931303 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f05d01609d0 0x7f05d00ad750 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T02:40:17.876 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:17.871+0000 7f05d5eb8700 1 -- 172.21.15.46:0/1558931303 >> 172.21.15.46:0/1558931303 conn(0x7f05d00ce860 msgr2=0x7f05d00cec30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T02:40:17.876 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:17.872+0000 7f05d5eb8700 1 -- 172.21.15.46:0/1558931303 shutdown_connections 2023-07-06T02:40:17.876 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:17.872+0000 7f05d5eb8700 1 -- 172.21.15.46:0/1558931303 wait complete. 2023-07-06T02:40:17.877 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:17.874+0000 7f05d5eb8700 1 Processor -- start 2023-07-06T02:40:17.877 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:17.874+0000 7f05d5eb8700 1 -- start start 2023-07-06T02:40:17.878 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:17.875+0000 7f05d5eb8700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f05d006a510 0x7f05d0145800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T02:40:17.878 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:17.875+0000 7f05d5eb8700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f05d00cdfb0 0x7f05d00c84b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T02:40:17.879 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:17.875+0000 7f05d5eb8700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f05d01609d0 0x7f05d00b35d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T02:40:17.879 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:17.875+0000 7f05d5eb8700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05d00b2530 con 0x7f05d01609d0 2023-07-06T02:40:17.879 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:17.875+0000 7f05d5eb8700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05d00b2810 con 0x7f05d006a510 2023-07-06T02:40:17.879 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:17.875+0000 7f05d5eb8700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f05d00b2af0 con 0x7f05d00cdfb0 2023-07-06T02:40:17.880 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:17.876+0000 7f05cffff700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f05d01609d0 0x7f05d00b35d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T02:40:17.880 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:17.876+0000 7f05cffff700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f05d01609d0 0x7f05d00b35d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:46020/0 (socket says 172.21.15.46:46020) 2023-07-06T02:40:17.880 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:17.876+0000 7f05cffff700 1 -- 172.21.15.46:0/685072591 learned_addr learned my addr 172.21.15.46:0/685072591 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-07-06T02:40:17.880 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:17.876+0000 7f05ceffd700 1 --2- 172.21.15.46:0/685072591 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f05d00cdfb0 0x7f05d00c84b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T02:40:17.880 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:17.877+0000 7f05cffff700 1 -- 172.21.15.46:0/685072591 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f05d00cdfb0 msgr2=0x7f05d00c84b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T02:40:17.880 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:17.877+0000 7f05cffff700 1 --2- 172.21.15.46:0/685072591 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f05d00cdfb0 0x7f05d00c84b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T02:40:17.881 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:17.877+0000 7f05cffff700 1 -- 172.21.15.46:0/685072591 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f05d006a510 msgr2=0x7f05d0145800 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-07-06T02:40:17.881 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:17.877+0000 7f05cffff700 1 --2- 172.21.15.46:0/685072591 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f05d006a510 0x7f05d0145800 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T02:40:17.881 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:17.877+0000 7f05cffff700 1 -- 172.21.15.46:0/685072591 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f05c8009a70 con 0x7f05d01609d0 2023-07-06T02:40:17.881 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:17.877+0000 7f05cffff700 1 --2- 172.21.15.46:0/685072591 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f05d01609d0 0x7f05d00b35d0 secure :-1 s=READY pgs=3235 cs=0 l=1 rev1=1 crypto rx=0x7f05c000e930 tx=0x7f05c000ec40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T02:40:17.882 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:17.878+0000 7f05b7fff700 1 -- 172.21.15.46:0/685072591 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05c00096d0 con 0x7f05d01609d0 2023-07-06T02:40:17.882 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:17.878+0000 7f05b7fff700 1 -- 172.21.15.46:0/685072591 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f05c000ee80 con 0x7f05d01609d0 2023-07-06T02:40:17.882 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:17.878+0000 7f05b7fff700 1 -- 172.21.15.46:0/685072591 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05c000ca70 con 0x7f05d01609d0 2023-07-06T02:40:17.882 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:17.878+0000 7f05d5eb8700 1 -- 172.21.15.46:0/685072591 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f05d00b2dd0 con 0x7f05d01609d0 2023-07-06T02:40:17.882 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:17.878+0000 7f05d5eb8700 1 -- 172.21.15.46:0/685072591 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f05d0145d40 con 0x7f05d01609d0 2023-07-06T02:40:17.884 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:17.881+0000 7f05b7fff700 1 -- 172.21.15.46:0/685072591 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f05c000cbd0 con 0x7f05d01609d0 2023-07-06T02:40:17.884 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:17.882+0000 7f05b7fff700 1 --2- 172.21.15.46:0/685072591 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7f05bc06ad30 0x7f05bc06d1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T02:40:17.885 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:17.882+0000 7f05b7fff700 1 -- 172.21.15.46:0/685072591 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 5296+0+0 (secure 0 0 0) 0x7f05c0089150 con 0x7f05d01609d0 2023-07-06T02:40:17.885 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:17.882+0000 7f05d5eb8700 1 -- 172.21.15.46:0/685072591 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f05b00052f0 con 0x7f05d01609d0 2023-07-06T02:40:17.886 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:17.882+0000 7f05cf7fe700 1 --2- 172.21.15.46:0/685072591 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7f05bc06ad30 0x7f05bc06d1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T02:40:17.895 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:17.892+0000 7f05b7fff700 1 -- 172.21.15.46:0/685072591 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f05c0017080 con 0x7f05d01609d0 2023-07-06T02:40:17.898 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:17.894+0000 7f05cf7fe700 1 --2- 172.21.15.46:0/685072591 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7f05bc06ad30 0x7f05bc06d1e0 secure :-1 s=READY pgs=731 cs=0 l=1 rev1=1 crypto rx=0x7f05c8014040 tx=0x7f05c8011000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T02:40:18.334 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:18.331+0000 7f05d5eb8700 1 -- 172.21.15.46:0/685072591 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7f05b0005b20 con 0x7f05d01609d0 2023-07-06T02:40:18.343 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:18.341+0000 7f05b7fff700 1 -- 172.21.15.46:0/685072591 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v11) v1 ==== 104+0+0 (secure 0 0 0) 0x7f05c00210a0 con 0x7f05d01609d0 2023-07-06T02:40:18.348 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:18.346+0000 7f05d5eb8700 1 -- 172.21.15.46:0/685072591 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7f05bc06ad30 msgr2=0x7f05bc06d1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T02:40:18.349 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:18.346+0000 7f05d5eb8700 1 --2- 172.21.15.46:0/685072591 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7f05bc06ad30 0x7f05bc06d1e0 secure :-1 s=READY pgs=731 cs=0 l=1 rev1=1 crypto rx=0x7f05c8014040 tx=0x7f05c8011000 comp rx=0 tx=0).stop 2023-07-06T02:40:18.349 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:18.346+0000 7f05d5eb8700 1 -- 172.21.15.46:0/685072591 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f05d01609d0 msgr2=0x7f05d00b35d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T02:40:18.349 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:18.346+0000 7f05d5eb8700 1 --2- 172.21.15.46:0/685072591 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f05d01609d0 0x7f05d00b35d0 secure :-1 s=READY pgs=3235 cs=0 l=1 rev1=1 crypto rx=0x7f05c000e930 tx=0x7f05c000ec40 comp rx=0 tx=0).stop 2023-07-06T02:40:18.349 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:18.346+0000 7f05d5eb8700 1 -- 172.21.15.46:0/685072591 shutdown_connections 2023-07-06T02:40:18.350 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:18.346+0000 7f05d5eb8700 1 --2- 172.21.15.46:0/685072591 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7f05bc06ad30 0x7f05bc06d1e0 unknown :-1 s=CLOSED pgs=731 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T02:40:18.350 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:18.346+0000 7f05d5eb8700 1 --2- 172.21.15.46:0/685072591 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f05d01609d0 0x7f05d00b35d0 unknown :-1 s=CLOSED pgs=3235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T02:40:18.350 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:18.346+0000 7f05d5eb8700 1 --2- 172.21.15.46:0/685072591 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f05d006a510 0x7f05d0145800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T02:40:18.350 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:18.346+0000 7f05d5eb8700 1 --2- 172.21.15.46:0/685072591 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f05d00cdfb0 0x7f05d00c84b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T02:40:18.350 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:18.346+0000 7f05d5eb8700 1 -- 172.21.15.46:0/685072591 >> 172.21.15.46:0/685072591 conn(0x7f05d00ce860 msgr2=0x7f05d01525c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T02:40:18.351 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:18.348+0000 7f05d5eb8700 1 -- 172.21.15.46:0/685072591 shutdown_connections 2023-07-06T02:40:18.351 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:18.349+0000 7f05d5eb8700 1 -- 172.21.15.46:0/685072591 wait complete. 2023-07-06T02:40:18.375 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.tests_from_xfstests_dev.TestXFSTestsDev.test_generic' 2023-07-06T02:40:18.782 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:18.778+0000 7feadc160700 1 Processor -- start 2023-07-06T02:40:18.782 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:18.779+0000 7feadc160700 1 -- start start 2023-07-06T02:40:18.788 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:18.784+0000 7feadc160700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fead41609d0 0x7fead40ad750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T02:40:18.788 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:18.784+0000 7feadc160700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fead406a510 0x7fead41646d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T02:40:18.788 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:18.784+0000 7feadc160700 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fead40c1f00 con 0x7fead40cdfb0 2023-07-06T02:40:18.788 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:18.784+0000 7feadc160700 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fead40ae030 con 0x7fead41609d0 2023-07-06T02:40:18.788 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:18.784+0000 7feadc160700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fead4070ec0 con 0x7fead406a510 2023-07-06T02:40:18.788 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:18.784+0000 7fead96fb700 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7fead40cdfb0 0x7fead4069e00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.46:59444/0 (socket says 172.21.15.46:59444) 2023-07-06T02:40:18.789 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:18.784+0000 7fead96fb700 1 -- 172.21.15.46:0/3935021231 learned_addr learned my addr 172.21.15.46:0/3935021231 (peer_addr_for_me v1:172.21.15.46:0/0) 2023-07-06T02:40:18.789 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:18.784+0000 7feada6fd700 1 --2- 172.21.15.46:0/3935021231 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fead406a510 0x7fead41646d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T02:40:18.789 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:18.785+0000 7feada6fd700 1 -- 172.21.15.46:0/3935021231 >> v2:172.21.15.73:3300/0 conn(0x7fead41609d0 msgr2=0x7fead40ad750 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-07-06T02:40:18.789 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:18.785+0000 7feada6fd700 1 --2- 172.21.15.46:0/3935021231 >> v2:172.21.15.73:3300/0 conn(0x7fead41609d0 0x7fead40ad750 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T02:40:18.790 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:18.785+0000 7feada6fd700 1 -- 172.21.15.46:0/3935021231 >> v1:172.21.15.73:6789/0 conn(0x7fead40cdfb0 legacy=0x7fead4069e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T02:40:18.790 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:18.785+0000 7feada6fd700 1 -- 172.21.15.46:0/3935021231 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fead40711a0 con 0x7fead406a510 2023-07-06T02:40:18.790 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:18.785+0000 7feada6fd700 1 --2- 172.21.15.46:0/3935021231 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fead406a510 0x7fead41646d0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7feacc009d90 tx=0x7feacc00b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3ce89764a0b63aa server_cookie=0 in_seq=0 out_seq=0 2023-07-06T02:40:18.790 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:18.786+0000 7fead8efa700 1 -- 172.21.15.46:0/3935021231 <== mon.2 v2:172.21.15.73:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feacc00e070 con 0x7fead406a510 2023-07-06T02:40:18.790 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:18.786+0000 7fead8efa700 1 -- 172.21.15.46:0/3935021231 <== mon.2 v2:172.21.15.73:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feacc00bbd0 con 0x7fead406a510 2023-07-06T02:40:18.790 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:18.786+0000 7fead8efa700 1 -- 172.21.15.46:0/3935021231 <== mon.2 v2:172.21.15.73:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feacc012430 con 0x7fead406a510 2023-07-06T02:40:18.791 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:18.787+0000 7feadc160700 1 -- 172.21.15.46:0/3935021231 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fead406a510 msgr2=0x7fead41646d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T02:40:18.791 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:18.787+0000 7feadc160700 1 --2- 172.21.15.46:0/3935021231 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fead406a510 0x7fead41646d0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7feacc009d90 tx=0x7feacc00b330 comp rx=0 tx=0).stop 2023-07-06T02:40:18.791 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:18.788+0000 7feadc160700 1 -- 172.21.15.46:0/3935021231 shutdown_connections 2023-07-06T02:40:18.791 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:18.788+0000 7feadc160700 1 --2- 172.21.15.46:0/3935021231 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fead406a510 0x7fead41646d0 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T02:40:18.791 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:18.788+0000 7feadc160700 1 --2- 172.21.15.46:0/3935021231 >> v2:172.21.15.73:3300/0 conn(0x7fead41609d0 0x7fead40ad750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T02:40:18.791 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:18.788+0000 7feadc160700 1 -- 172.21.15.46:0/3935021231 >> 172.21.15.46:0/3935021231 conn(0x7fead40ce860 msgr2=0x7fead40cec30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T02:40:18.794 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:18.791+0000 7feadc160700 1 -- 172.21.15.46:0/3935021231 shutdown_connections 2023-07-06T02:40:18.797 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:18.793+0000 7feadc160700 1 -- 172.21.15.46:0/3935021231 wait complete. 2023-07-06T02:40:18.798 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:18.795+0000 7feadc160700 1 Processor -- start 2023-07-06T02:40:18.799 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:18.795+0000 7feadc160700 1 -- start start 2023-07-06T02:40:18.799 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:18.796+0000 7feadc160700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fead406a510 0x7fead40b1690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T02:40:18.800 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:18.796+0000 7feadc160700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fead40cdfb0 0x7fead415c4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T02:40:18.800 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:18.796+0000 7feadc160700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fead41609d0 0x7fead40b2070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T02:40:18.800 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:18.796+0000 7feadc160700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fead40c70a0 con 0x7fead41609d0 2023-07-06T02:40:18.800 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:18.796+0000 7feadc160700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fead40c6790 con 0x7fead40cdfb0 2023-07-06T02:40:18.800 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:18.796+0000 7feadc160700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fead40b43f0 con 0x7fead406a510 2023-07-06T02:40:18.801 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:18.797+0000 7feada6fd700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fead41609d0 0x7fead40b2070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T02:40:18.801 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:18.797+0000 7feada6fd700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fead41609d0 0x7fead40b2070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:46030/0 (socket says 172.21.15.46:46030) 2023-07-06T02:40:18.801 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:18.797+0000 7feada6fd700 1 -- 172.21.15.46:0/105674871 learned_addr learned my addr 172.21.15.46:0/105674871 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-07-06T02:40:18.801 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:18.798+0000 7feada6fd700 1 -- 172.21.15.46:0/105674871 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fead406a510 msgr2=0x7fead40b1690 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-07-06T02:40:18.801 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:18.798+0000 7feada6fd700 1 --2- 172.21.15.46:0/105674871 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fead406a510 0x7fead40b1690 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T02:40:18.801 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:18.798+0000 7feada6fd700 1 -- 172.21.15.46:0/105674871 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fead40cdfb0 msgr2=0x7fead415c4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T02:40:18.802 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:18.798+0000 7feada6fd700 1 --2- 172.21.15.46:0/105674871 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fead40cdfb0 0x7fead415c4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T02:40:18.802 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:18.798+0000 7feada6fd700 1 -- 172.21.15.46:0/105674871 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feacc009a70 con 0x7fead41609d0 2023-07-06T02:40:18.802 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:18.798+0000 7feada6fd700 1 --2- 172.21.15.46:0/105674871 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fead41609d0 0x7fead40b2070 secure :-1 s=READY pgs=3236 cs=0 l=1 rev1=1 crypto rx=0x7feacc014040 tx=0x7feacc004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T02:40:18.803 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:18.799+0000 7feaca7fc700 1 -- 172.21.15.46:0/105674871 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feacc004960 con 0x7fead41609d0 2023-07-06T02:40:18.803 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:18.799+0000 7feadc160700 1 -- 172.21.15.46:0/105674871 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fead40c69e0 con 0x7fead41609d0 2023-07-06T02:40:18.804 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:18.799+0000 7feadc160700 1 -- 172.21.15.46:0/105674871 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fead415c9f0 con 0x7fead41609d0 2023-07-06T02:40:18.804 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:18.802+0000 7feadc160700 1 -- 172.21.15.46:0/105674871 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fead40c71e0 con 0x7fead41609d0 2023-07-06T02:40:18.807 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:18.804+0000 7feaca7fc700 1 -- 172.21.15.46:0/105674871 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feacc020070 con 0x7fead41609d0 2023-07-06T02:40:18.807 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:18.804+0000 7feaca7fc700 1 -- 172.21.15.46:0/105674871 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feacc0276a0 con 0x7fead41609d0 2023-07-06T02:40:18.821 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:18.817+0000 7feaca7fc700 1 -- 172.21.15.46:0/105674871 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7feacc031470 con 0x7fead41609d0 2023-07-06T02:40:18.821 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:18.818+0000 7feaca7fc700 1 --2- 172.21.15.46:0/105674871 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7feab806ace0 0x7feab806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T02:40:18.821 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:18.818+0000 7feaca7fc700 1 -- 172.21.15.46:0/105674871 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 5296+0+0 (secure 0 0 0) 0x7feacc022070 con 0x7fead41609d0 2023-07-06T02:40:18.821 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:18.818+0000 7feaca7fc700 1 -- 172.21.15.46:0/105674871 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7feacc08bb50 con 0x7fead41609d0 2023-07-06T02:40:18.824 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:18.819+0000 7fead9efc700 1 --2- 172.21.15.46:0/105674871 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7feab806ace0 0x7feab806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T02:40:18.853 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:18.850+0000 7fead9efc700 1 --2- 172.21.15.46:0/105674871 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7feab806ace0 0x7feab806d190 secure :-1 s=READY pgs=732 cs=0 l=1 rev1=1 crypto rx=0x7feac4006fd0 tx=0x7feac4006bc0 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T02:40:19.577 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:19.574+0000 7feadc160700 1 -- 172.21.15.46:0/105674871 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.tests_from_xfstests_dev.TestXFSTestsDev.test_generic"]} v 0) v1 -- 0x7fead40c71e0 con 0x7fead41609d0 2023-07-06T02:40:20.535 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:20.532+0000 7feaca7fc700 1 -- 172.21.15.46:0/105674871 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.tests_from_xfstests_dev.TestXFSTestsDev.test_generic"]}]=0 v14000) v1 ==== 144+0+0 (secure 0 0 0) 0x7fead40c71e0 con 0x7fead41609d0 2023-07-06T02:40:20.541 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:20.538+0000 7feadc160700 1 -- 172.21.15.46:0/105674871 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7feab806ace0 msgr2=0x7feab806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T02:40:20.541 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:20.538+0000 7feadc160700 1 --2- 172.21.15.46:0/105674871 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7feab806ace0 0x7feab806d190 secure :-1 s=READY pgs=732 cs=0 l=1 rev1=1 crypto rx=0x7feac4006fd0 tx=0x7feac4006bc0 comp rx=0 tx=0).stop 2023-07-06T02:40:20.541 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:20.538+0000 7feadc160700 1 -- 172.21.15.46:0/105674871 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fead41609d0 msgr2=0x7fead40b2070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T02:40:20.542 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:20.538+0000 7feadc160700 1 --2- 172.21.15.46:0/105674871 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fead41609d0 0x7fead40b2070 secure :-1 s=READY pgs=3236 cs=0 l=1 rev1=1 crypto rx=0x7feacc014040 tx=0x7feacc004ad0 comp rx=0 tx=0).stop 2023-07-06T02:40:20.542 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:20.538+0000 7feadc160700 1 -- 172.21.15.46:0/105674871 shutdown_connections 2023-07-06T02:40:20.542 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:20.538+0000 7feadc160700 1 --2- 172.21.15.46:0/105674871 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7feab806ace0 0x7feab806d190 unknown :-1 s=CLOSED pgs=732 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T02:40:20.542 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:20.538+0000 7feadc160700 1 --2- 172.21.15.46:0/105674871 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fead41609d0 0x7fead40b2070 unknown :-1 s=CLOSED pgs=3236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T02:40:20.542 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:20.538+0000 7feadc160700 1 --2- 172.21.15.46:0/105674871 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fead406a510 0x7fead40b1690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T02:40:20.542 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:20.538+0000 7feadc160700 1 --2- 172.21.15.46:0/105674871 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fead40cdfb0 0x7fead415c4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T02:40:20.542 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:20.538+0000 7feadc160700 1 -- 172.21.15.46:0/105674871 >> 172.21.15.46:0/105674871 conn(0x7fead40ce860 msgr2=0x7fead40c8e90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T02:40:20.542 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:20.538+0000 7feadc160700 1 -- 172.21.15.46:0/105674871 shutdown_connections 2023-07-06T02:40:20.543 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:20.538+0000 7feadc160700 1 -- 172.21.15.46:0/105674871 wait complete. 2023-07-06T02:40:20.566 INFO:tasks.cephfs_test_runner:test_generic (tasks.cephfs.tests_from_xfstests_dev.TestXFSTestsDev) ... FAIL 2023-07-06T02:40:20.567 INFO:tasks.cephfs_test_runner: 2023-07-06T02:40:20.567 INFO:tasks.cephfs_test_runner:====================================================================== 2023-07-06T02:40:20.568 INFO:tasks.cephfs_test_runner:FAIL: test_generic (tasks.cephfs.tests_from_xfstests_dev.TestXFSTestsDev) 2023-07-06T02:40:20.568 INFO:tasks.cephfs_test_runner:---------------------------------------------------------------------- 2023-07-06T02:40:20.568 INFO:tasks.cephfs_test_runner:Traceback (most recent call last): 2023-07-06T02:40:20.568 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph-c_0a781ef0807ae9473fb1306ef07036226ca4f1a6/qa/tasks/cephfs/tests_from_xfstests_dev.py", line 12, in test_generic 2023-07-06T02:40:20.568 INFO:tasks.cephfs_test_runner: self.run_generic_tests() 2023-07-06T02:40:20.569 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph-c_0a781ef0807ae9473fb1306ef07036226ca4f1a6/qa/tasks/cephfs/xfstests_dev.py", line 387, in run_generic_tests 2023-07-06T02:40:20.569 INFO:tasks.cephfs_test_runner: return self.run_testdir('generic') 2023-07-06T02:40:20.569 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph-c_0a781ef0807ae9473fb1306ef07036226ca4f1a6/qa/tasks/cephfs/xfstests_dev.py", line 379, in run_testdir 2023-07-06T02:40:20.569 INFO:tasks.cephfs_test_runner: self.assertEqual(self.total_tests_failed, 0) 2023-07-06T02:40:20.569 INFO:tasks.cephfs_test_runner:AssertionError: 2 != 0 2023-07-06T02:40:20.570 INFO:tasks.cephfs_test_runner: 2023-07-06T02:40:20.570 INFO:tasks.cephfs_test_runner:---------------------------------------------------------------------- 2023-07-06T02:40:20.570 INFO:tasks.cephfs_test_runner:Ran 1 test in 27813.757s 2023-07-06T02:40:20.570 INFO:tasks.cephfs_test_runner: 2023-07-06T02:40:20.570 INFO:tasks.cephfs_test_runner:FAILED (failures=1) 2023-07-06T02:40:20.571 INFO:tasks.cephfs_test_runner: 2023-07-06T02:40:20.571 INFO:tasks.cephfs_test_runner:====================================================================== 2023-07-06T02:40:20.571 INFO:tasks.cephfs_test_runner:FAIL: test_generic (tasks.cephfs.tests_from_xfstests_dev.TestXFSTestsDev) 2023-07-06T02:40:20.572 INFO:tasks.cephfs_test_runner:---------------------------------------------------------------------- 2023-07-06T02:40:20.572 INFO:tasks.cephfs_test_runner:Traceback (most recent call last): 2023-07-06T02:40:20.572 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph-c_0a781ef0807ae9473fb1306ef07036226ca4f1a6/qa/tasks/cephfs/tests_from_xfstests_dev.py", line 12, in test_generic 2023-07-06T02:40:20.572 INFO:tasks.cephfs_test_runner: self.run_generic_tests() 2023-07-06T02:40:20.572 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph-c_0a781ef0807ae9473fb1306ef07036226ca4f1a6/qa/tasks/cephfs/xfstests_dev.py", line 387, in run_generic_tests 2023-07-06T02:40:20.573 INFO:tasks.cephfs_test_runner: return self.run_testdir('generic') 2023-07-06T02:40:20.573 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph-c_0a781ef0807ae9473fb1306ef07036226ca4f1a6/qa/tasks/cephfs/xfstests_dev.py", line 379, in run_testdir 2023-07-06T02:40:20.573 INFO:tasks.cephfs_test_runner: self.assertEqual(self.total_tests_failed, 0) 2023-07-06T02:40:20.573 INFO:tasks.cephfs_test_runner:AssertionError: 2 != 0 2023-07-06T02:40:20.573 INFO:tasks.cephfs_test_runner: 2023-07-06T02:40:20.574 ERROR:teuthology.run_tasks:Saw exception from tasks. Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_b53f236c1077f1d295baafb9e0ca9a4b447019d7/teuthology/run_tasks.py", line 109, in run_tasks manager.__enter__() File "/usr/lib/python3.8/contextlib.py", line 113, in __enter__ return next(self.gen) File "/home/teuthworker/src/git.ceph.com_ceph-c_0a781ef0807ae9473fb1306ef07036226ca4f1a6/qa/tasks/cephfs_test_runner.py", line 211, in task raise RuntimeError("Test failure: {0}".format(", ".join(bad_tests))) RuntimeError: Test failure: test_generic (tasks.cephfs.tests_from_xfstests_dev.TestXFSTestsDev) 2023-07-06T02:40:20.646 ERROR:teuthology.run_tasks: Sentry event: https://sentry.ceph.com/organizations/ceph/?query=ac67f2f3a2ad4b9093b435b7d8f7ac01 Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_b53f236c1077f1d295baafb9e0ca9a4b447019d7/teuthology/run_tasks.py", line 109, in run_tasks manager.__enter__() File "/usr/lib/python3.8/contextlib.py", line 113, in __enter__ return next(self.gen) File "/home/teuthworker/src/git.ceph.com_ceph-c_0a781ef0807ae9473fb1306ef07036226ca4f1a6/qa/tasks/cephfs_test_runner.py", line 211, in task raise RuntimeError("Test failure: {0}".format(", ".join(bad_tests))) RuntimeError: Test failure: test_generic (tasks.cephfs.tests_from_xfstests_dev.TestXFSTestsDev) 2023-07-06T02:40:20.648 DEBUG:teuthology.run_tasks:Unwinding manager cephfs_test_runner 2023-07-06T02:40:20.658 DEBUG:teuthology.run_tasks:Unwinding manager kclient 2023-07-06T02:40:20.694 INFO:tasks.kclient:Unmounting kernel clients... 2023-07-06T02:40:20.697 DEBUG:teuthology.orchestra.run.smithi046:> set -ex 2023-07-06T02:40:20.697 DEBUG:teuthology.orchestra.run.smithi046:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-06T02:40:20.737 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=16287360k,nr_inodes=4071840,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,mode=755 0 0 tmpfs /sys/fs/cgroup tmpfs ro,seclabel,nosuid,nodev,noexec,mode=755 0 0 cgroup /sys/fs/cgroup/systemd cgroup rw,seclabel,nosuid,nodev,noexec,relatime,xattr,release_agent=/usr/lib/systemd/systemd-cgroups-agent,name=systemd 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 cgroup /sys/fs/cgroup/freezer cgroup rw,seclabel,nosuid,nodev,noexec,relatime,freezer 0 0 cgroup /sys/fs/cgroup/blkio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,blkio 0 0 cgroup /sys/fs/cgroup/hugetlb cgroup rw,seclabel,nosuid,nodev,noexec,relatime,hugetlb 0 0 cgroup /sys/fs/cgroup/net_cls,net_prio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,net_cls,net_prio 0 0 cgroup /sys/fs/cgroup/cpu,cpuacct cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpu,cpuacct 0 0 cgroup /sys/fs/cgroup/rdma cgroup rw,seclabel,nosuid,nodev,noexec,relatime,rdma 0 0 cgroup /sys/fs/cgroup/perf_event cgroup rw,seclabel,nosuid,nodev,noexec,relatime,perf_event 0 0 cgroup /sys/fs/cgroup/cpuset cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpuset 0 0 cgroup /sys/fs/cgroup/pids cgroup rw,seclabel,nosuid,nodev,noexec,relatime,pids 0 0 cgroup /sys/fs/cgroup/memory cgroup rw,seclabel,nosuid,nodev,noexec,relatime,memory 0 0 cgroup /sys/fs/cgroup/devices cgroup rw,seclabel,nosuid,nodev,noexec,relatime,devices 0 0 none /sys/kernel/tracing tracefs rw,seclabel,relatime 0 0 configfs /sys/kernel/config configfs rw,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=39,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=16105 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,relatime 0 0 mqueue /dev/mqueue mqueue rw,seclabel,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,relatime 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3261172k,mode=700,uid=1000,gid=1265 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw,seclabel 0 0 tmpfs /run/user/10101 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3261172k,mode=700,uid=10101,gid=10101 0 0 2023-07-06T02:40:20.738 DEBUG:teuthology.orchestra.run.smithi046:> set -ex 2023-07-06T02:40:20.738 DEBUG:teuthology.orchestra.run.smithi046:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-06T02:40:20.800 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=16287360k,nr_inodes=4071840,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,mode=755 0 0 tmpfs /sys/fs/cgroup tmpfs ro,seclabel,nosuid,nodev,noexec,mode=755 0 0 cgroup /sys/fs/cgroup/systemd cgroup rw,seclabel,nosuid,nodev,noexec,relatime,xattr,release_agent=/usr/lib/systemd/systemd-cgroups-agent,name=systemd 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 cgroup /sys/fs/cgroup/freezer cgroup rw,seclabel,nosuid,nodev,noexec,relatime,freezer 0 0 cgroup /sys/fs/cgroup/blkio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,blkio 0 0 cgroup /sys/fs/cgroup/hugetlb cgroup rw,seclabel,nosuid,nodev,noexec,relatime,hugetlb 0 0 cgroup /sys/fs/cgroup/net_cls,net_prio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,net_cls,net_prio 0 0 cgroup /sys/fs/cgroup/cpu,cpuacct cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpu,cpuacct 0 0 cgroup /sys/fs/cgroup/rdma cgroup rw,seclabel,nosuid,nodev,noexec,relatime,rdma 0 0 cgroup /sys/fs/cgroup/perf_event cgroup rw,seclabel,nosuid,nodev,noexec,relatime,perf_event 0 0 cgroup /sys/fs/cgroup/cpuset cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpuset 0 0 cgroup /sys/fs/cgroup/pids cgroup rw,seclabel,nosuid,nodev,noexec,relatime,pids 0 0 cgroup /sys/fs/cgroup/memory cgroup rw,seclabel,nosuid,nodev,noexec,relatime,memory 0 0 cgroup /sys/fs/cgroup/devices cgroup rw,seclabel,nosuid,nodev,noexec,relatime,devices 0 0 none /sys/kernel/tracing tracefs rw,seclabel,relatime 0 0 configfs /sys/kernel/config configfs rw,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=39,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=16105 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,relatime 0 0 mqueue /dev/mqueue mqueue rw,seclabel,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,relatime 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3261172k,mode=700,uid=1000,gid=1265 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw,seclabel 0 0 tmpfs /run/user/10101 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3261172k,mode=700,uid=10101,gid=10101 0 0 2023-07-06T02:40:20.800 DEBUG:teuthology.orchestra.run.smithi073:> set -ex 2023-07-06T02:40:20.800 DEBUG:teuthology.orchestra.run.smithi073:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-06T02:40:20.822 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=16284204k,nr_inodes=4071051,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,mode=755 0 0 tmpfs /sys/fs/cgroup tmpfs ro,seclabel,nosuid,nodev,noexec,mode=755 0 0 cgroup /sys/fs/cgroup/systemd cgroup rw,seclabel,nosuid,nodev,noexec,relatime,xattr,release_agent=/usr/lib/systemd/systemd-cgroups-agent,name=systemd 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 cgroup /sys/fs/cgroup/memory cgroup rw,seclabel,nosuid,nodev,noexec,relatime,memory 0 0 cgroup /sys/fs/cgroup/rdma cgroup rw,seclabel,nosuid,nodev,noexec,relatime,rdma 0 0 cgroup /sys/fs/cgroup/cpu,cpuacct cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpu,cpuacct 0 0 cgroup /sys/fs/cgroup/net_cls,net_prio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,net_cls,net_prio 0 0 cgroup /sys/fs/cgroup/pids cgroup rw,seclabel,nosuid,nodev,noexec,relatime,pids 0 0 cgroup /sys/fs/cgroup/perf_event cgroup rw,seclabel,nosuid,nodev,noexec,relatime,perf_event 0 0 cgroup /sys/fs/cgroup/freezer cgroup rw,seclabel,nosuid,nodev,noexec,relatime,freezer 0 0 cgroup /sys/fs/cgroup/hugetlb cgroup rw,seclabel,nosuid,nodev,noexec,relatime,hugetlb 0 0 cgroup /sys/fs/cgroup/cpuset cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpuset 0 0 cgroup /sys/fs/cgroup/devices cgroup rw,seclabel,nosuid,nodev,noexec,relatime,devices 0 0 cgroup /sys/fs/cgroup/blkio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,blkio 0 0 none /sys/kernel/tracing tracefs rw,seclabel,relatime 0 0 configfs /sys/kernel/config configfs rw,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=28,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=12193 0 0 mqueue /dev/mqueue mqueue rw,seclabel,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,relatime 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3260540k,mode=700,uid=1000,gid=1265 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw,seclabel 0 0 2023-07-06T02:40:20.822 DEBUG:teuthology.orchestra.run.smithi073:> set -ex 2023-07-06T02:40:20.823 DEBUG:teuthology.orchestra.run.smithi073:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-06T02:40:20.879 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=16284204k,nr_inodes=4071051,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,mode=755 0 0 tmpfs /sys/fs/cgroup tmpfs ro,seclabel,nosuid,nodev,noexec,mode=755 0 0 cgroup /sys/fs/cgroup/systemd cgroup rw,seclabel,nosuid,nodev,noexec,relatime,xattr,release_agent=/usr/lib/systemd/systemd-cgroups-agent,name=systemd 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 cgroup /sys/fs/cgroup/memory cgroup rw,seclabel,nosuid,nodev,noexec,relatime,memory 0 0 cgroup /sys/fs/cgroup/rdma cgroup rw,seclabel,nosuid,nodev,noexec,relatime,rdma 0 0 cgroup /sys/fs/cgroup/cpu,cpuacct cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpu,cpuacct 0 0 cgroup /sys/fs/cgroup/net_cls,net_prio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,net_cls,net_prio 0 0 cgroup /sys/fs/cgroup/pids cgroup rw,seclabel,nosuid,nodev,noexec,relatime,pids 0 0 cgroup /sys/fs/cgroup/perf_event cgroup rw,seclabel,nosuid,nodev,noexec,relatime,perf_event 0 0 cgroup /sys/fs/cgroup/freezer cgroup rw,seclabel,nosuid,nodev,noexec,relatime,freezer 0 0 cgroup /sys/fs/cgroup/hugetlb cgroup rw,seclabel,nosuid,nodev,noexec,relatime,hugetlb 0 0 cgroup /sys/fs/cgroup/cpuset cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpuset 0 0 cgroup /sys/fs/cgroup/devices cgroup rw,seclabel,nosuid,nodev,noexec,relatime,devices 0 0 cgroup /sys/fs/cgroup/blkio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,blkio 0 0 none /sys/kernel/tracing tracefs rw,seclabel,relatime 0 0 configfs /sys/kernel/config configfs rw,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=28,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=12193 0 0 mqueue /dev/mqueue mqueue rw,seclabel,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,relatime 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3260540k,mode=700,uid=1000,gid=1265 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw,seclabel 0 0 2023-07-06T02:40:20.879 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-06T02:40:20.880 DEBUG:teuthology.orchestra.run.smithi046:> ip netns list 2023-07-06T02:40:20.930 INFO:teuthology.orchestra.run.smithi046.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-07-06T02:40:20.931 INFO:teuthology.orchestra.run.smithi046.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-07-06T02:40:20.931 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-06T02:40:20.931 DEBUG:teuthology.orchestra.run.smithi046:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.2 2023-07-06T02:40:20.975 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-06T02:40:20.975 DEBUG:teuthology.orchestra.run.smithi046:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.0 2023-07-06T02:40:21.066 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-06T02:40:21.066 DEBUG:teuthology.orchestra.run.smithi046:> sudo ip link delete ceph-brx 2023-07-06T02:40:21.163 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-06T02:40:21.163 DEBUG:teuthology.orchestra.run.smithi046:> ip netns list 2023-07-06T02:40:21.181 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-06T02:40:21.182 DEBUG:teuthology.orchestra.run.smithi046:> sudo ip link delete ceph-brx 2023-07-06T02:40:21.275 INFO:teuthology.orchestra.run.smithi046.stderr:Cannot find device "ceph-brx" 2023-07-06T02:40:21.276 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-07-06T02:40:21.277 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-06T02:40:21.277 DEBUG:teuthology.orchestra.run.smithi073:> ip netns list 2023-07-06T02:40:21.386 INFO:teuthology.orchestra.run.smithi073.stdout:ceph-ns--home-ubuntu-cephtest-mnt.3 (id: 1) 2023-07-06T02:40:21.386 INFO:teuthology.orchestra.run.smithi073.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2023-07-06T02:40:21.387 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-06T02:40:21.387 DEBUG:teuthology.orchestra.run.smithi073:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.3 2023-07-06T02:40:21.423 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-06T02:40:21.424 DEBUG:teuthology.orchestra.run.smithi073:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.1 2023-07-06T02:40:21.505 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-06T02:40:21.505 DEBUG:teuthology.orchestra.run.smithi073:> sudo ip link delete ceph-brx 2023-07-06T02:40:21.643 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-06T02:40:21.643 DEBUG:teuthology.orchestra.run.smithi073:> ip netns list 2023-07-06T02:40:21.659 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-06T02:40:21.660 DEBUG:teuthology.orchestra.run.smithi073:> sudo ip link delete ceph-brx 2023-07-06T02:40:21.870 INFO:teuthology.orchestra.run.smithi073.stderr:Cannot find device "ceph-brx" 2023-07-06T02:40:21.871 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-07-06T02:40:21.872 DEBUG:teuthology.run_tasks:Unwinding manager ceph 2023-07-06T02:40:21.883 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2023-07-06T02:40:21.883 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-07-06T02:40:22.029 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:22.026+0000 7f71ffabe700 1 Processor -- start 2023-07-06T02:40:22.030 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:22.026+0000 7f71ffabe700 1 -- start start 2023-07-06T02:40:22.031 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:22.027+0000 7f71ffabe700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f71f8071090 0x7f71f815de90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T02:40:22.031 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:22.027+0000 7f71ffabe700 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f71f80cd580 con 0x7f71f806a510 2023-07-06T02:40:22.031 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:22.027+0000 7f71ffabe700 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f71f80cc970 con 0x7f71f80ce2d0 2023-07-06T02:40:22.032 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:22.027+0000 7f71ffabe700 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f71f80cc760 con 0x7f71f8071090 2023-07-06T02:40:22.032 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:22.027+0000 7f71fd059700 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7f71f806a510 0x7f71f8070980 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:45310/0 (socket says 172.21.15.46:45310) 2023-07-06T02:40:22.032 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:22.027+0000 7f71fd059700 1 -- 172.21.15.46:0/1436153313 learned_addr learned my addr 172.21.15.46:0/1436153313 (peer_addr_for_me v1:172.21.15.46:0/0) 2023-07-06T02:40:22.032 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:22.027+0000 7f71fe05b700 1 --2- 172.21.15.46:0/1436153313 >> v2:172.21.15.46:3300/0 conn(0x7f71f8071090 0x7f71f815de90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T02:40:22.033 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:22.027+0000 7f71fe05b700 1 -- 172.21.15.46:0/1436153313 >> v1:172.21.15.73:6789/0 conn(0x7f71f80ce2d0 legacy=0x7f71f8069e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T02:40:22.033 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:22.027+0000 7f71fe05b700 1 -- 172.21.15.46:0/1436153313 >> v1:172.21.15.46:6789/0 conn(0x7f71f806a510 legacy=0x7f71f8070980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T02:40:22.033 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:22.027+0000 7f71fe05b700 1 -- 172.21.15.46:0/1436153313 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f71f80ccc50 con 0x7f71f8071090 2023-07-06T02:40:22.034 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:22.028+0000 7f71fe05b700 1 --2- 172.21.15.46:0/1436153313 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f71f8071090 0x7f71f815de90 secure :-1 s=READY pgs=3238 cs=0 l=1 rev1=1 crypto rx=0x7f71f0009d90 tx=0x7f71f000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=854c19acf9254748 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T02:40:22.034 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:22.028+0000 7f71fc858700 1 -- 172.21.15.46:0/1436153313 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71f000e070 con 0x7f71f8071090 2023-07-06T02:40:22.034 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:22.028+0000 7f71fc858700 1 -- 172.21.15.46:0/1436153313 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f71f000bbd0 con 0x7f71f8071090 2023-07-06T02:40:22.034 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:22.028+0000 7f71fc858700 1 -- 172.21.15.46:0/1436153313 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71f0012430 con 0x7f71f8071090 2023-07-06T02:40:22.037 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:22.028+0000 7f71ffabe700 1 -- 172.21.15.46:0/1436153313 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f71f8071090 msgr2=0x7f71f815de90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T02:40:22.037 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:22.028+0000 7f71ffabe700 1 --2- 172.21.15.46:0/1436153313 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f71f8071090 0x7f71f815de90 secure :-1 s=READY pgs=3238 cs=0 l=1 rev1=1 crypto rx=0x7f71f0009d90 tx=0x7f71f000b330 comp rx=0 tx=0).stop 2023-07-06T02:40:22.037 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:22.028+0000 7f71ffabe700 1 -- 172.21.15.46:0/1436153313 shutdown_connections 2023-07-06T02:40:22.037 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:22.028+0000 7f71ffabe700 1 --2- 172.21.15.46:0/1436153313 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f71f8071090 0x7f71f815de90 unknown :-1 s=CLOSED pgs=3238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T02:40:22.038 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:22.029+0000 7f71ffabe700 1 -- 172.21.15.46:0/1436153313 >> 172.21.15.46:0/1436153313 conn(0x7f71f80b0fc0 msgr2=0x7f71f80ce860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T02:40:22.038 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:22.029+0000 7f71ffabe700 1 -- 172.21.15.46:0/1436153313 shutdown_connections 2023-07-06T02:40:22.038 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:22.029+0000 7f71ffabe700 1 -- 172.21.15.46:0/1436153313 wait complete. 2023-07-06T02:40:22.038 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:22.030+0000 7f71ffabe700 1 Processor -- start 2023-07-06T02:40:22.039 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:22.030+0000 7f71ffabe700 1 -- start start 2023-07-06T02:40:22.039 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:22.031+0000 7f71ffabe700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f71f806a510 0x7f71f814e550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T02:40:22.039 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:22.031+0000 7f71ffabe700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f71f8071090 0x7f71f80ca220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T02:40:22.039 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:22.031+0000 7f71ffabe700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f71f80ce2d0 0x7f71f80b3f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T02:40:22.039 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:22.031+0000 7f71ffabe700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71f80c5e90 con 0x7f71f8071090 2023-07-06T02:40:22.040 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:22.031+0000 7f71ffabe700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71f80ca760 con 0x7f71f806a510 2023-07-06T02:40:22.040 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:22.031+0000 7f71ffabe700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f71f80ca990 con 0x7f71f80ce2d0 2023-07-06T02:40:22.040 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:22.031+0000 7f71fd059700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f71f8071090 0x7f71f80ca220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T02:40:22.040 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:22.031+0000 7f71fd059700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f71f8071090 0x7f71f80ca220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:46044/0 (socket says 172.21.15.46:46044) 2023-07-06T02:40:22.041 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:22.031+0000 7f71fd059700 1 -- 172.21.15.46:0/631604839 learned_addr learned my addr 172.21.15.46:0/631604839 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-07-06T02:40:22.041 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:22.031+0000 7f71fd85a700 1 --2- 172.21.15.46:0/631604839 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f71f806a510 0x7f71f814e550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T02:40:22.041 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:22.031+0000 7f71fe05b700 1 --2- 172.21.15.46:0/631604839 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f71f80ce2d0 0x7f71f80b3f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T02:40:22.041 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:22.031+0000 7f71fd059700 1 -- 172.21.15.46:0/631604839 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f71f80ce2d0 msgr2=0x7f71f80b3f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T02:40:22.041 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:22.031+0000 7f71fd059700 1 --2- 172.21.15.46:0/631604839 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f71f80ce2d0 0x7f71f80b3f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T02:40:22.042 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:22.031+0000 7f71fd059700 1 -- 172.21.15.46:0/631604839 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f71f806a510 msgr2=0x7f71f814e550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T02:40:22.042 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:22.031+0000 7f71fd059700 1 --2- 172.21.15.46:0/631604839 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f71f806a510 0x7f71f814e550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T02:40:22.042 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:22.031+0000 7f71fd059700 1 -- 172.21.15.46:0/631604839 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f71f0009a70 con 0x7f71f8071090 2023-07-06T02:40:22.042 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:22.031+0000 7f71fd059700 1 --2- 172.21.15.46:0/631604839 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f71f8071090 0x7f71f80ca220 secure :-1 s=READY pgs=3239 cs=0 l=1 rev1=1 crypto rx=0x7f71e800c550 tx=0x7f71e800c860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T02:40:22.042 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:22.032+0000 7f71ee7fc700 1 -- 172.21.15.46:0/631604839 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71e8005d70 con 0x7f71f8071090 2023-07-06T02:40:22.042 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:22.032+0000 7f71ee7fc700 1 -- 172.21.15.46:0/631604839 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f71e80070d0 con 0x7f71f8071090 2023-07-06T02:40:22.043 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:22.032+0000 7f71ffabe700 1 -- 172.21.15.46:0/631604839 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f71f80cac70 con 0x7f71f8071090 2023-07-06T02:40:22.043 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:22.032+0000 7f71ee7fc700 1 -- 172.21.15.46:0/631604839 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71e8007440 con 0x7f71f8071090 2023-07-06T02:40:22.043 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:22.032+0000 7f71ffabe700 1 -- 172.21.15.46:0/631604839 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f71f80b4480 con 0x7f71f8071090 2023-07-06T02:40:22.043 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:22.033+0000 7f71ffabe700 1 -- 172.21.15.46:0/631604839 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f71f80c5fd0 con 0x7f71f8071090 2023-07-06T02:40:22.043 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:22.033+0000 7f71ee7fc700 1 -- 172.21.15.46:0/631604839 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f71e80075a0 con 0x7f71f8071090 2023-07-06T02:40:22.044 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:22.034+0000 7f71ee7fc700 1 --2- 172.21.15.46:0/631604839 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7f71dc06ace0 0x7f71dc06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T02:40:22.044 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:22.034+0000 7f71ee7fc700 1 -- 172.21.15.46:0/631604839 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 5296+0+0 (secure 0 0 0) 0x7f71e8088410 con 0x7f71f8071090 2023-07-06T02:40:22.044 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:22.034+0000 7f71fd85a700 1 --2- 172.21.15.46:0/631604839 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7f71dc06ace0 0x7f71dc06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T02:40:22.045 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:22.034+0000 7f71fd85a700 1 --2- 172.21.15.46:0/631604839 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7f71dc06ace0 0x7f71dc06d190 secure :-1 s=READY pgs=733 cs=0 l=1 rev1=1 crypto rx=0x7f71f4007fd0 tx=0x7f71f4009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T02:40:22.045 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:22.038+0000 7f71ee7fc700 1 -- 172.21.15.46:0/631604839 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f71f80c5fd0 con 0x7f71f8071090 2023-07-06T02:40:22.246 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:22.243+0000 7f71ffabe700 1 -- 172.21.15.46:0/631604839 --> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f71f80cd210 con 0x7f71dc06ace0 2023-07-06T02:40:22.272 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:22.269+0000 7f71ee7fc700 1 -- 172.21.15.46:0/631604839 <== mgr.4099 v2:172.21.15.73:6832/3033361733 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+71633 (secure 0 0 0) 0x7f71f4001cc0 con 0x7f71dc06ace0 2023-07-06T02:40:22.273 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-06T02:40:22.274 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:22.271+0000 7f71ffabe700 1 -- 172.21.15.46:0/631604839 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7f71dc06ace0 msgr2=0x7f71dc06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T02:40:22.274 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:22.271+0000 7f71ffabe700 1 --2- 172.21.15.46:0/631604839 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7f71dc06ace0 0x7f71dc06d190 secure :-1 s=READY pgs=733 cs=0 l=1 rev1=1 crypto rx=0x7f71f4007fd0 tx=0x7f71f4009040 comp rx=0 tx=0).stop 2023-07-06T02:40:22.274 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:22.271+0000 7f71ffabe700 1 -- 172.21.15.46:0/631604839 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f71f8071090 msgr2=0x7f71f80ca220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T02:40:22.275 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:22.271+0000 7f71ffabe700 1 --2- 172.21.15.46:0/631604839 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f71f8071090 0x7f71f80ca220 secure :-1 s=READY pgs=3239 cs=0 l=1 rev1=1 crypto rx=0x7f71e800c550 tx=0x7f71e800c860 comp rx=0 tx=0).stop 2023-07-06T02:40:22.275 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:22.271+0000 7f71ffabe700 1 -- 172.21.15.46:0/631604839 shutdown_connections 2023-07-06T02:40:22.275 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:22.271+0000 7f71ffabe700 1 --2- 172.21.15.46:0/631604839 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7f71dc06ace0 0x7f71dc06d190 unknown :-1 s=CLOSED pgs=733 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T02:40:22.275 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:22.271+0000 7f71ffabe700 1 --2- 172.21.15.46:0/631604839 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f71f80ce2d0 0x7f71f80b3f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T02:40:22.275 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:22.271+0000 7f71ffabe700 1 --2- 172.21.15.46:0/631604839 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f71f806a510 0x7f71f814e550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T02:40:22.276 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:22.271+0000 7f71ffabe700 1 --2- 172.21.15.46:0/631604839 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f71f8071090 0x7f71f80ca220 unknown :-1 s=CLOSED pgs=3239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T02:40:22.276 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:22.271+0000 7f71ffabe700 1 -- 172.21.15.46:0/631604839 >> 172.21.15.46:0/631604839 conn(0x7f71f80b0fc0 msgr2=0x7f71f81580d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T02:40:22.276 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:22.271+0000 7f71ffabe700 1 -- 172.21.15.46:0/631604839 shutdown_connections 2023-07-06T02:40:22.276 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:22.271+0000 7f71ffabe700 1 -- 172.21.15.46:0/631604839 wait complete. 2023-07-06T02:40:22.277 INFO:teuthology.orchestra.run.smithi046.stderr:dumped all 2023-07-06T02:40:22.288 INFO:teuthology.orchestra.run.smithi046.stdout:{"pg_ready":true,"pg_map":{"version":13954,"stamp":"2023-07-06T02:40:22.069116+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":146,"num_read_kb":127,"num_write":209,"num_write_kb":3462,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":161,"ondisk_log_size":161,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":189,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":38477476,"kb_used_data":26364196,"kb_used_omap":135394,"kb_used_meta":11712605,"kb_avail":716497244,"statfs":{"total":773094113280,"available":733693177856,"internally_reserved":0,"allocated":26996936704,"data_stored":26983849628,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":138643486,"internal_metadata":11993708514},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":264,"apply_latency_ms":264,"commit_latency_ns":264000000,"apply_latency_ns":264000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-62798561459,"num_objects":-45638,"num_object_clones":0,"num_object_copies":-91276,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-45638,"num_whiteouts":0,"num_read":-1619613,"num_read_kb":-364489914,"num_write":-3226784,"num_write_kb":-626104872,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-3691,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.001881"},"pg_stats":[{"pgid":"1.5","version":"0'0","reported_seq":274,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-07-06T02:40:17.475260+0000","last_change":"2023-07-05T18:56:09.622184+0000","last_active":"2023-07-06T02:40:17.475260+0000","last_peered":"2023-07-06T02:40:17.475260+0000","last_clean":"2023-07-06T02:40:17.475260+0000","last_became_active":"2023-07-05T18:56:09.621796+0000","last_became_peered":"2023-07-05T18:56:09.621796+0000","last_unstale":"2023-07-06T02:40:17.475260+0000","last_undegraded":"2023-07-06T02:40:17.475260+0000","last_fullsized":"2023-07-06T02:40:17.475260+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T18:56:08.603137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T18:56:08.603137+0000","last_clean_scrub_stamp":"2023-07-05T18:56:08.603137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-06T19:36:39.040166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":278,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-07-06T02:40:17.476927+0000","last_change":"2023-07-05T18:56:09.621596+0000","last_active":"2023-07-06T02:40:17.476927+0000","last_peered":"2023-07-06T02:40:17.476927+0000","last_clean":"2023-07-06T02:40:17.476927+0000","last_became_active":"2023-07-05T18:56:09.621315+0000","last_became_peered":"2023-07-05T18:56:09.621315+0000","last_unstale":"2023-07-06T02:40:17.476927+0000","last_undegraded":"2023-07-06T02:40:17.476927+0000","last_fullsized":"2023-07-06T02:40:17.476927+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T18:56:08.603137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T18:56:08.603137+0000","last_clean_scrub_stamp":"2023-07-05T18:56:08.603137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-06T21:41:31.701702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":273,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-07-06T02:40:17.497921+0000","last_change":"2023-07-05T18:56:09.617992+0000","last_active":"2023-07-06T02:40:17.497921+0000","last_peered":"2023-07-06T02:40:17.497921+0000","last_clean":"2023-07-06T02:40:17.497921+0000","last_became_active":"2023-07-05T18:56:09.617720+0000","last_became_peered":"2023-07-05T18:56:09.617720+0000","last_unstale":"2023-07-06T02:40:17.497921+0000","last_undegraded":"2023-07-06T02:40:17.497921+0000","last_fullsized":"2023-07-06T02:40:17.497921+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T18:56:08.603137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T18:56:08.603137+0000","last_clean_scrub_stamp":"2023-07-05T18:56:08.603137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-06T20:37:16.107143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"37'161","reported_seq":484,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-07-06T02:40:18.420953+0000","last_change":"2023-07-05T18:56:09.621746+0000","last_active":"2023-07-06T02:40:18.420953+0000","last_peered":"2023-07-06T02:40:18.420953+0000","last_clean":"2023-07-06T02:40:18.420953+0000","last_became_active":"2023-07-05T18:56:09.621421+0000","last_became_peered":"2023-07-05T18:56:09.621421+0000","last_unstale":"2023-07-06T02:40:18.420953+0000","last_undegraded":"2023-07-06T02:40:18.420953+0000","last_fullsized":"2023-07-06T02:40:18.420953+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T18:56:08.603137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T18:56:08.603137+0000","last_clean_scrub_stamp":"2023-07-05T18:56:08.603137+0000","objects_scrubbed":0,"log_size":161,"log_dups_size":0,"ondisk_log_size":161,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-06T22:19:16.877769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":146,"num_read_kb":127,"num_write":209,"num_write_kb":3462,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":273,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-07-06T02:40:18.421439+0000","last_change":"2023-07-05T18:56:10.073940+0000","last_active":"2023-07-06T02:40:18.421439+0000","last_peered":"2023-07-06T02:40:18.421439+0000","last_clean":"2023-07-06T02:40:18.421439+0000","last_became_active":"2023-07-05T18:56:10.073617+0000","last_became_peered":"2023-07-05T18:56:10.073617+0000","last_unstale":"2023-07-06T02:40:18.421439+0000","last_undegraded":"2023-07-06T02:40:18.421439+0000","last_fullsized":"2023-07-06T02:40:18.421439+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T18:56:08.603137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T18:56:08.603137+0000","last_clean_scrub_stamp":"2023-07-05T18:56:08.603137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-06T22:12:49.944261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":281,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-07-06T02:40:18.420814+0000","last_change":"2023-07-05T18:56:10.073658+0000","last_active":"2023-07-06T02:40:18.420814+0000","last_peered":"2023-07-06T02:40:18.420814+0000","last_clean":"2023-07-06T02:40:18.420814+0000","last_became_active":"2023-07-05T18:56:10.073336+0000","last_became_peered":"2023-07-05T18:56:10.073336+0000","last_unstale":"2023-07-06T02:40:18.420814+0000","last_undegraded":"2023-07-06T02:40:18.420814+0000","last_fullsized":"2023-07-06T02:40:18.420814+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T18:56:08.603137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T18:56:08.603137+0000","last_clean_scrub_stamp":"2023-07-05T18:56:08.603137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-06T23:56:59.615696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":274,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-07-06T02:40:17.980312+0000","last_change":"2023-07-05T18:56:10.073693+0000","last_active":"2023-07-06T02:40:17.980312+0000","last_peered":"2023-07-06T02:40:17.980312+0000","last_clean":"2023-07-06T02:40:17.980312+0000","last_became_active":"2023-07-05T18:56:10.073356+0000","last_became_peered":"2023-07-05T18:56:10.073356+0000","last_unstale":"2023-07-06T02:40:17.980312+0000","last_undegraded":"2023-07-06T02:40:17.980312+0000","last_fullsized":"2023-07-06T02:40:17.980312+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T18:56:08.603137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T18:56:08.603137+0000","last_clean_scrub_stamp":"2023-07-05T18:56:08.603137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-06T21:29:04.979258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":267,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-07-06T02:40:17.919071+0000","last_change":"2023-07-05T18:56:10.073639+0000","last_active":"2023-07-06T02:40:17.919071+0000","last_peered":"2023-07-06T02:40:17.919071+0000","last_clean":"2023-07-06T02:40:17.919071+0000","last_became_active":"2023-07-05T18:56:10.073339+0000","last_became_peered":"2023-07-05T18:56:10.073339+0000","last_unstale":"2023-07-06T02:40:17.919071+0000","last_undegraded":"2023-07-06T02:40:17.919071+0000","last_fullsized":"2023-07-06T02:40:17.919071+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T18:56:08.603137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T18:56:08.603137+0000","last_clean_scrub_stamp":"2023-07-05T18:56:08.603137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-06T23:08:47.739749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":267,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-07-06T02:40:17.919390+0000","last_change":"2023-07-05T18:56:09.619299+0000","last_active":"2023-07-06T02:40:17.919390+0000","last_peered":"2023-07-06T02:40:17.919390+0000","last_clean":"2023-07-06T02:40:17.919390+0000","last_became_active":"2023-07-05T18:56:09.618958+0000","last_became_peered":"2023-07-05T18:56:09.618958+0000","last_unstale":"2023-07-06T02:40:17.919390+0000","last_undegraded":"2023-07-06T02:40:17.919390+0000","last_fullsized":"2023-07-06T02:40:17.919390+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T18:56:08.603137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T18:56:08.603137+0000","last_clean_scrub_stamp":"2023-07-05T18:56:08.603137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-06T23:58:42.021659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":8},{"poolid":2,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":146,"num_read_kb":127,"num_write":209,"num_write_kb":3462,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":161,"ondisk_log_size":161,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834580411,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":5673296,"kb_used_data":3774448,"kb_used_omap":14013,"kb_used_meta":1876034,"kb_avail":88698544,"statfs":{"total":96636764160,"available":90827309056,"internally_reserved":0,"allocated":3865034752,"data_stored":3863186783,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":14349832,"internal_metadata":1921059320},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":31,"apply_latency_ms":31,"commit_latency_ns":31000000,"apply_latency_ns":31000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 6 02:40:11 2023","interfaces":[{"interface":"back","average":{"1min":6.3979999999999997,"5min":1.9890000000000001,"15min":1.554},"min":{"1min":0.24199999999999999,"5min":0.24199999999999999,"15min":0.24099999999999999},"max":{"1min":71.978999999999999,"5min":71.978999999999999,"15min":71.978999999999999},"last":0.42799999999999999},{"interface":"front","average":{"1min":4.657,"5min":2.1640000000000001,"15min":1.8440000000000001},"min":{"1min":0.25800000000000001,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":23.382000000000001,"5min":23.382000000000001,"15min":23.382000000000001},"last":0.45400000000000001}]},{"osd":1,"last update":"Thu Jul 6 02:40:11 2023","interfaces":[{"interface":"back","average":{"1min":7.2990000000000004,"5min":2.3500000000000001,"15min":1.829},"min":{"1min":0.27200000000000002,"5min":0.27200000000000002,"15min":0.25},"max":{"1min":71.951999999999998,"5min":71.951999999999998,"15min":71.951999999999998},"last":0.64000000000000001},{"interface":"front","average":{"1min":4.25,"5min":2.3250000000000002,"15min":2.0640000000000001},"min":{"1min":0.26100000000000001,"5min":0.26100000000000001,"15min":0.25900000000000001},"max":{"1min":23.489999999999998,"5min":23.489999999999998,"15min":23.489999999999998},"last":0.59499999999999997}]},{"osd":2,"last update":"Thu Jul 6 02:40:11 2023","interfaces":[{"interface":"back","average":{"1min":4.9379999999999997,"5min":2.2160000000000002,"15min":1.7969999999999999},"min":{"1min":0.33500000000000002,"5min":0.29899999999999999,"15min":0.29299999999999998},"max":{"1min":35.311999999999998,"5min":35.311999999999998,"15min":35.311999999999998},"last":0.62},{"interface":"front","average":{"1min":6.2610000000000001,"5min":2.5649999999999999,"15min":2.0960000000000001},"min":{"1min":0.308,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":66.536000000000001,"5min":66.536000000000001,"15min":66.536000000000001},"last":0.46800000000000003}]},{"osd":3,"last update":"Thu Jul 6 02:40:11 2023","interfaces":[{"interface":"back","average":{"1min":3.327,"5min":1.9690000000000001,"15min":1.8129999999999999},"min":{"1min":0.33200000000000002,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":25.637,"5min":25.637,"15min":25.637},"last":0.54400000000000004},{"interface":"front","average":{"1min":5.9050000000000002,"5min":2.617,"15min":2.2370000000000001},"min":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":71.905000000000001,"5min":71.905000000000001,"15min":71.905000000000001},"last":0.66700000000000004}]},{"osd":4,"last update":"Thu Jul 6 02:40:11 2023","interfaces":[{"interface":"back","average":{"1min":7.0339999999999998,"5min":2.3719999999999999,"15min":1.871},"min":{"1min":0.27700000000000002,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":52.734999999999999,"5min":52.734999999999999,"15min":52.734999999999999},"last":0.51100000000000001},{"interface":"front","average":{"1min":2.7069999999999999,"5min":1.359,"15min":1.2829999999999999},"min":{"1min":0.33500000000000002,"5min":0.32000000000000001,"15min":0.311},"max":{"1min":35.372,"5min":35.372,"15min":35.372},"last":0.58399999999999996}]},{"osd":5,"last update":"Thu Jul 6 02:40:11 2023","interfaces":[{"interface":"back","average":{"1min":5.3689999999999998,"5min":2.1030000000000002,"15min":1.788},"min":{"1min":0.29299999999999998,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":73.492999999999995,"5min":73.492999999999995,"15min":73.492999999999995},"last":0.60499999999999998},{"interface":"front","average":{"1min":2.839,"5min":1.847,"15min":1.754},"min":{"1min":0.34799999999999998,"5min":0.33800000000000002,"15min":0.30499999999999999},"max":{"1min":14.983000000000001,"5min":14.983000000000001,"15min":25.689},"last":0.56200000000000006}]},{"osd":6,"last update":"Thu Jul 6 02:40:11 2023","interfaces":[{"interface":"back","average":{"1min":3.9630000000000001,"5min":2.0470000000000002,"15min":1.986},"min":{"1min":0.34200000000000003,"5min":0.309,"15min":0.309},"max":{"1min":21.321000000000002,"5min":21.321000000000002,"15min":21.321000000000002},"last":0.628},{"interface":"front","average":{"1min":1.5349999999999999,"5min":1.4219999999999999,"15min":1.3460000000000001},"min":{"1min":0.376,"5min":0.376,"15min":0.373},"max":{"1min":11.273999999999999,"5min":11.273999999999999,"15min":12.099},"last":0.64900000000000002}]}]},{"osd":6,"up_from":13,"seq":55834580418,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":5593024,"kb_used_data":4906924,"kb_used_omap":14943,"kb_used_meta":658080,"kb_avail":88778816,"statfs":{"total":96636764160,"available":90909507584,"internally_reserved":0,"allocated":5024690176,"data_stored":5022424629,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":15302320,"internal_metadata":673874256},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":25,"apply_latency_ms":25,"commit_latency_ns":25000000,"apply_latency_ns":25000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 6 02:39:25 2023","interfaces":[{"interface":"back","average":{"1min":1.333,"5min":1.1419999999999999,"15min":0.999},"min":{"1min":0.29399999999999998,"5min":0.24199999999999999,"15min":0.22900000000000001},"max":{"1min":12.007,"5min":12.007,"15min":12.007},"last":0.621},{"interface":"front","average":{"1min":1.127,"5min":1.4590000000000001,"15min":1.512},"min":{"1min":0.27000000000000002,"5min":0.27000000000000002,"15min":0.26400000000000001},"max":{"1min":4.7229999999999999,"5min":8.2699999999999996,"15min":14.146000000000001},"last":1.224}]},{"osd":1,"last update":"Thu Jul 6 02:39:25 2023","interfaces":[{"interface":"back","average":{"1min":2.5179999999999998,"5min":1.738,"15min":1.796},"min":{"1min":0.25800000000000001,"5min":0.25800000000000001,"15min":0.25600000000000001},"max":{"1min":11.182,"5min":11.182,"15min":15.563000000000001},"last":0.41299999999999998},{"interface":"front","average":{"1min":4.2599999999999998,"5min":2.464,"15min":2.0059999999999998},"min":{"1min":0.307,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":62.668999999999997,"5min":62.668999999999997,"15min":62.668999999999997},"last":1.1759999999999999}]},{"osd":2,"last update":"Thu Jul 6 02:39:25 2023","interfaces":[{"interface":"back","average":{"1min":1.288,"5min":1.341,"15min":1.4259999999999999},"min":{"1min":0.33200000000000002,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":6.7249999999999996,"5min":6.7249999999999996,"15min":6.7249999999999996},"last":1.1240000000000001},{"interface":"front","average":{"1min":3.8999999999999999,"5min":2.298,"15min":2.3260000000000001},"min":{"1min":0.42999999999999999,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":29.617999999999999,"5min":29.617999999999999,"15min":29.617999999999999},"last":0.92600000000000005}]},{"osd":3,"last update":"Thu Jul 6 02:39:25 2023","interfaces":[{"interface":"back","average":{"1min":1.5189999999999999,"5min":1.9379999999999999,"15min":2.0710000000000002},"min":{"1min":0.33700000000000002,"5min":0.312,"15min":0.312},"max":{"1min":8.2560000000000002,"5min":11.526999999999999,"15min":14.084},"last":1.3660000000000001},{"interface":"front","average":{"1min":1.448,"5min":1.5,"15min":1.7310000000000001},"min":{"1min":0.39500000000000002,"5min":0.35199999999999998,"15min":0.34999999999999998},"max":{"1min":6.3529999999999998,"5min":6.3529999999999998,"15min":7.3040000000000003},"last":1.006}]},{"osd":4,"last update":"Thu Jul 6 02:39:25 2023","interfaces":[{"interface":"back","average":{"1min":2.016,"5min":1.468,"15min":1.645},"min":{"1min":0.29399999999999998,"5min":0.28599999999999998,"15min":0.27100000000000002},"max":{"1min":11.215999999999999,"5min":11.215999999999999,"15min":15.625999999999999},"last":0.78600000000000003},{"interface":"front","average":{"1min":1.2490000000000001,"5min":1.397,"15min":1.5660000000000001},"min":{"1min":0.29899999999999999,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":5.0679999999999996,"5min":8.3689999999999998,"15min":14.519},"last":1.2529999999999999}]},{"osd":5,"last update":"Thu Jul 6 02:39:25 2023","interfaces":[{"interface":"back","average":{"1min":1.0649999999999999,"5min":1.02,"15min":1.101},"min":{"1min":0.376,"5min":0.33900000000000002,"15min":0.315},"max":{"1min":5.508,"5min":6.3399999999999999,"15min":9.0790000000000006},"last":0.97399999999999998},{"interface":"front","average":{"1min":2.3340000000000001,"5min":1.5900000000000001,"15min":1.8069999999999999},"min":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":11.489000000000001,"5min":11.489000000000001,"15min":15.686},"last":0.98699999999999999}]},{"osd":7,"last update":"Thu Jul 6 02:39:25 2023","interfaces":[{"interface":"back","average":{"1min":3.1850000000000001,"5min":1.73,"15min":1.766},"min":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":38.942999999999998,"5min":38.942999999999998,"15min":38.942999999999998},"last":1.145},{"interface":"front","average":{"1min":2.9460000000000002,"5min":1.677,"15min":1.4410000000000001},"min":{"1min":0.41899999999999998,"5min":0.39000000000000001,"15min":0.35199999999999998},"max":{"1min":38.557000000000002,"5min":38.557000000000002,"15min":38.557000000000002},"last":1.0449999999999999}]}]},{"osd":1,"up_from":13,"seq":55834580395,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":5202972,"kb_used_data":3301816,"kb_used_omap":15006,"kb_used_meta":1848737,"kb_avail":89168868,"statfs":{"total":96636764160,"available":91308920832,"internally_reserved":0,"allocated":3381059584,"data_stored":3379442768,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":15366880,"internal_metadata":1893106976},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":35,"apply_latency_ms":35,"commit_latency_ns":35000000,"apply_latency_ns":35000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 6 02:40:11 2023","interfaces":[{"interface":"back","average":{"1min":1.8580000000000001,"5min":1.1719999999999999,"15min":1.0569999999999999},"min":{"1min":0.253,"5min":0.23400000000000001,"15min":0.23100000000000001},"max":{"1min":6.819,"5min":8.2579999999999991,"15min":11.006},"last":0.42499999999999999},{"interface":"front","average":{"1min":2.9079999999999999,"5min":1.796,"15min":1.3859999999999999},"min":{"1min":0.27700000000000002,"5min":0.27700000000000002,"15min":0.27000000000000002},"max":{"1min":15.366,"5min":15.366,"15min":15.366},"last":0.50700000000000001}]},{"osd":2,"last update":"Thu Jul 6 02:40:11 2023","interfaces":[{"interface":"back","average":{"1min":2.569,"5min":1.665,"15min":1.708},"min":{"1min":0.28899999999999998,"5min":0.26700000000000002,"15min":0.255},"max":{"1min":12.045999999999999,"5min":12.045999999999999,"15min":12.045999999999999},"last":0.48499999999999999},{"interface":"front","average":{"1min":2.6320000000000001,"5min":1.55,"15min":1.3480000000000001},"min":{"1min":0.28899999999999998,"5min":0.27700000000000002,"15min":0.25800000000000001},"max":{"1min":14.038,"5min":14.038,"15min":14.038},"last":0.52500000000000002}]},{"osd":3,"last update":"Thu Jul 6 02:40:11 2023","interfaces":[{"interface":"back","average":{"1min":2.4540000000000002,"5min":1.5960000000000001,"15min":1.387},"min":{"1min":0.35199999999999998,"5min":0.30499999999999999,"15min":0.253},"max":{"1min":15.712,"5min":15.712,"15min":15.712},"last":0.628},{"interface":"front","average":{"1min":2.931,"5min":1.8120000000000001,"15min":1.4970000000000001},"min":{"1min":0.432,"5min":0.29499999999999998,"15min":0.27300000000000002},"max":{"1min":15.414,"5min":15.414,"15min":15.414},"last":0.46899999999999997}]},{"osd":4,"last update":"Thu Jul 6 02:40:11 2023","interfaces":[{"interface":"back","average":{"1min":3.0249999999999999,"5min":1.988,"15min":1.6459999999999999},"min":{"1min":0.49199999999999999,"5min":0.38300000000000001,"15min":0.35199999999999998},"max":{"1min":15.442,"5min":15.442,"15min":15.442},"last":0.66000000000000003},{"interface":"front","average":{"1min":2.948,"5min":1.9690000000000001,"15min":1.9930000000000001},"min":{"1min":0.40200000000000002,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":15.279999999999999,"5min":15.279999999999999,"15min":15.279999999999999},"last":0.73099999999999998}]},{"osd":5,"last update":"Thu Jul 6 02:40:11 2023","interfaces":[{"interface":"back","average":{"1min":3.7349999999999999,"5min":2.484,"15min":2.3490000000000002},"min":{"1min":0.39300000000000002,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":22.263000000000002,"5min":22.263000000000002,"15min":22.263000000000002},"last":0.64500000000000002},{"interface":"front","average":{"1min":4.1920000000000002,"5min":2.1070000000000002,"15min":1.7270000000000001},"min":{"1min":0.41199999999999998,"5min":0.38200000000000001,"15min":0.36899999999999999},"max":{"1min":26.181000000000001,"5min":26.181000000000001,"15min":26.181000000000001},"last":0.67100000000000004}]},{"osd":6,"last update":"Thu Jul 6 02:40:11 2023","interfaces":[{"interface":"back","average":{"1min":2.206,"5min":1.8740000000000001,"15min":1.8300000000000001},"min":{"1min":0.52800000000000002,"5min":0.42199999999999999,"15min":0.39300000000000002},"max":{"1min":9.1600000000000001,"5min":9.5429999999999993,"15min":10.359999999999999},"last":0.746},{"interface":"front","average":{"1min":2.6960000000000002,"5min":2.0859999999999999,"15min":2.2839999999999998},"min":{"1min":0.48799999999999999,"5min":0.47399999999999998,"15min":0.439},"max":{"1min":10.478999999999999,"5min":10.478999999999999,"15min":11.101000000000001},"last":0.69799999999999995}]},{"osd":7,"last update":"Thu Jul 6 02:40:11 2023","interfaces":[{"interface":"back","average":{"1min":3.3220000000000001,"5min":2.1339999999999999,"15min":1.887},"min":{"1min":0.50600000000000001,"5min":0.44,"15min":0.44},"max":{"1min":18.707999999999998,"5min":18.707999999999998,"15min":18.707999999999998},"last":0.71999999999999997},{"interface":"front","average":{"1min":2.6869999999999998,"5min":2.282,"15min":2.0760000000000001},"min":{"1min":0.59299999999999997,"5min":0.47099999999999997,"15min":0.41799999999999998},"max":{"1min":11.893000000000001,"5min":11.893000000000001,"15min":11.893000000000001},"last":0.70799999999999996}]}]},{"osd":0,"up_from":13,"seq":55834580387,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":4524576,"kb_used_data":3072824,"kb_used_omap":12735,"kb_used_meta":1388224,"kb_avail":89847264,"statfs":{"total":96636764160,"available":92003598336,"internally_reserved":0,"allocated":3146571776,"data_stored":3144950115,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":13040941,"internal_metadata":1421542099},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":41,"apply_latency_ms":41,"commit_latency_ns":41000000,"apply_latency_ns":41000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jul 6 02:39:17 2023","interfaces":[{"interface":"back","average":{"1min":1.0740000000000001,"5min":1.244,"15min":1.2170000000000001},"min":{"1min":0.25900000000000001,"5min":0.246,"15min":0.23899999999999999},"max":{"1min":5.8579999999999997,"5min":7.1760000000000002,"15min":16.422000000000001},"last":0.437},{"interface":"front","average":{"1min":1.375,"5min":1.3740000000000001,"15min":1.448},"min":{"1min":0.27900000000000003,"5min":0.248,"15min":0.248},"max":{"1min":6.1260000000000003,"5min":7.0309999999999997,"15min":7.6500000000000004},"last":0.32600000000000001}]},{"osd":2,"last update":"Thu Jul 6 02:39:17 2023","interfaces":[{"interface":"back","average":{"1min":0.79800000000000004,"5min":1.3480000000000001,"15min":1.298},"min":{"1min":0.28499999999999998,"5min":0.26200000000000001,"15min":0.252},"max":{"1min":5.516,"5min":10.000999999999999,"15min":10.106},"last":0.378},{"interface":"front","average":{"1min":1.351,"5min":1.45,"15min":1.615},"min":{"1min":0.28799999999999998,"5min":0.245,"15min":0.245},"max":{"1min":6.21,"5min":13.625,"15min":13.625},"last":0.41399999999999998}]},{"osd":3,"last update":"Thu Jul 6 02:39:17 2023","interfaces":[{"interface":"back","average":{"1min":1.5389999999999999,"5min":1.9370000000000001,"15min":2.048},"min":{"1min":0.30499999999999999,"5min":0.29699999999999999,"15min":0.27800000000000002},"max":{"1min":7.6100000000000003,"5min":10.927,"15min":10.927},"last":0.48899999999999999},{"interface":"front","average":{"1min":0.96799999999999997,"5min":1.427,"15min":1.5309999999999999},"min":{"1min":0.40799999999999997,"5min":0.35799999999999998,"15min":0.315},"max":{"1min":5.3040000000000003,"5min":7.2359999999999998,"15min":7.9669999999999996},"last":0.55400000000000005}]},{"osd":4,"last update":"Thu Jul 6 02:39:17 2023","interfaces":[{"interface":"back","average":{"1min":1.3180000000000001,"5min":1.3660000000000001,"15min":1.5049999999999999},"min":{"1min":0.37,"5min":0.34899999999999998,"15min":0.32800000000000001},"max":{"1min":6.0199999999999996,"5min":10.901,"15min":10.977},"last":0.504},{"interface":"front","average":{"1min":1.72,"5min":1.764,"15min":1.9079999999999999},"min":{"1min":0.38800000000000001,"5min":0.34499999999999997,"15min":0.32400000000000001},"max":{"1min":8.6699999999999999,"5min":8.6699999999999999,"15min":11.01},"last":0.52700000000000002}]},{"osd":5,"last update":"Thu Jul 6 02:39:17 2023","interfaces":[{"interface":"back","average":{"1min":1.1910000000000001,"5min":1.4359999999999999,"15min":1.4370000000000001},"min":{"1min":0.498,"5min":0.379,"15min":0.35099999999999998},"max":{"1min":5.266,"5min":7.2779999999999996,"15min":7.8730000000000002},"last":0.51700000000000002},{"interface":"front","average":{"1min":1.9950000000000001,"5min":1.7669999999999999,"15min":1.7410000000000001},"min":{"1min":0.45100000000000001,"5min":0.372,"15min":0.36599999999999999},"max":{"1min":7.9630000000000001,"5min":10.773999999999999,"15min":10.773999999999999},"last":3.343}]},{"osd":6,"last update":"Thu Jul 6 02:39:17 2023","interfaces":[{"interface":"back","average":{"1min":1.7310000000000001,"5min":2.0049999999999999,"15min":2.1230000000000002},"min":{"1min":0.42499999999999999,"5min":0.379,"15min":0.379},"max":{"1min":6.2839999999999998,"5min":8.0679999999999996,"15min":10.191000000000001},"last":2.8889999999999998},{"interface":"front","average":{"1min":1.1850000000000001,"5min":1.3899999999999999,"15min":1.4279999999999999},"min":{"1min":0.52800000000000002,"5min":0.49299999999999999,"15min":0.38500000000000001},"max":{"1min":5.3419999999999996,"5min":7.3150000000000004,"15min":8.5690000000000008},"last":2.9660000000000002}]},{"osd":7,"last update":"Thu Jul 6 02:39:17 2023","interfaces":[{"interface":"back","average":{"1min":2.0190000000000001,"5min":2.1059999999999999,"15min":2.0750000000000002},"min":{"1min":0.51900000000000002,"5min":0.42299999999999999,"15min":0.41399999999999998},"max":{"1min":6.1740000000000004,"5min":14.018000000000001,"15min":14.018000000000001},"last":2.7690000000000001},{"interface":"front","average":{"1min":2.2490000000000001,"5min":2.4300000000000002,"15min":2.3109999999999999},"min":{"1min":0.47499999999999998,"5min":0.45900000000000002,"15min":0.44800000000000001},"max":{"1min":8.3019999999999996,"5min":8.3019999999999996,"15min":10.103999999999999},"last":3.1480000000000001}]}]},{"osd":2,"up_from":13,"seq":55834580382,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":4793832,"kb_used_data":3452648,"kb_used_omap":9607,"kb_used_meta":1300536,"kb_avail":89578008,"statfs":{"total":96636764160,"available":91727880192,"internally_reserved":0,"allocated":3535511552,"data_stored":3533841940,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":9837933,"internal_metadata":1331749523},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":51,"apply_latency_ms":51,"commit_latency_ns":51000000,"apply_latency_ns":51000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 6 02:40:19 2023","interfaces":[{"interface":"back","average":{"1min":5.1559999999999997,"5min":1.796,"15min":1.349},"min":{"1min":0.27200000000000002,"5min":0.22900000000000001,"15min":0.22900000000000001},"max":{"1min":36.674999999999997,"5min":36.674999999999997,"15min":36.674999999999997},"last":7.1970000000000001},{"interface":"front","average":{"1min":16.443000000000001,"5min":4.181,"15min":2.2999999999999998},"min":{"1min":0.27400000000000002,"5min":0.249,"15min":0.249},"max":{"1min":122.961,"5min":122.961,"15min":122.961},"last":7.3529999999999998}]},{"osd":1,"last update":"Thu Jul 6 02:40:19 2023","interfaces":[{"interface":"back","average":{"1min":5.3239999999999998,"5min":1.9450000000000001,"15min":1.504},"min":{"1min":0.30499999999999999,"5min":0.25,"15min":0.25},"max":{"1min":36.643999999999998,"5min":36.643999999999998,"15min":36.643999999999998},"last":8.3230000000000004},{"interface":"front","average":{"1min":5.3170000000000002,"5min":2.347,"15min":1.8460000000000001},"min":{"1min":0.312,"5min":0.28599999999999998,"15min":0.27900000000000003},"max":{"1min":25.643999999999998,"5min":25.643999999999998,"15min":25.643999999999998},"last":8.2140000000000004}]},{"osd":3,"last update":"Thu Jul 6 02:40:19 2023","interfaces":[{"interface":"back","average":{"1min":12.382999999999999,"5min":3.6989999999999998,"15min":2.4569999999999999},"min":{"1min":0.47199999999999998,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":101.968,"5min":101.968,"15min":101.968},"last":9.9879999999999995},{"interface":"front","average":{"1min":5.077,"5min":2.0960000000000001,"15min":1.6599999999999999},"min":{"1min":0.46899999999999997,"5min":0.31,"15min":0.31},"max":{"1min":36.701000000000001,"5min":36.701000000000001,"15min":36.701000000000001},"last":22.135999999999999}]},{"osd":4,"last update":"Thu Jul 6 02:40:19 2023","interfaces":[{"interface":"back","average":{"1min":6.5049999999999999,"5min":2.488,"15min":1.8740000000000001},"min":{"1min":0.38400000000000001,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":36.560000000000002,"5min":36.560000000000002,"15min":36.560000000000002},"last":7.5720000000000001},{"interface":"front","average":{"1min":8.7100000000000009,"5min":2.8820000000000001,"15min":2.105},"min":{"1min":0.59799999999999998,"5min":0.36599999999999999,"15min":0.33600000000000002},"max":{"1min":40.014000000000003,"5min":40.014000000000003,"15min":40.014000000000003},"last":8.1669999999999998}]},{"osd":5,"last update":"Thu Jul 6 02:40:19 2023","interfaces":[{"interface":"back","average":{"1min":10.765000000000001,"5min":3.7450000000000001,"15min":2.5470000000000002},"min":{"1min":0.57499999999999996,"5min":0.377,"15min":0.36099999999999999},"max":{"1min":81.969999999999999,"5min":81.969999999999999,"15min":81.969999999999999},"last":9.8179999999999996},{"interface":"front","average":{"1min":8.984,"5min":3.198,"15min":2.1360000000000001},"min":{"1min":0.53700000000000003,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":65.238,"5min":65.238,"15min":65.238},"last":7.5300000000000002}]},{"osd":6,"last update":"Thu Jul 6 02:40:19 2023","interfaces":[{"interface":"back","average":{"1min":7.5640000000000001,"5min":2.8290000000000002,"15min":2.1829999999999998},"min":{"1min":0.63600000000000001,"5min":0.40799999999999997,"15min":0.38700000000000001},"max":{"1min":25.689,"5min":25.689,"15min":25.689},"last":8.2780000000000005},{"interface":"front","average":{"1min":12.055,"5min":3.931,"15min":2.641},"min":{"1min":0.51700000000000002,"5min":0.433,"15min":0.40100000000000002},"max":{"1min":61.131999999999998,"5min":61.131999999999998,"15min":61.131999999999998},"last":9.7870000000000008}]},{"osd":7,"last update":"Thu Jul 6 02:40:19 2023","interfaces":[{"interface":"back","average":{"1min":8.6229999999999993,"5min":2.9830000000000001,"15min":2.27},"min":{"1min":0.68000000000000005,"5min":0.46200000000000002,"15min":0.45500000000000002},"max":{"1min":25.783000000000001,"5min":25.783000000000001,"15min":25.783000000000001},"last":8.2490000000000006},{"interface":"front","average":{"1min":9.2609999999999992,"5min":3.4860000000000002,"15min":2.6720000000000002},"min":{"1min":0.54800000000000004,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":72.167000000000002,"5min":72.167000000000002,"15min":72.167000000000002},"last":9.7409999999999997}]}]},{"osd":3,"up_from":13,"seq":55834580375,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":4176588,"kb_used_data":2776088,"kb_used_omap":21228,"kb_used_meta":1353939,"kb_avail":90195252,"statfs":{"total":96636764160,"available":92359938048,"internally_reserved":0,"allocated":2842714112,"data_stored":2841285898,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":21737712,"internal_metadata":1386434320},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":34,"apply_latency_ms":34,"commit_latency_ns":34000000,"apply_latency_ns":34000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 6 02:39:28 2023","interfaces":[{"interface":"back","average":{"1min":1.016,"5min":1.1739999999999999,"15min":1.0609999999999999},"min":{"1min":0.254,"5min":0.23799999999999999,"15min":0.22500000000000001},"max":{"1min":4.4199999999999999,"5min":7.0190000000000001,"15min":12.298999999999999},"last":0.58799999999999997},{"interface":"front","average":{"1min":2.1190000000000002,"5min":1.528,"15min":1.377},"min":{"1min":0.28299999999999997,"5min":0.27000000000000002,"15min":0.252},"max":{"1min":18.82,"5min":18.82,"15min":18.82},"last":0.54100000000000004}]},{"osd":1,"last update":"Thu Jul 6 02:39:28 2023","interfaces":[{"interface":"back","average":{"1min":7.5679999999999996,"5min":2.976,"15min":1.8959999999999999},"min":{"1min":0.307,"5min":0.27100000000000002,"15min":0.24299999999999999},"max":{"1min":103.182,"5min":103.182,"15min":103.182},"last":0.56000000000000005},{"interface":"front","average":{"1min":2.601,"5min":1.764,"15min":1.5369999999999999},"min":{"1min":0.27300000000000002,"5min":0.26800000000000002,"15min":0.25},"max":{"1min":18.895,"5min":18.895,"15min":18.895},"last":0.622}]},{"osd":2,"last update":"Thu Jul 6 02:39:44 2023","interfaces":[{"interface":"back","average":{"1min":4.5579999999999998,"5min":2.3660000000000001,"15min":1.8500000000000001},"min":{"1min":0.29699999999999999,"5min":0.29099999999999998,"15min":0.27700000000000002},"max":{"1min":33.005000000000003,"5min":33.005000000000003,"15min":33.005000000000003},"last":0.67100000000000004},{"interface":"front","average":{"1min":2.988,"5min":1.9219999999999999,"15min":1.8220000000000001},"min":{"1min":0.38300000000000001,"5min":0.29199999999999998,"15min":0.28799999999999998},"max":{"1min":18.997,"5min":18.997,"15min":18.997},"last":0.66400000000000003}]},{"osd":4,"last update":"Thu Jul 6 02:39:44 2023","interfaces":[{"interface":"back","average":{"1min":2.0710000000000002,"5min":1.5249999999999999,"15min":1.5229999999999999},"min":{"1min":0.33500000000000002,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":18.966000000000001,"5min":18.966000000000001,"15min":18.966000000000001},"last":0.86699999999999999},{"interface":"front","average":{"1min":2.8620000000000001,"5min":1.6899999999999999,"15min":1.462},"min":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":32.886000000000003,"5min":32.886000000000003,"15min":32.886000000000003},"last":0.81699999999999995}]},{"osd":5,"last update":"Thu Jul 6 02:39:28 2023","interfaces":[{"interface":"back","average":{"1min":2.9260000000000002,"5min":1.6990000000000001,"15min":1.667},"min":{"1min":0.42599999999999999,"5min":0.375,"15min":0.32400000000000001},"max":{"1min":18.539000000000001,"5min":18.539000000000001,"15min":21.579000000000001},"last":0.89100000000000001},{"interface":"front","average":{"1min":3.4460000000000002,"5min":2.2410000000000001,"15min":2.0720000000000001},"min":{"1min":0.49099999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":18.596,"5min":18.596,"15min":21.553999999999998},"last":0.96699999999999997}]},{"osd":6,"last update":"Thu Jul 6 02:39:44 2023","interfaces":[{"interface":"back","average":{"1min":5.5049999999999999,"5min":2.786,"15min":2.2749999999999999},"min":{"1min":0.47299999999999998,"5min":0.41199999999999998,"15min":0.377},"max":{"1min":43.991999999999997,"5min":43.991999999999997,"15min":43.991999999999997},"last":0.84099999999999997},{"interface":"front","average":{"1min":3.0289999999999999,"5min":2.1000000000000001,"15min":1.978},"min":{"1min":0.439,"5min":0.40799999999999997,"15min":0.39700000000000002},"max":{"1min":18.93,"5min":18.93,"15min":19.273},"last":0.91500000000000004}]},{"osd":7,"last update":"Thu Jul 6 02:39:44 2023","interfaces":[{"interface":"back","average":{"1min":4.3040000000000003,"5min":2.5259999999999998,"15min":2.0009999999999999},"min":{"1min":0.50600000000000001,"5min":0.47699999999999998,"15min":0.42299999999999999},"max":{"1min":32.942999999999998,"5min":32.942999999999998,"15min":32.942999999999998},"last":0.93799999999999994},{"interface":"front","average":{"1min":4.5119999999999996,"5min":2.3119999999999998,"15min":2.2999999999999998},"min":{"1min":0.56599999999999995,"5min":0.45100000000000001,"15min":0.439},"max":{"1min":33.039000000000001,"5min":33.039000000000001,"15min":33.039000000000001},"last":0.90000000000000002}]}]},{"osd":4,"up_from":13,"seq":55834580415,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":4497848,"kb_used_data":2558960,"kb_used_omap":28522,"kb_used_meta":1910357,"kb_avail":89873992,"statfs":{"total":96636764160,"available":92030967808,"internally_reserved":0,"allocated":2620375040,"data_stored":2619031791,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":29207047,"internal_metadata":1956206073},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":17,"apply_latency_ms":17,"commit_latency_ns":17000000,"apply_latency_ns":17000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 6 02:40:16 2023","interfaces":[{"interface":"back","average":{"1min":2.0750000000000002,"5min":1.0489999999999999,"15min":1.1559999999999999},"min":{"1min":0.245,"5min":0.245,"15min":0.23100000000000001},"max":{"1min":17.847999999999999,"5min":17.847999999999999,"15min":17.847999999999999},"last":0.64100000000000001},{"interface":"front","average":{"1min":3.0670000000000002,"5min":1.6060000000000001,"15min":1.704},"min":{"1min":0.27900000000000003,"5min":0.27900000000000003,"15min":0.26200000000000001},"max":{"1min":32.529000000000003,"5min":32.529000000000003,"15min":32.529000000000003},"last":0.53500000000000003}]},{"osd":1,"last update":"Thu Jul 6 02:40:16 2023","interfaces":[{"interface":"back","average":{"1min":3.2639999999999998,"5min":1.661,"15min":1.9530000000000001},"min":{"1min":0.39800000000000002,"5min":0.26900000000000002,"15min":0.26400000000000001},"max":{"1min":11.667,"5min":11.667,"15min":26.927},"last":0.65500000000000003},{"interface":"front","average":{"1min":3.3290000000000002,"5min":1.7390000000000001,"15min":1.944},"min":{"1min":0.308,"5min":0.28000000000000003,"15min":0.27500000000000002},"max":{"1min":12.082000000000001,"5min":12.082000000000001,"15min":26.620999999999999},"last":0.56699999999999995}]},{"osd":2,"last update":"Thu Jul 6 02:39:27 2023","interfaces":[{"interface":"back","average":{"1min":1.4399999999999999,"5min":1.5760000000000001,"15min":1.6619999999999999},"min":{"1min":0.35399999999999998,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":7.8890000000000002,"5min":13.345000000000001,"15min":18.768999999999998},"last":0.55600000000000005},{"interface":"front","average":{"1min":1.8620000000000001,"5min":1.9390000000000001,"15min":2.121},"min":{"1min":0.36599999999999999,"5min":0.35399999999999998,"15min":0.29999999999999999},"max":{"1min":7.5410000000000004,"5min":8.673,"15min":18.701000000000001},"last":0.69699999999999995}]},{"osd":3,"last update":"Thu Jul 6 02:40:16 2023","interfaces":[{"interface":"back","average":{"1min":2.746,"5min":1.984,"15min":2.0379999999999998},"min":{"1min":0.307,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":12.132,"5min":12.132,"15min":12.132},"last":0.51600000000000001},{"interface":"front","average":{"1min":3.4529999999999998,"5min":1.847,"15min":1.9370000000000001},"min":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.34699999999999998},"max":{"1min":18.472000000000001,"5min":18.472000000000001,"15min":18.472000000000001},"last":0.58299999999999996}]},{"osd":5,"last update":"Thu Jul 6 02:40:16 2023","interfaces":[{"interface":"back","average":{"1min":4.6159999999999997,"5min":1.837,"15min":1.6819999999999999},"min":{"1min":0.311,"5min":0.309,"15min":0.27400000000000002},"max":{"1min":46.088000000000001,"5min":46.088000000000001,"15min":46.088000000000001},"last":0.44500000000000001},{"interface":"front","average":{"1min":1.948,"5min":1.2549999999999999,"15min":1.4930000000000001},"min":{"1min":0.26800000000000002,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":21.468,"5min":21.468,"15min":21.468},"last":0.625}]},{"osd":6,"last update":"Thu Jul 6 02:40:16 2023","interfaces":[{"interface":"back","average":{"1min":2.4620000000000002,"5min":1.3009999999999999,"15min":1.274},"min":{"1min":0.30099999999999999,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":18.498000000000001,"5min":18.498000000000001,"15min":18.498000000000001},"last":0.48799999999999999},{"interface":"front","average":{"1min":1.8640000000000001,"5min":1.415,"15min":1.726},"min":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.35099999999999998},"max":{"1min":8.2309999999999999,"5min":8.2309999999999999,"15min":15.339},"last":0.60199999999999998}]},{"osd":7,"last update":"Thu Jul 6 02:40:16 2023","interfaces":[{"interface":"back","average":{"1min":9.0920000000000005,"5min":2.8130000000000002,"15min":2.0579999999999998},"min":{"1min":0.39400000000000002,"5min":0.37,"15min":0.36899999999999999},"max":{"1min":170.637,"5min":170.637,"15min":170.637},"last":0.68100000000000005},{"interface":"front","average":{"1min":9.891,"5min":2.907,"15min":1.903},"min":{"1min":0.375,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":170.33199999999999,"5min":170.33199999999999,"15min":170.33199999999999},"last":0.67200000000000004}]}]},{"osd":5,"up_from":13,"seq":55834580408,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":4015340,"kb_used_data":2520488,"kb_used_omap":19336,"kb_used_meta":1376695,"kb_avail":90356500,"statfs":{"total":96636764160,"available":92525056000,"internally_reserved":0,"allocated":2580979712,"data_stored":2579685704,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":19800821,"internal_metadata":1409735947},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":30,"apply_latency_ms":30,"commit_latency_ns":30000000,"apply_latency_ns":30000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 6 02:39:44 2023","interfaces":[{"interface":"back","average":{"1min":1.3859999999999999,"5min":1.1319999999999999,"15min":1.159},"min":{"1min":0.27000000000000002,"5min":0.23100000000000001,"15min":0.23100000000000001},"max":{"1min":4.9189999999999996,"5min":6.5110000000000001,"15min":10.669},"last":1.131},{"interface":"front","average":{"1min":2.4700000000000002,"5min":1.6679999999999999,"15min":1.5960000000000001},"min":{"1min":0.309,"5min":0.28100000000000003,"15min":0.26900000000000002},"max":{"1min":10.452999999999999,"5min":10.452999999999999,"15min":10.452999999999999},"last":2.0579999999999998}]},{"osd":1,"last update":"Thu Jul 6 02:39:44 2023","interfaces":[{"interface":"back","average":{"1min":2.0499999999999998,"5min":1.4830000000000001,"15min":1.5609999999999999},"min":{"1min":0.29699999999999999,"5min":0.28000000000000003,"15min":0.27600000000000002},"max":{"1min":8.3719999999999999,"5min":8.3719999999999999,"15min":8.3719999999999999},"last":1.9770000000000001},{"interface":"front","average":{"1min":2.2210000000000001,"5min":1.8799999999999999,"15min":1.671},"min":{"1min":0.36499999999999999,"5min":0.27600000000000002,"15min":0.26000000000000001},"max":{"1min":7.827,"5min":8.1120000000000001,"15min":10.724},"last":2.0099999999999998}]},{"osd":2,"last update":"Thu Jul 6 02:39:44 2023","interfaces":[{"interface":"back","average":{"1min":2.133,"5min":1.929,"15min":1.901},"min":{"1min":0.32900000000000001,"5min":0.31900000000000001,"15min":0.28799999999999998},"max":{"1min":6.1420000000000003,"5min":9.5739999999999998,"15min":9.5739999999999998},"last":1.647},{"interface":"front","average":{"1min":2.0089999999999999,"5min":1.843,"15min":1.915},"min":{"1min":0.33600000000000002,"5min":0.33600000000000002,"15min":0.29199999999999998},"max":{"1min":4.7720000000000002,"5min":7.4039999999999999,"15min":10.209},"last":2.2599999999999998}]},{"osd":3,"last update":"Thu Jul 6 02:39:44 2023","interfaces":[{"interface":"back","average":{"1min":2.2120000000000002,"5min":1.8740000000000001,"15min":1.944},"min":{"1min":0.39400000000000002,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":7.5860000000000003,"5min":7.5860000000000003,"15min":11.222},"last":0.97099999999999997},{"interface":"front","average":{"1min":1.925,"5min":2.0299999999999998,"15min":2.0289999999999999},"min":{"1min":0.36699999999999999,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":7.0499999999999998,"5min":7.0499999999999998,"15min":9.9700000000000006},"last":1.5569999999999999}]},{"osd":4,"last update":"Thu Jul 6 02:39:44 2023","interfaces":[{"interface":"back","average":{"1min":0.88900000000000001,"5min":1.165,"15min":1.298},"min":{"1min":0.33300000000000002,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":3.02,"5min":10.948,"15min":13.590999999999999},"last":1.056},{"interface":"front","average":{"1min":1.155,"5min":1.3220000000000001,"15min":1.5860000000000001},"min":{"1min":0.38300000000000001,"5min":0.30399999999999999,"15min":0.28599999999999998},"max":{"1min":3.4750000000000001,"5min":6.7130000000000001,"15min":9.4410000000000007},"last":0.76300000000000001}]},{"osd":6,"last update":"Thu Jul 6 02:39:44 2023","interfaces":[{"interface":"back","average":{"1min":0.95899999999999996,"5min":1.3149999999999999,"15min":1.4570000000000001},"min":{"1min":0.33700000000000002,"5min":0.33500000000000002,"15min":0.316},"max":{"1min":2.8180000000000001,"5min":6.1539999999999999,"15min":15.113},"last":0.74299999999999999},{"interface":"front","average":{"1min":1.2370000000000001,"5min":1.2989999999999999,"15min":1.5249999999999999},"min":{"1min":0.41799999999999998,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":4.0620000000000003,"5min":10.906000000000001,"15min":11.699},"last":1.103}]},{"osd":7,"last update":"Thu Jul 6 02:39:44 2023","interfaces":[{"interface":"back","average":{"1min":1.1160000000000001,"5min":1.49,"15min":1.7529999999999999},"min":{"1min":0.41199999999999998,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":3.6659999999999999,"5min":8.8499999999999996,"15min":11.294},"last":0.88500000000000001},{"interface":"front","average":{"1min":1.274,"5min":1.393,"15min":1.621},"min":{"1min":0.40600000000000003,"5min":0.36199999999999999,"15min":0.35399999999999998},"max":{"1min":3.8999999999999999,"5min":6.351,"15min":15.173},"last":0.79800000000000004}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-07-06T02:40:22.291 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-07-06T02:40:22.427 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:22.423+0000 7ff802c60700 1 Processor -- start 2023-07-06T02:40:22.427 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:22.423+0000 7ff802c60700 1 -- start start 2023-07-06T02:40:22.434 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:22.424+0000 7ff802c60700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7ff7fc15c6a0 0x7ff7fc0cd310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T02:40:22.435 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:22.424+0000 7ff802c60700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7ff7fc160b10 0x7ff7fc0b47d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T02:40:22.435 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:22.424+0000 7ff802c60700 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff7fc0b5130 con 0x7ff7fc0b4d10 2023-07-06T02:40:22.436 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:22.424+0000 7ff802c60700 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff7fc0d1a30 con 0x7ff7fc160b10 2023-07-06T02:40:22.436 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:22.424+0000 7ff802c60700 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff7fc160fb0 con 0x7ff7fc15c6a0 2023-07-06T02:40:22.437 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:22.424+0000 7ff7fbfff700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7ff7fc160b10 0x7ff7fc0b47d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T02:40:22.437 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:22.425+0000 7ff7fbfff700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7ff7fc160b10 0x7ff7fc0b47d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:46052/0 (socket says 172.21.15.46:46052) 2023-07-06T02:40:22.438 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:22.425+0000 7ff7fbfff700 1 -- 172.21.15.46:0/2224795730 learned_addr learned my addr 172.21.15.46:0/2224795730 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-07-06T02:40:22.438 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:22.425+0000 7ff8009fc700 1 --2- 172.21.15.46:0/2224795730 >> v2:172.21.15.73:3300/0 conn(0x7ff7fc15c6a0 0x7ff7fc0cd310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T02:40:22.438 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:22.425+0000 7ff7fbfff700 1 -- 172.21.15.46:0/2224795730 >> v2:172.21.15.73:3300/0 conn(0x7ff7fc15c6a0 msgr2=0x7ff7fc0cd310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T02:40:22.439 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:22.425+0000 7ff7fbfff700 1 --2- 172.21.15.46:0/2224795730 >> v2:172.21.15.73:3300/0 conn(0x7ff7fc15c6a0 0x7ff7fc0cd310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T02:40:22.439 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:22.425+0000 7ff7fbfff700 1 -- 172.21.15.46:0/2224795730 >> v1:172.21.15.73:6789/0 conn(0x7ff7fc0b4d10 legacy=0x7ff7fc06be00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T02:40:22.440 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:22.425+0000 7ff7fbfff700 1 -- 172.21.15.46:0/2224795730 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff7fc0cd9f0 con 0x7ff7fc160b10 2023-07-06T02:40:22.440 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:22.425+0000 7ff8009fc700 1 --2- 172.21.15.46:0/2224795730 >> v2:172.21.15.73:3300/0 conn(0x7ff7fc15c6a0 0x7ff7fc0cd310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-06T02:40:22.440 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:22.425+0000 7ff7fbfff700 1 --2- 172.21.15.46:0/2224795730 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff7fc160b10 0x7ff7fc0b47d0 secure :-1 s=READY pgs=3240 cs=0 l=1 rev1=1 crypto rx=0x7ff7fc06b910 tx=0x7ff7f0009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4ac15145887961de server_cookie=0 in_seq=0 out_seq=0 2023-07-06T02:40:22.441 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:22.425+0000 7ff7fb7fe700 1 -- 172.21.15.46:0/2224795730 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7f0004230 con 0x7ff7fc160b10 2023-07-06T02:40:22.441 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:22.425+0000 7ff7fb7fe700 1 -- 172.21.15.46:0/2224795730 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff7f0004390 con 0x7ff7fc160b10 2023-07-06T02:40:22.442 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:22.425+0000 7ff7fb7fe700 1 -- 172.21.15.46:0/2224795730 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7f00036a0 con 0x7ff7fc160b10 2023-07-06T02:40:22.442 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:22.426+0000 7ff802c60700 1 -- 172.21.15.46:0/2224795730 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff7fc160b10 msgr2=0x7ff7fc0b47d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T02:40:22.443 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:22.426+0000 7ff802c60700 1 --2- 172.21.15.46:0/2224795730 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff7fc160b10 0x7ff7fc0b47d0 secure :-1 s=READY pgs=3240 cs=0 l=1 rev1=1 crypto rx=0x7ff7fc06b910 tx=0x7ff7f0009bd0 comp rx=0 tx=0).stop 2023-07-06T02:40:22.443 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:22.426+0000 7ff802c60700 1 -- 172.21.15.46:0/2224795730 shutdown_connections 2023-07-06T02:40:22.443 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:22.426+0000 7ff802c60700 1 --2- 172.21.15.46:0/2224795730 >> v2:172.21.15.73:3300/0 conn(0x7ff7fc15c6a0 0x7ff7fc0cd310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T02:40:22.444 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:22.426+0000 7ff802c60700 1 --2- 172.21.15.46:0/2224795730 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff7fc160b10 0x7ff7fc0b47d0 unknown :-1 s=CLOSED pgs=3240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T02:40:22.444 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:22.426+0000 7ff802c60700 1 -- 172.21.15.46:0/2224795730 >> 172.21.15.46:0/2224795730 conn(0x7ff7fc0d39e0 msgr2=0x7ff7fc0cf7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T02:40:22.445 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:22.426+0000 7ff802c60700 1 -- 172.21.15.46:0/2224795730 shutdown_connections 2023-07-06T02:40:22.445 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:22.426+0000 7ff802c60700 1 -- 172.21.15.46:0/2224795730 wait complete. 2023-07-06T02:40:22.446 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:22.427+0000 7ff802c60700 1 Processor -- start 2023-07-06T02:40:22.446 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:22.427+0000 7ff802c60700 1 -- start start 2023-07-06T02:40:22.446 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:22.428+0000 7ff802c60700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff7fc0b4d10 0x7ff7fc1f4db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T02:40:22.447 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:22.428+0000 7ff802c60700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff7fc15c6a0 0x7ff7fc155a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T02:40:22.447 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:22.428+0000 7ff802c60700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7ff7fc160b10 0x7ff7fc155f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T02:40:22.448 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:22.428+0000 7ff802c60700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7fc159c90 con 0x7ff7fc15c6a0 2023-07-06T02:40:22.448 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:22.428+0000 7ff802c60700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7fc0b79b0 con 0x7ff7fc0b4d10 2023-07-06T02:40:22.448 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:22.428+0000 7ff802c60700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff7fc159ee0 con 0x7ff7fc160b10 2023-07-06T02:40:22.449 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:22.428+0000 7ff7fbfff700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff7fc15c6a0 0x7ff7fc155a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T02:40:22.449 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:22.428+0000 7ff7fbfff700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff7fc15c6a0 0x7ff7fc155a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:46056/0 (socket says 172.21.15.46:46056) 2023-07-06T02:40:22.450 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:22.428+0000 7ff7fbfff700 1 -- 172.21.15.46:0/1875984834 learned_addr learned my addr 172.21.15.46:0/1875984834 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-07-06T02:40:22.450 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:22.428+0000 7ff8009fc700 1 --2- 172.21.15.46:0/1875984834 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff7fc0b4d10 0x7ff7fc1f4db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T02:40:22.451 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:22.428+0000 7ff8011fd700 1 --2- 172.21.15.46:0/1875984834 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7ff7fc160b10 0x7ff7fc155f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T02:40:22.451 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:22.428+0000 7ff7fbfff700 1 -- 172.21.15.46:0/1875984834 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7ff7fc160b10 msgr2=0x7ff7fc155f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T02:40:22.451 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:22.428+0000 7ff7fbfff700 1 --2- 172.21.15.46:0/1875984834 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7ff7fc160b10 0x7ff7fc155f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T02:40:22.452 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:22.428+0000 7ff7fbfff700 1 -- 172.21.15.46:0/1875984834 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff7fc0b4d10 msgr2=0x7ff7fc1f4db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T02:40:22.452 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:22.428+0000 7ff7fbfff700 1 --2- 172.21.15.46:0/1875984834 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff7fc0b4d10 0x7ff7fc1f4db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T02:40:22.452 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:22.428+0000 7ff7fbfff700 1 -- 172.21.15.46:0/1875984834 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff7f0009550 con 0x7ff7fc15c6a0 2023-07-06T02:40:22.453 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:22.428+0000 7ff8009fc700 1 --2- 172.21.15.46:0/1875984834 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff7fc0b4d10 0x7ff7fc1f4db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-06T02:40:22.453 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:22.429+0000 7ff7fbfff700 1 --2- 172.21.15.46:0/1875984834 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff7fc15c6a0 0x7ff7fc155a50 secure :-1 s=READY pgs=3241 cs=0 l=1 rev1=1 crypto rx=0x7ff7f0009130 tx=0x7ff7f0004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T02:40:22.453 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:22.429+0000 7ff7f97fa700 1 -- 172.21.15.46:0/1875984834 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7f0011830 con 0x7ff7fc15c6a0 2023-07-06T02:40:22.453 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:22.429+0000 7ff7f97fa700 1 -- 172.21.15.46:0/1875984834 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff7f0011990 con 0x7ff7fc15c6a0 2023-07-06T02:40:22.453 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:22.429+0000 7ff802c60700 1 -- 172.21.15.46:0/1875984834 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff7fc15a1c0 con 0x7ff7fc15c6a0 2023-07-06T02:40:22.454 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:22.429+0000 7ff7f97fa700 1 -- 172.21.15.46:0/1875984834 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7f0011d40 con 0x7ff7fc15c6a0 2023-07-06T02:40:22.454 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:22.429+0000 7ff802c60700 1 -- 172.21.15.46:0/1875984834 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff7fc1f52f0 con 0x7ff7fc15c6a0 2023-07-06T02:40:22.454 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:22.430+0000 7ff802c60700 1 -- 172.21.15.46:0/1875984834 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff7fc0672e0 con 0x7ff7fc15c6a0 2023-07-06T02:40:22.454 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:22.430+0000 7ff7f97fa700 1 -- 172.21.15.46:0/1875984834 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7ff7f001b440 con 0x7ff7fc15c6a0 2023-07-06T02:40:22.454 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:22.431+0000 7ff7f97fa700 1 --2- 172.21.15.46:0/1875984834 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7ff7e806ace0 0x7ff7e806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T02:40:22.455 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:22.431+0000 7ff7f97fa700 1 -- 172.21.15.46:0/1875984834 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 5296+0+0 (secure 0 0 0) 0x7ff7f008a7c0 con 0x7ff7fc15c6a0 2023-07-06T02:40:22.455 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:22.431+0000 7ff8009fc700 1 --2- 172.21.15.46:0/1875984834 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7ff7e806ace0 0x7ff7e806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T02:40:22.455 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:22.432+0000 7ff8009fc700 1 --2- 172.21.15.46:0/1875984834 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7ff7e806ace0 0x7ff7e806d190 secure :-1 s=READY pgs=734 cs=0 l=1 rev1=1 crypto rx=0x7ff7ec00aa20 tx=0x7ff7ec008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T02:40:22.456 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:22.436+0000 7ff7f97fa700 1 -- 172.21.15.46:0/1875984834 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7ff7f0055c00 con 0x7ff7fc15c6a0 2023-07-06T02:40:22.639 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:22.636+0000 7ff802c60700 1 -- 172.21.15.46:0/1875984834 --> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7ff7fc15d140 con 0x7ff7e806ace0 2023-07-06T02:40:22.642 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:22.639+0000 7ff7f97fa700 1 -- 172.21.15.46:0/1875984834 <== mgr.4099 v2:172.21.15.73:6832/3033361733 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+71633 (secure 0 0 0) 0x7ff7ec00a6f0 con 0x7ff7e806ace0 2023-07-06T02:40:22.643 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-06T02:40:22.645 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:22.641+0000 7ff802c60700 1 -- 172.21.15.46:0/1875984834 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7ff7e806ace0 msgr2=0x7ff7e806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T02:40:22.645 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:22.641+0000 7ff802c60700 1 --2- 172.21.15.46:0/1875984834 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7ff7e806ace0 0x7ff7e806d190 secure :-1 s=READY pgs=734 cs=0 l=1 rev1=1 crypto rx=0x7ff7ec00aa20 tx=0x7ff7ec008040 comp rx=0 tx=0).stop 2023-07-06T02:40:22.645 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:22.641+0000 7ff802c60700 1 -- 172.21.15.46:0/1875984834 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff7fc15c6a0 msgr2=0x7ff7fc155a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T02:40:22.645 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:22.641+0000 7ff802c60700 1 --2- 172.21.15.46:0/1875984834 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff7fc15c6a0 0x7ff7fc155a50 secure :-1 s=READY pgs=3241 cs=0 l=1 rev1=1 crypto rx=0x7ff7f0009130 tx=0x7ff7f0004750 comp rx=0 tx=0).stop 2023-07-06T02:40:22.646 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:22.642+0000 7ff802c60700 1 -- 172.21.15.46:0/1875984834 shutdown_connections 2023-07-06T02:40:22.646 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:22.642+0000 7ff802c60700 1 --2- 172.21.15.46:0/1875984834 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7ff7e806ace0 0x7ff7e806d190 unknown :-1 s=CLOSED pgs=734 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T02:40:22.646 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:22.642+0000 7ff802c60700 1 --2- 172.21.15.46:0/1875984834 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7ff7fc160b10 0x7ff7fc155f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T02:40:22.646 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:22.642+0000 7ff802c60700 1 --2- 172.21.15.46:0/1875984834 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff7fc0b4d10 0x7ff7fc1f4db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T02:40:22.646 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:22.642+0000 7ff802c60700 1 --2- 172.21.15.46:0/1875984834 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff7fc15c6a0 0x7ff7fc155a50 unknown :-1 s=CLOSED pgs=3241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T02:40:22.647 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:22.642+0000 7ff802c60700 1 -- 172.21.15.46:0/1875984834 >> 172.21.15.46:0/1875984834 conn(0x7ff7fc0d39e0 msgr2=0x7ff7fc15f0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T02:40:22.647 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:22.642+0000 7ff802c60700 1 -- 172.21.15.46:0/1875984834 shutdown_connections 2023-07-06T02:40:22.647 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:22.642+0000 7ff802c60700 1 -- 172.21.15.46:0/1875984834 wait complete. 2023-07-06T02:40:22.647 INFO:teuthology.orchestra.run.smithi046.stderr:dumped all 2023-07-06T02:40:22.658 INFO:teuthology.orchestra.run.smithi046.stdout:{"pg_ready":true,"pg_map":{"version":13954,"stamp":"2023-07-06T02:40:22.069116+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":146,"num_read_kb":127,"num_write":209,"num_write_kb":3462,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":161,"ondisk_log_size":161,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":189,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":38477476,"kb_used_data":26364196,"kb_used_omap":135394,"kb_used_meta":11712605,"kb_avail":716497244,"statfs":{"total":773094113280,"available":733693177856,"internally_reserved":0,"allocated":26996936704,"data_stored":26983849628,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":138643486,"internal_metadata":11993708514},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":264,"apply_latency_ms":264,"commit_latency_ns":264000000,"apply_latency_ns":264000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-62798561459,"num_objects":-45638,"num_object_clones":0,"num_object_copies":-91276,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-45638,"num_whiteouts":0,"num_read":-1619613,"num_read_kb":-364489914,"num_write":-3226784,"num_write_kb":-626104872,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-3691,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.001881"},"pg_stats":[{"pgid":"1.5","version":"0'0","reported_seq":274,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-07-06T02:40:17.475260+0000","last_change":"2023-07-05T18:56:09.622184+0000","last_active":"2023-07-06T02:40:17.475260+0000","last_peered":"2023-07-06T02:40:17.475260+0000","last_clean":"2023-07-06T02:40:17.475260+0000","last_became_active":"2023-07-05T18:56:09.621796+0000","last_became_peered":"2023-07-05T18:56:09.621796+0000","last_unstale":"2023-07-06T02:40:17.475260+0000","last_undegraded":"2023-07-06T02:40:17.475260+0000","last_fullsized":"2023-07-06T02:40:17.475260+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T18:56:08.603137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T18:56:08.603137+0000","last_clean_scrub_stamp":"2023-07-05T18:56:08.603137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-06T19:36:39.040166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":278,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-07-06T02:40:17.476927+0000","last_change":"2023-07-05T18:56:09.621596+0000","last_active":"2023-07-06T02:40:17.476927+0000","last_peered":"2023-07-06T02:40:17.476927+0000","last_clean":"2023-07-06T02:40:17.476927+0000","last_became_active":"2023-07-05T18:56:09.621315+0000","last_became_peered":"2023-07-05T18:56:09.621315+0000","last_unstale":"2023-07-06T02:40:17.476927+0000","last_undegraded":"2023-07-06T02:40:17.476927+0000","last_fullsized":"2023-07-06T02:40:17.476927+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T18:56:08.603137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T18:56:08.603137+0000","last_clean_scrub_stamp":"2023-07-05T18:56:08.603137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-06T21:41:31.701702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":273,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-07-06T02:40:17.497921+0000","last_change":"2023-07-05T18:56:09.617992+0000","last_active":"2023-07-06T02:40:17.497921+0000","last_peered":"2023-07-06T02:40:17.497921+0000","last_clean":"2023-07-06T02:40:17.497921+0000","last_became_active":"2023-07-05T18:56:09.617720+0000","last_became_peered":"2023-07-05T18:56:09.617720+0000","last_unstale":"2023-07-06T02:40:17.497921+0000","last_undegraded":"2023-07-06T02:40:17.497921+0000","last_fullsized":"2023-07-06T02:40:17.497921+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T18:56:08.603137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T18:56:08.603137+0000","last_clean_scrub_stamp":"2023-07-05T18:56:08.603137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-06T20:37:16.107143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"37'161","reported_seq":484,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-07-06T02:40:18.420953+0000","last_change":"2023-07-05T18:56:09.621746+0000","last_active":"2023-07-06T02:40:18.420953+0000","last_peered":"2023-07-06T02:40:18.420953+0000","last_clean":"2023-07-06T02:40:18.420953+0000","last_became_active":"2023-07-05T18:56:09.621421+0000","last_became_peered":"2023-07-05T18:56:09.621421+0000","last_unstale":"2023-07-06T02:40:18.420953+0000","last_undegraded":"2023-07-06T02:40:18.420953+0000","last_fullsized":"2023-07-06T02:40:18.420953+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T18:56:08.603137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T18:56:08.603137+0000","last_clean_scrub_stamp":"2023-07-05T18:56:08.603137+0000","objects_scrubbed":0,"log_size":161,"log_dups_size":0,"ondisk_log_size":161,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-06T22:19:16.877769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":146,"num_read_kb":127,"num_write":209,"num_write_kb":3462,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":273,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-07-06T02:40:18.421439+0000","last_change":"2023-07-05T18:56:10.073940+0000","last_active":"2023-07-06T02:40:18.421439+0000","last_peered":"2023-07-06T02:40:18.421439+0000","last_clean":"2023-07-06T02:40:18.421439+0000","last_became_active":"2023-07-05T18:56:10.073617+0000","last_became_peered":"2023-07-05T18:56:10.073617+0000","last_unstale":"2023-07-06T02:40:18.421439+0000","last_undegraded":"2023-07-06T02:40:18.421439+0000","last_fullsized":"2023-07-06T02:40:18.421439+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T18:56:08.603137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T18:56:08.603137+0000","last_clean_scrub_stamp":"2023-07-05T18:56:08.603137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-06T22:12:49.944261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":281,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-07-06T02:40:18.420814+0000","last_change":"2023-07-05T18:56:10.073658+0000","last_active":"2023-07-06T02:40:18.420814+0000","last_peered":"2023-07-06T02:40:18.420814+0000","last_clean":"2023-07-06T02:40:18.420814+0000","last_became_active":"2023-07-05T18:56:10.073336+0000","last_became_peered":"2023-07-05T18:56:10.073336+0000","last_unstale":"2023-07-06T02:40:18.420814+0000","last_undegraded":"2023-07-06T02:40:18.420814+0000","last_fullsized":"2023-07-06T02:40:18.420814+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T18:56:08.603137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T18:56:08.603137+0000","last_clean_scrub_stamp":"2023-07-05T18:56:08.603137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-06T23:56:59.615696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":274,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-07-06T02:40:17.980312+0000","last_change":"2023-07-05T18:56:10.073693+0000","last_active":"2023-07-06T02:40:17.980312+0000","last_peered":"2023-07-06T02:40:17.980312+0000","last_clean":"2023-07-06T02:40:17.980312+0000","last_became_active":"2023-07-05T18:56:10.073356+0000","last_became_peered":"2023-07-05T18:56:10.073356+0000","last_unstale":"2023-07-06T02:40:17.980312+0000","last_undegraded":"2023-07-06T02:40:17.980312+0000","last_fullsized":"2023-07-06T02:40:17.980312+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T18:56:08.603137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T18:56:08.603137+0000","last_clean_scrub_stamp":"2023-07-05T18:56:08.603137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-06T21:29:04.979258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":267,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-07-06T02:40:17.919071+0000","last_change":"2023-07-05T18:56:10.073639+0000","last_active":"2023-07-06T02:40:17.919071+0000","last_peered":"2023-07-06T02:40:17.919071+0000","last_clean":"2023-07-06T02:40:17.919071+0000","last_became_active":"2023-07-05T18:56:10.073339+0000","last_became_peered":"2023-07-05T18:56:10.073339+0000","last_unstale":"2023-07-06T02:40:17.919071+0000","last_undegraded":"2023-07-06T02:40:17.919071+0000","last_fullsized":"2023-07-06T02:40:17.919071+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T18:56:08.603137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T18:56:08.603137+0000","last_clean_scrub_stamp":"2023-07-05T18:56:08.603137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-06T23:08:47.739749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":267,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-07-06T02:40:17.919390+0000","last_change":"2023-07-05T18:56:09.619299+0000","last_active":"2023-07-06T02:40:17.919390+0000","last_peered":"2023-07-06T02:40:17.919390+0000","last_clean":"2023-07-06T02:40:17.919390+0000","last_became_active":"2023-07-05T18:56:09.618958+0000","last_became_peered":"2023-07-05T18:56:09.618958+0000","last_unstale":"2023-07-06T02:40:17.919390+0000","last_undegraded":"2023-07-06T02:40:17.919390+0000","last_fullsized":"2023-07-06T02:40:17.919390+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T18:56:08.603137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T18:56:08.603137+0000","last_clean_scrub_stamp":"2023-07-05T18:56:08.603137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-06T23:58:42.021659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":8},{"poolid":2,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":146,"num_read_kb":127,"num_write":209,"num_write_kb":3462,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":161,"ondisk_log_size":161,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834580411,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":5673296,"kb_used_data":3774448,"kb_used_omap":14013,"kb_used_meta":1876034,"kb_avail":88698544,"statfs":{"total":96636764160,"available":90827309056,"internally_reserved":0,"allocated":3865034752,"data_stored":3863186783,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":14349832,"internal_metadata":1921059320},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":31,"apply_latency_ms":31,"commit_latency_ns":31000000,"apply_latency_ns":31000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 6 02:40:11 2023","interfaces":[{"interface":"back","average":{"1min":6.3979999999999997,"5min":1.9890000000000001,"15min":1.554},"min":{"1min":0.24199999999999999,"5min":0.24199999999999999,"15min":0.24099999999999999},"max":{"1min":71.978999999999999,"5min":71.978999999999999,"15min":71.978999999999999},"last":0.42799999999999999},{"interface":"front","average":{"1min":4.657,"5min":2.1640000000000001,"15min":1.8440000000000001},"min":{"1min":0.25800000000000001,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":23.382000000000001,"5min":23.382000000000001,"15min":23.382000000000001},"last":0.45400000000000001}]},{"osd":1,"last update":"Thu Jul 6 02:40:11 2023","interfaces":[{"interface":"back","average":{"1min":7.2990000000000004,"5min":2.3500000000000001,"15min":1.829},"min":{"1min":0.27200000000000002,"5min":0.27200000000000002,"15min":0.25},"max":{"1min":71.951999999999998,"5min":71.951999999999998,"15min":71.951999999999998},"last":0.64000000000000001},{"interface":"front","average":{"1min":4.25,"5min":2.3250000000000002,"15min":2.0640000000000001},"min":{"1min":0.26100000000000001,"5min":0.26100000000000001,"15min":0.25900000000000001},"max":{"1min":23.489999999999998,"5min":23.489999999999998,"15min":23.489999999999998},"last":0.59499999999999997}]},{"osd":2,"last update":"Thu Jul 6 02:40:11 2023","interfaces":[{"interface":"back","average":{"1min":4.9379999999999997,"5min":2.2160000000000002,"15min":1.7969999999999999},"min":{"1min":0.33500000000000002,"5min":0.29899999999999999,"15min":0.29299999999999998},"max":{"1min":35.311999999999998,"5min":35.311999999999998,"15min":35.311999999999998},"last":0.62},{"interface":"front","average":{"1min":6.2610000000000001,"5min":2.5649999999999999,"15min":2.0960000000000001},"min":{"1min":0.308,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":66.536000000000001,"5min":66.536000000000001,"15min":66.536000000000001},"last":0.46800000000000003}]},{"osd":3,"last update":"Thu Jul 6 02:40:11 2023","interfaces":[{"interface":"back","average":{"1min":3.327,"5min":1.9690000000000001,"15min":1.8129999999999999},"min":{"1min":0.33200000000000002,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":25.637,"5min":25.637,"15min":25.637},"last":0.54400000000000004},{"interface":"front","average":{"1min":5.9050000000000002,"5min":2.617,"15min":2.2370000000000001},"min":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":71.905000000000001,"5min":71.905000000000001,"15min":71.905000000000001},"last":0.66700000000000004}]},{"osd":4,"last update":"Thu Jul 6 02:40:11 2023","interfaces":[{"interface":"back","average":{"1min":7.0339999999999998,"5min":2.3719999999999999,"15min":1.871},"min":{"1min":0.27700000000000002,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":52.734999999999999,"5min":52.734999999999999,"15min":52.734999999999999},"last":0.51100000000000001},{"interface":"front","average":{"1min":2.7069999999999999,"5min":1.359,"15min":1.2829999999999999},"min":{"1min":0.33500000000000002,"5min":0.32000000000000001,"15min":0.311},"max":{"1min":35.372,"5min":35.372,"15min":35.372},"last":0.58399999999999996}]},{"osd":5,"last update":"Thu Jul 6 02:40:11 2023","interfaces":[{"interface":"back","average":{"1min":5.3689999999999998,"5min":2.1030000000000002,"15min":1.788},"min":{"1min":0.29299999999999998,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":73.492999999999995,"5min":73.492999999999995,"15min":73.492999999999995},"last":0.60499999999999998},{"interface":"front","average":{"1min":2.839,"5min":1.847,"15min":1.754},"min":{"1min":0.34799999999999998,"5min":0.33800000000000002,"15min":0.30499999999999999},"max":{"1min":14.983000000000001,"5min":14.983000000000001,"15min":25.689},"last":0.56200000000000006}]},{"osd":6,"last update":"Thu Jul 6 02:40:11 2023","interfaces":[{"interface":"back","average":{"1min":3.9630000000000001,"5min":2.0470000000000002,"15min":1.986},"min":{"1min":0.34200000000000003,"5min":0.309,"15min":0.309},"max":{"1min":21.321000000000002,"5min":21.321000000000002,"15min":21.321000000000002},"last":0.628},{"interface":"front","average":{"1min":1.5349999999999999,"5min":1.4219999999999999,"15min":1.3460000000000001},"min":{"1min":0.376,"5min":0.376,"15min":0.373},"max":{"1min":11.273999999999999,"5min":11.273999999999999,"15min":12.099},"last":0.64900000000000002}]}]},{"osd":6,"up_from":13,"seq":55834580418,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":5593024,"kb_used_data":4906924,"kb_used_omap":14943,"kb_used_meta":658080,"kb_avail":88778816,"statfs":{"total":96636764160,"available":90909507584,"internally_reserved":0,"allocated":5024690176,"data_stored":5022424629,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":15302320,"internal_metadata":673874256},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":25,"apply_latency_ms":25,"commit_latency_ns":25000000,"apply_latency_ns":25000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 6 02:39:25 2023","interfaces":[{"interface":"back","average":{"1min":1.333,"5min":1.1419999999999999,"15min":0.999},"min":{"1min":0.29399999999999998,"5min":0.24199999999999999,"15min":0.22900000000000001},"max":{"1min":12.007,"5min":12.007,"15min":12.007},"last":0.621},{"interface":"front","average":{"1min":1.127,"5min":1.4590000000000001,"15min":1.512},"min":{"1min":0.27000000000000002,"5min":0.27000000000000002,"15min":0.26400000000000001},"max":{"1min":4.7229999999999999,"5min":8.2699999999999996,"15min":14.146000000000001},"last":1.224}]},{"osd":1,"last update":"Thu Jul 6 02:39:25 2023","interfaces":[{"interface":"back","average":{"1min":2.5179999999999998,"5min":1.738,"15min":1.796},"min":{"1min":0.25800000000000001,"5min":0.25800000000000001,"15min":0.25600000000000001},"max":{"1min":11.182,"5min":11.182,"15min":15.563000000000001},"last":0.41299999999999998},{"interface":"front","average":{"1min":4.2599999999999998,"5min":2.464,"15min":2.0059999999999998},"min":{"1min":0.307,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":62.668999999999997,"5min":62.668999999999997,"15min":62.668999999999997},"last":1.1759999999999999}]},{"osd":2,"last update":"Thu Jul 6 02:39:25 2023","interfaces":[{"interface":"back","average":{"1min":1.288,"5min":1.341,"15min":1.4259999999999999},"min":{"1min":0.33200000000000002,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":6.7249999999999996,"5min":6.7249999999999996,"15min":6.7249999999999996},"last":1.1240000000000001},{"interface":"front","average":{"1min":3.8999999999999999,"5min":2.298,"15min":2.3260000000000001},"min":{"1min":0.42999999999999999,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":29.617999999999999,"5min":29.617999999999999,"15min":29.617999999999999},"last":0.92600000000000005}]},{"osd":3,"last update":"Thu Jul 6 02:39:25 2023","interfaces":[{"interface":"back","average":{"1min":1.5189999999999999,"5min":1.9379999999999999,"15min":2.0710000000000002},"min":{"1min":0.33700000000000002,"5min":0.312,"15min":0.312},"max":{"1min":8.2560000000000002,"5min":11.526999999999999,"15min":14.084},"last":1.3660000000000001},{"interface":"front","average":{"1min":1.448,"5min":1.5,"15min":1.7310000000000001},"min":{"1min":0.39500000000000002,"5min":0.35199999999999998,"15min":0.34999999999999998},"max":{"1min":6.3529999999999998,"5min":6.3529999999999998,"15min":7.3040000000000003},"last":1.006}]},{"osd":4,"last update":"Thu Jul 6 02:39:25 2023","interfaces":[{"interface":"back","average":{"1min":2.016,"5min":1.468,"15min":1.645},"min":{"1min":0.29399999999999998,"5min":0.28599999999999998,"15min":0.27100000000000002},"max":{"1min":11.215999999999999,"5min":11.215999999999999,"15min":15.625999999999999},"last":0.78600000000000003},{"interface":"front","average":{"1min":1.2490000000000001,"5min":1.397,"15min":1.5660000000000001},"min":{"1min":0.29899999999999999,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":5.0679999999999996,"5min":8.3689999999999998,"15min":14.519},"last":1.2529999999999999}]},{"osd":5,"last update":"Thu Jul 6 02:39:25 2023","interfaces":[{"interface":"back","average":{"1min":1.0649999999999999,"5min":1.02,"15min":1.101},"min":{"1min":0.376,"5min":0.33900000000000002,"15min":0.315},"max":{"1min":5.508,"5min":6.3399999999999999,"15min":9.0790000000000006},"last":0.97399999999999998},{"interface":"front","average":{"1min":2.3340000000000001,"5min":1.5900000000000001,"15min":1.8069999999999999},"min":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":11.489000000000001,"5min":11.489000000000001,"15min":15.686},"last":0.98699999999999999}]},{"osd":7,"last update":"Thu Jul 6 02:39:25 2023","interfaces":[{"interface":"back","average":{"1min":3.1850000000000001,"5min":1.73,"15min":1.766},"min":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":38.942999999999998,"5min":38.942999999999998,"15min":38.942999999999998},"last":1.145},{"interface":"front","average":{"1min":2.9460000000000002,"5min":1.677,"15min":1.4410000000000001},"min":{"1min":0.41899999999999998,"5min":0.39000000000000001,"15min":0.35199999999999998},"max":{"1min":38.557000000000002,"5min":38.557000000000002,"15min":38.557000000000002},"last":1.0449999999999999}]}]},{"osd":1,"up_from":13,"seq":55834580395,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":5202972,"kb_used_data":3301816,"kb_used_omap":15006,"kb_used_meta":1848737,"kb_avail":89168868,"statfs":{"total":96636764160,"available":91308920832,"internally_reserved":0,"allocated":3381059584,"data_stored":3379442768,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":15366880,"internal_metadata":1893106976},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":35,"apply_latency_ms":35,"commit_latency_ns":35000000,"apply_latency_ns":35000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 6 02:40:11 2023","interfaces":[{"interface":"back","average":{"1min":1.8580000000000001,"5min":1.1719999999999999,"15min":1.0569999999999999},"min":{"1min":0.253,"5min":0.23400000000000001,"15min":0.23100000000000001},"max":{"1min":6.819,"5min":8.2579999999999991,"15min":11.006},"last":0.42499999999999999},{"interface":"front","average":{"1min":2.9079999999999999,"5min":1.796,"15min":1.3859999999999999},"min":{"1min":0.27700000000000002,"5min":0.27700000000000002,"15min":0.27000000000000002},"max":{"1min":15.366,"5min":15.366,"15min":15.366},"last":0.50700000000000001}]},{"osd":2,"last update":"Thu Jul 6 02:40:11 2023","interfaces":[{"interface":"back","average":{"1min":2.569,"5min":1.665,"15min":1.708},"min":{"1min":0.28899999999999998,"5min":0.26700000000000002,"15min":0.255},"max":{"1min":12.045999999999999,"5min":12.045999999999999,"15min":12.045999999999999},"last":0.48499999999999999},{"interface":"front","average":{"1min":2.6320000000000001,"5min":1.55,"15min":1.3480000000000001},"min":{"1min":0.28899999999999998,"5min":0.27700000000000002,"15min":0.25800000000000001},"max":{"1min":14.038,"5min":14.038,"15min":14.038},"last":0.52500000000000002}]},{"osd":3,"last update":"Thu Jul 6 02:40:11 2023","interfaces":[{"interface":"back","average":{"1min":2.4540000000000002,"5min":1.5960000000000001,"15min":1.387},"min":{"1min":0.35199999999999998,"5min":0.30499999999999999,"15min":0.253},"max":{"1min":15.712,"5min":15.712,"15min":15.712},"last":0.628},{"interface":"front","average":{"1min":2.931,"5min":1.8120000000000001,"15min":1.4970000000000001},"min":{"1min":0.432,"5min":0.29499999999999998,"15min":0.27300000000000002},"max":{"1min":15.414,"5min":15.414,"15min":15.414},"last":0.46899999999999997}]},{"osd":4,"last update":"Thu Jul 6 02:40:11 2023","interfaces":[{"interface":"back","average":{"1min":3.0249999999999999,"5min":1.988,"15min":1.6459999999999999},"min":{"1min":0.49199999999999999,"5min":0.38300000000000001,"15min":0.35199999999999998},"max":{"1min":15.442,"5min":15.442,"15min":15.442},"last":0.66000000000000003},{"interface":"front","average":{"1min":2.948,"5min":1.9690000000000001,"15min":1.9930000000000001},"min":{"1min":0.40200000000000002,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":15.279999999999999,"5min":15.279999999999999,"15min":15.279999999999999},"last":0.73099999999999998}]},{"osd":5,"last update":"Thu Jul 6 02:40:11 2023","interfaces":[{"interface":"back","average":{"1min":3.7349999999999999,"5min":2.484,"15min":2.3490000000000002},"min":{"1min":0.39300000000000002,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":22.263000000000002,"5min":22.263000000000002,"15min":22.263000000000002},"last":0.64500000000000002},{"interface":"front","average":{"1min":4.1920000000000002,"5min":2.1070000000000002,"15min":1.7270000000000001},"min":{"1min":0.41199999999999998,"5min":0.38200000000000001,"15min":0.36899999999999999},"max":{"1min":26.181000000000001,"5min":26.181000000000001,"15min":26.181000000000001},"last":0.67100000000000004}]},{"osd":6,"last update":"Thu Jul 6 02:40:11 2023","interfaces":[{"interface":"back","average":{"1min":2.206,"5min":1.8740000000000001,"15min":1.8300000000000001},"min":{"1min":0.52800000000000002,"5min":0.42199999999999999,"15min":0.39300000000000002},"max":{"1min":9.1600000000000001,"5min":9.5429999999999993,"15min":10.359999999999999},"last":0.746},{"interface":"front","average":{"1min":2.6960000000000002,"5min":2.0859999999999999,"15min":2.2839999999999998},"min":{"1min":0.48799999999999999,"5min":0.47399999999999998,"15min":0.439},"max":{"1min":10.478999999999999,"5min":10.478999999999999,"15min":11.101000000000001},"last":0.69799999999999995}]},{"osd":7,"last update":"Thu Jul 6 02:40:11 2023","interfaces":[{"interface":"back","average":{"1min":3.3220000000000001,"5min":2.1339999999999999,"15min":1.887},"min":{"1min":0.50600000000000001,"5min":0.44,"15min":0.44},"max":{"1min":18.707999999999998,"5min":18.707999999999998,"15min":18.707999999999998},"last":0.71999999999999997},{"interface":"front","average":{"1min":2.6869999999999998,"5min":2.282,"15min":2.0760000000000001},"min":{"1min":0.59299999999999997,"5min":0.47099999999999997,"15min":0.41799999999999998},"max":{"1min":11.893000000000001,"5min":11.893000000000001,"15min":11.893000000000001},"last":0.70799999999999996}]}]},{"osd":0,"up_from":13,"seq":55834580387,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":4524576,"kb_used_data":3072824,"kb_used_omap":12735,"kb_used_meta":1388224,"kb_avail":89847264,"statfs":{"total":96636764160,"available":92003598336,"internally_reserved":0,"allocated":3146571776,"data_stored":3144950115,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":13040941,"internal_metadata":1421542099},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":41,"apply_latency_ms":41,"commit_latency_ns":41000000,"apply_latency_ns":41000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jul 6 02:39:17 2023","interfaces":[{"interface":"back","average":{"1min":1.0740000000000001,"5min":1.244,"15min":1.2170000000000001},"min":{"1min":0.25900000000000001,"5min":0.246,"15min":0.23899999999999999},"max":{"1min":5.8579999999999997,"5min":7.1760000000000002,"15min":16.422000000000001},"last":0.437},{"interface":"front","average":{"1min":1.375,"5min":1.3740000000000001,"15min":1.448},"min":{"1min":0.27900000000000003,"5min":0.248,"15min":0.248},"max":{"1min":6.1260000000000003,"5min":7.0309999999999997,"15min":7.6500000000000004},"last":0.32600000000000001}]},{"osd":2,"last update":"Thu Jul 6 02:39:17 2023","interfaces":[{"interface":"back","average":{"1min":0.79800000000000004,"5min":1.3480000000000001,"15min":1.298},"min":{"1min":0.28499999999999998,"5min":0.26200000000000001,"15min":0.252},"max":{"1min":5.516,"5min":10.000999999999999,"15min":10.106},"last":0.378},{"interface":"front","average":{"1min":1.351,"5min":1.45,"15min":1.615},"min":{"1min":0.28799999999999998,"5min":0.245,"15min":0.245},"max":{"1min":6.21,"5min":13.625,"15min":13.625},"last":0.41399999999999998}]},{"osd":3,"last update":"Thu Jul 6 02:39:17 2023","interfaces":[{"interface":"back","average":{"1min":1.5389999999999999,"5min":1.9370000000000001,"15min":2.048},"min":{"1min":0.30499999999999999,"5min":0.29699999999999999,"15min":0.27800000000000002},"max":{"1min":7.6100000000000003,"5min":10.927,"15min":10.927},"last":0.48899999999999999},{"interface":"front","average":{"1min":0.96799999999999997,"5min":1.427,"15min":1.5309999999999999},"min":{"1min":0.40799999999999997,"5min":0.35799999999999998,"15min":0.315},"max":{"1min":5.3040000000000003,"5min":7.2359999999999998,"15min":7.9669999999999996},"last":0.55400000000000005}]},{"osd":4,"last update":"Thu Jul 6 02:39:17 2023","interfaces":[{"interface":"back","average":{"1min":1.3180000000000001,"5min":1.3660000000000001,"15min":1.5049999999999999},"min":{"1min":0.37,"5min":0.34899999999999998,"15min":0.32800000000000001},"max":{"1min":6.0199999999999996,"5min":10.901,"15min":10.977},"last":0.504},{"interface":"front","average":{"1min":1.72,"5min":1.764,"15min":1.9079999999999999},"min":{"1min":0.38800000000000001,"5min":0.34499999999999997,"15min":0.32400000000000001},"max":{"1min":8.6699999999999999,"5min":8.6699999999999999,"15min":11.01},"last":0.52700000000000002}]},{"osd":5,"last update":"Thu Jul 6 02:39:17 2023","interfaces":[{"interface":"back","average":{"1min":1.1910000000000001,"5min":1.4359999999999999,"15min":1.4370000000000001},"min":{"1min":0.498,"5min":0.379,"15min":0.35099999999999998},"max":{"1min":5.266,"5min":7.2779999999999996,"15min":7.8730000000000002},"last":0.51700000000000002},{"interface":"front","average":{"1min":1.9950000000000001,"5min":1.7669999999999999,"15min":1.7410000000000001},"min":{"1min":0.45100000000000001,"5min":0.372,"15min":0.36599999999999999},"max":{"1min":7.9630000000000001,"5min":10.773999999999999,"15min":10.773999999999999},"last":3.343}]},{"osd":6,"last update":"Thu Jul 6 02:39:17 2023","interfaces":[{"interface":"back","average":{"1min":1.7310000000000001,"5min":2.0049999999999999,"15min":2.1230000000000002},"min":{"1min":0.42499999999999999,"5min":0.379,"15min":0.379},"max":{"1min":6.2839999999999998,"5min":8.0679999999999996,"15min":10.191000000000001},"last":2.8889999999999998},{"interface":"front","average":{"1min":1.1850000000000001,"5min":1.3899999999999999,"15min":1.4279999999999999},"min":{"1min":0.52800000000000002,"5min":0.49299999999999999,"15min":0.38500000000000001},"max":{"1min":5.3419999999999996,"5min":7.3150000000000004,"15min":8.5690000000000008},"last":2.9660000000000002}]},{"osd":7,"last update":"Thu Jul 6 02:39:17 2023","interfaces":[{"interface":"back","average":{"1min":2.0190000000000001,"5min":2.1059999999999999,"15min":2.0750000000000002},"min":{"1min":0.51900000000000002,"5min":0.42299999999999999,"15min":0.41399999999999998},"max":{"1min":6.1740000000000004,"5min":14.018000000000001,"15min":14.018000000000001},"last":2.7690000000000001},{"interface":"front","average":{"1min":2.2490000000000001,"5min":2.4300000000000002,"15min":2.3109999999999999},"min":{"1min":0.47499999999999998,"5min":0.45900000000000002,"15min":0.44800000000000001},"max":{"1min":8.3019999999999996,"5min":8.3019999999999996,"15min":10.103999999999999},"last":3.1480000000000001}]}]},{"osd":2,"up_from":13,"seq":55834580382,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":4793832,"kb_used_data":3452648,"kb_used_omap":9607,"kb_used_meta":1300536,"kb_avail":89578008,"statfs":{"total":96636764160,"available":91727880192,"internally_reserved":0,"allocated":3535511552,"data_stored":3533841940,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":9837933,"internal_metadata":1331749523},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":51,"apply_latency_ms":51,"commit_latency_ns":51000000,"apply_latency_ns":51000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 6 02:40:19 2023","interfaces":[{"interface":"back","average":{"1min":5.1559999999999997,"5min":1.796,"15min":1.349},"min":{"1min":0.27200000000000002,"5min":0.22900000000000001,"15min":0.22900000000000001},"max":{"1min":36.674999999999997,"5min":36.674999999999997,"15min":36.674999999999997},"last":7.1970000000000001},{"interface":"front","average":{"1min":16.443000000000001,"5min":4.181,"15min":2.2999999999999998},"min":{"1min":0.27400000000000002,"5min":0.249,"15min":0.249},"max":{"1min":122.961,"5min":122.961,"15min":122.961},"last":7.3529999999999998}]},{"osd":1,"last update":"Thu Jul 6 02:40:19 2023","interfaces":[{"interface":"back","average":{"1min":5.3239999999999998,"5min":1.9450000000000001,"15min":1.504},"min":{"1min":0.30499999999999999,"5min":0.25,"15min":0.25},"max":{"1min":36.643999999999998,"5min":36.643999999999998,"15min":36.643999999999998},"last":8.3230000000000004},{"interface":"front","average":{"1min":5.3170000000000002,"5min":2.347,"15min":1.8460000000000001},"min":{"1min":0.312,"5min":0.28599999999999998,"15min":0.27900000000000003},"max":{"1min":25.643999999999998,"5min":25.643999999999998,"15min":25.643999999999998},"last":8.2140000000000004}]},{"osd":3,"last update":"Thu Jul 6 02:40:19 2023","interfaces":[{"interface":"back","average":{"1min":12.382999999999999,"5min":3.6989999999999998,"15min":2.4569999999999999},"min":{"1min":0.47199999999999998,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":101.968,"5min":101.968,"15min":101.968},"last":9.9879999999999995},{"interface":"front","average":{"1min":5.077,"5min":2.0960000000000001,"15min":1.6599999999999999},"min":{"1min":0.46899999999999997,"5min":0.31,"15min":0.31},"max":{"1min":36.701000000000001,"5min":36.701000000000001,"15min":36.701000000000001},"last":22.135999999999999}]},{"osd":4,"last update":"Thu Jul 6 02:40:19 2023","interfaces":[{"interface":"back","average":{"1min":6.5049999999999999,"5min":2.488,"15min":1.8740000000000001},"min":{"1min":0.38400000000000001,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":36.560000000000002,"5min":36.560000000000002,"15min":36.560000000000002},"last":7.5720000000000001},{"interface":"front","average":{"1min":8.7100000000000009,"5min":2.8820000000000001,"15min":2.105},"min":{"1min":0.59799999999999998,"5min":0.36599999999999999,"15min":0.33600000000000002},"max":{"1min":40.014000000000003,"5min":40.014000000000003,"15min":40.014000000000003},"last":8.1669999999999998}]},{"osd":5,"last update":"Thu Jul 6 02:40:19 2023","interfaces":[{"interface":"back","average":{"1min":10.765000000000001,"5min":3.7450000000000001,"15min":2.5470000000000002},"min":{"1min":0.57499999999999996,"5min":0.377,"15min":0.36099999999999999},"max":{"1min":81.969999999999999,"5min":81.969999999999999,"15min":81.969999999999999},"last":9.8179999999999996},{"interface":"front","average":{"1min":8.984,"5min":3.198,"15min":2.1360000000000001},"min":{"1min":0.53700000000000003,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":65.238,"5min":65.238,"15min":65.238},"last":7.5300000000000002}]},{"osd":6,"last update":"Thu Jul 6 02:40:19 2023","interfaces":[{"interface":"back","average":{"1min":7.5640000000000001,"5min":2.8290000000000002,"15min":2.1829999999999998},"min":{"1min":0.63600000000000001,"5min":0.40799999999999997,"15min":0.38700000000000001},"max":{"1min":25.689,"5min":25.689,"15min":25.689},"last":8.2780000000000005},{"interface":"front","average":{"1min":12.055,"5min":3.931,"15min":2.641},"min":{"1min":0.51700000000000002,"5min":0.433,"15min":0.40100000000000002},"max":{"1min":61.131999999999998,"5min":61.131999999999998,"15min":61.131999999999998},"last":9.7870000000000008}]},{"osd":7,"last update":"Thu Jul 6 02:40:19 2023","interfaces":[{"interface":"back","average":{"1min":8.6229999999999993,"5min":2.9830000000000001,"15min":2.27},"min":{"1min":0.68000000000000005,"5min":0.46200000000000002,"15min":0.45500000000000002},"max":{"1min":25.783000000000001,"5min":25.783000000000001,"15min":25.783000000000001},"last":8.2490000000000006},{"interface":"front","average":{"1min":9.2609999999999992,"5min":3.4860000000000002,"15min":2.6720000000000002},"min":{"1min":0.54800000000000004,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":72.167000000000002,"5min":72.167000000000002,"15min":72.167000000000002},"last":9.7409999999999997}]}]},{"osd":3,"up_from":13,"seq":55834580375,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":4176588,"kb_used_data":2776088,"kb_used_omap":21228,"kb_used_meta":1353939,"kb_avail":90195252,"statfs":{"total":96636764160,"available":92359938048,"internally_reserved":0,"allocated":2842714112,"data_stored":2841285898,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":21737712,"internal_metadata":1386434320},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":34,"apply_latency_ms":34,"commit_latency_ns":34000000,"apply_latency_ns":34000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 6 02:39:28 2023","interfaces":[{"interface":"back","average":{"1min":1.016,"5min":1.1739999999999999,"15min":1.0609999999999999},"min":{"1min":0.254,"5min":0.23799999999999999,"15min":0.22500000000000001},"max":{"1min":4.4199999999999999,"5min":7.0190000000000001,"15min":12.298999999999999},"last":0.58799999999999997},{"interface":"front","average":{"1min":2.1190000000000002,"5min":1.528,"15min":1.377},"min":{"1min":0.28299999999999997,"5min":0.27000000000000002,"15min":0.252},"max":{"1min":18.82,"5min":18.82,"15min":18.82},"last":0.54100000000000004}]},{"osd":1,"last update":"Thu Jul 6 02:39:28 2023","interfaces":[{"interface":"back","average":{"1min":7.5679999999999996,"5min":2.976,"15min":1.8959999999999999},"min":{"1min":0.307,"5min":0.27100000000000002,"15min":0.24299999999999999},"max":{"1min":103.182,"5min":103.182,"15min":103.182},"last":0.56000000000000005},{"interface":"front","average":{"1min":2.601,"5min":1.764,"15min":1.5369999999999999},"min":{"1min":0.27300000000000002,"5min":0.26800000000000002,"15min":0.25},"max":{"1min":18.895,"5min":18.895,"15min":18.895},"last":0.622}]},{"osd":2,"last update":"Thu Jul 6 02:39:44 2023","interfaces":[{"interface":"back","average":{"1min":4.5579999999999998,"5min":2.3660000000000001,"15min":1.8500000000000001},"min":{"1min":0.29699999999999999,"5min":0.29099999999999998,"15min":0.27700000000000002},"max":{"1min":33.005000000000003,"5min":33.005000000000003,"15min":33.005000000000003},"last":0.67100000000000004},{"interface":"front","average":{"1min":2.988,"5min":1.9219999999999999,"15min":1.8220000000000001},"min":{"1min":0.38300000000000001,"5min":0.29199999999999998,"15min":0.28799999999999998},"max":{"1min":18.997,"5min":18.997,"15min":18.997},"last":0.66400000000000003}]},{"osd":4,"last update":"Thu Jul 6 02:39:44 2023","interfaces":[{"interface":"back","average":{"1min":2.0710000000000002,"5min":1.5249999999999999,"15min":1.5229999999999999},"min":{"1min":0.33500000000000002,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":18.966000000000001,"5min":18.966000000000001,"15min":18.966000000000001},"last":0.86699999999999999},{"interface":"front","average":{"1min":2.8620000000000001,"5min":1.6899999999999999,"15min":1.462},"min":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":32.886000000000003,"5min":32.886000000000003,"15min":32.886000000000003},"last":0.81699999999999995}]},{"osd":5,"last update":"Thu Jul 6 02:39:28 2023","interfaces":[{"interface":"back","average":{"1min":2.9260000000000002,"5min":1.6990000000000001,"15min":1.667},"min":{"1min":0.42599999999999999,"5min":0.375,"15min":0.32400000000000001},"max":{"1min":18.539000000000001,"5min":18.539000000000001,"15min":21.579000000000001},"last":0.89100000000000001},{"interface":"front","average":{"1min":3.4460000000000002,"5min":2.2410000000000001,"15min":2.0720000000000001},"min":{"1min":0.49099999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":18.596,"5min":18.596,"15min":21.553999999999998},"last":0.96699999999999997}]},{"osd":6,"last update":"Thu Jul 6 02:39:44 2023","interfaces":[{"interface":"back","average":{"1min":5.5049999999999999,"5min":2.786,"15min":2.2749999999999999},"min":{"1min":0.47299999999999998,"5min":0.41199999999999998,"15min":0.377},"max":{"1min":43.991999999999997,"5min":43.991999999999997,"15min":43.991999999999997},"last":0.84099999999999997},{"interface":"front","average":{"1min":3.0289999999999999,"5min":2.1000000000000001,"15min":1.978},"min":{"1min":0.439,"5min":0.40799999999999997,"15min":0.39700000000000002},"max":{"1min":18.93,"5min":18.93,"15min":19.273},"last":0.91500000000000004}]},{"osd":7,"last update":"Thu Jul 6 02:39:44 2023","interfaces":[{"interface":"back","average":{"1min":4.3040000000000003,"5min":2.5259999999999998,"15min":2.0009999999999999},"min":{"1min":0.50600000000000001,"5min":0.47699999999999998,"15min":0.42299999999999999},"max":{"1min":32.942999999999998,"5min":32.942999999999998,"15min":32.942999999999998},"last":0.93799999999999994},{"interface":"front","average":{"1min":4.5119999999999996,"5min":2.3119999999999998,"15min":2.2999999999999998},"min":{"1min":0.56599999999999995,"5min":0.45100000000000001,"15min":0.439},"max":{"1min":33.039000000000001,"5min":33.039000000000001,"15min":33.039000000000001},"last":0.90000000000000002}]}]},{"osd":4,"up_from":13,"seq":55834580415,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":4497848,"kb_used_data":2558960,"kb_used_omap":28522,"kb_used_meta":1910357,"kb_avail":89873992,"statfs":{"total":96636764160,"available":92030967808,"internally_reserved":0,"allocated":2620375040,"data_stored":2619031791,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":29207047,"internal_metadata":1956206073},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":17,"apply_latency_ms":17,"commit_latency_ns":17000000,"apply_latency_ns":17000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 6 02:40:16 2023","interfaces":[{"interface":"back","average":{"1min":2.0750000000000002,"5min":1.0489999999999999,"15min":1.1559999999999999},"min":{"1min":0.245,"5min":0.245,"15min":0.23100000000000001},"max":{"1min":17.847999999999999,"5min":17.847999999999999,"15min":17.847999999999999},"last":0.64100000000000001},{"interface":"front","average":{"1min":3.0670000000000002,"5min":1.6060000000000001,"15min":1.704},"min":{"1min":0.27900000000000003,"5min":0.27900000000000003,"15min":0.26200000000000001},"max":{"1min":32.529000000000003,"5min":32.529000000000003,"15min":32.529000000000003},"last":0.53500000000000003}]},{"osd":1,"last update":"Thu Jul 6 02:40:16 2023","interfaces":[{"interface":"back","average":{"1min":3.2639999999999998,"5min":1.661,"15min":1.9530000000000001},"min":{"1min":0.39800000000000002,"5min":0.26900000000000002,"15min":0.26400000000000001},"max":{"1min":11.667,"5min":11.667,"15min":26.927},"last":0.65500000000000003},{"interface":"front","average":{"1min":3.3290000000000002,"5min":1.7390000000000001,"15min":1.944},"min":{"1min":0.308,"5min":0.28000000000000003,"15min":0.27500000000000002},"max":{"1min":12.082000000000001,"5min":12.082000000000001,"15min":26.620999999999999},"last":0.56699999999999995}]},{"osd":2,"last update":"Thu Jul 6 02:39:27 2023","interfaces":[{"interface":"back","average":{"1min":1.4399999999999999,"5min":1.5760000000000001,"15min":1.6619999999999999},"min":{"1min":0.35399999999999998,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":7.8890000000000002,"5min":13.345000000000001,"15min":18.768999999999998},"last":0.55600000000000005},{"interface":"front","average":{"1min":1.8620000000000001,"5min":1.9390000000000001,"15min":2.121},"min":{"1min":0.36599999999999999,"5min":0.35399999999999998,"15min":0.29999999999999999},"max":{"1min":7.5410000000000004,"5min":8.673,"15min":18.701000000000001},"last":0.69699999999999995}]},{"osd":3,"last update":"Thu Jul 6 02:40:16 2023","interfaces":[{"interface":"back","average":{"1min":2.746,"5min":1.984,"15min":2.0379999999999998},"min":{"1min":0.307,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":12.132,"5min":12.132,"15min":12.132},"last":0.51600000000000001},{"interface":"front","average":{"1min":3.4529999999999998,"5min":1.847,"15min":1.9370000000000001},"min":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.34699999999999998},"max":{"1min":18.472000000000001,"5min":18.472000000000001,"15min":18.472000000000001},"last":0.58299999999999996}]},{"osd":5,"last update":"Thu Jul 6 02:40:16 2023","interfaces":[{"interface":"back","average":{"1min":4.6159999999999997,"5min":1.837,"15min":1.6819999999999999},"min":{"1min":0.311,"5min":0.309,"15min":0.27400000000000002},"max":{"1min":46.088000000000001,"5min":46.088000000000001,"15min":46.088000000000001},"last":0.44500000000000001},{"interface":"front","average":{"1min":1.948,"5min":1.2549999999999999,"15min":1.4930000000000001},"min":{"1min":0.26800000000000002,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":21.468,"5min":21.468,"15min":21.468},"last":0.625}]},{"osd":6,"last update":"Thu Jul 6 02:40:16 2023","interfaces":[{"interface":"back","average":{"1min":2.4620000000000002,"5min":1.3009999999999999,"15min":1.274},"min":{"1min":0.30099999999999999,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":18.498000000000001,"5min":18.498000000000001,"15min":18.498000000000001},"last":0.48799999999999999},{"interface":"front","average":{"1min":1.8640000000000001,"5min":1.415,"15min":1.726},"min":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.35099999999999998},"max":{"1min":8.2309999999999999,"5min":8.2309999999999999,"15min":15.339},"last":0.60199999999999998}]},{"osd":7,"last update":"Thu Jul 6 02:40:16 2023","interfaces":[{"interface":"back","average":{"1min":9.0920000000000005,"5min":2.8130000000000002,"15min":2.0579999999999998},"min":{"1min":0.39400000000000002,"5min":0.37,"15min":0.36899999999999999},"max":{"1min":170.637,"5min":170.637,"15min":170.637},"last":0.68100000000000005},{"interface":"front","average":{"1min":9.891,"5min":2.907,"15min":1.903},"min":{"1min":0.375,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":170.33199999999999,"5min":170.33199999999999,"15min":170.33199999999999},"last":0.67200000000000004}]}]},{"osd":5,"up_from":13,"seq":55834580408,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":4015340,"kb_used_data":2520488,"kb_used_omap":19336,"kb_used_meta":1376695,"kb_avail":90356500,"statfs":{"total":96636764160,"available":92525056000,"internally_reserved":0,"allocated":2580979712,"data_stored":2579685704,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":19800821,"internal_metadata":1409735947},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":30,"apply_latency_ms":30,"commit_latency_ns":30000000,"apply_latency_ns":30000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 6 02:39:44 2023","interfaces":[{"interface":"back","average":{"1min":1.3859999999999999,"5min":1.1319999999999999,"15min":1.159},"min":{"1min":0.27000000000000002,"5min":0.23100000000000001,"15min":0.23100000000000001},"max":{"1min":4.9189999999999996,"5min":6.5110000000000001,"15min":10.669},"last":1.131},{"interface":"front","average":{"1min":2.4700000000000002,"5min":1.6679999999999999,"15min":1.5960000000000001},"min":{"1min":0.309,"5min":0.28100000000000003,"15min":0.26900000000000002},"max":{"1min":10.452999999999999,"5min":10.452999999999999,"15min":10.452999999999999},"last":2.0579999999999998}]},{"osd":1,"last update":"Thu Jul 6 02:39:44 2023","interfaces":[{"interface":"back","average":{"1min":2.0499999999999998,"5min":1.4830000000000001,"15min":1.5609999999999999},"min":{"1min":0.29699999999999999,"5min":0.28000000000000003,"15min":0.27600000000000002},"max":{"1min":8.3719999999999999,"5min":8.3719999999999999,"15min":8.3719999999999999},"last":1.9770000000000001},{"interface":"front","average":{"1min":2.2210000000000001,"5min":1.8799999999999999,"15min":1.671},"min":{"1min":0.36499999999999999,"5min":0.27600000000000002,"15min":0.26000000000000001},"max":{"1min":7.827,"5min":8.1120000000000001,"15min":10.724},"last":2.0099999999999998}]},{"osd":2,"last update":"Thu Jul 6 02:39:44 2023","interfaces":[{"interface":"back","average":{"1min":2.133,"5min":1.929,"15min":1.901},"min":{"1min":0.32900000000000001,"5min":0.31900000000000001,"15min":0.28799999999999998},"max":{"1min":6.1420000000000003,"5min":9.5739999999999998,"15min":9.5739999999999998},"last":1.647},{"interface":"front","average":{"1min":2.0089999999999999,"5min":1.843,"15min":1.915},"min":{"1min":0.33600000000000002,"5min":0.33600000000000002,"15min":0.29199999999999998},"max":{"1min":4.7720000000000002,"5min":7.4039999999999999,"15min":10.209},"last":2.2599999999999998}]},{"osd":3,"last update":"Thu Jul 6 02:39:44 2023","interfaces":[{"interface":"back","average":{"1min":2.2120000000000002,"5min":1.8740000000000001,"15min":1.944},"min":{"1min":0.39400000000000002,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":7.5860000000000003,"5min":7.5860000000000003,"15min":11.222},"last":0.97099999999999997},{"interface":"front","average":{"1min":1.925,"5min":2.0299999999999998,"15min":2.0289999999999999},"min":{"1min":0.36699999999999999,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":7.0499999999999998,"5min":7.0499999999999998,"15min":9.9700000000000006},"last":1.5569999999999999}]},{"osd":4,"last update":"Thu Jul 6 02:39:44 2023","interfaces":[{"interface":"back","average":{"1min":0.88900000000000001,"5min":1.165,"15min":1.298},"min":{"1min":0.33300000000000002,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":3.02,"5min":10.948,"15min":13.590999999999999},"last":1.056},{"interface":"front","average":{"1min":1.155,"5min":1.3220000000000001,"15min":1.5860000000000001},"min":{"1min":0.38300000000000001,"5min":0.30399999999999999,"15min":0.28599999999999998},"max":{"1min":3.4750000000000001,"5min":6.7130000000000001,"15min":9.4410000000000007},"last":0.76300000000000001}]},{"osd":6,"last update":"Thu Jul 6 02:39:44 2023","interfaces":[{"interface":"back","average":{"1min":0.95899999999999996,"5min":1.3149999999999999,"15min":1.4570000000000001},"min":{"1min":0.33700000000000002,"5min":0.33500000000000002,"15min":0.316},"max":{"1min":2.8180000000000001,"5min":6.1539999999999999,"15min":15.113},"last":0.74299999999999999},{"interface":"front","average":{"1min":1.2370000000000001,"5min":1.2989999999999999,"15min":1.5249999999999999},"min":{"1min":0.41799999999999998,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":4.0620000000000003,"5min":10.906000000000001,"15min":11.699},"last":1.103}]},{"osd":7,"last update":"Thu Jul 6 02:39:44 2023","interfaces":[{"interface":"back","average":{"1min":1.1160000000000001,"5min":1.49,"15min":1.7529999999999999},"min":{"1min":0.41199999999999998,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":3.6659999999999999,"5min":8.8499999999999996,"15min":11.294},"last":0.88500000000000001},{"interface":"front","average":{"1min":1.274,"5min":1.393,"15min":1.621},"min":{"1min":0.40600000000000003,"5min":0.36199999999999999,"15min":0.35399999999999998},"max":{"1min":3.8999999999999999,"5min":6.351,"15min":15.173},"last":0.79800000000000004}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-07-06T02:40:22.661 INFO:tasks.ceph.ceph_manager.ceph:clean! 2023-07-06T02:40:22.661 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-07-06T02:40:22.797 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:22.794+0000 7fa73f4d9700 1 Processor -- start 2023-07-06T02:40:22.798 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:22.795+0000 7fa73f4d9700 1 -- start start 2023-07-06T02:40:22.800 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:22.795+0000 7fa73f4d9700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fa7380c46d0 0x7fa7380cccf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T02:40:22.801 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:22.795+0000 7fa73f4d9700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fa7380ce5a0 0x7fa73806de20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T02:40:22.801 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:22.795+0000 7fa73f4d9700 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa73806d990 con 0x7fa738158920 2023-07-06T02:40:22.801 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:22.795+0000 7fa73f4d9700 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa73806e360 con 0x7fa7380ce5a0 2023-07-06T02:40:22.801 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:22.795+0000 7fa73f4d9700 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa73806d360 con 0x7fa7380c46d0 2023-07-06T02:40:22.802 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:22.796+0000 7fa73d275700 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7fa738158920 0x7fa7380c3fc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:45336/0 (socket says 172.21.15.46:45336) 2023-07-06T02:40:22.802 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:22.796+0000 7fa73d275700 1 -- 172.21.15.46:0/3815639171 learned_addr learned my addr 172.21.15.46:0/3815639171 (peer_addr_for_me v1:172.21.15.46:0/0) 2023-07-06T02:40:22.802 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:22.796+0000 7fa73da76700 1 --2- 172.21.15.46:0/3815639171 >> v2:172.21.15.46:3300/0 conn(0x7fa7380ce5a0 0x7fa73806de20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T02:40:22.802 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:22.796+0000 7fa73ca74700 1 --2- 172.21.15.46:0/3815639171 >> v2:172.21.15.73:3300/0 conn(0x7fa7380c46d0 0x7fa7380cccf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T02:40:22.803 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:22.796+0000 7fa73da76700 1 -- 172.21.15.46:0/3815639171 >> v2:172.21.15.73:3300/0 conn(0x7fa7380c46d0 msgr2=0x7fa7380cccf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T02:40:22.803 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:22.796+0000 7fa73da76700 1 --2- 172.21.15.46:0/3815639171 >> v2:172.21.15.73:3300/0 conn(0x7fa7380c46d0 0x7fa7380cccf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T02:40:22.803 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:22.796+0000 7fa73da76700 1 -- 172.21.15.46:0/3815639171 >> v1:172.21.15.46:6789/0 conn(0x7fa738158920 legacy=0x7fa7380c3fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T02:40:22.804 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:22.796+0000 7fa73da76700 1 -- 172.21.15.46:0/3815639171 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa738158cf0 con 0x7fa7380ce5a0 2023-07-06T02:40:22.804 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:22.796+0000 7fa737fff700 1 -- 172.21.15.46:0/3815639171 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1869764751 0 0) 0x7fa73806d990 con 0x7fa738158920 2023-07-06T02:40:22.804 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:22.796+0000 7fa73da76700 1 --2- 172.21.15.46:0/3815639171 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa7380ce5a0 0x7fa73806de20 secure :-1 s=READY pgs=3243 cs=0 l=1 rev1=1 crypto rx=0x7fa73806fd10 tx=0x7fa730009b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b6435fd12985f78 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T02:40:22.804 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:22.796+0000 7fa737fff700 1 -- 172.21.15.46:0/3815639171 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa730011830 con 0x7fa7380ce5a0 2023-07-06T02:40:22.805 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:22.796+0000 7fa737fff700 1 -- 172.21.15.46:0/3815639171 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa730011990 con 0x7fa7380ce5a0 2023-07-06T02:40:22.805 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:22.797+0000 7fa737fff700 1 -- 172.21.15.46:0/3815639171 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa730011d20 con 0x7fa7380ce5a0 2023-07-06T02:40:22.805 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:22.797+0000 7fa73f4d9700 1 -- 172.21.15.46:0/3815639171 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa7380ce5a0 msgr2=0x7fa73806de20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T02:40:22.805 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:22.797+0000 7fa73f4d9700 1 --2- 172.21.15.46:0/3815639171 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa7380ce5a0 0x7fa73806de20 secure :-1 s=READY pgs=3243 cs=0 l=1 rev1=1 crypto rx=0x7fa73806fd10 tx=0x7fa730009b20 comp rx=0 tx=0).stop 2023-07-06T02:40:22.806 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:22.797+0000 7fa73f4d9700 1 -- 172.21.15.46:0/3815639171 shutdown_connections 2023-07-06T02:40:22.806 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:22.797+0000 7fa73f4d9700 1 --2- 172.21.15.46:0/3815639171 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa7380ce5a0 0x7fa73806de20 unknown :-1 s=CLOSED pgs=3243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T02:40:22.806 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:22.797+0000 7fa73f4d9700 1 --2- 172.21.15.46:0/3815639171 >> v2:172.21.15.73:3300/0 conn(0x7fa7380c46d0 0x7fa7380cccf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T02:40:22.806 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:22.797+0000 7fa73f4d9700 1 -- 172.21.15.46:0/3815639171 >> 172.21.15.46:0/3815639171 conn(0x7fa7380cbba0 msgr2=0x7fa7380cbf70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T02:40:22.807 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:22.797+0000 7fa73f4d9700 1 -- 172.21.15.46:0/3815639171 shutdown_connections 2023-07-06T02:40:22.807 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:22.797+0000 7fa73f4d9700 1 -- 172.21.15.46:0/3815639171 wait complete. 2023-07-06T02:40:22.810 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:22.798+0000 7fa73f4d9700 1 Processor -- start 2023-07-06T02:40:22.811 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:22.799+0000 7fa73f4d9700 1 -- start start 2023-07-06T02:40:22.811 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:22.799+0000 7fa73f4d9700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa7380c46d0 0x7fa7380ca4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T02:40:22.811 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:22.799+0000 7fa73f4d9700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fa7380ce5a0 0x7fa73814ca10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T02:40:22.811 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:22.799+0000 7fa73f4d9700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa738158920 0x7fa7380acb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T02:40:22.812 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:22.799+0000 7fa73f4d9700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa73814cf50 con 0x7fa7380c46d0 2023-07-06T02:40:22.812 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:22.799+0000 7fa73f4d9700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa73814dd70 con 0x7fa738158920 2023-07-06T02:40:22.812 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:22.799+0000 7fa73f4d9700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa73806fe10 con 0x7fa7380ce5a0 2023-07-06T02:40:22.813 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:22.799+0000 7fa73d275700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa7380c46d0 0x7fa7380ca4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T02:40:22.813 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:22.799+0000 7fa73d275700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa7380c46d0 0x7fa7380ca4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:46070/0 (socket says 172.21.15.46:46070) 2023-07-06T02:40:22.813 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:22.800+0000 7fa73d275700 1 -- 172.21.15.46:0/2933374390 learned_addr learned my addr 172.21.15.46:0/2933374390 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-07-06T02:40:22.813 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:22.800+0000 7fa73ca74700 1 --2- 172.21.15.46:0/2933374390 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fa7380ce5a0 0x7fa73814ca10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T02:40:22.813 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:22.800+0000 7fa73da76700 1 --2- 172.21.15.46:0/2933374390 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa738158920 0x7fa7380acb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T02:40:22.814 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:22.800+0000 7fa73d275700 1 -- 172.21.15.46:0/2933374390 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fa7380ce5a0 msgr2=0x7fa73814ca10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T02:40:22.814 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:22.800+0000 7fa73d275700 1 --2- 172.21.15.46:0/2933374390 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fa7380ce5a0 0x7fa73814ca10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T02:40:22.814 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:22.800+0000 7fa73d275700 1 -- 172.21.15.46:0/2933374390 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa738158920 msgr2=0x7fa7380acb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T02:40:22.814 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:22.800+0000 7fa73d275700 1 --2- 172.21.15.46:0/2933374390 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa738158920 0x7fa7380acb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T02:40:22.814 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:22.800+0000 7fa73d275700 1 -- 172.21.15.46:0/2933374390 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa7300094a0 con 0x7fa7380c46d0 2023-07-06T02:40:22.815 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:22.800+0000 7fa73ca74700 1 --2- 172.21.15.46:0/2933374390 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fa7380ce5a0 0x7fa73814ca10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-06T02:40:22.815 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:22.800+0000 7fa73d275700 1 --2- 172.21.15.46:0/2933374390 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa7380c46d0 0x7fa7380ca4f0 secure :-1 s=READY pgs=3244 cs=0 l=1 rev1=1 crypto rx=0x7fa72800cc50 tx=0x7fa72800a340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T02:40:22.815 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:22.800+0000 7fa735ffb700 1 -- 172.21.15.46:0/2933374390 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa72800ada0 con 0x7fa7380c46d0 2023-07-06T02:40:22.815 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:22.800+0000 7fa735ffb700 1 -- 172.21.15.46:0/2933374390 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa72800ce50 con 0x7fa7380c46d0 2023-07-06T02:40:22.815 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:22.800+0000 7fa73f4d9700 1 -- 172.21.15.46:0/2933374390 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa73814d160 con 0x7fa7380c46d0 2023-07-06T02:40:22.816 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:22.800+0000 7fa735ffb700 1 -- 172.21.15.46:0/2933374390 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa728007310 con 0x7fa7380c46d0 2023-07-06T02:40:22.816 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:22.800+0000 7fa73f4d9700 1 -- 172.21.15.46:0/2933374390 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa73814d720 con 0x7fa7380c46d0 2023-07-06T02:40:22.816 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:22.801+0000 7fa73f4d9700 1 -- 172.21.15.46:0/2933374390 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa7380672e0 con 0x7fa7380c46d0 2023-07-06T02:40:22.816 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:22.802+0000 7fa735ffb700 1 -- 172.21.15.46:0/2933374390 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fa728007470 con 0x7fa7380c46d0 2023-07-06T02:40:22.816 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:22.802+0000 7fa735ffb700 1 --2- 172.21.15.46:0/2933374390 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7fa72406ace0 0x7fa72406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T02:40:22.817 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:22.802+0000 7fa735ffb700 1 -- 172.21.15.46:0/2933374390 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 5296+0+0 (secure 0 0 0) 0x7fa7280890b0 con 0x7fa7380c46d0 2023-07-06T02:40:22.817 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:22.802+0000 7fa73ca74700 1 --2- 172.21.15.46:0/2933374390 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7fa72406ace0 0x7fa72406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T02:40:22.817 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:22.803+0000 7fa73ca74700 1 --2- 172.21.15.46:0/2933374390 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7fa72406ace0 0x7fa72406d190 secure :-1 s=READY pgs=735 cs=0 l=1 rev1=1 crypto rx=0x7fa7380c9660 tx=0x7fa72c008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T02:40:22.817 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:22.807+0000 7fa735ffb700 1 -- 172.21.15.46:0/2933374390 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fa728054460 con 0x7fa7380c46d0 2023-07-06T02:40:23.013 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:23.011+0000 7fa73f4d9700 1 -- 172.21.15.46:0/2933374390 --> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fa7380cee20 con 0x7fa72406ace0 2023-07-06T02:40:23.017 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:23.014+0000 7fa735ffb700 1 -- 172.21.15.46:0/2933374390 <== mgr.4099 v2:172.21.15.73:6832/3033361733 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+71633 (secure 0 0 0) 0x7fa72c009610 con 0x7fa72406ace0 2023-07-06T02:40:23.018 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-06T02:40:23.020 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:23.016+0000 7fa73f4d9700 1 -- 172.21.15.46:0/2933374390 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7fa72406ace0 msgr2=0x7fa72406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T02:40:23.020 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:23.016+0000 7fa73f4d9700 1 --2- 172.21.15.46:0/2933374390 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7fa72406ace0 0x7fa72406d190 secure :-1 s=READY pgs=735 cs=0 l=1 rev1=1 crypto rx=0x7fa7380c9660 tx=0x7fa72c008040 comp rx=0 tx=0).stop 2023-07-06T02:40:23.020 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:23.016+0000 7fa73f4d9700 1 -- 172.21.15.46:0/2933374390 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa7380c46d0 msgr2=0x7fa7380ca4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T02:40:23.020 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:23.016+0000 7fa73f4d9700 1 --2- 172.21.15.46:0/2933374390 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa7380c46d0 0x7fa7380ca4f0 secure :-1 s=READY pgs=3244 cs=0 l=1 rev1=1 crypto rx=0x7fa72800cc50 tx=0x7fa72800a340 comp rx=0 tx=0).stop 2023-07-06T02:40:23.021 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:23.017+0000 7fa73f4d9700 1 -- 172.21.15.46:0/2933374390 shutdown_connections 2023-07-06T02:40:23.021 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:23.017+0000 7fa73f4d9700 1 --2- 172.21.15.46:0/2933374390 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7fa72406ace0 0x7fa72406d190 unknown :-1 s=CLOSED pgs=735 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T02:40:23.021 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:23.017+0000 7fa73f4d9700 1 --2- 172.21.15.46:0/2933374390 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa738158920 0x7fa7380acb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T02:40:23.021 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:23.017+0000 7fa73f4d9700 1 --2- 172.21.15.46:0/2933374390 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa7380c46d0 0x7fa7380ca4f0 unknown :-1 s=CLOSED pgs=3244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T02:40:23.021 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:23.017+0000 7fa73f4d9700 1 --2- 172.21.15.46:0/2933374390 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fa7380ce5a0 0x7fa73814ca10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T02:40:23.022 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:23.017+0000 7fa73f4d9700 1 -- 172.21.15.46:0/2933374390 >> 172.21.15.46:0/2933374390 conn(0x7fa7380cbba0 msgr2=0x7fa738065b90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T02:40:23.022 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:23.017+0000 7fa73f4d9700 1 -- 172.21.15.46:0/2933374390 shutdown_connections 2023-07-06T02:40:23.022 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:23.017+0000 7fa73f4d9700 1 -- 172.21.15.46:0/2933374390 wait complete. 2023-07-06T02:40:23.022 INFO:teuthology.orchestra.run.smithi046.stderr:dumped all 2023-07-06T02:40:23.033 INFO:teuthology.orchestra.run.smithi046.stdout:{"pg_ready":true,"pg_map":{"version":13954,"stamp":"2023-07-06T02:40:22.069116+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":146,"num_read_kb":127,"num_write":209,"num_write_kb":3462,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":161,"ondisk_log_size":161,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":189,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":38477476,"kb_used_data":26364196,"kb_used_omap":135394,"kb_used_meta":11712605,"kb_avail":716497244,"statfs":{"total":773094113280,"available":733693177856,"internally_reserved":0,"allocated":26996936704,"data_stored":26983849628,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":138643486,"internal_metadata":11993708514},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":264,"apply_latency_ms":264,"commit_latency_ns":264000000,"apply_latency_ns":264000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-62798561459,"num_objects":-45638,"num_object_clones":0,"num_object_copies":-91276,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-45638,"num_whiteouts":0,"num_read":-1619613,"num_read_kb":-364489914,"num_write":-3226784,"num_write_kb":-626104872,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-3691,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.001881"},"pg_stats":[{"pgid":"1.5","version":"0'0","reported_seq":274,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-07-06T02:40:17.475260+0000","last_change":"2023-07-05T18:56:09.622184+0000","last_active":"2023-07-06T02:40:17.475260+0000","last_peered":"2023-07-06T02:40:17.475260+0000","last_clean":"2023-07-06T02:40:17.475260+0000","last_became_active":"2023-07-05T18:56:09.621796+0000","last_became_peered":"2023-07-05T18:56:09.621796+0000","last_unstale":"2023-07-06T02:40:17.475260+0000","last_undegraded":"2023-07-06T02:40:17.475260+0000","last_fullsized":"2023-07-06T02:40:17.475260+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T18:56:08.603137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T18:56:08.603137+0000","last_clean_scrub_stamp":"2023-07-05T18:56:08.603137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-06T19:36:39.040166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":278,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-07-06T02:40:17.476927+0000","last_change":"2023-07-05T18:56:09.621596+0000","last_active":"2023-07-06T02:40:17.476927+0000","last_peered":"2023-07-06T02:40:17.476927+0000","last_clean":"2023-07-06T02:40:17.476927+0000","last_became_active":"2023-07-05T18:56:09.621315+0000","last_became_peered":"2023-07-05T18:56:09.621315+0000","last_unstale":"2023-07-06T02:40:17.476927+0000","last_undegraded":"2023-07-06T02:40:17.476927+0000","last_fullsized":"2023-07-06T02:40:17.476927+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T18:56:08.603137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T18:56:08.603137+0000","last_clean_scrub_stamp":"2023-07-05T18:56:08.603137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-06T21:41:31.701702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":273,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-07-06T02:40:17.497921+0000","last_change":"2023-07-05T18:56:09.617992+0000","last_active":"2023-07-06T02:40:17.497921+0000","last_peered":"2023-07-06T02:40:17.497921+0000","last_clean":"2023-07-06T02:40:17.497921+0000","last_became_active":"2023-07-05T18:56:09.617720+0000","last_became_peered":"2023-07-05T18:56:09.617720+0000","last_unstale":"2023-07-06T02:40:17.497921+0000","last_undegraded":"2023-07-06T02:40:17.497921+0000","last_fullsized":"2023-07-06T02:40:17.497921+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T18:56:08.603137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T18:56:08.603137+0000","last_clean_scrub_stamp":"2023-07-05T18:56:08.603137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-06T20:37:16.107143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"37'161","reported_seq":484,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-07-06T02:40:18.420953+0000","last_change":"2023-07-05T18:56:09.621746+0000","last_active":"2023-07-06T02:40:18.420953+0000","last_peered":"2023-07-06T02:40:18.420953+0000","last_clean":"2023-07-06T02:40:18.420953+0000","last_became_active":"2023-07-05T18:56:09.621421+0000","last_became_peered":"2023-07-05T18:56:09.621421+0000","last_unstale":"2023-07-06T02:40:18.420953+0000","last_undegraded":"2023-07-06T02:40:18.420953+0000","last_fullsized":"2023-07-06T02:40:18.420953+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T18:56:08.603137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T18:56:08.603137+0000","last_clean_scrub_stamp":"2023-07-05T18:56:08.603137+0000","objects_scrubbed":0,"log_size":161,"log_dups_size":0,"ondisk_log_size":161,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-06T22:19:16.877769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":146,"num_read_kb":127,"num_write":209,"num_write_kb":3462,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":273,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-07-06T02:40:18.421439+0000","last_change":"2023-07-05T18:56:10.073940+0000","last_active":"2023-07-06T02:40:18.421439+0000","last_peered":"2023-07-06T02:40:18.421439+0000","last_clean":"2023-07-06T02:40:18.421439+0000","last_became_active":"2023-07-05T18:56:10.073617+0000","last_became_peered":"2023-07-05T18:56:10.073617+0000","last_unstale":"2023-07-06T02:40:18.421439+0000","last_undegraded":"2023-07-06T02:40:18.421439+0000","last_fullsized":"2023-07-06T02:40:18.421439+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T18:56:08.603137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T18:56:08.603137+0000","last_clean_scrub_stamp":"2023-07-05T18:56:08.603137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-06T22:12:49.944261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":281,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-07-06T02:40:18.420814+0000","last_change":"2023-07-05T18:56:10.073658+0000","last_active":"2023-07-06T02:40:18.420814+0000","last_peered":"2023-07-06T02:40:18.420814+0000","last_clean":"2023-07-06T02:40:18.420814+0000","last_became_active":"2023-07-05T18:56:10.073336+0000","last_became_peered":"2023-07-05T18:56:10.073336+0000","last_unstale":"2023-07-06T02:40:18.420814+0000","last_undegraded":"2023-07-06T02:40:18.420814+0000","last_fullsized":"2023-07-06T02:40:18.420814+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T18:56:08.603137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T18:56:08.603137+0000","last_clean_scrub_stamp":"2023-07-05T18:56:08.603137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-06T23:56:59.615696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":274,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-07-06T02:40:17.980312+0000","last_change":"2023-07-05T18:56:10.073693+0000","last_active":"2023-07-06T02:40:17.980312+0000","last_peered":"2023-07-06T02:40:17.980312+0000","last_clean":"2023-07-06T02:40:17.980312+0000","last_became_active":"2023-07-05T18:56:10.073356+0000","last_became_peered":"2023-07-05T18:56:10.073356+0000","last_unstale":"2023-07-06T02:40:17.980312+0000","last_undegraded":"2023-07-06T02:40:17.980312+0000","last_fullsized":"2023-07-06T02:40:17.980312+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T18:56:08.603137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T18:56:08.603137+0000","last_clean_scrub_stamp":"2023-07-05T18:56:08.603137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-06T21:29:04.979258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":267,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-07-06T02:40:17.919071+0000","last_change":"2023-07-05T18:56:10.073639+0000","last_active":"2023-07-06T02:40:17.919071+0000","last_peered":"2023-07-06T02:40:17.919071+0000","last_clean":"2023-07-06T02:40:17.919071+0000","last_became_active":"2023-07-05T18:56:10.073339+0000","last_became_peered":"2023-07-05T18:56:10.073339+0000","last_unstale":"2023-07-06T02:40:17.919071+0000","last_undegraded":"2023-07-06T02:40:17.919071+0000","last_fullsized":"2023-07-06T02:40:17.919071+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T18:56:08.603137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T18:56:08.603137+0000","last_clean_scrub_stamp":"2023-07-05T18:56:08.603137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-06T23:08:47.739749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":267,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-07-06T02:40:17.919390+0000","last_change":"2023-07-05T18:56:09.619299+0000","last_active":"2023-07-06T02:40:17.919390+0000","last_peered":"2023-07-06T02:40:17.919390+0000","last_clean":"2023-07-06T02:40:17.919390+0000","last_became_active":"2023-07-05T18:56:09.618958+0000","last_became_peered":"2023-07-05T18:56:09.618958+0000","last_unstale":"2023-07-06T02:40:17.919390+0000","last_undegraded":"2023-07-06T02:40:17.919390+0000","last_fullsized":"2023-07-06T02:40:17.919390+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T18:56:08.603137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T18:56:08.603137+0000","last_clean_scrub_stamp":"2023-07-05T18:56:08.603137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-06T23:58:42.021659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":8},{"poolid":2,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":146,"num_read_kb":127,"num_write":209,"num_write_kb":3462,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":161,"ondisk_log_size":161,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834580411,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":5673296,"kb_used_data":3774448,"kb_used_omap":14013,"kb_used_meta":1876034,"kb_avail":88698544,"statfs":{"total":96636764160,"available":90827309056,"internally_reserved":0,"allocated":3865034752,"data_stored":3863186783,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":14349832,"internal_metadata":1921059320},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":31,"apply_latency_ms":31,"commit_latency_ns":31000000,"apply_latency_ns":31000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 6 02:40:11 2023","interfaces":[{"interface":"back","average":{"1min":6.3979999999999997,"5min":1.9890000000000001,"15min":1.554},"min":{"1min":0.24199999999999999,"5min":0.24199999999999999,"15min":0.24099999999999999},"max":{"1min":71.978999999999999,"5min":71.978999999999999,"15min":71.978999999999999},"last":0.42799999999999999},{"interface":"front","average":{"1min":4.657,"5min":2.1640000000000001,"15min":1.8440000000000001},"min":{"1min":0.25800000000000001,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":23.382000000000001,"5min":23.382000000000001,"15min":23.382000000000001},"last":0.45400000000000001}]},{"osd":1,"last update":"Thu Jul 6 02:40:11 2023","interfaces":[{"interface":"back","average":{"1min":7.2990000000000004,"5min":2.3500000000000001,"15min":1.829},"min":{"1min":0.27200000000000002,"5min":0.27200000000000002,"15min":0.25},"max":{"1min":71.951999999999998,"5min":71.951999999999998,"15min":71.951999999999998},"last":0.64000000000000001},{"interface":"front","average":{"1min":4.25,"5min":2.3250000000000002,"15min":2.0640000000000001},"min":{"1min":0.26100000000000001,"5min":0.26100000000000001,"15min":0.25900000000000001},"max":{"1min":23.489999999999998,"5min":23.489999999999998,"15min":23.489999999999998},"last":0.59499999999999997}]},{"osd":2,"last update":"Thu Jul 6 02:40:11 2023","interfaces":[{"interface":"back","average":{"1min":4.9379999999999997,"5min":2.2160000000000002,"15min":1.7969999999999999},"min":{"1min":0.33500000000000002,"5min":0.29899999999999999,"15min":0.29299999999999998},"max":{"1min":35.311999999999998,"5min":35.311999999999998,"15min":35.311999999999998},"last":0.62},{"interface":"front","average":{"1min":6.2610000000000001,"5min":2.5649999999999999,"15min":2.0960000000000001},"min":{"1min":0.308,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":66.536000000000001,"5min":66.536000000000001,"15min":66.536000000000001},"last":0.46800000000000003}]},{"osd":3,"last update":"Thu Jul 6 02:40:11 2023","interfaces":[{"interface":"back","average":{"1min":3.327,"5min":1.9690000000000001,"15min":1.8129999999999999},"min":{"1min":0.33200000000000002,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":25.637,"5min":25.637,"15min":25.637},"last":0.54400000000000004},{"interface":"front","average":{"1min":5.9050000000000002,"5min":2.617,"15min":2.2370000000000001},"min":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":71.905000000000001,"5min":71.905000000000001,"15min":71.905000000000001},"last":0.66700000000000004}]},{"osd":4,"last update":"Thu Jul 6 02:40:11 2023","interfaces":[{"interface":"back","average":{"1min":7.0339999999999998,"5min":2.3719999999999999,"15min":1.871},"min":{"1min":0.27700000000000002,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":52.734999999999999,"5min":52.734999999999999,"15min":52.734999999999999},"last":0.51100000000000001},{"interface":"front","average":{"1min":2.7069999999999999,"5min":1.359,"15min":1.2829999999999999},"min":{"1min":0.33500000000000002,"5min":0.32000000000000001,"15min":0.311},"max":{"1min":35.372,"5min":35.372,"15min":35.372},"last":0.58399999999999996}]},{"osd":5,"last update":"Thu Jul 6 02:40:11 2023","interfaces":[{"interface":"back","average":{"1min":5.3689999999999998,"5min":2.1030000000000002,"15min":1.788},"min":{"1min":0.29299999999999998,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":73.492999999999995,"5min":73.492999999999995,"15min":73.492999999999995},"last":0.60499999999999998},{"interface":"front","average":{"1min":2.839,"5min":1.847,"15min":1.754},"min":{"1min":0.34799999999999998,"5min":0.33800000000000002,"15min":0.30499999999999999},"max":{"1min":14.983000000000001,"5min":14.983000000000001,"15min":25.689},"last":0.56200000000000006}]},{"osd":6,"last update":"Thu Jul 6 02:40:11 2023","interfaces":[{"interface":"back","average":{"1min":3.9630000000000001,"5min":2.0470000000000002,"15min":1.986},"min":{"1min":0.34200000000000003,"5min":0.309,"15min":0.309},"max":{"1min":21.321000000000002,"5min":21.321000000000002,"15min":21.321000000000002},"last":0.628},{"interface":"front","average":{"1min":1.5349999999999999,"5min":1.4219999999999999,"15min":1.3460000000000001},"min":{"1min":0.376,"5min":0.376,"15min":0.373},"max":{"1min":11.273999999999999,"5min":11.273999999999999,"15min":12.099},"last":0.64900000000000002}]}]},{"osd":6,"up_from":13,"seq":55834580418,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":5593024,"kb_used_data":4906924,"kb_used_omap":14943,"kb_used_meta":658080,"kb_avail":88778816,"statfs":{"total":96636764160,"available":90909507584,"internally_reserved":0,"allocated":5024690176,"data_stored":5022424629,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":15302320,"internal_metadata":673874256},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":25,"apply_latency_ms":25,"commit_latency_ns":25000000,"apply_latency_ns":25000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 6 02:39:25 2023","interfaces":[{"interface":"back","average":{"1min":1.333,"5min":1.1419999999999999,"15min":0.999},"min":{"1min":0.29399999999999998,"5min":0.24199999999999999,"15min":0.22900000000000001},"max":{"1min":12.007,"5min":12.007,"15min":12.007},"last":0.621},{"interface":"front","average":{"1min":1.127,"5min":1.4590000000000001,"15min":1.512},"min":{"1min":0.27000000000000002,"5min":0.27000000000000002,"15min":0.26400000000000001},"max":{"1min":4.7229999999999999,"5min":8.2699999999999996,"15min":14.146000000000001},"last":1.224}]},{"osd":1,"last update":"Thu Jul 6 02:39:25 2023","interfaces":[{"interface":"back","average":{"1min":2.5179999999999998,"5min":1.738,"15min":1.796},"min":{"1min":0.25800000000000001,"5min":0.25800000000000001,"15min":0.25600000000000001},"max":{"1min":11.182,"5min":11.182,"15min":15.563000000000001},"last":0.41299999999999998},{"interface":"front","average":{"1min":4.2599999999999998,"5min":2.464,"15min":2.0059999999999998},"min":{"1min":0.307,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":62.668999999999997,"5min":62.668999999999997,"15min":62.668999999999997},"last":1.1759999999999999}]},{"osd":2,"last update":"Thu Jul 6 02:39:25 2023","interfaces":[{"interface":"back","average":{"1min":1.288,"5min":1.341,"15min":1.4259999999999999},"min":{"1min":0.33200000000000002,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":6.7249999999999996,"5min":6.7249999999999996,"15min":6.7249999999999996},"last":1.1240000000000001},{"interface":"front","average":{"1min":3.8999999999999999,"5min":2.298,"15min":2.3260000000000001},"min":{"1min":0.42999999999999999,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":29.617999999999999,"5min":29.617999999999999,"15min":29.617999999999999},"last":0.92600000000000005}]},{"osd":3,"last update":"Thu Jul 6 02:39:25 2023","interfaces":[{"interface":"back","average":{"1min":1.5189999999999999,"5min":1.9379999999999999,"15min":2.0710000000000002},"min":{"1min":0.33700000000000002,"5min":0.312,"15min":0.312},"max":{"1min":8.2560000000000002,"5min":11.526999999999999,"15min":14.084},"last":1.3660000000000001},{"interface":"front","average":{"1min":1.448,"5min":1.5,"15min":1.7310000000000001},"min":{"1min":0.39500000000000002,"5min":0.35199999999999998,"15min":0.34999999999999998},"max":{"1min":6.3529999999999998,"5min":6.3529999999999998,"15min":7.3040000000000003},"last":1.006}]},{"osd":4,"last update":"Thu Jul 6 02:39:25 2023","interfaces":[{"interface":"back","average":{"1min":2.016,"5min":1.468,"15min":1.645},"min":{"1min":0.29399999999999998,"5min":0.28599999999999998,"15min":0.27100000000000002},"max":{"1min":11.215999999999999,"5min":11.215999999999999,"15min":15.625999999999999},"last":0.78600000000000003},{"interface":"front","average":{"1min":1.2490000000000001,"5min":1.397,"15min":1.5660000000000001},"min":{"1min":0.29899999999999999,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":5.0679999999999996,"5min":8.3689999999999998,"15min":14.519},"last":1.2529999999999999}]},{"osd":5,"last update":"Thu Jul 6 02:39:25 2023","interfaces":[{"interface":"back","average":{"1min":1.0649999999999999,"5min":1.02,"15min":1.101},"min":{"1min":0.376,"5min":0.33900000000000002,"15min":0.315},"max":{"1min":5.508,"5min":6.3399999999999999,"15min":9.0790000000000006},"last":0.97399999999999998},{"interface":"front","average":{"1min":2.3340000000000001,"5min":1.5900000000000001,"15min":1.8069999999999999},"min":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":11.489000000000001,"5min":11.489000000000001,"15min":15.686},"last":0.98699999999999999}]},{"osd":7,"last update":"Thu Jul 6 02:39:25 2023","interfaces":[{"interface":"back","average":{"1min":3.1850000000000001,"5min":1.73,"15min":1.766},"min":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":38.942999999999998,"5min":38.942999999999998,"15min":38.942999999999998},"last":1.145},{"interface":"front","average":{"1min":2.9460000000000002,"5min":1.677,"15min":1.4410000000000001},"min":{"1min":0.41899999999999998,"5min":0.39000000000000001,"15min":0.35199999999999998},"max":{"1min":38.557000000000002,"5min":38.557000000000002,"15min":38.557000000000002},"last":1.0449999999999999}]}]},{"osd":1,"up_from":13,"seq":55834580395,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":5202972,"kb_used_data":3301816,"kb_used_omap":15006,"kb_used_meta":1848737,"kb_avail":89168868,"statfs":{"total":96636764160,"available":91308920832,"internally_reserved":0,"allocated":3381059584,"data_stored":3379442768,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":15366880,"internal_metadata":1893106976},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":35,"apply_latency_ms":35,"commit_latency_ns":35000000,"apply_latency_ns":35000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 6 02:40:11 2023","interfaces":[{"interface":"back","average":{"1min":1.8580000000000001,"5min":1.1719999999999999,"15min":1.0569999999999999},"min":{"1min":0.253,"5min":0.23400000000000001,"15min":0.23100000000000001},"max":{"1min":6.819,"5min":8.2579999999999991,"15min":11.006},"last":0.42499999999999999},{"interface":"front","average":{"1min":2.9079999999999999,"5min":1.796,"15min":1.3859999999999999},"min":{"1min":0.27700000000000002,"5min":0.27700000000000002,"15min":0.27000000000000002},"max":{"1min":15.366,"5min":15.366,"15min":15.366},"last":0.50700000000000001}]},{"osd":2,"last update":"Thu Jul 6 02:40:11 2023","interfaces":[{"interface":"back","average":{"1min":2.569,"5min":1.665,"15min":1.708},"min":{"1min":0.28899999999999998,"5min":0.26700000000000002,"15min":0.255},"max":{"1min":12.045999999999999,"5min":12.045999999999999,"15min":12.045999999999999},"last":0.48499999999999999},{"interface":"front","average":{"1min":2.6320000000000001,"5min":1.55,"15min":1.3480000000000001},"min":{"1min":0.28899999999999998,"5min":0.27700000000000002,"15min":0.25800000000000001},"max":{"1min":14.038,"5min":14.038,"15min":14.038},"last":0.52500000000000002}]},{"osd":3,"last update":"Thu Jul 6 02:40:11 2023","interfaces":[{"interface":"back","average":{"1min":2.4540000000000002,"5min":1.5960000000000001,"15min":1.387},"min":{"1min":0.35199999999999998,"5min":0.30499999999999999,"15min":0.253},"max":{"1min":15.712,"5min":15.712,"15min":15.712},"last":0.628},{"interface":"front","average":{"1min":2.931,"5min":1.8120000000000001,"15min":1.4970000000000001},"min":{"1min":0.432,"5min":0.29499999999999998,"15min":0.27300000000000002},"max":{"1min":15.414,"5min":15.414,"15min":15.414},"last":0.46899999999999997}]},{"osd":4,"last update":"Thu Jul 6 02:40:11 2023","interfaces":[{"interface":"back","average":{"1min":3.0249999999999999,"5min":1.988,"15min":1.6459999999999999},"min":{"1min":0.49199999999999999,"5min":0.38300000000000001,"15min":0.35199999999999998},"max":{"1min":15.442,"5min":15.442,"15min":15.442},"last":0.66000000000000003},{"interface":"front","average":{"1min":2.948,"5min":1.9690000000000001,"15min":1.9930000000000001},"min":{"1min":0.40200000000000002,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":15.279999999999999,"5min":15.279999999999999,"15min":15.279999999999999},"last":0.73099999999999998}]},{"osd":5,"last update":"Thu Jul 6 02:40:11 2023","interfaces":[{"interface":"back","average":{"1min":3.7349999999999999,"5min":2.484,"15min":2.3490000000000002},"min":{"1min":0.39300000000000002,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":22.263000000000002,"5min":22.263000000000002,"15min":22.263000000000002},"last":0.64500000000000002},{"interface":"front","average":{"1min":4.1920000000000002,"5min":2.1070000000000002,"15min":1.7270000000000001},"min":{"1min":0.41199999999999998,"5min":0.38200000000000001,"15min":0.36899999999999999},"max":{"1min":26.181000000000001,"5min":26.181000000000001,"15min":26.181000000000001},"last":0.67100000000000004}]},{"osd":6,"last update":"Thu Jul 6 02:40:11 2023","interfaces":[{"interface":"back","average":{"1min":2.206,"5min":1.8740000000000001,"15min":1.8300000000000001},"min":{"1min":0.52800000000000002,"5min":0.42199999999999999,"15min":0.39300000000000002},"max":{"1min":9.1600000000000001,"5min":9.5429999999999993,"15min":10.359999999999999},"last":0.746},{"interface":"front","average":{"1min":2.6960000000000002,"5min":2.0859999999999999,"15min":2.2839999999999998},"min":{"1min":0.48799999999999999,"5min":0.47399999999999998,"15min":0.439},"max":{"1min":10.478999999999999,"5min":10.478999999999999,"15min":11.101000000000001},"last":0.69799999999999995}]},{"osd":7,"last update":"Thu Jul 6 02:40:11 2023","interfaces":[{"interface":"back","average":{"1min":3.3220000000000001,"5min":2.1339999999999999,"15min":1.887},"min":{"1min":0.50600000000000001,"5min":0.44,"15min":0.44},"max":{"1min":18.707999999999998,"5min":18.707999999999998,"15min":18.707999999999998},"last":0.71999999999999997},{"interface":"front","average":{"1min":2.6869999999999998,"5min":2.282,"15min":2.0760000000000001},"min":{"1min":0.59299999999999997,"5min":0.47099999999999997,"15min":0.41799999999999998},"max":{"1min":11.893000000000001,"5min":11.893000000000001,"15min":11.893000000000001},"last":0.70799999999999996}]}]},{"osd":0,"up_from":13,"seq":55834580387,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":4524576,"kb_used_data":3072824,"kb_used_omap":12735,"kb_used_meta":1388224,"kb_avail":89847264,"statfs":{"total":96636764160,"available":92003598336,"internally_reserved":0,"allocated":3146571776,"data_stored":3144950115,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":13040941,"internal_metadata":1421542099},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":41,"apply_latency_ms":41,"commit_latency_ns":41000000,"apply_latency_ns":41000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jul 6 02:39:17 2023","interfaces":[{"interface":"back","average":{"1min":1.0740000000000001,"5min":1.244,"15min":1.2170000000000001},"min":{"1min":0.25900000000000001,"5min":0.246,"15min":0.23899999999999999},"max":{"1min":5.8579999999999997,"5min":7.1760000000000002,"15min":16.422000000000001},"last":0.437},{"interface":"front","average":{"1min":1.375,"5min":1.3740000000000001,"15min":1.448},"min":{"1min":0.27900000000000003,"5min":0.248,"15min":0.248},"max":{"1min":6.1260000000000003,"5min":7.0309999999999997,"15min":7.6500000000000004},"last":0.32600000000000001}]},{"osd":2,"last update":"Thu Jul 6 02:39:17 2023","interfaces":[{"interface":"back","average":{"1min":0.79800000000000004,"5min":1.3480000000000001,"15min":1.298},"min":{"1min":0.28499999999999998,"5min":0.26200000000000001,"15min":0.252},"max":{"1min":5.516,"5min":10.000999999999999,"15min":10.106},"last":0.378},{"interface":"front","average":{"1min":1.351,"5min":1.45,"15min":1.615},"min":{"1min":0.28799999999999998,"5min":0.245,"15min":0.245},"max":{"1min":6.21,"5min":13.625,"15min":13.625},"last":0.41399999999999998}]},{"osd":3,"last update":"Thu Jul 6 02:39:17 2023","interfaces":[{"interface":"back","average":{"1min":1.5389999999999999,"5min":1.9370000000000001,"15min":2.048},"min":{"1min":0.30499999999999999,"5min":0.29699999999999999,"15min":0.27800000000000002},"max":{"1min":7.6100000000000003,"5min":10.927,"15min":10.927},"last":0.48899999999999999},{"interface":"front","average":{"1min":0.96799999999999997,"5min":1.427,"15min":1.5309999999999999},"min":{"1min":0.40799999999999997,"5min":0.35799999999999998,"15min":0.315},"max":{"1min":5.3040000000000003,"5min":7.2359999999999998,"15min":7.9669999999999996},"last":0.55400000000000005}]},{"osd":4,"last update":"Thu Jul 6 02:39:17 2023","interfaces":[{"interface":"back","average":{"1min":1.3180000000000001,"5min":1.3660000000000001,"15min":1.5049999999999999},"min":{"1min":0.37,"5min":0.34899999999999998,"15min":0.32800000000000001},"max":{"1min":6.0199999999999996,"5min":10.901,"15min":10.977},"last":0.504},{"interface":"front","average":{"1min":1.72,"5min":1.764,"15min":1.9079999999999999},"min":{"1min":0.38800000000000001,"5min":0.34499999999999997,"15min":0.32400000000000001},"max":{"1min":8.6699999999999999,"5min":8.6699999999999999,"15min":11.01},"last":0.52700000000000002}]},{"osd":5,"last update":"Thu Jul 6 02:39:17 2023","interfaces":[{"interface":"back","average":{"1min":1.1910000000000001,"5min":1.4359999999999999,"15min":1.4370000000000001},"min":{"1min":0.498,"5min":0.379,"15min":0.35099999999999998},"max":{"1min":5.266,"5min":7.2779999999999996,"15min":7.8730000000000002},"last":0.51700000000000002},{"interface":"front","average":{"1min":1.9950000000000001,"5min":1.7669999999999999,"15min":1.7410000000000001},"min":{"1min":0.45100000000000001,"5min":0.372,"15min":0.36599999999999999},"max":{"1min":7.9630000000000001,"5min":10.773999999999999,"15min":10.773999999999999},"last":3.343}]},{"osd":6,"last update":"Thu Jul 6 02:39:17 2023","interfaces":[{"interface":"back","average":{"1min":1.7310000000000001,"5min":2.0049999999999999,"15min":2.1230000000000002},"min":{"1min":0.42499999999999999,"5min":0.379,"15min":0.379},"max":{"1min":6.2839999999999998,"5min":8.0679999999999996,"15min":10.191000000000001},"last":2.8889999999999998},{"interface":"front","average":{"1min":1.1850000000000001,"5min":1.3899999999999999,"15min":1.4279999999999999},"min":{"1min":0.52800000000000002,"5min":0.49299999999999999,"15min":0.38500000000000001},"max":{"1min":5.3419999999999996,"5min":7.3150000000000004,"15min":8.5690000000000008},"last":2.9660000000000002}]},{"osd":7,"last update":"Thu Jul 6 02:39:17 2023","interfaces":[{"interface":"back","average":{"1min":2.0190000000000001,"5min":2.1059999999999999,"15min":2.0750000000000002},"min":{"1min":0.51900000000000002,"5min":0.42299999999999999,"15min":0.41399999999999998},"max":{"1min":6.1740000000000004,"5min":14.018000000000001,"15min":14.018000000000001},"last":2.7690000000000001},{"interface":"front","average":{"1min":2.2490000000000001,"5min":2.4300000000000002,"15min":2.3109999999999999},"min":{"1min":0.47499999999999998,"5min":0.45900000000000002,"15min":0.44800000000000001},"max":{"1min":8.3019999999999996,"5min":8.3019999999999996,"15min":10.103999999999999},"last":3.1480000000000001}]}]},{"osd":2,"up_from":13,"seq":55834580382,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":4793832,"kb_used_data":3452648,"kb_used_omap":9607,"kb_used_meta":1300536,"kb_avail":89578008,"statfs":{"total":96636764160,"available":91727880192,"internally_reserved":0,"allocated":3535511552,"data_stored":3533841940,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":9837933,"internal_metadata":1331749523},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":51,"apply_latency_ms":51,"commit_latency_ns":51000000,"apply_latency_ns":51000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 6 02:40:19 2023","interfaces":[{"interface":"back","average":{"1min":5.1559999999999997,"5min":1.796,"15min":1.349},"min":{"1min":0.27200000000000002,"5min":0.22900000000000001,"15min":0.22900000000000001},"max":{"1min":36.674999999999997,"5min":36.674999999999997,"15min":36.674999999999997},"last":7.1970000000000001},{"interface":"front","average":{"1min":16.443000000000001,"5min":4.181,"15min":2.2999999999999998},"min":{"1min":0.27400000000000002,"5min":0.249,"15min":0.249},"max":{"1min":122.961,"5min":122.961,"15min":122.961},"last":7.3529999999999998}]},{"osd":1,"last update":"Thu Jul 6 02:40:19 2023","interfaces":[{"interface":"back","average":{"1min":5.3239999999999998,"5min":1.9450000000000001,"15min":1.504},"min":{"1min":0.30499999999999999,"5min":0.25,"15min":0.25},"max":{"1min":36.643999999999998,"5min":36.643999999999998,"15min":36.643999999999998},"last":8.3230000000000004},{"interface":"front","average":{"1min":5.3170000000000002,"5min":2.347,"15min":1.8460000000000001},"min":{"1min":0.312,"5min":0.28599999999999998,"15min":0.27900000000000003},"max":{"1min":25.643999999999998,"5min":25.643999999999998,"15min":25.643999999999998},"last":8.2140000000000004}]},{"osd":3,"last update":"Thu Jul 6 02:40:19 2023","interfaces":[{"interface":"back","average":{"1min":12.382999999999999,"5min":3.6989999999999998,"15min":2.4569999999999999},"min":{"1min":0.47199999999999998,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":101.968,"5min":101.968,"15min":101.968},"last":9.9879999999999995},{"interface":"front","average":{"1min":5.077,"5min":2.0960000000000001,"15min":1.6599999999999999},"min":{"1min":0.46899999999999997,"5min":0.31,"15min":0.31},"max":{"1min":36.701000000000001,"5min":36.701000000000001,"15min":36.701000000000001},"last":22.135999999999999}]},{"osd":4,"last update":"Thu Jul 6 02:40:19 2023","interfaces":[{"interface":"back","average":{"1min":6.5049999999999999,"5min":2.488,"15min":1.8740000000000001},"min":{"1min":0.38400000000000001,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":36.560000000000002,"5min":36.560000000000002,"15min":36.560000000000002},"last":7.5720000000000001},{"interface":"front","average":{"1min":8.7100000000000009,"5min":2.8820000000000001,"15min":2.105},"min":{"1min":0.59799999999999998,"5min":0.36599999999999999,"15min":0.33600000000000002},"max":{"1min":40.014000000000003,"5min":40.014000000000003,"15min":40.014000000000003},"last":8.1669999999999998}]},{"osd":5,"last update":"Thu Jul 6 02:40:19 2023","interfaces":[{"interface":"back","average":{"1min":10.765000000000001,"5min":3.7450000000000001,"15min":2.5470000000000002},"min":{"1min":0.57499999999999996,"5min":0.377,"15min":0.36099999999999999},"max":{"1min":81.969999999999999,"5min":81.969999999999999,"15min":81.969999999999999},"last":9.8179999999999996},{"interface":"front","average":{"1min":8.984,"5min":3.198,"15min":2.1360000000000001},"min":{"1min":0.53700000000000003,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":65.238,"5min":65.238,"15min":65.238},"last":7.5300000000000002}]},{"osd":6,"last update":"Thu Jul 6 02:40:19 2023","interfaces":[{"interface":"back","average":{"1min":7.5640000000000001,"5min":2.8290000000000002,"15min":2.1829999999999998},"min":{"1min":0.63600000000000001,"5min":0.40799999999999997,"15min":0.38700000000000001},"max":{"1min":25.689,"5min":25.689,"15min":25.689},"last":8.2780000000000005},{"interface":"front","average":{"1min":12.055,"5min":3.931,"15min":2.641},"min":{"1min":0.51700000000000002,"5min":0.433,"15min":0.40100000000000002},"max":{"1min":61.131999999999998,"5min":61.131999999999998,"15min":61.131999999999998},"last":9.7870000000000008}]},{"osd":7,"last update":"Thu Jul 6 02:40:19 2023","interfaces":[{"interface":"back","average":{"1min":8.6229999999999993,"5min":2.9830000000000001,"15min":2.27},"min":{"1min":0.68000000000000005,"5min":0.46200000000000002,"15min":0.45500000000000002},"max":{"1min":25.783000000000001,"5min":25.783000000000001,"15min":25.783000000000001},"last":8.2490000000000006},{"interface":"front","average":{"1min":9.2609999999999992,"5min":3.4860000000000002,"15min":2.6720000000000002},"min":{"1min":0.54800000000000004,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":72.167000000000002,"5min":72.167000000000002,"15min":72.167000000000002},"last":9.7409999999999997}]}]},{"osd":3,"up_from":13,"seq":55834580375,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":4176588,"kb_used_data":2776088,"kb_used_omap":21228,"kb_used_meta":1353939,"kb_avail":90195252,"statfs":{"total":96636764160,"available":92359938048,"internally_reserved":0,"allocated":2842714112,"data_stored":2841285898,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":21737712,"internal_metadata":1386434320},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":34,"apply_latency_ms":34,"commit_latency_ns":34000000,"apply_latency_ns":34000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 6 02:39:28 2023","interfaces":[{"interface":"back","average":{"1min":1.016,"5min":1.1739999999999999,"15min":1.0609999999999999},"min":{"1min":0.254,"5min":0.23799999999999999,"15min":0.22500000000000001},"max":{"1min":4.4199999999999999,"5min":7.0190000000000001,"15min":12.298999999999999},"last":0.58799999999999997},{"interface":"front","average":{"1min":2.1190000000000002,"5min":1.528,"15min":1.377},"min":{"1min":0.28299999999999997,"5min":0.27000000000000002,"15min":0.252},"max":{"1min":18.82,"5min":18.82,"15min":18.82},"last":0.54100000000000004}]},{"osd":1,"last update":"Thu Jul 6 02:39:28 2023","interfaces":[{"interface":"back","average":{"1min":7.5679999999999996,"5min":2.976,"15min":1.8959999999999999},"min":{"1min":0.307,"5min":0.27100000000000002,"15min":0.24299999999999999},"max":{"1min":103.182,"5min":103.182,"15min":103.182},"last":0.56000000000000005},{"interface":"front","average":{"1min":2.601,"5min":1.764,"15min":1.5369999999999999},"min":{"1min":0.27300000000000002,"5min":0.26800000000000002,"15min":0.25},"max":{"1min":18.895,"5min":18.895,"15min":18.895},"last":0.622}]},{"osd":2,"last update":"Thu Jul 6 02:39:44 2023","interfaces":[{"interface":"back","average":{"1min":4.5579999999999998,"5min":2.3660000000000001,"15min":1.8500000000000001},"min":{"1min":0.29699999999999999,"5min":0.29099999999999998,"15min":0.27700000000000002},"max":{"1min":33.005000000000003,"5min":33.005000000000003,"15min":33.005000000000003},"last":0.67100000000000004},{"interface":"front","average":{"1min":2.988,"5min":1.9219999999999999,"15min":1.8220000000000001},"min":{"1min":0.38300000000000001,"5min":0.29199999999999998,"15min":0.28799999999999998},"max":{"1min":18.997,"5min":18.997,"15min":18.997},"last":0.66400000000000003}]},{"osd":4,"last update":"Thu Jul 6 02:39:44 2023","interfaces":[{"interface":"back","average":{"1min":2.0710000000000002,"5min":1.5249999999999999,"15min":1.5229999999999999},"min":{"1min":0.33500000000000002,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":18.966000000000001,"5min":18.966000000000001,"15min":18.966000000000001},"last":0.86699999999999999},{"interface":"front","average":{"1min":2.8620000000000001,"5min":1.6899999999999999,"15min":1.462},"min":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":32.886000000000003,"5min":32.886000000000003,"15min":32.886000000000003},"last":0.81699999999999995}]},{"osd":5,"last update":"Thu Jul 6 02:39:28 2023","interfaces":[{"interface":"back","average":{"1min":2.9260000000000002,"5min":1.6990000000000001,"15min":1.667},"min":{"1min":0.42599999999999999,"5min":0.375,"15min":0.32400000000000001},"max":{"1min":18.539000000000001,"5min":18.539000000000001,"15min":21.579000000000001},"last":0.89100000000000001},{"interface":"front","average":{"1min":3.4460000000000002,"5min":2.2410000000000001,"15min":2.0720000000000001},"min":{"1min":0.49099999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":18.596,"5min":18.596,"15min":21.553999999999998},"last":0.96699999999999997}]},{"osd":6,"last update":"Thu Jul 6 02:39:44 2023","interfaces":[{"interface":"back","average":{"1min":5.5049999999999999,"5min":2.786,"15min":2.2749999999999999},"min":{"1min":0.47299999999999998,"5min":0.41199999999999998,"15min":0.377},"max":{"1min":43.991999999999997,"5min":43.991999999999997,"15min":43.991999999999997},"last":0.84099999999999997},{"interface":"front","average":{"1min":3.0289999999999999,"5min":2.1000000000000001,"15min":1.978},"min":{"1min":0.439,"5min":0.40799999999999997,"15min":0.39700000000000002},"max":{"1min":18.93,"5min":18.93,"15min":19.273},"last":0.91500000000000004}]},{"osd":7,"last update":"Thu Jul 6 02:39:44 2023","interfaces":[{"interface":"back","average":{"1min":4.3040000000000003,"5min":2.5259999999999998,"15min":2.0009999999999999},"min":{"1min":0.50600000000000001,"5min":0.47699999999999998,"15min":0.42299999999999999},"max":{"1min":32.942999999999998,"5min":32.942999999999998,"15min":32.942999999999998},"last":0.93799999999999994},{"interface":"front","average":{"1min":4.5119999999999996,"5min":2.3119999999999998,"15min":2.2999999999999998},"min":{"1min":0.56599999999999995,"5min":0.45100000000000001,"15min":0.439},"max":{"1min":33.039000000000001,"5min":33.039000000000001,"15min":33.039000000000001},"last":0.90000000000000002}]}]},{"osd":4,"up_from":13,"seq":55834580415,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":4497848,"kb_used_data":2558960,"kb_used_omap":28522,"kb_used_meta":1910357,"kb_avail":89873992,"statfs":{"total":96636764160,"available":92030967808,"internally_reserved":0,"allocated":2620375040,"data_stored":2619031791,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":29207047,"internal_metadata":1956206073},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":17,"apply_latency_ms":17,"commit_latency_ns":17000000,"apply_latency_ns":17000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 6 02:40:16 2023","interfaces":[{"interface":"back","average":{"1min":2.0750000000000002,"5min":1.0489999999999999,"15min":1.1559999999999999},"min":{"1min":0.245,"5min":0.245,"15min":0.23100000000000001},"max":{"1min":17.847999999999999,"5min":17.847999999999999,"15min":17.847999999999999},"last":0.64100000000000001},{"interface":"front","average":{"1min":3.0670000000000002,"5min":1.6060000000000001,"15min":1.704},"min":{"1min":0.27900000000000003,"5min":0.27900000000000003,"15min":0.26200000000000001},"max":{"1min":32.529000000000003,"5min":32.529000000000003,"15min":32.529000000000003},"last":0.53500000000000003}]},{"osd":1,"last update":"Thu Jul 6 02:40:16 2023","interfaces":[{"interface":"back","average":{"1min":3.2639999999999998,"5min":1.661,"15min":1.9530000000000001},"min":{"1min":0.39800000000000002,"5min":0.26900000000000002,"15min":0.26400000000000001},"max":{"1min":11.667,"5min":11.667,"15min":26.927},"last":0.65500000000000003},{"interface":"front","average":{"1min":3.3290000000000002,"5min":1.7390000000000001,"15min":1.944},"min":{"1min":0.308,"5min":0.28000000000000003,"15min":0.27500000000000002},"max":{"1min":12.082000000000001,"5min":12.082000000000001,"15min":26.620999999999999},"last":0.56699999999999995}]},{"osd":2,"last update":"Thu Jul 6 02:39:27 2023","interfaces":[{"interface":"back","average":{"1min":1.4399999999999999,"5min":1.5760000000000001,"15min":1.6619999999999999},"min":{"1min":0.35399999999999998,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":7.8890000000000002,"5min":13.345000000000001,"15min":18.768999999999998},"last":0.55600000000000005},{"interface":"front","average":{"1min":1.8620000000000001,"5min":1.9390000000000001,"15min":2.121},"min":{"1min":0.36599999999999999,"5min":0.35399999999999998,"15min":0.29999999999999999},"max":{"1min":7.5410000000000004,"5min":8.673,"15min":18.701000000000001},"last":0.69699999999999995}]},{"osd":3,"last update":"Thu Jul 6 02:40:16 2023","interfaces":[{"interface":"back","average":{"1min":2.746,"5min":1.984,"15min":2.0379999999999998},"min":{"1min":0.307,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":12.132,"5min":12.132,"15min":12.132},"last":0.51600000000000001},{"interface":"front","average":{"1min":3.4529999999999998,"5min":1.847,"15min":1.9370000000000001},"min":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.34699999999999998},"max":{"1min":18.472000000000001,"5min":18.472000000000001,"15min":18.472000000000001},"last":0.58299999999999996}]},{"osd":5,"last update":"Thu Jul 6 02:40:16 2023","interfaces":[{"interface":"back","average":{"1min":4.6159999999999997,"5min":1.837,"15min":1.6819999999999999},"min":{"1min":0.311,"5min":0.309,"15min":0.27400000000000002},"max":{"1min":46.088000000000001,"5min":46.088000000000001,"15min":46.088000000000001},"last":0.44500000000000001},{"interface":"front","average":{"1min":1.948,"5min":1.2549999999999999,"15min":1.4930000000000001},"min":{"1min":0.26800000000000002,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":21.468,"5min":21.468,"15min":21.468},"last":0.625}]},{"osd":6,"last update":"Thu Jul 6 02:40:16 2023","interfaces":[{"interface":"back","average":{"1min":2.4620000000000002,"5min":1.3009999999999999,"15min":1.274},"min":{"1min":0.30099999999999999,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":18.498000000000001,"5min":18.498000000000001,"15min":18.498000000000001},"last":0.48799999999999999},{"interface":"front","average":{"1min":1.8640000000000001,"5min":1.415,"15min":1.726},"min":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.35099999999999998},"max":{"1min":8.2309999999999999,"5min":8.2309999999999999,"15min":15.339},"last":0.60199999999999998}]},{"osd":7,"last update":"Thu Jul 6 02:40:16 2023","interfaces":[{"interface":"back","average":{"1min":9.0920000000000005,"5min":2.8130000000000002,"15min":2.0579999999999998},"min":{"1min":0.39400000000000002,"5min":0.37,"15min":0.36899999999999999},"max":{"1min":170.637,"5min":170.637,"15min":170.637},"last":0.68100000000000005},{"interface":"front","average":{"1min":9.891,"5min":2.907,"15min":1.903},"min":{"1min":0.375,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":170.33199999999999,"5min":170.33199999999999,"15min":170.33199999999999},"last":0.67200000000000004}]}]},{"osd":5,"up_from":13,"seq":55834580408,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":4015340,"kb_used_data":2520488,"kb_used_omap":19336,"kb_used_meta":1376695,"kb_avail":90356500,"statfs":{"total":96636764160,"available":92525056000,"internally_reserved":0,"allocated":2580979712,"data_stored":2579685704,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":19800821,"internal_metadata":1409735947},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":30,"apply_latency_ms":30,"commit_latency_ns":30000000,"apply_latency_ns":30000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 6 02:39:44 2023","interfaces":[{"interface":"back","average":{"1min":1.3859999999999999,"5min":1.1319999999999999,"15min":1.159},"min":{"1min":0.27000000000000002,"5min":0.23100000000000001,"15min":0.23100000000000001},"max":{"1min":4.9189999999999996,"5min":6.5110000000000001,"15min":10.669},"last":1.131},{"interface":"front","average":{"1min":2.4700000000000002,"5min":1.6679999999999999,"15min":1.5960000000000001},"min":{"1min":0.309,"5min":0.28100000000000003,"15min":0.26900000000000002},"max":{"1min":10.452999999999999,"5min":10.452999999999999,"15min":10.452999999999999},"last":2.0579999999999998}]},{"osd":1,"last update":"Thu Jul 6 02:39:44 2023","interfaces":[{"interface":"back","average":{"1min":2.0499999999999998,"5min":1.4830000000000001,"15min":1.5609999999999999},"min":{"1min":0.29699999999999999,"5min":0.28000000000000003,"15min":0.27600000000000002},"max":{"1min":8.3719999999999999,"5min":8.3719999999999999,"15min":8.3719999999999999},"last":1.9770000000000001},{"interface":"front","average":{"1min":2.2210000000000001,"5min":1.8799999999999999,"15min":1.671},"min":{"1min":0.36499999999999999,"5min":0.27600000000000002,"15min":0.26000000000000001},"max":{"1min":7.827,"5min":8.1120000000000001,"15min":10.724},"last":2.0099999999999998}]},{"osd":2,"last update":"Thu Jul 6 02:39:44 2023","interfaces":[{"interface":"back","average":{"1min":2.133,"5min":1.929,"15min":1.901},"min":{"1min":0.32900000000000001,"5min":0.31900000000000001,"15min":0.28799999999999998},"max":{"1min":6.1420000000000003,"5min":9.5739999999999998,"15min":9.5739999999999998},"last":1.647},{"interface":"front","average":{"1min":2.0089999999999999,"5min":1.843,"15min":1.915},"min":{"1min":0.33600000000000002,"5min":0.33600000000000002,"15min":0.29199999999999998},"max":{"1min":4.7720000000000002,"5min":7.4039999999999999,"15min":10.209},"last":2.2599999999999998}]},{"osd":3,"last update":"Thu Jul 6 02:39:44 2023","interfaces":[{"interface":"back","average":{"1min":2.2120000000000002,"5min":1.8740000000000001,"15min":1.944},"min":{"1min":0.39400000000000002,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":7.5860000000000003,"5min":7.5860000000000003,"15min":11.222},"last":0.97099999999999997},{"interface":"front","average":{"1min":1.925,"5min":2.0299999999999998,"15min":2.0289999999999999},"min":{"1min":0.36699999999999999,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":7.0499999999999998,"5min":7.0499999999999998,"15min":9.9700000000000006},"last":1.5569999999999999}]},{"osd":4,"last update":"Thu Jul 6 02:39:44 2023","interfaces":[{"interface":"back","average":{"1min":0.88900000000000001,"5min":1.165,"15min":1.298},"min":{"1min":0.33300000000000002,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":3.02,"5min":10.948,"15min":13.590999999999999},"last":1.056},{"interface":"front","average":{"1min":1.155,"5min":1.3220000000000001,"15min":1.5860000000000001},"min":{"1min":0.38300000000000001,"5min":0.30399999999999999,"15min":0.28599999999999998},"max":{"1min":3.4750000000000001,"5min":6.7130000000000001,"15min":9.4410000000000007},"last":0.76300000000000001}]},{"osd":6,"last update":"Thu Jul 6 02:39:44 2023","interfaces":[{"interface":"back","average":{"1min":0.95899999999999996,"5min":1.3149999999999999,"15min":1.4570000000000001},"min":{"1min":0.33700000000000002,"5min":0.33500000000000002,"15min":0.316},"max":{"1min":2.8180000000000001,"5min":6.1539999999999999,"15min":15.113},"last":0.74299999999999999},{"interface":"front","average":{"1min":1.2370000000000001,"5min":1.2989999999999999,"15min":1.5249999999999999},"min":{"1min":0.41799999999999998,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":4.0620000000000003,"5min":10.906000000000001,"15min":11.699},"last":1.103}]},{"osd":7,"last update":"Thu Jul 6 02:39:44 2023","interfaces":[{"interface":"back","average":{"1min":1.1160000000000001,"5min":1.49,"15min":1.7529999999999999},"min":{"1min":0.41199999999999998,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":3.6659999999999999,"5min":8.8499999999999996,"15min":11.294},"last":0.88500000000000001},{"interface":"front","average":{"1min":1.274,"5min":1.393,"15min":1.621},"min":{"1min":0.40600000000000003,"5min":0.36199999999999999,"15min":0.35399999999999998},"max":{"1min":3.8999999999999999,"5min":6.351,"15min":15.173},"last":0.79800000000000004}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-07-06T02:40:23.037 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-06T02:40:23.173 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:23.170+0000 7f100ed7a700 1 Processor -- start 2023-07-06T02:40:23.173 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:23.170+0000 7f100ed7a700 1 -- start start 2023-07-06T02:40:23.176 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:23.170+0000 7f100ed7a700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f1008159180 0x7f10080b54c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T02:40:23.176 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:23.170+0000 7f100ed7a700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f10080b1d50 0x7f100806c7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T02:40:23.176 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:23.171+0000 7f100ed7a700 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f100815a1e0 con 0x7f100815d710 2023-07-06T02:40:23.178 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:23.171+0000 7f100ed7a700 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f100815a670 con 0x7f1008159180 2023-07-06T02:40:23.178 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:23.171+0000 7f100ed7a700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f10080b5aa0 con 0x7f10080b1d50 2023-07-06T02:40:23.178 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:23.171+0000 7f100cb16700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f1008159180 0x7f10080b54c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T02:40:23.178 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:23.171+0000 7f1007fff700 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7f100815d710 0x7f10080b1640 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:45350/0 (socket says 172.21.15.46:45350) 2023-07-06T02:40:23.179 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:23.171+0000 7f1007fff700 1 -- 172.21.15.46:0/2757178793 learned_addr learned my addr 172.21.15.46:0/2757178793 (peer_addr_for_me v1:172.21.15.46:0/0) 2023-07-06T02:40:23.179 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:23.171+0000 7f100d317700 1 --2- 172.21.15.46:0/2757178793 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f10080b1d50 0x7f100806c7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T02:40:23.179 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:23.171+0000 7f100cb16700 1 -- 172.21.15.46:0/2757178793 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f10080b1d50 msgr2=0x7f100806c7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T02:40:23.179 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:23.171+0000 7f100cb16700 1 --2- 172.21.15.46:0/2757178793 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f10080b1d50 0x7f100806c7e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T02:40:23.179 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:23.171+0000 7f100cb16700 1 -- 172.21.15.46:0/2757178793 >> v1:172.21.15.46:6789/0 conn(0x7f100815d710 legacy=0x7f10080b1640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T02:40:23.180 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:23.171+0000 7f100cb16700 1 -- 172.21.15.46:0/2757178793 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f100815dbb0 con 0x7f1008159180 2023-07-06T02:40:23.180 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:23.171+0000 7f10077fe700 1 -- 172.21.15.46:0/2757178793 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 356861576 0 0) 0x7f100815a1e0 con 0x7f100815d710 2023-07-06T02:40:23.180 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:23.171+0000 7f100cb16700 1 --2- 172.21.15.46:0/2757178793 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1008159180 0x7f10080b54c0 secure :-1 s=READY pgs=3246 cs=0 l=1 rev1=1 crypto rx=0x7f1000009de0 tx=0x7f100000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3cbd7bcc051fee92 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T02:40:23.181 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:23.171+0000 7f10077fe700 1 -- 172.21.15.46:0/2757178793 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f100000e070 con 0x7f1008159180 2023-07-06T02:40:23.181 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:23.171+0000 7f10077fe700 1 -- 172.21.15.46:0/2757178793 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f100000bbd0 con 0x7f1008159180 2023-07-06T02:40:23.181 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:23.171+0000 7f10077fe700 1 -- 172.21.15.46:0/2757178793 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1000012430 con 0x7f1008159180 2023-07-06T02:40:23.181 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:23.172+0000 7f100ed7a700 1 -- 172.21.15.46:0/2757178793 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1008159180 msgr2=0x7f10080b54c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T02:40:23.182 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:23.172+0000 7f100ed7a700 1 --2- 172.21.15.46:0/2757178793 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1008159180 0x7f10080b54c0 secure :-1 s=READY pgs=3246 cs=0 l=1 rev1=1 crypto rx=0x7f1000009de0 tx=0x7f100000b330 comp rx=0 tx=0).stop 2023-07-06T02:40:23.182 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:23.172+0000 7f100ed7a700 1 -- 172.21.15.46:0/2757178793 shutdown_connections 2023-07-06T02:40:23.182 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:23.172+0000 7f100ed7a700 1 --2- 172.21.15.46:0/2757178793 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f10080b1d50 0x7f100806c7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T02:40:23.182 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:23.172+0000 7f100ed7a700 1 --2- 172.21.15.46:0/2757178793 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1008159180 0x7f10080b54c0 unknown :-1 s=CLOSED pgs=3246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T02:40:23.182 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:23.172+0000 7f100ed7a700 1 -- 172.21.15.46:0/2757178793 >> 172.21.15.46:0/2757178793 conn(0x7f10080cf9a0 msgr2=0x7f10080cfda0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T02:40:23.183 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:23.172+0000 7f100ed7a700 1 -- 172.21.15.46:0/2757178793 shutdown_connections 2023-07-06T02:40:23.183 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:23.172+0000 7f100ed7a700 1 -- 172.21.15.46:0/2757178793 wait complete. 2023-07-06T02:40:23.185 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:23.173+0000 7f100ed7a700 1 Processor -- start 2023-07-06T02:40:23.185 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:23.173+0000 7f100ed7a700 1 -- start start 2023-07-06T02:40:23.186 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:23.174+0000 7f100ed7a700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f10080b1d50 0x7f100814d350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T02:40:23.186 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:23.174+0000 7f100ed7a700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f1008159180 0x7f10080ae850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T02:40:23.186 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:23.174+0000 7f100ed7a700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f100815d710 0x7f10080b0670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T02:40:23.186 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:23.174+0000 7f100ed7a700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10080c49c0 con 0x7f10080b1d50 2023-07-06T02:40:23.186 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:23.174+0000 7f100ed7a700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f100814ddd0 con 0x7f100815d710 2023-07-06T02:40:23.187 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:23.174+0000 7f100ed7a700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f10080c4c60 con 0x7f1008159180 2023-07-06T02:40:23.187 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:23.174+0000 7f100cb16700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f10080b1d50 0x7f100814d350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T02:40:23.187 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:23.174+0000 7f100cb16700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f10080b1d50 0x7f100814d350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:46082/0 (socket says 172.21.15.46:46082) 2023-07-06T02:40:23.187 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:23.174+0000 7f100cb16700 1 -- 172.21.15.46:0/2077179024 learned_addr learned my addr 172.21.15.46:0/2077179024 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-07-06T02:40:23.187 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:23.174+0000 7f100d317700 1 --2- 172.21.15.46:0/2077179024 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f100815d710 0x7f10080b0670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T02:40:23.188 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:23.174+0000 7f1007fff700 1 --2- 172.21.15.46:0/2077179024 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f1008159180 0x7f10080ae850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T02:40:23.188 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:23.175+0000 7f100cb16700 1 -- 172.21.15.46:0/2077179024 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f1008159180 msgr2=0x7f10080ae850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T02:40:23.188 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:23.175+0000 7f100cb16700 1 --2- 172.21.15.46:0/2077179024 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f1008159180 0x7f10080ae850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T02:40:23.189 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:23.175+0000 7f100cb16700 1 -- 172.21.15.46:0/2077179024 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f100815d710 msgr2=0x7f10080b0670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T02:40:23.189 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:23.175+0000 7f100cb16700 1 --2- 172.21.15.46:0/2077179024 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f100815d710 0x7f10080b0670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T02:40:23.189 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:23.175+0000 7f100cb16700 1 -- 172.21.15.46:0/2077179024 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1000009a70 con 0x7f10080b1d50 2023-07-06T02:40:23.190 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:23.175+0000 7f100d317700 1 --2- 172.21.15.46:0/2077179024 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f100815d710 0x7f10080b0670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-06T02:40:23.190 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:23.175+0000 7f1007fff700 1 --2- 172.21.15.46:0/2077179024 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f1008159180 0x7f10080ae850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-06T02:40:23.190 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:23.175+0000 7f100cb16700 1 --2- 172.21.15.46:0/2077179024 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f10080b1d50 0x7f100814d350 secure :-1 s=READY pgs=3247 cs=0 l=1 rev1=1 crypto rx=0x7f100000b370 tx=0x7f1000004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T02:40:23.190 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:23.175+0000 7f10057fa700 1 -- 172.21.15.46:0/2077179024 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1000012430 con 0x7f10080b1d50 2023-07-06T02:40:23.190 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:23.175+0000 7f10057fa700 1 -- 172.21.15.46:0/2077179024 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1000020070 con 0x7f10080b1d50 2023-07-06T02:40:23.191 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:23.175+0000 7f100ed7a700 1 -- 172.21.15.46:0/2077179024 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f10080c4f40 con 0x7f10080b1d50 2023-07-06T02:40:23.191 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:23.175+0000 7f10057fa700 1 -- 172.21.15.46:0/2077179024 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1000004260 con 0x7f10080b1d50 2023-07-06T02:40:23.191 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:23.175+0000 7f100ed7a700 1 -- 172.21.15.46:0/2077179024 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f10080c5500 con 0x7f10080b1d50 2023-07-06T02:40:23.191 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:23.176+0000 7f100ed7a700 1 -- 172.21.15.46:0/2077179024 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f10080672e0 con 0x7f10080b1d50 2023-07-06T02:40:23.192 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:23.177+0000 7f10057fa700 1 -- 172.21.15.46:0/2077179024 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f10000043c0 con 0x7f10080b1d50 2023-07-06T02:40:23.192 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:23.177+0000 7f10057fa700 1 --2- 172.21.15.46:0/2077179024 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7f0fe806ace0 0x7f0fe806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T02:40:23.192 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:23.177+0000 7f10057fa700 1 -- 172.21.15.46:0/2077179024 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 5296+0+0 (secure 0 0 0) 0x7f1000022070 con 0x7f10080b1d50 2023-07-06T02:40:23.193 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:23.177+0000 7f1007fff700 1 --2- 172.21.15.46:0/2077179024 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7f0fe806ace0 0x7f0fe806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T02:40:23.193 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:23.178+0000 7f1007fff700 1 --2- 172.21.15.46:0/2077179024 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7f0fe806ace0 0x7f0fe806d190 secure :-1 s=READY pgs=736 cs=0 l=1 rev1=1 crypto rx=0x7f0ff8007fd0 tx=0x7f0ff8009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T02:40:23.193 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:23.182+0000 7f10057fa700 1 -- 172.21.15.46:0/2077179024 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f1000056610 con 0x7f10080b1d50 2023-07-06T02:40:23.392 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:23.389+0000 7f100ed7a700 1 -- 172.21.15.46:0/2077179024 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f10080cd8d0 con 0x7f10080b1d50 2023-07-06T02:40:23.393 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:23.390+0000 7f10057fa700 1 -- 172.21.15.46:0/2077179024 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v40) v1 ==== 74+0+14648 (secure 0 0 0) 0x7f1000059c30 con 0x7f10080b1d50 2023-07-06T02:40:23.393 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-06T02:40:23.393 INFO:teuthology.orchestra.run.smithi046.stdout:{"epoch":40,"fsid":"042652d3-d80c-4ad8-9366-3e94f2a0a512","created":"2023-07-05T18:55:56.455710+0000","modified":"2023-07-06T02:40:17.465590+0000","last_up_change":"2023-07-05T18:56:06.594022+0000","last_in_change":"2023-07-05T18:55:58.879340+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-07-05T18:56:07.729620+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2023-07-05T18:56:08.128122+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"20009183-9a47-4392-8751-883f88d2bfb1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6813","nonce":4151971443},{"type":"v1","addr":"172.21.15.46:6815","nonce":4151971443}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6817","nonce":4151971443},{"type":"v1","addr":"172.21.15.46:6818","nonce":4151971443}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6822","nonce":4151971443},{"type":"v1","addr":"172.21.15.46:6823","nonce":4151971443}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6820","nonce":4151971443},{"type":"v1","addr":"172.21.15.46:6821","nonce":4151971443}]},"public_addr":"172.21.15.46:6815/4151971443","cluster_addr":"172.21.15.46:6818/4151971443","heartbeat_back_addr":"172.21.15.46:6823/4151971443","heartbeat_front_addr":"172.21.15.46:6821/4151971443","state":["exists","up"]},{"osd":1,"uuid":"91b4a7b0-e4e4-4888-a1fe-9edb0d68004c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6808","nonce":502575881},{"type":"v1","addr":"172.21.15.46:6809","nonce":502575881}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6810","nonce":502575881},{"type":"v1","addr":"172.21.15.46:6811","nonce":502575881}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6816","nonce":502575881},{"type":"v1","addr":"172.21.15.46:6819","nonce":502575881}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6812","nonce":502575881},{"type":"v1","addr":"172.21.15.46:6814","nonce":502575881}]},"public_addr":"172.21.15.46:6809/502575881","cluster_addr":"172.21.15.46:6811/502575881","heartbeat_back_addr":"172.21.15.46:6819/502575881","heartbeat_front_addr":"172.21.15.46:6814/502575881","state":["exists","up"]},{"osd":2,"uuid":"669ff744-1331-47c5-8579-0440731c889a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6800","nonce":2115251461},{"type":"v1","addr":"172.21.15.46:6801","nonce":2115251461}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6802","nonce":2115251461},{"type":"v1","addr":"172.21.15.46:6803","nonce":2115251461}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6806","nonce":2115251461},{"type":"v1","addr":"172.21.15.46:6807","nonce":2115251461}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6804","nonce":2115251461},{"type":"v1","addr":"172.21.15.46:6805","nonce":2115251461}]},"public_addr":"172.21.15.46:6801/2115251461","cluster_addr":"172.21.15.46:6803/2115251461","heartbeat_back_addr":"172.21.15.46:6807/2115251461","heartbeat_front_addr":"172.21.15.46:6805/2115251461","state":["exists","up"]},{"osd":3,"uuid":"34e1b86d-ffad-415d-861c-07a5f08068a6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6824","nonce":2981388766},{"type":"v1","addr":"172.21.15.46:6825","nonce":2981388766}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6826","nonce":2981388766},{"type":"v1","addr":"172.21.15.46:6827","nonce":2981388766}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6830","nonce":2981388766},{"type":"v1","addr":"172.21.15.46:6831","nonce":2981388766}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6828","nonce":2981388766},{"type":"v1","addr":"172.21.15.46:6829","nonce":2981388766}]},"public_addr":"172.21.15.46:6825/2981388766","cluster_addr":"172.21.15.46:6827/2981388766","heartbeat_back_addr":"172.21.15.46:6831/2981388766","heartbeat_front_addr":"172.21.15.46:6829/2981388766","state":["exists","up"]},{"osd":4,"uuid":"57ffcb91-c7dc-4a69-ae71-4d9622a14a05","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6800","nonce":2083655348},{"type":"v1","addr":"172.21.15.73:6801","nonce":2083655348}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6802","nonce":2083655348},{"type":"v1","addr":"172.21.15.73:6803","nonce":2083655348}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6806","nonce":2083655348},{"type":"v1","addr":"172.21.15.73:6807","nonce":2083655348}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6804","nonce":2083655348},{"type":"v1","addr":"172.21.15.73:6805","nonce":2083655348}]},"public_addr":"172.21.15.73:6801/2083655348","cluster_addr":"172.21.15.73:6803/2083655348","heartbeat_back_addr":"172.21.15.73:6807/2083655348","heartbeat_front_addr":"172.21.15.73:6805/2083655348","state":["exists","up"]},{"osd":5,"uuid":"665f41c9-ee20-49cf-bf0e-fbe0c03d3aed","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6824","nonce":2803788401},{"type":"v1","addr":"172.21.15.73:6825","nonce":2803788401}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6826","nonce":2803788401},{"type":"v1","addr":"172.21.15.73:6827","nonce":2803788401}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6830","nonce":2803788401},{"type":"v1","addr":"172.21.15.73:6831","nonce":2803788401}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6828","nonce":2803788401},{"type":"v1","addr":"172.21.15.73:6829","nonce":2803788401}]},"public_addr":"172.21.15.73:6825/2803788401","cluster_addr":"172.21.15.73:6827/2803788401","heartbeat_back_addr":"172.21.15.73:6831/2803788401","heartbeat_front_addr":"172.21.15.73:6829/2803788401","state":["exists","up"]},{"osd":6,"uuid":"5790c6cc-bd56-4ce4-9a7c-0f0c3b59215c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6808","nonce":974108383},{"type":"v1","addr":"172.21.15.73:6809","nonce":974108383}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6810","nonce":974108383},{"type":"v1","addr":"172.21.15.73:6811","nonce":974108383}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6815","nonce":974108383},{"type":"v1","addr":"172.21.15.73:6817","nonce":974108383}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6812","nonce":974108383},{"type":"v1","addr":"172.21.15.73:6813","nonce":974108383}]},"public_addr":"172.21.15.73:6809/974108383","cluster_addr":"172.21.15.73:6811/974108383","heartbeat_back_addr":"172.21.15.73:6817/974108383","heartbeat_front_addr":"172.21.15.73:6813/974108383","state":["exists","up"]},{"osd":7,"uuid":"b66f4d2e-147e-4c9b-97dd-cbd59d33802e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6814","nonce":3772673248},{"type":"v1","addr":"172.21.15.73:6816","nonce":3772673248}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6818","nonce":3772673248},{"type":"v1","addr":"172.21.15.73:6819","nonce":3772673248}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6822","nonce":3772673248},{"type":"v1","addr":"172.21.15.73:6823","nonce":3772673248}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6820","nonce":3772673248},{"type":"v1","addr":"172.21.15.73:6821","nonce":3772673248}]},"public_addr":"172.21.15.73:6816/3772673248","cluster_addr":"172.21.15.73:6819/3772673248","heartbeat_back_addr":"172.21.15.73:6823/3772673248","heartbeat_front_addr":"172.21.15.73:6821/3772673248","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-05T18:56:04.115334+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-05T18:56:04.071250+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-05T18:56:04.044387+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-05T18:56:04.085389+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-05T18:56:04.090726+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-05T18:56:04.074529+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-05T18:56:04.058841+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-05T18:56:04.043054+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.73:6836/255434995":"2023-07-07T02:40:13.451993+0000","172.21.15.73:6834/255434995":"2023-07-07T02:40:13.451993+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-06T02:40:23.395 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:23.392+0000 7f100ed7a700 1 -- 172.21.15.46:0/2077179024 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7f0fe806ace0 msgr2=0x7f0fe806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T02:40:23.395 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:23.392+0000 7f100ed7a700 1 --2- 172.21.15.46:0/2077179024 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7f0fe806ace0 0x7f0fe806d190 secure :-1 s=READY pgs=736 cs=0 l=1 rev1=1 crypto rx=0x7f0ff8007fd0 tx=0x7f0ff8009040 comp rx=0 tx=0).stop 2023-07-06T02:40:23.396 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:23.392+0000 7f100ed7a700 1 -- 172.21.15.46:0/2077179024 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f10080b1d50 msgr2=0x7f100814d350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T02:40:23.396 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:23.392+0000 7f100ed7a700 1 --2- 172.21.15.46:0/2077179024 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f10080b1d50 0x7f100814d350 secure :-1 s=READY pgs=3247 cs=0 l=1 rev1=1 crypto rx=0x7f100000b370 tx=0x7f1000004ad0 comp rx=0 tx=0).stop 2023-07-06T02:40:23.396 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:23.392+0000 7f100ed7a700 1 -- 172.21.15.46:0/2077179024 shutdown_connections 2023-07-06T02:40:23.396 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:23.392+0000 7f100ed7a700 1 --2- 172.21.15.46:0/2077179024 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7f0fe806ace0 0x7f0fe806d190 unknown :-1 s=CLOSED pgs=736 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T02:40:23.397 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:23.392+0000 7f100ed7a700 1 --2- 172.21.15.46:0/2077179024 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f100815d710 0x7f10080b0670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T02:40:23.397 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:23.392+0000 7f100ed7a700 1 --2- 172.21.15.46:0/2077179024 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f10080b1d50 0x7f100814d350 unknown :-1 s=CLOSED pgs=3247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T02:40:23.397 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:23.392+0000 7f100ed7a700 1 --2- 172.21.15.46:0/2077179024 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f1008159180 0x7f10080ae850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T02:40:23.397 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:23.392+0000 7f100ed7a700 1 -- 172.21.15.46:0/2077179024 >> 172.21.15.46:0/2077179024 conn(0x7f10080cf9a0 msgr2=0x7f10080cdaf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T02:40:23.397 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:23.392+0000 7f100ed7a700 1 -- 172.21.15.46:0/2077179024 shutdown_connections 2023-07-06T02:40:23.398 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:23.392+0000 7f100ed7a700 1 -- 172.21.15.46:0/2077179024 wait complete. 2023-07-06T02:40:24.410 INFO:tasks.ceph:Scrubbing osd.0 2023-07-06T02:40:24.411 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 config set osd_debug_deep_scrub_sleep 0 2023-07-06T02:40:24.561 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:24.558+0000 7fced7665700 1 Processor -- start 2023-07-06T02:40:24.562 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:24.559+0000 7fced7665700 1 -- start start 2023-07-06T02:40:24.564 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:24.559+0000 7fced7665700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fced015c250 0x7fced0160a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T02:40:24.564 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:24.559+0000 7fced7665700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fced006c340 0x7fced0069e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T02:40:24.565 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:24.559+0000 7fced7665700 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fced00cd0e0 con 0x7fced015c620 2023-07-06T02:40:24.565 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:24.559+0000 7fced7665700 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fced0160f40 con 0x7fced006c340 2023-07-06T02:40:24.565 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:24.559+0000 7fced7665700 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fced00cc230 con 0x7fced015c250 2023-07-06T02:40:24.566 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:24.559+0000 7fced4c00700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fced006c340 0x7fced0069e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T02:40:24.566 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:24.560+0000 7fced4c00700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fced006c340 0x7fced0069e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:46092/0 (socket says 172.21.15.46:46092) 2023-07-06T02:40:24.566 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:24.560+0000 7fced4c00700 1 -- 172.21.15.46:0/3923182629 learned_addr learned my addr 172.21.15.46:0/3923182629 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-07-06T02:40:24.567 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:24.560+0000 7fced5401700 1 --2- 172.21.15.46:0/3923182629 >> v2:172.21.15.73:3300/0 conn(0x7fced015c250 0x7fced0160a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T02:40:24.567 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:24.560+0000 7fced4c00700 1 -- 172.21.15.46:0/3923182629 >> v2:172.21.15.73:3300/0 conn(0x7fced015c250 msgr2=0x7fced0160a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T02:40:24.567 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:24.560+0000 7fced4c00700 1 --2- 172.21.15.46:0/3923182629 >> v2:172.21.15.73:3300/0 conn(0x7fced015c250 0x7fced0160a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T02:40:24.568 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:24.560+0000 7fced4c00700 1 -- 172.21.15.46:0/3923182629 >> v1:172.21.15.73:6789/0 conn(0x7fced015c620 legacy=0x7fced006cd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T02:40:24.568 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:24.560+0000 7fced4c00700 1 -- 172.21.15.46:0/3923182629 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fced00cc4d0 con 0x7fced006c340 2023-07-06T02:40:24.568 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:24.560+0000 7fced4c00700 1 --2- 172.21.15.46:0/3923182629 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fced006c340 0x7fced0069e00 secure :-1 s=READY pgs=3248 cs=0 l=1 rev1=1 crypto rx=0x7fced00d0a40 tx=0x7fcec4009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=286795d7af9f4389 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T02:40:24.568 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:24.560+0000 7fcecffff700 1 -- 172.21.15.46:0/3923182629 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcec4004230 con 0x7fced006c340 2023-07-06T02:40:24.568 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:24.560+0000 7fcecffff700 1 -- 172.21.15.46:0/3923182629 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcec4004390 con 0x7fced006c340 2023-07-06T02:40:24.569 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:24.560+0000 7fcecffff700 1 -- 172.21.15.46:0/3923182629 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcec40036a0 con 0x7fced006c340 2023-07-06T02:40:24.569 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:24.561+0000 7fced7665700 1 -- 172.21.15.46:0/3923182629 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fced006c340 msgr2=0x7fced0069e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T02:40:24.569 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:24.561+0000 7fced7665700 1 --2- 172.21.15.46:0/3923182629 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fced006c340 0x7fced0069e00 secure :-1 s=READY pgs=3248 cs=0 l=1 rev1=1 crypto rx=0x7fced00d0a40 tx=0x7fcec4009bd0 comp rx=0 tx=0).stop 2023-07-06T02:40:24.569 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:24.561+0000 7fced7665700 1 -- 172.21.15.46:0/3923182629 shutdown_connections 2023-07-06T02:40:24.569 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:24.561+0000 7fced7665700 1 --2- 172.21.15.46:0/3923182629 >> v2:172.21.15.73:3300/0 conn(0x7fced015c250 0x7fced0160a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T02:40:24.570 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:24.561+0000 7fced7665700 1 --2- 172.21.15.46:0/3923182629 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fced006c340 0x7fced0069e00 unknown :-1 s=CLOSED pgs=3248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T02:40:24.570 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:24.561+0000 7fced7665700 1 -- 172.21.15.46:0/3923182629 >> 172.21.15.46:0/3923182629 conn(0x7fced006bba0 msgr2=0x7fced00b1510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T02:40:24.571 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:24.561+0000 7fced7665700 1 -- 172.21.15.46:0/3923182629 shutdown_connections 2023-07-06T02:40:24.571 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:24.561+0000 7fced7665700 1 -- 172.21.15.46:0/3923182629 wait complete. 2023-07-06T02:40:24.576 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:24.562+0000 7fced7665700 1 Processor -- start 2023-07-06T02:40:24.577 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:24.562+0000 7fced7665700 1 -- start start 2023-07-06T02:40:24.577 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:24.563+0000 7fced7665700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fced006c340 0x7fced01e6080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T02:40:24.577 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:24.563+0000 7fced7665700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fced015c250 0x7fced0155aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T02:40:24.577 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:24.563+0000 7fced7665700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fced015c620 0x7fced0155fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T02:40:24.578 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:24.563+0000 7fced7665700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fced00c3a00 con 0x7fced015c250 2023-07-06T02:40:24.578 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:24.563+0000 7fced7665700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fced00c45a0 con 0x7fced006c340 2023-07-06T02:40:24.578 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:24.563+0000 7fced7665700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fced015ae60 con 0x7fced015c620 2023-07-06T02:40:24.578 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:24.563+0000 7fced4c00700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fced015c250 0x7fced0155aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T02:40:24.578 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:24.563+0000 7fced4c00700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fced015c250 0x7fced0155aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:46098/0 (socket says 172.21.15.46:46098) 2023-07-06T02:40:24.579 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:24.563+0000 7fced4c00700 1 -- 172.21.15.46:0/747836797 learned_addr learned my addr 172.21.15.46:0/747836797 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-07-06T02:40:24.579 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:24.563+0000 7fced5401700 1 --2- 172.21.15.46:0/747836797 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fced006c340 0x7fced01e6080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T02:40:24.579 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:24.563+0000 7fced5c02700 1 --2- 172.21.15.46:0/747836797 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fced015c620 0x7fced0155fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T02:40:24.579 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:24.563+0000 7fced4c00700 1 -- 172.21.15.46:0/747836797 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fced015c620 msgr2=0x7fced0155fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T02:40:24.579 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:24.563+0000 7fced4c00700 1 --2- 172.21.15.46:0/747836797 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fced015c620 0x7fced0155fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T02:40:24.580 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:24.563+0000 7fced4c00700 1 -- 172.21.15.46:0/747836797 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fced006c340 msgr2=0x7fced01e6080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T02:40:24.580 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:24.563+0000 7fced4c00700 1 --2- 172.21.15.46:0/747836797 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fced006c340 0x7fced01e6080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T02:40:24.580 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:24.563+0000 7fced4c00700 1 -- 172.21.15.46:0/747836797 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcec4009550 con 0x7fced015c250 2023-07-06T02:40:24.580 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:24.563+0000 7fced5c02700 1 --2- 172.21.15.46:0/747836797 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fced015c620 0x7fced0155fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-06T02:40:24.581 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:24.564+0000 7fced4c00700 1 --2- 172.21.15.46:0/747836797 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fced015c250 0x7fced0155aa0 secure :-1 s=READY pgs=3249 cs=0 l=1 rev1=1 crypto rx=0x7fcec4009c10 tx=0x7fcec4004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T02:40:24.581 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:24.564+0000 7fcecdffb700 1 -- 172.21.15.46:0/747836797 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcec4003c90 con 0x7fced015c250 2023-07-06T02:40:24.581 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:24.564+0000 7fcecdffb700 1 -- 172.21.15.46:0/747836797 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcec401f070 con 0x7fced015c250 2023-07-06T02:40:24.581 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:24.564+0000 7fced7665700 1 -- 172.21.15.46:0/747836797 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fced015b140 con 0x7fced015c250 2023-07-06T02:40:24.581 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:24.564+0000 7fcecdffb700 1 -- 172.21.15.46:0/747836797 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcec4011870 con 0x7fced015c250 2023-07-06T02:40:24.582 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:24.564+0000 7fced7665700 1 -- 172.21.15.46:0/747836797 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fced00c4230 con 0x7fced015c250 2023-07-06T02:40:24.582 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:24.565+0000 7fced7665700 1 -- 172.21.15.46:0/747836797 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fced00cca90 con 0x7fced015c250 2023-07-06T02:40:24.582 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:24.565+0000 7fcecdffb700 1 -- 172.21.15.46:0/747836797 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fcec4021030 con 0x7fced015c250 2023-07-06T02:40:24.582 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:24.566+0000 7fcecdffb700 1 --2- 172.21.15.46:0/747836797 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7fcebc06ace0 0x7fcebc06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T02:40:24.582 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:24.566+0000 7fcecdffb700 1 -- 172.21.15.46:0/747836797 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 5296+0+0 (secure 0 0 0) 0x7fcec408aba0 con 0x7fced015c250 2023-07-06T02:40:24.583 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:24.566+0000 7fcecdffb700 1 --2- 172.21.15.46:0/747836797 >> [v2:172.21.15.46:6813/4151971443,v1:172.21.15.46:6815/4151971443] conn(0x7fcebc071150 0x7fcebc073560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T02:40:24.583 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:24.566+0000 7fcecdffb700 1 -- 172.21.15.46:0/747836797 --> [v2:172.21.15.46:6813/4151971443,v1:172.21.15.46:6815/4151971443] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fcebc073c30 con 0x7fcebc071150 2023-07-06T02:40:24.583 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:24.566+0000 7fcecdffb700 1 -- 172.21.15.46:0/747836797 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_get_version_reply(handle=1 version=40) v2 ==== 24+0+0 (secure 0 0 0) 0x7fcec408afd0 con 0x7fced015c250 2023-07-06T02:40:24.583 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:24.566+0000 7fced5401700 1 --2- 172.21.15.46:0/747836797 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7fcebc06ace0 0x7fcebc06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T02:40:24.583 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:24.566+0000 7fced5c02700 1 --2- 172.21.15.46:0/747836797 >> [v2:172.21.15.46:6813/4151971443,v1:172.21.15.46:6815/4151971443] conn(0x7fcebc071150 0x7fcebc073560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T02:40:24.584 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:24.567+0000 7fced5401700 1 --2- 172.21.15.46:0/747836797 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7fcebc06ace0 0x7fcebc06d190 secure :-1 s=READY pgs=737 cs=0 l=1 rev1=1 crypto rx=0x7fcec0006fd0 tx=0x7fcec0008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T02:40:24.584 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:24.567+0000 7fced5c02700 1 --2- 172.21.15.46:0/747836797 >> [v2:172.21.15.46:6813/4151971443,v1:172.21.15.46:6815/4151971443] conn(0x7fcebc071150 0x7fcebc073560 crc :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T02:40:24.584 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:24.567+0000 7fcecdffb700 1 -- 172.21.15.46:0/747836797 <== osd.0 v2:172.21.15.46:6813/4151971443 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7fcebc073c30 con 0x7fcebc071150 2023-07-06T02:40:24.585 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:24.583+0000 7fced7665700 1 -- 172.21.15.46:0/747836797 --> [v2:172.21.15.46:6813/4151971443,v1:172.21.15.46:6815/4151971443] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7fced00cc7b0 con 0x7fcebc071150 2023-07-06T02:40:24.586 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:24.583+0000 7fcecdffb700 1 -- 172.21.15.46:0/747836797 <== osd.0 v2:172.21.15.46:6813/4151971443 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7fcec800b3f0 con 0x7fcebc071150 2023-07-06T02:40:24.586 INFO:teuthology.orchestra.run.smithi046.stdout:{ 2023-07-06T02:40:24.587 INFO:teuthology.orchestra.run.smithi046.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-07-06T02:40:24.587 INFO:teuthology.orchestra.run.smithi046.stdout:} 2023-07-06T02:40:24.588 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:24.583+0000 7fced7665700 1 -- 172.21.15.46:0/747836797 >> [v2:172.21.15.46:6813/4151971443,v1:172.21.15.46:6815/4151971443] conn(0x7fcebc071150 msgr2=0x7fcebc073560 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T02:40:24.588 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:24.583+0000 7fced7665700 1 --2- 172.21.15.46:0/747836797 >> [v2:172.21.15.46:6813/4151971443,v1:172.21.15.46:6815/4151971443] conn(0x7fcebc071150 0x7fcebc073560 crc :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T02:40:24.588 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:24.583+0000 7fced7665700 1 -- 172.21.15.46:0/747836797 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7fcebc06ace0 msgr2=0x7fcebc06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T02:40:24.588 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:24.583+0000 7fced7665700 1 --2- 172.21.15.46:0/747836797 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7fcebc06ace0 0x7fcebc06d190 secure :-1 s=READY pgs=737 cs=0 l=1 rev1=1 crypto rx=0x7fcec0006fd0 tx=0x7fcec0008040 comp rx=0 tx=0).stop 2023-07-06T02:40:24.589 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:24.583+0000 7fced7665700 1 -- 172.21.15.46:0/747836797 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fced015c250 msgr2=0x7fced0155aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T02:40:24.589 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:24.583+0000 7fced7665700 1 --2- 172.21.15.46:0/747836797 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fced015c250 0x7fced0155aa0 secure :-1 s=READY pgs=3249 cs=0 l=1 rev1=1 crypto rx=0x7fcec4009c10 tx=0x7fcec4004750 comp rx=0 tx=0).stop 2023-07-06T02:40:24.589 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:24.583+0000 7fced5c02700 1 -- 172.21.15.46:0/747836797 reap_dead start 2023-07-06T02:40:24.589 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:24.583+0000 7fced7665700 1 -- 172.21.15.46:0/747836797 shutdown_connections 2023-07-06T02:40:24.589 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:24.583+0000 7fced7665700 1 -- 172.21.15.46:0/747836797 >> 172.21.15.46:0/747836797 conn(0x7fced006bba0 msgr2=0x7fced006cd40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T02:40:24.590 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:24.583+0000 7fced7665700 1 -- 172.21.15.46:0/747836797 shutdown_connections 2023-07-06T02:40:24.590 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:24.583+0000 7fced7665700 1 -- 172.21.15.46:0/747836797 wait complete. 2023-07-06T02:40:24.600 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 0 2023-07-06T02:40:24.736 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:24.733+0000 7fd48f35a700 1 Processor -- start 2023-07-06T02:40:24.737 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:24.734+0000 7fd48f35a700 1 -- start start 2023-07-06T02:40:24.739 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:24.734+0000 7fd48f35a700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fd4880ce700 0x7fd4880cead0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T02:40:24.739 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:24.734+0000 7fd48f35a700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fd4880af710 0x7fd48815e020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T02:40:24.739 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:24.734+0000 7fd48f35a700 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd4880af280 con 0x7fd4880ae0d0 2023-07-06T02:40:24.740 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:24.734+0000 7fd48f35a700 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd48815a910 con 0x7fd4880ce700 2023-07-06T02:40:24.740 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:24.734+0000 7fd48f35a700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd4880cf010 con 0x7fd4880af710 2023-07-06T02:40:24.740 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:24.735+0000 7fd48d8f7700 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7fd4880ae0d0 0x7fd48815e560 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:45382/0 (socket says 172.21.15.46:45382) 2023-07-06T02:40:24.740 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:24.735+0000 7fd48d0f6700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fd4880ce700 0x7fd4880cead0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T02:40:24.741 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:24.735+0000 7fd48d8f7700 1 -- 172.21.15.46:0/1441623697 learned_addr learned my addr 172.21.15.46:0/1441623697 (peer_addr_for_me v1:172.21.15.46:0/0) 2023-07-06T02:40:24.741 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:24.735+0000 7fd48c8f5700 1 --2- 172.21.15.46:0/1441623697 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fd4880af710 0x7fd48815e020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T02:40:24.741 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:24.735+0000 7fd47ffff700 1 -- 172.21.15.46:0/1441623697 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4117840531 0 0) 0x7fd4880af280 con 0x7fd4880ae0d0 2023-07-06T02:40:24.741 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:24.735+0000 7fd47ffff700 1 -- 172.21.15.46:0/1441623697 --> v1:172.21.15.46:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd4740035b0 con 0x7fd4880ae0d0 2023-07-06T02:40:24.742 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:24.735+0000 7fd48d0f6700 1 -- 172.21.15.46:0/1441623697 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fd4880af710 msgr2=0x7fd48815e020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T02:40:24.742 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:24.735+0000 7fd48d0f6700 1 --2- 172.21.15.46:0/1441623697 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fd4880af710 0x7fd48815e020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T02:40:24.742 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:24.735+0000 7fd48d0f6700 1 -- 172.21.15.46:0/1441623697 >> v1:172.21.15.46:6789/0 conn(0x7fd4880ae0d0 legacy=0x7fd48815e560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T02:40:24.742 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:24.735+0000 7fd48d0f6700 1 -- 172.21.15.46:0/1441623697 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd4880ae670 con 0x7fd4880ce700 2023-07-06T02:40:24.743 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:24.735+0000 7fd48d0f6700 1 --2- 172.21.15.46:0/1441623697 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd4880ce700 0x7fd4880cead0 secure :-1 s=READY pgs=3251 cs=0 l=1 rev1=1 crypto rx=0x7fd484009840 tx=0x7fd484009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7d5605193f7b4eae server_cookie=0 in_seq=0 out_seq=0 2023-07-06T02:40:24.743 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:24.735+0000 7fd47ffff700 1 -- 172.21.15.46:0/1441623697 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd484011830 con 0x7fd4880ce700 2023-07-06T02:40:24.743 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:24.735+0000 7fd47ffff700 1 -- 172.21.15.46:0/1441623697 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd484011990 con 0x7fd4880ce700 2023-07-06T02:40:24.743 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:24.735+0000 7fd47ffff700 1 -- 172.21.15.46:0/1441623697 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd484011d20 con 0x7fd4880ce700 2023-07-06T02:40:24.743 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:24.736+0000 7fd48f35a700 1 -- 172.21.15.46:0/1441623697 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd4880ce700 msgr2=0x7fd4880cead0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T02:40:24.744 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:24.736+0000 7fd48f35a700 1 --2- 172.21.15.46:0/1441623697 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd4880ce700 0x7fd4880cead0 secure :-1 s=READY pgs=3251 cs=0 l=1 rev1=1 crypto rx=0x7fd484009840 tx=0x7fd484009b50 comp rx=0 tx=0).stop 2023-07-06T02:40:24.744 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:24.736+0000 7fd48f35a700 1 -- 172.21.15.46:0/1441623697 shutdown_connections 2023-07-06T02:40:24.744 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:24.736+0000 7fd48f35a700 1 --2- 172.21.15.46:0/1441623697 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd4880ce700 0x7fd4880cead0 unknown :-1 s=CLOSED pgs=3251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T02:40:24.744 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:24.736+0000 7fd48f35a700 1 --2- 172.21.15.46:0/1441623697 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fd4880af710 0x7fd48815e020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T02:40:24.745 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:24.736+0000 7fd48f35a700 1 -- 172.21.15.46:0/1441623697 >> 172.21.15.46:0/1441623697 conn(0x7fd488099e00 msgr2=0x7fd4880d0b30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T02:40:24.745 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:24.736+0000 7fd48f35a700 1 -- 172.21.15.46:0/1441623697 shutdown_connections 2023-07-06T02:40:24.745 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:24.736+0000 7fd48f35a700 1 -- 172.21.15.46:0/1441623697 wait complete. 2023-07-06T02:40:24.747 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:24.737+0000 7fd48f35a700 1 Processor -- start 2023-07-06T02:40:24.747 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:24.738+0000 7fd48f35a700 1 -- start start 2023-07-06T02:40:24.748 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:24.738+0000 7fd48f35a700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fd4880ae0d0 0x7fd488158840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T02:40:24.748 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:24.738+0000 7fd48f35a700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd4880af710 0x7fd48815b460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T02:40:24.748 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:24.738+0000 7fd48f35a700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd4880ce700 0x7fd4880c6c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T02:40:24.748 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:24.738+0000 7fd48f35a700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4880c7190 con 0x7fd4880ce700 2023-07-06T02:40:24.749 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:24.738+0000 7fd48f35a700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd48815bb60 con 0x7fd4880af710 2023-07-06T02:40:24.749 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:24.738+0000 7fd48f35a700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd48815be40 con 0x7fd4880ae0d0 2023-07-06T02:40:24.749 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:24.738+0000 7fd48d8f7700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd4880ce700 0x7fd4880c6c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T02:40:24.749 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:24.738+0000 7fd48d8f7700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd4880ce700 0x7fd4880c6c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:46116/0 (socket says 172.21.15.46:46116) 2023-07-06T02:40:24.749 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:24.738+0000 7fd48d8f7700 1 -- 172.21.15.46:0/3793406829 learned_addr learned my addr 172.21.15.46:0/3793406829 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-07-06T02:40:24.750 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:24.739+0000 7fd48c8f5700 1 --2- 172.21.15.46:0/3793406829 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd4880af710 0x7fd48815b460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T02:40:24.750 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:24.739+0000 7fd48d0f6700 1 --2- 172.21.15.46:0/3793406829 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fd4880ae0d0 0x7fd488158840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T02:40:24.750 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:24.739+0000 7fd48d8f7700 1 -- 172.21.15.46:0/3793406829 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fd4880ae0d0 msgr2=0x7fd488158840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T02:40:24.750 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:24.739+0000 7fd48d8f7700 1 --2- 172.21.15.46:0/3793406829 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fd4880ae0d0 0x7fd488158840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T02:40:24.750 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:24.739+0000 7fd48d8f7700 1 -- 172.21.15.46:0/3793406829 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd4880af710 msgr2=0x7fd48815b460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T02:40:24.750 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:24.739+0000 7fd48d8f7700 1 --2- 172.21.15.46:0/3793406829 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd4880af710 0x7fd48815b460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T02:40:24.751 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:24.739+0000 7fd48d8f7700 1 -- 172.21.15.46:0/3793406829 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd4840094a0 con 0x7fd4880ce700 2023-07-06T02:40:24.751 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:24.739+0000 7fd48d0f6700 1 --2- 172.21.15.46:0/3793406829 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fd4880ae0d0 0x7fd488158840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-06T02:40:24.751 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:24.739+0000 7fd48c8f5700 1 --2- 172.21.15.46:0/3793406829 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd4880af710 0x7fd48815b460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-06T02:40:24.751 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:24.739+0000 7fd48d8f7700 1 --2- 172.21.15.46:0/3793406829 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd4880ce700 0x7fd4880c6c50 secure :-1 s=READY pgs=3252 cs=0 l=1 rev1=1 crypto rx=0x7fd48000cb40 tx=0x7fd48000cf00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T02:40:24.751 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:24.739+0000 7fd47dffb700 1 -- 172.21.15.46:0/3793406829 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd48000ab50 con 0x7fd4880ce700 2023-07-06T02:40:24.752 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:24.739+0000 7fd47dffb700 1 -- 172.21.15.46:0/3793406829 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd48000acb0 con 0x7fd4880ce700 2023-07-06T02:40:24.752 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:24.739+0000 7fd48f35a700 1 -- 172.21.15.46:0/3793406829 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd48815c120 con 0x7fd4880ce700 2023-07-06T02:40:24.752 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:24.739+0000 7fd47dffb700 1 -- 172.21.15.46:0/3793406829 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd480012620 con 0x7fd4880ce700 2023-07-06T02:40:24.752 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:24.739+0000 7fd48f35a700 1 -- 172.21.15.46:0/3793406829 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd48815c6e0 con 0x7fd4880ce700 2023-07-06T02:40:24.752 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:24.740+0000 7fd48f35a700 1 -- 172.21.15.46:0/3793406829 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd48815c8d0 con 0x7fd4880ce700 2023-07-06T02:40:24.753 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:24.741+0000 7fd47dffb700 1 -- 172.21.15.46:0/3793406829 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fd48001b3b0 con 0x7fd4880ce700 2023-07-06T02:40:24.753 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:24.741+0000 7fd47dffb700 1 --2- 172.21.15.46:0/3793406829 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7fd46c06ace0 0x7fd46c06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T02:40:24.753 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:24.741+0000 7fd47dffb700 1 -- 172.21.15.46:0/3793406829 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 5296+0+0 (secure 0 0 0) 0x7fd480088fd0 con 0x7fd4880ce700 2023-07-06T02:40:24.753 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:24.742+0000 7fd48d0f6700 1 --2- 172.21.15.46:0/3793406829 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7fd46c06ace0 0x7fd46c06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T02:40:24.754 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:24.742+0000 7fd48d0f6700 1 --2- 172.21.15.46:0/3793406829 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7fd46c06ace0 0x7fd46c06d190 secure :-1 s=READY pgs=738 cs=0 l=1 rev1=1 crypto rx=0x7fd484000c00 tx=0x7fd48401c040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T02:40:24.754 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:24.746+0000 7fd47dffb700 1 -- 172.21.15.46:0/3793406829 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fd480054380 con 0x7fd4880ce700 2023-07-06T02:40:24.954 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:24.951+0000 7fd48f35a700 1 -- 172.21.15.46:0/3793406829 --> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "0", "target": ["mon-mgr", ""]}) v1 -- 0x7fd4880aec30 con 0x7fd46c06ace0 2023-07-06T02:40:24.955 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:24.952+0000 7fd47dffb700 1 -- 172.21.15.46:0/3793406829 <== mgr.4099 v2:172.21.15.73:6832/3033361733 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 0 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7fd484011b80 con 0x7fd46c06ace0 2023-07-06T02:40:24.957 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:24.954+0000 7fd48f35a700 1 -- 172.21.15.46:0/3793406829 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7fd46c06ace0 msgr2=0x7fd46c06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T02:40:24.957 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:24.954+0000 7fd48f35a700 1 --2- 172.21.15.46:0/3793406829 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7fd46c06ace0 0x7fd46c06d190 secure :-1 s=READY pgs=738 cs=0 l=1 rev1=1 crypto rx=0x7fd484000c00 tx=0x7fd48401c040 comp rx=0 tx=0).stop 2023-07-06T02:40:24.957 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:24.954+0000 7fd48f35a700 1 -- 172.21.15.46:0/3793406829 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd4880ce700 msgr2=0x7fd4880c6c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T02:40:24.958 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:24.954+0000 7fd48f35a700 1 --2- 172.21.15.46:0/3793406829 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd4880ce700 0x7fd4880c6c50 secure :-1 s=READY pgs=3252 cs=0 l=1 rev1=1 crypto rx=0x7fd48000cb40 tx=0x7fd48000cf00 comp rx=0 tx=0).stop 2023-07-06T02:40:24.959 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:24.954+0000 7fd48f35a700 1 -- 172.21.15.46:0/3793406829 shutdown_connections 2023-07-06T02:40:24.959 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:24.954+0000 7fd48f35a700 1 --2- 172.21.15.46:0/3793406829 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7fd46c06ace0 0x7fd46c06d190 unknown :-1 s=CLOSED pgs=738 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T02:40:24.959 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:24.954+0000 7fd48f35a700 1 --2- 172.21.15.46:0/3793406829 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd4880ce700 0x7fd4880c6c50 unknown :-1 s=CLOSED pgs=3252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T02:40:24.959 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:24.954+0000 7fd48f35a700 1 --2- 172.21.15.46:0/3793406829 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fd4880ae0d0 0x7fd488158840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T02:40:24.959 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:24.954+0000 7fd48f35a700 1 --2- 172.21.15.46:0/3793406829 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd4880af710 0x7fd48815b460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T02:40:24.960 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:24.954+0000 7fd48f35a700 1 -- 172.21.15.46:0/3793406829 >> 172.21.15.46:0/3793406829 conn(0x7fd488099e00 msgr2=0x7fd4880b2620 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T02:40:24.960 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:24.954+0000 7fd48f35a700 1 -- 172.21.15.46:0/3793406829 shutdown_connections 2023-07-06T02:40:24.960 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:24.954+0000 7fd48f35a700 1 -- 172.21.15.46:0/3793406829 wait complete. 2023-07-06T02:40:24.961 INFO:teuthology.orchestra.run.smithi046.stderr:instructed osd(s) 0 to deep-scrub 2023-07-06T02:40:24.972 INFO:tasks.ceph:Scrubbing osd.1 2023-07-06T02:40:24.973 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 config set osd_debug_deep_scrub_sleep 0 2023-07-06T02:40:25.113 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:25.110+0000 7f57959ba700 1 Processor -- start 2023-07-06T02:40:25.113 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:25.110+0000 7f57959ba700 1 -- start start 2023-07-06T02:40:25.115 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:25.111+0000 7f57959ba700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f57900cfd70 0x7f5790167140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T02:40:25.116 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:25.111+0000 7f57959ba700 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f57900cf1d0 con 0x7f57900b8540 2023-07-06T02:40:25.116 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:25.111+0000 7f57959ba700 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f57900d0fc0 con 0x7f57901609f0 2023-07-06T02:40:25.116 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:25.111+0000 7f57959ba700 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f57900cda50 con 0x7f57900cfd70 2023-07-06T02:40:25.117 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:25.111+0000 7f578effd700 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7f57900b8540 0x7f57900d08b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:45392/0 (socket says 172.21.15.46:45392) 2023-07-06T02:40:25.117 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:25.111+0000 7f578effd700 1 -- 172.21.15.46:0/3532492095 learned_addr learned my addr 172.21.15.46:0/3532492095 (peer_addr_for_me v1:172.21.15.46:0/0) 2023-07-06T02:40:25.117 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:25.111+0000 7f578f7fe700 1 --2- 172.21.15.46:0/3532492095 >> v2:172.21.15.73:3300/0 conn(0x7f57900cfd70 0x7f5790167140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T02:40:25.117 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:25.111+0000 7f578dffb700 1 -- 172.21.15.46:0/3532492095 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4008829817 0 0) 0x7f57900cf1d0 con 0x7f57900b8540 2023-07-06T02:40:25.117 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:25.111+0000 7f578dffb700 1 -- 172.21.15.46:0/3532492095 --> v1:172.21.15.46:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f57780035b0 con 0x7f57900b8540 2023-07-06T02:40:25.118 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:25.112+0000 7f578dffb700 1 -- 172.21.15.46:0/3532492095 <== mon.0 v1:172.21.15.46:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 291064258 0 0) 0x7f57780035b0 con 0x7f57900b8540 2023-07-06T02:40:25.118 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:25.112+0000 7f578dffb700 1 -- 172.21.15.46:0/3532492095 >> v2:172.21.15.73:3300/0 conn(0x7f57900cfd70 msgr2=0x7f5790167140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T02:40:25.119 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:25.112+0000 7f578dffb700 1 --2- 172.21.15.46:0/3532492095 >> v2:172.21.15.73:3300/0 conn(0x7f57900cfd70 0x7f5790167140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T02:40:25.119 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:25.112+0000 7f578dffb700 1 -- 172.21.15.46:0/3532492095 >> v1:172.21.15.73:6789/0 conn(0x7f57901609f0 legacy=0x7f57900cf660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T02:40:25.119 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:25.112+0000 7f578dffb700 1 -- 172.21.15.46:0/3532492095 --> v1:172.21.15.46:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f57900cd4b0 con 0x7f57900b8540 2023-07-06T02:40:25.119 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:25.112+0000 7f578dffb700 1 -- 172.21.15.46:0/3532492095 <== mon.0 v1:172.21.15.46:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2195585215 0 0) 0x7f5780001670 con 0x7f57900b8540 2023-07-06T02:40:25.119 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:25.112+0000 7f578dffb700 1 -- 172.21.15.46:0/3532492095 >> v1:172.21.15.46:6789/0 conn(0x7f57900b8540 legacy=0x7f57900d08b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T02:40:25.120 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:25.112+0000 7f578dffb700 1 --2- 172.21.15.46:0/3532492095 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5778003a50 0x7f5778003e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T02:40:25.120 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:25.112+0000 7f578dffb700 1 --2- 172.21.15.46:0/3532492095 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f5778004850 0x7f5778004cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T02:40:25.120 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:25.112+0000 7f578dffb700 1 --2- 172.21.15.46:0/3532492095 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5778005200 0x7f577800ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T02:40:25.120 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:25.112+0000 7f578dffb700 1 -- 172.21.15.46:0/3532492095 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57900cda50 con 0x7f5778003a50 2023-07-06T02:40:25.120 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:25.112+0000 7f578dffb700 1 -- 172.21.15.46:0/3532492095 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f577800c0e0 con 0x7f5778005200 2023-07-06T02:40:25.121 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:25.112+0000 7f578dffb700 1 -- 172.21.15.46:0/3532492095 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f577800c2a0 con 0x7f5778004850 2023-07-06T02:40:25.121 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:25.112+0000 7f578effd700 1 --2- 172.21.15.46:0/3532492095 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5778003a50 0x7f5778003e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T02:40:25.121 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:25.112+0000 7f578e7fc700 1 --2- 172.21.15.46:0/3532492095 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f5778004850 0x7f5778004cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T02:40:25.121 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:25.112+0000 7f578f7fe700 1 --2- 172.21.15.46:0/3532492095 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5778005200 0x7f577800ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T02:40:25.121 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:25.112+0000 7f578effd700 1 -- 172.21.15.46:0/3532492095 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f5778004850 msgr2=0x7f5778004cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T02:40:25.122 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:25.112+0000 7f578effd700 1 --2- 172.21.15.46:0/3532492095 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f5778004850 0x7f5778004cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T02:40:25.122 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:25.112+0000 7f578effd700 1 -- 172.21.15.46:0/3532492095 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5778005200 msgr2=0x7f577800ba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T02:40:25.122 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:25.112+0000 7f578effd700 1 --2- 172.21.15.46:0/3532492095 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5778005200 0x7f577800ba10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T02:40:25.122 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:25.112+0000 7f578f7fe700 1 -- 172.21.15.46:0/3532492095 reap_dead start 2023-07-06T02:40:25.122 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:25.112+0000 7f578effd700 1 -- 172.21.15.46:0/3532492095 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f57780035b0 con 0x7f5778003a50 2023-07-06T02:40:25.123 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:25.113+0000 7f578effd700 1 --2- 172.21.15.46:0/3532492095 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5778003a50 0x7f5778003e60 secure :-1 s=READY pgs=3254 cs=0 l=1 rev1=1 crypto rx=0x7f5780001eb0 tx=0x7f5778005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=67d882d84f8c0d33 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T02:40:25.123 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:25.113+0000 7f578dffb700 1 -- 172.21.15.46:0/3532492095 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5780007b70 con 0x7f5778003a50 2023-07-06T02:40:25.123 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:25.113+0000 7f578dffb700 1 -- 172.21.15.46:0/3532492095 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f578000cc70 con 0x7f5778003a50 2023-07-06T02:40:25.123 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:25.113+0000 7f578dffb700 1 -- 172.21.15.46:0/3532492095 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5780005960 con 0x7f5778003a50 2023-07-06T02:40:25.126 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:25.113+0000 7f57959ba700 1 -- 172.21.15.46:0/3532492095 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5778003a50 msgr2=0x7f5778003e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T02:40:25.126 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:25.113+0000 7f57959ba700 1 --2- 172.21.15.46:0/3532492095 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5778003a50 0x7f5778003e60 secure :-1 s=READY pgs=3254 cs=0 l=1 rev1=1 crypto rx=0x7f5780001eb0 tx=0x7f5778005880 comp rx=0 tx=0).stop 2023-07-06T02:40:25.126 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:25.113+0000 7f57959ba700 1 -- 172.21.15.46:0/3532492095 shutdown_connections 2023-07-06T02:40:25.126 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:25.113+0000 7f57959ba700 1 --2- 172.21.15.46:0/3532492095 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5778003a50 0x7f5778003e60 unknown :-1 s=CLOSED pgs=3254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T02:40:25.127 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:25.113+0000 7f57959ba700 1 -- 172.21.15.46:0/3532492095 >> 172.21.15.46:0/3532492095 conn(0x7f579006a3a0 msgr2=0x7f579006a770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T02:40:25.127 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:25.113+0000 7f57959ba700 1 -- 172.21.15.46:0/3532492095 shutdown_connections 2023-07-06T02:40:25.127 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:25.113+0000 7f57959ba700 1 -- 172.21.15.46:0/3532492095 wait complete. 2023-07-06T02:40:25.127 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:25.115+0000 7f57959ba700 1 Processor -- start 2023-07-06T02:40:25.127 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:25.115+0000 7f57959ba700 1 -- start start 2023-07-06T02:40:25.128 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:25.115+0000 7f57959ba700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5778003a50 0x7f57900b6dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T02:40:25.128 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:25.115+0000 7f57959ba700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5790156360 0x7f5790153df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T02:40:25.128 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:25.115+0000 7f57959ba700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f57901f54e0 0x7f5790154330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T02:40:25.129 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:25.115+0000 7f57959ba700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57901f30b0 con 0x7f5778003a50 2023-07-06T02:40:25.129 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:25.115+0000 7f57959ba700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5790154870 con 0x7f5790156360 2023-07-06T02:40:25.129 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:25.115+0000 7f57959ba700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f57901f59e0 con 0x7f57901f54e0 2023-07-06T02:40:25.129 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:25.116+0000 7f578effd700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5778003a50 0x7f57900b6dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T02:40:25.129 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:25.116+0000 7f578effd700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5778003a50 0x7f57900b6dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:46132/0 (socket says 172.21.15.46:46132) 2023-07-06T02:40:25.129 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:25.116+0000 7f578effd700 1 -- 172.21.15.46:0/606072253 learned_addr learned my addr 172.21.15.46:0/606072253 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-07-06T02:40:25.130 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:25.116+0000 7f578e7fc700 1 --2- 172.21.15.46:0/606072253 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5790156360 0x7f5790153df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T02:40:25.130 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:25.116+0000 7f578f7fe700 1 --2- 172.21.15.46:0/606072253 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f57901f54e0 0x7f5790154330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T02:40:25.130 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:25.116+0000 7f578effd700 1 -- 172.21.15.46:0/606072253 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f57901f54e0 msgr2=0x7f5790154330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T02:40:25.130 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:25.116+0000 7f578effd700 1 --2- 172.21.15.46:0/606072253 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f57901f54e0 0x7f5790154330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T02:40:25.130 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:25.116+0000 7f578effd700 1 -- 172.21.15.46:0/606072253 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5790156360 msgr2=0x7f5790153df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T02:40:25.131 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:25.116+0000 7f578effd700 1 --2- 172.21.15.46:0/606072253 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5790156360 0x7f5790153df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T02:40:25.131 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:25.116+0000 7f578effd700 1 -- 172.21.15.46:0/606072253 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f57901f5cc0 con 0x7f5778003a50 2023-07-06T02:40:25.131 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:25.116+0000 7f578e7fc700 1 --2- 172.21.15.46:0/606072253 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5790156360 0x7f5790153df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-06T02:40:25.131 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:25.116+0000 7f578effd700 1 --2- 172.21.15.46:0/606072253 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5778003a50 0x7f57900b6dd0 secure :-1 s=READY pgs=3255 cs=0 l=1 rev1=1 crypto rx=0x7f578000c720 tx=0x7f5780001930 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T02:40:25.131 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:25.116+0000 7f5777fff700 1 -- 172.21.15.46:0/606072253 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5780004c80 con 0x7f5778003a50 2023-07-06T02:40:25.132 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:25.116+0000 7f5777fff700 1 -- 172.21.15.46:0/606072253 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5780004de0 con 0x7f5778003a50 2023-07-06T02:40:25.132 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:25.116+0000 7f57959ba700 1 -- 172.21.15.46:0/606072253 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f57901f5fa0 con 0x7f5778003a50 2023-07-06T02:40:25.132 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:25.116+0000 7f5777fff700 1 -- 172.21.15.46:0/606072253 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57800072f0 con 0x7f5778003a50 2023-07-06T02:40:25.132 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:25.116+0000 7f57959ba700 1 -- 172.21.15.46:0/606072253 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f57900b7310 con 0x7f5778003a50 2023-07-06T02:40:25.132 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:25.117+0000 7f57959ba700 1 -- 172.21.15.46:0/606072253 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f57900cd770 con 0x7f5778003a50 2023-07-06T02:40:25.133 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:25.118+0000 7f5777fff700 1 -- 172.21.15.46:0/606072253 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f5780007450 con 0x7f5778003a50 2023-07-06T02:40:25.133 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:25.118+0000 7f5777fff700 1 --2- 172.21.15.46:0/606072253 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7f577c06ace0 0x7f577c06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T02:40:25.133 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:25.119+0000 7f5777fff700 1 -- 172.21.15.46:0/606072253 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 5296+0+0 (secure 0 0 0) 0x7f578008a190 con 0x7f5778003a50 2023-07-06T02:40:25.133 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:25.119+0000 7f5777fff700 1 --2- 172.21.15.46:0/606072253 >> [v2:172.21.15.46:6808/502575881,v1:172.21.15.46:6809/502575881] conn(0x7f577c071150 0x7f577c073560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T02:40:25.133 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:25.119+0000 7f5777fff700 1 -- 172.21.15.46:0/606072253 --> [v2:172.21.15.46:6808/502575881,v1:172.21.15.46:6809/502575881] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f577c073c30 con 0x7f577c071150 2023-07-06T02:40:25.134 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:25.119+0000 7f5777fff700 1 -- 172.21.15.46:0/606072253 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_get_version_reply(handle=1 version=40) v2 ==== 24+0+0 (secure 0 0 0) 0x7f578008a5c0 con 0x7f5778003a50 2023-07-06T02:40:25.134 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:25.119+0000 7f578e7fc700 1 --2- 172.21.15.46:0/606072253 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7f577c06ace0 0x7f577c06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T02:40:25.134 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:25.119+0000 7f578f7fe700 1 --2- 172.21.15.46:0/606072253 >> [v2:172.21.15.46:6808/502575881,v1:172.21.15.46:6809/502575881] conn(0x7f577c071150 0x7f577c073560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T02:40:25.134 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:25.119+0000 7f578f7fe700 1 --2- 172.21.15.46:0/606072253 >> [v2:172.21.15.46:6808/502575881,v1:172.21.15.46:6809/502575881] conn(0x7f577c071150 0x7f577c073560 crc :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T02:40:25.134 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:25.119+0000 7f578e7fc700 1 --2- 172.21.15.46:0/606072253 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7f577c06ace0 0x7f577c06d190 secure :-1 s=READY pgs=739 cs=0 l=1 rev1=1 crypto rx=0x7f5790156730 tx=0x7f5784009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T02:40:25.135 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:25.120+0000 7f5777fff700 1 -- 172.21.15.46:0/606072253 <== osd.1 v2:172.21.15.46:6808/502575881 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7f577c073c30 con 0x7f577c071150 2023-07-06T02:40:25.138 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:25.135+0000 7f57959ba700 1 -- 172.21.15.46:0/606072253 --> [v2:172.21.15.46:6808/502575881,v1:172.21.15.46:6809/502575881] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f57901f3350 con 0x7f577c071150 2023-07-06T02:40:25.138 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:25.135+0000 7f5777fff700 1 -- 172.21.15.46:0/606072253 <== osd.1 v2:172.21.15.46:6808/502575881 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7f57901f3350 con 0x7f577c071150 2023-07-06T02:40:25.139 INFO:teuthology.orchestra.run.smithi046.stdout:{ 2023-07-06T02:40:25.139 INFO:teuthology.orchestra.run.smithi046.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-07-06T02:40:25.139 INFO:teuthology.orchestra.run.smithi046.stdout:} 2023-07-06T02:40:25.140 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:25.136+0000 7f57959ba700 1 -- 172.21.15.46:0/606072253 >> [v2:172.21.15.46:6808/502575881,v1:172.21.15.46:6809/502575881] conn(0x7f577c071150 msgr2=0x7f577c073560 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T02:40:25.140 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:25.136+0000 7f57959ba700 1 --2- 172.21.15.46:0/606072253 >> [v2:172.21.15.46:6808/502575881,v1:172.21.15.46:6809/502575881] conn(0x7f577c071150 0x7f577c073560 crc :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T02:40:25.141 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:25.136+0000 7f57959ba700 1 -- 172.21.15.46:0/606072253 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7f577c06ace0 msgr2=0x7f577c06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T02:40:25.141 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:25.136+0000 7f57959ba700 1 --2- 172.21.15.46:0/606072253 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7f577c06ace0 0x7f577c06d190 secure :-1 s=READY pgs=739 cs=0 l=1 rev1=1 crypto rx=0x7f5790156730 tx=0x7f5784009040 comp rx=0 tx=0).stop 2023-07-06T02:40:25.141 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:25.136+0000 7f57959ba700 1 -- 172.21.15.46:0/606072253 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5778003a50 msgr2=0x7f57900b6dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T02:40:25.141 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:25.136+0000 7f57959ba700 1 --2- 172.21.15.46:0/606072253 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5778003a50 0x7f57900b6dd0 secure :-1 s=READY pgs=3255 cs=0 l=1 rev1=1 crypto rx=0x7f578000c720 tx=0x7f5780001930 comp rx=0 tx=0).stop 2023-07-06T02:40:25.142 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:25.136+0000 7f578f7fe700 1 -- 172.21.15.46:0/606072253 reap_dead start 2023-07-06T02:40:25.142 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:25.136+0000 7f57959ba700 1 -- 172.21.15.46:0/606072253 shutdown_connections 2023-07-06T02:40:25.142 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:25.136+0000 7f57959ba700 1 -- 172.21.15.46:0/606072253 >> 172.21.15.46:0/606072253 conn(0x7f579006a3a0 msgr2=0x7f579006a770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T02:40:25.142 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:25.136+0000 7f57959ba700 1 -- 172.21.15.46:0/606072253 shutdown_connections 2023-07-06T02:40:25.142 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:25.136+0000 7f57959ba700 1 -- 172.21.15.46:0/606072253 wait complete. 2023-07-06T02:40:25.152 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 1 2023-07-06T02:40:25.289 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:25.286+0000 7fba16802700 1 Processor -- start 2023-07-06T02:40:25.289 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:25.286+0000 7fba16802700 1 -- start start 2023-07-06T02:40:25.291 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:25.287+0000 7fba16802700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fba1015c6c0 0x7fba100cd2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T02:40:25.291 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:25.287+0000 7fba16802700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fba100b5ae0 0x7fba100b5f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T02:40:25.291 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:25.287+0000 7fba16802700 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fba100cd8c0 con 0x7fba1015c2f0 2023-07-06T02:40:25.291 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:25.287+0000 7fba16802700 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fba100d0990 con 0x7fba100b5ae0 2023-07-06T02:40:25.292 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:25.287+0000 7fba16802700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fba100d0c70 con 0x7fba1015c6c0 2023-07-06T02:40:25.292 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:25.287+0000 7fba14d9f700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fba100b5ae0 0x7fba100b5f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T02:40:25.292 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:25.287+0000 7fba14d9f700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fba100b5ae0 0x7fba100b5f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:46146/0 (socket says 172.21.15.46:46146) 2023-07-06T02:40:25.292 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:25.287+0000 7fba14d9f700 1 -- 172.21.15.46:0/750976930 learned_addr learned my addr 172.21.15.46:0/750976930 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-07-06T02:40:25.292 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:25.287+0000 7fba0f7fe700 1 --2- 172.21.15.46:0/750976930 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fba1015c6c0 0x7fba100cd2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T02:40:25.293 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:25.287+0000 7fba14d9f700 1 -- 172.21.15.46:0/750976930 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fba1015c6c0 msgr2=0x7fba100cd2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T02:40:25.293 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:25.287+0000 7fba14d9f700 1 --2- 172.21.15.46:0/750976930 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fba1015c6c0 0x7fba100cd2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T02:40:25.293 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:25.287+0000 7fba14d9f700 1 -- 172.21.15.46:0/750976930 >> v1:172.21.15.73:6789/0 conn(0x7fba1015c2f0 legacy=0x7fba1006c760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T02:40:25.293 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:25.287+0000 7fba14d9f700 1 -- 172.21.15.46:0/750976930 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fba100d0f50 con 0x7fba100b5ae0 2023-07-06T02:40:25.293 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:25.288+0000 7fba14d9f700 1 --2- 172.21.15.46:0/750976930 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fba100b5ae0 0x7fba100b5f00 secure :-1 s=READY pgs=3256 cs=0 l=1 rev1=1 crypto rx=0x7fba08009e50 tx=0x7fba0800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ad09a99a7697d4d8 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T02:40:25.294 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:25.288+0000 7fba0effd700 1 -- 172.21.15.46:0/750976930 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba0800e070 con 0x7fba100b5ae0 2023-07-06T02:40:25.294 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:25.288+0000 7fba0effd700 1 -- 172.21.15.46:0/750976930 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fba08003a20 con 0x7fba100b5ae0 2023-07-06T02:40:25.294 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:25.288+0000 7fba0effd700 1 -- 172.21.15.46:0/750976930 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba08003dd0 con 0x7fba100b5ae0 2023-07-06T02:40:25.296 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:25.288+0000 7fba16802700 1 -- 172.21.15.46:0/750976930 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fba100b5ae0 msgr2=0x7fba100b5f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T02:40:25.297 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:25.288+0000 7fba16802700 1 --2- 172.21.15.46:0/750976930 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fba100b5ae0 0x7fba100b5f00 secure :-1 s=READY pgs=3256 cs=0 l=1 rev1=1 crypto rx=0x7fba08009e50 tx=0x7fba0800b330 comp rx=0 tx=0).stop 2023-07-06T02:40:25.297 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:25.288+0000 7fba16802700 1 -- 172.21.15.46:0/750976930 shutdown_connections 2023-07-06T02:40:25.297 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:25.288+0000 7fba16802700 1 --2- 172.21.15.46:0/750976930 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fba100b5ae0 0x7fba100b5f00 unknown :-1 s=CLOSED pgs=3256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T02:40:25.297 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:25.288+0000 7fba16802700 1 --2- 172.21.15.46:0/750976930 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fba1015c6c0 0x7fba100cd2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T02:40:25.297 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:25.288+0000 7fba16802700 1 -- 172.21.15.46:0/750976930 >> 172.21.15.46:0/750976930 conn(0x7fba1006afa0 msgr2=0x7fba100cf710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T02:40:25.298 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:25.288+0000 7fba16802700 1 -- 172.21.15.46:0/750976930 shutdown_connections 2023-07-06T02:40:25.298 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:25.288+0000 7fba16802700 1 -- 172.21.15.46:0/750976930 wait complete. 2023-07-06T02:40:25.298 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:25.290+0000 7fba16802700 1 Processor -- start 2023-07-06T02:40:25.298 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:25.290+0000 7fba16802700 1 -- start start 2023-07-06T02:40:25.298 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:25.290+0000 7fba16802700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fba100b5ae0 0x7fba100c94e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T02:40:25.298 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:25.290+0000 7fba16802700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fba1015c2f0 0x7fba1015a5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T02:40:25.299 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:25.290+0000 7fba16802700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fba1015c6c0 0x7fba101e6df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T02:40:25.299 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:25.290+0000 7fba16802700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba1015aae0 con 0x7fba100b5ae0 2023-07-06T02:40:25.299 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:25.290+0000 7fba16802700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba101e4e40 con 0x7fba1015c6c0 2023-07-06T02:40:25.299 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:25.290+0000 7fba16802700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fba101e5120 con 0x7fba1015c2f0 2023-07-06T02:40:25.299 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:25.291+0000 7fba0ffff700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fba100b5ae0 0x7fba100c94e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T02:40:25.300 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:25.291+0000 7fba0ffff700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fba100b5ae0 0x7fba100c94e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:46148/0 (socket says 172.21.15.46:46148) 2023-07-06T02:40:25.300 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:25.291+0000 7fba0ffff700 1 -- 172.21.15.46:0/3002357366 learned_addr learned my addr 172.21.15.46:0/3002357366 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-07-06T02:40:25.300 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:25.291+0000 7fba14d9f700 1 --2- 172.21.15.46:0/3002357366 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fba1015c6c0 0x7fba101e6df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T02:40:25.300 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:25.291+0000 7fba0f7fe700 1 --2- 172.21.15.46:0/3002357366 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fba1015c2f0 0x7fba1015a5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T02:40:25.300 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:25.291+0000 7fba0ffff700 1 -- 172.21.15.46:0/3002357366 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fba1015c2f0 msgr2=0x7fba1015a5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T02:40:25.301 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:25.291+0000 7fba0ffff700 1 --2- 172.21.15.46:0/3002357366 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fba1015c2f0 0x7fba1015a5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T02:40:25.301 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:25.291+0000 7fba0ffff700 1 -- 172.21.15.46:0/3002357366 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fba1015c6c0 msgr2=0x7fba101e6df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T02:40:25.301 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:25.291+0000 7fba0ffff700 1 --2- 172.21.15.46:0/3002357366 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fba1015c6c0 0x7fba101e6df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T02:40:25.301 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:25.291+0000 7fba0ffff700 1 -- 172.21.15.46:0/3002357366 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fba08009b30 con 0x7fba100b5ae0 2023-07-06T02:40:25.301 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:25.291+0000 7fba0ffff700 1 --2- 172.21.15.46:0/3002357366 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fba100b5ae0 0x7fba100c94e0 secure :-1 s=READY pgs=3257 cs=0 l=1 rev1=1 crypto rx=0x7fba0000c4a0 tx=0x7fba0000c7b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T02:40:25.302 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:25.291+0000 7fba0cff9700 1 -- 172.21.15.46:0/3002357366 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba000054e0 con 0x7fba100b5ae0 2023-07-06T02:40:25.302 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:25.291+0000 7fba0cff9700 1 -- 172.21.15.46:0/3002357366 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fba00003680 con 0x7fba100b5ae0 2023-07-06T02:40:25.302 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:25.291+0000 7fba16802700 1 -- 172.21.15.46:0/3002357366 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fba101e5400 con 0x7fba100b5ae0 2023-07-06T02:40:25.302 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:25.291+0000 7fba0cff9700 1 -- 172.21.15.46:0/3002357366 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba00003a30 con 0x7fba100b5ae0 2023-07-06T02:40:25.302 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:25.291+0000 7fba16802700 1 -- 172.21.15.46:0/3002357366 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fba1015b450 con 0x7fba100b5ae0 2023-07-06T02:40:25.303 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:25.292+0000 7fba16802700 1 -- 172.21.15.46:0/3002357366 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fba1004e1d0 con 0x7fba100b5ae0 2023-07-06T02:40:25.303 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:25.293+0000 7fba0cff9700 1 -- 172.21.15.46:0/3002357366 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fba00003b90 con 0x7fba100b5ae0 2023-07-06T02:40:25.303 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:25.293+0000 7fba0cff9700 1 --2- 172.21.15.46:0/3002357366 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7fb9fc06ace0 0x7fb9fc06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T02:40:25.303 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:25.293+0000 7fba0cff9700 1 -- 172.21.15.46:0/3002357366 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 5296+0+0 (secure 0 0 0) 0x7fba00088590 con 0x7fba100b5ae0 2023-07-06T02:40:25.303 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:25.294+0000 7fba0f7fe700 1 --2- 172.21.15.46:0/3002357366 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7fb9fc06ace0 0x7fb9fc06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T02:40:25.304 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:25.294+0000 7fba0f7fe700 1 --2- 172.21.15.46:0/3002357366 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7fb9fc06ace0 0x7fb9fc06d190 secure :-1 s=READY pgs=740 cs=0 l=1 rev1=1 crypto rx=0x7fba100d2be0 tx=0x7fba04008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T02:40:25.304 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:25.298+0000 7fba0cff9700 1 -- 172.21.15.46:0/3002357366 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fba00053940 con 0x7fba100b5ae0 2023-07-06T02:40:25.507 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:25.504+0000 7fba16802700 1 -- 172.21.15.46:0/3002357366 --> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "1", "target": ["mon-mgr", ""]}) v1 -- 0x7fba100cdba0 con 0x7fb9fc06ace0 2023-07-06T02:40:25.508 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:25.505+0000 7fba0cff9700 1 -- 172.21.15.46:0/3002357366 <== mgr.4099 v2:172.21.15.73:6832/3033361733 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 1 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7fba040076d0 con 0x7fb9fc06ace0 2023-07-06T02:40:25.510 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:25.507+0000 7fba16802700 1 -- 172.21.15.46:0/3002357366 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7fb9fc06ace0 msgr2=0x7fb9fc06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T02:40:25.511 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:25.507+0000 7fba16802700 1 --2- 172.21.15.46:0/3002357366 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7fb9fc06ace0 0x7fb9fc06d190 secure :-1 s=READY pgs=740 cs=0 l=1 rev1=1 crypto rx=0x7fba100d2be0 tx=0x7fba04008040 comp rx=0 tx=0).stop 2023-07-06T02:40:25.511 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:25.507+0000 7fba16802700 1 -- 172.21.15.46:0/3002357366 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fba100b5ae0 msgr2=0x7fba100c94e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T02:40:25.511 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:25.507+0000 7fba16802700 1 --2- 172.21.15.46:0/3002357366 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fba100b5ae0 0x7fba100c94e0 secure :-1 s=READY pgs=3257 cs=0 l=1 rev1=1 crypto rx=0x7fba0000c4a0 tx=0x7fba0000c7b0 comp rx=0 tx=0).stop 2023-07-06T02:40:25.511 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:25.507+0000 7fba16802700 1 -- 172.21.15.46:0/3002357366 shutdown_connections 2023-07-06T02:40:25.511 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:25.507+0000 7fba16802700 1 --2- 172.21.15.46:0/3002357366 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7fb9fc06ace0 0x7fb9fc06d190 unknown :-1 s=CLOSED pgs=740 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T02:40:25.512 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:25.507+0000 7fba16802700 1 --2- 172.21.15.46:0/3002357366 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fba1015c6c0 0x7fba101e6df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T02:40:25.512 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:25.507+0000 7fba16802700 1 --2- 172.21.15.46:0/3002357366 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fba100b5ae0 0x7fba100c94e0 unknown :-1 s=CLOSED pgs=3257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T02:40:25.512 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:25.507+0000 7fba16802700 1 --2- 172.21.15.46:0/3002357366 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fba1015c2f0 0x7fba1015a5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T02:40:25.512 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:25.507+0000 7fba16802700 1 -- 172.21.15.46:0/3002357366 >> 172.21.15.46:0/3002357366 conn(0x7fba1006afa0 msgr2=0x7fba1015e4f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T02:40:25.513 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:25.508+0000 7fba16802700 1 -- 172.21.15.46:0/3002357366 shutdown_connections 2023-07-06T02:40:25.513 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:25.508+0000 7fba16802700 1 -- 172.21.15.46:0/3002357366 wait complete. 2023-07-06T02:40:25.513 INFO:teuthology.orchestra.run.smithi046.stderr:instructed osd(s) 1 to deep-scrub 2023-07-06T02:40:25.524 INFO:tasks.ceph:Scrubbing osd.2 2023-07-06T02:40:25.525 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 config set osd_debug_deep_scrub_sleep 0 2023-07-06T02:40:25.665 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:25.662+0000 7faad6c47700 1 Processor -- start 2023-07-06T02:40:25.666 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:25.662+0000 7faad6c47700 1 -- start start 2023-07-06T02:40:25.667 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:25.663+0000 7faad6c47700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7faad00b8540 0x7faad00d08b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T02:40:25.667 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:25.663+0000 7faad6c47700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7faad01609f0 0x7faad00cf660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T02:40:25.667 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:25.663+0000 7faad6c47700 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faad00cf1d0 con 0x7faad00cfba0 2023-07-06T02:40:25.668 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:25.663+0000 7faad6c47700 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faad00cda50 con 0x7faad00b8540 2023-07-06T02:40:25.668 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:25.663+0000 7faad6c47700 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faad00b8910 con 0x7faad01609f0 2023-07-06T02:40:25.668 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:25.663+0000 7faad49e3700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7faad00b8540 0x7faad00d08b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T02:40:25.668 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:25.663+0000 7faad51e4700 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7faad00cfba0 0x7faad00d2c70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:45428/0 (socket says 172.21.15.46:45428) 2023-07-06T02:40:25.668 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:25.663+0000 7faad51e4700 1 -- 172.21.15.46:0/2453370931 learned_addr learned my addr 172.21.15.46:0/2453370931 (peer_addr_for_me v1:172.21.15.46:0/0) 2023-07-06T02:40:25.669 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:25.663+0000 7faacffff700 1 --2- 172.21.15.46:0/2453370931 >> v2:172.21.15.73:3300/0 conn(0x7faad01609f0 0x7faad00cf660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T02:40:25.669 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:25.664+0000 7faad49e3700 1 -- 172.21.15.46:0/2453370931 >> v2:172.21.15.73:3300/0 conn(0x7faad01609f0 msgr2=0x7faad00cf660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T02:40:25.669 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:25.664+0000 7faad49e3700 1 --2- 172.21.15.46:0/2453370931 >> v2:172.21.15.73:3300/0 conn(0x7faad01609f0 0x7faad00cf660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T02:40:25.669 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:25.664+0000 7faad49e3700 1 -- 172.21.15.46:0/2453370931 >> v1:172.21.15.46:6789/0 conn(0x7faad00cfba0 legacy=0x7faad00d2c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T02:40:25.669 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:25.664+0000 7faad49e3700 1 -- 172.21.15.46:0/2453370931 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faad00cd4b0 con 0x7faad00b8540 2023-07-06T02:40:25.670 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:25.664+0000 7faacf7fe700 1 -- 172.21.15.46:0/2453370931 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 323807908 0 0) 0x7faad00cf1d0 con 0x7faad00cfba0 2023-07-06T02:40:25.670 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:25.664+0000 7faad49e3700 1 --2- 172.21.15.46:0/2453370931 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7faad00b8540 0x7faad00d08b0 secure :-1 s=READY pgs=3259 cs=0 l=1 rev1=1 crypto rx=0x7faad00d0350 tx=0x7faac0009b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4cb92ce26f803645 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T02:40:25.670 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:25.664+0000 7faacf7fe700 1 -- 172.21.15.46:0/2453370931 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faac0011830 con 0x7faad00b8540 2023-07-06T02:40:25.670 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:25.664+0000 7faacf7fe700 1 -- 172.21.15.46:0/2453370931 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faac0011990 con 0x7faad00b8540 2023-07-06T02:40:25.670 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:25.664+0000 7faacf7fe700 1 -- 172.21.15.46:0/2453370931 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faac0011d20 con 0x7faad00b8540 2023-07-06T02:40:25.673 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:25.665+0000 7faad6c47700 1 -- 172.21.15.46:0/2453370931 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7faad00b8540 msgr2=0x7faad00d08b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T02:40:25.674 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:25.665+0000 7faad6c47700 1 --2- 172.21.15.46:0/2453370931 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7faad00b8540 0x7faad00d08b0 secure :-1 s=READY pgs=3259 cs=0 l=1 rev1=1 crypto rx=0x7faad00d0350 tx=0x7faac0009b20 comp rx=0 tx=0).stop 2023-07-06T02:40:25.674 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:25.665+0000 7faad6c47700 1 -- 172.21.15.46:0/2453370931 shutdown_connections 2023-07-06T02:40:25.674 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:25.665+0000 7faad6c47700 1 --2- 172.21.15.46:0/2453370931 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7faad00b8540 0x7faad00d08b0 unknown :-1 s=CLOSED pgs=3259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T02:40:25.674 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:25.665+0000 7faad6c47700 1 --2- 172.21.15.46:0/2453370931 >> v2:172.21.15.73:3300/0 conn(0x7faad01609f0 0x7faad00cf660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T02:40:25.674 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:25.665+0000 7faad6c47700 1 -- 172.21.15.46:0/2453370931 >> 172.21.15.46:0/2453370931 conn(0x7faad006a3a0 msgr2=0x7faad006a770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T02:40:25.675 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:25.665+0000 7faad6c47700 1 -- 172.21.15.46:0/2453370931 shutdown_connections 2023-07-06T02:40:25.675 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:25.665+0000 7faad6c47700 1 -- 172.21.15.46:0/2453370931 wait complete. 2023-07-06T02:40:25.675 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:25.666+0000 7faad6c47700 1 Processor -- start 2023-07-06T02:40:25.675 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:25.666+0000 7faad6c47700 1 -- start start 2023-07-06T02:40:25.675 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:25.667+0000 7faad6c47700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7faad00b8540 0x7faad0154c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T02:40:25.675 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:25.667+0000 7faad6c47700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7faad00cfba0 0x7faad0154100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T02:40:25.676 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:25.667+0000 7faad6c47700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7faad01609f0 0x7faad00b5e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T02:40:25.676 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:25.667+0000 7faad6c47700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faad0158060 con 0x7faad01609f0 2023-07-06T02:40:25.676 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:25.667+0000 7faad6c47700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faad0154640 con 0x7faad00cfba0 2023-07-06T02:40:25.676 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:25.667+0000 7faad6c47700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faad01557b0 con 0x7faad00b8540 2023-07-06T02:40:25.676 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:25.667+0000 7faad51e4700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7faad01609f0 0x7faad00b5e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T02:40:25.677 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:25.667+0000 7faad51e4700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7faad01609f0 0x7faad00b5e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:46166/0 (socket says 172.21.15.46:46166) 2023-07-06T02:40:25.677 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:25.667+0000 7faad51e4700 1 -- 172.21.15.46:0/1712511509 learned_addr learned my addr 172.21.15.46:0/1712511509 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-07-06T02:40:25.677 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:25.667+0000 7faad49e3700 1 --2- 172.21.15.46:0/1712511509 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7faad00b8540 0x7faad0154c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T02:40:25.677 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:25.667+0000 7faacffff700 1 --2- 172.21.15.46:0/1712511509 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7faad00cfba0 0x7faad0154100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T02:40:25.677 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:25.667+0000 7faad51e4700 1 -- 172.21.15.46:0/1712511509 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7faad00b8540 msgr2=0x7faad0154c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T02:40:25.678 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:25.667+0000 7faad51e4700 1 --2- 172.21.15.46:0/1712511509 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7faad00b8540 0x7faad0154c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T02:40:25.678 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:25.667+0000 7faad51e4700 1 -- 172.21.15.46:0/1712511509 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7faad00cfba0 msgr2=0x7faad0154100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T02:40:25.678 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:25.667+0000 7faad51e4700 1 --2- 172.21.15.46:0/1712511509 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7faad00cfba0 0x7faad0154100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T02:40:25.678 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:25.667+0000 7faad51e4700 1 -- 172.21.15.46:0/1712511509 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faac00094a0 con 0x7faad01609f0 2023-07-06T02:40:25.678 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:25.667+0000 7faacffff700 1 --2- 172.21.15.46:0/1712511509 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7faad00cfba0 0x7faad0154100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-06T02:40:25.679 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:25.667+0000 7faad49e3700 1 --2- 172.21.15.46:0/1712511509 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7faad00b8540 0x7faad0154c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-06T02:40:25.679 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:25.667+0000 7faad51e4700 1 --2- 172.21.15.46:0/1712511509 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7faad01609f0 0x7faad00b5e90 secure :-1 s=READY pgs=3260 cs=0 l=1 rev1=1 crypto rx=0x7faac8002230 tx=0x7faac800a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T02:40:25.679 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:25.668+0000 7faacd7fa700 1 -- 172.21.15.46:0/1712511509 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faac800ac20 con 0x7faad01609f0 2023-07-06T02:40:25.679 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:25.668+0000 7faacd7fa700 1 -- 172.21.15.46:0/1712511509 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faac800ada0 con 0x7faad01609f0 2023-07-06T02:40:25.679 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:25.668+0000 7faad6c47700 1 -- 172.21.15.46:0/1712511509 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faad0155a90 con 0x7faad01609f0 2023-07-06T02:40:25.680 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:25.668+0000 7faacd7fa700 1 -- 172.21.15.46:0/1712511509 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faac8007310 con 0x7faad01609f0 2023-07-06T02:40:25.680 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:25.668+0000 7faad6c47700 1 -- 172.21.15.46:0/1712511509 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faad0155d70 con 0x7faad01609f0 2023-07-06T02:40:25.680 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:25.669+0000 7faad6c47700 1 -- 172.21.15.46:0/1712511509 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7faad00d0000 con 0x7faad01609f0 2023-07-06T02:40:25.680 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:25.669+0000 7faacd7fa700 1 -- 172.21.15.46:0/1712511509 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7faac8007470 con 0x7faad01609f0 2023-07-06T02:40:25.680 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:25.670+0000 7faacd7fa700 1 --2- 172.21.15.46:0/1712511509 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7faabc06ace0 0x7faabc06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T02:40:25.681 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:25.670+0000 7faacd7fa700 1 -- 172.21.15.46:0/1712511509 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 5296+0+0 (secure 0 0 0) 0x7faac8088c90 con 0x7faad01609f0 2023-07-06T02:40:25.681 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:25.670+0000 7faacd7fa700 1 --2- 172.21.15.46:0/1712511509 >> [v2:172.21.15.46:6800/2115251461,v1:172.21.15.46:6801/2115251461] conn(0x7faabc071150 0x7faabc073560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T02:40:25.681 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:25.670+0000 7faad49e3700 1 --2- 172.21.15.46:0/1712511509 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7faabc06ace0 0x7faabc06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T02:40:25.681 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:25.670+0000 7faacd7fa700 1 -- 172.21.15.46:0/1712511509 --> [v2:172.21.15.46:6800/2115251461,v1:172.21.15.46:6801/2115251461] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7faabc073c30 con 0x7faabc071150 2023-07-06T02:40:25.681 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:25.670+0000 7faacd7fa700 1 -- 172.21.15.46:0/1712511509 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_get_version_reply(handle=1 version=40) v2 ==== 24+0+0 (secure 0 0 0) 0x7faac808b330 con 0x7faad01609f0 2023-07-06T02:40:25.682 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:25.670+0000 7faacffff700 1 --2- 172.21.15.46:0/1712511509 >> [v2:172.21.15.46:6800/2115251461,v1:172.21.15.46:6801/2115251461] conn(0x7faabc071150 0x7faabc073560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T02:40:25.682 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:25.670+0000 7faad49e3700 1 --2- 172.21.15.46:0/1712511509 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7faabc06ace0 0x7faabc06d190 secure :-1 s=READY pgs=741 cs=0 l=1 rev1=1 crypto rx=0x7faac00090b0 tx=0x7faac0008030 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T02:40:25.682 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:25.671+0000 7faacffff700 1 --2- 172.21.15.46:0/1712511509 >> [v2:172.21.15.46:6800/2115251461,v1:172.21.15.46:6801/2115251461] conn(0x7faabc071150 0x7faabc073560 crc :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T02:40:25.682 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:25.671+0000 7faacd7fa700 1 -- 172.21.15.46:0/1712511509 <== osd.2 v2:172.21.15.46:6800/2115251461 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7faabc073c30 con 0x7faabc071150 2023-07-06T02:40:25.689 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:25.687+0000 7faad6c47700 1 -- 172.21.15.46:0/1712511509 --> [v2:172.21.15.46:6800/2115251461,v1:172.21.15.46:6801/2115251461] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7faad00cd770 con 0x7faabc071150 2023-07-06T02:40:25.690 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:25.687+0000 7faacd7fa700 1 -- 172.21.15.46:0/1712511509 <== osd.2 v2:172.21.15.46:6800/2115251461 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7faac4009b50 con 0x7faabc071150 2023-07-06T02:40:25.690 INFO:teuthology.orchestra.run.smithi046.stdout:{ 2023-07-06T02:40:25.690 INFO:teuthology.orchestra.run.smithi046.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-07-06T02:40:25.691 INFO:teuthology.orchestra.run.smithi046.stdout:} 2023-07-06T02:40:25.691 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:25.687+0000 7faad6c47700 1 -- 172.21.15.46:0/1712511509 >> [v2:172.21.15.46:6800/2115251461,v1:172.21.15.46:6801/2115251461] conn(0x7faabc071150 msgr2=0x7faabc073560 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T02:40:25.692 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:25.687+0000 7faad6c47700 1 --2- 172.21.15.46:0/1712511509 >> [v2:172.21.15.46:6800/2115251461,v1:172.21.15.46:6801/2115251461] conn(0x7faabc071150 0x7faabc073560 crc :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T02:40:25.692 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:25.687+0000 7faad6c47700 1 -- 172.21.15.46:0/1712511509 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7faabc06ace0 msgr2=0x7faabc06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T02:40:25.692 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:25.687+0000 7faad6c47700 1 --2- 172.21.15.46:0/1712511509 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7faabc06ace0 0x7faabc06d190 secure :-1 s=READY pgs=741 cs=0 l=1 rev1=1 crypto rx=0x7faac00090b0 tx=0x7faac0008030 comp rx=0 tx=0).stop 2023-07-06T02:40:25.692 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:25.687+0000 7faad6c47700 1 -- 172.21.15.46:0/1712511509 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7faad01609f0 msgr2=0x7faad00b5e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T02:40:25.693 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:25.687+0000 7faad6c47700 1 --2- 172.21.15.46:0/1712511509 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7faad01609f0 0x7faad00b5e90 secure :-1 s=READY pgs=3260 cs=0 l=1 rev1=1 crypto rx=0x7faac8002230 tx=0x7faac800a060 comp rx=0 tx=0).stop 2023-07-06T02:40:25.693 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:25.687+0000 7faad51e4700 1 -- 172.21.15.46:0/1712511509 reap_dead start 2023-07-06T02:40:25.693 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:25.687+0000 7faad6c47700 1 -- 172.21.15.46:0/1712511509 shutdown_connections 2023-07-06T02:40:25.693 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:25.687+0000 7faad6c47700 1 -- 172.21.15.46:0/1712511509 >> 172.21.15.46:0/1712511509 conn(0x7faad006a3a0 msgr2=0x7faad00d20f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T02:40:25.693 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:25.687+0000 7faad6c47700 1 -- 172.21.15.46:0/1712511509 shutdown_connections 2023-07-06T02:40:25.694 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:25.687+0000 7faad6c47700 1 -- 172.21.15.46:0/1712511509 wait complete. 2023-07-06T02:40:25.704 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 2 2023-07-06T02:40:25.840 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:25.837+0000 7fdbdfc70700 1 Processor -- start 2023-07-06T02:40:25.840 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:25.837+0000 7fdbdfc70700 1 -- start start 2023-07-06T02:40:25.842 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:25.838+0000 7fdbdfc70700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fdbd815c2f0 0x7fdbd80cd2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T02:40:25.842 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:25.838+0000 7fdbdfc70700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fdbd815c6c0 0x7fdbd806c760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T02:40:25.842 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:25.838+0000 7fdbdfc70700 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdbd80cd8c0 con 0x7fdbd80b5ae0 2023-07-06T02:40:25.842 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:25.838+0000 7fdbdfc70700 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdbd80d0990 con 0x7fdbd815c6c0 2023-07-06T02:40:25.843 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:25.838+0000 7fdbdfc70700 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdbd80d0c70 con 0x7fdbd815c2f0 2023-07-06T02:40:25.843 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:25.838+0000 7fdbdd20b700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fdbd815c6c0 0x7fdbd806c760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T02:40:25.843 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:25.838+0000 7fdbdd20b700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fdbd815c6c0 0x7fdbd806c760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:46172/0 (socket says 172.21.15.46:46172) 2023-07-06T02:40:25.843 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:25.838+0000 7fdbdd20b700 1 -- 172.21.15.46:0/1574339373 learned_addr learned my addr 172.21.15.46:0/1574339373 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-07-06T02:40:25.843 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:25.839+0000 7fdbdda0c700 1 --2- 172.21.15.46:0/1574339373 >> v2:172.21.15.73:3300/0 conn(0x7fdbd815c2f0 0x7fdbd80cd2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T02:40:25.844 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:25.839+0000 7fdbdd20b700 1 -- 172.21.15.46:0/1574339373 >> v2:172.21.15.73:3300/0 conn(0x7fdbd815c2f0 msgr2=0x7fdbd80cd2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T02:40:25.844 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:25.839+0000 7fdbdd20b700 1 --2- 172.21.15.46:0/1574339373 >> v2:172.21.15.73:3300/0 conn(0x7fdbd815c2f0 0x7fdbd80cd2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T02:40:25.844 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:25.839+0000 7fdbdd20b700 1 -- 172.21.15.46:0/1574339373 >> v1:172.21.15.73:6789/0 conn(0x7fdbd80b5ae0 legacy=0x7fdbd80d1450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T02:40:25.844 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:25.839+0000 7fdbdd20b700 1 -- 172.21.15.46:0/1574339373 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdbd80d0f50 con 0x7fdbd815c6c0 2023-07-06T02:40:25.845 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:25.839+0000 7fdbdd20b700 1 --2- 172.21.15.46:0/1574339373 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fdbd815c6c0 0x7fdbd806c760 secure :-1 s=READY pgs=3261 cs=0 l=1 rev1=1 crypto rx=0x7fdbd80cf670 tx=0x7fdbc8009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4ab07905e4f260f2 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T02:40:25.845 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:25.839+0000 7fdbdca0a700 1 -- 172.21.15.46:0/1574339373 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdbc800b870 con 0x7fdbd815c6c0 2023-07-06T02:40:25.845 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:25.839+0000 7fdbdca0a700 1 -- 172.21.15.46:0/1574339373 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdbc800b9d0 con 0x7fdbd815c6c0 2023-07-06T02:40:25.845 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:25.839+0000 7fdbdca0a700 1 -- 172.21.15.46:0/1574339373 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdbc800bd60 con 0x7fdbd815c6c0 2023-07-06T02:40:25.847 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:25.840+0000 7fdbdfc70700 1 -- 172.21.15.46:0/1574339373 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fdbd815c6c0 msgr2=0x7fdbd806c760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T02:40:25.848 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:25.840+0000 7fdbdfc70700 1 --2- 172.21.15.46:0/1574339373 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fdbd815c6c0 0x7fdbd806c760 secure :-1 s=READY pgs=3261 cs=0 l=1 rev1=1 crypto rx=0x7fdbd80cf670 tx=0x7fdbc8009bd0 comp rx=0 tx=0).stop 2023-07-06T02:40:25.848 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:25.840+0000 7fdbdfc70700 1 -- 172.21.15.46:0/1574339373 shutdown_connections 2023-07-06T02:40:25.848 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:25.840+0000 7fdbdfc70700 1 --2- 172.21.15.46:0/1574339373 >> v2:172.21.15.73:3300/0 conn(0x7fdbd815c2f0 0x7fdbd80cd2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T02:40:25.848 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:25.840+0000 7fdbdfc70700 1 --2- 172.21.15.46:0/1574339373 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fdbd815c6c0 0x7fdbd806c760 unknown :-1 s=CLOSED pgs=3261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T02:40:25.848 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:25.840+0000 7fdbdfc70700 1 -- 172.21.15.46:0/1574339373 >> 172.21.15.46:0/1574339373 conn(0x7fdbd806afa0 msgr2=0x7fdbd80cf710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T02:40:25.849 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:25.840+0000 7fdbdfc70700 1 -- 172.21.15.46:0/1574339373 shutdown_connections 2023-07-06T02:40:25.849 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:25.840+0000 7fdbdfc70700 1 -- 172.21.15.46:0/1574339373 wait complete. 2023-07-06T02:40:25.849 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:25.841+0000 7fdbdfc70700 1 Processor -- start 2023-07-06T02:40:25.849 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:25.841+0000 7fdbdfc70700 1 -- start start 2023-07-06T02:40:25.849 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:25.842+0000 7fdbdfc70700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fdbd80b5ae0 0x7fdbd8156300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T02:40:25.850 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:25.842+0000 7fdbdfc70700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fdbd815c2f0 0x7fdbd80c8910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T02:40:25.850 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:25.842+0000 7fdbdfc70700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fdbd815c6c0 0x7fdbd80c8e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T02:40:25.850 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:25.842+0000 7fdbdfc70700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdbd80c67c0 con 0x7fdbd815c2f0 2023-07-06T02:40:25.850 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:25.842+0000 7fdbdfc70700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdbd80c6aa0 con 0x7fdbd80b5ae0 2023-07-06T02:40:25.850 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:25.842+0000 7fdbdfc70700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdbd80c6d80 con 0x7fdbd815c6c0 2023-07-06T02:40:25.851 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:25.842+0000 7fdbdd20b700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fdbd815c2f0 0x7fdbd80c8910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T02:40:25.851 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:25.842+0000 7fdbdd20b700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fdbd815c2f0 0x7fdbd80c8910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:46180/0 (socket says 172.21.15.46:46180) 2023-07-06T02:40:25.851 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:25.842+0000 7fdbdd20b700 1 -- 172.21.15.46:0/3439231750 learned_addr learned my addr 172.21.15.46:0/3439231750 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-07-06T02:40:25.851 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:25.842+0000 7fdbdda0c700 1 --2- 172.21.15.46:0/3439231750 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fdbd80b5ae0 0x7fdbd8156300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T02:40:25.851 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:25.842+0000 7fdbde20d700 1 --2- 172.21.15.46:0/3439231750 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fdbd815c6c0 0x7fdbd80c8e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T02:40:25.852 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:25.842+0000 7fdbdd20b700 1 -- 172.21.15.46:0/3439231750 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fdbd815c6c0 msgr2=0x7fdbd80c8e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T02:40:25.852 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:25.842+0000 7fdbdd20b700 1 --2- 172.21.15.46:0/3439231750 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fdbd815c6c0 0x7fdbd80c8e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T02:40:25.852 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:25.842+0000 7fdbdd20b700 1 -- 172.21.15.46:0/3439231750 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fdbd80b5ae0 msgr2=0x7fdbd8156300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T02:40:25.852 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:25.842+0000 7fdbdd20b700 1 --2- 172.21.15.46:0/3439231750 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fdbd80b5ae0 0x7fdbd8156300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T02:40:25.852 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:25.842+0000 7fdbdd20b700 1 -- 172.21.15.46:0/3439231750 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdbc8009550 con 0x7fdbd815c2f0 2023-07-06T02:40:25.853 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:25.843+0000 7fdbdd20b700 1 --2- 172.21.15.46:0/3439231750 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fdbd815c2f0 0x7fdbd80c8910 secure :-1 s=READY pgs=3262 cs=0 l=1 rev1=1 crypto rx=0x7fdbc8000c00 tx=0x7fdbc8004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T02:40:25.853 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:25.843+0000 7fdbce7fc700 1 -- 172.21.15.46:0/3439231750 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdbc8004540 con 0x7fdbd815c2f0 2023-07-06T02:40:25.853 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:25.843+0000 7fdbce7fc700 1 -- 172.21.15.46:0/3439231750 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdbc80036a0 con 0x7fdbd815c2f0 2023-07-06T02:40:25.853 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:25.843+0000 7fdbdfc70700 1 -- 172.21.15.46:0/3439231750 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdbd80c7060 con 0x7fdbd815c2f0 2023-07-06T02:40:25.853 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:25.843+0000 7fdbce7fc700 1 -- 172.21.15.46:0/3439231750 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdbc8003a10 con 0x7fdbd815c2f0 2023-07-06T02:40:25.853 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:25.843+0000 7fdbdfc70700 1 -- 172.21.15.46:0/3439231750 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdbd80c7620 con 0x7fdbd815c2f0 2023-07-06T02:40:25.854 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:25.844+0000 7fdbdfc70700 1 -- 172.21.15.46:0/3439231750 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdbd80ce0d0 con 0x7fdbd815c2f0 2023-07-06T02:40:25.854 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:25.844+0000 7fdbce7fc700 1 -- 172.21.15.46:0/3439231750 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fdbc8021070 con 0x7fdbd815c2f0 2023-07-06T02:40:25.854 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:25.845+0000 7fdbce7fc700 1 --2- 172.21.15.46:0/3439231750 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7fdbbc06ace0 0x7fdbbc06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T02:40:25.855 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:25.845+0000 7fdbce7fc700 1 -- 172.21.15.46:0/3439231750 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 5296+0+0 (secure 0 0 0) 0x7fdbc808a830 con 0x7fdbd815c2f0 2023-07-06T02:40:25.855 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:25.845+0000 7fdbdda0c700 1 --2- 172.21.15.46:0/3439231750 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7fdbbc06ace0 0x7fdbbc06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T02:40:25.855 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:25.846+0000 7fdbdda0c700 1 --2- 172.21.15.46:0/3439231750 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7fdbbc06ace0 0x7fdbbc06d190 secure :-1 s=READY pgs=742 cs=0 l=1 rev1=1 crypto rx=0x7fdbd4006b20 tx=0x7fdbd4008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T02:40:25.855 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:25.849+0000 7fdbce7fc700 1 -- 172.21.15.46:0/3439231750 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fdbc8055c70 con 0x7fdbd815c2f0 2023-07-06T02:40:26.060 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:26.057+0000 7fdbdfc70700 1 -- 172.21.15.46:0/3439231750 --> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "2", "target": ["mon-mgr", ""]}) v1 -- 0x7fdbd80cdba0 con 0x7fdbbc06ace0 2023-07-06T02:40:26.060 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:26.058+0000 7fdbce7fc700 1 -- 172.21.15.46:0/3439231750 <== mgr.4099 v2:172.21.15.73:6832/3033361733 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 2 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7fdbd4009e40 con 0x7fdbbc06ace0 2023-07-06T02:40:26.063 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:26.060+0000 7fdbdfc70700 1 -- 172.21.15.46:0/3439231750 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7fdbbc06ace0 msgr2=0x7fdbbc06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T02:40:26.064 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:26.060+0000 7fdbdfc70700 1 --2- 172.21.15.46:0/3439231750 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7fdbbc06ace0 0x7fdbbc06d190 secure :-1 s=READY pgs=742 cs=0 l=1 rev1=1 crypto rx=0x7fdbd4006b20 tx=0x7fdbd4008040 comp rx=0 tx=0).stop 2023-07-06T02:40:26.064 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:26.060+0000 7fdbdfc70700 1 -- 172.21.15.46:0/3439231750 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fdbd815c2f0 msgr2=0x7fdbd80c8910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T02:40:26.064 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:26.060+0000 7fdbdfc70700 1 --2- 172.21.15.46:0/3439231750 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fdbd815c2f0 0x7fdbd80c8910 secure :-1 s=READY pgs=3262 cs=0 l=1 rev1=1 crypto rx=0x7fdbc8000c00 tx=0x7fdbc8004750 comp rx=0 tx=0).stop 2023-07-06T02:40:26.064 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:26.060+0000 7fdbdfc70700 1 -- 172.21.15.46:0/3439231750 shutdown_connections 2023-07-06T02:40:26.065 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:26.060+0000 7fdbdfc70700 1 --2- 172.21.15.46:0/3439231750 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7fdbbc06ace0 0x7fdbbc06d190 unknown :-1 s=CLOSED pgs=742 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T02:40:26.065 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:26.060+0000 7fdbdfc70700 1 --2- 172.21.15.46:0/3439231750 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fdbd815c6c0 0x7fdbd80c8e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T02:40:26.065 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:26.060+0000 7fdbdfc70700 1 --2- 172.21.15.46:0/3439231750 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fdbd80b5ae0 0x7fdbd8156300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T02:40:26.066 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:26.060+0000 7fdbdfc70700 1 --2- 172.21.15.46:0/3439231750 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fdbd815c2f0 0x7fdbd80c8910 unknown :-1 s=CLOSED pgs=3262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T02:40:26.066 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:26.060+0000 7fdbdfc70700 1 -- 172.21.15.46:0/3439231750 >> 172.21.15.46:0/3439231750 conn(0x7fdbd806afa0 msgr2=0x7fdbd806bd90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T02:40:26.066 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:26.060+0000 7fdbdfc70700 1 -- 172.21.15.46:0/3439231750 shutdown_connections 2023-07-06T02:40:26.066 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:26.060+0000 7fdbdfc70700 1 -- 172.21.15.46:0/3439231750 wait complete. 2023-07-06T02:40:26.067 INFO:teuthology.orchestra.run.smithi046.stderr:instructed osd(s) 2 to deep-scrub 2023-07-06T02:40:26.077 INFO:tasks.ceph:Scrubbing osd.3 2023-07-06T02:40:26.077 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 config set osd_debug_deep_scrub_sleep 0 2023-07-06T02:40:26.217 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:26.214+0000 7fd4242d2700 1 Processor -- start 2023-07-06T02:40:26.218 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:26.214+0000 7fd4242d2700 1 -- start start 2023-07-06T02:40:26.219 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:26.215+0000 7fd4242d2700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fd41c06e7c0 0x7fd41c06ba50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T02:40:26.219 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:26.215+0000 7fd4242d2700 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd41c0cf440 con 0x7fd41c15c8d0 2023-07-06T02:40:26.220 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:26.215+0000 7fd4242d2700 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd41c06acd0 con 0x7fd41c06c810 2023-07-06T02:40:26.220 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:26.215+0000 7fd4242d2700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd41c06d540 con 0x7fd41c06e7c0 2023-07-06T02:40:26.220 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:26.216+0000 7fd42206e700 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7fd41c15c8d0 0x7fd41c06e0b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:45458/0 (socket says 172.21.15.46:45458) 2023-07-06T02:40:26.220 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:26.216+0000 7fd42206e700 1 -- 172.21.15.46:0/2172640865 learned_addr learned my addr 172.21.15.46:0/2172640865 (peer_addr_for_me v1:172.21.15.46:0/0) 2023-07-06T02:40:26.220 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:26.216+0000 7fd42186d700 1 --2- 172.21.15.46:0/2172640865 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fd41c06e7c0 0x7fd41c06ba50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T02:40:26.221 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:26.216+0000 7fd42106c700 1 -- 172.21.15.46:0/2172640865 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3955164180 0 0) 0x7fd418001110 con 0x7fd41c15c8d0 2023-07-06T02:40:26.221 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:26.216+0000 7fd42106c700 1 -- 172.21.15.46:0/2172640865 --> v1:172.21.15.46:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd4080035b0 con 0x7fd41c15c8d0 2023-07-06T02:40:26.221 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:26.216+0000 7fd42106c700 1 -- 172.21.15.46:0/2172640865 <== mon.1 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3776200196 0 0) 0x7fd41c06acd0 con 0x7fd41c06c810 2023-07-06T02:40:26.221 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:26.216+0000 7fd42106c700 1 -- 172.21.15.46:0/2172640865 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd418001110 con 0x7fd41c06c810 2023-07-06T02:40:26.221 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:26.216+0000 7fd42186d700 1 -- 172.21.15.46:0/2172640865 >> v1:172.21.15.73:6789/0 conn(0x7fd41c06c810 legacy=0x7fd41c06ccb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T02:40:26.222 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:26.216+0000 7fd42186d700 1 -- 172.21.15.46:0/2172640865 >> v1:172.21.15.46:6789/0 conn(0x7fd41c15c8d0 legacy=0x7fd41c06e0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T02:40:26.222 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:26.216+0000 7fd42186d700 1 -- 172.21.15.46:0/2172640865 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd41c06af70 con 0x7fd41c06e7c0 2023-07-06T02:40:26.222 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:26.216+0000 7fd42186d700 1 --2- 172.21.15.46:0/2172640865 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fd41c06e7c0 0x7fd41c06ba50 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fd40c009870 tx=0x7fd40c009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1597582a2fdd9396 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T02:40:26.222 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:26.217+0000 7fd42106c700 1 -- 172.21.15.46:0/2172640865 <== mon.2 v2:172.21.15.73:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd40c011830 con 0x7fd41c06e7c0 2023-07-06T02:40:26.222 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:26.217+0000 7fd42106c700 1 -- 172.21.15.46:0/2172640865 <== mon.2 v2:172.21.15.73:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd40c011990 con 0x7fd41c06e7c0 2023-07-06T02:40:26.223 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:26.217+0000 7fd42106c700 1 -- 172.21.15.46:0/2172640865 <== mon.2 v2:172.21.15.73:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd40c011d20 con 0x7fd41c06e7c0 2023-07-06T02:40:26.225 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:26.217+0000 7fd4242d2700 1 -- 172.21.15.46:0/2172640865 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fd41c06e7c0 msgr2=0x7fd41c06ba50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T02:40:26.226 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:26.217+0000 7fd4242d2700 1 --2- 172.21.15.46:0/2172640865 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fd41c06e7c0 0x7fd41c06ba50 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fd40c009870 tx=0x7fd40c009b80 comp rx=0 tx=0).stop 2023-07-06T02:40:26.226 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:26.217+0000 7fd4242d2700 1 -- 172.21.15.46:0/2172640865 shutdown_connections 2023-07-06T02:40:26.226 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:26.217+0000 7fd4242d2700 1 --2- 172.21.15.46:0/2172640865 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fd41c06e7c0 0x7fd41c06ba50 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T02:40:26.226 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:26.217+0000 7fd4242d2700 1 -- 172.21.15.46:0/2172640865 >> 172.21.15.46:0/2172640865 conn(0x7fd41c0cf9e0 msgr2=0x7fd41c0cfde0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T02:40:26.226 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:26.217+0000 7fd4242d2700 1 -- 172.21.15.46:0/2172640865 shutdown_connections 2023-07-06T02:40:26.227 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:26.217+0000 7fd4242d2700 1 -- 172.21.15.46:0/2172640865 wait complete. 2023-07-06T02:40:26.227 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:26.219+0000 7fd4242d2700 1 Processor -- start 2023-07-06T02:40:26.227 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:26.219+0000 7fd4242d2700 1 -- start start 2023-07-06T02:40:26.227 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:26.219+0000 7fd4242d2700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd41c06c810 0x7fd41c1523d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T02:40:26.227 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:26.219+0000 7fd4242d2700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fd41c06e7c0 0x7fd41c0c4830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T02:40:26.228 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:26.219+0000 7fd4242d2700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd41c15c8d0 0x7fd41c0c4d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T02:40:26.228 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:26.219+0000 7fd4242d2700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd41c0c5740 con 0x7fd41c06c810 2023-07-06T02:40:26.228 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:26.219+0000 7fd4242d2700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd41c0c5a20 con 0x7fd41c15c8d0 2023-07-06T02:40:26.228 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:26.219+0000 7fd4242d2700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd41c157010 con 0x7fd41c06e7c0 2023-07-06T02:40:26.228 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:26.220+0000 7fd42206e700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd41c06c810 0x7fd41c1523d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T02:40:26.229 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:26.220+0000 7fd42206e700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd41c06c810 0x7fd41c1523d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:46192/0 (socket says 172.21.15.46:46192) 2023-07-06T02:40:26.229 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:26.220+0000 7fd42206e700 1 -- 172.21.15.46:0/3634550994 learned_addr learned my addr 172.21.15.46:0/3634550994 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-07-06T02:40:26.229 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:26.220+0000 7fd42286f700 1 --2- 172.21.15.46:0/3634550994 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd41c15c8d0 0x7fd41c0c4d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T02:40:26.230 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:26.220+0000 7fd42186d700 1 --2- 172.21.15.46:0/3634550994 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fd41c06e7c0 0x7fd41c0c4830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T02:40:26.230 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:26.220+0000 7fd42206e700 1 -- 172.21.15.46:0/3634550994 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fd41c06e7c0 msgr2=0x7fd41c0c4830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T02:40:26.230 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:26.220+0000 7fd42206e700 1 --2- 172.21.15.46:0/3634550994 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fd41c06e7c0 0x7fd41c0c4830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T02:40:26.230 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:26.220+0000 7fd42206e700 1 -- 172.21.15.46:0/3634550994 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd41c15c8d0 msgr2=0x7fd41c0c4d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T02:40:26.231 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:26.220+0000 7fd42206e700 1 --2- 172.21.15.46:0/3634550994 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd41c15c8d0 0x7fd41c0c4d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T02:40:26.231 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:26.220+0000 7fd42206e700 1 -- 172.21.15.46:0/3634550994 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd40c0094a0 con 0x7fd41c06c810 2023-07-06T02:40:26.231 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:26.220+0000 7fd42206e700 1 --2- 172.21.15.46:0/3634550994 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd41c06c810 0x7fd41c1523d0 secure :-1 s=READY pgs=3264 cs=0 l=1 rev1=1 crypto rx=0x7fd41800c700 tx=0x7fd41800cac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T02:40:26.231 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:26.220+0000 7fd412ffd700 1 -- 172.21.15.46:0/3634550994 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd418005d70 con 0x7fd41c06c810 2023-07-06T02:40:26.231 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:26.220+0000 7fd412ffd700 1 -- 172.21.15.46:0/3634550994 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd4180070f0 con 0x7fd41c06c810 2023-07-06T02:40:26.232 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:26.220+0000 7fd4242d2700 1 -- 172.21.15.46:0/3634550994 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd41c1530f0 con 0x7fd41c06c810 2023-07-06T02:40:26.232 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:26.220+0000 7fd412ffd700 1 -- 172.21.15.46:0/3634550994 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd418007480 con 0x7fd41c06c810 2023-07-06T02:40:26.232 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:26.220+0000 7fd4242d2700 1 -- 172.21.15.46:0/3634550994 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd41c0c5490 con 0x7fd41c06c810 2023-07-06T02:40:26.232 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:26.221+0000 7fd4242d2700 1 -- 172.21.15.46:0/3634550994 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fd41c0c58b0 con 0x7fd41c06c810 2023-07-06T02:40:26.233 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:26.222+0000 7fd412ffd700 1 -- 172.21.15.46:0/3634550994 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fd4180075e0 con 0x7fd41c06c810 2023-07-06T02:40:26.233 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:26.222+0000 7fd412ffd700 1 --2- 172.21.15.46:0/3634550994 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7fd40006ace0 0x7fd40006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T02:40:26.233 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:26.222+0000 7fd412ffd700 1 -- 172.21.15.46:0/3634550994 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 5296+0+0 (secure 0 0 0) 0x7fd4180886b0 con 0x7fd41c06c810 2023-07-06T02:40:26.233 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:26.222+0000 7fd412ffd700 1 --2- 172.21.15.46:0/3634550994 >> [v2:172.21.15.46:6824/2981388766,v1:172.21.15.46:6825/2981388766] conn(0x7fd400071150 0x7fd400073560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T02:40:26.233 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:26.223+0000 7fd42186d700 1 --2- 172.21.15.46:0/3634550994 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7fd40006ace0 0x7fd40006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T02:40:26.234 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:26.223+0000 7fd412ffd700 1 -- 172.21.15.46:0/3634550994 --> [v2:172.21.15.46:6824/2981388766,v1:172.21.15.46:6825/2981388766] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fd400073c30 con 0x7fd400071150 2023-07-06T02:40:26.234 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:26.223+0000 7fd412ffd700 1 -- 172.21.15.46:0/3634550994 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_get_version_reply(handle=1 version=40) v2 ==== 24+0+0 (secure 0 0 0) 0x7fd41808ac90 con 0x7fd41c06c810 2023-07-06T02:40:26.234 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:26.223+0000 7fd42286f700 1 --2- 172.21.15.46:0/3634550994 >> [v2:172.21.15.46:6824/2981388766,v1:172.21.15.46:6825/2981388766] conn(0x7fd400071150 0x7fd400073560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T02:40:26.235 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:26.223+0000 7fd42286f700 1 --2- 172.21.15.46:0/3634550994 >> [v2:172.21.15.46:6824/2981388766,v1:172.21.15.46:6825/2981388766] conn(0x7fd400071150 0x7fd400073560 crc :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T02:40:26.235 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:26.223+0000 7fd42186d700 1 --2- 172.21.15.46:0/3634550994 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7fd40006ace0 0x7fd40006d190 secure :-1 s=READY pgs=743 cs=0 l=1 rev1=1 crypto rx=0x7fd41c06ebb0 tx=0x7fd40c01c040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T02:40:26.235 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:26.224+0000 7fd412ffd700 1 -- 172.21.15.46:0/3634550994 <== osd.3 v2:172.21.15.46:6824/2981388766 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7fd400073c30 con 0x7fd400071150 2023-07-06T02:40:26.242 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:26.239+0000 7fd4242d2700 1 -- 172.21.15.46:0/3634550994 --> [v2:172.21.15.46:6824/2981388766,v1:172.21.15.46:6825/2981388766] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7fd41c06b530 con 0x7fd400071150 2023-07-06T02:40:26.242 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:26.239+0000 7fd412ffd700 1 -- 172.21.15.46:0/3634550994 <== osd.3 v2:172.21.15.46:6824/2981388766 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7fd414003a00 con 0x7fd400071150 2023-07-06T02:40:26.243 INFO:teuthology.orchestra.run.smithi046.stdout:{ 2023-07-06T02:40:26.243 INFO:teuthology.orchestra.run.smithi046.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-07-06T02:40:26.243 INFO:teuthology.orchestra.run.smithi046.stdout:} 2023-07-06T02:40:26.244 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:26.240+0000 7fd4242d2700 1 -- 172.21.15.46:0/3634550994 >> [v2:172.21.15.46:6824/2981388766,v1:172.21.15.46:6825/2981388766] conn(0x7fd400071150 msgr2=0x7fd400073560 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T02:40:26.245 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:26.240+0000 7fd4242d2700 1 --2- 172.21.15.46:0/3634550994 >> [v2:172.21.15.46:6824/2981388766,v1:172.21.15.46:6825/2981388766] conn(0x7fd400071150 0x7fd400073560 crc :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T02:40:26.245 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:26.240+0000 7fd4242d2700 1 -- 172.21.15.46:0/3634550994 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7fd40006ace0 msgr2=0x7fd40006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T02:40:26.245 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:26.240+0000 7fd4242d2700 1 --2- 172.21.15.46:0/3634550994 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7fd40006ace0 0x7fd40006d190 secure :-1 s=READY pgs=743 cs=0 l=1 rev1=1 crypto rx=0x7fd41c06ebb0 tx=0x7fd40c01c040 comp rx=0 tx=0).stop 2023-07-06T02:40:26.245 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:26.240+0000 7fd4242d2700 1 -- 172.21.15.46:0/3634550994 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd41c06c810 msgr2=0x7fd41c1523d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T02:40:26.245 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:26.240+0000 7fd4242d2700 1 --2- 172.21.15.46:0/3634550994 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd41c06c810 0x7fd41c1523d0 secure :-1 s=READY pgs=3264 cs=0 l=1 rev1=1 crypto rx=0x7fd41800c700 tx=0x7fd41800cac0 comp rx=0 tx=0).stop 2023-07-06T02:40:26.246 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:26.240+0000 7fd42286f700 1 -- 172.21.15.46:0/3634550994 reap_dead start 2023-07-06T02:40:26.246 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:26.240+0000 7fd4242d2700 1 -- 172.21.15.46:0/3634550994 shutdown_connections 2023-07-06T02:40:26.246 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:26.240+0000 7fd4242d2700 1 -- 172.21.15.46:0/3634550994 >> 172.21.15.46:0/3634550994 conn(0x7fd41c0cf9e0 msgr2=0x7fd41c06e0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T02:40:26.246 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:26.240+0000 7fd4242d2700 1 -- 172.21.15.46:0/3634550994 shutdown_connections 2023-07-06T02:40:26.246 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:26.240+0000 7fd4242d2700 1 -- 172.21.15.46:0/3634550994 wait complete. 2023-07-06T02:40:26.257 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 3 2023-07-06T02:40:26.393 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:26.390+0000 7fd56622d700 1 Processor -- start 2023-07-06T02:40:26.394 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:26.390+0000 7fd56622d700 1 -- start start 2023-07-06T02:40:26.396 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:26.391+0000 7fd56622d700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fd5600d08f0 0x7fd5600d0d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T02:40:26.397 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:26.391+0000 7fd56622d700 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd5600b5b70 con 0x7fd5600b43a0 2023-07-06T02:40:26.397 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:26.391+0000 7fd56622d700 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd5600b5e50 con 0x7fd5600b62e0 2023-07-06T02:40:26.397 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:26.391+0000 7fd56622d700 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd5600d12b0 con 0x7fd5600d08f0 2023-07-06T02:40:26.397 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:26.391+0000 7fd55f7fe700 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7fd5600b43a0 0x7fd5600ce290 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:45474/0 (socket says 172.21.15.46:45474) 2023-07-06T02:40:26.397 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:26.391+0000 7fd55f7fe700 1 -- 172.21.15.46:0/1776359891 learned_addr learned my addr 172.21.15.46:0/1776359891 (peer_addr_for_me v1:172.21.15.46:0/0) 2023-07-06T02:40:26.398 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:26.391+0000 7fd55e7fc700 1 -- 172.21.15.46:0/1776359891 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 217391998 0 0) 0x7fd5600b5b70 con 0x7fd5600b43a0 2023-07-06T02:40:26.398 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:26.391+0000 7fd55e7fc700 1 -- 172.21.15.46:0/1776359891 --> v1:172.21.15.46:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd5480035b0 con 0x7fd5600b43a0 2023-07-06T02:40:26.398 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:26.391+0000 7fd55effd700 1 --2- 172.21.15.46:0/1776359891 >> v2:172.21.15.73:3300/0 conn(0x7fd5600d08f0 0x7fd5600d0d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T02:40:26.398 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:26.392+0000 7fd55e7fc700 1 -- 172.21.15.46:0/1776359891 <== mon.0 v1:172.21.15.46:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 669385714 0 0) 0x7fd5480035b0 con 0x7fd5600b43a0 2023-07-06T02:40:26.399 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:26.392+0000 7fd55e7fc700 1 -- 172.21.15.46:0/1776359891 >> v2:172.21.15.73:3300/0 conn(0x7fd5600d08f0 msgr2=0x7fd5600d0d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T02:40:26.399 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:26.392+0000 7fd55e7fc700 1 --2- 172.21.15.46:0/1776359891 >> v2:172.21.15.73:3300/0 conn(0x7fd5600d08f0 0x7fd5600d0d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T02:40:26.399 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:26.392+0000 7fd55e7fc700 1 -- 172.21.15.46:0/1776359891 >> v1:172.21.15.73:6789/0 conn(0x7fd5600b62e0 legacy=0x7fd5600b6700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T02:40:26.399 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:26.392+0000 7fd55e7fc700 1 -- 172.21.15.46:0/1776359891 --> v1:172.21.15.46:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd56015cb90 con 0x7fd5600b43a0 2023-07-06T02:40:26.399 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:26.392+0000 7fd55e7fc700 1 -- 172.21.15.46:0/1776359891 <== mon.0 v1:172.21.15.46:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2195585215 0 0) 0x7fd5500017f0 con 0x7fd5600b43a0 2023-07-06T02:40:26.400 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:26.392+0000 7fd55e7fc700 1 -- 172.21.15.46:0/1776359891 >> v1:172.21.15.46:6789/0 conn(0x7fd5600b43a0 legacy=0x7fd5600ce290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T02:40:26.400 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:26.392+0000 7fd55e7fc700 1 --2- 172.21.15.46:0/1776359891 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd548003a00 0x7fd548003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T02:40:26.400 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:26.392+0000 7fd55e7fc700 1 --2- 172.21.15.46:0/1776359891 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fd548004850 0x7fd548004cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T02:40:26.400 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:26.392+0000 7fd55e7fc700 1 --2- 172.21.15.46:0/1776359891 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd548005200 0x7fd54800ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T02:40:26.401 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:26.392+0000 7fd55e7fc700 1 -- 172.21.15.46:0/1776359891 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5600d12b0 con 0x7fd548005200 2023-07-06T02:40:26.401 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:26.392+0000 7fd55e7fc700 1 -- 172.21.15.46:0/1776359891 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd54800c060 con 0x7fd548003a00 2023-07-06T02:40:26.401 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:26.392+0000 7fd55e7fc700 1 -- 172.21.15.46:0/1776359891 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd54800c220 con 0x7fd548004850 2023-07-06T02:40:26.401 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:26.392+0000 7fd55ffff700 1 --2- 172.21.15.46:0/1776359891 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd548005200 0x7fd54800ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T02:40:26.401 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:26.392+0000 7fd55f7fe700 1 --2- 172.21.15.46:0/1776359891 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd548003a00 0x7fd548003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T02:40:26.402 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:26.392+0000 7fd55effd700 1 --2- 172.21.15.46:0/1776359891 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fd548004850 0x7fd548004cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T02:40:26.402 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:26.392+0000 7fd55ffff700 1 -- 172.21.15.46:0/1776359891 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fd548004850 msgr2=0x7fd548004cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T02:40:26.402 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:26.392+0000 7fd55ffff700 1 --2- 172.21.15.46:0/1776359891 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fd548004850 0x7fd548004cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T02:40:26.402 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:26.392+0000 7fd55ffff700 1 -- 172.21.15.46:0/1776359891 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd548003a00 msgr2=0x7fd548003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T02:40:26.402 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:26.392+0000 7fd55ffff700 1 --2- 172.21.15.46:0/1776359891 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd548003a00 0x7fd548003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T02:40:26.403 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:26.392+0000 7fd55ffff700 1 -- 172.21.15.46:0/1776359891 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd5480035b0 con 0x7fd548005200 2023-07-06T02:40:26.403 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:26.393+0000 7fd55ffff700 1 -- 172.21.15.46:0/1776359891 reap_dead start 2023-07-06T02:40:26.403 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:26.393+0000 7fd55ffff700 1 --2- 172.21.15.46:0/1776359891 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd548005200 0x7fd54800ba10 secure :-1 s=READY pgs=3266 cs=0 l=1 rev1=1 crypto rx=0x7fd55800c240 tx=0x7fd548005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a9fb423f358a1ec2 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T02:40:26.403 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:26.393+0000 7fd55e7fc700 1 -- 172.21.15.46:0/1776359891 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd558001e70 con 0x7fd548005200 2023-07-06T02:40:26.403 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:26.393+0000 7fd55e7fc700 1 -- 172.21.15.46:0/1776359891 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd55800cde0 con 0x7fd548005200 2023-07-06T02:40:26.404 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:26.393+0000 7fd55e7fc700 1 -- 172.21.15.46:0/1776359891 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd558003c40 con 0x7fd548005200 2023-07-06T02:40:26.404 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:26.393+0000 7fd56622d700 1 -- 172.21.15.46:0/1776359891 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd548005200 msgr2=0x7fd54800ba10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T02:40:26.404 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:26.393+0000 7fd56622d700 1 --2- 172.21.15.46:0/1776359891 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd548005200 0x7fd54800ba10 secure :-1 s=READY pgs=3266 cs=0 l=1 rev1=1 crypto rx=0x7fd55800c240 tx=0x7fd548005880 comp rx=0 tx=0).stop 2023-07-06T02:40:26.404 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:26.393+0000 7fd56622d700 1 -- 172.21.15.46:0/1776359891 shutdown_connections 2023-07-06T02:40:26.404 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:26.393+0000 7fd56622d700 1 --2- 172.21.15.46:0/1776359891 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd548005200 0x7fd54800ba10 unknown :-1 s=CLOSED pgs=3266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T02:40:26.405 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:26.393+0000 7fd56622d700 1 -- 172.21.15.46:0/1776359891 >> 172.21.15.46:0/1776359891 conn(0x7fd56009bff0 msgr2=0x7fd5600d2d20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T02:40:26.405 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:26.393+0000 7fd56622d700 1 -- 172.21.15.46:0/1776359891 shutdown_connections 2023-07-06T02:40:26.405 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:26.394+0000 7fd56622d700 1 -- 172.21.15.46:0/1776359891 wait complete. 2023-07-06T02:40:26.407 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:26.395+0000 7fd56622d700 1 Processor -- start 2023-07-06T02:40:26.407 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:26.395+0000 7fd56622d700 1 -- start start 2023-07-06T02:40:26.408 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:26.396+0000 7fd56622d700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fd548005200 0x7fd5601e4c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T02:40:26.408 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:26.396+0000 7fd56622d700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd56015a550 0x7fd5600b27d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T02:40:26.408 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:26.396+0000 7fd56622d700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd5600b2d10 0x7fd5600afd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T02:40:26.408 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:26.396+0000 7fd56622d700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd56006ada0 con 0x7fd56015a550 2023-07-06T02:40:26.408 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:26.396+0000 7fd56622d700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5601e51b0 con 0x7fd5600b2d10 2023-07-06T02:40:26.409 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:26.396+0000 7fd56622d700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd5600b3190 con 0x7fd548005200 2023-07-06T02:40:26.409 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:26.396+0000 7fd55effd700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd56015a550 0x7fd5600b27d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T02:40:26.409 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:26.396+0000 7fd55effd700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd56015a550 0x7fd5600b27d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:46216/0 (socket says 172.21.15.46:46216) 2023-07-06T02:40:26.409 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:26.396+0000 7fd55effd700 1 -- 172.21.15.46:0/1039708187 learned_addr learned my addr 172.21.15.46:0/1039708187 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-07-06T02:40:26.409 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:26.396+0000 7fd55ffff700 1 --2- 172.21.15.46:0/1039708187 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd5600b2d10 0x7fd5600afd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T02:40:26.410 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:26.396+0000 7fd55f7fe700 1 --2- 172.21.15.46:0/1039708187 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fd548005200 0x7fd5601e4c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T02:40:26.410 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:26.396+0000 7fd55effd700 1 -- 172.21.15.46:0/1039708187 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fd548005200 msgr2=0x7fd5601e4c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T02:40:26.410 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:26.396+0000 7fd55effd700 1 --2- 172.21.15.46:0/1039708187 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fd548005200 0x7fd5601e4c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T02:40:26.410 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:26.396+0000 7fd55effd700 1 -- 172.21.15.46:0/1039708187 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd5600b2d10 msgr2=0x7fd5600afd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T02:40:26.410 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:26.396+0000 7fd55effd700 1 --2- 172.21.15.46:0/1039708187 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd5600b2d10 0x7fd5600afd10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T02:40:26.411 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:26.396+0000 7fd55effd700 1 -- 172.21.15.46:0/1039708187 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd56006a470 con 0x7fd56015a550 2023-07-06T02:40:26.411 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:26.396+0000 7fd55ffff700 1 --2- 172.21.15.46:0/1039708187 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd5600b2d10 0x7fd5600afd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-06T02:40:26.411 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:26.396+0000 7fd55effd700 1 --2- 172.21.15.46:0/1039708187 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd56015a550 0x7fd5600b27d0 secure :-1 s=READY pgs=3267 cs=0 l=1 rev1=1 crypto rx=0x7fd5540119a0 tx=0x7fd554011d60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T02:40:26.411 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:26.396+0000 7fd547fff700 1 -- 172.21.15.46:0/1039708187 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd55400f940 con 0x7fd56015a550 2023-07-06T02:40:26.411 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:26.396+0000 7fd547fff700 1 -- 172.21.15.46:0/1039708187 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd55400faa0 con 0x7fd56015a550 2023-07-06T02:40:26.412 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:26.396+0000 7fd547fff700 1 -- 172.21.15.46:0/1039708187 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd55400fe30 con 0x7fd56015a550 2023-07-06T02:40:26.412 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:26.396+0000 7fd56622d700 1 -- 172.21.15.46:0/1039708187 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd56006a750 con 0x7fd56015a550 2023-07-06T02:40:26.412 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:26.397+0000 7fd56622d700 1 -- 172.21.15.46:0/1039708187 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd5601e6b80 con 0x7fd56015a550 2023-07-06T02:40:26.412 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:26.397+0000 7fd56622d700 1 -- 172.21.15.46:0/1039708187 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd56004e1d0 con 0x7fd56015a550 2023-07-06T02:40:26.413 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:26.398+0000 7fd547fff700 1 -- 172.21.15.46:0/1039708187 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fd554014440 con 0x7fd56015a550 2023-07-06T02:40:26.413 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:26.399+0000 7fd547fff700 1 --2- 172.21.15.46:0/1039708187 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7fd54c06ace0 0x7fd54c06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T02:40:26.414 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:26.399+0000 7fd547fff700 1 -- 172.21.15.46:0/1039708187 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 5296+0+0 (secure 0 0 0) 0x7fd5540898a0 con 0x7fd56015a550 2023-07-06T02:40:26.414 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:26.399+0000 7fd55f7fe700 1 --2- 172.21.15.46:0/1039708187 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7fd54c06ace0 0x7fd54c06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T02:40:26.414 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:26.399+0000 7fd55f7fe700 1 --2- 172.21.15.46:0/1039708187 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7fd54c06ace0 0x7fd54c06d190 secure :-1 s=READY pgs=744 cs=0 l=1 rev1=1 crypto rx=0x7fd5600afad0 tx=0x7fd550009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T02:40:26.414 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:26.403+0000 7fd547fff700 1 -- 172.21.15.46:0/1039708187 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fd554058790 con 0x7fd56015a550 2023-07-06T02:40:26.616 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:26.613+0000 7fd56622d700 1 -- 172.21.15.46:0/1039708187 --> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "3", "target": ["mon-mgr", ""]}) v1 -- 0x7fd5601e6da0 con 0x7fd54c06ace0 2023-07-06T02:40:26.617 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:26.614+0000 7fd547fff700 1 -- 172.21.15.46:0/1039708187 <== mgr.4099 v2:172.21.15.73:6832/3033361733 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 3 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7fd5601e6da0 con 0x7fd54c06ace0 2023-07-06T02:40:26.619 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:26.616+0000 7fd56622d700 1 -- 172.21.15.46:0/1039708187 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7fd54c06ace0 msgr2=0x7fd54c06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T02:40:26.619 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:26.616+0000 7fd56622d700 1 --2- 172.21.15.46:0/1039708187 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7fd54c06ace0 0x7fd54c06d190 secure :-1 s=READY pgs=744 cs=0 l=1 rev1=1 crypto rx=0x7fd5600afad0 tx=0x7fd550009040 comp rx=0 tx=0).stop 2023-07-06T02:40:26.619 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:26.616+0000 7fd56622d700 1 -- 172.21.15.46:0/1039708187 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd56015a550 msgr2=0x7fd5600b27d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T02:40:26.620 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:26.616+0000 7fd56622d700 1 --2- 172.21.15.46:0/1039708187 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd56015a550 0x7fd5600b27d0 secure :-1 s=READY pgs=3267 cs=0 l=1 rev1=1 crypto rx=0x7fd5540119a0 tx=0x7fd554011d60 comp rx=0 tx=0).stop 2023-07-06T02:40:26.620 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:26.616+0000 7fd56622d700 1 -- 172.21.15.46:0/1039708187 shutdown_connections 2023-07-06T02:40:26.620 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:26.616+0000 7fd56622d700 1 --2- 172.21.15.46:0/1039708187 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7fd54c06ace0 0x7fd54c06d190 unknown :-1 s=CLOSED pgs=744 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T02:40:26.620 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:26.616+0000 7fd56622d700 1 --2- 172.21.15.46:0/1039708187 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd5600b2d10 0x7fd5600afd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T02:40:26.621 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:26.616+0000 7fd56622d700 1 --2- 172.21.15.46:0/1039708187 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fd548005200 0x7fd5601e4c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T02:40:26.621 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:26.616+0000 7fd56622d700 1 --2- 172.21.15.46:0/1039708187 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd56015a550 0x7fd5600b27d0 unknown :-1 s=CLOSED pgs=3267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T02:40:26.621 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:26.616+0000 7fd56622d700 1 -- 172.21.15.46:0/1039708187 >> 172.21.15.46:0/1039708187 conn(0x7fd56009bff0 msgr2=0x7fd56015c300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T02:40:26.621 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:26.616+0000 7fd56622d700 1 -- 172.21.15.46:0/1039708187 shutdown_connections 2023-07-06T02:40:26.622 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:26.616+0000 7fd56622d700 1 -- 172.21.15.46:0/1039708187 wait complete. 2023-07-06T02:40:26.622 INFO:teuthology.orchestra.run.smithi046.stderr:instructed osd(s) 3 to deep-scrub 2023-07-06T02:40:26.634 INFO:tasks.ceph:Scrubbing osd.4 2023-07-06T02:40:26.634 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 config set osd_debug_deep_scrub_sleep 0 2023-07-06T02:40:26.775 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:26.772+0000 7f9bde2dc700 1 Processor -- start 2023-07-06T02:40:26.775 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:26.772+0000 7f9bde2dc700 1 -- start start 2023-07-06T02:40:26.777 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:26.773+0000 7f9bde2dc700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f9bd80b8540 0x7f9bd80d08b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T02:40:26.777 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:26.773+0000 7f9bde2dc700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f9bd81609f0 0x7f9bd80cf660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T02:40:26.778 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:26.773+0000 7f9bde2dc700 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9bd80cf1d0 con 0x7f9bd80cfba0 2023-07-06T02:40:26.778 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:26.773+0000 7f9bde2dc700 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9bd80cda50 con 0x7f9bd80b8540 2023-07-06T02:40:26.778 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:26.773+0000 7f9bde2dc700 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9bd80b8910 con 0x7f9bd81609f0 2023-07-06T02:40:26.778 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:26.773+0000 7f9bd7fff700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f9bd80b8540 0x7f9bd80d08b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T02:40:26.779 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:26.773+0000 7f9bd7fff700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f9bd80b8540 0x7f9bd80d08b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:46222/0 (socket says 172.21.15.46:46222) 2023-07-06T02:40:26.779 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:26.773+0000 7f9bd7fff700 1 -- 172.21.15.46:0/82231823 learned_addr learned my addr 172.21.15.46:0/82231823 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-07-06T02:40:26.779 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:26.773+0000 7f9bd77fe700 1 --2- 172.21.15.46:0/82231823 >> v2:172.21.15.73:3300/0 conn(0x7f9bd81609f0 0x7f9bd80cf660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T02:40:26.779 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:26.773+0000 7f9bd7fff700 1 -- 172.21.15.46:0/82231823 >> v2:172.21.15.73:3300/0 conn(0x7f9bd81609f0 msgr2=0x7f9bd80cf660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T02:40:26.779 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:26.773+0000 7f9bd7fff700 1 --2- 172.21.15.46:0/82231823 >> v2:172.21.15.73:3300/0 conn(0x7f9bd81609f0 0x7f9bd80cf660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T02:40:26.780 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:26.773+0000 7f9bd7fff700 1 -- 172.21.15.46:0/82231823 >> v1:172.21.15.73:6789/0 conn(0x7f9bd80cfba0 legacy=0x7f9bd80d2c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T02:40:26.780 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:26.773+0000 7f9bd7fff700 1 -- 172.21.15.46:0/82231823 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9bd80cd4b0 con 0x7f9bd80b8540 2023-07-06T02:40:26.780 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:26.773+0000 7f9bd7fff700 1 --2- 172.21.15.46:0/82231823 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9bd80b8540 0x7f9bd80d08b0 secure :-1 s=READY pgs=3268 cs=0 l=1 rev1=1 crypto rx=0x7f9bd80d0350 tx=0x7f9bc8009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3a8109daf158a99d server_cookie=0 in_seq=0 out_seq=0 2023-07-06T02:40:26.780 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:26.774+0000 7f9bd6ffd700 1 -- 172.21.15.46:0/82231823 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9bc8011830 con 0x7f9bd80b8540 2023-07-06T02:40:26.781 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:26.774+0000 7f9bd6ffd700 1 -- 172.21.15.46:0/82231823 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9bc8011990 con 0x7f9bd80b8540 2023-07-06T02:40:26.781 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:26.774+0000 7f9bd6ffd700 1 -- 172.21.15.46:0/82231823 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9bc8011d20 con 0x7f9bd80b8540 2023-07-06T02:40:26.781 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:26.774+0000 7f9bde2dc700 1 -- 172.21.15.46:0/82231823 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9bd80b8540 msgr2=0x7f9bd80d08b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T02:40:26.781 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:26.774+0000 7f9bde2dc700 1 --2- 172.21.15.46:0/82231823 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9bd80b8540 0x7f9bd80d08b0 secure :-1 s=READY pgs=3268 cs=0 l=1 rev1=1 crypto rx=0x7f9bd80d0350 tx=0x7f9bc8009bd0 comp rx=0 tx=0).stop 2023-07-06T02:40:26.782 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:26.774+0000 7f9bde2dc700 1 -- 172.21.15.46:0/82231823 shutdown_connections 2023-07-06T02:40:26.782 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:26.774+0000 7f9bde2dc700 1 --2- 172.21.15.46:0/82231823 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9bd80b8540 0x7f9bd80d08b0 unknown :-1 s=CLOSED pgs=3268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T02:40:26.782 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:26.774+0000 7f9bde2dc700 1 --2- 172.21.15.46:0/82231823 >> v2:172.21.15.73:3300/0 conn(0x7f9bd81609f0 0x7f9bd80cf660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T02:40:26.782 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:26.774+0000 7f9bde2dc700 1 -- 172.21.15.46:0/82231823 >> 172.21.15.46:0/82231823 conn(0x7f9bd806a3a0 msgr2=0x7f9bd806a770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T02:40:26.783 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:26.774+0000 7f9bde2dc700 1 -- 172.21.15.46:0/82231823 shutdown_connections 2023-07-06T02:40:26.783 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:26.774+0000 7f9bde2dc700 1 -- 172.21.15.46:0/82231823 wait complete. 2023-07-06T02:40:26.786 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:26.776+0000 7f9bde2dc700 1 Processor -- start 2023-07-06T02:40:26.786 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:26.776+0000 7f9bde2dc700 1 -- start start 2023-07-06T02:40:26.786 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:26.776+0000 7f9bde2dc700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9bd80b8540 0x7f9bd80ace80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T02:40:26.787 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:26.776+0000 7f9bde2dc700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9bd80cfba0 0x7f9bd80cc4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T02:40:26.787 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:26.777+0000 7f9bde2dc700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f9bd81609f0 0x7f9bd80aab30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T02:40:26.787 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:26.777+0000 7f9bde2dc700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9bd80aa710 con 0x7f9bd80b8540 2023-07-06T02:40:26.787 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:26.777+0000 7f9bde2dc700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9bd8154a50 con 0x7f9bd80cfba0 2023-07-06T02:40:26.787 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:26.777+0000 7f9bde2dc700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9bd80cc9e0 con 0x7f9bd81609f0 2023-07-06T02:40:26.788 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:26.777+0000 7f9bd7fff700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9bd80b8540 0x7f9bd80ace80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T02:40:26.788 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:26.777+0000 7f9bd7fff700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9bd80b8540 0x7f9bd80ace80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:46228/0 (socket says 172.21.15.46:46228) 2023-07-06T02:40:26.788 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:26.777+0000 7f9bd7fff700 1 -- 172.21.15.46:0/1195174990 learned_addr learned my addr 172.21.15.46:0/1195174990 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-07-06T02:40:26.788 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:26.777+0000 7f9bd77fe700 1 --2- 172.21.15.46:0/1195174990 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9bd80cfba0 0x7f9bd80cc4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T02:40:26.788 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:26.777+0000 7f9bdc879700 1 --2- 172.21.15.46:0/1195174990 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f9bd81609f0 0x7f9bd80aab30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T02:40:26.789 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:26.777+0000 7f9bd7fff700 1 -- 172.21.15.46:0/1195174990 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f9bd81609f0 msgr2=0x7f9bd80aab30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T02:40:26.789 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:26.777+0000 7f9bd7fff700 1 --2- 172.21.15.46:0/1195174990 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f9bd81609f0 0x7f9bd80aab30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T02:40:26.789 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:26.777+0000 7f9bd7fff700 1 -- 172.21.15.46:0/1195174990 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9bd80cfba0 msgr2=0x7f9bd80cc4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T02:40:26.789 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:26.777+0000 7f9bd7fff700 1 --2- 172.21.15.46:0/1195174990 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9bd80cfba0 0x7f9bd80cc4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T02:40:26.789 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:26.777+0000 7f9bd7fff700 1 -- 172.21.15.46:0/1195174990 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9bc8009550 con 0x7f9bd80b8540 2023-07-06T02:40:26.790 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:26.777+0000 7f9bd7fff700 1 --2- 172.21.15.46:0/1195174990 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9bd80b8540 0x7f9bd80ace80 secure :-1 s=READY pgs=3269 cs=0 l=1 rev1=1 crypto rx=0x7f9bc8009c10 tx=0x7f9bc8004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T02:40:26.790 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:26.777+0000 7f9bd4ff9700 1 -- 172.21.15.46:0/1195174990 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9bc8004400 con 0x7f9bd80b8540 2023-07-06T02:40:26.790 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:26.777+0000 7f9bd4ff9700 1 -- 172.21.15.46:0/1195174990 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9bc801f070 con 0x7f9bd80b8540 2023-07-06T02:40:26.790 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:26.777+0000 7f9bd4ff9700 1 -- 172.21.15.46:0/1195174990 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9bc80038e0 con 0x7f9bd80b8540 2023-07-06T02:40:26.790 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:26.777+0000 7f9bde2dc700 1 -- 172.21.15.46:0/1195174990 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9bd80a9a90 con 0x7f9bd80b8540 2023-07-06T02:40:26.791 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:26.777+0000 7f9bde2dc700 1 -- 172.21.15.46:0/1195174990 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9bd80aa050 con 0x7f9bd80b8540 2023-07-06T02:40:26.791 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:26.778+0000 7f9bde2dc700 1 -- 172.21.15.46:0/1195174990 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f9bd80d0000 con 0x7f9bd80b8540 2023-07-06T02:40:26.791 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:26.779+0000 7f9bd4ff9700 1 -- 172.21.15.46:0/1195174990 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f9bc8021030 con 0x7f9bd80b8540 2023-07-06T02:40:26.791 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:26.779+0000 7f9bd4ff9700 1 --2- 172.21.15.46:0/1195174990 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7f9bc406ace0 0x7f9bc406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T02:40:26.791 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:26.779+0000 7f9bd4ff9700 1 -- 172.21.15.46:0/1195174990 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 5296+0+0 (secure 0 0 0) 0x7f9bc808a510 con 0x7f9bd80b8540 2023-07-06T02:40:26.792 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:26.779+0000 7f9bd77fe700 1 --2- 172.21.15.46:0/1195174990 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7f9bc406ace0 0x7f9bc406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T02:40:26.792 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:26.780+0000 7f9bd4ff9700 1 --2- 172.21.15.46:0/1195174990 >> [v2:172.21.15.73:6800/2083655348,v1:172.21.15.73:6801/2083655348] conn(0x7f9bc4071150 0x7f9bc4073560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T02:40:26.792 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:26.780+0000 7f9bd4ff9700 1 -- 172.21.15.46:0/1195174990 --> [v2:172.21.15.73:6800/2083655348,v1:172.21.15.73:6801/2083655348] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f9bc4073c30 con 0x7f9bc4071150 2023-07-06T02:40:26.792 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:26.780+0000 7f9bd4ff9700 1 -- 172.21.15.46:0/1195174990 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_get_version_reply(handle=1 version=40) v2 ==== 24+0+0 (secure 0 0 0) 0x7f9bc808cbb0 con 0x7f9bd80b8540 2023-07-06T02:40:26.793 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:26.780+0000 7f9bdc879700 1 --2- 172.21.15.46:0/1195174990 >> [v2:172.21.15.73:6800/2083655348,v1:172.21.15.73:6801/2083655348] conn(0x7f9bc4071150 0x7f9bc4073560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T02:40:26.793 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:26.780+0000 7f9bd77fe700 1 --2- 172.21.15.46:0/1195174990 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7f9bc406ace0 0x7f9bc406d190 secure :-1 s=READY pgs=745 cs=0 l=1 rev1=1 crypto rx=0x7f9bd80c9490 tx=0x7f9bcc009210 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T02:40:26.793 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:26.780+0000 7f9bdc879700 1 --2- 172.21.15.46:0/1195174990 >> [v2:172.21.15.73:6800/2083655348,v1:172.21.15.73:6801/2083655348] conn(0x7f9bc4071150 0x7f9bc4073560 crc :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T02:40:26.793 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:26.781+0000 7f9bd4ff9700 1 -- 172.21.15.46:0/1195174990 <== osd.4 v2:172.21.15.73:6800/2083655348 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7f9bc4073c30 con 0x7f9bc4071150 2023-07-06T02:40:26.799 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:26.796+0000 7f9bde2dc700 1 -- 172.21.15.46:0/1195174990 --> [v2:172.21.15.73:6800/2083655348,v1:172.21.15.73:6801/2083655348] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f9bd80cd770 con 0x7f9bc4071150 2023-07-06T02:40:26.800 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:26.797+0000 7f9bd4ff9700 1 -- 172.21.15.46:0/1195174990 <== osd.4 v2:172.21.15.73:6800/2083655348 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7f9bd0003a00 con 0x7f9bc4071150 2023-07-06T02:40:26.800 INFO:teuthology.orchestra.run.smithi046.stdout:{ 2023-07-06T02:40:26.801 INFO:teuthology.orchestra.run.smithi046.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-07-06T02:40:26.801 INFO:teuthology.orchestra.run.smithi046.stdout:} 2023-07-06T02:40:26.802 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:26.797+0000 7f9bde2dc700 1 -- 172.21.15.46:0/1195174990 >> [v2:172.21.15.73:6800/2083655348,v1:172.21.15.73:6801/2083655348] conn(0x7f9bc4071150 msgr2=0x7f9bc4073560 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T02:40:26.802 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:26.797+0000 7f9bde2dc700 1 --2- 172.21.15.46:0/1195174990 >> [v2:172.21.15.73:6800/2083655348,v1:172.21.15.73:6801/2083655348] conn(0x7f9bc4071150 0x7f9bc4073560 crc :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T02:40:26.802 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:26.797+0000 7f9bde2dc700 1 -- 172.21.15.46:0/1195174990 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7f9bc406ace0 msgr2=0x7f9bc406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T02:40:26.802 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:26.797+0000 7f9bde2dc700 1 --2- 172.21.15.46:0/1195174990 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7f9bc406ace0 0x7f9bc406d190 secure :-1 s=READY pgs=745 cs=0 l=1 rev1=1 crypto rx=0x7f9bd80c9490 tx=0x7f9bcc009210 comp rx=0 tx=0).stop 2023-07-06T02:40:26.802 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:26.797+0000 7f9bde2dc700 1 -- 172.21.15.46:0/1195174990 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9bd80b8540 msgr2=0x7f9bd80ace80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T02:40:26.803 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:26.797+0000 7f9bde2dc700 1 --2- 172.21.15.46:0/1195174990 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9bd80b8540 0x7f9bd80ace80 secure :-1 s=READY pgs=3269 cs=0 l=1 rev1=1 crypto rx=0x7f9bc8009c10 tx=0x7f9bc8004750 comp rx=0 tx=0).stop 2023-07-06T02:40:26.803 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:26.797+0000 7f9bdc879700 1 -- 172.21.15.46:0/1195174990 reap_dead start 2023-07-06T02:40:26.803 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:26.797+0000 7f9bde2dc700 1 -- 172.21.15.46:0/1195174990 shutdown_connections 2023-07-06T02:40:26.803 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:26.797+0000 7f9bde2dc700 1 -- 172.21.15.46:0/1195174990 >> 172.21.15.46:0/1195174990 conn(0x7f9bd806a3a0 msgr2=0x7f9bd80d1d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T02:40:26.804 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:26.797+0000 7f9bde2dc700 1 -- 172.21.15.46:0/1195174990 shutdown_connections 2023-07-06T02:40:26.804 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:26.797+0000 7f9bde2dc700 1 -- 172.21.15.46:0/1195174990 wait complete. 2023-07-06T02:40:26.814 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 4 2023-07-06T02:40:26.950 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:26.947+0000 7f5bd3857700 1 Processor -- start 2023-07-06T02:40:26.951 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:26.947+0000 7f5bd3857700 1 -- start start 2023-07-06T02:40:26.953 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:26.948+0000 7f5bd3857700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f5bcc15c6c0 0x7f5bcc0cd2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T02:40:26.953 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:26.948+0000 7f5bd3857700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f5bcc0b5ae0 0x7f5bcc0b5f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T02:40:26.953 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:26.948+0000 7f5bd3857700 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5bcc0cd8c0 con 0x7f5bcc15c2f0 2023-07-06T02:40:26.953 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:26.948+0000 7f5bd3857700 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5bcc0d0990 con 0x7f5bcc0b5ae0 2023-07-06T02:40:26.954 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:26.948+0000 7f5bd3857700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5bcc0d0c70 con 0x7f5bcc15c6c0 2023-07-06T02:40:26.954 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:26.948+0000 7f5bd15f3700 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7f5bcc15c2f0 0x7f5bcc06c760 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:45510/0 (socket says 172.21.15.46:45510) 2023-07-06T02:40:26.954 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:26.948+0000 7f5bd15f3700 1 -- 172.21.15.46:0/64704808 learned_addr learned my addr 172.21.15.46:0/64704808 (peer_addr_for_me v1:172.21.15.46:0/0) 2023-07-06T02:40:26.954 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:26.948+0000 7f5bd0df2700 1 --2- 172.21.15.46:0/64704808 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f5bcc15c6c0 0x7f5bcc0cd2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T02:40:26.954 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:26.948+0000 7f5bd1df4700 1 --2- 172.21.15.46:0/64704808 >> v2:172.21.15.73:3300/0 conn(0x7f5bcc0b5ae0 0x7f5bcc0b5f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T02:40:26.955 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:26.948+0000 7f5bc3fff700 1 -- 172.21.15.46:0/64704808 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2485727133 0 0) 0x7f5bcc0cd8c0 con 0x7f5bcc15c2f0 2023-07-06T02:40:26.955 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:26.948+0000 7f5bc3fff700 1 -- 172.21.15.46:0/64704808 --> v1:172.21.15.46:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5bb80035b0 con 0x7f5bcc15c2f0 2023-07-06T02:40:26.955 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:26.949+0000 7f5bd0df2700 1 -- 172.21.15.46:0/64704808 >> v2:172.21.15.73:3300/0 conn(0x7f5bcc0b5ae0 msgr2=0x7f5bcc0b5f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T02:40:26.955 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:26.949+0000 7f5bd0df2700 1 --2- 172.21.15.46:0/64704808 >> v2:172.21.15.73:3300/0 conn(0x7f5bcc0b5ae0 0x7f5bcc0b5f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T02:40:26.955 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:26.949+0000 7f5bc3fff700 1 -- 172.21.15.46:0/64704808 <== mon.0 v1:172.21.15.46:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 997747550 0 0) 0x7f5bb80035b0 con 0x7f5bcc15c2f0 2023-07-06T02:40:26.956 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:26.949+0000 7f5bd0df2700 1 -- 172.21.15.46:0/64704808 >> v1:172.21.15.46:6789/0 conn(0x7f5bcc15c2f0 legacy=0x7f5bcc06c760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T02:40:26.956 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:26.949+0000 7f5bd0df2700 1 -- 172.21.15.46:0/64704808 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5bcc0d0f50 con 0x7f5bcc15c6c0 2023-07-06T02:40:26.956 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:26.949+0000 7f5bd0df2700 1 --2- 172.21.15.46:0/64704808 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f5bcc15c6c0 0x7f5bcc0cd2e0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f5bbc009840 tx=0x7f5bbc009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=699ba819ae055871 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T02:40:26.956 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:26.949+0000 7f5bc3fff700 1 -- 172.21.15.46:0/64704808 <== mon.2 v2:172.21.15.73:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5bc8001670 con 0x7f5bcc15c6c0 2023-07-06T02:40:26.956 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:26.949+0000 7f5bc3fff700 1 -- 172.21.15.46:0/64704808 <== mon.2 v2:172.21.15.73:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5bbc004030 con 0x7f5bcc15c6c0 2023-07-06T02:40:26.957 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:26.949+0000 7f5bc3fff700 1 -- 172.21.15.46:0/64704808 <== mon.2 v2:172.21.15.73:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5bbc0043c0 con 0x7f5bcc15c6c0 2023-07-06T02:40:26.957 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:26.950+0000 7f5bd3857700 1 -- 172.21.15.46:0/64704808 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f5bcc15c6c0 msgr2=0x7f5bcc0cd2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T02:40:26.957 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:26.950+0000 7f5bd3857700 1 --2- 172.21.15.46:0/64704808 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f5bcc15c6c0 0x7f5bcc0cd2e0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f5bbc009840 tx=0x7f5bbc009b50 comp rx=0 tx=0).stop 2023-07-06T02:40:26.957 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:26.950+0000 7f5bd3857700 1 -- 172.21.15.46:0/64704808 shutdown_connections 2023-07-06T02:40:26.957 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:26.950+0000 7f5bd3857700 1 --2- 172.21.15.46:0/64704808 >> v2:172.21.15.73:3300/0 conn(0x7f5bcc0b5ae0 0x7f5bcc0b5f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T02:40:26.958 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:26.950+0000 7f5bd3857700 1 --2- 172.21.15.46:0/64704808 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f5bcc15c6c0 0x7f5bcc0cd2e0 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T02:40:26.958 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:26.950+0000 7f5bd3857700 1 -- 172.21.15.46:0/64704808 >> 172.21.15.46:0/64704808 conn(0x7f5bcc06afa0 msgr2=0x7f5bcc0cf710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T02:40:26.958 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:26.950+0000 7f5bd3857700 1 -- 172.21.15.46:0/64704808 shutdown_connections 2023-07-06T02:40:26.958 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:26.950+0000 7f5bd3857700 1 -- 172.21.15.46:0/64704808 wait complete. 2023-07-06T02:40:26.960 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:26.951+0000 7f5bd3857700 1 Processor -- start 2023-07-06T02:40:26.960 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:26.951+0000 7f5bd3857700 1 -- start start 2023-07-06T02:40:26.961 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:26.952+0000 7f5bd3857700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f5bcc0b5ae0 0x7f5bcc155230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T02:40:26.961 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:26.952+0000 7f5bd3857700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5bcc15c2f0 0x7f5bcc155a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T02:40:26.961 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:26.952+0000 7f5bd3857700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5bcc15c6c0 0x7f5bcc157390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T02:40:26.961 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:26.952+0000 7f5bd3857700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5bcc155770 con 0x7f5bcc15c6c0 2023-07-06T02:40:26.961 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:26.952+0000 7f5bd3857700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5bcc1563e0 con 0x7f5bcc15c2f0 2023-07-06T02:40:26.962 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:26.952+0000 7f5bd3857700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5bcc1566c0 con 0x7f5bcc0b5ae0 2023-07-06T02:40:26.962 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:26.952+0000 7f5bd1df4700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5bcc15c6c0 0x7f5bcc157390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T02:40:26.962 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:26.952+0000 7f5bd1df4700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5bcc15c6c0 0x7f5bcc157390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:46248/0 (socket says 172.21.15.46:46248) 2023-07-06T02:40:26.962 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:26.952+0000 7f5bd1df4700 1 -- 172.21.15.46:0/3308848057 learned_addr learned my addr 172.21.15.46:0/3308848057 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-07-06T02:40:26.962 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:26.952+0000 7f5bd15f3700 1 --2- 172.21.15.46:0/3308848057 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f5bcc0b5ae0 0x7f5bcc155230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T02:40:26.963 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:26.952+0000 7f5bd0df2700 1 --2- 172.21.15.46:0/3308848057 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5bcc15c2f0 0x7f5bcc155a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T02:40:26.963 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:26.952+0000 7f5bd1df4700 1 -- 172.21.15.46:0/3308848057 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f5bcc0b5ae0 msgr2=0x7f5bcc155230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T02:40:26.963 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:26.952+0000 7f5bd1df4700 1 --2- 172.21.15.46:0/3308848057 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f5bcc0b5ae0 0x7f5bcc155230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T02:40:26.963 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:26.952+0000 7f5bd1df4700 1 -- 172.21.15.46:0/3308848057 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5bcc15c2f0 msgr2=0x7f5bcc155a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T02:40:26.963 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:26.952+0000 7f5bd1df4700 1 --2- 172.21.15.46:0/3308848057 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5bcc15c2f0 0x7f5bcc155a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T02:40:26.964 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:26.952+0000 7f5bd1df4700 1 -- 172.21.15.46:0/3308848057 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5bbc0094a0 con 0x7f5bcc15c6c0 2023-07-06T02:40:26.964 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:26.952+0000 7f5bd1df4700 1 --2- 172.21.15.46:0/3308848057 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5bcc15c6c0 0x7f5bcc157390 secure :-1 s=READY pgs=3271 cs=0 l=1 rev1=1 crypto rx=0x7f5bc400efc0 tx=0x7f5bc400c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T02:40:26.964 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:26.953+0000 7f5bc1ffb700 1 -- 172.21.15.46:0/3308848057 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5bc4009ea0 con 0x7f5bcc15c6c0 2023-07-06T02:40:26.964 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:26.953+0000 7f5bc1ffb700 1 -- 172.21.15.46:0/3308848057 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5bc400f040 con 0x7f5bcc15c6c0 2023-07-06T02:40:26.964 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:26.953+0000 7f5bd3857700 1 -- 172.21.15.46:0/3308848057 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5bcc1569a0 con 0x7f5bcc15c6c0 2023-07-06T02:40:26.965 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:26.953+0000 7f5bc1ffb700 1 -- 172.21.15.46:0/3308848057 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5bc400ced0 con 0x7f5bcc15c6c0 2023-07-06T02:40:26.965 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:26.953+0000 7f5bd3857700 1 -- 172.21.15.46:0/3308848057 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5bcc156f60 con 0x7f5bcc15c6c0 2023-07-06T02:40:26.965 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:26.954+0000 7f5bd3857700 1 -- 172.21.15.46:0/3308848057 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5bcc04e1d0 con 0x7f5bcc15c6c0 2023-07-06T02:40:26.965 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:26.954+0000 7f5bc1ffb700 1 -- 172.21.15.46:0/3308848057 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f5bc4014480 con 0x7f5bcc15c6c0 2023-07-06T02:40:26.965 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:26.955+0000 7f5bc1ffb700 1 --2- 172.21.15.46:0/3308848057 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7f5bb006ace0 0x7f5bb006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T02:40:26.966 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:26.955+0000 7f5bc1ffb700 1 -- 172.21.15.46:0/3308848057 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 5296+0+0 (secure 0 0 0) 0x7f5bc4089970 con 0x7f5bcc15c6c0 2023-07-06T02:40:26.966 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:26.955+0000 7f5bd15f3700 1 --2- 172.21.15.46:0/3308848057 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7f5bb006ace0 0x7f5bb006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T02:40:26.966 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:26.956+0000 7f5bd15f3700 1 --2- 172.21.15.46:0/3308848057 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7f5bb006ace0 0x7f5bb006d190 secure :-1 s=READY pgs=746 cs=0 l=1 rev1=1 crypto rx=0x7f5bc8000f60 tx=0x7f5bc8001230 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T02:40:26.966 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:26.959+0000 7f5bc1ffb700 1 -- 172.21.15.46:0/3308848057 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f5bc4054d30 con 0x7f5bcc15c6c0 2023-07-06T02:40:27.174 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:27.172+0000 7f5bd3857700 1 -- 172.21.15.46:0/3308848057 --> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "4", "target": ["mon-mgr", ""]}) v1 -- 0x7f5bcc0cdba0 con 0x7f5bb006ace0 2023-07-06T02:40:27.175 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:27.172+0000 7f5bc1ffb700 1 -- 172.21.15.46:0/3308848057 <== mgr.4099 v2:172.21.15.73:6832/3033361733 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 4 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f5bc800f690 con 0x7f5bb006ace0 2023-07-06T02:40:27.178 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:27.174+0000 7f5bd3857700 1 -- 172.21.15.46:0/3308848057 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7f5bb006ace0 msgr2=0x7f5bb006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T02:40:27.178 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:27.174+0000 7f5bd3857700 1 --2- 172.21.15.46:0/3308848057 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7f5bb006ace0 0x7f5bb006d190 secure :-1 s=READY pgs=746 cs=0 l=1 rev1=1 crypto rx=0x7f5bc8000f60 tx=0x7f5bc8001230 comp rx=0 tx=0).stop 2023-07-06T02:40:27.178 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:27.175+0000 7f5bd3857700 1 -- 172.21.15.46:0/3308848057 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5bcc15c6c0 msgr2=0x7f5bcc157390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T02:40:27.178 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:27.175+0000 7f5bd3857700 1 --2- 172.21.15.46:0/3308848057 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5bcc15c6c0 0x7f5bcc157390 secure :-1 s=READY pgs=3271 cs=0 l=1 rev1=1 crypto rx=0x7f5bc400efc0 tx=0x7f5bc400c3a0 comp rx=0 tx=0).stop 2023-07-06T02:40:27.179 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:27.175+0000 7f5bd3857700 1 -- 172.21.15.46:0/3308848057 shutdown_connections 2023-07-06T02:40:27.179 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:27.175+0000 7f5bd3857700 1 --2- 172.21.15.46:0/3308848057 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7f5bb006ace0 0x7f5bb006d190 unknown :-1 s=CLOSED pgs=746 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T02:40:27.179 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:27.175+0000 7f5bd3857700 1 --2- 172.21.15.46:0/3308848057 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5bcc15c6c0 0x7f5bcc157390 unknown :-1 s=CLOSED pgs=3271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T02:40:27.179 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:27.175+0000 7f5bd3857700 1 --2- 172.21.15.46:0/3308848057 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f5bcc0b5ae0 0x7f5bcc155230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T02:40:27.179 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:27.175+0000 7f5bd3857700 1 --2- 172.21.15.46:0/3308848057 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5bcc15c2f0 0x7f5bcc155a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T02:40:27.179 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:27.175+0000 7f5bd3857700 1 -- 172.21.15.46:0/3308848057 >> 172.21.15.46:0/3308848057 conn(0x7f5bcc06afa0 msgr2=0x7f5bcc0d19b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T02:40:27.180 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:27.175+0000 7f5bd3857700 1 -- 172.21.15.46:0/3308848057 shutdown_connections 2023-07-06T02:40:27.180 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:27.175+0000 7f5bd3857700 1 -- 172.21.15.46:0/3308848057 wait complete. 2023-07-06T02:40:27.180 INFO:teuthology.orchestra.run.smithi046.stderr:instructed osd(s) 4 to deep-scrub 2023-07-06T02:40:27.192 INFO:tasks.ceph:Scrubbing osd.5 2023-07-06T02:40:27.192 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 config set osd_debug_deep_scrub_sleep 0 2023-07-06T02:40:27.332 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:27.329+0000 7f0f1c681700 1 Processor -- start 2023-07-06T02:40:27.332 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:27.329+0000 7f0f1c681700 1 -- start start 2023-07-06T02:40:27.334 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:27.330+0000 7f0f1c681700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f0f1415c6d0 0x7f0f140b1620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T02:40:27.334 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:27.330+0000 7f0f1c681700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f0f140d0890 0x7f0f140d0ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T02:40:27.334 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:27.330+0000 7f0f1c681700 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0f140d15d0 con 0x7f0f1406af10 2023-07-06T02:40:27.334 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:27.330+0000 7f0f1c681700 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0f140b1b60 con 0x7f0f140d0890 2023-07-06T02:40:27.335 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:27.330+0000 7f0f1c681700 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0f140d12f0 con 0x7f0f1415c6d0 2023-07-06T02:40:27.335 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:27.330+0000 7f0f19c1c700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f0f140d0890 0x7f0f140d0ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T02:40:27.335 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:27.330+0000 7f0f1ac1e700 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7f0f1406af10 0x7f0f140cb0f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:45526/0 (socket says 172.21.15.46:45526) 2023-07-06T02:40:27.335 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:27.330+0000 7f0f1ac1e700 1 -- 172.21.15.46:0/3553460229 learned_addr learned my addr 172.21.15.46:0/3553460229 (peer_addr_for_me v1:172.21.15.46:0/0) 2023-07-06T02:40:27.336 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:27.331+0000 7f0f1a41d700 1 --2- 172.21.15.46:0/3553460229 >> v2:172.21.15.73:3300/0 conn(0x7f0f1415c6d0 0x7f0f140b1620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T02:40:27.336 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:27.331+0000 7f0f1941b700 1 -- 172.21.15.46:0/3553460229 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4229042126 0 0) 0x7f0f140d15d0 con 0x7f0f1406af10 2023-07-06T02:40:27.336 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:27.331+0000 7f0f1941b700 1 -- 172.21.15.46:0/3553460229 --> v1:172.21.15.46:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0f000035b0 con 0x7f0f1406af10 2023-07-06T02:40:27.336 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:27.331+0000 7f0f19c1c700 1 -- 172.21.15.46:0/3553460229 >> v2:172.21.15.73:3300/0 conn(0x7f0f1415c6d0 msgr2=0x7f0f140b1620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T02:40:27.336 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:27.331+0000 7f0f19c1c700 1 --2- 172.21.15.46:0/3553460229 >> v2:172.21.15.73:3300/0 conn(0x7f0f1415c6d0 0x7f0f140b1620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T02:40:27.337 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:27.331+0000 7f0f19c1c700 1 -- 172.21.15.46:0/3553460229 >> v1:172.21.15.46:6789/0 conn(0x7f0f1406af10 legacy=0x7f0f140cb0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T02:40:27.337 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:27.331+0000 7f0f19c1c700 1 -- 172.21.15.46:0/3553460229 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0f140b0b40 con 0x7f0f140d0890 2023-07-06T02:40:27.337 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:27.331+0000 7f0f19c1c700 1 --2- 172.21.15.46:0/3553460229 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0f140d0890 0x7f0f140d0ce0 secure :-1 s=READY pgs=3273 cs=0 l=1 rev1=1 crypto rx=0x7f0f14071bf0 tx=0x7f0f04009b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=93e2c809cbed5421 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T02:40:27.337 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:27.331+0000 7f0f1941b700 1 -- 172.21.15.46:0/3553460229 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f04011830 con 0x7f0f140d0890 2023-07-06T02:40:27.337 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:27.331+0000 7f0f1941b700 1 -- 172.21.15.46:0/3553460229 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0f04011990 con 0x7f0f140d0890 2023-07-06T02:40:27.338 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:27.331+0000 7f0f1941b700 1 -- 172.21.15.46:0/3553460229 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f04011d20 con 0x7f0f140d0890 2023-07-06T02:40:27.341 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:27.332+0000 7f0f1c681700 1 -- 172.21.15.46:0/3553460229 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0f140d0890 msgr2=0x7f0f140d0ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T02:40:27.341 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:27.332+0000 7f0f1c681700 1 --2- 172.21.15.46:0/3553460229 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0f140d0890 0x7f0f140d0ce0 secure :-1 s=READY pgs=3273 cs=0 l=1 rev1=1 crypto rx=0x7f0f14071bf0 tx=0x7f0f04009b20 comp rx=0 tx=0).stop 2023-07-06T02:40:27.341 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:27.332+0000 7f0f1c681700 1 -- 172.21.15.46:0/3553460229 shutdown_connections 2023-07-06T02:40:27.341 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:27.332+0000 7f0f1c681700 1 --2- 172.21.15.46:0/3553460229 >> v2:172.21.15.73:3300/0 conn(0x7f0f1415c6d0 0x7f0f140b1620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T02:40:27.341 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:27.332+0000 7f0f1c681700 1 --2- 172.21.15.46:0/3553460229 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0f140d0890 0x7f0f140d0ce0 unknown :-1 s=CLOSED pgs=3273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T02:40:27.342 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:27.332+0000 7f0f1c681700 1 -- 172.21.15.46:0/3553460229 >> 172.21.15.46:0/3553460229 conn(0x7f0f140664b0 msgr2=0x7f0f14099da0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T02:40:27.342 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:27.332+0000 7f0f1c681700 1 -- 172.21.15.46:0/3553460229 shutdown_connections 2023-07-06T02:40:27.342 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:27.332+0000 7f0f1c681700 1 -- 172.21.15.46:0/3553460229 wait complete. 2023-07-06T02:40:27.342 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:27.333+0000 7f0f1c681700 1 Processor -- start 2023-07-06T02:40:27.343 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:27.333+0000 7f0f1c681700 1 -- start start 2023-07-06T02:40:27.343 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:27.334+0000 7f0f1c681700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0f1406af10 0x7f0f140b6140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T02:40:27.343 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:27.334+0000 7f0f1c681700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f0f140d0890 0x7f0f140c9e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T02:40:27.343 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:27.334+0000 7f0f1c681700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0f1415c6d0 0x7f0f140c7e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T02:40:27.343 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:27.334+0000 7f0f1c681700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f1415dc20 con 0x7f0f1406af10 2023-07-06T02:40:27.343 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:27.334+0000 7f0f1c681700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f1415d010 con 0x7f0f1415c6d0 2023-07-06T02:40:27.344 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:27.334+0000 7f0f1c681700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0f1415d2f0 con 0x7f0f140d0890 2023-07-06T02:40:27.344 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:27.334+0000 7f0f1a41d700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0f1406af10 0x7f0f140b6140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T02:40:27.344 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:27.334+0000 7f0f1a41d700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0f1406af10 0x7f0f140b6140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:46256/0 (socket says 172.21.15.46:46256) 2023-07-06T02:40:27.344 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:27.334+0000 7f0f1a41d700 1 -- 172.21.15.46:0/3617926551 learned_addr learned my addr 172.21.15.46:0/3617926551 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-07-06T02:40:27.345 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:27.334+0000 7f0f19c1c700 1 --2- 172.21.15.46:0/3617926551 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f0f140d0890 0x7f0f140c9e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T02:40:27.345 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:27.334+0000 7f0f1ac1e700 1 --2- 172.21.15.46:0/3617926551 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0f1415c6d0 0x7f0f140c7e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T02:40:27.345 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:27.334+0000 7f0f1a41d700 1 -- 172.21.15.46:0/3617926551 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f0f140d0890 msgr2=0x7f0f140c9e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T02:40:27.345 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:27.334+0000 7f0f1a41d700 1 --2- 172.21.15.46:0/3617926551 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f0f140d0890 0x7f0f140c9e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T02:40:27.345 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:27.334+0000 7f0f1a41d700 1 -- 172.21.15.46:0/3617926551 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0f1415c6d0 msgr2=0x7f0f140c7e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T02:40:27.345 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:27.334+0000 7f0f1a41d700 1 --2- 172.21.15.46:0/3617926551 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0f1415c6d0 0x7f0f140c7e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T02:40:27.346 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:27.334+0000 7f0f1a41d700 1 -- 172.21.15.46:0/3617926551 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0f040094a0 con 0x7f0f1406af10 2023-07-06T02:40:27.346 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:27.334+0000 7f0f1ac1e700 1 --2- 172.21.15.46:0/3617926551 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0f1415c6d0 0x7f0f140c7e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-06T02:40:27.346 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:27.335+0000 7f0f1a41d700 1 --2- 172.21.15.46:0/3617926551 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0f1406af10 0x7f0f140b6140 secure :-1 s=READY pgs=3274 cs=0 l=1 rev1=1 crypto rx=0x7f0f1000e9b0 tx=0x7f0f1000ed70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T02:40:27.346 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:27.335+0000 7f0f0affd700 1 -- 172.21.15.46:0/3617926551 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f10009710 con 0x7f0f1406af10 2023-07-06T02:40:27.346 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:27.335+0000 7f0f0affd700 1 -- 172.21.15.46:0/3617926551 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0f1000c850 con 0x7f0f1406af10 2023-07-06T02:40:27.347 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:27.335+0000 7f0f1c681700 1 -- 172.21.15.46:0/3617926551 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0f1415d5d0 con 0x7f0f1406af10 2023-07-06T02:40:27.347 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:27.335+0000 7f0f0affd700 1 -- 172.21.15.46:0/3617926551 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f1000cbc0 con 0x7f0f1406af10 2023-07-06T02:40:27.347 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:27.335+0000 7f0f1c681700 1 -- 172.21.15.46:0/3617926551 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0f140b6680 con 0x7f0f1406af10 2023-07-06T02:40:27.347 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:27.336+0000 7f0f1c681700 1 -- 172.21.15.46:0/3617926551 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f0f140b1100 con 0x7f0f1406af10 2023-07-06T02:40:27.347 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:27.336+0000 7f0f0affd700 1 -- 172.21.15.46:0/3617926551 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f0f1000cd20 con 0x7f0f1406af10 2023-07-06T02:40:27.348 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:27.337+0000 7f0f0affd700 1 --2- 172.21.15.46:0/3617926551 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7f0ef806ace0 0x7f0ef806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T02:40:27.348 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:27.337+0000 7f0f0affd700 1 -- 172.21.15.46:0/3617926551 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 5296+0+0 (secure 0 0 0) 0x7f0f10089630 con 0x7f0f1406af10 2023-07-06T02:40:27.348 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:27.337+0000 7f0f19c1c700 1 --2- 172.21.15.46:0/3617926551 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7f0ef806ace0 0x7f0ef806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T02:40:27.348 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:27.337+0000 7f0f0affd700 1 --2- 172.21.15.46:0/3617926551 >> [v2:172.21.15.73:6824/2803788401,v1:172.21.15.73:6825/2803788401] conn(0x7f0ef8071150 0x7f0ef8073560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T02:40:27.349 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:27.337+0000 7f0f0affd700 1 -- 172.21.15.46:0/3617926551 --> [v2:172.21.15.73:6824/2803788401,v1:172.21.15.73:6825/2803788401] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f0ef8073c30 con 0x7f0ef8071150 2023-07-06T02:40:27.349 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:27.337+0000 7f0f0affd700 1 -- 172.21.15.46:0/3617926551 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_get_version_reply(handle=1 version=40) v2 ==== 24+0+0 (secure 0 0 0) 0x7f0f10089a60 con 0x7f0f1406af10 2023-07-06T02:40:27.349 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:27.337+0000 7f0f1ac1e700 1 --2- 172.21.15.46:0/3617926551 >> [v2:172.21.15.73:6824/2803788401,v1:172.21.15.73:6825/2803788401] conn(0x7f0ef8071150 0x7f0ef8073560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T02:40:27.349 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:27.338+0000 7f0f19c1c700 1 --2- 172.21.15.46:0/3617926551 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7f0ef806ace0 0x7f0ef806d190 secure :-1 s=READY pgs=747 cs=0 l=1 rev1=1 crypto rx=0x7f0f14071bf0 tx=0x7f0f0401c040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T02:40:27.349 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:27.338+0000 7f0f1ac1e700 1 --2- 172.21.15.46:0/3617926551 >> [v2:172.21.15.73:6824/2803788401,v1:172.21.15.73:6825/2803788401] conn(0x7f0ef8071150 0x7f0ef8073560 crc :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T02:40:27.350 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:27.338+0000 7f0f0affd700 1 -- 172.21.15.46:0/3617926551 <== osd.5 v2:172.21.15.73:6824/2803788401 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7f0ef8073c30 con 0x7f0ef8071150 2023-07-06T02:40:27.356 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:27.354+0000 7f0f1c681700 1 -- 172.21.15.46:0/3617926551 --> [v2:172.21.15.73:6824/2803788401,v1:172.21.15.73:6825/2803788401] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f0f140b0e20 con 0x7f0ef8071150 2023-07-06T02:40:27.357 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:27.354+0000 7f0f0affd700 1 -- 172.21.15.46:0/3617926551 <== osd.5 v2:172.21.15.73:6824/2803788401 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7f0f0c0070f0 con 0x7f0ef8071150 2023-07-06T02:40:27.357 INFO:teuthology.orchestra.run.smithi046.stdout:{ 2023-07-06T02:40:27.358 INFO:teuthology.orchestra.run.smithi046.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-07-06T02:40:27.358 INFO:teuthology.orchestra.run.smithi046.stdout:} 2023-07-06T02:40:27.359 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:27.355+0000 7f0f1c681700 1 -- 172.21.15.46:0/3617926551 >> [v2:172.21.15.73:6824/2803788401,v1:172.21.15.73:6825/2803788401] conn(0x7f0ef8071150 msgr2=0x7f0ef8073560 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T02:40:27.359 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:27.355+0000 7f0f1c681700 1 --2- 172.21.15.46:0/3617926551 >> [v2:172.21.15.73:6824/2803788401,v1:172.21.15.73:6825/2803788401] conn(0x7f0ef8071150 0x7f0ef8073560 crc :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T02:40:27.359 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:27.355+0000 7f0f1c681700 1 -- 172.21.15.46:0/3617926551 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7f0ef806ace0 msgr2=0x7f0ef806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T02:40:27.360 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:27.355+0000 7f0f1c681700 1 --2- 172.21.15.46:0/3617926551 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7f0ef806ace0 0x7f0ef806d190 secure :-1 s=READY pgs=747 cs=0 l=1 rev1=1 crypto rx=0x7f0f14071bf0 tx=0x7f0f0401c040 comp rx=0 tx=0).stop 2023-07-06T02:40:27.360 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:27.355+0000 7f0f1c681700 1 -- 172.21.15.46:0/3617926551 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0f1406af10 msgr2=0x7f0f140b6140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T02:40:27.360 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:27.355+0000 7f0f1c681700 1 --2- 172.21.15.46:0/3617926551 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0f1406af10 0x7f0f140b6140 secure :-1 s=READY pgs=3274 cs=0 l=1 rev1=1 crypto rx=0x7f0f1000e9b0 tx=0x7f0f1000ed70 comp rx=0 tx=0).stop 2023-07-06T02:40:27.360 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:27.355+0000 7f0f1ac1e700 1 -- 172.21.15.46:0/3617926551 reap_dead start 2023-07-06T02:40:27.361 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:27.355+0000 7f0f1c681700 1 -- 172.21.15.46:0/3617926551 shutdown_connections 2023-07-06T02:40:27.361 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:27.355+0000 7f0f1c681700 1 -- 172.21.15.46:0/3617926551 >> 172.21.15.46:0/3617926551 conn(0x7f0f140664b0 msgr2=0x7f0f1406d860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T02:40:27.361 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:27.355+0000 7f0f1c681700 1 -- 172.21.15.46:0/3617926551 shutdown_connections 2023-07-06T02:40:27.362 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:27.355+0000 7f0f1c681700 1 -- 172.21.15.46:0/3617926551 wait complete. 2023-07-06T02:40:27.371 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 5 2023-07-06T02:40:27.507 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:27.504+0000 7f1be410e700 1 Processor -- start 2023-07-06T02:40:27.508 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:27.505+0000 7f1be410e700 1 -- start start 2023-07-06T02:40:27.509 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:27.505+0000 7f1be410e700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f1bdc0b17c0 0x7f1bdc06bb60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T02:40:27.509 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:27.505+0000 7f1be410e700 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1bdc15cb30 con 0x7f1bdc0b1350 2023-07-06T02:40:27.509 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:27.505+0000 7f1be410e700 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1bdc0b1d40 con 0x7f1bdc0cea30 2023-07-06T02:40:27.510 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:27.505+0000 7f1be410e700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1bdc06b030 con 0x7f1bdc0b17c0 2023-07-06T02:40:27.510 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:27.505+0000 7f1be16a9700 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7f1bdc0b1350 0x7f1bdc06b450 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:45540/0 (socket says 172.21.15.46:45540) 2023-07-06T02:40:27.510 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:27.506+0000 7f1be16a9700 1 -- 172.21.15.46:0/2226253385 learned_addr learned my addr 172.21.15.46:0/2226253385 (peer_addr_for_me v1:172.21.15.46:0/0) 2023-07-06T02:40:27.510 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:27.506+0000 7f1be26ab700 1 --2- 172.21.15.46:0/2226253385 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f1bdc0b17c0 0x7f1bdc06bb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T02:40:27.511 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:27.506+0000 7f1be0ea8700 1 -- 172.21.15.46:0/2226253385 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1408095507 0 0) 0x7f1bdc15cb30 con 0x7f1bdc0b1350 2023-07-06T02:40:27.511 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:27.506+0000 7f1be0ea8700 1 -- 172.21.15.46:0/2226253385 --> v1:172.21.15.46:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1bc80035b0 con 0x7f1bdc0b1350 2023-07-06T02:40:27.511 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:27.506+0000 7f1be0ea8700 1 -- 172.21.15.46:0/2226253385 <== mon.1 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3501387179 0 0) 0x7f1bdc0b1d40 con 0x7f1bdc0cea30 2023-07-06T02:40:27.511 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:27.506+0000 7f1be26ab700 1 -- 172.21.15.46:0/2226253385 >> v1:172.21.15.73:6789/0 conn(0x7f1bdc0cea30 legacy=0x7f1bdc0cee00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T02:40:27.511 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:27.506+0000 7f1be26ab700 1 -- 172.21.15.46:0/2226253385 >> v1:172.21.15.46:6789/0 conn(0x7f1bdc0b1350 legacy=0x7f1bdc06b450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T02:40:27.512 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:27.506+0000 7f1be26ab700 1 -- 172.21.15.46:0/2226253385 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1bdc0b2020 con 0x7f1bdc0b17c0 2023-07-06T02:40:27.512 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:27.506+0000 7f1be26ab700 1 --2- 172.21.15.46:0/2226253385 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f1bdc0b17c0 0x7f1bdc06bb60 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f1bd4009dc0 tx=0x7f1bd400b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6118bde33a53b875 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T02:40:27.512 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:27.506+0000 7f1be0ea8700 1 -- 172.21.15.46:0/2226253385 <== mon.2 v2:172.21.15.73:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1bd400e070 con 0x7f1bdc0b17c0 2023-07-06T02:40:27.512 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:27.507+0000 7f1be0ea8700 1 -- 172.21.15.46:0/2226253385 <== mon.2 v2:172.21.15.73:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1bd4003a20 con 0x7f1bdc0b17c0 2023-07-06T02:40:27.513 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:27.507+0000 7f1be0ea8700 1 -- 172.21.15.46:0/2226253385 <== mon.2 v2:172.21.15.73:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1bcc001670 con 0x7f1bdc0b17c0 2023-07-06T02:40:27.515 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:27.507+0000 7f1be410e700 1 -- 172.21.15.46:0/2226253385 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f1bdc0b17c0 msgr2=0x7f1bdc06bb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T02:40:27.515 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:27.507+0000 7f1be410e700 1 --2- 172.21.15.46:0/2226253385 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f1bdc0b17c0 0x7f1bdc06bb60 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f1bd4009dc0 tx=0x7f1bd400b330 comp rx=0 tx=0).stop 2023-07-06T02:40:27.516 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:27.507+0000 7f1be410e700 1 -- 172.21.15.46:0/2226253385 shutdown_connections 2023-07-06T02:40:27.516 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:27.507+0000 7f1be410e700 1 --2- 172.21.15.46:0/2226253385 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f1bdc0b17c0 0x7f1bdc06bb60 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T02:40:27.516 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:27.507+0000 7f1be410e700 1 -- 172.21.15.46:0/2226253385 >> 172.21.15.46:0/2226253385 conn(0x7f1bdc099e00 msgr2=0x7f1bdc0d0b00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T02:40:27.517 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:27.507+0000 7f1be410e700 1 -- 172.21.15.46:0/2226253385 shutdown_connections 2023-07-06T02:40:27.517 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:27.507+0000 7f1be410e700 1 -- 172.21.15.46:0/2226253385 wait complete. 2023-07-06T02:40:27.517 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:27.508+0000 7f1be410e700 1 Processor -- start 2023-07-06T02:40:27.517 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:27.508+0000 7f1be410e700 1 -- start start 2023-07-06T02:40:27.517 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:27.509+0000 7f1be410e700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1bdc0b1350 0x7f1bdc1f54e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T02:40:27.518 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:27.509+0000 7f1be410e700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1bdc0b17c0 0x7f1bdc1f2800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T02:40:27.518 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:27.509+0000 7f1be410e700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f1bdc0cea30 0x7f1bdc1f1640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T02:40:27.518 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:27.509+0000 7f1be410e700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1bdc1f5dc0 con 0x7f1bdc0b17c0 2023-07-06T02:40:27.518 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:27.509+0000 7f1be410e700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1bdc1f60a0 con 0x7f1bdc0b1350 2023-07-06T02:40:27.518 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:27.509+0000 7f1be410e700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1bdc1f6380 con 0x7f1bdc0cea30 2023-07-06T02:40:27.519 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:27.509+0000 7f1be16a9700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1bdc0b17c0 0x7f1bdc1f2800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T02:40:27.519 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:27.509+0000 7f1be16a9700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1bdc0b17c0 0x7f1bdc1f2800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:46272/0 (socket says 172.21.15.46:46272) 2023-07-06T02:40:27.519 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:27.509+0000 7f1be16a9700 1 -- 172.21.15.46:0/3522744831 learned_addr learned my addr 172.21.15.46:0/3522744831 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-07-06T02:40:27.520 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:27.509+0000 7f1be1eaa700 1 --2- 172.21.15.46:0/3522744831 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1bdc0b1350 0x7f1bdc1f54e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T02:40:27.520 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:27.509+0000 7f1be26ab700 1 --2- 172.21.15.46:0/3522744831 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f1bdc0cea30 0x7f1bdc1f1640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T02:40:27.520 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:27.510+0000 7f1be16a9700 1 -- 172.21.15.46:0/3522744831 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f1bdc0cea30 msgr2=0x7f1bdc1f1640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T02:40:27.520 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:27.510+0000 7f1be16a9700 1 --2- 172.21.15.46:0/3522744831 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f1bdc0cea30 0x7f1bdc1f1640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T02:40:27.521 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:27.510+0000 7f1be16a9700 1 -- 172.21.15.46:0/3522744831 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1bdc0b1350 msgr2=0x7f1bdc1f54e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T02:40:27.521 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:27.510+0000 7f1be16a9700 1 --2- 172.21.15.46:0/3522744831 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1bdc0b1350 0x7f1bdc1f54e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T02:40:27.521 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:27.510+0000 7f1be16a9700 1 -- 172.21.15.46:0/3522744831 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1bd4009a70 con 0x7f1bdc0b17c0 2023-07-06T02:40:27.521 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:27.510+0000 7f1be16a9700 1 --2- 172.21.15.46:0/3522744831 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1bdc0b17c0 0x7f1bdc1f2800 secure :-1 s=READY pgs=3276 cs=0 l=1 rev1=1 crypto rx=0x7f1bcc00c750 tx=0x7f1bcc00ca60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T02:40:27.522 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:27.510+0000 7f1bd27fc700 1 -- 172.21.15.46:0/3522744831 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1bcc004c80 con 0x7f1bdc0b17c0 2023-07-06T02:40:27.522 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:27.510+0000 7f1bd27fc700 1 -- 172.21.15.46:0/3522744831 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1bcc004de0 con 0x7f1bdc0b17c0 2023-07-06T02:40:27.522 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:27.510+0000 7f1be410e700 1 -- 172.21.15.46:0/3522744831 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1bdc1f2000 con 0x7f1bdc0b17c0 2023-07-06T02:40:27.522 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:27.510+0000 7f1bd27fc700 1 -- 172.21.15.46:0/3522744831 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1bcc0072f0 con 0x7f1bdc0b17c0 2023-07-06T02:40:27.522 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:27.510+0000 7f1be410e700 1 -- 172.21.15.46:0/3522744831 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1bdc1f5a20 con 0x7f1bdc0b17c0 2023-07-06T02:40:27.523 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:27.511+0000 7f1be410e700 1 -- 172.21.15.46:0/3522744831 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1bdc1f2520 con 0x7f1bdc0b17c0 2023-07-06T02:40:27.523 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:27.512+0000 7f1bd27fc700 1 -- 172.21.15.46:0/3522744831 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f1bcc007450 con 0x7f1bdc0b17c0 2023-07-06T02:40:27.524 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:27.512+0000 7f1bd27fc700 1 --2- 172.21.15.46:0/3522744831 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7f1bc006ace0 0x7f1bc006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T02:40:27.524 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:27.512+0000 7f1bd27fc700 1 -- 172.21.15.46:0/3522744831 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 5296+0+0 (secure 0 0 0) 0x7f1bcc088f60 con 0x7f1bdc0b17c0 2023-07-06T02:40:27.524 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:27.512+0000 7f1be1eaa700 1 --2- 172.21.15.46:0/3522744831 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7f1bc006ace0 0x7f1bc006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T02:40:27.525 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:27.513+0000 7f1be1eaa700 1 --2- 172.21.15.46:0/3522744831 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7f1bc006ace0 0x7f1bc006d190 secure :-1 s=READY pgs=748 cs=0 l=1 rev1=1 crypto rx=0x7f1bd8007fd0 tx=0x7f1bd8009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T02:40:27.526 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:27.517+0000 7f1bd27fc700 1 -- 172.21.15.46:0/3522744831 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f1bdc1f2520 con 0x7f1bdc0b17c0 2023-07-06T02:40:27.730 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:27.727+0000 7f1be410e700 1 -- 172.21.15.46:0/3522744831 --> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "5", "target": ["mon-mgr", ""]}) v1 -- 0x7f1bdc1f6210 con 0x7f1bc006ace0 2023-07-06T02:40:27.731 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:27.728+0000 7f1bd27fc700 1 -- 172.21.15.46:0/3522744831 <== mgr.4099 v2:172.21.15.73:6832/3033361733 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 5 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f1bdc1f6210 con 0x7f1bc006ace0 2023-07-06T02:40:27.733 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:27.730+0000 7f1be410e700 1 -- 172.21.15.46:0/3522744831 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7f1bc006ace0 msgr2=0x7f1bc006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T02:40:27.734 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:27.730+0000 7f1be410e700 1 --2- 172.21.15.46:0/3522744831 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7f1bc006ace0 0x7f1bc006d190 secure :-1 s=READY pgs=748 cs=0 l=1 rev1=1 crypto rx=0x7f1bd8007fd0 tx=0x7f1bd8009040 comp rx=0 tx=0).stop 2023-07-06T02:40:27.734 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:27.730+0000 7f1be410e700 1 -- 172.21.15.46:0/3522744831 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1bdc0b17c0 msgr2=0x7f1bdc1f2800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T02:40:27.734 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:27.730+0000 7f1be410e700 1 --2- 172.21.15.46:0/3522744831 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1bdc0b17c0 0x7f1bdc1f2800 secure :-1 s=READY pgs=3276 cs=0 l=1 rev1=1 crypto rx=0x7f1bcc00c750 tx=0x7f1bcc00ca60 comp rx=0 tx=0).stop 2023-07-06T02:40:27.734 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:27.730+0000 7f1be410e700 1 -- 172.21.15.46:0/3522744831 shutdown_connections 2023-07-06T02:40:27.735 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:27.730+0000 7f1be410e700 1 --2- 172.21.15.46:0/3522744831 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7f1bc006ace0 0x7f1bc006d190 unknown :-1 s=CLOSED pgs=748 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T02:40:27.735 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:27.730+0000 7f1be410e700 1 --2- 172.21.15.46:0/3522744831 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f1bdc0cea30 0x7f1bdc1f1640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T02:40:27.735 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:27.730+0000 7f1be410e700 1 --2- 172.21.15.46:0/3522744831 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1bdc0b1350 0x7f1bdc1f54e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T02:40:27.735 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:27.730+0000 7f1be410e700 1 --2- 172.21.15.46:0/3522744831 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1bdc0b17c0 0x7f1bdc1f2800 unknown :-1 s=CLOSED pgs=3276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T02:40:27.735 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:27.730+0000 7f1be410e700 1 -- 172.21.15.46:0/3522744831 >> 172.21.15.46:0/3522744831 conn(0x7f1bdc099e00 msgr2=0x7f1bdc06f080 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T02:40:27.736 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:27.730+0000 7f1be410e700 1 -- 172.21.15.46:0/3522744831 shutdown_connections 2023-07-06T02:40:27.736 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:27.730+0000 7f1be410e700 1 -- 172.21.15.46:0/3522744831 wait complete. 2023-07-06T02:40:27.736 INFO:teuthology.orchestra.run.smithi046.stderr:instructed osd(s) 5 to deep-scrub 2023-07-06T02:40:27.747 INFO:tasks.ceph:Scrubbing osd.6 2023-07-06T02:40:27.748 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 config set osd_debug_deep_scrub_sleep 0 2023-07-06T02:40:27.887 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:27.884+0000 7f6ad1ede700 1 Processor -- start 2023-07-06T02:40:27.888 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:27.884+0000 7f6ad1ede700 1 -- start start 2023-07-06T02:40:27.891 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:27.885+0000 7f6ad1ede700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f6acc0b8540 0x7f6acc0d08b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T02:40:27.891 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:27.885+0000 7f6ad1ede700 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6acc0cf1d0 con 0x7f6acc1609f0 2023-07-06T02:40:27.891 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:27.885+0000 7f6ad1ede700 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6acc0cd4b0 con 0x7f6acc0cfd70 2023-07-06T02:40:27.892 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:27.885+0000 7f6ad1ede700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6acc0cda50 con 0x7f6acc0b8540 2023-07-06T02:40:27.892 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:27.885+0000 7f6acaffd700 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7f6acc1609f0 0x7f6acc0cf660 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:45556/0 (socket says 172.21.15.46:45556) 2023-07-06T02:40:27.892 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:27.885+0000 7f6acaffd700 1 -- 172.21.15.46:0/4064431204 learned_addr learned my addr 172.21.15.46:0/4064431204 (peer_addr_for_me v1:172.21.15.46:0/0) 2023-07-06T02:40:27.892 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:27.886+0000 7f6aca7fc700 1 -- 172.21.15.46:0/4064431204 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3257920953 0 0) 0x7f6acc0cf1d0 con 0x7f6acc1609f0 2023-07-06T02:40:27.892 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:27.886+0000 7f6acb7fe700 1 --2- 172.21.15.46:0/4064431204 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f6acc0b8540 0x7f6acc0d08b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T02:40:27.893 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:27.886+0000 7f6aca7fc700 1 -- 172.21.15.46:0/4064431204 --> v1:172.21.15.46:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6ab40035b0 con 0x7f6acc1609f0 2023-07-06T02:40:27.893 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:27.886+0000 7f6aca7fc700 1 -- 172.21.15.46:0/4064431204 <== mon.0 v1:172.21.15.46:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1607998959 0 0) 0x7f6ab40035b0 con 0x7f6acc1609f0 2023-07-06T02:40:27.893 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:27.886+0000 7f6aca7fc700 1 -- 172.21.15.46:0/4064431204 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f6acc0b8540 msgr2=0x7f6acc0d08b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T02:40:27.893 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:27.886+0000 7f6aca7fc700 1 --2- 172.21.15.46:0/4064431204 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f6acc0b8540 0x7f6acc0d08b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T02:40:27.894 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:27.886+0000 7f6aca7fc700 1 -- 172.21.15.46:0/4064431204 >> v1:172.21.15.73:6789/0 conn(0x7f6acc0cfd70 legacy=0x7f6acc15ca10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T02:40:27.894 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:27.886+0000 7f6aca7fc700 1 -- 172.21.15.46:0/4064431204 --> v1:172.21.15.46:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6acc0cd770 con 0x7f6acc1609f0 2023-07-06T02:40:27.894 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:27.886+0000 7f6aca7fc700 1 -- 172.21.15.46:0/4064431204 <== mon.0 v1:172.21.15.46:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2195585215 0 0) 0x7f6ac0001670 con 0x7f6acc1609f0 2023-07-06T02:40:27.894 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:27.886+0000 7f6aca7fc700 1 -- 172.21.15.46:0/4064431204 >> v1:172.21.15.46:6789/0 conn(0x7f6acc1609f0 legacy=0x7f6acc0cf660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T02:40:27.894 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:27.886+0000 7f6aca7fc700 1 --2- 172.21.15.46:0/4064431204 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6ab4003a30 0x7f6ab4003e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T02:40:27.895 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:27.886+0000 7f6aca7fc700 1 --2- 172.21.15.46:0/4064431204 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6ab4004850 0x7f6ab4004cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T02:40:27.895 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:27.886+0000 7f6aca7fc700 1 --2- 172.21.15.46:0/4064431204 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f6acc0b8540 0x7f6ab4005200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T02:40:27.895 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:27.886+0000 7f6aca7fc700 1 -- 172.21.15.46:0/4064431204 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6acc0cda50 con 0x7f6ab4004850 2023-07-06T02:40:27.895 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:27.886+0000 7f6aca7fc700 1 -- 172.21.15.46:0/4064431204 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ab400bac0 con 0x7f6ab4003a30 2023-07-06T02:40:27.895 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:27.886+0000 7f6aca7fc700 1 -- 172.21.15.46:0/4064431204 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6ab400bc50 con 0x7f6acc0b8540 2023-07-06T02:40:27.896 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:27.886+0000 7f6acaffd700 1 --2- 172.21.15.46:0/4064431204 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6ab4004850 0x7f6ab4004cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T02:40:27.896 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:27.886+0000 7f6acb7fe700 1 --2- 172.21.15.46:0/4064431204 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6ab4003a30 0x7f6ab4003e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T02:40:27.896 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:27.886+0000 7f6acbfff700 1 --2- 172.21.15.46:0/4064431204 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f6acc0b8540 0x7f6ab4005200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T02:40:27.896 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:27.886+0000 7f6acaffd700 1 -- 172.21.15.46:0/4064431204 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f6acc0b8540 msgr2=0x7f6ab4005200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T02:40:27.897 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:27.886+0000 7f6acaffd700 1 --2- 172.21.15.46:0/4064431204 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f6acc0b8540 0x7f6ab4005200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T02:40:27.897 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:27.886+0000 7f6acaffd700 1 -- 172.21.15.46:0/4064431204 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6ab4003a30 msgr2=0x7f6ab4003e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T02:40:27.897 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:27.887+0000 7f6acaffd700 1 --2- 172.21.15.46:0/4064431204 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6ab4003a30 0x7f6ab4003e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T02:40:27.897 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:27.887+0000 7f6acaffd700 1 -- 172.21.15.46:0/4064431204 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ab40035b0 con 0x7f6ab4004850 2023-07-06T02:40:27.897 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:27.887+0000 7f6acaffd700 1 --2- 172.21.15.46:0/4064431204 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6ab4004850 0x7f6ab4004cc0 secure :-1 s=READY pgs=3278 cs=0 l=1 rev1=1 crypto rx=0x7f6ac000c240 tx=0x7f6ab4005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=13c4356c9e0e4cca server_cookie=0 in_seq=0 out_seq=0 2023-07-06T02:40:27.898 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:27.887+0000 7f6aca7fc700 1 -- 172.21.15.46:0/4064431204 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ac0007c10 con 0x7f6ab4004850 2023-07-06T02:40:27.898 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:27.887+0000 7f6aca7fc700 1 -- 172.21.15.46:0/4064431204 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6ac000ce00 con 0x7f6ab4004850 2023-07-06T02:40:27.898 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:27.887+0000 7f6aca7fc700 1 -- 172.21.15.46:0/4064431204 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ac0005ba0 con 0x7f6ab4004850 2023-07-06T02:40:27.898 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:27.887+0000 7f6ad1ede700 1 -- 172.21.15.46:0/4064431204 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6ab4004850 msgr2=0x7f6ab4004cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T02:40:27.898 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:27.887+0000 7f6ad1ede700 1 --2- 172.21.15.46:0/4064431204 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6ab4004850 0x7f6ab4004cc0 secure :-1 s=READY pgs=3278 cs=0 l=1 rev1=1 crypto rx=0x7f6ac000c240 tx=0x7f6ab4005880 comp rx=0 tx=0).stop 2023-07-06T02:40:27.899 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:27.887+0000 7f6acbfff700 1 -- 172.21.15.46:0/4064431204 reap_dead start 2023-07-06T02:40:27.899 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:27.887+0000 7f6ad1ede700 1 -- 172.21.15.46:0/4064431204 shutdown_connections 2023-07-06T02:40:27.899 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:27.887+0000 7f6ad1ede700 1 -- 172.21.15.46:0/4064431204 >> 172.21.15.46:0/4064431204 conn(0x7f6acc06a3a0 msgr2=0x7f6acc06a770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T02:40:27.899 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:27.887+0000 7f6ad1ede700 1 -- 172.21.15.46:0/4064431204 shutdown_connections 2023-07-06T02:40:27.899 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:27.888+0000 7f6ad1ede700 1 -- 172.21.15.46:0/4064431204 wait complete. 2023-07-06T02:40:27.902 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:27.889+0000 7f6ad1ede700 1 Processor -- start 2023-07-06T02:40:27.902 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:27.889+0000 7f6ad1ede700 1 -- start start 2023-07-06T02:40:27.903 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:27.889+0000 7f6ad1ede700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f6ab4004850 0x7f6acc0c8be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T02:40:27.903 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:27.890+0000 7f6ad1ede700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6acc0ca340 0x7f6acc1589c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T02:40:27.903 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:27.890+0000 7f6ad1ede700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6acc0ca7b0 0x7f6acc158f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T02:40:27.903 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:27.890+0000 7f6ad1ede700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6acc0c9120 con 0x7f6acc0ca7b0 2023-07-06T02:40:27.903 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:27.890+0000 7f6ad1ede700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6acc0cd220 con 0x7f6acc0ca340 2023-07-06T02:40:27.904 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:27.890+0000 7f6ad1ede700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6acc0cc460 con 0x7f6ab4004850 2023-07-06T02:40:27.904 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:27.890+0000 7f6acbfff700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6acc0ca7b0 0x7f6acc158f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T02:40:27.904 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:27.890+0000 7f6acbfff700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6acc0ca7b0 0x7f6acc158f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:46296/0 (socket says 172.21.15.46:46296) 2023-07-06T02:40:27.904 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:27.890+0000 7f6acbfff700 1 -- 172.21.15.46:0/319394314 learned_addr learned my addr 172.21.15.46:0/319394314 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-07-06T02:40:27.905 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:27.890+0000 7f6acaffd700 1 --2- 172.21.15.46:0/319394314 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6acc0ca340 0x7f6acc1589c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T02:40:27.905 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:27.890+0000 7f6acb7fe700 1 --2- 172.21.15.46:0/319394314 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f6ab4004850 0x7f6acc0c8be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T02:40:27.905 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:27.890+0000 7f6acbfff700 1 -- 172.21.15.46:0/319394314 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f6ab4004850 msgr2=0x7f6acc0c8be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T02:40:27.906 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:27.890+0000 7f6acbfff700 1 --2- 172.21.15.46:0/319394314 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f6ab4004850 0x7f6acc0c8be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T02:40:27.906 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:27.890+0000 7f6acbfff700 1 -- 172.21.15.46:0/319394314 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6acc0ca340 msgr2=0x7f6acc1589c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T02:40:27.906 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:27.890+0000 7f6acbfff700 1 --2- 172.21.15.46:0/319394314 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6acc0ca340 0x7f6acc1589c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T02:40:27.907 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:27.890+0000 7f6acbfff700 1 -- 172.21.15.46:0/319394314 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6acc0cc740 con 0x7f6acc0ca7b0 2023-07-06T02:40:27.907 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:27.890+0000 7f6acbfff700 1 --2- 172.21.15.46:0/319394314 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6acc0ca7b0 0x7f6acc158f00 secure :-1 s=READY pgs=3279 cs=0 l=1 rev1=1 crypto rx=0x7f6acc0b18c0 tx=0x7f6ac400d150 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T02:40:27.908 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:27.890+0000 7f6ab3fff700 1 -- 172.21.15.46:0/319394314 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ac4003c10 con 0x7f6acc0ca7b0 2023-07-06T02:40:27.908 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:27.890+0000 7f6ab3fff700 1 -- 172.21.15.46:0/319394314 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6ac4003d90 con 0x7f6acc0ca7b0 2023-07-06T02:40:27.909 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:27.890+0000 7f6ab3fff700 1 -- 172.21.15.46:0/319394314 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ac400d950 con 0x7f6acc0ca7b0 2023-07-06T02:40:27.909 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:27.890+0000 7f6ad1ede700 1 -- 172.21.15.46:0/319394314 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6acc0cca20 con 0x7f6acc0ca7b0 2023-07-06T02:40:27.909 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:27.890+0000 7f6ad1ede700 1 -- 172.21.15.46:0/319394314 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6acc0cc080 con 0x7f6acc0ca7b0 2023-07-06T02:40:27.910 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:27.891+0000 7f6ad1ede700 1 -- 172.21.15.46:0/319394314 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f6acc0cc240 con 0x7f6acc0ca7b0 2023-07-06T02:40:27.910 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:27.892+0000 7f6ab3fff700 1 -- 172.21.15.46:0/319394314 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f6ac400dab0 con 0x7f6acc0ca7b0 2023-07-06T02:40:27.911 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:27.892+0000 7f6ab3fff700 1 --2- 172.21.15.46:0/319394314 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7f6ab806ace0 0x7f6ab806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T02:40:27.911 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:27.893+0000 7f6ab3fff700 1 -- 172.21.15.46:0/319394314 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 5296+0+0 (secure 0 0 0) 0x7f6ac4089d50 con 0x7f6acc0ca7b0 2023-07-06T02:40:27.911 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:27.893+0000 7f6ab3fff700 1 --2- 172.21.15.46:0/319394314 >> [v2:172.21.15.73:6808/974108383,v1:172.21.15.73:6809/974108383] conn(0x7f6ab8071150 0x7f6ab8073560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T02:40:27.912 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:27.893+0000 7f6ab3fff700 1 -- 172.21.15.46:0/319394314 --> [v2:172.21.15.73:6808/974108383,v1:172.21.15.73:6809/974108383] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f6ab8073c30 con 0x7f6ab8071150 2023-07-06T02:40:27.912 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:27.893+0000 7f6ab3fff700 1 -- 172.21.15.46:0/319394314 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_get_version_reply(handle=1 version=40) v2 ==== 24+0+0 (secure 0 0 0) 0x7f6ac408a180 con 0x7f6acc0ca7b0 2023-07-06T02:40:27.913 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:27.893+0000 7f6acb7fe700 1 --2- 172.21.15.46:0/319394314 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7f6ab806ace0 0x7f6ab806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T02:40:27.913 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:27.893+0000 7f6acaffd700 1 --2- 172.21.15.46:0/319394314 >> [v2:172.21.15.73:6808/974108383,v1:172.21.15.73:6809/974108383] conn(0x7f6ab8071150 0x7f6ab8073560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T02:40:27.913 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:27.893+0000 7f6acb7fe700 1 --2- 172.21.15.46:0/319394314 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7f6ab806ace0 0x7f6ab806d190 secure :-1 s=READY pgs=749 cs=0 l=1 rev1=1 crypto rx=0x7f6abc009c60 tx=0x7f6abc009210 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T02:40:27.914 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:27.893+0000 7f6acaffd700 1 --2- 172.21.15.46:0/319394314 >> [v2:172.21.15.73:6808/974108383,v1:172.21.15.73:6809/974108383] conn(0x7f6ab8071150 0x7f6ab8073560 crc :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T02:40:27.914 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:27.894+0000 7f6ab3fff700 1 -- 172.21.15.46:0/319394314 <== osd.6 v2:172.21.15.73:6808/974108383 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7f6ab8073c30 con 0x7f6ab8071150 2023-07-06T02:40:27.914 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:27.909+0000 7f6ad1ede700 1 -- 172.21.15.46:0/319394314 --> [v2:172.21.15.73:6808/974108383,v1:172.21.15.73:6809/974108383] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f6acc0d08b0 con 0x7f6ab8071150 2023-07-06T02:40:27.915 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:27.910+0000 7f6ab3fff700 1 -- 172.21.15.46:0/319394314 <== osd.6 v2:172.21.15.73:6808/974108383 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7f6ac0007b30 con 0x7f6ab8071150 2023-07-06T02:40:27.915 INFO:teuthology.orchestra.run.smithi046.stdout:{ 2023-07-06T02:40:27.915 INFO:teuthology.orchestra.run.smithi046.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-07-06T02:40:27.916 INFO:teuthology.orchestra.run.smithi046.stdout:} 2023-07-06T02:40:27.916 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:27.910+0000 7f6ad1ede700 1 -- 172.21.15.46:0/319394314 >> [v2:172.21.15.73:6808/974108383,v1:172.21.15.73:6809/974108383] conn(0x7f6ab8071150 msgr2=0x7f6ab8073560 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T02:40:27.917 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:27.910+0000 7f6ad1ede700 1 --2- 172.21.15.46:0/319394314 >> [v2:172.21.15.73:6808/974108383,v1:172.21.15.73:6809/974108383] conn(0x7f6ab8071150 0x7f6ab8073560 crc :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T02:40:27.917 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:27.910+0000 7f6ad1ede700 1 -- 172.21.15.46:0/319394314 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7f6ab806ace0 msgr2=0x7f6ab806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T02:40:27.917 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:27.910+0000 7f6ad1ede700 1 --2- 172.21.15.46:0/319394314 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7f6ab806ace0 0x7f6ab806d190 secure :-1 s=READY pgs=749 cs=0 l=1 rev1=1 crypto rx=0x7f6abc009c60 tx=0x7f6abc009210 comp rx=0 tx=0).stop 2023-07-06T02:40:27.917 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:27.910+0000 7f6ad1ede700 1 -- 172.21.15.46:0/319394314 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6acc0ca7b0 msgr2=0x7f6acc158f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T02:40:27.917 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:27.910+0000 7f6ad1ede700 1 --2- 172.21.15.46:0/319394314 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6acc0ca7b0 0x7f6acc158f00 secure :-1 s=READY pgs=3279 cs=0 l=1 rev1=1 crypto rx=0x7f6acc0b18c0 tx=0x7f6ac400d150 comp rx=0 tx=0).stop 2023-07-06T02:40:27.918 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:27.910+0000 7f6acbfff700 1 -- 172.21.15.46:0/319394314 reap_dead start 2023-07-06T02:40:27.918 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:27.910+0000 7f6ad1ede700 1 -- 172.21.15.46:0/319394314 shutdown_connections 2023-07-06T02:40:27.918 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:27.910+0000 7f6ad1ede700 1 -- 172.21.15.46:0/319394314 >> 172.21.15.46:0/319394314 conn(0x7f6acc06a3a0 msgr2=0x7f6acc0d0cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T02:40:27.918 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:27.910+0000 7f6ad1ede700 1 -- 172.21.15.46:0/319394314 shutdown_connections 2023-07-06T02:40:27.918 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:27.911+0000 7f6ad1ede700 1 -- 172.21.15.46:0/319394314 wait complete. 2023-07-06T02:40:27.927 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 6 2023-07-06T02:40:28.063 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:28.060+0000 7f36ae304700 1 Processor -- start 2023-07-06T02:40:28.063 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:28.060+0000 7f36ae304700 1 -- start start 2023-07-06T02:40:28.065 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:28.061+0000 7f36ae304700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f36a815c2f0 0x7f36a80cd2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T02:40:28.065 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:28.061+0000 7f36ae304700 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f36a80cd8c0 con 0x7f36a80b5ae0 2023-07-06T02:40:28.066 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:28.061+0000 7f36ae304700 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f36a80d0990 con 0x7f36a815c6c0 2023-07-06T02:40:28.066 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:28.061+0000 7f36ae304700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f36a80d0c70 con 0x7f36a815c2f0 2023-07-06T02:40:28.066 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:28.061+0000 7f36ac8a1700 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7f36a80b5ae0 0x7f36a80d1450 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:45578/0 (socket says 172.21.15.46:45578) 2023-07-06T02:40:28.066 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:28.061+0000 7f36ac8a1700 1 -- 172.21.15.46:0/1550167972 learned_addr learned my addr 172.21.15.46:0/1550167972 (peer_addr_for_me v1:172.21.15.46:0/0) 2023-07-06T02:40:28.066 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:28.061+0000 7f36a7fff700 1 --2- 172.21.15.46:0/1550167972 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f36a815c2f0 0x7f36a80cd2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T02:40:28.067 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:28.062+0000 7f36a6ffd700 1 -- 172.21.15.46:0/1550167972 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 324685607 0 0) 0x7f36a80cd8c0 con 0x7f36a80b5ae0 2023-07-06T02:40:28.067 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:28.062+0000 7f36a6ffd700 1 -- 172.21.15.46:0/1550167972 --> v1:172.21.15.46:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f36900035b0 con 0x7f36a80b5ae0 2023-07-06T02:40:28.067 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:28.062+0000 7f36a6ffd700 1 -- 172.21.15.46:0/1550167972 <== mon.1 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 728097780 0 0) 0x7f36a80d0990 con 0x7f36a815c6c0 2023-07-06T02:40:28.067 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:28.062+0000 7f36a6ffd700 1 -- 172.21.15.46:0/1550167972 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f36a80cd8c0 con 0x7f36a815c6c0 2023-07-06T02:40:28.067 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:28.062+0000 7f36a7fff700 1 -- 172.21.15.46:0/1550167972 >> v1:172.21.15.73:6789/0 conn(0x7f36a815c6c0 legacy=0x7f36a806c760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T02:40:28.068 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:28.062+0000 7f36a7fff700 1 -- 172.21.15.46:0/1550167972 >> v1:172.21.15.46:6789/0 conn(0x7f36a80b5ae0 legacy=0x7f36a80d1450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T02:40:28.068 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:28.062+0000 7f36a7fff700 1 -- 172.21.15.46:0/1550167972 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f36a80d0f50 con 0x7f36a815c2f0 2023-07-06T02:40:28.068 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:28.062+0000 7f36a7fff700 1 --2- 172.21.15.46:0/1550167972 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f36a815c2f0 0x7f36a80cd2e0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f369c009870 tx=0x7f369c009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8d9436a544d09776 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T02:40:28.068 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:28.062+0000 7f36a6ffd700 1 -- 172.21.15.46:0/1550167972 <== mon.2 v2:172.21.15.73:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f369c011830 con 0x7f36a815c2f0 2023-07-06T02:40:28.069 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:28.062+0000 7f36a6ffd700 1 -- 172.21.15.46:0/1550167972 <== mon.2 v2:172.21.15.73:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f369c011990 con 0x7f36a815c2f0 2023-07-06T02:40:28.069 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:28.062+0000 7f36a6ffd700 1 -- 172.21.15.46:0/1550167972 <== mon.2 v2:172.21.15.73:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f369c011d00 con 0x7f36a815c2f0 2023-07-06T02:40:28.071 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:28.063+0000 7f36ae304700 1 -- 172.21.15.46:0/1550167972 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f36a815c2f0 msgr2=0x7f36a80cd2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T02:40:28.071 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:28.063+0000 7f36ae304700 1 --2- 172.21.15.46:0/1550167972 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f36a815c2f0 0x7f36a80cd2e0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f369c009870 tx=0x7f369c009b80 comp rx=0 tx=0).stop 2023-07-06T02:40:28.072 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:28.063+0000 7f36ae304700 1 -- 172.21.15.46:0/1550167972 shutdown_connections 2023-07-06T02:40:28.072 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:28.063+0000 7f36ae304700 1 --2- 172.21.15.46:0/1550167972 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f36a815c2f0 0x7f36a80cd2e0 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T02:40:28.072 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:28.063+0000 7f36ae304700 1 -- 172.21.15.46:0/1550167972 >> 172.21.15.46:0/1550167972 conn(0x7f36a806afa0 msgr2=0x7f36a80cf710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T02:40:28.072 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:28.063+0000 7f36ae304700 1 -- 172.21.15.46:0/1550167972 shutdown_connections 2023-07-06T02:40:28.072 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:28.063+0000 7f36ae304700 1 -- 172.21.15.46:0/1550167972 wait complete. 2023-07-06T02:40:28.073 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:28.064+0000 7f36ae304700 1 Processor -- start 2023-07-06T02:40:28.073 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:28.064+0000 7f36ae304700 1 -- start start 2023-07-06T02:40:28.073 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:28.065+0000 7f36ae304700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f36a80b5ae0 0x7f36a8156630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T02:40:28.073 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:28.065+0000 7f36ae304700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f36a815c2f0 0x7f36a81f55b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T02:40:28.073 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:28.065+0000 7f36ae304700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f36a815c6c0 0x7f36a8153230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T02:40:28.074 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:28.065+0000 7f36ae304700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36a81f6550 con 0x7f36a80b5ae0 2023-07-06T02:40:28.074 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:28.065+0000 7f36ae304700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36a81f1f70 con 0x7f36a815c2f0 2023-07-06T02:40:28.074 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:28.065+0000 7f36ae304700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f36a81f5cb0 con 0x7f36a815c6c0 2023-07-06T02:40:28.074 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:28.065+0000 7f36a7fff700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f36a80b5ae0 0x7f36a8156630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T02:40:28.074 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:28.065+0000 7f36a7fff700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f36a80b5ae0 0x7f36a8156630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:46308/0 (socket says 172.21.15.46:46308) 2023-07-06T02:40:28.075 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:28.065+0000 7f36a7fff700 1 -- 172.21.15.46:0/1300089645 learned_addr learned my addr 172.21.15.46:0/1300089645 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-07-06T02:40:28.075 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:28.065+0000 7f36ac8a1700 1 --2- 172.21.15.46:0/1300089645 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f36a815c6c0 0x7f36a8153230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T02:40:28.075 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:28.065+0000 7f36a77fe700 1 --2- 172.21.15.46:0/1300089645 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f36a815c2f0 0x7f36a81f55b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T02:40:28.075 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:28.065+0000 7f36a7fff700 1 -- 172.21.15.46:0/1300089645 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f36a815c6c0 msgr2=0x7f36a8153230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T02:40:28.075 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:28.065+0000 7f36a7fff700 1 --2- 172.21.15.46:0/1300089645 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f36a815c6c0 0x7f36a8153230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T02:40:28.076 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:28.065+0000 7f36a7fff700 1 -- 172.21.15.46:0/1300089645 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f36a815c2f0 msgr2=0x7f36a81f55b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T02:40:28.076 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:28.065+0000 7f36a7fff700 1 --2- 172.21.15.46:0/1300089645 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f36a815c2f0 0x7f36a81f55b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T02:40:28.076 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:28.065+0000 7f36a7fff700 1 -- 172.21.15.46:0/1300089645 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f369c0094a0 con 0x7f36a80b5ae0 2023-07-06T02:40:28.076 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:28.065+0000 7f36a77fe700 1 --2- 172.21.15.46:0/1300089645 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f36a815c2f0 0x7f36a81f55b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-06T02:40:28.076 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:28.066+0000 7f36a7fff700 1 --2- 172.21.15.46:0/1300089645 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f36a80b5ae0 0x7f36a8156630 secure :-1 s=READY pgs=3281 cs=0 l=1 rev1=1 crypto rx=0x7f36a806d010 tx=0x7f369c004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T02:40:28.077 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:28.066+0000 7f36a4ff9700 1 -- 172.21.15.46:0/1300089645 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f369c0044d0 con 0x7f36a80b5ae0 2023-07-06T02:40:28.077 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:28.066+0000 7f36a4ff9700 1 -- 172.21.15.46:0/1300089645 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f369c01f070 con 0x7f36a80b5ae0 2023-07-06T02:40:28.077 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:28.066+0000 7f36a4ff9700 1 -- 172.21.15.46:0/1300089645 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f369c0038c0 con 0x7f36a80b5ae0 2023-07-06T02:40:28.077 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:28.066+0000 7f36ae304700 1 -- 172.21.15.46:0/1300089645 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f36a81f5f90 con 0x7f36a80b5ae0 2023-07-06T02:40:28.077 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:28.066+0000 7f36ae304700 1 -- 172.21.15.46:0/1300089645 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f36a81f21d0 con 0x7f36a80b5ae0 2023-07-06T02:40:28.078 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:28.067+0000 7f36ae304700 1 -- 172.21.15.46:0/1300089645 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f36a804e1d0 con 0x7f36a80b5ae0 2023-07-06T02:40:28.078 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:28.067+0000 7f36a4ff9700 1 -- 172.21.15.46:0/1300089645 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f369c003a20 con 0x7f36a80b5ae0 2023-07-06T02:40:28.078 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:28.068+0000 7f36a4ff9700 1 --2- 172.21.15.46:0/1300089645 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7f369406ace0 0x7f369406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T02:40:28.078 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:28.068+0000 7f36a4ff9700 1 -- 172.21.15.46:0/1300089645 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 5296+0+0 (secure 0 0 0) 0x7f369c021070 con 0x7f36a80b5ae0 2023-07-06T02:40:28.078 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:28.068+0000 7f36a77fe700 1 --2- 172.21.15.46:0/1300089645 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7f369406ace0 0x7f369406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T02:40:28.078 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:28.068+0000 7f36a77fe700 1 --2- 172.21.15.46:0/1300089645 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7f369406ace0 0x7f369406d190 secure :-1 s=READY pgs=750 cs=0 l=1 rev1=1 crypto rx=0x7f36a8153cd0 tx=0x7f3698009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T02:40:28.079 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:28.072+0000 7f36a4ff9700 1 -- 172.21.15.46:0/1300089645 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f369c055da0 con 0x7f36a80b5ae0 2023-07-06T02:40:28.281 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:28.278+0000 7f36ae304700 1 -- 172.21.15.46:0/1300089645 --> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "6", "target": ["mon-mgr", ""]}) v1 -- 0x7f36a80cdba0 con 0x7f369406ace0 2023-07-06T02:40:28.282 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:28.279+0000 7f36a4ff9700 1 -- 172.21.15.46:0/1300089645 <== mgr.4099 v2:172.21.15.73:6832/3033361733 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 6 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f3698001400 con 0x7f369406ace0 2023-07-06T02:40:28.285 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:28.281+0000 7f36ae304700 1 -- 172.21.15.46:0/1300089645 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7f369406ace0 msgr2=0x7f369406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T02:40:28.285 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:28.281+0000 7f36ae304700 1 --2- 172.21.15.46:0/1300089645 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7f369406ace0 0x7f369406d190 secure :-1 s=READY pgs=750 cs=0 l=1 rev1=1 crypto rx=0x7f36a8153cd0 tx=0x7f3698009040 comp rx=0 tx=0).stop 2023-07-06T02:40:28.285 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:28.281+0000 7f36ae304700 1 -- 172.21.15.46:0/1300089645 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f36a80b5ae0 msgr2=0x7f36a8156630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T02:40:28.286 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:28.281+0000 7f36ae304700 1 --2- 172.21.15.46:0/1300089645 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f36a80b5ae0 0x7f36a8156630 secure :-1 s=READY pgs=3281 cs=0 l=1 rev1=1 crypto rx=0x7f36a806d010 tx=0x7f369c004750 comp rx=0 tx=0).stop 2023-07-06T02:40:28.286 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:28.281+0000 7f36ae304700 1 -- 172.21.15.46:0/1300089645 shutdown_connections 2023-07-06T02:40:28.286 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:28.281+0000 7f36ae304700 1 --2- 172.21.15.46:0/1300089645 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7f369406ace0 0x7f369406d190 unknown :-1 s=CLOSED pgs=750 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T02:40:28.286 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:28.281+0000 7f36ae304700 1 --2- 172.21.15.46:0/1300089645 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f36a815c6c0 0x7f36a8153230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T02:40:28.286 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:28.281+0000 7f36ae304700 1 --2- 172.21.15.46:0/1300089645 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f36a80b5ae0 0x7f36a8156630 unknown :-1 s=CLOSED pgs=3281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T02:40:28.287 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:28.281+0000 7f36ae304700 1 --2- 172.21.15.46:0/1300089645 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f36a815c2f0 0x7f36a81f55b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T02:40:28.287 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:28.281+0000 7f36ae304700 1 -- 172.21.15.46:0/1300089645 >> 172.21.15.46:0/1300089645 conn(0x7f36a806afa0 msgr2=0x7f36a806bd90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T02:40:28.287 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:28.281+0000 7f36ae304700 1 -- 172.21.15.46:0/1300089645 shutdown_connections 2023-07-06T02:40:28.287 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:28.281+0000 7f36ae304700 1 -- 172.21.15.46:0/1300089645 wait complete. 2023-07-06T02:40:28.288 INFO:teuthology.orchestra.run.smithi046.stderr:instructed osd(s) 6 to deep-scrub 2023-07-06T02:40:28.298 INFO:tasks.ceph:Scrubbing osd.7 2023-07-06T02:40:28.299 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 config set osd_debug_deep_scrub_sleep 0 2023-07-06T02:40:28.439 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:28.436+0000 7fec2b95e700 1 Processor -- start 2023-07-06T02:40:28.439 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:28.436+0000 7fec2b95e700 1 -- start start 2023-07-06T02:40:28.442 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:28.437+0000 7fec2b95e700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fec240b8540 0x7fec240d08b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T02:40:28.442 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:28.437+0000 7fec2b95e700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fec240cfd70 0x7fec2415ca10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T02:40:28.443 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:28.437+0000 7fec2b95e700 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fec240cf1d0 con 0x7fec241609f0 2023-07-06T02:40:28.443 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:28.437+0000 7fec2b95e700 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fec240cda50 con 0x7fec240cfd70 2023-07-06T02:40:28.443 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:28.437+0000 7fec2b95e700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fec240b8910 con 0x7fec240b8540 2023-07-06T02:40:28.443 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:28.437+0000 7fec28ef9700 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7fec241609f0 0x7fec240cf660 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:45590/0 (socket says 172.21.15.46:45590) 2023-07-06T02:40:28.444 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:28.437+0000 7fec28ef9700 1 -- 172.21.15.46:0/3526342589 learned_addr learned my addr 172.21.15.46:0/3526342589 (peer_addr_for_me v1:172.21.15.46:0/0) 2023-07-06T02:40:28.444 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:28.437+0000 7fec1bfff700 1 -- 172.21.15.46:0/3526342589 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 899786004 0 0) 0x7fec240cf1d0 con 0x7fec241609f0 2023-07-06T02:40:28.444 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:28.437+0000 7fec296fa700 1 --2- 172.21.15.46:0/3526342589 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fec240b8540 0x7fec240d08b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T02:40:28.444 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:28.437+0000 7fec29efb700 1 --2- 172.21.15.46:0/3526342589 >> v2:172.21.15.73:3300/0 conn(0x7fec240cfd70 0x7fec2415ca10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T02:40:28.445 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:28.437+0000 7fec1bfff700 1 -- 172.21.15.46:0/3526342589 --> v1:172.21.15.46:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fec100035b0 con 0x7fec241609f0 2023-07-06T02:40:28.445 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:28.438+0000 7fec1bfff700 1 -- 172.21.15.46:0/3526342589 <== mon.0 v1:172.21.15.46:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2560342693 0 0) 0x7fec100035b0 con 0x7fec241609f0 2023-07-06T02:40:28.445 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:28.438+0000 7fec1bfff700 1 -- 172.21.15.46:0/3526342589 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fec240b8540 msgr2=0x7fec240d08b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T02:40:28.445 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:28.438+0000 7fec1bfff700 1 --2- 172.21.15.46:0/3526342589 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fec240b8540 0x7fec240d08b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T02:40:28.445 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:28.438+0000 7fec1bfff700 1 -- 172.21.15.46:0/3526342589 >> v2:172.21.15.73:3300/0 conn(0x7fec240cfd70 msgr2=0x7fec2415ca10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T02:40:28.446 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:28.438+0000 7fec1bfff700 1 --2- 172.21.15.46:0/3526342589 >> v2:172.21.15.73:3300/0 conn(0x7fec240cfd70 0x7fec2415ca10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T02:40:28.446 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:28.438+0000 7fec1bfff700 1 -- 172.21.15.46:0/3526342589 --> v1:172.21.15.46:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fec240cd4b0 con 0x7fec241609f0 2023-07-06T02:40:28.446 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:28.438+0000 7fec1bfff700 1 -- 172.21.15.46:0/3526342589 <== mon.0 v1:172.21.15.46:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2195585215 0 0) 0x7fec20001670 con 0x7fec241609f0 2023-07-06T02:40:28.446 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:28.438+0000 7fec1bfff700 1 -- 172.21.15.46:0/3526342589 >> v1:172.21.15.46:6789/0 conn(0x7fec241609f0 legacy=0x7fec240cf660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T02:40:28.446 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:28.438+0000 7fec1bfff700 1 --2- 172.21.15.46:0/3526342589 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fec240b8540 0x7fec10003a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T02:40:28.446 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:28.438+0000 7fec1bfff700 1 --2- 172.21.15.46:0/3526342589 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fec10003f80 0x7fec10004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T02:40:28.447 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:28.438+0000 7fec1bfff700 1 --2- 172.21.15.46:0/3526342589 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fec10004d90 0x7fec10005200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T02:40:28.447 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:28.438+0000 7fec1bfff700 1 -- 172.21.15.46:0/3526342589 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec240cda50 con 0x7fec10003f80 2023-07-06T02:40:28.447 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:28.438+0000 7fec1bfff700 1 -- 172.21.15.46:0/3526342589 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec1000ba10 con 0x7fec10004d90 2023-07-06T02:40:28.447 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:28.438+0000 7fec1bfff700 1 -- 172.21.15.46:0/3526342589 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fec1000bb50 con 0x7fec240b8540 2023-07-06T02:40:28.448 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:28.438+0000 7fec28ef9700 1 --2- 172.21.15.46:0/3526342589 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fec10003f80 0x7fec10004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T02:40:28.448 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:28.438+0000 7fec296fa700 1 --2- 172.21.15.46:0/3526342589 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fec240b8540 0x7fec10003a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T02:40:28.448 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:28.438+0000 7fec29efb700 1 --2- 172.21.15.46:0/3526342589 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fec10004d90 0x7fec10005200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T02:40:28.448 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:28.438+0000 7fec28ef9700 1 -- 172.21.15.46:0/3526342589 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fec240b8540 msgr2=0x7fec10003a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T02:40:28.448 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:28.438+0000 7fec28ef9700 1 --2- 172.21.15.46:0/3526342589 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fec240b8540 0x7fec10003a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T02:40:28.449 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:28.438+0000 7fec28ef9700 1 -- 172.21.15.46:0/3526342589 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fec10004d90 msgr2=0x7fec10005200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T02:40:28.449 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:28.438+0000 7fec28ef9700 1 --2- 172.21.15.46:0/3526342589 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fec10004d90 0x7fec10005200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T02:40:28.449 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:28.438+0000 7fec28ef9700 1 -- 172.21.15.46:0/3526342589 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fec100035b0 con 0x7fec10003f80 2023-07-06T02:40:28.449 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:28.438+0000 7fec28ef9700 1 --2- 172.21.15.46:0/3526342589 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fec10003f80 0x7fec10004850 secure :-1 s=READY pgs=3283 cs=0 l=1 rev1=1 crypto rx=0x7fec2000c370 tx=0x7fec10005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aea4e09e5a9cc9a6 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T02:40:28.449 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:28.439+0000 7fec1bfff700 1 -- 172.21.15.46:0/3526342589 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec20007c60 con 0x7fec10003f80 2023-07-06T02:40:28.450 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:28.439+0000 7fec1bfff700 1 -- 172.21.15.46:0/3526342589 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fec20005960 con 0x7fec10003f80 2023-07-06T02:40:28.450 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:28.439+0000 7fec1bfff700 1 -- 172.21.15.46:0/3526342589 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec20005d10 con 0x7fec10003f80 2023-07-06T02:40:28.450 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:28.439+0000 7fec2b95e700 1 -- 172.21.15.46:0/3526342589 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fec10003f80 msgr2=0x7fec10004850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T02:40:28.450 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:28.439+0000 7fec2b95e700 1 --2- 172.21.15.46:0/3526342589 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fec10003f80 0x7fec10004850 secure :-1 s=READY pgs=3283 cs=0 l=1 rev1=1 crypto rx=0x7fec2000c370 tx=0x7fec10005880 comp rx=0 tx=0).stop 2023-07-06T02:40:28.450 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:28.439+0000 7fec29efb700 1 -- 172.21.15.46:0/3526342589 reap_dead start 2023-07-06T02:40:28.451 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:28.439+0000 7fec2b95e700 1 -- 172.21.15.46:0/3526342589 shutdown_connections 2023-07-06T02:40:28.451 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:28.439+0000 7fec2b95e700 1 -- 172.21.15.46:0/3526342589 >> 172.21.15.46:0/3526342589 conn(0x7fec2406a3a0 msgr2=0x7fec2406a770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T02:40:28.451 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:28.439+0000 7fec2b95e700 1 -- 172.21.15.46:0/3526342589 shutdown_connections 2023-07-06T02:40:28.451 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:28.439+0000 7fec2b95e700 1 -- 172.21.15.46:0/3526342589 wait complete. 2023-07-06T02:40:28.454 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:28.441+0000 7fec2b95e700 1 Processor -- start 2023-07-06T02:40:28.454 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:28.441+0000 7fec2b95e700 1 -- start start 2023-07-06T02:40:28.454 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:28.441+0000 7fec2b95e700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fec10003f80 0x7fec241f16c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T02:40:28.454 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:28.441+0000 7fec2b95e700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fec24153330 0x7fec24157690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T02:40:28.455 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:28.441+0000 7fec2b95e700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fec24157bd0 0x7fec240b26e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T02:40:28.455 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:28.441+0000 7fec2b95e700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec241537d0 con 0x7fec10003f80 2023-07-06T02:40:28.455 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:28.441+0000 7fec2b95e700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec24153ab0 con 0x7fec24157bd0 2023-07-06T02:40:28.455 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:28.441+0000 7fec2b95e700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fec24153d90 con 0x7fec24153330 2023-07-06T02:40:28.455 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:28.441+0000 7fec296fa700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fec10003f80 0x7fec241f16c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T02:40:28.456 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:28.441+0000 7fec296fa700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fec10003f80 0x7fec241f16c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:46328/0 (socket says 172.21.15.46:46328) 2023-07-06T02:40:28.456 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:28.442+0000 7fec296fa700 1 -- 172.21.15.46:0/1712259165 learned_addr learned my addr 172.21.15.46:0/1712259165 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-07-06T02:40:28.456 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:28.442+0000 7fec28ef9700 1 --2- 172.21.15.46:0/1712259165 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fec24153330 0x7fec24157690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T02:40:28.456 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:28.442+0000 7fec29efb700 1 --2- 172.21.15.46:0/1712259165 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fec24157bd0 0x7fec240b26e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T02:40:28.456 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:28.442+0000 7fec296fa700 1 -- 172.21.15.46:0/1712259165 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fec24153330 msgr2=0x7fec24157690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T02:40:28.457 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:28.442+0000 7fec296fa700 1 --2- 172.21.15.46:0/1712259165 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fec24153330 0x7fec24157690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T02:40:28.457 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:28.442+0000 7fec296fa700 1 -- 172.21.15.46:0/1712259165 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fec24157bd0 msgr2=0x7fec240b26e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T02:40:28.457 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:28.442+0000 7fec296fa700 1 --2- 172.21.15.46:0/1712259165 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fec24157bd0 0x7fec240b26e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T02:40:28.457 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:28.442+0000 7fec296fa700 1 -- 172.21.15.46:0/1712259165 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fec24154070 con 0x7fec10003f80 2023-07-06T02:40:28.457 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:28.442+0000 7fec296fa700 1 --2- 172.21.15.46:0/1712259165 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fec10003f80 0x7fec241f16c0 secure :-1 s=READY pgs=3284 cs=0 l=1 rev1=1 crypto rx=0x7fec140119a0 tx=0x7fec14011cb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T02:40:28.458 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:28.442+0000 7fec19ffb700 1 -- 172.21.15.46:0/1712259165 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec1400f780 con 0x7fec10003f80 2023-07-06T02:40:28.458 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:28.442+0000 7fec19ffb700 1 -- 172.21.15.46:0/1712259165 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fec1400f8e0 con 0x7fec10003f80 2023-07-06T02:40:28.458 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:28.442+0000 7fec2b95e700 1 -- 172.21.15.46:0/1712259165 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fec24154350 con 0x7fec10003f80 2023-07-06T02:40:28.458 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:28.442+0000 7fec19ffb700 1 -- 172.21.15.46:0/1712259165 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec1400fc70 con 0x7fec10003f80 2023-07-06T02:40:28.458 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:28.442+0000 7fec2b95e700 1 -- 172.21.15.46:0/1712259165 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fec240b2e00 con 0x7fec10003f80 2023-07-06T02:40:28.459 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:28.443+0000 7fec2b95e700 1 -- 172.21.15.46:0/1712259165 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fec240cd770 con 0x7fec10003f80 2023-07-06T02:40:28.459 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:28.444+0000 7fec19ffb700 1 -- 172.21.15.46:0/1712259165 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fec14014440 con 0x7fec10003f80 2023-07-06T02:40:28.459 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:28.444+0000 7fec19ffb700 1 --2- 172.21.15.46:0/1712259165 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7fec0806ace0 0x7fec0806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T02:40:28.459 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:28.444+0000 7fec19ffb700 1 -- 172.21.15.46:0/1712259165 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 5296+0+0 (secure 0 0 0) 0x7fec14089720 con 0x7fec10003f80 2023-07-06T02:40:28.459 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:28.444+0000 7fec19ffb700 1 --2- 172.21.15.46:0/1712259165 >> [v2:172.21.15.73:6814/3772673248,v1:172.21.15.73:6816/3772673248] conn(0x7fec08071150 0x7fec08073560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T02:40:28.460 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:28.444+0000 7fec19ffb700 1 -- 172.21.15.46:0/1712259165 --> [v2:172.21.15.73:6814/3772673248,v1:172.21.15.73:6816/3772673248] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fec08073c30 con 0x7fec08071150 2023-07-06T02:40:28.460 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:28.444+0000 7fec19ffb700 1 -- 172.21.15.46:0/1712259165 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_get_version_reply(handle=1 version=40) v2 ==== 24+0+0 (secure 0 0 0) 0x7fec1408bdc0 con 0x7fec10003f80 2023-07-06T02:40:28.460 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:28.444+0000 7fec28ef9700 1 --2- 172.21.15.46:0/1712259165 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7fec0806ace0 0x7fec0806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T02:40:28.460 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:28.445+0000 7fec29efb700 1 --2- 172.21.15.46:0/1712259165 >> [v2:172.21.15.73:6814/3772673248,v1:172.21.15.73:6816/3772673248] conn(0x7fec08071150 0x7fec08073560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T02:40:28.460 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:28.445+0000 7fec28ef9700 1 --2- 172.21.15.46:0/1712259165 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7fec0806ace0 0x7fec0806d190 secure :-1 s=READY pgs=751 cs=0 l=1 rev1=1 crypto rx=0x7fec20001930 tx=0x7fec2000a000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T02:40:28.461 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:28.445+0000 7fec29efb700 1 --2- 172.21.15.46:0/1712259165 >> [v2:172.21.15.73:6814/3772673248,v1:172.21.15.73:6816/3772673248] conn(0x7fec08071150 0x7fec08073560 crc :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T02:40:28.461 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:28.446+0000 7fec19ffb700 1 -- 172.21.15.46:0/1712259165 <== osd.7 v2:172.21.15.73:6814/3772673248 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7fec08073c30 con 0x7fec08071150 2023-07-06T02:40:28.463 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:28.461+0000 7fec2b95e700 1 -- 172.21.15.46:0/1712259165 --> [v2:172.21.15.73:6814/3772673248,v1:172.21.15.73:6816/3772673248] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7fec241546c0 con 0x7fec08071150 2023-07-06T02:40:28.464 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:28.461+0000 7fec19ffb700 1 -- 172.21.15.46:0/1712259165 <== osd.7 v2:172.21.15.73:6814/3772673248 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7fec241546c0 con 0x7fec08071150 2023-07-06T02:40:28.465 INFO:teuthology.orchestra.run.smithi046.stdout:{ 2023-07-06T02:40:28.465 INFO:teuthology.orchestra.run.smithi046.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-07-06T02:40:28.465 INFO:teuthology.orchestra.run.smithi046.stdout:} 2023-07-06T02:40:28.466 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:28.462+0000 7fec2b95e700 1 -- 172.21.15.46:0/1712259165 >> [v2:172.21.15.73:6814/3772673248,v1:172.21.15.73:6816/3772673248] conn(0x7fec08071150 msgr2=0x7fec08073560 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T02:40:28.466 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:28.462+0000 7fec2b95e700 1 --2- 172.21.15.46:0/1712259165 >> [v2:172.21.15.73:6814/3772673248,v1:172.21.15.73:6816/3772673248] conn(0x7fec08071150 0x7fec08073560 crc :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T02:40:28.466 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:28.462+0000 7fec2b95e700 1 -- 172.21.15.46:0/1712259165 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7fec0806ace0 msgr2=0x7fec0806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T02:40:28.467 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:28.462+0000 7fec2b95e700 1 --2- 172.21.15.46:0/1712259165 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7fec0806ace0 0x7fec0806d190 secure :-1 s=READY pgs=751 cs=0 l=1 rev1=1 crypto rx=0x7fec20001930 tx=0x7fec2000a000 comp rx=0 tx=0).stop 2023-07-06T02:40:28.467 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:28.462+0000 7fec2b95e700 1 -- 172.21.15.46:0/1712259165 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fec10003f80 msgr2=0x7fec241f16c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T02:40:28.467 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:28.462+0000 7fec2b95e700 1 --2- 172.21.15.46:0/1712259165 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fec10003f80 0x7fec241f16c0 secure :-1 s=READY pgs=3284 cs=0 l=1 rev1=1 crypto rx=0x7fec140119a0 tx=0x7fec14011cb0 comp rx=0 tx=0).stop 2023-07-06T02:40:28.467 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:28.462+0000 7fec29efb700 1 -- 172.21.15.46:0/1712259165 reap_dead start 2023-07-06T02:40:28.467 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:28.462+0000 7fec2b95e700 1 -- 172.21.15.46:0/1712259165 shutdown_connections 2023-07-06T02:40:28.468 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:28.462+0000 7fec2b95e700 1 -- 172.21.15.46:0/1712259165 >> 172.21.15.46:0/1712259165 conn(0x7fec2406a3a0 msgr2=0x7fec2415ad40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T02:40:28.468 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:28.462+0000 7fec2b95e700 1 -- 172.21.15.46:0/1712259165 shutdown_connections 2023-07-06T02:40:28.468 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:28.462+0000 7fec2b95e700 1 -- 172.21.15.46:0/1712259165 wait complete. 2023-07-06T02:40:28.478 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 7 2023-07-06T02:40:28.619 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:28.616+0000 7fd47a4be700 1 Processor -- start 2023-07-06T02:40:28.619 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:28.616+0000 7fd47a4be700 1 -- start start 2023-07-06T02:40:28.621 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:28.616+0000 7fd47a4be700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fd47415c6a0 0x7fd4740cd310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T02:40:28.622 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:28.616+0000 7fd47a4be700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fd474160b10 0x7fd4740b47d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T02:40:28.622 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:28.616+0000 7fd47a4be700 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd4740b5130 con 0x7fd4740b4d10 2023-07-06T02:40:28.622 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:28.616+0000 7fd47a4be700 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd4740d1a30 con 0x7fd47415c6a0 2023-07-06T02:40:28.623 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:28.616+0000 7fd47a4be700 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd474160fb0 con 0x7fd474160b10 2023-07-06T02:40:28.623 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:28.617+0000 7fd473fff700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fd47415c6a0 0x7fd4740cd310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T02:40:28.623 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:28.617+0000 7fd478a5b700 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7fd4740b4d10 0x7fd47406be00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:45612/0 (socket says 172.21.15.46:45612) 2023-07-06T02:40:28.623 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:28.617+0000 7fd478a5b700 1 -- 172.21.15.46:0/1004301764 learned_addr learned my addr 172.21.15.46:0/1004301764 (peer_addr_for_me v1:172.21.15.46:0/0) 2023-07-06T02:40:28.623 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:28.617+0000 7fd4737fe700 1 --2- 172.21.15.46:0/1004301764 >> v2:172.21.15.73:3300/0 conn(0x7fd474160b10 0x7fd4740b47d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T02:40:28.624 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:28.617+0000 7fd472ffd700 1 -- 172.21.15.46:0/1004301764 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3549250069 0 0) 0x7fd4740b5130 con 0x7fd4740b4d10 2023-07-06T02:40:28.624 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:28.617+0000 7fd472ffd700 1 -- 172.21.15.46:0/1004301764 --> v1:172.21.15.46:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd45c0035b0 con 0x7fd4740b4d10 2023-07-06T02:40:28.624 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:28.617+0000 7fd473fff700 1 -- 172.21.15.46:0/1004301764 >> v2:172.21.15.73:3300/0 conn(0x7fd474160b10 msgr2=0x7fd4740b47d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T02:40:28.625 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:28.617+0000 7fd473fff700 1 --2- 172.21.15.46:0/1004301764 >> v2:172.21.15.73:3300/0 conn(0x7fd474160b10 0x7fd4740b47d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T02:40:28.625 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:28.617+0000 7fd473fff700 1 -- 172.21.15.46:0/1004301764 >> v1:172.21.15.46:6789/0 conn(0x7fd4740b4d10 legacy=0x7fd47406be00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T02:40:28.625 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:28.617+0000 7fd473fff700 1 -- 172.21.15.46:0/1004301764 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd4740cd9f0 con 0x7fd47415c6a0 2023-07-06T02:40:28.625 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:28.617+0000 7fd473fff700 1 --2- 172.21.15.46:0/1004301764 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd47415c6a0 0x7fd4740cd310 secure :-1 s=READY pgs=3286 cs=0 l=1 rev1=1 crypto rx=0x7fd47406a250 tx=0x7fd464009b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=394ff5dc7beda553 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T02:40:28.625 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:28.617+0000 7fd472ffd700 1 -- 172.21.15.46:0/1004301764 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd464011830 con 0x7fd47415c6a0 2023-07-06T02:40:28.626 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:28.617+0000 7fd472ffd700 1 -- 172.21.15.46:0/1004301764 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd464011990 con 0x7fd47415c6a0 2023-07-06T02:40:28.626 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:28.617+0000 7fd472ffd700 1 -- 172.21.15.46:0/1004301764 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd464011d20 con 0x7fd47415c6a0 2023-07-06T02:40:28.626 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:28.618+0000 7fd47a4be700 1 -- 172.21.15.46:0/1004301764 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd47415c6a0 msgr2=0x7fd4740cd310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T02:40:28.626 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:28.618+0000 7fd47a4be700 1 --2- 172.21.15.46:0/1004301764 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd47415c6a0 0x7fd4740cd310 secure :-1 s=READY pgs=3286 cs=0 l=1 rev1=1 crypto rx=0x7fd47406a250 tx=0x7fd464009b20 comp rx=0 tx=0).stop 2023-07-06T02:40:28.626 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:28.618+0000 7fd47a4be700 1 -- 172.21.15.46:0/1004301764 shutdown_connections 2023-07-06T02:40:28.626 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:28.618+0000 7fd47a4be700 1 --2- 172.21.15.46:0/1004301764 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd47415c6a0 0x7fd4740cd310 unknown :-1 s=CLOSED pgs=3286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T02:40:28.627 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:28.618+0000 7fd47a4be700 1 --2- 172.21.15.46:0/1004301764 >> v2:172.21.15.73:3300/0 conn(0x7fd474160b10 0x7fd4740b47d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T02:40:28.627 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:28.618+0000 7fd47a4be700 1 -- 172.21.15.46:0/1004301764 >> 172.21.15.46:0/1004301764 conn(0x7fd4740d39e0 msgr2=0x7fd4740cf7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T02:40:28.627 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:28.618+0000 7fd47a4be700 1 -- 172.21.15.46:0/1004301764 shutdown_connections 2023-07-06T02:40:28.627 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:28.618+0000 7fd47a4be700 1 -- 172.21.15.46:0/1004301764 wait complete. 2023-07-06T02:40:28.629 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:28.620+0000 7fd47a4be700 1 Processor -- start 2023-07-06T02:40:28.630 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:28.620+0000 7fd47a4be700 1 -- start start 2023-07-06T02:40:28.630 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:28.620+0000 7fd47a4be700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd4740b4d10 0x7fd47414ce40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T02:40:28.630 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:28.620+0000 7fd47a4be700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fd47415c6a0 0x7fd4740cc420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T02:40:28.630 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:28.621+0000 7fd47a4be700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd474160b10 0x7fd47414f180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T02:40:28.631 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:28.621+0000 7fd47a4be700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd47414d380 con 0x7fd4740b4d10 2023-07-06T02:40:28.631 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:28.621+0000 7fd47a4be700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd47414e0e0 con 0x7fd474160b10 2023-07-06T02:40:28.631 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:28.621+0000 7fd47a4be700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd47414e3c0 con 0x7fd47415c6a0 2023-07-06T02:40:28.631 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:28.621+0000 7fd473fff700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd4740b4d10 0x7fd47414ce40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T02:40:28.631 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:28.621+0000 7fd473fff700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd4740b4d10 0x7fd47414ce40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:46342/0 (socket says 172.21.15.46:46342) 2023-07-06T02:40:28.632 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:28.621+0000 7fd473fff700 1 -- 172.21.15.46:0/3653823725 learned_addr learned my addr 172.21.15.46:0/3653823725 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-07-06T02:40:28.632 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:28.621+0000 7fd478a5b700 1 --2- 172.21.15.46:0/3653823725 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd474160b10 0x7fd47414f180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T02:40:28.632 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:28.621+0000 7fd4737fe700 1 --2- 172.21.15.46:0/3653823725 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fd47415c6a0 0x7fd4740cc420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T02:40:28.632 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:28.621+0000 7fd473fff700 1 -- 172.21.15.46:0/3653823725 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fd47415c6a0 msgr2=0x7fd4740cc420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T02:40:28.633 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:28.621+0000 7fd473fff700 1 --2- 172.21.15.46:0/3653823725 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fd47415c6a0 0x7fd4740cc420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T02:40:28.633 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:28.621+0000 7fd473fff700 1 -- 172.21.15.46:0/3653823725 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd474160b10 msgr2=0x7fd47414f180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T02:40:28.633 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:28.621+0000 7fd473fff700 1 --2- 172.21.15.46:0/3653823725 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd474160b10 0x7fd47414f180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T02:40:28.633 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:28.621+0000 7fd473fff700 1 -- 172.21.15.46:0/3653823725 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd4640094a0 con 0x7fd4740b4d10 2023-07-06T02:40:28.633 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:28.621+0000 7fd4737fe700 1 --2- 172.21.15.46:0/3653823725 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fd47415c6a0 0x7fd4740cc420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-06T02:40:28.634 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:28.621+0000 7fd473fff700 1 --2- 172.21.15.46:0/3653823725 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd4740b4d10 0x7fd47414ce40 secure :-1 s=READY pgs=3287 cs=0 l=1 rev1=1 crypto rx=0x7fd464000c00 tx=0x7fd464004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T02:40:28.634 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:28.621+0000 7fd470ff9700 1 -- 172.21.15.46:0/3653823725 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd464004590 con 0x7fd4740b4d10 2023-07-06T02:40:28.634 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:28.621+0000 7fd470ff9700 1 -- 172.21.15.46:0/3653823725 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd46401e070 con 0x7fd4740b4d10 2023-07-06T02:40:28.634 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:28.621+0000 7fd47a4be700 1 -- 172.21.15.46:0/3653823725 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd47414e6a0 con 0x7fd4740b4d10 2023-07-06T02:40:28.634 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:28.622+0000 7fd470ff9700 1 -- 172.21.15.46:0/3653823725 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4640038e0 con 0x7fd4740b4d10 2023-07-06T02:40:28.635 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:28.622+0000 7fd47a4be700 1 -- 172.21.15.46:0/3653823725 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd47414ec60 con 0x7fd4740b4d10 2023-07-06T02:40:28.635 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:28.623+0000 7fd47a4be700 1 -- 172.21.15.46:0/3653823725 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd47414ee50 con 0x7fd4740b4d10 2023-07-06T02:40:28.635 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:28.623+0000 7fd470ff9700 1 -- 172.21.15.46:0/3653823725 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fd464003a40 con 0x7fd4740b4d10 2023-07-06T02:40:28.635 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:28.624+0000 7fd470ff9700 1 --2- 172.21.15.46:0/3653823725 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7fd46006ace0 0x7fd46006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T02:40:28.636 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:28.624+0000 7fd470ff9700 1 -- 172.21.15.46:0/3653823725 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 5296+0+0 (secure 0 0 0) 0x7fd464089e80 con 0x7fd4740b4d10 2023-07-06T02:40:28.636 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:28.624+0000 7fd4737fe700 1 --2- 172.21.15.46:0/3653823725 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7fd46006ace0 0x7fd46006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T02:40:28.636 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:28.625+0000 7fd4737fe700 1 --2- 172.21.15.46:0/3653823725 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7fd46006ace0 0x7fd46006d190 secure :-1 s=READY pgs=752 cs=0 l=1 rev1=1 crypto rx=0x7fd468009ac0 tx=0x7fd468008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T02:40:28.637 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:28.628+0000 7fd470ff9700 1 -- 172.21.15.46:0/3653823725 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fd4640552c0 con 0x7fd4740b4d10 2023-07-06T02:40:28.842 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:28.839+0000 7fd47a4be700 1 -- 172.21.15.46:0/3653823725 --> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "7", "target": ["mon-mgr", ""]}) v1 -- 0x7fd47415d140 con 0x7fd46006ace0 2023-07-06T02:40:28.843 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:28.840+0000 7fd470ff9700 1 -- 172.21.15.46:0/3653823725 <== mgr.4099 v2:172.21.15.73:6832/3033361733 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 7 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7fd468004020 con 0x7fd46006ace0 2023-07-06T02:40:28.845 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:28.842+0000 7fd47a4be700 1 -- 172.21.15.46:0/3653823725 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7fd46006ace0 msgr2=0x7fd46006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T02:40:28.845 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:28.842+0000 7fd47a4be700 1 --2- 172.21.15.46:0/3653823725 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7fd46006ace0 0x7fd46006d190 secure :-1 s=READY pgs=752 cs=0 l=1 rev1=1 crypto rx=0x7fd468009ac0 tx=0x7fd468008040 comp rx=0 tx=0).stop 2023-07-06T02:40:28.846 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:28.842+0000 7fd47a4be700 1 -- 172.21.15.46:0/3653823725 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd4740b4d10 msgr2=0x7fd47414ce40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T02:40:28.846 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:28.842+0000 7fd47a4be700 1 --2- 172.21.15.46:0/3653823725 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd4740b4d10 0x7fd47414ce40 secure :-1 s=READY pgs=3287 cs=0 l=1 rev1=1 crypto rx=0x7fd464000c00 tx=0x7fd464004750 comp rx=0 tx=0).stop 2023-07-06T02:40:28.846 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:28.842+0000 7fd47a4be700 1 -- 172.21.15.46:0/3653823725 shutdown_connections 2023-07-06T02:40:28.846 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:28.842+0000 7fd47a4be700 1 --2- 172.21.15.46:0/3653823725 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7fd46006ace0 0x7fd46006d190 unknown :-1 s=CLOSED pgs=752 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T02:40:28.847 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:28.842+0000 7fd47a4be700 1 --2- 172.21.15.46:0/3653823725 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd474160b10 0x7fd47414f180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T02:40:28.847 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:28.842+0000 7fd47a4be700 1 --2- 172.21.15.46:0/3653823725 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd4740b4d10 0x7fd47414ce40 unknown :-1 s=CLOSED pgs=3287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T02:40:28.847 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:28.842+0000 7fd47a4be700 1 --2- 172.21.15.46:0/3653823725 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fd47415c6a0 0x7fd4740cc420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T02:40:28.847 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:28.842+0000 7fd47a4be700 1 -- 172.21.15.46:0/3653823725 >> 172.21.15.46:0/3653823725 conn(0x7fd4740d39e0 msgr2=0x7fd47406be00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T02:40:28.847 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:28.842+0000 7fd47a4be700 1 -- 172.21.15.46:0/3653823725 shutdown_connections 2023-07-06T02:40:28.848 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:28.842+0000 7fd47a4be700 1 -- 172.21.15.46:0/3653823725 wait complete. 2023-07-06T02:40:28.848 INFO:teuthology.orchestra.run.smithi046.stderr:instructed osd(s) 7 to deep-scrub 2023-07-06T02:40:28.859 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-07-06T02:40:28.996 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:28.993+0000 7f85b65b2700 1 Processor -- start 2023-07-06T02:40:28.997 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:28.993+0000 7f85b65b2700 1 -- start start 2023-07-06T02:40:28.998 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:28.994+0000 7f85b65b2700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f85b015c2f0 0x7f85b00cd2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T02:40:28.999 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:28.994+0000 7f85b65b2700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f85b00b5ae0 0x7f85b00b5f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T02:40:28.999 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:28.994+0000 7f85b65b2700 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f85b00cd8c0 con 0x7f85b015c6c0 2023-07-06T02:40:28.999 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:28.994+0000 7f85b65b2700 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f85b00d0990 con 0x7f85b015c2f0 2023-07-06T02:40:28.999 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:28.994+0000 7f85b65b2700 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f85b00d0c70 con 0x7f85b00b5ae0 2023-07-06T02:40:29.000 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:28.994+0000 7f85affff700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f85b015c2f0 0x7f85b00cd2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T02:40:29.000 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:28.994+0000 7f85affff700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f85b015c2f0 0x7f85b00cd2e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:46350/0 (socket says 172.21.15.46:46350) 2023-07-06T02:40:29.000 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:28.994+0000 7f85affff700 1 -- 172.21.15.46:0/3596181444 learned_addr learned my addr 172.21.15.46:0/3596181444 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-07-06T02:40:29.000 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:28.994+0000 7f85b4b4f700 1 --2- 172.21.15.46:0/3596181444 >> v2:172.21.15.73:3300/0 conn(0x7f85b00b5ae0 0x7f85b00b5f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T02:40:29.000 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:28.995+0000 7f85affff700 1 -- 172.21.15.46:0/3596181444 >> v2:172.21.15.73:3300/0 conn(0x7f85b00b5ae0 msgr2=0x7f85b00b5f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T02:40:29.001 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:28.995+0000 7f85affff700 1 --2- 172.21.15.46:0/3596181444 >> v2:172.21.15.73:3300/0 conn(0x7f85b00b5ae0 0x7f85b00b5f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T02:40:29.001 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:28.995+0000 7f85affff700 1 -- 172.21.15.46:0/3596181444 >> v1:172.21.15.73:6789/0 conn(0x7f85b015c6c0 legacy=0x7f85b006c760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T02:40:29.001 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:28.995+0000 7f85affff700 1 -- 172.21.15.46:0/3596181444 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f85b00d0f50 con 0x7f85b015c2f0 2023-07-06T02:40:29.001 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:28.995+0000 7f85affff700 1 --2- 172.21.15.46:0/3596181444 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f85b015c2f0 0x7f85b00cd2e0 secure :-1 s=READY pgs=3288 cs=0 l=1 rev1=1 crypto rx=0x7f85b00d3ca0 tx=0x7f85a0009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d8b3bd241dc1c8d3 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T02:40:29.001 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:28.995+0000 7f85aeffd700 1 -- 172.21.15.46:0/3596181444 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85a0011830 con 0x7f85b015c2f0 2023-07-06T02:40:29.001 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:28.995+0000 7f85aeffd700 1 -- 172.21.15.46:0/3596181444 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f85a0011990 con 0x7f85b015c2f0 2023-07-06T02:40:29.002 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:28.995+0000 7f85aeffd700 1 -- 172.21.15.46:0/3596181444 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85a0011d20 con 0x7f85b015c2f0 2023-07-06T02:40:29.002 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:28.996+0000 7f85b65b2700 1 -- 172.21.15.46:0/3596181444 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f85b015c2f0 msgr2=0x7f85b00cd2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T02:40:29.002 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:28.996+0000 7f85b65b2700 1 --2- 172.21.15.46:0/3596181444 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f85b015c2f0 0x7f85b00cd2e0 secure :-1 s=READY pgs=3288 cs=0 l=1 rev1=1 crypto rx=0x7f85b00d3ca0 tx=0x7f85a0009bd0 comp rx=0 tx=0).stop 2023-07-06T02:40:29.002 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:28.996+0000 7f85b65b2700 1 -- 172.21.15.46:0/3596181444 shutdown_connections 2023-07-06T02:40:29.002 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:28.996+0000 7f85b65b2700 1 --2- 172.21.15.46:0/3596181444 >> v2:172.21.15.73:3300/0 conn(0x7f85b00b5ae0 0x7f85b00b5f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T02:40:29.003 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:28.996+0000 7f85b65b2700 1 --2- 172.21.15.46:0/3596181444 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f85b015c2f0 0x7f85b00cd2e0 unknown :-1 s=CLOSED pgs=3288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T02:40:29.003 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:28.996+0000 7f85b65b2700 1 -- 172.21.15.46:0/3596181444 >> 172.21.15.46:0/3596181444 conn(0x7f85b006afa0 msgr2=0x7f85b00cf710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T02:40:29.003 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:28.996+0000 7f85b65b2700 1 -- 172.21.15.46:0/3596181444 shutdown_connections 2023-07-06T02:40:29.003 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:28.996+0000 7f85b65b2700 1 -- 172.21.15.46:0/3596181444 wait complete. 2023-07-06T02:40:29.005 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:28.997+0000 7f85b65b2700 1 Processor -- start 2023-07-06T02:40:29.006 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:28.997+0000 7f85b65b2700 1 -- start start 2023-07-06T02:40:29.006 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:28.998+0000 7f85b65b2700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f85b00b5ae0 0x7f85b014a030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T02:40:29.006 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:28.998+0000 7f85b65b2700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f85b015c2f0 0x7f85b00a9660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T02:40:29.006 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:28.998+0000 7f85b65b2700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f85b015c6c0 0x7f85b00a9ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T02:40:29.006 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:28.998+0000 7f85b65b2700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85b00c8960 con 0x7f85b00b5ae0 2023-07-06T02:40:29.007 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:28.998+0000 7f85b65b2700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85b00c8bd0 con 0x7f85b015c2f0 2023-07-06T02:40:29.007 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:28.998+0000 7f85b65b2700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f85b00c8eb0 con 0x7f85b015c6c0 2023-07-06T02:40:29.007 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:28.998+0000 7f85affff700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f85b00b5ae0 0x7f85b014a030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T02:40:29.007 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:28.998+0000 7f85affff700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f85b00b5ae0 0x7f85b014a030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:46356/0 (socket says 172.21.15.46:46356) 2023-07-06T02:40:29.007 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:28.998+0000 7f85affff700 1 -- 172.21.15.46:0/855995314 learned_addr learned my addr 172.21.15.46:0/855995314 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-07-06T02:40:29.008 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:28.998+0000 7f85af7fe700 1 --2- 172.21.15.46:0/855995314 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f85b015c2f0 0x7f85b00a9660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T02:40:29.008 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:28.998+0000 7f85b4b4f700 1 --2- 172.21.15.46:0/855995314 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f85b015c6c0 0x7f85b00a9ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T02:40:29.008 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:28.998+0000 7f85affff700 1 -- 172.21.15.46:0/855995314 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f85b015c6c0 msgr2=0x7f85b00a9ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T02:40:29.008 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:28.998+0000 7f85affff700 1 --2- 172.21.15.46:0/855995314 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f85b015c6c0 0x7f85b00a9ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T02:40:29.008 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:28.998+0000 7f85affff700 1 -- 172.21.15.46:0/855995314 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f85b015c2f0 msgr2=0x7f85b00a9660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T02:40:29.009 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:28.998+0000 7f85affff700 1 --2- 172.21.15.46:0/855995314 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f85b015c2f0 0x7f85b00a9660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T02:40:29.009 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:28.998+0000 7f85affff700 1 -- 172.21.15.46:0/855995314 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f85a0009550 con 0x7f85b00b5ae0 2023-07-06T02:40:29.009 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:28.998+0000 7f85affff700 1 --2- 172.21.15.46:0/855995314 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f85b00b5ae0 0x7f85b014a030 secure :-1 s=READY pgs=3289 cs=0 l=1 rev1=1 crypto rx=0x7f85a0000c00 tx=0x7f85a0004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T02:40:29.009 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:28.999+0000 7f85acff9700 1 -- 172.21.15.46:0/855995314 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85a0004380 con 0x7f85b00b5ae0 2023-07-06T02:40:29.009 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:28.999+0000 7f85acff9700 1 -- 172.21.15.46:0/855995314 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f85a001f070 con 0x7f85b00b5ae0 2023-07-06T02:40:29.010 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:28.999+0000 7f85b65b2700 1 -- 172.21.15.46:0/855995314 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f85b00c9190 con 0x7f85b00b5ae0 2023-07-06T02:40:29.010 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:28.999+0000 7f85acff9700 1 -- 172.21.15.46:0/855995314 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85a00036a0 con 0x7f85b00b5ae0 2023-07-06T02:40:29.010 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:28.999+0000 7f85b65b2700 1 -- 172.21.15.46:0/855995314 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f85b014a570 con 0x7f85b00b5ae0 2023-07-06T02:40:29.010 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:29.000+0000 7f85b65b2700 1 -- 172.21.15.46:0/855995314 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f85b00c9650 con 0x7f85b00b5ae0 2023-07-06T02:40:29.010 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:29.000+0000 7f85acff9700 1 -- 172.21.15.46:0/855995314 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f85a0021030 con 0x7f85b00b5ae0 2023-07-06T02:40:29.011 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:29.000+0000 7f85acff9700 1 --2- 172.21.15.46:0/855995314 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7f859006ace0 0x7f859006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T02:40:29.011 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:29.001+0000 7f85acff9700 1 -- 172.21.15.46:0/855995314 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 5296+0+0 (secure 0 0 0) 0x7f85a008a510 con 0x7f85b00b5ae0 2023-07-06T02:40:29.011 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:29.001+0000 7f85af7fe700 1 --2- 172.21.15.46:0/855995314 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7f859006ace0 0x7f859006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T02:40:29.011 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:29.001+0000 7f85af7fe700 1 --2- 172.21.15.46:0/855995314 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7f859006ace0 0x7f859006d190 secure :-1 s=READY pgs=753 cs=0 l=1 rev1=1 crypto rx=0x7f85b00d2be0 tx=0x7f8598009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T02:40:29.012 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:29.005+0000 7f85acff9700 1 -- 172.21.15.46:0/855995314 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f85a00558d0 con 0x7f85b00b5ae0 2023-07-06T02:40:29.217 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:29.214+0000 7f85b65b2700 1 -- 172.21.15.46:0/855995314 --> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f85b00cdba0 con 0x7f859006ace0 2023-07-06T02:40:29.220 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:29.217+0000 7f85acff9700 1 -- 172.21.15.46:0/855995314 <== mgr.4099 v2:172.21.15.73:6832/3033361733 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+71502 (secure 0 0 0) 0x7f8598001cc0 con 0x7f859006ace0 2023-07-06T02:40:29.221 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-06T02:40:29.223 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:29.220+0000 7f85b65b2700 1 -- 172.21.15.46:0/855995314 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7f859006ace0 msgr2=0x7f859006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T02:40:29.223 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:29.220+0000 7f85b65b2700 1 --2- 172.21.15.46:0/855995314 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7f859006ace0 0x7f859006d190 secure :-1 s=READY pgs=753 cs=0 l=1 rev1=1 crypto rx=0x7f85b00d2be0 tx=0x7f8598009040 comp rx=0 tx=0).stop 2023-07-06T02:40:29.223 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:29.220+0000 7f85b65b2700 1 -- 172.21.15.46:0/855995314 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f85b00b5ae0 msgr2=0x7f85b014a030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T02:40:29.224 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:29.220+0000 7f85b65b2700 1 --2- 172.21.15.46:0/855995314 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f85b00b5ae0 0x7f85b014a030 secure :-1 s=READY pgs=3289 cs=0 l=1 rev1=1 crypto rx=0x7f85a0000c00 tx=0x7f85a0004750 comp rx=0 tx=0).stop 2023-07-06T02:40:29.224 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:29.220+0000 7f85b65b2700 1 -- 172.21.15.46:0/855995314 shutdown_connections 2023-07-06T02:40:29.224 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:29.220+0000 7f85b65b2700 1 --2- 172.21.15.46:0/855995314 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7f859006ace0 0x7f859006d190 unknown :-1 s=CLOSED pgs=753 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T02:40:29.224 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:29.220+0000 7f85b65b2700 1 --2- 172.21.15.46:0/855995314 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f85b015c6c0 0x7f85b00a9ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T02:40:29.224 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:29.220+0000 7f85b65b2700 1 --2- 172.21.15.46:0/855995314 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f85b00b5ae0 0x7f85b014a030 unknown :-1 s=CLOSED pgs=3289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T02:40:29.225 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:29.220+0000 7f85b65b2700 1 --2- 172.21.15.46:0/855995314 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f85b015c2f0 0x7f85b00a9660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T02:40:29.225 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:29.220+0000 7f85b65b2700 1 -- 172.21.15.46:0/855995314 >> 172.21.15.46:0/855995314 conn(0x7f85b006afa0 msgr2=0x7f85b015ffa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T02:40:29.225 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:29.220+0000 7f85b65b2700 1 -- 172.21.15.46:0/855995314 shutdown_connections 2023-07-06T02:40:29.225 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:29.220+0000 7f85b65b2700 1 -- 172.21.15.46:0/855995314 wait complete. 2023-07-06T02:40:29.226 INFO:teuthology.orchestra.run.smithi046.stderr:dumped all 2023-07-06T02:40:29.237 INFO:teuthology.orchestra.run.smithi046.stdout:{"pg_ready":true,"pg_map":{"version":13957,"stamp":"2023-07-06T02:40:28.070127+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":146,"num_read_kb":127,"num_write":209,"num_write_kb":3462,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":161,"ondisk_log_size":161,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":37,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":11831236,"kb_used_data":4804,"kb_used_omap":135724,"kb_used_meta":11690643,"kb_avail":743143484,"statfs":{"total":773094113280,"available":760978927616,"internally_reserved":0,"allocated":4919296,"data_stored":2750791,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":138982351,"internal_metadata":11971218481},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":475,"apply_latency_ms":475,"commit_latency_ns":475000000,"apply_latency_ns":475000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"10.598202"},"pg_stats":[{"pgid":"1.5","version":"0'0","reported_seq":274,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-07-06T02:40:17.475260+0000","last_change":"2023-07-05T18:56:09.622184+0000","last_active":"2023-07-06T02:40:17.475260+0000","last_peered":"2023-07-06T02:40:17.475260+0000","last_clean":"2023-07-06T02:40:17.475260+0000","last_became_active":"2023-07-05T18:56:09.621796+0000","last_became_peered":"2023-07-05T18:56:09.621796+0000","last_unstale":"2023-07-06T02:40:17.475260+0000","last_undegraded":"2023-07-06T02:40:17.475260+0000","last_fullsized":"2023-07-06T02:40:17.475260+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T18:56:08.603137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T18:56:08.603137+0000","last_clean_scrub_stamp":"2023-07-05T18:56:08.603137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-06T19:36:39.040166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":278,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-07-06T02:40:17.476927+0000","last_change":"2023-07-05T18:56:09.621596+0000","last_active":"2023-07-06T02:40:17.476927+0000","last_peered":"2023-07-06T02:40:17.476927+0000","last_clean":"2023-07-06T02:40:17.476927+0000","last_became_active":"2023-07-05T18:56:09.621315+0000","last_became_peered":"2023-07-05T18:56:09.621315+0000","last_unstale":"2023-07-06T02:40:17.476927+0000","last_undegraded":"2023-07-06T02:40:17.476927+0000","last_fullsized":"2023-07-06T02:40:17.476927+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T18:56:08.603137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T18:56:08.603137+0000","last_clean_scrub_stamp":"2023-07-05T18:56:08.603137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-06T21:41:31.701702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":273,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-07-06T02:40:17.497921+0000","last_change":"2023-07-05T18:56:09.617992+0000","last_active":"2023-07-06T02:40:17.497921+0000","last_peered":"2023-07-06T02:40:17.497921+0000","last_clean":"2023-07-06T02:40:17.497921+0000","last_became_active":"2023-07-05T18:56:09.617720+0000","last_became_peered":"2023-07-05T18:56:09.617720+0000","last_unstale":"2023-07-06T02:40:17.497921+0000","last_undegraded":"2023-07-06T02:40:17.497921+0000","last_fullsized":"2023-07-06T02:40:17.497921+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T18:56:08.603137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T18:56:08.603137+0000","last_clean_scrub_stamp":"2023-07-05T18:56:08.603137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-06T20:37:16.107143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"37'161","reported_seq":484,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-07-06T02:40:18.420953+0000","last_change":"2023-07-05T18:56:09.621746+0000","last_active":"2023-07-06T02:40:18.420953+0000","last_peered":"2023-07-06T02:40:18.420953+0000","last_clean":"2023-07-06T02:40:18.420953+0000","last_became_active":"2023-07-05T18:56:09.621421+0000","last_became_peered":"2023-07-05T18:56:09.621421+0000","last_unstale":"2023-07-06T02:40:18.420953+0000","last_undegraded":"2023-07-06T02:40:18.420953+0000","last_fullsized":"2023-07-06T02:40:18.420953+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T18:56:08.603137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T18:56:08.603137+0000","last_clean_scrub_stamp":"2023-07-05T18:56:08.603137+0000","objects_scrubbed":0,"log_size":161,"log_dups_size":0,"ondisk_log_size":161,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-06T22:19:16.877769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":146,"num_read_kb":127,"num_write":209,"num_write_kb":3462,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":273,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-07-06T02:40:18.421439+0000","last_change":"2023-07-05T18:56:10.073940+0000","last_active":"2023-07-06T02:40:18.421439+0000","last_peered":"2023-07-06T02:40:18.421439+0000","last_clean":"2023-07-06T02:40:18.421439+0000","last_became_active":"2023-07-05T18:56:10.073617+0000","last_became_peered":"2023-07-05T18:56:10.073617+0000","last_unstale":"2023-07-06T02:40:18.421439+0000","last_undegraded":"2023-07-06T02:40:18.421439+0000","last_fullsized":"2023-07-06T02:40:18.421439+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T18:56:08.603137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T18:56:08.603137+0000","last_clean_scrub_stamp":"2023-07-05T18:56:08.603137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-06T22:12:49.944261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":281,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-07-06T02:40:18.420814+0000","last_change":"2023-07-05T18:56:10.073658+0000","last_active":"2023-07-06T02:40:18.420814+0000","last_peered":"2023-07-06T02:40:18.420814+0000","last_clean":"2023-07-06T02:40:18.420814+0000","last_became_active":"2023-07-05T18:56:10.073336+0000","last_became_peered":"2023-07-05T18:56:10.073336+0000","last_unstale":"2023-07-06T02:40:18.420814+0000","last_undegraded":"2023-07-06T02:40:18.420814+0000","last_fullsized":"2023-07-06T02:40:18.420814+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T18:56:08.603137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T18:56:08.603137+0000","last_clean_scrub_stamp":"2023-07-05T18:56:08.603137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-06T23:56:59.615696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":274,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-07-06T02:40:17.980312+0000","last_change":"2023-07-05T18:56:10.073693+0000","last_active":"2023-07-06T02:40:17.980312+0000","last_peered":"2023-07-06T02:40:17.980312+0000","last_clean":"2023-07-06T02:40:17.980312+0000","last_became_active":"2023-07-05T18:56:10.073356+0000","last_became_peered":"2023-07-05T18:56:10.073356+0000","last_unstale":"2023-07-06T02:40:17.980312+0000","last_undegraded":"2023-07-06T02:40:17.980312+0000","last_fullsized":"2023-07-06T02:40:17.980312+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T18:56:08.603137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T18:56:08.603137+0000","last_clean_scrub_stamp":"2023-07-05T18:56:08.603137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-06T21:29:04.979258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":267,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-07-06T02:40:17.919071+0000","last_change":"2023-07-05T18:56:10.073639+0000","last_active":"2023-07-06T02:40:17.919071+0000","last_peered":"2023-07-06T02:40:17.919071+0000","last_clean":"2023-07-06T02:40:17.919071+0000","last_became_active":"2023-07-05T18:56:10.073339+0000","last_became_peered":"2023-07-05T18:56:10.073339+0000","last_unstale":"2023-07-06T02:40:17.919071+0000","last_undegraded":"2023-07-06T02:40:17.919071+0000","last_fullsized":"2023-07-06T02:40:17.919071+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T18:56:08.603137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T18:56:08.603137+0000","last_clean_scrub_stamp":"2023-07-05T18:56:08.603137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-06T23:08:47.739749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":267,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-07-06T02:40:17.919390+0000","last_change":"2023-07-05T18:56:09.619299+0000","last_active":"2023-07-06T02:40:17.919390+0000","last_peered":"2023-07-06T02:40:17.919390+0000","last_clean":"2023-07-06T02:40:17.919390+0000","last_became_active":"2023-07-05T18:56:09.618958+0000","last_became_peered":"2023-07-05T18:56:09.618958+0000","last_unstale":"2023-07-06T02:40:17.919390+0000","last_undegraded":"2023-07-06T02:40:17.919390+0000","last_fullsized":"2023-07-06T02:40:17.919390+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T18:56:08.603137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T18:56:08.603137+0000","last_clean_scrub_stamp":"2023-07-05T18:56:08.603137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-06T23:58:42.021659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":8},{"poolid":2,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":146,"num_read_kb":127,"num_write":209,"num_write_kb":3462,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":161,"ondisk_log_size":161,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834580412,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1891092,"kb_used_data":1036,"kb_used_omap":14013,"kb_used_meta":1876034,"kb_avail":92480748,"statfs":{"total":96636764160,"available":94700285952,"internally_reserved":0,"allocated":1060864,"data_stored":786745,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":14349832,"internal_metadata":1921059320},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":32,"apply_latency_ms":32,"commit_latency_ns":32000000,"apply_latency_ns":32000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 6 02:40:11 2023","interfaces":[{"interface":"back","average":{"1min":6.3979999999999997,"5min":1.9890000000000001,"15min":1.554},"min":{"1min":0.24199999999999999,"5min":0.24199999999999999,"15min":0.24099999999999999},"max":{"1min":71.978999999999999,"5min":71.978999999999999,"15min":71.978999999999999},"last":0.60799999999999998},{"interface":"front","average":{"1min":4.657,"5min":2.1640000000000001,"15min":1.8440000000000001},"min":{"1min":0.25800000000000001,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":23.382000000000001,"5min":23.382000000000001,"15min":23.382000000000001},"last":0.53600000000000003}]},{"osd":1,"last update":"Thu Jul 6 02:40:11 2023","interfaces":[{"interface":"back","average":{"1min":7.2990000000000004,"5min":2.3500000000000001,"15min":1.829},"min":{"1min":0.27200000000000002,"5min":0.27200000000000002,"15min":0.25},"max":{"1min":71.951999999999998,"5min":71.951999999999998,"15min":71.951999999999998},"last":0.44600000000000001},{"interface":"front","average":{"1min":4.25,"5min":2.3250000000000002,"15min":2.0640000000000001},"min":{"1min":0.26100000000000001,"5min":0.26100000000000001,"15min":0.25900000000000001},"max":{"1min":23.489999999999998,"5min":23.489999999999998,"15min":23.489999999999998},"last":0.64300000000000002}]},{"osd":2,"last update":"Thu Jul 6 02:40:11 2023","interfaces":[{"interface":"back","average":{"1min":4.9379999999999997,"5min":2.2160000000000002,"15min":1.7969999999999999},"min":{"1min":0.33500000000000002,"5min":0.29899999999999999,"15min":0.29299999999999998},"max":{"1min":35.311999999999998,"5min":35.311999999999998,"15min":35.311999999999998},"last":0.42899999999999999},{"interface":"front","average":{"1min":6.2610000000000001,"5min":2.5649999999999999,"15min":2.0960000000000001},"min":{"1min":0.308,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":66.536000000000001,"5min":66.536000000000001,"15min":66.536000000000001},"last":0.69999999999999996}]},{"osd":3,"last update":"Thu Jul 6 02:40:11 2023","interfaces":[{"interface":"back","average":{"1min":3.327,"5min":1.9690000000000001,"15min":1.8129999999999999},"min":{"1min":0.33200000000000002,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":25.637,"5min":25.637,"15min":25.637},"last":0.47499999999999998},{"interface":"front","average":{"1min":5.9050000000000002,"5min":2.617,"15min":2.2370000000000001},"min":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":71.905000000000001,"5min":71.905000000000001,"15min":71.905000000000001},"last":0.65800000000000003}]},{"osd":4,"last update":"Thu Jul 6 02:40:11 2023","interfaces":[{"interface":"back","average":{"1min":7.0339999999999998,"5min":2.3719999999999999,"15min":1.871},"min":{"1min":0.27700000000000002,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":52.734999999999999,"5min":52.734999999999999,"15min":52.734999999999999},"last":0.58199999999999996},{"interface":"front","average":{"1min":2.7069999999999999,"5min":1.359,"15min":1.2829999999999999},"min":{"1min":0.33500000000000002,"5min":0.32000000000000001,"15min":0.311},"max":{"1min":35.372,"5min":35.372,"15min":35.372},"last":0.56799999999999995}]},{"osd":5,"last update":"Thu Jul 6 02:40:11 2023","interfaces":[{"interface":"back","average":{"1min":5.3689999999999998,"5min":2.1030000000000002,"15min":1.788},"min":{"1min":0.29299999999999998,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":73.492999999999995,"5min":73.492999999999995,"15min":73.492999999999995},"last":0.52200000000000002},{"interface":"front","average":{"1min":2.839,"5min":1.847,"15min":1.754},"min":{"1min":0.34799999999999998,"5min":0.33800000000000002,"15min":0.30499999999999999},"max":{"1min":14.983000000000001,"5min":14.983000000000001,"15min":25.689},"last":0.68799999999999994}]},{"osd":6,"last update":"Thu Jul 6 02:40:11 2023","interfaces":[{"interface":"back","average":{"1min":3.9630000000000001,"5min":2.0470000000000002,"15min":1.986},"min":{"1min":0.34200000000000003,"5min":0.309,"15min":0.309},"max":{"1min":21.321000000000002,"5min":21.321000000000002,"15min":21.321000000000002},"last":0.72499999999999998},{"interface":"front","average":{"1min":1.5349999999999999,"5min":1.4219999999999999,"15min":1.3460000000000001},"min":{"1min":0.376,"5min":0.376,"15min":0.373},"max":{"1min":11.273999999999999,"5min":11.273999999999999,"15min":12.099},"last":0.625}]}]},{"osd":6,"up_from":13,"seq":55834580419,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":695632,"kb_used_data":456,"kb_used_omap":14943,"kb_used_meta":680224,"kb_avail":93676208,"statfs":{"total":96636764160,"available":95924436992,"internally_reserved":0,"allocated":466944,"data_stored":196377,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":15302320,"internal_metadata":696549712},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":38,"apply_latency_ms":38,"commit_latency_ns":38000000,"apply_latency_ns":38000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 6 02:39:25 2023","interfaces":[{"interface":"back","average":{"1min":1.333,"5min":1.1419999999999999,"15min":0.999},"min":{"1min":0.29399999999999998,"5min":0.24199999999999999,"15min":0.22900000000000001},"max":{"1min":12.007,"5min":12.007,"15min":12.007},"last":0.621},{"interface":"front","average":{"1min":1.127,"5min":1.4590000000000001,"15min":1.512},"min":{"1min":0.27000000000000002,"5min":0.27000000000000002,"15min":0.26400000000000001},"max":{"1min":4.7229999999999999,"5min":8.2699999999999996,"15min":14.146000000000001},"last":1.224}]},{"osd":1,"last update":"Thu Jul 6 02:39:25 2023","interfaces":[{"interface":"back","average":{"1min":2.5179999999999998,"5min":1.738,"15min":1.796},"min":{"1min":0.25800000000000001,"5min":0.25800000000000001,"15min":0.25600000000000001},"max":{"1min":11.182,"5min":11.182,"15min":15.563000000000001},"last":0.41299999999999998},{"interface":"front","average":{"1min":4.2599999999999998,"5min":2.464,"15min":2.0059999999999998},"min":{"1min":0.307,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":62.668999999999997,"5min":62.668999999999997,"15min":62.668999999999997},"last":1.1759999999999999}]},{"osd":2,"last update":"Thu Jul 6 02:39:25 2023","interfaces":[{"interface":"back","average":{"1min":1.288,"5min":1.341,"15min":1.4259999999999999},"min":{"1min":0.33200000000000002,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":6.7249999999999996,"5min":6.7249999999999996,"15min":6.7249999999999996},"last":1.1240000000000001},{"interface":"front","average":{"1min":3.8999999999999999,"5min":2.298,"15min":2.3260000000000001},"min":{"1min":0.42999999999999999,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":29.617999999999999,"5min":29.617999999999999,"15min":29.617999999999999},"last":0.92600000000000005}]},{"osd":3,"last update":"Thu Jul 6 02:39:25 2023","interfaces":[{"interface":"back","average":{"1min":1.5189999999999999,"5min":1.9379999999999999,"15min":2.0710000000000002},"min":{"1min":0.33700000000000002,"5min":0.312,"15min":0.312},"max":{"1min":8.2560000000000002,"5min":11.526999999999999,"15min":14.084},"last":1.3660000000000001},{"interface":"front","average":{"1min":1.448,"5min":1.5,"15min":1.7310000000000001},"min":{"1min":0.39500000000000002,"5min":0.35199999999999998,"15min":0.34999999999999998},"max":{"1min":6.3529999999999998,"5min":6.3529999999999998,"15min":7.3040000000000003},"last":1.006}]},{"osd":4,"last update":"Thu Jul 6 02:39:25 2023","interfaces":[{"interface":"back","average":{"1min":2.016,"5min":1.468,"15min":1.645},"min":{"1min":0.29399999999999998,"5min":0.28599999999999998,"15min":0.27100000000000002},"max":{"1min":11.215999999999999,"5min":11.215999999999999,"15min":15.625999999999999},"last":0.78600000000000003},{"interface":"front","average":{"1min":1.2490000000000001,"5min":1.397,"15min":1.5660000000000001},"min":{"1min":0.29899999999999999,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":5.0679999999999996,"5min":8.3689999999999998,"15min":14.519},"last":1.2529999999999999}]},{"osd":5,"last update":"Thu Jul 6 02:39:25 2023","interfaces":[{"interface":"back","average":{"1min":1.0649999999999999,"5min":1.02,"15min":1.101},"min":{"1min":0.376,"5min":0.33900000000000002,"15min":0.315},"max":{"1min":5.508,"5min":6.3399999999999999,"15min":9.0790000000000006},"last":0.97399999999999998},{"interface":"front","average":{"1min":2.3340000000000001,"5min":1.5900000000000001,"15min":1.8069999999999999},"min":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":11.489000000000001,"5min":11.489000000000001,"15min":15.686},"last":0.98699999999999999}]},{"osd":7,"last update":"Thu Jul 6 02:39:25 2023","interfaces":[{"interface":"back","average":{"1min":3.1850000000000001,"5min":1.73,"15min":1.766},"min":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":38.942999999999998,"5min":38.942999999999998,"15min":38.942999999999998},"last":1.145},{"interface":"front","average":{"1min":2.9460000000000002,"5min":1.677,"15min":1.4410000000000001},"min":{"1min":0.41899999999999998,"5min":0.39000000000000001,"15min":0.35199999999999998},"max":{"1min":38.557000000000002,"5min":38.557000000000002,"15min":38.557000000000002},"last":1.0449999999999999}]}]},{"osd":1,"up_from":13,"seq":55834580396,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1864788,"kb_used_data":1036,"kb_used_omap":15006,"kb_used_meta":1848737,"kb_avail":92507052,"statfs":{"total":96636764160,"available":94727221248,"internally_reserved":0,"allocated":1060864,"data_stored":786745,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":15366880,"internal_metadata":1893106976},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":82,"apply_latency_ms":82,"commit_latency_ns":82000000,"apply_latency_ns":82000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 6 02:40:11 2023","interfaces":[{"interface":"back","average":{"1min":1.8580000000000001,"5min":1.1719999999999999,"15min":1.0569999999999999},"min":{"1min":0.253,"5min":0.23400000000000001,"15min":0.23100000000000001},"max":{"1min":6.819,"5min":8.2579999999999991,"15min":11.006},"last":0.53600000000000003},{"interface":"front","average":{"1min":2.9079999999999999,"5min":1.796,"15min":1.3859999999999999},"min":{"1min":0.27700000000000002,"5min":0.27700000000000002,"15min":0.27000000000000002},"max":{"1min":15.366,"5min":15.366,"15min":15.366},"last":0.44400000000000001}]},{"osd":2,"last update":"Thu Jul 6 02:40:11 2023","interfaces":[{"interface":"back","average":{"1min":2.569,"5min":1.665,"15min":1.708},"min":{"1min":0.28899999999999998,"5min":0.26700000000000002,"15min":0.255},"max":{"1min":12.045999999999999,"5min":12.045999999999999,"15min":12.045999999999999},"last":0.46000000000000002},{"interface":"front","average":{"1min":2.6320000000000001,"5min":1.55,"15min":1.3480000000000001},"min":{"1min":0.28899999999999998,"5min":0.27700000000000002,"15min":0.25800000000000001},"max":{"1min":14.038,"5min":14.038,"15min":14.038},"last":0.47699999999999998}]},{"osd":3,"last update":"Thu Jul 6 02:40:11 2023","interfaces":[{"interface":"back","average":{"1min":2.4540000000000002,"5min":1.5960000000000001,"15min":1.387},"min":{"1min":0.35199999999999998,"5min":0.30499999999999999,"15min":0.253},"max":{"1min":15.712,"5min":15.712,"15min":15.712},"last":0.59799999999999998},{"interface":"front","average":{"1min":2.931,"5min":1.8120000000000001,"15min":1.4970000000000001},"min":{"1min":0.432,"5min":0.29499999999999998,"15min":0.27300000000000002},"max":{"1min":15.414,"5min":15.414,"15min":15.414},"last":0.502}]},{"osd":4,"last update":"Thu Jul 6 02:40:11 2023","interfaces":[{"interface":"back","average":{"1min":3.0249999999999999,"5min":1.988,"15min":1.6459999999999999},"min":{"1min":0.49199999999999999,"5min":0.38300000000000001,"15min":0.35199999999999998},"max":{"1min":15.442,"5min":15.442,"15min":15.442},"last":0.72099999999999997},{"interface":"front","average":{"1min":2.948,"5min":1.9690000000000001,"15min":1.9930000000000001},"min":{"1min":0.40200000000000002,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":15.279999999999999,"5min":15.279999999999999,"15min":15.279999999999999},"last":0.66700000000000004}]},{"osd":5,"last update":"Thu Jul 6 02:40:11 2023","interfaces":[{"interface":"back","average":{"1min":3.7349999999999999,"5min":2.484,"15min":2.3490000000000002},"min":{"1min":0.39300000000000002,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":22.263000000000002,"5min":22.263000000000002,"15min":22.263000000000002},"last":0.58799999999999997},{"interface":"front","average":{"1min":4.1920000000000002,"5min":2.1070000000000002,"15min":1.7270000000000001},"min":{"1min":0.41199999999999998,"5min":0.38200000000000001,"15min":0.36899999999999999},"max":{"1min":26.181000000000001,"5min":26.181000000000001,"15min":26.181000000000001},"last":0.81200000000000006}]},{"osd":6,"last update":"Thu Jul 6 02:40:11 2023","interfaces":[{"interface":"back","average":{"1min":2.206,"5min":1.8740000000000001,"15min":1.8300000000000001},"min":{"1min":0.52800000000000002,"5min":0.42199999999999999,"15min":0.39300000000000002},"max":{"1min":9.1600000000000001,"5min":9.5429999999999993,"15min":10.359999999999999},"last":0.57399999999999995},{"interface":"front","average":{"1min":2.6960000000000002,"5min":2.0859999999999999,"15min":2.2839999999999998},"min":{"1min":0.48799999999999999,"5min":0.47399999999999998,"15min":0.439},"max":{"1min":10.478999999999999,"5min":10.478999999999999,"15min":11.101000000000001},"last":0.69999999999999996}]},{"osd":7,"last update":"Thu Jul 6 02:40:11 2023","interfaces":[{"interface":"back","average":{"1min":3.3220000000000001,"5min":2.1339999999999999,"15min":1.887},"min":{"1min":0.50600000000000001,"5min":0.44,"15min":0.44},"max":{"1min":18.707999999999998,"5min":18.707999999999998,"15min":18.707999999999998},"last":0.84699999999999998},{"interface":"front","average":{"1min":2.6869999999999998,"5min":2.282,"15min":2.0760000000000001},"min":{"1min":0.59299999999999997,"5min":0.47099999999999997,"15min":0.41799999999999998},"max":{"1min":11.893000000000001,"5min":11.893000000000001,"15min":11.893000000000001},"last":0.65200000000000002}]}]},{"osd":0,"up_from":13,"seq":55834580388,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1405520,"kb_used_data":456,"kb_used_omap":12735,"kb_used_meta":1392320,"kb_avail":92966320,"statfs":{"total":96636764160,"available":95197511680,"internally_reserved":0,"allocated":466944,"data_stored":196377,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":13040941,"internal_metadata":1425736403},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":44,"apply_latency_ms":44,"commit_latency_ns":44000000,"apply_latency_ns":44000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jul 6 02:40:20 2023","interfaces":[{"interface":"back","average":{"1min":11.510999999999999,"5min":3.1629999999999998,"15min":1.9379999999999999},"min":{"1min":0.251,"5min":0.246,"15min":0.23899999999999999},"max":{"1min":181.02000000000001,"5min":181.02000000000001,"15min":181.02000000000001},"last":0.34999999999999998},{"interface":"front","average":{"1min":6.1219999999999999,"5min":2.1720000000000002,"15min":1.762},"min":{"1min":0.27100000000000002,"5min":0.248,"15min":0.248},"max":{"1min":64.414000000000001,"5min":64.414000000000001,"15min":64.414000000000001},"last":0.39500000000000002}]},{"osd":2,"last update":"Thu Jul 6 02:40:20 2023","interfaces":[{"interface":"back","average":{"1min":10.853999999999999,"5min":3.1179999999999999,"15min":1.97},"min":{"1min":0.317,"5min":0.26200000000000001,"15min":0.252},"max":{"1min":181.05699999999999,"5min":181.05699999999999,"15min":181.05699999999999},"last":0.41399999999999998},{"interface":"front","average":{"1min":5.3239999999999998,"5min":2.0950000000000002,"15min":1.877},"min":{"1min":0.317,"5min":0.245,"15min":0.245},"max":{"1min":44.764000000000003,"5min":44.764000000000003,"15min":44.764000000000003},"last":0.48699999999999999}]},{"osd":3,"last update":"Thu Jul 6 02:40:20 2023","interfaces":[{"interface":"back","average":{"1min":4.3259999999999996,"5min":2.335,"15min":2.2200000000000002},"min":{"1min":0.42399999999999999,"5min":0.30499999999999999,"15min":0.27800000000000002},"max":{"1min":22.457000000000001,"5min":22.457000000000001,"15min":22.457000000000001},"last":0.505},{"interface":"front","average":{"1min":11.337,"5min":3.2690000000000001,"15min":2.2069999999999999},"min":{"1min":0.38200000000000001,"5min":0.35799999999999998,"15min":0.315},"max":{"1min":170.40899999999999,"5min":170.40899999999999,"15min":170.40899999999999},"last":0.47399999999999998}]},{"osd":4,"last update":"Thu Jul 6 02:40:20 2023","interfaces":[{"interface":"back","average":{"1min":5.0039999999999996,"5min":1.9430000000000001,"15min":1.7509999999999999},"min":{"1min":0.40999999999999998,"5min":0.36099999999999999,"15min":0.34399999999999997},"max":{"1min":44.676000000000002,"5min":44.676000000000002,"15min":44.676000000000002},"last":0.69499999999999995},{"interface":"front","average":{"1min":3.702,"5min":2.0699999999999998,"15min":2.0499999999999998},"min":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.32400000000000001},"max":{"1min":22.384,"5min":22.384,"15min":22.384},"last":0.72999999999999998}]},{"osd":5,"last update":"Thu Jul 6 02:40:20 2023","interfaces":[{"interface":"back","average":{"1min":18.643000000000001,"5min":4.7960000000000003,"15min":2.617},"min":{"1min":0.51700000000000002,"5min":0.41199999999999998,"15min":0.35099999999999998},"max":{"1min":232.208,"5min":232.208,"15min":232.208},"last":0.70699999999999996},{"interface":"front","average":{"1min":5.4089999999999998,"5min":2.411,"15min":1.956},"min":{"1min":0.40300000000000002,"5min":0.372,"15min":0.372},"max":{"1min":44.734999999999999,"5min":44.734999999999999,"15min":44.734999999999999},"last":0.66300000000000003}]},{"osd":6,"last update":"Thu Jul 6 02:40:20 2023","interfaces":[{"interface":"back","average":{"1min":4.516,"5min":2.3809999999999998,"15min":2.286},"min":{"1min":0.42299999999999999,"5min":0.379,"15min":0.379},"max":{"1min":22.427,"5min":22.427,"15min":22.427},"last":0.82899999999999996},{"interface":"front","average":{"1min":12.401,"5min":3.5009999999999999,"15min":2.1619999999999999},"min":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.38500000000000001},"max":{"1min":180.94900000000001,"5min":180.94900000000001,"15min":180.94900000000001},"last":0.64900000000000002}]},{"osd":7,"last update":"Thu Jul 6 02:40:20 2023","interfaces":[{"interface":"back","average":{"1min":5.7839999999999998,"5min":2.645,"15min":2.3700000000000001},"min":{"1min":0.46100000000000002,"5min":0.42299999999999999,"15min":0.41399999999999998},"max":{"1min":44.792000000000002,"5min":44.792000000000002,"15min":44.792000000000002},"last":0.625},{"interface":"front","average":{"1min":6.1829999999999998,"5min":3.02,"15min":2.601},"min":{"1min":0.48599999999999999,"5min":0.47499999999999998,"15min":0.44800000000000001},"max":{"1min":53.578000000000003,"5min":53.578000000000003,"15min":53.578000000000003},"last":0.78600000000000003}]}]},{"osd":2,"up_from":13,"seq":55834580383,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1328652,"kb_used_data":452,"kb_used_omap":9607,"kb_used_meta":1318584,"kb_avail":93043188,"statfs":{"total":96636764160,"available":95276224512,"internally_reserved":0,"allocated":462848,"data_stored":195416,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":9837933,"internal_metadata":1350230675},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":42,"apply_latency_ms":42,"commit_latency_ns":42000000,"apply_latency_ns":42000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 6 02:40:19 2023","interfaces":[{"interface":"back","average":{"1min":5.1559999999999997,"5min":1.796,"15min":1.349},"min":{"1min":0.27200000000000002,"5min":0.22900000000000001,"15min":0.22900000000000001},"max":{"1min":36.674999999999997,"5min":36.674999999999997,"15min":36.674999999999997},"last":0.40600000000000003},{"interface":"front","average":{"1min":16.443000000000001,"5min":4.181,"15min":2.2999999999999998},"min":{"1min":0.27400000000000002,"5min":0.249,"15min":0.249},"max":{"1min":122.961,"5min":122.961,"15min":122.961},"last":0.38600000000000001}]},{"osd":1,"last update":"Thu Jul 6 02:40:19 2023","interfaces":[{"interface":"back","average":{"1min":5.3239999999999998,"5min":1.9450000000000001,"15min":1.504},"min":{"1min":0.30499999999999999,"5min":0.25,"15min":0.25},"max":{"1min":36.643999999999998,"5min":36.643999999999998,"15min":36.643999999999998},"last":0.48399999999999999},{"interface":"front","average":{"1min":5.3170000000000002,"5min":2.347,"15min":1.8460000000000001},"min":{"1min":0.312,"5min":0.28599999999999998,"15min":0.27900000000000003},"max":{"1min":25.643999999999998,"5min":25.643999999999998,"15min":25.643999999999998},"last":0.45300000000000001}]},{"osd":3,"last update":"Thu Jul 6 02:40:19 2023","interfaces":[{"interface":"back","average":{"1min":12.382999999999999,"5min":3.6989999999999998,"15min":2.4569999999999999},"min":{"1min":0.47199999999999998,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":101.968,"5min":101.968,"15min":101.968},"last":0.432},{"interface":"front","average":{"1min":5.077,"5min":2.0960000000000001,"15min":1.6599999999999999},"min":{"1min":0.46899999999999997,"5min":0.31,"15min":0.31},"max":{"1min":36.701000000000001,"5min":36.701000000000001,"15min":36.701000000000001},"last":0.53800000000000003}]},{"osd":4,"last update":"Thu Jul 6 02:40:19 2023","interfaces":[{"interface":"back","average":{"1min":6.5049999999999999,"5min":2.488,"15min":1.8740000000000001},"min":{"1min":0.38400000000000001,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":36.560000000000002,"5min":36.560000000000002,"15min":36.560000000000002},"last":0.621},{"interface":"front","average":{"1min":8.7100000000000009,"5min":2.8820000000000001,"15min":2.105},"min":{"1min":0.59799999999999998,"5min":0.36599999999999999,"15min":0.33600000000000002},"max":{"1min":40.014000000000003,"5min":40.014000000000003,"15min":40.014000000000003},"last":0.73999999999999999}]},{"osd":5,"last update":"Thu Jul 6 02:40:19 2023","interfaces":[{"interface":"back","average":{"1min":10.765000000000001,"5min":3.7450000000000001,"15min":2.5470000000000002},"min":{"1min":0.57499999999999996,"5min":0.377,"15min":0.36099999999999999},"max":{"1min":81.969999999999999,"5min":81.969999999999999,"15min":81.969999999999999},"last":0.60799999999999998},{"interface":"front","average":{"1min":8.984,"5min":3.198,"15min":2.1360000000000001},"min":{"1min":0.53700000000000003,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":65.238,"5min":65.238,"15min":65.238},"last":0.72399999999999998}]},{"osd":6,"last update":"Thu Jul 6 02:40:19 2023","interfaces":[{"interface":"back","average":{"1min":7.5640000000000001,"5min":2.8290000000000002,"15min":2.1829999999999998},"min":{"1min":0.63600000000000001,"5min":0.40799999999999997,"15min":0.38700000000000001},"max":{"1min":25.689,"5min":25.689,"15min":25.689},"last":0.83699999999999997},{"interface":"front","average":{"1min":12.055,"5min":3.931,"15min":2.641},"min":{"1min":0.51700000000000002,"5min":0.433,"15min":0.40100000000000002},"max":{"1min":61.131999999999998,"5min":61.131999999999998,"15min":61.131999999999998},"last":0.64700000000000002}]},{"osd":7,"last update":"Thu Jul 6 02:40:19 2023","interfaces":[{"interface":"back","average":{"1min":8.6229999999999993,"5min":2.9830000000000001,"15min":2.27},"min":{"1min":0.68000000000000005,"5min":0.46200000000000002,"15min":0.45500000000000002},"max":{"1min":25.783000000000001,"5min":25.783000000000001,"15min":25.783000000000001},"last":0.79100000000000004},{"interface":"front","average":{"1min":9.2609999999999992,"5min":3.4860000000000002,"15min":2.6720000000000002},"min":{"1min":0.54800000000000004,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":72.167000000000002,"5min":72.167000000000002,"15min":72.167000000000002},"last":0.67700000000000005}]}]},{"osd":3,"up_from":13,"seq":55834580376,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1393680,"kb_used_data":456,"kb_used_omap":21228,"kb_used_meta":1371987,"kb_avail":92978160,"statfs":{"total":96636764160,"available":95209635840,"internally_reserved":0,"allocated":466944,"data_stored":196377,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":21737712,"internal_metadata":1404915472},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":119,"apply_latency_ms":119,"commit_latency_ns":119000000,"apply_latency_ns":119000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 6 02:39:28 2023","interfaces":[{"interface":"back","average":{"1min":1.016,"5min":1.1739999999999999,"15min":1.0609999999999999},"min":{"1min":0.254,"5min":0.23799999999999999,"15min":0.22500000000000001},"max":{"1min":4.4199999999999999,"5min":7.0190000000000001,"15min":12.298999999999999},"last":9.7010000000000005},{"interface":"front","average":{"1min":2.1190000000000002,"5min":1.528,"15min":1.377},"min":{"1min":0.28299999999999997,"5min":0.27000000000000002,"15min":0.252},"max":{"1min":18.82,"5min":18.82,"15min":18.82},"last":0.84099999999999997}]},{"osd":1,"last update":"Thu Jul 6 02:39:28 2023","interfaces":[{"interface":"back","average":{"1min":7.5679999999999996,"5min":2.976,"15min":1.8959999999999999},"min":{"1min":0.307,"5min":0.27100000000000002,"15min":0.24299999999999999},"max":{"1min":103.182,"5min":103.182,"15min":103.182},"last":0.52000000000000002},{"interface":"front","average":{"1min":2.601,"5min":1.764,"15min":1.5369999999999999},"min":{"1min":0.27300000000000002,"5min":0.26800000000000002,"15min":0.25},"max":{"1min":18.895,"5min":18.895,"15min":18.895},"last":0.79000000000000004}]},{"osd":2,"last update":"Thu Jul 6 02:39:44 2023","interfaces":[{"interface":"back","average":{"1min":4.5579999999999998,"5min":2.3660000000000001,"15min":1.8500000000000001},"min":{"1min":0.29699999999999999,"5min":0.29099999999999998,"15min":0.27700000000000002},"max":{"1min":33.005000000000003,"5min":33.005000000000003,"15min":33.005000000000003},"last":0.58299999999999996},{"interface":"front","average":{"1min":2.988,"5min":1.9219999999999999,"15min":1.8220000000000001},"min":{"1min":0.38300000000000001,"5min":0.29199999999999998,"15min":0.28799999999999998},"max":{"1min":18.997,"5min":18.997,"15min":18.997},"last":7.3150000000000004}]},{"osd":4,"last update":"Thu Jul 6 02:39:44 2023","interfaces":[{"interface":"back","average":{"1min":2.0710000000000002,"5min":1.5249999999999999,"15min":1.5229999999999999},"min":{"1min":0.33500000000000002,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":18.966000000000001,"5min":18.966000000000001,"15min":18.966000000000001},"last":2.0110000000000001},{"interface":"front","average":{"1min":2.8620000000000001,"5min":1.6899999999999999,"15min":1.462},"min":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":32.886000000000003,"5min":32.886000000000003,"15min":32.886000000000003},"last":9.6440000000000001}]},{"osd":5,"last update":"Thu Jul 6 02:39:28 2023","interfaces":[{"interface":"back","average":{"1min":2.9260000000000002,"5min":1.6990000000000001,"15min":1.667},"min":{"1min":0.42599999999999999,"5min":0.375,"15min":0.32400000000000001},"max":{"1min":18.539000000000001,"5min":18.539000000000001,"15min":21.579000000000001},"last":11.497},{"interface":"front","average":{"1min":3.4460000000000002,"5min":2.2410000000000001,"15min":2.0720000000000001},"min":{"1min":0.49099999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":18.596,"5min":18.596,"15min":21.553999999999998},"last":1.5349999999999999}]},{"osd":6,"last update":"Thu Jul 6 02:39:44 2023","interfaces":[{"interface":"back","average":{"1min":5.5049999999999999,"5min":2.786,"15min":2.2749999999999999},"min":{"1min":0.47299999999999998,"5min":0.41199999999999998,"15min":0.377},"max":{"1min":43.991999999999997,"5min":43.991999999999997,"15min":43.991999999999997},"last":2.6150000000000002},{"interface":"front","average":{"1min":3.0289999999999999,"5min":2.1000000000000001,"15min":1.978},"min":{"1min":0.439,"5min":0.40799999999999997,"15min":0.39700000000000002},"max":{"1min":18.93,"5min":18.93,"15min":19.273},"last":0.88500000000000001}]},{"osd":7,"last update":"Thu Jul 6 02:39:44 2023","interfaces":[{"interface":"back","average":{"1min":4.3040000000000003,"5min":2.5259999999999998,"15min":2.0009999999999999},"min":{"1min":0.50600000000000001,"5min":0.47699999999999998,"15min":0.42299999999999999},"max":{"1min":32.942999999999998,"5min":32.942999999999998,"15min":32.942999999999998},"last":22.087},{"interface":"front","average":{"1min":4.5119999999999996,"5min":2.3119999999999998,"15min":2.2999999999999998},"min":{"1min":0.56599999999999995,"5min":0.45100000000000001,"15min":0.439},"max":{"1min":33.039000000000001,"5min":33.039000000000001,"15min":33.039000000000001},"last":2.5739999999999998}]}]},{"osd":4,"up_from":13,"seq":55834580416,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1833232,"kb_used_data":456,"kb_used_omap":28853,"kb_used_meta":1803914,"kb_avail":92538608,"statfs":{"total":96636764160,"available":94759534592,"internally_reserved":0,"allocated":466944,"data_stored":196377,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":29545912,"internal_metadata":1847208520},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":59,"apply_latency_ms":59,"commit_latency_ns":59000000,"apply_latency_ns":59000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 6 02:40:16 2023","interfaces":[{"interface":"back","average":{"1min":2.0750000000000002,"5min":1.0489999999999999,"15min":1.1559999999999999},"min":{"1min":0.245,"5min":0.245,"15min":0.23100000000000001},"max":{"1min":17.847999999999999,"5min":17.847999999999999,"15min":17.847999999999999},"last":1.863},{"interface":"front","average":{"1min":3.0670000000000002,"5min":1.6060000000000001,"15min":1.704},"min":{"1min":0.27900000000000003,"5min":0.27900000000000003,"15min":0.26200000000000001},"max":{"1min":32.529000000000003,"5min":32.529000000000003,"15min":32.529000000000003},"last":1.6459999999999999}]},{"osd":1,"last update":"Thu Jul 6 02:40:16 2023","interfaces":[{"interface":"back","average":{"1min":3.2639999999999998,"5min":1.661,"15min":1.9530000000000001},"min":{"1min":0.39800000000000002,"5min":0.26900000000000002,"15min":0.26400000000000001},"max":{"1min":11.667,"5min":11.667,"15min":26.927},"last":0.89100000000000001},{"interface":"front","average":{"1min":3.3290000000000002,"5min":1.7390000000000001,"15min":1.944},"min":{"1min":0.308,"5min":0.28000000000000003,"15min":0.27500000000000002},"max":{"1min":12.082000000000001,"5min":12.082000000000001,"15min":26.620999999999999},"last":0.84599999999999997}]},{"osd":2,"last update":"Thu Jul 6 02:39:27 2023","interfaces":[{"interface":"back","average":{"1min":1.4399999999999999,"5min":1.5760000000000001,"15min":1.6619999999999999},"min":{"1min":0.35399999999999998,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":7.8890000000000002,"5min":13.345000000000001,"15min":18.768999999999998},"last":5.8650000000000002},{"interface":"front","average":{"1min":1.8620000000000001,"5min":1.9390000000000001,"15min":2.121},"min":{"1min":0.36599999999999999,"5min":0.35399999999999998,"15min":0.29999999999999999},"max":{"1min":7.5410000000000004,"5min":8.673,"15min":18.701000000000001},"last":5.9249999999999998}]},{"osd":3,"last update":"Thu Jul 6 02:40:16 2023","interfaces":[{"interface":"back","average":{"1min":2.746,"5min":1.984,"15min":2.0379999999999998},"min":{"1min":0.307,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":12.132,"5min":12.132,"15min":12.132},"last":0.79800000000000004},{"interface":"front","average":{"1min":3.4529999999999998,"5min":1.847,"15min":1.9370000000000001},"min":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.34699999999999998},"max":{"1min":18.472000000000001,"5min":18.472000000000001,"15min":18.472000000000001},"last":0.60199999999999998}]},{"osd":5,"last update":"Thu Jul 6 02:40:16 2023","interfaces":[{"interface":"back","average":{"1min":4.6159999999999997,"5min":1.837,"15min":1.6819999999999999},"min":{"1min":0.311,"5min":0.309,"15min":0.27400000000000002},"max":{"1min":46.088000000000001,"5min":46.088000000000001,"15min":46.088000000000001},"last":0.85899999999999999},{"interface":"front","average":{"1min":1.948,"5min":1.2549999999999999,"15min":1.4930000000000001},"min":{"1min":0.26800000000000002,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":21.468,"5min":21.468,"15min":21.468},"last":0.70299999999999996}]},{"osd":6,"last update":"Thu Jul 6 02:40:16 2023","interfaces":[{"interface":"back","average":{"1min":2.4620000000000002,"5min":1.3009999999999999,"15min":1.274},"min":{"1min":0.30099999999999999,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":18.498000000000001,"5min":18.498000000000001,"15min":18.498000000000001},"last":0.74099999999999999},{"interface":"front","average":{"1min":1.8640000000000001,"5min":1.415,"15min":1.726},"min":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.35099999999999998},"max":{"1min":8.2309999999999999,"5min":8.2309999999999999,"15min":15.339},"last":0.92000000000000004}]},{"osd":7,"last update":"Thu Jul 6 02:40:16 2023","interfaces":[{"interface":"back","average":{"1min":9.0920000000000005,"5min":2.8130000000000002,"15min":2.0579999999999998},"min":{"1min":0.39400000000000002,"5min":0.37,"15min":0.36899999999999999},"max":{"1min":170.637,"5min":170.637,"15min":170.637},"last":0.76000000000000001},{"interface":"front","average":{"1min":9.891,"5min":2.907,"15min":1.903},"min":{"1min":0.375,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":170.33199999999999,"5min":170.33199999999999,"15min":170.33199999999999},"last":0.499}]}]},{"osd":5,"up_from":13,"seq":55834580409,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1418640,"kb_used_data":456,"kb_used_omap":19336,"kb_used_meta":1398839,"kb_avail":92953200,"statfs":{"total":96636764160,"available":95184076800,"internally_reserved":0,"allocated":466944,"data_stored":196377,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":19800821,"internal_metadata":1432411403},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":59,"apply_latency_ms":59,"commit_latency_ns":59000000,"apply_latency_ns":59000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 6 02:39:44 2023","interfaces":[{"interface":"back","average":{"1min":1.3859999999999999,"5min":1.1319999999999999,"15min":1.159},"min":{"1min":0.27000000000000002,"5min":0.23100000000000001,"15min":0.23100000000000001},"max":{"1min":4.9189999999999996,"5min":6.5110000000000001,"15min":10.669},"last":0.57899999999999996},{"interface":"front","average":{"1min":2.4700000000000002,"5min":1.6679999999999999,"15min":1.5960000000000001},"min":{"1min":0.309,"5min":0.28100000000000003,"15min":0.26900000000000002},"max":{"1min":10.452999999999999,"5min":10.452999999999999,"15min":10.452999999999999},"last":0.69999999999999996}]},{"osd":1,"last update":"Thu Jul 6 02:39:44 2023","interfaces":[{"interface":"back","average":{"1min":2.0499999999999998,"5min":1.4830000000000001,"15min":1.5609999999999999},"min":{"1min":0.29699999999999999,"5min":0.28000000000000003,"15min":0.27600000000000002},"max":{"1min":8.3719999999999999,"5min":8.3719999999999999,"15min":8.3719999999999999},"last":0.71299999999999997},{"interface":"front","average":{"1min":2.2210000000000001,"5min":1.8799999999999999,"15min":1.671},"min":{"1min":0.36499999999999999,"5min":0.27600000000000002,"15min":0.26000000000000001},"max":{"1min":7.827,"5min":8.1120000000000001,"15min":10.724},"last":0.65000000000000002}]},{"osd":2,"last update":"Thu Jul 6 02:39:44 2023","interfaces":[{"interface":"back","average":{"1min":2.133,"5min":1.929,"15min":1.901},"min":{"1min":0.32900000000000001,"5min":0.31900000000000001,"15min":0.28799999999999998},"max":{"1min":6.1420000000000003,"5min":9.5739999999999998,"15min":9.5739999999999998},"last":0.78600000000000003},{"interface":"front","average":{"1min":2.0089999999999999,"5min":1.843,"15min":1.915},"min":{"1min":0.33600000000000002,"5min":0.33600000000000002,"15min":0.29199999999999998},"max":{"1min":4.7720000000000002,"5min":7.4039999999999999,"15min":10.209},"last":0.67600000000000005}]},{"osd":3,"last update":"Thu Jul 6 02:39:44 2023","interfaces":[{"interface":"back","average":{"1min":2.2120000000000002,"5min":1.8740000000000001,"15min":1.944},"min":{"1min":0.39400000000000002,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":7.5860000000000003,"5min":7.5860000000000003,"15min":11.222},"last":0.76300000000000001},{"interface":"front","average":{"1min":1.925,"5min":2.0299999999999998,"15min":2.0289999999999999},"min":{"1min":0.36699999999999999,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":7.0499999999999998,"5min":7.0499999999999998,"15min":9.9700000000000006},"last":0.63800000000000001}]},{"osd":4,"last update":"Thu Jul 6 02:39:44 2023","interfaces":[{"interface":"back","average":{"1min":0.88900000000000001,"5min":1.165,"15min":1.298},"min":{"1min":0.33300000000000002,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":3.02,"5min":10.948,"15min":13.590999999999999},"last":0.45100000000000001},{"interface":"front","average":{"1min":1.155,"5min":1.3220000000000001,"15min":1.5860000000000001},"min":{"1min":0.38300000000000001,"5min":0.30399999999999999,"15min":0.28599999999999998},"max":{"1min":3.4750000000000001,"5min":6.7130000000000001,"15min":9.4410000000000007},"last":0.61699999999999999}]},{"osd":6,"last update":"Thu Jul 6 02:39:44 2023","interfaces":[{"interface":"back","average":{"1min":0.95899999999999996,"5min":1.3149999999999999,"15min":1.4570000000000001},"min":{"1min":0.33700000000000002,"5min":0.33500000000000002,"15min":0.316},"max":{"1min":2.8180000000000001,"5min":6.1539999999999999,"15min":15.113},"last":0.48799999999999999},{"interface":"front","average":{"1min":1.2370000000000001,"5min":1.2989999999999999,"15min":1.5249999999999999},"min":{"1min":0.41799999999999998,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":4.0620000000000003,"5min":10.906000000000001,"15min":11.699},"last":0.68500000000000005}]},{"osd":7,"last update":"Thu Jul 6 02:39:44 2023","interfaces":[{"interface":"back","average":{"1min":1.1160000000000001,"5min":1.49,"15min":1.7529999999999999},"min":{"1min":0.41199999999999998,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":3.6659999999999999,"5min":8.8499999999999996,"15min":11.294},"last":0.73699999999999999},{"interface":"front","average":{"1min":1.274,"5min":1.393,"15min":1.621},"min":{"1min":0.40600000000000003,"5min":0.36199999999999999,"15min":0.35399999999999998},"max":{"1min":3.8999999999999999,"5min":6.351,"15min":15.173},"last":0.56399999999999995}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-07-06T02:40:29.241 INFO:tasks.ceph:pgid 1.5 last_scrub_stamp 2023-07-05T18:56:08.603137+0000 time.struct_time(tm_year=2023, tm_mon=7, tm_mday=5, tm_hour=18, tm_min=56, tm_sec=8, tm_wday=2, tm_yday=186, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=7, tm_mday=6, tm_hour=2, tm_min=40, tm_sec=23, tm_wday=3, tm_yday=187, tm_isdst=0) 2023-07-06T02:40:29.241 INFO:tasks.ceph:pgid 1.4 last_scrub_stamp 2023-07-05T18:56:08.603137+0000 time.struct_time(tm_year=2023, tm_mon=7, tm_mday=5, tm_hour=18, tm_min=56, tm_sec=8, tm_wday=2, tm_yday=186, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=7, tm_mday=6, tm_hour=2, tm_min=40, tm_sec=23, tm_wday=3, tm_yday=187, tm_isdst=0) 2023-07-06T02:40:29.242 INFO:tasks.ceph:pgid 1.3 last_scrub_stamp 2023-07-05T18:56:08.603137+0000 time.struct_time(tm_year=2023, tm_mon=7, tm_mday=5, tm_hour=18, tm_min=56, tm_sec=8, tm_wday=2, tm_yday=186, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=7, tm_mday=6, tm_hour=2, tm_min=40, tm_sec=23, tm_wday=3, tm_yday=187, tm_isdst=0) 2023-07-06T02:40:29.242 INFO:tasks.ceph:pgid 2.0 last_scrub_stamp 2023-07-05T18:56:08.603137+0000 time.struct_time(tm_year=2023, tm_mon=7, tm_mday=5, tm_hour=18, tm_min=56, tm_sec=8, tm_wday=2, tm_yday=186, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=7, tm_mday=6, tm_hour=2, tm_min=40, tm_sec=23, tm_wday=3, tm_yday=187, tm_isdst=0) 2023-07-06T02:40:29.242 INFO:tasks.ceph:pgid 1.2 last_scrub_stamp 2023-07-05T18:56:08.603137+0000 time.struct_time(tm_year=2023, tm_mon=7, tm_mday=5, tm_hour=18, tm_min=56, tm_sec=8, tm_wday=2, tm_yday=186, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=7, tm_mday=6, tm_hour=2, tm_min=40, tm_sec=23, tm_wday=3, tm_yday=187, tm_isdst=0) 2023-07-06T02:40:29.243 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2023-07-05T18:56:08.603137+0000 time.struct_time(tm_year=2023, tm_mon=7, tm_mday=5, tm_hour=18, tm_min=56, tm_sec=8, tm_wday=2, tm_yday=186, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=7, tm_mday=6, tm_hour=2, tm_min=40, tm_sec=23, tm_wday=3, tm_yday=187, tm_isdst=0) 2023-07-06T02:40:29.243 INFO:tasks.ceph:pgid 1.1 last_scrub_stamp 2023-07-05T18:56:08.603137+0000 time.struct_time(tm_year=2023, tm_mon=7, tm_mday=5, tm_hour=18, tm_min=56, tm_sec=8, tm_wday=2, tm_yday=186, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=7, tm_mday=6, tm_hour=2, tm_min=40, tm_sec=23, tm_wday=3, tm_yday=187, tm_isdst=0) 2023-07-06T02:40:29.243 INFO:tasks.ceph:pgid 1.6 last_scrub_stamp 2023-07-05T18:56:08.603137+0000 time.struct_time(tm_year=2023, tm_mon=7, tm_mday=5, tm_hour=18, tm_min=56, tm_sec=8, tm_wday=2, tm_yday=186, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=7, tm_mday=6, tm_hour=2, tm_min=40, tm_sec=23, tm_wday=3, tm_yday=187, tm_isdst=0) 2023-07-06T02:40:29.243 INFO:tasks.ceph:pgid 1.7 last_scrub_stamp 2023-07-05T18:56:08.603137+0000 time.struct_time(tm_year=2023, tm_mon=7, tm_mday=5, tm_hour=18, tm_min=56, tm_sec=8, tm_wday=2, tm_yday=186, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=7, tm_mday=6, tm_hour=2, tm_min=40, tm_sec=23, tm_wday=3, tm_yday=187, tm_isdst=0) 2023-07-06T02:40:29.244 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2023-07-06T02:40:42.407 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-06T02:40:42.410 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-06T02:40:49.244 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-07-06T02:40:49.392 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:49.389+0000 7fcd04d2b700 1 Processor -- start 2023-07-06T02:40:49.392 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:49.389+0000 7fcd04d2b700 1 -- start start 2023-07-06T02:40:49.394 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:49.390+0000 7fcd04d2b700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fcd00071350 0x7fcd000b5590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T02:40:49.395 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:49.390+0000 7fcd04d2b700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fcd000b1ec0 0x7fcd0015a980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T02:40:49.395 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:49.390+0000 7fcd04d2b700 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcd0015df10 con 0x7fcd0006c870 2023-07-06T02:40:49.395 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:49.390+0000 7fcd04d2b700 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcd0015eb50 con 0x7fcd000b1ec0 2023-07-06T02:40:49.395 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:49.390+0000 7fcd04d2b700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcd0015e1b0 con 0x7fcd00071350 2023-07-06T02:40:49.396 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:49.390+0000 7fccfed9d700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fcd000b1ec0 0x7fcd0015a980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T02:40:49.396 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:49.390+0000 7fccfdd9b700 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7fcd0006c870 0x7fcd000b17b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:45640/0 (socket says 172.21.15.46:45640) 2023-07-06T02:40:49.396 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:49.390+0000 7fccfdd9b700 1 -- 172.21.15.46:0/1988387294 learned_addr learned my addr 172.21.15.46:0/1988387294 (peer_addr_for_me v1:172.21.15.46:0/0) 2023-07-06T02:40:49.396 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:49.390+0000 7fccfe59c700 1 --2- 172.21.15.46:0/1988387294 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fcd00071350 0x7fcd000b5590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T02:40:49.397 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:49.390+0000 7fccfed9d700 1 -- 172.21.15.46:0/1988387294 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fcd00071350 msgr2=0x7fcd000b5590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T02:40:49.397 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:49.390+0000 7fccfed9d700 1 --2- 172.21.15.46:0/1988387294 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fcd00071350 0x7fcd000b5590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T02:40:49.397 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:49.390+0000 7fccfed9d700 1 -- 172.21.15.46:0/1988387294 >> v1:172.21.15.46:6789/0 conn(0x7fcd0006c870 legacy=0x7fcd000b17b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T02:40:49.397 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:49.390+0000 7fccfed9d700 1 -- 172.21.15.46:0/1988387294 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd0015e490 con 0x7fcd000b1ec0 2023-07-06T02:40:49.398 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:49.390+0000 7fccfd59a700 1 -- 172.21.15.46:0/1988387294 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 103695534 0 0) 0x7fcd0015df10 con 0x7fcd0006c870 2023-07-06T02:40:49.398 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:49.391+0000 7fccfed9d700 1 --2- 172.21.15.46:0/1988387294 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fcd000b1ec0 0x7fcd0015a980 secure :-1 s=READY pgs=3291 cs=0 l=1 rev1=1 crypto rx=0x7fccf8009d90 tx=0x7fccf800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e5f79a7c2da3d9de server_cookie=0 in_seq=0 out_seq=0 2023-07-06T02:40:49.398 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:49.391+0000 7fccfd59a700 1 -- 172.21.15.46:0/1988387294 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fccf800e070 con 0x7fcd000b1ec0 2023-07-06T02:40:49.398 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:49.391+0000 7fccfd59a700 1 -- 172.21.15.46:0/1988387294 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fccf800bbd0 con 0x7fcd000b1ec0 2023-07-06T02:40:49.399 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:49.391+0000 7fccfd59a700 1 -- 172.21.15.46:0/1988387294 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fccf8012430 con 0x7fcd000b1ec0 2023-07-06T02:40:49.399 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:49.391+0000 7fcd04d2b700 1 -- 172.21.15.46:0/1988387294 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fcd000b1ec0 msgr2=0x7fcd0015a980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T02:40:49.399 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:49.391+0000 7fcd04d2b700 1 --2- 172.21.15.46:0/1988387294 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fcd000b1ec0 0x7fcd0015a980 secure :-1 s=READY pgs=3291 cs=0 l=1 rev1=1 crypto rx=0x7fccf8009d90 tx=0x7fccf800b330 comp rx=0 tx=0).stop 2023-07-06T02:40:49.399 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:49.391+0000 7fcd04d2b700 1 -- 172.21.15.46:0/1988387294 shutdown_connections 2023-07-06T02:40:49.399 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:49.391+0000 7fcd04d2b700 1 --2- 172.21.15.46:0/1988387294 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fcd000b1ec0 0x7fcd0015a980 unknown :-1 s=CLOSED pgs=3291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T02:40:49.400 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:49.391+0000 7fcd04d2b700 1 --2- 172.21.15.46:0/1988387294 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fcd00071350 0x7fcd000b5590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T02:40:49.400 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:49.391+0000 7fcd04d2b700 1 -- 172.21.15.46:0/1988387294 >> 172.21.15.46:0/1988387294 conn(0x7fcd0006af10 msgr2=0x7fcd0006b310 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T02:40:49.400 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:49.392+0000 7fcd04d2b700 1 -- 172.21.15.46:0/1988387294 shutdown_connections 2023-07-06T02:40:49.400 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:49.392+0000 7fcd04d2b700 1 -- 172.21.15.46:0/1988387294 wait complete. 2023-07-06T02:40:49.402 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:49.393+0000 7fcd04d2b700 1 Processor -- start 2023-07-06T02:40:49.402 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:49.393+0000 7fcd04d2b700 1 -- start start 2023-07-06T02:40:49.403 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:49.394+0000 7fcd04d2b700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fcd0006c870 0x7fcd000cd680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T02:40:49.403 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:49.394+0000 7fcd04d2b700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fcd00071350 0x7fcd00142e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T02:40:49.403 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:49.394+0000 7fcd04d2b700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fcd000b1ec0 0x7fcd00143390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T02:40:49.403 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:49.394+0000 7fcd04d2b700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd000cdbc0 con 0x7fcd00071350 2023-07-06T02:40:49.403 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:49.394+0000 7fcd04d2b700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd001438d0 con 0x7fcd0006c870 2023-07-06T02:40:49.404 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:49.394+0000 7fcd04d2b700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcd000cddb0 con 0x7fcd000b1ec0 2023-07-06T02:40:49.404 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:49.394+0000 7fccfdd9b700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fcd00071350 0x7fcd00142e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T02:40:49.404 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:49.394+0000 7fccfdd9b700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fcd00071350 0x7fcd00142e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:46372/0 (socket says 172.21.15.46:46372) 2023-07-06T02:40:49.404 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:49.394+0000 7fccfdd9b700 1 -- 172.21.15.46:0/1427140960 learned_addr learned my addr 172.21.15.46:0/1427140960 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-07-06T02:40:49.405 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:49.394+0000 7fccfe59c700 1 --2- 172.21.15.46:0/1427140960 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fcd0006c870 0x7fcd000cd680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T02:40:49.405 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:49.394+0000 7fccfed9d700 1 --2- 172.21.15.46:0/1427140960 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fcd000b1ec0 0x7fcd00143390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T02:40:49.405 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:49.394+0000 7fccfdd9b700 1 -- 172.21.15.46:0/1427140960 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fcd000b1ec0 msgr2=0x7fcd00143390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T02:40:49.405 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:49.394+0000 7fccfdd9b700 1 --2- 172.21.15.46:0/1427140960 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fcd000b1ec0 0x7fcd00143390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T02:40:49.405 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:49.394+0000 7fccfdd9b700 1 -- 172.21.15.46:0/1427140960 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fcd0006c870 msgr2=0x7fcd000cd680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T02:40:49.405 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:49.394+0000 7fccfdd9b700 1 --2- 172.21.15.46:0/1427140960 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fcd0006c870 0x7fcd000cd680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T02:40:49.406 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:49.394+0000 7fccfdd9b700 1 -- 172.21.15.46:0/1427140960 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fccf8009a70 con 0x7fcd00071350 2023-07-06T02:40:49.406 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:49.394+0000 7fccfe59c700 1 --2- 172.21.15.46:0/1427140960 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fcd0006c870 0x7fcd000cd680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-06T02:40:49.406 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:49.394+0000 7fccfed9d700 1 --2- 172.21.15.46:0/1427140960 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fcd000b1ec0 0x7fcd00143390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-06T02:40:49.406 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:49.394+0000 7fccfdd9b700 1 --2- 172.21.15.46:0/1427140960 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fcd00071350 0x7fcd00142e50 secure :-1 s=READY pgs=3292 cs=0 l=1 rev1=1 crypto rx=0x7fccf400c570 tx=0x7fccf400c930 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T02:40:49.406 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:49.395+0000 7fcceeffd700 1 -- 172.21.15.46:0/1427140960 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fccf4004c80 con 0x7fcd00071350 2023-07-06T02:40:49.407 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:49.395+0000 7fcceeffd700 1 -- 172.21.15.46:0/1427140960 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fccf4004e00 con 0x7fcd00071350 2023-07-06T02:40:49.407 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:49.395+0000 7fcd04d2b700 1 -- 172.21.15.46:0/1427140960 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcd000ce090 con 0x7fcd00071350 2023-07-06T02:40:49.407 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:49.395+0000 7fcceeffd700 1 -- 172.21.15.46:0/1427140960 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fccf4007310 con 0x7fcd00071350 2023-07-06T02:40:49.407 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:49.395+0000 7fcd04d2b700 1 -- 172.21.15.46:0/1427140960 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcd000ce650 con 0x7fcd00071350 2023-07-06T02:40:49.407 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:49.396+0000 7fcd04d2b700 1 -- 172.21.15.46:0/1427140960 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcd000672e0 con 0x7fcd00071350 2023-07-06T02:40:49.408 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:49.396+0000 7fcceeffd700 1 -- 172.21.15.46:0/1427140960 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fccf4007470 con 0x7fcd00071350 2023-07-06T02:40:49.408 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:49.397+0000 7fcceeffd700 1 --2- 172.21.15.46:0/1427140960 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7fcce006ad10 0x7fcce006d1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T02:40:49.408 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:49.397+0000 7fcceeffd700 1 -- 172.21.15.46:0/1427140960 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 5296+0+0 (secure 0 0 0) 0x7fccf4088f70 con 0x7fcd00071350 2023-07-06T02:40:49.408 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:49.397+0000 7fccfe59c700 1 --2- 172.21.15.46:0/1427140960 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7fcce006ad10 0x7fcce006d1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T02:40:49.408 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:49.397+0000 7fccfe59c700 1 --2- 172.21.15.46:0/1427140960 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7fcce006ad10 0x7fcce006d1c0 secure :-1 s=READY pgs=754 cs=0 l=1 rev1=1 crypto rx=0x7fccf00099f0 tx=0x7fccf0008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T02:40:49.409 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:49.401+0000 7fcceeffd700 1 -- 172.21.15.46:0/1427140960 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fccf40bb310 con 0x7fcd00071350 2023-07-06T02:40:49.609 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:49.606+0000 7fcd04d2b700 1 -- 172.21.15.46:0/1427140960 --> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fcd00071720 con 0x7fcce006ad10 2023-07-06T02:40:49.613 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:49.610+0000 7fcceeffd700 1 -- 172.21.15.46:0/1427140960 <== mgr.4099 v2:172.21.15.73:6832/3033361733 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+71780 (secure 0 0 0) 0x7fccf0009680 con 0x7fcce006ad10 2023-07-06T02:40:49.614 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-06T02:40:49.615 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:49.612+0000 7fcd04d2b700 1 -- 172.21.15.46:0/1427140960 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7fcce006ad10 msgr2=0x7fcce006d1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T02:40:49.616 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:49.612+0000 7fcd04d2b700 1 --2- 172.21.15.46:0/1427140960 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7fcce006ad10 0x7fcce006d1c0 secure :-1 s=READY pgs=754 cs=0 l=1 rev1=1 crypto rx=0x7fccf00099f0 tx=0x7fccf0008040 comp rx=0 tx=0).stop 2023-07-06T02:40:49.616 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:49.612+0000 7fcd04d2b700 1 -- 172.21.15.46:0/1427140960 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fcd00071350 msgr2=0x7fcd00142e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T02:40:49.616 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:49.612+0000 7fcd04d2b700 1 --2- 172.21.15.46:0/1427140960 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fcd00071350 0x7fcd00142e50 secure :-1 s=READY pgs=3292 cs=0 l=1 rev1=1 crypto rx=0x7fccf400c570 tx=0x7fccf400c930 comp rx=0 tx=0).stop 2023-07-06T02:40:49.616 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:49.612+0000 7fcd04d2b700 1 -- 172.21.15.46:0/1427140960 shutdown_connections 2023-07-06T02:40:49.617 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:49.612+0000 7fcd04d2b700 1 --2- 172.21.15.46:0/1427140960 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7fcce006ad10 0x7fcce006d1c0 unknown :-1 s=CLOSED pgs=754 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T02:40:49.617 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:49.612+0000 7fcd04d2b700 1 --2- 172.21.15.46:0/1427140960 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fcd000b1ec0 0x7fcd00143390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T02:40:49.617 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:49.612+0000 7fcd04d2b700 1 --2- 172.21.15.46:0/1427140960 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fcd0006c870 0x7fcd000cd680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T02:40:49.617 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:49.612+0000 7fcd04d2b700 1 --2- 172.21.15.46:0/1427140960 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fcd00071350 0x7fcd00142e50 unknown :-1 s=CLOSED pgs=3292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T02:40:49.617 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:49.612+0000 7fcd04d2b700 1 -- 172.21.15.46:0/1427140960 >> 172.21.15.46:0/1427140960 conn(0x7fcd0006af10 msgr2=0x7fcd00070730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T02:40:49.618 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:49.612+0000 7fcd04d2b700 1 -- 172.21.15.46:0/1427140960 shutdown_connections 2023-07-06T02:40:49.618 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:49.612+0000 7fcd04d2b700 1 -- 172.21.15.46:0/1427140960 wait complete. 2023-07-06T02:40:49.618 INFO:teuthology.orchestra.run.smithi046.stderr:dumped all 2023-07-06T02:40:49.629 INFO:teuthology.orchestra.run.smithi046.stdout:{"pg_ready":true,"pg_map":{"version":13967,"stamp":"2023-07-06T02:40:48.074556+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":146,"num_read_kb":127,"num_write":209,"num_write_kb":3462,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":163,"ondisk_log_size":163,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":18,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":11831236,"kb_used_data":4804,"kb_used_omap":135724,"kb_used_meta":11690643,"kb_avail":743143484,"statfs":{"total":773094113280,"available":760978927616,"internally_reserved":0,"allocated":4919296,"data_stored":2750791,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":138982351,"internal_metadata":11971218481},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002897"},"pg_stats":[{"pgid":"1.5","version":"0'0","reported_seq":283,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-07-06T02:40:28.120253+0000","last_change":"2023-07-06T02:40:28.120319+0000","last_active":"2023-07-06T02:40:28.120253+0000","last_peered":"2023-07-06T02:40:28.120253+0000","last_clean":"2023-07-06T02:40:28.120253+0000","last_became_active":"2023-07-05T18:56:09.621796+0000","last_became_peered":"2023-07-05T18:56:09.621796+0000","last_unstale":"2023-07-06T02:40:28.120253+0000","last_undegraded":"2023-07-06T02:40:28.120253+0000","last_fullsized":"2023-07-06T02:40:28.120253+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T02:40:28.120044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T02:40:28.120044+0000","last_clean_scrub_stamp":"2023-07-06T02:40:28.120044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T02:40:48.866682+0000","scrub_duration":0.041441217000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":287,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-07-06T02:40:27.706559+0000","last_change":"2023-07-06T02:40:27.706610+0000","last_active":"2023-07-06T02:40:27.706559+0000","last_peered":"2023-07-06T02:40:27.706559+0000","last_clean":"2023-07-06T02:40:27.706559+0000","last_became_active":"2023-07-05T18:56:09.621315+0000","last_became_peered":"2023-07-05T18:56:09.621315+0000","last_unstale":"2023-07-06T02:40:27.706559+0000","last_undegraded":"2023-07-06T02:40:27.706559+0000","last_fullsized":"2023-07-06T02:40:27.706559+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T02:40:27.706435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T02:40:27.706435+0000","last_clean_scrub_stamp":"2023-07-06T02:40:27.706435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T08:15:36.489689+0000","scrub_duration":0.078535018999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":282,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-07-06T02:40:26.568073+0000","last_change":"2023-07-06T02:40:26.568122+0000","last_active":"2023-07-06T02:40:26.568073+0000","last_peered":"2023-07-06T02:40:26.568073+0000","last_clean":"2023-07-06T02:40:26.568073+0000","last_became_active":"2023-07-05T18:56:09.617720+0000","last_became_peered":"2023-07-05T18:56:09.617720+0000","last_unstale":"2023-07-06T02:40:26.568073+0000","last_undegraded":"2023-07-06T02:40:26.568073+0000","last_fullsized":"2023-07-06T02:40:26.568073+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T02:40:26.567929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T02:40:26.567929+0000","last_clean_scrub_stamp":"2023-07-06T02:40:26.567929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T04:07:02.730091+0000","scrub_duration":0.034508456999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"40'163","reported_seq":495,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-07-06T02:40:29.957294+0000","last_change":"2023-07-06T02:40:29.957350+0000","last_active":"2023-07-06T02:40:29.957294+0000","last_peered":"2023-07-06T02:40:29.957294+0000","last_clean":"2023-07-06T02:40:29.957294+0000","last_became_active":"2023-07-05T18:56:09.621421+0000","last_became_peered":"2023-07-05T18:56:09.621421+0000","last_unstale":"2023-07-06T02:40:29.957294+0000","last_undegraded":"2023-07-06T02:40:29.957294+0000","last_fullsized":"2023-07-06T02:40:29.957294+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"40'163","last_scrub_stamp":"2023-07-06T02:40:29.957212+0000","last_deep_scrub":"40'163","last_deep_scrub_stamp":"2023-07-06T02:40:29.957212+0000","last_clean_scrub_stamp":"2023-07-06T02:40:29.957212+0000","objects_scrubbed":2,"log_size":163,"log_dups_size":0,"ondisk_log_size":163,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T04:14:32.806973+0000","scrub_duration":0.121998652,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":146,"num_read_kb":127,"num_write":209,"num_write_kb":3462,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":282,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-07-06T02:40:32.834914+0000","last_change":"2023-07-06T02:40:32.834965+0000","last_active":"2023-07-06T02:40:32.834914+0000","last_peered":"2023-07-06T02:40:32.834914+0000","last_clean":"2023-07-06T02:40:32.834914+0000","last_became_active":"2023-07-05T18:56:10.073617+0000","last_became_peered":"2023-07-05T18:56:10.073617+0000","last_unstale":"2023-07-06T02:40:32.834914+0000","last_undegraded":"2023-07-06T02:40:32.834914+0000","last_fullsized":"2023-07-06T02:40:32.834914+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T02:40:32.834130+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T02:40:32.834130+0000","last_clean_scrub_stamp":"2023-07-06T02:40:32.834130+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T12:20:14.031349+0000","scrub_duration":0.038689959000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":290,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-07-06T02:40:31.834536+0000","last_change":"2023-07-06T02:40:31.834583+0000","last_active":"2023-07-06T02:40:31.834536+0000","last_peered":"2023-07-06T02:40:31.834536+0000","last_clean":"2023-07-06T02:40:31.834536+0000","last_became_active":"2023-07-05T18:56:10.073336+0000","last_became_peered":"2023-07-05T18:56:10.073336+0000","last_unstale":"2023-07-06T02:40:31.834536+0000","last_undegraded":"2023-07-06T02:40:31.834536+0000","last_fullsized":"2023-07-06T02:40:31.834536+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T02:40:31.834407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T02:40:31.834407+0000","last_clean_scrub_stamp":"2023-07-06T02:40:31.834407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T06:55:26.788066+0000","scrub_duration":0.013696656999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":283,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-07-06T02:40:30.933961+0000","last_change":"2023-07-06T02:40:30.934010+0000","last_active":"2023-07-06T02:40:30.933961+0000","last_peered":"2023-07-06T02:40:30.933961+0000","last_clean":"2023-07-06T02:40:30.933961+0000","last_became_active":"2023-07-05T18:56:10.073356+0000","last_became_peered":"2023-07-05T18:56:10.073356+0000","last_unstale":"2023-07-06T02:40:30.933961+0000","last_undegraded":"2023-07-06T02:40:30.933961+0000","last_fullsized":"2023-07-06T02:40:30.933961+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T02:40:30.933798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T02:40:30.933798+0000","last_clean_scrub_stamp":"2023-07-06T02:40:30.933798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T12:40:28.105714+0000","scrub_duration":0.079953472999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":276,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-07-06T02:40:28.638804+0000","last_change":"2023-07-06T02:40:28.638867+0000","last_active":"2023-07-06T02:40:28.638804+0000","last_peered":"2023-07-06T02:40:28.638804+0000","last_clean":"2023-07-06T02:40:28.638804+0000","last_became_active":"2023-07-05T18:56:10.073339+0000","last_became_peered":"2023-07-05T18:56:10.073339+0000","last_unstale":"2023-07-06T02:40:28.638804+0000","last_undegraded":"2023-07-06T02:40:28.638804+0000","last_fullsized":"2023-07-06T02:40:28.638804+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T02:40:28.638662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T02:40:28.638662+0000","last_clean_scrub_stamp":"2023-07-06T02:40:28.638662+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T10:59:46.462705+0000","scrub_duration":0.052806888000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":276,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-07-06T02:40:35.530118+0000","last_change":"2023-07-06T02:40:35.530178+0000","last_active":"2023-07-06T02:40:35.530118+0000","last_peered":"2023-07-06T02:40:35.530118+0000","last_clean":"2023-07-06T02:40:35.530118+0000","last_became_active":"2023-07-05T18:56:09.618958+0000","last_became_peered":"2023-07-05T18:56:09.618958+0000","last_unstale":"2023-07-06T02:40:35.530118+0000","last_undegraded":"2023-07-06T02:40:35.530118+0000","last_fullsized":"2023-07-06T02:40:35.530118+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T02:40:35.529994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T02:40:35.529994+0000","last_clean_scrub_stamp":"2023-07-06T02:40:35.529994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T05:13:31.906116+0000","scrub_duration":0.062884752000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":8},{"poolid":2,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":146,"num_read_kb":127,"num_write":209,"num_write_kb":3462,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":163,"ondisk_log_size":163,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834580416,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1891092,"kb_used_data":1036,"kb_used_omap":14013,"kb_used_meta":1876034,"kb_avail":92480748,"statfs":{"total":96636764160,"available":94700285952,"internally_reserved":0,"allocated":1060864,"data_stored":786745,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":14349832,"internal_metadata":1921059320},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 6 02:40:11 2023","interfaces":[{"interface":"back","average":{"1min":6.3979999999999997,"5min":1.9890000000000001,"15min":1.554},"min":{"1min":0.24199999999999999,"5min":0.24199999999999999,"15min":0.24099999999999999},"max":{"1min":71.978999999999999,"5min":71.978999999999999,"15min":71.978999999999999},"last":0.50600000000000001},{"interface":"front","average":{"1min":4.657,"5min":2.1640000000000001,"15min":1.8440000000000001},"min":{"1min":0.25800000000000001,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":23.382000000000001,"5min":23.382000000000001,"15min":23.382000000000001},"last":0.61699999999999999}]},{"osd":1,"last update":"Thu Jul 6 02:40:11 2023","interfaces":[{"interface":"back","average":{"1min":7.2990000000000004,"5min":2.3500000000000001,"15min":1.829},"min":{"1min":0.27200000000000002,"5min":0.27200000000000002,"15min":0.25},"max":{"1min":71.951999999999998,"5min":71.951999999999998,"15min":71.951999999999998},"last":0.59199999999999997},{"interface":"front","average":{"1min":4.25,"5min":2.3250000000000002,"15min":2.0640000000000001},"min":{"1min":0.26100000000000001,"5min":0.26100000000000001,"15min":0.25900000000000001},"max":{"1min":23.489999999999998,"5min":23.489999999999998,"15min":23.489999999999998},"last":0.64800000000000002}]},{"osd":2,"last update":"Thu Jul 6 02:40:11 2023","interfaces":[{"interface":"back","average":{"1min":4.9379999999999997,"5min":2.2160000000000002,"15min":1.7969999999999999},"min":{"1min":0.33500000000000002,"5min":0.29899999999999999,"15min":0.29299999999999998},"max":{"1min":35.311999999999998,"5min":35.311999999999998,"15min":35.311999999999998},"last":0.56100000000000005},{"interface":"front","average":{"1min":6.2610000000000001,"5min":2.5649999999999999,"15min":2.0960000000000001},"min":{"1min":0.308,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":66.536000000000001,"5min":66.536000000000001,"15min":66.536000000000001},"last":0.63200000000000001}]},{"osd":3,"last update":"Thu Jul 6 02:40:11 2023","interfaces":[{"interface":"back","average":{"1min":3.327,"5min":1.9690000000000001,"15min":1.8129999999999999},"min":{"1min":0.33200000000000002,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":25.637,"5min":25.637,"15min":25.637},"last":0.52900000000000003},{"interface":"front","average":{"1min":5.9050000000000002,"5min":2.617,"15min":2.2370000000000001},"min":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":71.905000000000001,"5min":71.905000000000001,"15min":71.905000000000001},"last":0.54600000000000004}]},{"osd":4,"last update":"Thu Jul 6 02:40:11 2023","interfaces":[{"interface":"back","average":{"1min":7.0339999999999998,"5min":2.3719999999999999,"15min":1.871},"min":{"1min":0.27700000000000002,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":52.734999999999999,"5min":52.734999999999999,"15min":52.734999999999999},"last":0.44600000000000001},{"interface":"front","average":{"1min":2.7069999999999999,"5min":1.359,"15min":1.2829999999999999},"min":{"1min":0.33500000000000002,"5min":0.32000000000000001,"15min":0.311},"max":{"1min":35.372,"5min":35.372,"15min":35.372},"last":0.46000000000000002}]},{"osd":5,"last update":"Thu Jul 6 02:40:11 2023","interfaces":[{"interface":"back","average":{"1min":5.3689999999999998,"5min":2.1030000000000002,"15min":1.788},"min":{"1min":0.29299999999999998,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":73.492999999999995,"5min":73.492999999999995,"15min":73.492999999999995},"last":0.432},{"interface":"front","average":{"1min":2.839,"5min":1.847,"15min":1.754},"min":{"1min":0.34799999999999998,"5min":0.33800000000000002,"15min":0.30499999999999999},"max":{"1min":14.983000000000001,"5min":14.983000000000001,"15min":25.689},"last":0.57299999999999995}]},{"osd":6,"last update":"Thu Jul 6 02:40:11 2023","interfaces":[{"interface":"back","average":{"1min":3.9630000000000001,"5min":2.0470000000000002,"15min":1.986},"min":{"1min":0.34200000000000003,"5min":0.309,"15min":0.309},"max":{"1min":21.321000000000002,"5min":21.321000000000002,"15min":21.321000000000002},"last":0.51800000000000002},{"interface":"front","average":{"1min":1.5349999999999999,"5min":1.4219999999999999,"15min":1.3460000000000001},"min":{"1min":0.376,"5min":0.376,"15min":0.373},"max":{"1min":11.273999999999999,"5min":11.273999999999999,"15min":12.099},"last":0.60499999999999998}]}]},{"osd":6,"up_from":13,"seq":55834580423,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":695632,"kb_used_data":456,"kb_used_omap":14943,"kb_used_meta":680224,"kb_avail":93676208,"statfs":{"total":96636764160,"available":95924436992,"internally_reserved":0,"allocated":466944,"data_stored":196377,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":15302320,"internal_metadata":696549712},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 6 02:40:28 2023","interfaces":[{"interface":"back","average":{"1min":2.0640000000000001,"5min":1.2769999999999999,"15min":1.0529999999999999},"min":{"1min":0.26000000000000001,"5min":0.24199999999999999,"15min":0.22900000000000001},"max":{"1min":22.327999999999999,"5min":22.327999999999999,"15min":22.327999999999999},"last":0.58799999999999997},{"interface":"front","average":{"1min":2.9329999999999998,"5min":1.6970000000000001,"15min":1.6299999999999999},"min":{"1min":0.27900000000000003,"5min":0.27000000000000002,"15min":0.26400000000000001},"max":{"1min":12.07,"5min":12.07,"15min":14.146000000000001},"last":0.41999999999999998}]},{"osd":1,"last update":"Thu Jul 6 02:40:28 2023","interfaces":[{"interface":"back","average":{"1min":3.8929999999999998,"5min":2.1349999999999998,"15min":1.889},"min":{"1min":0.29099999999999998,"5min":0.25800000000000001,"15min":0.25600000000000001},"max":{"1min":25.202000000000002,"5min":25.202000000000002,"15min":25.202000000000002},"last":0.39100000000000001},{"interface":"front","average":{"1min":3.6640000000000001,"5min":2.6779999999999999,"15min":2.1659999999999999},"min":{"1min":0.316,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":30.145,"5min":62.668999999999997,"15min":62.668999999999997},"last":0.55300000000000005}]},{"osd":2,"last update":"Thu Jul 6 02:40:28 2023","interfaces":[{"interface":"back","average":{"1min":3.23,"5min":1.6339999999999999,"15min":1.5469999999999999},"min":{"1min":0.31,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":22.366,"5min":22.366,"15min":22.366},"last":0.52600000000000002},{"interface":"front","average":{"1min":4.2999999999999998,"5min":2.6190000000000002,"15min":2.415},"min":{"1min":0.42399999999999999,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":25.236000000000001,"5min":29.617999999999999,"15min":29.617999999999999},"last":0.504}]},{"osd":3,"last update":"Thu Jul 6 02:40:28 2023","interfaces":[{"interface":"back","average":{"1min":4.5720000000000001,"5min":2.3959999999999999,"15min":2.2599999999999998},"min":{"1min":0.36599999999999999,"5min":0.312,"15min":0.312},"max":{"1min":30.100999999999999,"5min":30.100999999999999,"15min":30.100999999999999},"last":0.47699999999999998},{"interface":"front","average":{"1min":3.0830000000000002,"5min":1.8220000000000001,"15min":1.7909999999999999},"min":{"1min":0.378,"5min":0.35199999999999998,"15min":0.34999999999999998},"max":{"1min":19.103999999999999,"5min":19.103999999999999,"15min":19.103999999999999},"last":0.69699999999999995}]},{"osd":4,"last update":"Thu Jul 6 02:40:28 2023","interfaces":[{"interface":"back","average":{"1min":3.956,"5min":1.9590000000000001,"15min":1.724},"min":{"1min":0.27700000000000002,"5min":0.27700000000000002,"15min":0.27100000000000002},"max":{"1min":25.271000000000001,"5min":25.271000000000001,"15min":25.271000000000001},"last":0.46100000000000002},{"interface":"front","average":{"1min":3.0369999999999999,"5min":1.7669999999999999,"15min":1.6419999999999999},"min":{"1min":0.32400000000000001,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":30.251999999999999,"5min":30.251999999999999,"15min":30.251999999999999},"last":0.60699999999999998}]},{"osd":5,"last update":"Thu Jul 6 02:40:28 2023","interfaces":[{"interface":"back","average":{"1min":1.6639999999999999,"5min":1.1299999999999999,"15min":1.1200000000000001},"min":{"1min":0.29299999999999998,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":10.397,"5min":10.397,"15min":10.397},"last":0.64700000000000002},{"interface":"front","average":{"1min":7.4009999999999998,"5min":2.7200000000000002,"15min":2.1400000000000001},"min":{"1min":0.316,"5min":0.316,"15min":0.316},"max":{"1min":119.92400000000001,"5min":119.92400000000001,"15min":119.92400000000001},"last":0.57299999999999995}]},{"osd":7,"last update":"Thu Jul 6 02:40:28 2023","interfaces":[{"interface":"back","average":{"1min":3.3519999999999999,"5min":2.1829999999999998,"15min":1.8899999999999999},"min":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":33.680999999999997,"5min":38.942999999999998,"15min":38.942999999999998},"last":0.66400000000000003},{"interface":"front","average":{"1min":3,"5min":2.0190000000000001,"15min":1.5329999999999999},"min":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.35199999999999998},"max":{"1min":50.673000000000002,"5min":50.673000000000002,"15min":50.673000000000002},"last":0.73199999999999998}]}]},{"osd":1,"up_from":13,"seq":55834580400,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1864788,"kb_used_data":1036,"kb_used_omap":15006,"kb_used_meta":1848737,"kb_avail":92507052,"statfs":{"total":96636764160,"available":94727221248,"internally_reserved":0,"allocated":1060864,"data_stored":786745,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":15366880,"internal_metadata":1893106976},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 6 02:40:11 2023","interfaces":[{"interface":"back","average":{"1min":1.8580000000000001,"5min":1.1719999999999999,"15min":1.0569999999999999},"min":{"1min":0.253,"5min":0.23400000000000001,"15min":0.23100000000000001},"max":{"1min":6.819,"5min":8.2579999999999991,"15min":11.006},"last":0.39200000000000002},{"interface":"front","average":{"1min":2.9079999999999999,"5min":1.796,"15min":1.3859999999999999},"min":{"1min":0.27700000000000002,"5min":0.27700000000000002,"15min":0.27000000000000002},"max":{"1min":15.366,"5min":15.366,"15min":15.366},"last":0.45000000000000001}]},{"osd":2,"last update":"Thu Jul 6 02:40:11 2023","interfaces":[{"interface":"back","average":{"1min":2.569,"5min":1.665,"15min":1.708},"min":{"1min":0.28899999999999998,"5min":0.26700000000000002,"15min":0.255},"max":{"1min":12.045999999999999,"5min":12.045999999999999,"15min":12.045999999999999},"last":0.42299999999999999},{"interface":"front","average":{"1min":2.6320000000000001,"5min":1.55,"15min":1.3480000000000001},"min":{"1min":0.28899999999999998,"5min":0.27700000000000002,"15min":0.25800000000000001},"max":{"1min":14.038,"5min":14.038,"15min":14.038},"last":0.58199999999999996}]},{"osd":3,"last update":"Thu Jul 6 02:40:11 2023","interfaces":[{"interface":"back","average":{"1min":2.4540000000000002,"5min":1.5960000000000001,"15min":1.387},"min":{"1min":0.35199999999999998,"5min":0.30499999999999999,"15min":0.253},"max":{"1min":15.712,"5min":15.712,"15min":15.712},"last":0.53500000000000003},{"interface":"front","average":{"1min":2.931,"5min":1.8120000000000001,"15min":1.4970000000000001},"min":{"1min":0.432,"5min":0.29499999999999998,"15min":0.27300000000000002},"max":{"1min":15.414,"5min":15.414,"15min":15.414},"last":0.51900000000000002}]},{"osd":4,"last update":"Thu Jul 6 02:40:11 2023","interfaces":[{"interface":"back","average":{"1min":3.0249999999999999,"5min":1.988,"15min":1.6459999999999999},"min":{"1min":0.49199999999999999,"5min":0.38300000000000001,"15min":0.35199999999999998},"max":{"1min":15.442,"5min":15.442,"15min":15.442},"last":0.874},{"interface":"front","average":{"1min":2.948,"5min":1.9690000000000001,"15min":1.9930000000000001},"min":{"1min":0.40200000000000002,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":15.279999999999999,"5min":15.279999999999999,"15min":15.279999999999999},"last":0.88900000000000001}]},{"osd":5,"last update":"Thu Jul 6 02:40:11 2023","interfaces":[{"interface":"back","average":{"1min":3.7349999999999999,"5min":2.484,"15min":2.3490000000000002},"min":{"1min":0.39300000000000002,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":22.263000000000002,"5min":22.263000000000002,"15min":22.263000000000002},"last":0.77400000000000002},{"interface":"front","average":{"1min":4.1920000000000002,"5min":2.1070000000000002,"15min":1.7270000000000001},"min":{"1min":0.41199999999999998,"5min":0.38200000000000001,"15min":0.36899999999999999},"max":{"1min":26.181000000000001,"5min":26.181000000000001,"15min":26.181000000000001},"last":0.85999999999999999}]},{"osd":6,"last update":"Thu Jul 6 02:40:11 2023","interfaces":[{"interface":"back","average":{"1min":2.206,"5min":1.8740000000000001,"15min":1.8300000000000001},"min":{"1min":0.52800000000000002,"5min":0.42199999999999999,"15min":0.39300000000000002},"max":{"1min":9.1600000000000001,"5min":9.5429999999999993,"15min":10.359999999999999},"last":0.753},{"interface":"front","average":{"1min":2.6960000000000002,"5min":2.0859999999999999,"15min":2.2839999999999998},"min":{"1min":0.48799999999999999,"5min":0.47399999999999998,"15min":0.439},"max":{"1min":10.478999999999999,"5min":10.478999999999999,"15min":11.101000000000001},"last":0.93500000000000005}]},{"osd":7,"last update":"Thu Jul 6 02:40:11 2023","interfaces":[{"interface":"back","average":{"1min":3.3220000000000001,"5min":2.1339999999999999,"15min":1.887},"min":{"1min":0.50600000000000001,"5min":0.44,"15min":0.44},"max":{"1min":18.707999999999998,"5min":18.707999999999998,"15min":18.707999999999998},"last":0.90700000000000003},{"interface":"front","average":{"1min":2.6869999999999998,"5min":2.282,"15min":2.0760000000000001},"min":{"1min":0.59299999999999997,"5min":0.47099999999999997,"15min":0.41799999999999998},"max":{"1min":11.893000000000001,"5min":11.893000000000001,"15min":11.893000000000001},"last":0.79700000000000004}]}]},{"osd":0,"up_from":13,"seq":55834580392,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1405520,"kb_used_data":456,"kb_used_omap":12735,"kb_used_meta":1392320,"kb_avail":92966320,"statfs":{"total":96636764160,"available":95197511680,"internally_reserved":0,"allocated":466944,"data_stored":196377,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":13040941,"internal_metadata":1425736403},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jul 6 02:40:20 2023","interfaces":[{"interface":"back","average":{"1min":11.510999999999999,"5min":3.1629999999999998,"15min":1.9379999999999999},"min":{"1min":0.251,"5min":0.246,"15min":0.23899999999999999},"max":{"1min":181.02000000000001,"5min":181.02000000000001,"15min":181.02000000000001},"last":0.5},{"interface":"front","average":{"1min":6.1219999999999999,"5min":2.1720000000000002,"15min":1.762},"min":{"1min":0.27100000000000002,"5min":0.248,"15min":0.248},"max":{"1min":64.414000000000001,"5min":64.414000000000001,"15min":64.414000000000001},"last":0.39000000000000001}]},{"osd":2,"last update":"Thu Jul 6 02:40:20 2023","interfaces":[{"interface":"back","average":{"1min":10.853999999999999,"5min":3.1179999999999999,"15min":1.97},"min":{"1min":0.317,"5min":0.26200000000000001,"15min":0.252},"max":{"1min":181.05699999999999,"5min":181.05699999999999,"15min":181.05699999999999},"last":0.59499999999999997},{"interface":"front","average":{"1min":5.3239999999999998,"5min":2.0950000000000002,"15min":1.877},"min":{"1min":0.317,"5min":0.245,"15min":0.245},"max":{"1min":44.764000000000003,"5min":44.764000000000003,"15min":44.764000000000003},"last":0.44500000000000001}]},{"osd":3,"last update":"Thu Jul 6 02:40:20 2023","interfaces":[{"interface":"back","average":{"1min":4.3259999999999996,"5min":2.335,"15min":2.2200000000000002},"min":{"1min":0.42399999999999999,"5min":0.30499999999999999,"15min":0.27800000000000002},"max":{"1min":22.457000000000001,"5min":22.457000000000001,"15min":22.457000000000001},"last":0.46300000000000002},{"interface":"front","average":{"1min":11.337,"5min":3.2690000000000001,"15min":2.2069999999999999},"min":{"1min":0.38200000000000001,"5min":0.35799999999999998,"15min":0.315},"max":{"1min":170.40899999999999,"5min":170.40899999999999,"15min":170.40899999999999},"last":0.64000000000000001}]},{"osd":4,"last update":"Thu Jul 6 02:40:20 2023","interfaces":[{"interface":"back","average":{"1min":5.0039999999999996,"5min":1.9430000000000001,"15min":1.7509999999999999},"min":{"1min":0.40999999999999998,"5min":0.36099999999999999,"15min":0.34399999999999997},"max":{"1min":44.676000000000002,"5min":44.676000000000002,"15min":44.676000000000002},"last":0.57399999999999995},{"interface":"front","average":{"1min":3.702,"5min":2.0699999999999998,"15min":2.0499999999999998},"min":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.32400000000000001},"max":{"1min":22.384,"5min":22.384,"15min":22.384},"last":0.69199999999999995}]},{"osd":5,"last update":"Thu Jul 6 02:40:20 2023","interfaces":[{"interface":"back","average":{"1min":18.643000000000001,"5min":4.7960000000000003,"15min":2.617},"min":{"1min":0.51700000000000002,"5min":0.41199999999999998,"15min":0.35099999999999998},"max":{"1min":232.208,"5min":232.208,"15min":232.208},"last":0.68200000000000005},{"interface":"front","average":{"1min":5.4089999999999998,"5min":2.411,"15min":1.956},"min":{"1min":0.40300000000000002,"5min":0.372,"15min":0.372},"max":{"1min":44.734999999999999,"5min":44.734999999999999,"15min":44.734999999999999},"last":0.52200000000000002}]},{"osd":6,"last update":"Thu Jul 6 02:40:20 2023","interfaces":[{"interface":"back","average":{"1min":4.516,"5min":2.3809999999999998,"15min":2.286},"min":{"1min":0.42299999999999999,"5min":0.379,"15min":0.379},"max":{"1min":22.427,"5min":22.427,"15min":22.427},"last":0.60999999999999999},{"interface":"front","average":{"1min":12.401,"5min":3.5009999999999999,"15min":2.1619999999999999},"min":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.38500000000000001},"max":{"1min":180.94900000000001,"5min":180.94900000000001,"15min":180.94900000000001},"last":0.71099999999999997}]},{"osd":7,"last update":"Thu Jul 6 02:40:20 2023","interfaces":[{"interface":"back","average":{"1min":5.7839999999999998,"5min":2.645,"15min":2.3700000000000001},"min":{"1min":0.46100000000000002,"5min":0.42299999999999999,"15min":0.41399999999999998},"max":{"1min":44.792000000000002,"5min":44.792000000000002,"15min":44.792000000000002},"last":0.625},{"interface":"front","average":{"1min":6.1829999999999998,"5min":3.02,"15min":2.601},"min":{"1min":0.48599999999999999,"5min":0.47499999999999998,"15min":0.44800000000000001},"max":{"1min":53.578000000000003,"5min":53.578000000000003,"15min":53.578000000000003},"last":0.65400000000000003}]}]},{"osd":2,"up_from":13,"seq":55834580387,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1328652,"kb_used_data":452,"kb_used_omap":9607,"kb_used_meta":1318584,"kb_avail":93043188,"statfs":{"total":96636764160,"available":95276224512,"internally_reserved":0,"allocated":462848,"data_stored":195416,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":9837933,"internal_metadata":1350230675},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 6 02:40:19 2023","interfaces":[{"interface":"back","average":{"1min":5.1559999999999997,"5min":1.796,"15min":1.349},"min":{"1min":0.27200000000000002,"5min":0.22900000000000001,"15min":0.22900000000000001},"max":{"1min":36.674999999999997,"5min":36.674999999999997,"15min":36.674999999999997},"last":0.41199999999999998},{"interface":"front","average":{"1min":16.443000000000001,"5min":4.181,"15min":2.2999999999999998},"min":{"1min":0.27400000000000002,"5min":0.249,"15min":0.249},"max":{"1min":122.961,"5min":122.961,"15min":122.961},"last":0.53700000000000003}]},{"osd":1,"last update":"Thu Jul 6 02:40:19 2023","interfaces":[{"interface":"back","average":{"1min":5.3239999999999998,"5min":1.9450000000000001,"15min":1.504},"min":{"1min":0.30499999999999999,"5min":0.25,"15min":0.25},"max":{"1min":36.643999999999998,"5min":36.643999999999998,"15min":36.643999999999998},"last":0.46800000000000003},{"interface":"front","average":{"1min":5.3170000000000002,"5min":2.347,"15min":1.8460000000000001},"min":{"1min":0.312,"5min":0.28599999999999998,"15min":0.27900000000000003},"max":{"1min":25.643999999999998,"5min":25.643999999999998,"15min":25.643999999999998},"last":0.61299999999999999}]},{"osd":3,"last update":"Thu Jul 6 02:40:19 2023","interfaces":[{"interface":"back","average":{"1min":12.382999999999999,"5min":3.6989999999999998,"15min":2.4569999999999999},"min":{"1min":0.47199999999999998,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":101.968,"5min":101.968,"15min":101.968},"last":0.64200000000000002},{"interface":"front","average":{"1min":5.077,"5min":2.0960000000000001,"15min":1.6599999999999999},"min":{"1min":0.46899999999999997,"5min":0.31,"15min":0.31},"max":{"1min":36.701000000000001,"5min":36.701000000000001,"15min":36.701000000000001},"last":0.51900000000000002}]},{"osd":4,"last update":"Thu Jul 6 02:40:19 2023","interfaces":[{"interface":"back","average":{"1min":6.5049999999999999,"5min":2.488,"15min":1.8740000000000001},"min":{"1min":0.38400000000000001,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":36.560000000000002,"5min":36.560000000000002,"15min":36.560000000000002},"last":0.59499999999999997},{"interface":"front","average":{"1min":8.7100000000000009,"5min":2.8820000000000001,"15min":2.105},"min":{"1min":0.59799999999999998,"5min":0.36599999999999999,"15min":0.33600000000000002},"max":{"1min":40.014000000000003,"5min":40.014000000000003,"15min":40.014000000000003},"last":0.76900000000000002}]},{"osd":5,"last update":"Thu Jul 6 02:40:19 2023","interfaces":[{"interface":"back","average":{"1min":10.765000000000001,"5min":3.7450000000000001,"15min":2.5470000000000002},"min":{"1min":0.57499999999999996,"5min":0.377,"15min":0.36099999999999999},"max":{"1min":81.969999999999999,"5min":81.969999999999999,"15min":81.969999999999999},"last":0.72299999999999998},{"interface":"front","average":{"1min":8.984,"5min":3.198,"15min":2.1360000000000001},"min":{"1min":0.53700000000000003,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":65.238,"5min":65.238,"15min":65.238},"last":0.71099999999999997}]},{"osd":6,"last update":"Thu Jul 6 02:40:19 2023","interfaces":[{"interface":"back","average":{"1min":7.5640000000000001,"5min":2.8290000000000002,"15min":2.1829999999999998},"min":{"1min":0.63600000000000001,"5min":0.40799999999999997,"15min":0.38700000000000001},"max":{"1min":25.689,"5min":25.689,"15min":25.689},"last":0.69099999999999995},{"interface":"front","average":{"1min":12.055,"5min":3.931,"15min":2.641},"min":{"1min":0.51700000000000002,"5min":0.433,"15min":0.40100000000000002},"max":{"1min":61.131999999999998,"5min":61.131999999999998,"15min":61.131999999999998},"last":0.75800000000000001}]},{"osd":7,"last update":"Thu Jul 6 02:40:19 2023","interfaces":[{"interface":"back","average":{"1min":8.6229999999999993,"5min":2.9830000000000001,"15min":2.27},"min":{"1min":0.68000000000000005,"5min":0.46200000000000002,"15min":0.45500000000000002},"max":{"1min":25.783000000000001,"5min":25.783000000000001,"15min":25.783000000000001},"last":0.73799999999999999},{"interface":"front","average":{"1min":9.2609999999999992,"5min":3.4860000000000002,"15min":2.6720000000000002},"min":{"1min":0.54800000000000004,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":72.167000000000002,"5min":72.167000000000002,"15min":72.167000000000002},"last":0.78300000000000003}]}]},{"osd":3,"up_from":13,"seq":55834580380,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1393680,"kb_used_data":456,"kb_used_omap":21228,"kb_used_meta":1371987,"kb_avail":92978160,"statfs":{"total":96636764160,"available":95209635840,"internally_reserved":0,"allocated":466944,"data_stored":196377,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":21737712,"internal_metadata":1404915472},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 6 02:40:30 2023","interfaces":[{"interface":"back","average":{"1min":1.7929999999999999,"5min":1.157,"15min":1.079},"min":{"1min":0.26900000000000002,"5min":0.23799999999999999,"15min":0.22500000000000001},"max":{"1min":9.7010000000000005,"5min":9.7010000000000005,"15min":10.045999999999999},"last":0.51700000000000002},{"interface":"front","average":{"1min":3.5409999999999999,"5min":1.8520000000000001,"15min":1.5249999999999999},"min":{"1min":0.32900000000000001,"5min":0.27000000000000002,"15min":0.252},"max":{"1min":22.716000000000001,"5min":22.716000000000001,"15min":22.716000000000001},"last":0.66500000000000004}]},{"osd":1,"last update":"Thu Jul 6 02:40:30 2023","interfaces":[{"interface":"back","average":{"1min":1.242,"5min":2.71,"15min":1.9199999999999999},"min":{"1min":0.32100000000000001,"5min":0.27100000000000002,"15min":0.24299999999999999},"max":{"1min":5.5519999999999996,"5min":103.182,"15min":103.182},"last":0.56299999999999994},{"interface":"front","average":{"1min":3.6560000000000001,"5min":2.0649999999999999,"15min":1.6499999999999999},"min":{"1min":0.28199999999999997,"5min":0.26800000000000002,"15min":0.25},"max":{"1min":22.768000000000001,"5min":22.768000000000001,"15min":22.768000000000001},"last":0.73299999999999998}]},{"osd":2,"last update":"Thu Jul 6 02:39:44 2023","interfaces":[{"interface":"back","average":{"1min":4.5579999999999998,"5min":2.3660000000000001,"15min":1.8500000000000001},"min":{"1min":0.29699999999999999,"5min":0.29099999999999998,"15min":0.27700000000000002},"max":{"1min":33.005000000000003,"5min":33.005000000000003,"15min":33.005000000000003},"last":0.64000000000000001},{"interface":"front","average":{"1min":2.988,"5min":1.9219999999999999,"15min":1.8220000000000001},"min":{"1min":0.38300000000000001,"5min":0.29199999999999998,"15min":0.28799999999999998},"max":{"1min":18.997,"5min":18.997,"15min":18.997},"last":0.60399999999999998}]},{"osd":4,"last update":"Thu Jul 6 02:39:44 2023","interfaces":[{"interface":"back","average":{"1min":2.0710000000000002,"5min":1.5249999999999999,"15min":1.5229999999999999},"min":{"1min":0.33500000000000002,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":18.966000000000001,"5min":18.966000000000001,"15min":18.966000000000001},"last":0.81499999999999995},{"interface":"front","average":{"1min":2.8620000000000001,"5min":1.6899999999999999,"15min":1.462},"min":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":32.886000000000003,"5min":32.886000000000003,"15min":32.886000000000003},"last":0.873}]},{"osd":5,"last update":"Thu Jul 6 02:40:30 2023","interfaces":[{"interface":"back","average":{"1min":2.0720000000000001,"5min":1.728,"15min":1.706},"min":{"1min":0.40600000000000003,"5min":0.375,"15min":0.32400000000000001},"max":{"1min":14.542999999999999,"5min":18.539000000000001,"15min":21.579000000000001},"last":1.0269999999999999},{"interface":"front","average":{"1min":1.155,"5min":1.988,"15min":2.0350000000000001},"min":{"1min":0.435,"5min":0.371,"15min":0.36799999999999999},"max":{"1min":3.218,"5min":18.596,"15min":21.553999999999998},"last":0.91300000000000003}]},{"osd":6,"last update":"Thu Jul 6 02:39:44 2023","interfaces":[{"interface":"back","average":{"1min":5.5049999999999999,"5min":2.786,"15min":2.2749999999999999},"min":{"1min":0.47299999999999998,"5min":0.41199999999999998,"15min":0.377},"max":{"1min":43.991999999999997,"5min":43.991999999999997,"15min":43.991999999999997},"last":0.83099999999999996},{"interface":"front","average":{"1min":3.0289999999999999,"5min":2.1000000000000001,"15min":1.978},"min":{"1min":0.439,"5min":0.40799999999999997,"15min":0.39700000000000002},"max":{"1min":18.93,"5min":18.93,"15min":19.273},"last":0.94699999999999995}]},{"osd":7,"last update":"Thu Jul 6 02:39:44 2023","interfaces":[{"interface":"back","average":{"1min":4.3040000000000003,"5min":2.5259999999999998,"15min":2.0009999999999999},"min":{"1min":0.50600000000000001,"5min":0.47699999999999998,"15min":0.42299999999999999},"max":{"1min":32.942999999999998,"5min":32.942999999999998,"15min":32.942999999999998},"last":0.98199999999999998},{"interface":"front","average":{"1min":4.5119999999999996,"5min":2.3119999999999998,"15min":2.2999999999999998},"min":{"1min":0.56599999999999995,"5min":0.45100000000000001,"15min":0.439},"max":{"1min":33.039000000000001,"5min":33.039000000000001,"15min":33.039000000000001},"last":0.96699999999999997}]}]},{"osd":4,"up_from":13,"seq":55834580420,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1833232,"kb_used_data":456,"kb_used_omap":28853,"kb_used_meta":1803914,"kb_avail":92538608,"statfs":{"total":96636764160,"available":94759534592,"internally_reserved":0,"allocated":466944,"data_stored":196377,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":29545912,"internal_metadata":1847208520},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 6 02:40:16 2023","interfaces":[{"interface":"back","average":{"1min":2.0750000000000002,"5min":1.0489999999999999,"15min":1.1559999999999999},"min":{"1min":0.245,"5min":0.245,"15min":0.23100000000000001},"max":{"1min":17.847999999999999,"5min":17.847999999999999,"15min":17.847999999999999},"last":0.63800000000000001},{"interface":"front","average":{"1min":3.0670000000000002,"5min":1.6060000000000001,"15min":1.704},"min":{"1min":0.27900000000000003,"5min":0.27900000000000003,"15min":0.26200000000000001},"max":{"1min":32.529000000000003,"5min":32.529000000000003,"15min":32.529000000000003},"last":0.60699999999999998}]},{"osd":1,"last update":"Thu Jul 6 02:40:16 2023","interfaces":[{"interface":"back","average":{"1min":3.2639999999999998,"5min":1.661,"15min":1.9530000000000001},"min":{"1min":0.39800000000000002,"5min":0.26900000000000002,"15min":0.26400000000000001},"max":{"1min":11.667,"5min":11.667,"15min":26.927},"last":0.56699999999999995},{"interface":"front","average":{"1min":3.3290000000000002,"5min":1.7390000000000001,"15min":1.944},"min":{"1min":0.308,"5min":0.28000000000000003,"15min":0.27500000000000002},"max":{"1min":12.082000000000001,"5min":12.082000000000001,"15min":26.620999999999999},"last":0.66900000000000004}]},{"osd":2,"last update":"Thu Jul 6 02:40:30 2023","interfaces":[{"interface":"back","average":{"1min":4.2599999999999998,"5min":2.1309999999999998,"15min":1.847},"min":{"1min":0.34599999999999997,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":32.212000000000003,"5min":32.212000000000003,"15min":32.212000000000003},"last":0.55100000000000005},{"interface":"front","average":{"1min":4.1059999999999999,"5min":2.1579999999999999,"15min":2.258},"min":{"1min":0.35799999999999998,"5min":0.35399999999999998,"15min":0.29999999999999999},"max":{"1min":18.302,"5min":18.302,"15min":18.701000000000001},"last":0.65300000000000002}]},{"osd":3,"last update":"Thu Jul 6 02:40:16 2023","interfaces":[{"interface":"back","average":{"1min":2.746,"5min":1.984,"15min":2.0379999999999998},"min":{"1min":0.307,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":12.132,"5min":12.132,"15min":12.132},"last":0.61799999999999999},{"interface":"front","average":{"1min":3.4529999999999998,"5min":1.847,"15min":1.9370000000000001},"min":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.34699999999999998},"max":{"1min":18.472000000000001,"5min":18.472000000000001,"15min":18.472000000000001},"last":0.59699999999999998}]},{"osd":5,"last update":"Thu Jul 6 02:40:16 2023","interfaces":[{"interface":"back","average":{"1min":4.6159999999999997,"5min":1.837,"15min":1.6819999999999999},"min":{"1min":0.311,"5min":0.309,"15min":0.27400000000000002},"max":{"1min":46.088000000000001,"5min":46.088000000000001,"15min":46.088000000000001},"last":0.52100000000000002},{"interface":"front","average":{"1min":1.948,"5min":1.2549999999999999,"15min":1.4930000000000001},"min":{"1min":0.26800000000000002,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":21.468,"5min":21.468,"15min":21.468},"last":0.378}]},{"osd":6,"last update":"Thu Jul 6 02:40:16 2023","interfaces":[{"interface":"back","average":{"1min":2.4620000000000002,"5min":1.3009999999999999,"15min":1.274},"min":{"1min":0.30099999999999999,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":18.498000000000001,"5min":18.498000000000001,"15min":18.498000000000001},"last":0.42499999999999999},{"interface":"front","average":{"1min":1.8640000000000001,"5min":1.415,"15min":1.726},"min":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.35099999999999998},"max":{"1min":8.2309999999999999,"5min":8.2309999999999999,"15min":15.339},"last":0.46000000000000002}]},{"osd":7,"last update":"Thu Jul 6 02:40:16 2023","interfaces":[{"interface":"back","average":{"1min":9.0920000000000005,"5min":2.8130000000000002,"15min":2.0579999999999998},"min":{"1min":0.39400000000000002,"5min":0.37,"15min":0.36899999999999999},"max":{"1min":170.637,"5min":170.637,"15min":170.637},"last":0.53400000000000003},{"interface":"front","average":{"1min":9.891,"5min":2.907,"15min":1.903},"min":{"1min":0.375,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":170.33199999999999,"5min":170.33199999999999,"15min":170.33199999999999},"last":0.68400000000000005}]}]},{"osd":5,"up_from":13,"seq":55834580413,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1418640,"kb_used_data":456,"kb_used_omap":19336,"kb_used_meta":1398839,"kb_avail":92953200,"statfs":{"total":96636764160,"available":95184076800,"internally_reserved":0,"allocated":466944,"data_stored":196377,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":19800821,"internal_metadata":1432411403},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 6 02:39:44 2023","interfaces":[{"interface":"back","average":{"1min":1.3859999999999999,"5min":1.1319999999999999,"15min":1.159},"min":{"1min":0.27000000000000002,"5min":0.23100000000000001,"15min":0.23100000000000001},"max":{"1min":4.9189999999999996,"5min":6.5110000000000001,"15min":10.669},"last":0.70199999999999996},{"interface":"front","average":{"1min":2.4700000000000002,"5min":1.6679999999999999,"15min":1.5960000000000001},"min":{"1min":0.309,"5min":0.28100000000000003,"15min":0.26900000000000002},"max":{"1min":10.452999999999999,"5min":10.452999999999999,"15min":10.452999999999999},"last":0.71399999999999997}]},{"osd":1,"last update":"Thu Jul 6 02:39:44 2023","interfaces":[{"interface":"back","average":{"1min":2.0499999999999998,"5min":1.4830000000000001,"15min":1.5609999999999999},"min":{"1min":0.29699999999999999,"5min":0.28000000000000003,"15min":0.27600000000000002},"max":{"1min":8.3719999999999999,"5min":8.3719999999999999,"15min":8.3719999999999999},"last":0.72899999999999998},{"interface":"front","average":{"1min":2.2210000000000001,"5min":1.8799999999999999,"15min":1.671},"min":{"1min":0.36499999999999999,"5min":0.27600000000000002,"15min":0.26000000000000001},"max":{"1min":7.827,"5min":8.1120000000000001,"15min":10.724},"last":0.73899999999999999}]},{"osd":2,"last update":"Thu Jul 6 02:39:44 2023","interfaces":[{"interface":"back","average":{"1min":2.133,"5min":1.929,"15min":1.901},"min":{"1min":0.32900000000000001,"5min":0.31900000000000001,"15min":0.28799999999999998},"max":{"1min":6.1420000000000003,"5min":9.5739999999999998,"15min":9.5739999999999998},"last":0.65700000000000003},{"interface":"front","average":{"1min":2.0089999999999999,"5min":1.843,"15min":1.915},"min":{"1min":0.33600000000000002,"5min":0.33600000000000002,"15min":0.29199999999999998},"max":{"1min":4.7720000000000002,"5min":7.4039999999999999,"15min":10.209},"last":0.81699999999999995}]},{"osd":3,"last update":"Thu Jul 6 02:39:44 2023","interfaces":[{"interface":"back","average":{"1min":2.2120000000000002,"5min":1.8740000000000001,"15min":1.944},"min":{"1min":0.39400000000000002,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":7.5860000000000003,"5min":7.5860000000000003,"15min":11.222},"last":0.752},{"interface":"front","average":{"1min":1.925,"5min":2.0299999999999998,"15min":2.0289999999999999},"min":{"1min":0.36699999999999999,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":7.0499999999999998,"5min":7.0499999999999998,"15min":9.9700000000000006},"last":0.68899999999999995}]},{"osd":4,"last update":"Thu Jul 6 02:39:44 2023","interfaces":[{"interface":"back","average":{"1min":0.88900000000000001,"5min":1.165,"15min":1.298},"min":{"1min":0.33300000000000002,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":3.02,"5min":10.948,"15min":13.590999999999999},"last":0.56299999999999994},{"interface":"front","average":{"1min":1.155,"5min":1.3220000000000001,"15min":1.5860000000000001},"min":{"1min":0.38300000000000001,"5min":0.30399999999999999,"15min":0.28599999999999998},"max":{"1min":3.4750000000000001,"5min":6.7130000000000001,"15min":9.4410000000000007},"last":0.48799999999999999}]},{"osd":6,"last update":"Thu Jul 6 02:39:44 2023","interfaces":[{"interface":"back","average":{"1min":0.95899999999999996,"5min":1.3149999999999999,"15min":1.4570000000000001},"min":{"1min":0.33700000000000002,"5min":0.33500000000000002,"15min":0.316},"max":{"1min":2.8180000000000001,"5min":6.1539999999999999,"15min":15.113},"last":0.54300000000000004},{"interface":"front","average":{"1min":1.2370000000000001,"5min":1.2989999999999999,"15min":1.5249999999999999},"min":{"1min":0.41799999999999998,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":4.0620000000000003,"5min":10.906000000000001,"15min":11.699},"last":0.66800000000000004}]},{"osd":7,"last update":"Thu Jul 6 02:39:44 2023","interfaces":[{"interface":"back","average":{"1min":1.1160000000000001,"5min":1.49,"15min":1.7529999999999999},"min":{"1min":0.41199999999999998,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":3.6659999999999999,"5min":8.8499999999999996,"15min":11.294},"last":0.61399999999999999},{"interface":"front","average":{"1min":1.274,"5min":1.393,"15min":1.621},"min":{"1min":0.40600000000000003,"5min":0.36199999999999999,"15min":0.35399999999999998},"max":{"1min":3.8999999999999999,"5min":6.351,"15min":15.173},"last":0.629}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-07-06T02:40:49.633 DEBUG:teuthology.orchestra.run.smithi046:> sudo ceph --cluster ceph config set global mon_health_to_clog false 2023-07-06T02:40:49.769 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:49.766+0000 7f781b1a5700 1 Processor -- start 2023-07-06T02:40:49.769 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:49.766+0000 7f781b1a5700 1 -- start start 2023-07-06T02:40:49.771 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:49.767+0000 7f781b1a5700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f781415c2f0 0x7f78140cd2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T02:40:49.771 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:49.767+0000 7f781b1a5700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f78140b5ae0 0x7f78140b5f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T02:40:49.771 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:49.767+0000 7f781b1a5700 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f78140cd8c0 con 0x7f781415c6c0 2023-07-06T02:40:49.771 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:49.767+0000 7f781b1a5700 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f78140d0990 con 0x7f781415c2f0 2023-07-06T02:40:49.772 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:49.767+0000 7f781b1a5700 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f78140d0c70 con 0x7f78140b5ae0 2023-07-06T02:40:49.772 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:49.767+0000 7f7818f41700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f781415c2f0 0x7f78140cd2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T02:40:49.772 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:49.767+0000 7f7813fff700 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7f781415c6c0 0x7f781406c760 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:45650/0 (socket says 172.21.15.46:45650) 2023-07-06T02:40:49.772 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:49.767+0000 7f7813fff700 1 -- 172.21.15.46:0/2743373994 learned_addr learned my addr 172.21.15.46:0/2743373994 (peer_addr_for_me v1:172.21.15.46:0/0) 2023-07-06T02:40:49.772 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:49.767+0000 7f7819742700 1 --2- 172.21.15.46:0/2743373994 >> v2:172.21.15.73:3300/0 conn(0x7f78140b5ae0 0x7f78140b5f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T02:40:49.773 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:49.767+0000 7f7818f41700 1 -- 172.21.15.46:0/2743373994 >> v2:172.21.15.73:3300/0 conn(0x7f78140b5ae0 msgr2=0x7f78140b5f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T02:40:49.773 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:49.767+0000 7f7818f41700 1 --2- 172.21.15.46:0/2743373994 >> v2:172.21.15.73:3300/0 conn(0x7f78140b5ae0 0x7f78140b5f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T02:40:49.773 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:49.767+0000 7f7818f41700 1 -- 172.21.15.46:0/2743373994 >> v1:172.21.15.46:6789/0 conn(0x7f781415c6c0 legacy=0x7f781406c760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T02:40:49.773 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:49.768+0000 7f7818f41700 1 -- 172.21.15.46:0/2743373994 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f78140d0f50 con 0x7f781415c2f0 2023-07-06T02:40:49.773 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:49.767+0000 7f78137fe700 1 -- 172.21.15.46:0/2743373994 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 291152107 0 0) 0x7f78140cd8c0 con 0x7f781415c6c0 2023-07-06T02:40:49.774 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:49.768+0000 7f7818f41700 1 --2- 172.21.15.46:0/2743373994 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f781415c2f0 0x7f78140cd2e0 secure :-1 s=READY pgs=3294 cs=0 l=1 rev1=1 crypto rx=0x7f78140d3ca0 tx=0x7f7804009b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7aa653f2910b21a6 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T02:40:49.774 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:49.768+0000 7f78137fe700 1 -- 172.21.15.46:0/2743373994 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7804011830 con 0x7f781415c2f0 2023-07-06T02:40:49.774 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:49.768+0000 7f78137fe700 1 -- 172.21.15.46:0/2743373994 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7804011990 con 0x7f781415c2f0 2023-07-06T02:40:49.774 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:49.768+0000 7f78137fe700 1 -- 172.21.15.46:0/2743373994 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7804011d20 con 0x7f781415c2f0 2023-07-06T02:40:49.777 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:49.768+0000 7f781b1a5700 1 -- 172.21.15.46:0/2743373994 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f781415c2f0 msgr2=0x7f78140cd2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T02:40:49.777 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:49.768+0000 7f781b1a5700 1 --2- 172.21.15.46:0/2743373994 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f781415c2f0 0x7f78140cd2e0 secure :-1 s=READY pgs=3294 cs=0 l=1 rev1=1 crypto rx=0x7f78140d3ca0 tx=0x7f7804009b20 comp rx=0 tx=0).stop 2023-07-06T02:40:49.777 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:49.768+0000 7f781b1a5700 1 -- 172.21.15.46:0/2743373994 shutdown_connections 2023-07-06T02:40:49.777 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:49.768+0000 7f781b1a5700 1 --2- 172.21.15.46:0/2743373994 >> v2:172.21.15.73:3300/0 conn(0x7f78140b5ae0 0x7f78140b5f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T02:40:49.777 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:49.768+0000 7f781b1a5700 1 --2- 172.21.15.46:0/2743373994 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f781415c2f0 0x7f78140cd2e0 unknown :-1 s=CLOSED pgs=3294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T02:40:49.778 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:49.768+0000 7f781b1a5700 1 -- 172.21.15.46:0/2743373994 >> 172.21.15.46:0/2743373994 conn(0x7f781406afa0 msgr2=0x7f78140cf710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T02:40:49.778 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:49.769+0000 7f781b1a5700 1 -- 172.21.15.46:0/2743373994 shutdown_connections 2023-07-06T02:40:49.778 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:49.769+0000 7f781b1a5700 1 -- 172.21.15.46:0/2743373994 wait complete. 2023-07-06T02:40:49.778 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:49.770+0000 7f781b1a5700 1 Processor -- start 2023-07-06T02:40:49.778 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:49.770+0000 7f781b1a5700 1 -- start start 2023-07-06T02:40:49.779 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:49.770+0000 7f781b1a5700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f78140b5ae0 0x7f78141f5e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T02:40:49.779 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:49.771+0000 7f781b1a5700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f781415c2f0 0x7f781415f040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T02:40:49.779 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:49.771+0000 7f781b1a5700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f781415c6c0 0x7f78140b3af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T02:40:49.779 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:49.771+0000 7f781b1a5700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78141f2c60 con 0x7f781415c2f0 2023-07-06T02:40:49.779 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:49.771+0000 7f781b1a5700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78141f63a0 con 0x7f781415c6c0 2023-07-06T02:40:49.780 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:49.771+0000 7f781b1a5700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f78141f1fe0 con 0x7f78140b5ae0 2023-07-06T02:40:49.780 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:49.771+0000 7f7813fff700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f781415c2f0 0x7f781415f040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T02:40:49.780 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:49.771+0000 7f7813fff700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f781415c2f0 0x7f781415f040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:46386/0 (socket says 172.21.15.46:46386) 2023-07-06T02:40:49.780 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:49.771+0000 7f7813fff700 1 -- 172.21.15.46:0/960984126 learned_addr learned my addr 172.21.15.46:0/960984126 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-07-06T02:40:49.780 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:49.771+0000 7f7818f41700 1 --2- 172.21.15.46:0/960984126 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f78140b5ae0 0x7f78141f5e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T02:40:49.781 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:49.771+0000 7f7819742700 1 --2- 172.21.15.46:0/960984126 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f781415c6c0 0x7f78140b3af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T02:40:49.781 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:49.771+0000 7f7813fff700 1 -- 172.21.15.46:0/960984126 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f78140b5ae0 msgr2=0x7f78141f5e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T02:40:49.781 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:49.771+0000 7f7813fff700 1 --2- 172.21.15.46:0/960984126 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f78140b5ae0 0x7f78141f5e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T02:40:49.781 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:49.771+0000 7f7813fff700 1 -- 172.21.15.46:0/960984126 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f781415c6c0 msgr2=0x7f78140b3af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T02:40:49.781 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:49.771+0000 7f7813fff700 1 --2- 172.21.15.46:0/960984126 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f781415c6c0 0x7f78140b3af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T02:40:49.782 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:49.771+0000 7f7813fff700 1 -- 172.21.15.46:0/960984126 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f78040094a0 con 0x7f781415c2f0 2023-07-06T02:40:49.782 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:49.771+0000 7f7813fff700 1 --2- 172.21.15.46:0/960984126 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f781415c2f0 0x7f781415f040 secure :-1 s=READY pgs=3295 cs=0 l=1 rev1=1 crypto rx=0x7f780800c520 tx=0x7f780800c830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T02:40:49.782 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:49.771+0000 7f78117fa700 1 -- 172.21.15.46:0/960984126 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7808004c80 con 0x7f781415c2f0 2023-07-06T02:40:49.782 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:49.771+0000 7f78117fa700 1 -- 172.21.15.46:0/960984126 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7808004de0 con 0x7f781415c2f0 2023-07-06T02:40:49.782 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:49.771+0000 7f781b1a5700 1 -- 172.21.15.46:0/960984126 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f78141f22c0 con 0x7f781415c2f0 2023-07-06T02:40:49.782 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:49.771+0000 7f78117fa700 1 -- 172.21.15.46:0/960984126 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78080072d0 con 0x7f781415c2f0 2023-07-06T02:40:49.783 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:49.772+0000 7f781b1a5700 1 -- 172.21.15.46:0/960984126 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f78141f2880 con 0x7f781415c2f0 2023-07-06T02:40:49.783 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:49.772+0000 7f781b1a5700 1 -- 172.21.15.46:0/960984126 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f781404e1d0 con 0x7f781415c2f0 2023-07-06T02:40:49.783 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:49.773+0000 7f78117fa700 1 -- 172.21.15.46:0/960984126 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f7808007430 con 0x7f781415c2f0 2023-07-06T02:40:49.783 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:49.773+0000 7f78117fa700 1 --2- 172.21.15.46:0/960984126 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7f780006ace0 0x7f780006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T02:40:49.783 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:49.773+0000 7f78117fa700 1 -- 172.21.15.46:0/960984126 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 5296+0+0 (secure 0 0 0) 0x7f7808088c70 con 0x7f781415c2f0 2023-07-06T02:40:49.784 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:49.774+0000 7f7818f41700 1 --2- 172.21.15.46:0/960984126 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7f780006ace0 0x7f780006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T02:40:49.784 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:49.774+0000 7f7818f41700 1 --2- 172.21.15.46:0/960984126 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7f780006ace0 0x7f780006d190 secure :-1 s=READY pgs=755 cs=0 l=1 rev1=1 crypto rx=0x7f78040090b0 tx=0x7f7804008030 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T02:40:49.784 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:49.778+0000 7f78117fa700 1 -- 172.21.15.46:0/960984126 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f78080540b0 con 0x7f781415c2f0 2023-07-06T02:40:49.988 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:49.985+0000 7f781b1a5700 1 -- 172.21.15.46:0/960984126 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command([{prefix=config set, name=mon_health_to_clog}] v 0) v1 -- 0x7f78140ce0f0 con 0x7f781415c2f0 2023-07-06T02:40:49.992 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:49.989+0000 7f78117fa700 1 -- 172.21.15.46:0/960984126 <== mon.0 v2:172.21.15.46:3300/0 7 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f78080540b0 con 0x7f781415c2f0 2023-07-06T02:40:49.992 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:49.989+0000 7f78117fa700 1 -- 172.21.15.46:0/960984126 <== mon.0 v2:172.21.15.46:3300/0 8 ==== mon_command_ack([{prefix=config set, name=mon_health_to_clog}]=0 v12)=0 v12) v1 ==== 123+0+0 (secure 0 0 0) 0x7f78080576d0 con 0x7f781415c2f0 2023-07-06T02:40:49.995 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:49.992+0000 7f781b1a5700 1 -- 172.21.15.46:0/960984126 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7f780006ace0 msgr2=0x7f780006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T02:40:49.995 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:49.992+0000 7f781b1a5700 1 --2- 172.21.15.46:0/960984126 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7f780006ace0 0x7f780006d190 secure :-1 s=READY pgs=755 cs=0 l=1 rev1=1 crypto rx=0x7f78040090b0 tx=0x7f7804008030 comp rx=0 tx=0).stop 2023-07-06T02:40:49.996 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:49.992+0000 7f781b1a5700 1 -- 172.21.15.46:0/960984126 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f781415c2f0 msgr2=0x7f781415f040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T02:40:49.996 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:49.992+0000 7f781b1a5700 1 --2- 172.21.15.46:0/960984126 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f781415c2f0 0x7f781415f040 secure :-1 s=READY pgs=3295 cs=0 l=1 rev1=1 crypto rx=0x7f780800c520 tx=0x7f780800c830 comp rx=0 tx=0).stop 2023-07-06T02:40:49.996 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:49.992+0000 7f781b1a5700 1 -- 172.21.15.46:0/960984126 shutdown_connections 2023-07-06T02:40:49.996 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:49.992+0000 7f781b1a5700 1 --2- 172.21.15.46:0/960984126 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7f780006ace0 0x7f780006d190 unknown :-1 s=CLOSED pgs=755 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T02:40:49.997 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:49.992+0000 7f781b1a5700 1 --2- 172.21.15.46:0/960984126 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f781415c6c0 0x7f78140b3af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T02:40:49.997 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:49.992+0000 7f781b1a5700 1 --2- 172.21.15.46:0/960984126 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f78140b5ae0 0x7f78141f5e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T02:40:49.997 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:49.992+0000 7f781b1a5700 1 --2- 172.21.15.46:0/960984126 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f781415c2f0 0x7f781415f040 unknown :-1 s=CLOSED pgs=3295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T02:40:49.997 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:49.992+0000 7f781b1a5700 1 -- 172.21.15.46:0/960984126 >> 172.21.15.46:0/960984126 conn(0x7f781406afa0 msgr2=0x7f78140d21f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T02:40:49.997 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:49.992+0000 7f781b1a5700 1 -- 172.21.15.46:0/960984126 shutdown_connections 2023-07-06T02:40:49.998 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:49.992+0000 7f781b1a5700 1 -- 172.21.15.46:0/960984126 wait complete. 2023-07-06T02:40:50.009 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-07-06T02:40:50.010 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-06T02:40:50.146 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:50.143+0000 7f9d682f1700 1 Processor -- start 2023-07-06T02:40:50.146 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:50.143+0000 7f9d682f1700 1 -- start start 2023-07-06T02:40:50.148 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:50.144+0000 7f9d682f1700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f9d6015c2f0 0x7f9d600cd2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T02:40:50.148 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:50.144+0000 7f9d682f1700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f9d6015c6c0 0x7f9d6006c760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T02:40:50.148 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:50.144+0000 7f9d682f1700 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9d600cd8c0 con 0x7f9d600b5ae0 2023-07-06T02:40:50.148 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:50.144+0000 7f9d682f1700 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9d600d0990 con 0x7f9d6015c2f0 2023-07-06T02:40:50.149 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:50.144+0000 7f9d682f1700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9d600d0c70 con 0x7f9d6015c6c0 2023-07-06T02:40:50.149 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:50.144+0000 7f9d6688e700 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7f9d600b5ae0 0x7f9d600d1450 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:45664/0 (socket says 172.21.15.46:45664) 2023-07-06T02:40:50.149 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:50.144+0000 7f9d6688e700 1 -- 172.21.15.46:0/1576391084 learned_addr learned my addr 172.21.15.46:0/1576391084 (peer_addr_for_me v1:172.21.15.46:0/0) 2023-07-06T02:40:50.149 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:50.144+0000 7f9d6608d700 1 --2- 172.21.15.46:0/1576391084 >> v2:172.21.15.73:3300/0 conn(0x7f9d6015c2f0 0x7f9d600cd2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T02:40:50.149 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:50.144+0000 7f9d6588c700 1 --2- 172.21.15.46:0/1576391084 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f9d6015c6c0 0x7f9d6006c760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T02:40:50.150 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:50.144+0000 7f9d6508b700 1 -- 172.21.15.46:0/1576391084 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3503777592 0 0) 0x7f9d600cd8c0 con 0x7f9d600b5ae0 2023-07-06T02:40:50.150 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:50.144+0000 7f9d6508b700 1 -- 172.21.15.46:0/1576391084 --> v1:172.21.15.46:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9d4c0035b0 con 0x7f9d600b5ae0 2023-07-06T02:40:50.150 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:50.144+0000 7f9d6588c700 1 -- 172.21.15.46:0/1576391084 >> v2:172.21.15.73:3300/0 conn(0x7f9d6015c2f0 msgr2=0x7f9d600cd2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T02:40:50.150 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:50.144+0000 7f9d6588c700 1 --2- 172.21.15.46:0/1576391084 >> v2:172.21.15.73:3300/0 conn(0x7f9d6015c2f0 0x7f9d600cd2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T02:40:50.150 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:50.144+0000 7f9d6588c700 1 -- 172.21.15.46:0/1576391084 >> v1:172.21.15.46:6789/0 conn(0x7f9d600b5ae0 legacy=0x7f9d600d1450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T02:40:50.151 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:50.144+0000 7f9d6588c700 1 -- 172.21.15.46:0/1576391084 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9d600d0f50 con 0x7f9d6015c6c0 2023-07-06T02:40:50.151 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:50.145+0000 7f9d6608d700 1 --2- 172.21.15.46:0/1576391084 >> v2:172.21.15.73:3300/0 conn(0x7f9d6015c2f0 0x7f9d600cd2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-06T02:40:50.151 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:50.145+0000 7f9d6588c700 1 --2- 172.21.15.46:0/1576391084 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f9d6015c6c0 0x7f9d6006c760 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f9d5c009840 tx=0x7f9d5c009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=26070aa8987df883 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T02:40:50.151 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:50.145+0000 7f9d6508b700 1 -- 172.21.15.46:0/1576391084 <== mon.2 v2:172.21.15.73:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d5c011830 con 0x7f9d6015c6c0 2023-07-06T02:40:50.151 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:50.145+0000 7f9d6508b700 1 -- 172.21.15.46:0/1576391084 <== mon.2 v2:172.21.15.73:3301/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f9d5c011990 con 0x7f9d6015c6c0 2023-07-06T02:40:50.152 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:50.145+0000 7f9d6508b700 1 -- 172.21.15.46:0/1576391084 <== mon.2 v2:172.21.15.73:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d5c011d40 con 0x7f9d6015c6c0 2023-07-06T02:40:50.154 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:50.145+0000 7f9d682f1700 1 -- 172.21.15.46:0/1576391084 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f9d6015c6c0 msgr2=0x7f9d6006c760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T02:40:50.154 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:50.145+0000 7f9d682f1700 1 --2- 172.21.15.46:0/1576391084 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f9d6015c6c0 0x7f9d6006c760 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f9d5c009840 tx=0x7f9d5c009b50 comp rx=0 tx=0).stop 2023-07-06T02:40:50.154 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:50.146+0000 7f9d682f1700 1 -- 172.21.15.46:0/1576391084 shutdown_connections 2023-07-06T02:40:50.155 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:50.146+0000 7f9d682f1700 1 --2- 172.21.15.46:0/1576391084 >> v2:172.21.15.73:3300/0 conn(0x7f9d6015c2f0 0x7f9d600cd2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T02:40:50.155 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:50.146+0000 7f9d682f1700 1 --2- 172.21.15.46:0/1576391084 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f9d6015c6c0 0x7f9d6006c760 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T02:40:50.155 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:50.146+0000 7f9d682f1700 1 -- 172.21.15.46:0/1576391084 >> 172.21.15.46:0/1576391084 conn(0x7f9d6006afa0 msgr2=0x7f9d600cf710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T02:40:50.155 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:50.146+0000 7f9d682f1700 1 -- 172.21.15.46:0/1576391084 shutdown_connections 2023-07-06T02:40:50.155 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:50.146+0000 7f9d682f1700 1 -- 172.21.15.46:0/1576391084 wait complete. 2023-07-06T02:40:50.156 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:50.147+0000 7f9d682f1700 1 Processor -- start 2023-07-06T02:40:50.156 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:50.147+0000 7f9d682f1700 1 -- start start 2023-07-06T02:40:50.156 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:50.148+0000 7f9d682f1700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9d600b5ae0 0x7f9d600c9700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T02:40:50.156 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:50.148+0000 7f9d682f1700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f9d6015c2f0 0x7f9d601e84d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T02:40:50.156 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:50.148+0000 7f9d682f1700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9d6015c6c0 0x7f9d601e6730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T02:40:50.157 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:50.148+0000 7f9d682f1700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d601e8d40 con 0x7f9d600b5ae0 2023-07-06T02:40:50.157 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:50.148+0000 7f9d682f1700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d601e9020 con 0x7f9d6015c6c0 2023-07-06T02:40:50.157 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:50.148+0000 7f9d682f1700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9d601e9300 con 0x7f9d6015c2f0 2023-07-06T02:40:50.157 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:50.148+0000 7f9d6608d700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9d600b5ae0 0x7f9d600c9700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T02:40:50.157 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:50.148+0000 7f9d6608d700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9d600b5ae0 0x7f9d600c9700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:46398/0 (socket says 172.21.15.46:46398) 2023-07-06T02:40:50.158 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:50.148+0000 7f9d6608d700 1 -- 172.21.15.46:0/2904950907 learned_addr learned my addr 172.21.15.46:0/2904950907 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-07-06T02:40:50.158 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:50.148+0000 7f9d6688e700 1 --2- 172.21.15.46:0/2904950907 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9d6015c6c0 0x7f9d601e6730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T02:40:50.158 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:50.148+0000 7f9d6588c700 1 --2- 172.21.15.46:0/2904950907 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f9d6015c2f0 0x7f9d601e84d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T02:40:50.158 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:50.148+0000 7f9d6608d700 1 -- 172.21.15.46:0/2904950907 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f9d6015c2f0 msgr2=0x7f9d601e84d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T02:40:50.158 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:50.148+0000 7f9d6608d700 1 --2- 172.21.15.46:0/2904950907 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f9d6015c2f0 0x7f9d601e84d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T02:40:50.159 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:50.148+0000 7f9d6608d700 1 -- 172.21.15.46:0/2904950907 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9d6015c6c0 msgr2=0x7f9d601e6730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T02:40:50.159 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:50.148+0000 7f9d6608d700 1 --2- 172.21.15.46:0/2904950907 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9d6015c6c0 0x7f9d601e6730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T02:40:50.159 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:50.148+0000 7f9d6608d700 1 -- 172.21.15.46:0/2904950907 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9d500094a0 con 0x7f9d600b5ae0 2023-07-06T02:40:50.159 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:50.148+0000 7f9d6608d700 1 --2- 172.21.15.46:0/2904950907 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9d600b5ae0 0x7f9d600c9700 secure :-1 s=READY pgs=3297 cs=0 l=1 rev1=1 crypto rx=0x7f9d5000ebe0 tx=0x7f9d5000eef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T02:40:50.159 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:50.149+0000 7f9d56ffd700 1 -- 172.21.15.46:0/2904950907 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d5000c850 con 0x7f9d600b5ae0 2023-07-06T02:40:50.160 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:50.149+0000 7f9d56ffd700 1 -- 172.21.15.46:0/2904950907 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f9d5000c9b0 con 0x7f9d600b5ae0 2023-07-06T02:40:50.160 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:50.149+0000 7f9d682f1700 1 -- 172.21.15.46:0/2904950907 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9d5c0094a0 con 0x7f9d600b5ae0 2023-07-06T02:40:50.160 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:50.149+0000 7f9d56ffd700 1 -- 172.21.15.46:0/2904950907 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d5000cd60 con 0x7f9d600b5ae0 2023-07-06T02:40:50.160 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:50.149+0000 7f9d682f1700 1 -- 172.21.15.46:0/2904950907 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9d601e98c0 con 0x7f9d600b5ae0 2023-07-06T02:40:50.160 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:50.150+0000 7f9d682f1700 1 -- 172.21.15.46:0/2904950907 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9d6004e1d0 con 0x7f9d600b5ae0 2023-07-06T02:40:50.161 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:50.150+0000 7f9d56ffd700 1 -- 172.21.15.46:0/2904950907 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f9d50013470 con 0x7f9d600b5ae0 2023-07-06T02:40:50.161 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:50.151+0000 7f9d56ffd700 1 --2- 172.21.15.46:0/2904950907 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7f9d4406ace0 0x7f9d4406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T02:40:50.161 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:50.151+0000 7f9d56ffd700 1 -- 172.21.15.46:0/2904950907 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 5296+0+0 (secure 0 0 0) 0x7f9d500892f0 con 0x7f9d600b5ae0 2023-07-06T02:40:50.161 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:50.151+0000 7f9d6588c700 1 --2- 172.21.15.46:0/2904950907 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7f9d4406ace0 0x7f9d4406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T02:40:50.161 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:50.151+0000 7f9d6588c700 1 --2- 172.21.15.46:0/2904950907 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7f9d4406ace0 0x7f9d4406d190 secure :-1 s=READY pgs=756 cs=0 l=1 rev1=1 crypto rx=0x7f9d6015cb00 tx=0x7f9d5c008030 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T02:40:50.164 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:50.155+0000 7f9d56ffd700 1 -- 172.21.15.46:0/2904950907 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f9d50054620 con 0x7f9d600b5ae0 2023-07-06T02:40:50.410 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:50.407+0000 7f9d682f1700 1 -- 172.21.15.46:0/2904950907 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f9d600b89e0 con 0x7f9d600b5ae0 2023-07-06T02:40:50.411 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:50.408+0000 7f9d56ffd700 1 -- 172.21.15.46:0/2904950907 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 17 v17) v1 ==== 94+0+3526 (secure 0 0 0) 0x7f9d50017de0 con 0x7f9d600b5ae0 2023-07-06T02:40:50.411 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-06T02:40:50.412 INFO:teuthology.orchestra.run.smithi046.stdout:{"epoch":17,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4823,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.73:6837/1783526483","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6835","nonce":1783526483},{"type":"v1","addr":"172.21.15.73:6837","nonce":1783526483}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":4826,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.46:6834/1224451753","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6832","nonce":1224451753},{"type":"v1","addr":"172.21.15.46:6834","nonce":1224451753}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":4829,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.46:6835/549881285","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6833","nonce":549881285},{"type":"v1","addr":"172.21.15.46:6835","nonce":549881285}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":5012,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.73:6836/3616191203","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6834","nonce":3616191203},{"type":"v1","addr":"172.21.15.73:6836","nonce":3616191203}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":16}],"filesystems":[]} 2023-07-06T02:40:50.413 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:50.410+0000 7f9d682f1700 1 -- 172.21.15.46:0/2904950907 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7f9d4406ace0 msgr2=0x7f9d4406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T02:40:50.413 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:50.410+0000 7f9d682f1700 1 --2- 172.21.15.46:0/2904950907 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7f9d4406ace0 0x7f9d4406d190 secure :-1 s=READY pgs=756 cs=0 l=1 rev1=1 crypto rx=0x7f9d6015cb00 tx=0x7f9d5c008030 comp rx=0 tx=0).stop 2023-07-06T02:40:50.413 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:50.410+0000 7f9d682f1700 1 -- 172.21.15.46:0/2904950907 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9d600b5ae0 msgr2=0x7f9d600c9700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T02:40:50.414 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:50.410+0000 7f9d682f1700 1 --2- 172.21.15.46:0/2904950907 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9d600b5ae0 0x7f9d600c9700 secure :-1 s=READY pgs=3297 cs=0 l=1 rev1=1 crypto rx=0x7f9d5000ebe0 tx=0x7f9d5000eef0 comp rx=0 tx=0).stop 2023-07-06T02:40:50.414 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:50.410+0000 7f9d682f1700 1 -- 172.21.15.46:0/2904950907 shutdown_connections 2023-07-06T02:40:50.414 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:50.410+0000 7f9d682f1700 1 --2- 172.21.15.46:0/2904950907 >> [v2:172.21.15.73:6832/3033361733,v1:172.21.15.73:6833/3033361733] conn(0x7f9d4406ace0 0x7f9d4406d190 unknown :-1 s=CLOSED pgs=756 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T02:40:50.414 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:50.410+0000 7f9d682f1700 1 --2- 172.21.15.46:0/2904950907 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9d6015c6c0 0x7f9d601e6730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T02:40:50.414 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:50.410+0000 7f9d682f1700 1 --2- 172.21.15.46:0/2904950907 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9d600b5ae0 0x7f9d600c9700 unknown :-1 s=CLOSED pgs=3297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T02:40:50.415 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:50.410+0000 7f9d682f1700 1 --2- 172.21.15.46:0/2904950907 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f9d6015c2f0 0x7f9d601e84d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T02:40:50.415 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:50.410+0000 7f9d682f1700 1 -- 172.21.15.46:0/2904950907 >> 172.21.15.46:0/2904950907 conn(0x7f9d6006afa0 msgr2=0x7f9d600d1450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T02:40:50.415 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:50.410+0000 7f9d682f1700 1 -- 172.21.15.46:0/2904950907 shutdown_connections 2023-07-06T02:40:50.415 INFO:teuthology.orchestra.run.smithi046.stderr:2023-07-06T02:40:50.410+0000 7f9d682f1700 1 -- 172.21.15.46:0/2904950907 wait complete. 2023-07-06T02:40:50.416 INFO:teuthology.orchestra.run.smithi046.stderr:dumped fsmap epoch 17 2023-07-06T02:40:50.427 DEBUG:tasks.cephfs.filesystem:already dead... 2023-07-06T02:40:50.427 INFO:teuthology.misc:Shutting down mds daemons... 2023-07-06T02:40:50.428 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-07-06T02:40:50.428 INFO:teuthology.orchestra.run:waiting for 300 2023-07-06T02:40:50.438 INFO:tasks.ceph.mds.a:Stopped 2023-07-06T02:40:50.438 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-07-06T02:40:50.439 INFO:teuthology.orchestra.run:waiting for 300 2023-07-06T02:40:50.488 INFO:tasks.ceph.mds.c:Stopped 2023-07-06T02:40:50.489 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-07-06T02:40:50.489 INFO:teuthology.orchestra.run:waiting for 300 2023-07-06T02:40:50.500 INFO:tasks.ceph.mds.b:Stopped 2023-07-06T02:40:50.501 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-07-06T02:40:50.501 INFO:teuthology.orchestra.run:waiting for 300 2023-07-06T02:40:50.552 INFO:tasks.ceph.mds.d:Stopped 2023-07-06T02:40:50.552 INFO:teuthology.misc:Shutting down osd daemons... 2023-07-06T02:40:50.553 DEBUG:tasks.ceph.osd.0:waiting for process to exit 2023-07-06T02:40:50.553 INFO:teuthology.orchestra.run:waiting for 300 2023-07-06T02:40:50.653 INFO:tasks.ceph.osd.0:Stopped 2023-07-06T02:40:50.654 DEBUG:tasks.ceph.osd.1:waiting for process to exit 2023-07-06T02:40:50.654 INFO:teuthology.orchestra.run:waiting for 300 2023-07-06T02:40:50.741 INFO:tasks.ceph.osd.1:Stopped 2023-07-06T02:40:50.742 DEBUG:tasks.ceph.osd.2:waiting for process to exit 2023-07-06T02:40:50.742 INFO:teuthology.orchestra.run:waiting for 300 2023-07-06T02:40:50.842 INFO:tasks.ceph.osd.2:Stopped 2023-07-06T02:40:50.843 DEBUG:tasks.ceph.osd.3:waiting for process to exit 2023-07-06T02:40:50.843 INFO:teuthology.orchestra.run:waiting for 300 2023-07-06T02:40:50.934 INFO:tasks.ceph.osd.3:Stopped 2023-07-06T02:40:50.934 DEBUG:tasks.ceph.osd.4:waiting for process to exit 2023-07-06T02:40:50.935 INFO:teuthology.orchestra.run:waiting for 300 2023-07-06T02:40:51.027 INFO:tasks.ceph.osd.4:Stopped 2023-07-06T02:40:51.027 DEBUG:tasks.ceph.osd.5:waiting for process to exit 2023-07-06T02:40:51.028 INFO:teuthology.orchestra.run:waiting for 300 2023-07-06T02:40:55.000 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~0s 2023-07-06T02:40:57.129 INFO:tasks.ceph.osd.5:Stopped 2023-07-06T02:40:57.130 DEBUG:tasks.ceph.osd.6:waiting for process to exit 2023-07-06T02:40:57.130 INFO:teuthology.orchestra.run:waiting for 300 2023-07-06T02:40:57.203 INFO:tasks.ceph.osd.6:Stopped 2023-07-06T02:40:57.233 DEBUG:tasks.ceph.osd.7:waiting for process to exit 2023-07-06T02:40:57.233 INFO:teuthology.orchestra.run:waiting for 300 2023-07-06T02:41:00.504 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.7 is failed for ~0s 2023-07-06T02:41:00.504 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 has been restored 2023-07-06T02:41:03.335 INFO:tasks.ceph.osd.7:Stopped 2023-07-06T02:41:03.336 INFO:teuthology.misc:Shutting down mgr daemons... 2023-07-06T02:41:03.336 DEBUG:tasks.ceph.mgr.y:waiting for process to exit 2023-07-06T02:41:03.337 INFO:teuthology.orchestra.run:waiting for 300 2023-07-06T02:41:03.368 INFO:tasks.ceph.mgr.y:Stopped 2023-07-06T02:41:03.369 DEBUG:tasks.ceph.mgr.x:waiting for process to exit 2023-07-06T02:41:03.369 INFO:teuthology.orchestra.run:waiting for 300 2023-07-06T02:41:03.399 INFO:tasks.ceph.mgr.x:Stopped 2023-07-06T02:41:03.399 INFO:teuthology.misc:Shutting down mon daemons... 2023-07-06T02:41:03.399 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2023-07-06T02:41:03.400 INFO:teuthology.orchestra.run:waiting for 300 2023-07-06T02:41:03.446 INFO:tasks.ceph.mon.a:Stopped 2023-07-06T02:41:03.446 DEBUG:tasks.ceph.mon.b:waiting for process to exit 2023-07-06T02:41:03.447 INFO:teuthology.orchestra.run:waiting for 300 2023-07-06T02:41:03.470 INFO:tasks.ceph.mon.b:Stopped 2023-07-06T02:41:03.470 DEBUG:tasks.ceph.mon.c:waiting for process to exit 2023-07-06T02:41:03.471 INFO:teuthology.orchestra.run:waiting for 300 2023-07-06T02:41:03.534 INFO:tasks.ceph.mon.c:Stopped 2023-07-06T02:41:03.535 INFO:tasks.ceph:Checking cluster log for badness... 2023-07-06T02:41:03.535 DEBUG:teuthology.orchestra.run.smithi046:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v 'overall HEALTH_' | egrep -v '\(FS_DEGRADED\)' | egrep -v '\(MDS_FAILED\)' | egrep -v '\(MDS_DEGRADED\)' | egrep -v '\(FS_WITH_FAILED_MDS\)' | egrep -v '\(MDS_DAMAGE\)' | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v '\(FS_INLINE_DATA_DEPRECATED\)' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | head -n 1 2023-07-06T02:41:03.657 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-0 on ubuntu@smithi046.front.sepia.ceph.com 2023-07-06T02:41:03.658 DEBUG:teuthology.orchestra.run.smithi046:> sync && sudo umount -f /var/lib/ceph/osd/ceph-0 2023-07-06T02:41:04.030 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-1 on ubuntu@smithi046.front.sepia.ceph.com 2023-07-06T02:41:04.030 DEBUG:teuthology.orchestra.run.smithi046:> sync && sudo umount -f /var/lib/ceph/osd/ceph-1 2023-07-06T02:41:04.173 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-2 on ubuntu@smithi046.front.sepia.ceph.com 2023-07-06T02:41:04.174 DEBUG:teuthology.orchestra.run.smithi046:> sync && sudo umount -f /var/lib/ceph/osd/ceph-2 2023-07-06T02:41:04.308 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-3 on ubuntu@smithi046.front.sepia.ceph.com 2023-07-06T02:41:04.309 DEBUG:teuthology.orchestra.run.smithi046:> sync && sudo umount -f /var/lib/ceph/osd/ceph-3 2023-07-06T02:41:04.480 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-4 on ubuntu@smithi073.front.sepia.ceph.com 2023-07-06T02:41:04.481 DEBUG:teuthology.orchestra.run.smithi073:> sync && sudo umount -f /var/lib/ceph/osd/ceph-4 2023-07-06T02:41:04.748 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-5 on ubuntu@smithi073.front.sepia.ceph.com 2023-07-06T02:41:04.749 DEBUG:teuthology.orchestra.run.smithi073:> sync && sudo umount -f /var/lib/ceph/osd/ceph-5 2023-07-06T02:41:04.874 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-6 on ubuntu@smithi073.front.sepia.ceph.com 2023-07-06T02:41:04.875 DEBUG:teuthology.orchestra.run.smithi073:> sync && sudo umount -f /var/lib/ceph/osd/ceph-6 2023-07-06T02:41:05.036 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-7 on ubuntu@smithi073.front.sepia.ceph.com 2023-07-06T02:41:05.037 DEBUG:teuthology.orchestra.run.smithi073:> sync && sudo umount -f /var/lib/ceph/osd/ceph-7 2023-07-06T02:41:05.183 INFO:tasks.ceph:Archiving mon data... 2023-07-06T02:41:05.184 DEBUG:teuthology.misc:Transferring archived files from smithi046:/var/lib/ceph/mon/ceph-a to /home/teuthworker/archive/rishabh-2023-07-05_18:32:52-fs-wip-rishabh-CephManager-in-CephFSTestCase-testing-default-smithi/7327386/data/mon.a.tgz 2023-07-06T02:41:05.185 DEBUG:teuthology.orchestra.run.smithi046:> mktemp 2023-07-06T02:41:05.207 INFO:teuthology.orchestra.run.smithi046.stdout:/tmp/tmp.rkQPYuEo4d 2023-07-06T02:41:05.208 DEBUG:teuthology.orchestra.run.smithi046:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-a -- . > /tmp/tmp.rkQPYuEo4d 2023-07-06T02:41:05.383 DEBUG:teuthology.orchestra.run.smithi046:> sudo chmod 0666 /tmp/tmp.rkQPYuEo4d 2023-07-06T02:41:05.502 DEBUG:teuthology.orchestra.remote:smithi046:/tmp/tmp.rkQPYuEo4d is 607KB 2023-07-06T02:41:05.505 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.7 has been restored 2023-07-06T02:41:05.599 DEBUG:teuthology.orchestra.run.smithi046:> rm -fr /tmp/tmp.rkQPYuEo4d 2023-07-06T02:41:05.620 DEBUG:teuthology.misc:Transferring archived files from smithi073:/var/lib/ceph/mon/ceph-b to /home/teuthworker/archive/rishabh-2023-07-05_18:32:52-fs-wip-rishabh-CephManager-in-CephFSTestCase-testing-default-smithi/7327386/data/mon.b.tgz 2023-07-06T02:41:05.621 DEBUG:teuthology.orchestra.run.smithi073:> mktemp 2023-07-06T02:41:05.654 INFO:teuthology.orchestra.run.smithi073.stdout:/tmp/tmp.yCR08AsNAh 2023-07-06T02:41:05.655 DEBUG:teuthology.orchestra.run.smithi073:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-b -- . > /tmp/tmp.yCR08AsNAh 2023-07-06T02:41:05.838 DEBUG:teuthology.orchestra.run.smithi073:> sudo chmod 0666 /tmp/tmp.yCR08AsNAh 2023-07-06T02:41:05.955 DEBUG:teuthology.orchestra.remote:smithi073:/tmp/tmp.yCR08AsNAh is 608KB 2023-07-06T02:41:06.052 DEBUG:teuthology.orchestra.run.smithi073:> rm -fr /tmp/tmp.yCR08AsNAh 2023-07-06T02:41:06.085 DEBUG:teuthology.misc:Transferring archived files from smithi073:/var/lib/ceph/mon/ceph-c to /home/teuthworker/archive/rishabh-2023-07-05_18:32:52-fs-wip-rishabh-CephManager-in-CephFSTestCase-testing-default-smithi/7327386/data/mon.c.tgz 2023-07-06T02:41:06.085 DEBUG:teuthology.orchestra.run.smithi073:> mktemp 2023-07-06T02:41:06.140 INFO:teuthology.orchestra.run.smithi073.stdout:/tmp/tmp.3NwfdWgvgY 2023-07-06T02:41:06.141 DEBUG:teuthology.orchestra.run.smithi073:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-c -- . > /tmp/tmp.3NwfdWgvgY 2023-07-06T02:41:06.293 DEBUG:teuthology.orchestra.run.smithi073:> sudo chmod 0666 /tmp/tmp.3NwfdWgvgY 2023-07-06T02:41:06.378 DEBUG:teuthology.orchestra.remote:smithi073:/tmp/tmp.3NwfdWgvgY is 608KB 2023-07-06T02:41:06.448 DEBUG:teuthology.orchestra.run.smithi073:> rm -fr /tmp/tmp.3NwfdWgvgY 2023-07-06T02:41:06.464 INFO:tasks.ceph:Cleaning ceph cluster... 2023-07-06T02:41:06.465 DEBUG:teuthology.orchestra.run.smithi046:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2023-07-06T02:41:06.467 DEBUG:teuthology.orchestra.run.smithi073:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2023-07-06T02:41:06.559 INFO:tasks.ceph:Checking for errors in any valgrind logs... 2023-07-06T02:41:06.560 DEBUG:teuthology.orchestra.run.smithi046:> sudo zgrep '' /var/log/ceph/valgrind/* /dev/null | sort | uniq 2023-07-06T02:41:06.562 DEBUG:teuthology.orchestra.run.smithi073:> sudo zgrep '' /var/log/ceph/valgrind/* /dev/null | sort | uniq 2023-07-06T02:41:06.611 INFO:teuthology.orchestra.run.smithi046.stderr:gzip: /var/log/ceph/valgrind/*.gz: No such file or directory 2023-07-06T02:41:06.613 INFO:teuthology.orchestra.run.smithi073.stderr:gzip: /var/log/ceph/valgrind/*.gz: No such file or directory 2023-07-06T02:41:06.619 INFO:tasks.ceph:Archiving crash dumps... 2023-07-06T02:41:06.620 DEBUG:teuthology.misc:Transferring archived files from smithi046:/var/lib/ceph/crash to /home/teuthworker/archive/rishabh-2023-07-05_18:32:52-fs-wip-rishabh-CephManager-in-CephFSTestCase-testing-default-smithi/7327386/remote/smithi046/crash 2023-07-06T02:41:06.621 DEBUG:teuthology.orchestra.run.smithi046:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2023-07-06T02:41:06.654 DEBUG:teuthology.misc:Transferring archived files from smithi073:/var/lib/ceph/crash to /home/teuthworker/archive/rishabh-2023-07-05_18:32:52-fs-wip-rishabh-CephManager-in-CephFSTestCase-testing-default-smithi/7327386/remote/smithi073/crash 2023-07-06T02:41:06.655 DEBUG:teuthology.orchestra.run.smithi073:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2023-07-06T02:41:06.681 INFO:tasks.ceph:Shutting down logrotate 2023-07-06T02:41:06.682 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-06T02:41:06.699 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-06T02:41:06.775 DEBUG:teuthology.orchestra.run.smithi046:> sudo rm /etc/logrotate.d/ceph-test.conf 2023-07-06T02:41:06.812 DEBUG:teuthology.orchestra.run.smithi073:> sudo rm /etc/logrotate.d/ceph-test.conf 2023-07-06T02:41:06.853 INFO:tasks.ceph:Compressing logs... 2023-07-06T02:41:06.854 DEBUG:teuthology.orchestra.run.smithi046:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2023-07-06T02:41:06.856 DEBUG:teuthology.orchestra.run.smithi073:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2023-07-06T02:41:06.901 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.248494.log 2023-07-06T02:41:06.903 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.653390.log 2023-07-06T02:41:06.903 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.248494.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.292738.log 2023-07-06T02:41:06.903 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.248494.log.gz 2023-07-06T02:41:06.904 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.653390.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.653390.log.gz 2023-07-06T02:41:06.904 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.931963.log 2023-07-06T02:41:06.904 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.292738.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.756157.log 2023-07-06T02:41:06.904 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.292738.log.gz 2023-07-06T02:41:06.905 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.931963.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.370436.log 2023-07-06T02:41:06.906 INFO:teuthology.orchestra.run.smithi046.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.931963.log.gz 2023-07-06T02:41:06.906 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.756157.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.327479.log 2023-07-06T02:41:06.906 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.756157.log.gz 2023-07-06T02:41:06.906 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.684730.log 2023-07-06T02:41:06.907 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.170825.log 2023-07-06T02:41:06.907 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.200659.log 2023-07-06T02:41:06.907 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.289887.log 2023-07-06T02:41:06.907 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.795536.log 2023-07-06T02:41:06.907 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.109824.log 2023-07-06T02:41:06.908 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.626709.log 2023-07-06T02:41:06.908 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.448175.log 2023-07-06T02:41:06.909 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.404023.log 2023-07-06T02:41:06.909 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.342747.log 2023-07-06T02:41:06.910 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.770076.log 2023-07-06T02:41:06.910 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.640212.log 2023-07-06T02:41:06.910 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.249817.log 2023-07-06T02:41:06.910 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.811925.log 2023-07-06T02:41:06.910 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.297086.log 2023-07-06T02:41:06.911 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.169138.log 2023-07-06T02:41:06.911 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.394814.log 2023-07-06T02:41:06.911 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.414669.log 2023-07-06T02:41:06.911 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.700786.log 2023-07-06T02:41:06.912 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.400951.log 2023-07-06T02:41:06.913 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.347000.log 2023-07-06T02:41:06.913 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.308266.log 2023-07-06T02:41:06.913 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.399795.log 2023-07-06T02:41:06.913 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.651616.log 2023-07-06T02:41:06.914 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.414209.log 2023-07-06T02:41:06.914 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.169152.log 2023-07-06T02:41:06.914 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.197128.log 2023-07-06T02:41:06.914 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.668996.log 2023-07-06T02:41:06.914 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.631954.log 2023-07-06T02:41:06.914 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.202682.log 2023-07-06T02:41:06.916 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.692227.log 2023-07-06T02:41:06.916 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.753330.log 2023-07-06T02:41:06.916 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.264606.log 2023-07-06T02:41:06.916 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.314843.log 2023-07-06T02:41:06.917 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.347315.log 2023-07-06T02:41:06.917 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.626491.log 2023-07-06T02:41:06.917 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.327479.log: /var/log/ceph/ceph-client.admin.370436.log: /var/log/ceph/ceph-client.admin.684730.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.331063.log 2023-07-06T02:41:06.917 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.258411.log 2023-07-06T02:41:06.917 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.927650.log 2023-07-06T02:41:06.918 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.623660.log 2023-07-06T02:41:06.939 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.5.log 2023-07-06T02:41:06.939 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.log 2023-07-06T02:41:06.939 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-osd.5.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.1.108160.log 2023-07-06T02:41:06.939 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.6.log 2023-07-06T02:41:06.940 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.101044.log 2023-07-06T02:41:06.940 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.1.108160.log: 0.0% -- replaced with /var/log/ceph/ceph-client.1.108160.log.gz 2023-07-06T02:41:06.940 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-osd.6.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.3.108767.log 2023-07-06T02:41:06.940 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.101044.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.101136.log 2023-07-06T02:41:06.940 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.3.108767.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.101090.log 2023-07-06T02:41:06.941 INFO:teuthology.orchestra.run.smithi073.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.3.108767.log.gz 2023-07-06T02:41:06.941 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.101136.log: gzip -5 --verbose -- /var/log/ceph/ceph-mds.d.log 2023-07-06T02:41:06.941 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2023-07-06T02:41:06.941 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.101090.log: /var/log/ceph/ceph-mds.d.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.4.log 2023-07-06T02:41:06.942 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.101227.log 2023-07-06T02:41:06.942 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-osd.4.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.101324.log 2023-07-06T02:41:06.942 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.101227.log: gzip -5 --verbose -- /var/log/ceph/ceph-mgr.x.log 2023-07-06T02:41:06.942 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.101324.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100997.log 2023-07-06T02:41:06.942 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-mgr.x.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.101181.log 2023-07-06T02:41:06.943 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.100997.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.3.108771.log 2023-07-06T02:41:06.943 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.101181.log: gzip -5 --verbose -- /var/log/ceph/ceph-mon.c.log 2023-07-06T02:41:06.943 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.3.108771.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.7.log 2023-07-06T02:41:06.943 INFO:teuthology.orchestra.run.smithi073.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.3.108771.log.gz 2023-07-06T02:41:06.943 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-mon.c.log: gzip -5 --verbose -- /var/log/ceph/ceph-mon.b.log 2023-07-06T02:41:06.944 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-osd.7.log: gzip -5 --verbose -- /var/log/ceph/ceph-mds.b.log 2023-07-06T02:41:06.944 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-mon.b.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.101272.log 2023-07-06T02:41:06.944 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-mds.b.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.1.108152.log 2023-07-06T02:41:06.944 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.101272.log: /var/log/ceph/ceph-client.1.108152.log: 0.0% -- replaced with /var/log/ceph/ceph-client.1.108152.log.gz 2023-07-06T02:41:06.952 INFO:teuthology.orchestra.run.smithi073.stderr: 86.9% -- replaced with /var/log/ceph/ceph-client.admin.100997.log.gz 2023-07-06T02:41:06.952 INFO:teuthology.orchestra.run.smithi073.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.101044.log.gz 2023-07-06T02:41:06.953 INFO:teuthology.orchestra.run.smithi073.stderr: 86.9% -- replaced with /var/log/ceph/ceph-client.admin.101090.log.gz 2023-07-06T02:41:06.953 INFO:teuthology.orchestra.run.smithi073.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.101136.log.gz 2023-07-06T02:41:06.953 INFO:teuthology.orchestra.run.smithi073.stderr: 86.9% -- replaced with /var/log/ceph/ceph-client.admin.101181.log.gz 2023-07-06T02:41:06.953 INFO:teuthology.orchestra.run.smithi073.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.101227.log.gz 2023-07-06T02:41:06.954 INFO:teuthology.orchestra.run.smithi073.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.101272.log.gz 2023-07-06T02:41:06.954 INFO:teuthology.orchestra.run.smithi073.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.101324.log.gz 2023-07-06T02:41:06.968 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.803109.log 2023-07-06T02:41:06.969 INFO:teuthology.orchestra.run.smithi046.stderr:gzip /var/log/ceph/ceph-client.admin.795536.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.754022.log 2023-07-06T02:41:06.969 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.626709.log: /var/log/ceph/ceph-client.admin.448175.log: /var/log/ceph/ceph-client.admin.770076.log: /var/log/ceph/ceph-client.admin.640212.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.626709.log.gz 2023-07-06T02:41:06.969 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.448175.log.gz 2023-07-06T02:41:06.969 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.811925.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.770076.log.gz 2023-07-06T02:41:06.969 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.640212.log.gz 2023-07-06T02:41:06.970 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.803109.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.811925.log.gz 2023-07-06T02:41:06.970 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 0.0%--verbose -- -- replaced with /var/log/ceph/ceph-client.admin.795536.log.gz/var/log/ceph/ceph-client.admin.167365.log 2023-07-06T02:41:06.970 INFO:teuthology.orchestra.run.smithi046.stderr: 2023-07-06T02:41:06.970 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.803109.log.gz 2023-07-06T02:41:06.970 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.700786.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.700786.log.gz 2023-07-06T02:41:06.971 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.651616.log: /var/log/ceph/ceph-client.admin.668996.log: /var/log/ceph/ceph-client.admin.631954.log: /var/log/ceph/ceph-client.admin.692227.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.651616.log.gz 2023-07-06T02:41:06.971 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.753330.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.111700.log 2023-07-06T02:41:06.971 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.327479.log.gz 2023-07-06T02:41:06.971 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.170825.log: /var/log/ceph/ceph-client.admin.258411.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.370436.log.gz 2023-07-06T02:41:06.971 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.200659.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.170825.log.gz 2023-07-06T02:41:06.972 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.258411.log.gz 2023-07-06T02:41:06.972 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.200659.log.gz 2023-07-06T02:41:06.972 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.167365.log: /var/log/ceph/ceph-client.admin.264606.log: /var/log/ceph/ceph-client.admin.289887.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.684730.log.gz 2023-07-06T02:41:06.972 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.306306.log 2023-07-06T02:41:06.972 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.297086.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.167365.log.gz 2023-07-06T02:41:06.973 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.264606.log.gz 2023-07-06T02:41:06.973 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.289887.log.gz 2023-07-06T02:41:06.973 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.297086.log.gz 2023-07-06T02:41:06.973 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.169152.log: /var/log/ceph/ceph-client.admin.314843.log: /var/log/ceph/ceph-client.admin.169138.log: 0.0%/var/log/ceph/ceph-client.admin.308266.log: -- replaced with /var/log/ceph/ceph-client.admin.169152.log.gz 2023-07-06T02:41:06.973 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.197128.log: /var/log/ceph/ceph-client.admin.111700.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.314843.log.gz 2023-07-06T02:41:06.974 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.169138.log.gz 2023-07-06T02:41:06.974 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.308266.log.gz 2023-07-06T02:41:06.974 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.197128.log.gz 2023-07-06T02:41:06.974 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.342747.log: /var/log/ceph/ceph-client.admin.347000.log: /var/log/ceph/ceph-client.admin.202682.log: /var/log/ceph/ceph-client.admin.109824.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.342747.log.gz 2023-07-06T02:41:06.974 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.347000.log.gz 2023-07-06T02:41:06.974 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.202682.log.gz 2023-07-06T02:41:06.975 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.249817.log: /var/log/ceph/ceph-client.admin.626491.log: /var/log/ceph/ceph-client.admin.394814.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.754864.log 2023-07-06T02:41:06.975 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.400951.log: /var/log/ceph/ceph-client.admin.399795.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.249817.log.gz 2023-07-06T02:41:06.975 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.626491.log.gz 2023-07-06T02:41:06.975 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0%/var/log/ceph/ceph-client.admin.404023.log: -- replaced with /var/log/ceph/ceph-client.admin.394814.log.gz 2023-07-06T02:41:06.975 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.400951.log.gz 2023-07-06T02:41:06.976 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.399795.log.gz 2023-07-06T02:41:06.976 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.404023.log.gz 2023-07-06T02:41:06.976 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.927650.log: /var/log/ceph/ceph-client.admin.414669.log: /var/log/ceph/ceph-client.admin.414209.log: /var/log/ceph/ceph-client.admin.623660.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.668996.log.gz 2023-07-06T02:41:06.976 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.927650.log.gz 2023-07-06T02:41:06.976 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.754022.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.414669.log.gz 2023-07-06T02:41:06.977 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.414209.log.gz 2023-07-06T02:41:06.977 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.623660.log.gz 2023-07-06T02:41:06.977 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.754022.log.gz 2023-07-06T02:41:06.977 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.631954.log.gz 0.0% 2023-07-06T02:41:06.977 INFO:teuthology.orchestra.run.smithi046.stderr: -- replaced with /var/log/ceph/ceph-client.admin.692227.log.gz 2023-07-06T02:41:06.978 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.331063.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.753330.log.gz 2023-07-06T02:41:06.978 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.347315.log: /var/log/ceph/ceph-client.admin.306306.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.331063.log.gz 2023-07-06T02:41:06.978 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.347315.log.gz 2023-07-06T02:41:06.978 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.306306.log.gz 2023-07-06T02:41:06.978 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.754864.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.754864.log.gz 2023-07-06T02:41:06.978 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.111285.log 2023-07-06T02:41:06.979 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.394059.log 2023-07-06T02:41:06.979 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.111285.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.932791.log 2023-07-06T02:41:06.979 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.394059.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.194234.log 2023-07-06T02:41:06.979 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.394059.log.gz 2023-07-06T02:41:06.979 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.932791.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.625557.log 2023-07-06T02:41:06.980 INFO:teuthology.orchestra.run.smithi046.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.932791.log.gz 2023-07-06T02:41:06.980 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.194234.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.380052.log 2023-07-06T02:41:06.980 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.194234.log.gz 2023-07-06T02:41:06.980 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.625557.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.813229.log 2023-07-06T02:41:06.980 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.625557.log.gz 2023-07-06T02:41:06.981 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.380052.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.292213.log 2023-07-06T02:41:06.981 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.380052.log.gz 2023-07-06T02:41:06.981 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.813229.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.812917.log 2023-07-06T02:41:06.981 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.813229.log.gz 2023-07-06T02:41:06.981 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.292213.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.631861.log 2023-07-06T02:41:06.982 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.292213.log.gz 2023-07-06T02:41:06.982 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.812917.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.299769.log 2023-07-06T02:41:06.982 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.812917.log.gz 2023-07-06T02:41:06.982 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.631861.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.307315.log 2023-07-06T02:41:06.982 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.631861.log.gz 2023-07-06T02:41:06.983 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.299769.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.808171.log 2023-07-06T02:41:06.983 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.299769.log.gz 2023-07-06T02:41:06.983 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.307315.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.284959.log 2023-07-06T02:41:06.983 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.307315.log.gz 2023-07-06T02:41:06.983 INFO:teuthology.orchestra.run.smithi046.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.109824.log.gz 2023-07-06T02:41:06.984 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.808171.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.808171.log.gz 2023-07-06T02:41:06.984 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.306385.log 2023-07-06T02:41:06.984 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.284959.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.923762.log 2023-07-06T02:41:06.984 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.284959.log.gz 2023-07-06T02:41:06.985 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.306385.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.639271.log 2023-07-06T02:41:06.985 INFO:teuthology.orchestra.run.smithi046.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.111700.log.gz 2023-07-06T02:41:06.985 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.306385.log.gz 2023-07-06T02:41:06.985 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.923762.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.930832.log 2023-07-06T02:41:06.985 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.923762.log.gz 2023-07-06T02:41:06.986 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.639271.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.256270.log 2023-07-06T02:41:06.986 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.639271.log.gz 2023-07-06T02:41:06.986 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.930832.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.203540.log 2023-07-06T02:41:06.986 INFO:teuthology.orchestra.run.smithi046.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.930832.log.gz 2023-07-06T02:41:06.986 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.256270.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.932515.log 2023-07-06T02:41:06.987 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.256270.log.gz 2023-07-06T02:41:06.987 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.203540.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.634799.log 2023-07-06T02:41:06.987 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.203540.log.gz 2023-07-06T02:41:06.987 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.932515.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.277436.log 2023-07-06T02:41:06.987 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.634799.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.932515.log.gz 2023-07-06T02:41:06.988 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 0.0%--verbose -- -- replaced with /var/log/ceph/ceph-client.admin.634799.log.gz/var/log/ceph/ceph-client.admin.697580.log 2023-07-06T02:41:06.988 INFO:teuthology.orchestra.run.smithi046.stderr: 2023-07-06T02:41:06.988 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.277436.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.666289.log 2023-07-06T02:41:06.988 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.277436.log.gz 2023-07-06T02:41:06.988 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.697580.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.288958.log 2023-07-06T02:41:06.989 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.697580.log.gz 2023-07-06T02:41:06.989 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.666289.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.111884.log 2023-07-06T02:41:06.989 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.666289.log.gz 2023-07-06T02:41:06.989 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.288958.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.299041.log 2023-07-06T02:41:06.989 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.288958.log.gz 2023-07-06T02:41:06.990 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.111884.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.277716.log 2023-07-06T02:41:06.990 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.299041.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.799444.log 2023-07-06T02:41:06.990 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.299041.log.gz 2023-07-06T02:41:06.990 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.277716.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.799134.log 2023-07-06T02:41:06.990 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.277716.log.gz 2023-07-06T02:41:06.991 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.799444.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.285478.log 2023-07-06T02:41:06.991 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.799444.log.gz 2023-07-06T02:41:06.991 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.799134.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.311330.log 2023-07-06T02:41:06.991 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.799134.log.gz 2023-07-06T02:41:06.991 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.285478.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.299244.log 2023-07-06T02:41:06.992 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.285478.log.gz 2023-07-06T02:41:06.992 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.311330.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.703673.log 2023-07-06T02:41:06.992 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.311330.log.gz 2023-07-06T02:41:06.992 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.299244.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.411606.log 2023-07-06T02:41:06.992 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.299244.log.gz 2023-07-06T02:41:06.993 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.703673.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.312591.log 2023-07-06T02:41:06.993 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.703673.log.gz 2023-07-06T02:41:06.993 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.411606.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.369669.log 2023-07-06T02:41:06.993 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.411606.log.gz 2023-07-06T02:41:06.993 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.312591.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.809698.log 2023-07-06T02:41:06.994 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.312591.log.gz 2023-07-06T02:41:06.994 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.369669.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.927046.log 2023-07-06T02:41:06.994 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.369669.log.gz 2023-07-06T02:41:06.994 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.809698.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.340981.log 2023-07-06T02:41:06.994 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.809698.log.gz 2023-07-06T02:41:06.995 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.927046.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.241592.log 2023-07-06T02:41:06.995 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.927046.log.gz 2023-07-06T02:41:06.995 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.340981.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.340995.log 2023-07-06T02:41:06.995 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.340981.log.gz 2023-07-06T02:41:06.995 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.241592.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.283939.log 2023-07-06T02:41:06.996 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.241592.log.gz 2023-07-06T02:41:06.996 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.340995.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.187658.log 2023-07-06T02:41:06.996 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.340995.log.gz 2023-07-06T02:41:06.996 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.283939.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.623044.log 2023-07-06T02:41:06.996 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.283939.log.gz 2023-07-06T02:41:06.997 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.279253.log 2023-07-06T02:41:06.997 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.187658.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.187658.log.gz 2023-07-06T02:41:06.997 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.623044.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.115063.log 2023-07-06T02:41:06.997 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.623044.log.gz 2023-07-06T02:41:06.997 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.279253.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.415768.log 2023-07-06T02:41:06.998 INFO:teuthology.orchestra.run.smithi046.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.111285.log.gz 2023-07-06T02:41:06.998 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.279253.log.gz 2023-07-06T02:41:06.998 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.259769.log 2023-07-06T02:41:06.998 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.115063.log: /var/log/ceph/ceph-client.admin.415768.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.415768.log.gz 2023-07-06T02:41:06.998 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.354709.log 2023-07-06T02:41:06.999 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 /var/log/ceph/ceph-client.admin.259769.log: --verbose -- /var/log/ceph/ceph-client.admin.663849.log 2023-07-06T02:41:06.999 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.259769.log.gz 2023-07-06T02:41:06.999 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.354709.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.635754.log 2023-07-06T02:41:06.999 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.354709.log.gz 2023-07-06T02:41:06.999 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.663849.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.653607.log 2023-07-06T02:41:07.000 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.663849.log.gz 2023-07-06T02:41:07.000 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.635754.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.791789.log 2023-07-06T02:41:07.000 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.635754.log.gz 2023-07-06T02:41:07.000 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.653607.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.278755.log 2023-07-06T02:41:07.000 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.653607.log.gz 2023-07-06T02:41:07.001 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.791789.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.388408.log 2023-07-06T02:41:07.001 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.791789.log.gz 2023-07-06T02:41:07.001 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.278755.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.218876.log 2023-07-06T02:41:07.001 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.278755.log.gz 2023-07-06T02:41:07.001 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.388408.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.401999.log 2023-07-06T02:41:07.002 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.388408.log.gz 2023-07-06T02:41:07.002 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.686305.log 2023-07-06T02:41:07.002 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.218876.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.218876.log.gz 2023-07-06T02:41:07.002 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.401999.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.295016.log 2023-07-06T02:41:07.002 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.401999.log.gz 2023-07-06T02:41:07.003 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.686305.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.313303.log 2023-07-06T02:41:07.003 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.686305.log.gz 2023-07-06T02:41:07.003 INFO:teuthology.orchestra.run.smithi046.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.115063.log.gz 2023-07-06T02:41:07.003 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.295016.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.242373.log 2023-07-06T02:41:07.004 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.295016.log.gz 2023-07-06T02:41:07.004 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.313303.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.693286.log 2023-07-06T02:41:07.004 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.313303.log.gz 2023-07-06T02:41:07.004 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.242373.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.320219.log 2023-07-06T02:41:07.004 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.242373.log.gz 2023-07-06T02:41:07.005 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.693286.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.648216.log 2023-07-06T02:41:07.005 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.693286.log.gz 2023-07-06T02:41:07.005 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.320219.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.330203.log 2023-07-06T02:41:07.005 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.320219.log.gz 2023-07-06T02:41:07.005 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.648216.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.318928.log 2023-07-06T02:41:07.006 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.648216.log.gz 2023-07-06T02:41:07.006 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.330203.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.205625.log 2023-07-06T02:41:07.006 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.330203.log.gz 2023-07-06T02:41:07.006 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.186207.log /var/log/ceph/ceph-client.admin.318928.log: 2023-07-06T02:41:07.006 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.318928.log.gz 2023-07-06T02:41:07.006 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.205625.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.803595.log 2023-07-06T02:41:07.007 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.205625.log.gz 2023-07-06T02:41:07.007 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.186207.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.243470.log 2023-07-06T02:41:07.007 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% 88.5% -- replaced with /var/log/ceph/ceph-client.admin.111884.log.gz -- replaced with /var/log/ceph/ceph-client.admin.186207.log.gz 2023-07-06T02:41:07.007 INFO:teuthology.orchestra.run.smithi046.stderr: 2023-07-06T02:41:07.007 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.803595.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.796378.log 2023-07-06T02:41:07.008 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.803595.log.gz 2023-07-06T02:41:07.008 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.243470.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.171782.log 2023-07-06T02:41:07.008 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.243470.log.gz 2023-07-06T02:41:07.008 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.796378.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.930090.log 2023-07-06T02:41:07.008 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.796378.log.gz 2023-07-06T02:41:07.009 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.171782.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.609900.log 2023-07-06T02:41:07.009 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.171782.log.gz 2023-07-06T02:41:07.009 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.930090.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.251513.log 2023-07-06T02:41:07.009 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.930090.log.gz 2023-07-06T02:41:07.009 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.609900.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.813713.log 2023-07-06T02:41:07.010 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.609900.log.gz 2023-07-06T02:41:07.010 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.251513.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.323655.log 2023-07-06T02:41:07.010 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.251513.log.gz 2023-07-06T02:41:07.010 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.813713.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.409836.log 2023-07-06T02:41:07.010 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.813713.log.gz 2023-07-06T02:41:07.011 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.323655.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.766321.log 2023-07-06T02:41:07.011 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.323655.log.gz 2023-07-06T02:41:07.011 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.409836.log: gzip -5 0.0%--verbose -- -- replaced with /var/log/ceph/ceph-client.admin.409836.log.gz/var/log/ceph/ceph-client.admin.355224.log 2023-07-06T02:41:07.011 INFO:teuthology.orchestra.run.smithi046.stderr: 2023-07-06T02:41:07.011 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.766321.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.115249.log 2023-07-06T02:41:07.012 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.766321.log.gz 2023-07-06T02:41:07.012 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.355224.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.635190.log 2023-07-06T02:41:07.012 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.355224.log.gz 2023-07-06T02:41:07.012 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.115249.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.244007.log 2023-07-06T02:41:07.012 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.635190.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.365081.log 2023-07-06T02:41:07.013 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.635190.log.gz 2023-07-06T02:41:07.013 INFO:teuthology.orchestra.run.smithi046.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.115249.log.gz 2023-07-06T02:41:07.013 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 /var/log/ceph/ceph-client.admin.244007.log: --verbose -- /var/log/ceph/ceph-client.admin.111930.log 2023-07-06T02:41:07.013 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.244007.log.gz 2023-07-06T02:41:07.013 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.365081.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.284449.log 2023-07-06T02:41:07.014 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.365081.log.gz 2023-07-06T02:41:07.014 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.111930.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.759028.log 2023-07-06T02:41:07.014 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.284449.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.323872.log 2023-07-06T02:41:07.014 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.284449.log.gz 2023-07-06T02:41:07.014 INFO:teuthology.orchestra.run.smithi046.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.111930.log.gz 2023-07-06T02:41:07.015 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.436822.log 2023-07-06T02:41:07.015 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.759028.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.759028.log.gz 2023-07-06T02:41:07.015 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.323872.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.403453.log 2023-07-06T02:41:07.015 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.323872.log.gz 2023-07-06T02:41:07.015 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.436822.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.817144.log 2023-07-06T02:41:07.015 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.436822.log.gz 2023-07-06T02:41:07.016 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.403453.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.370422.log 2023-07-06T02:41:07.016 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.403453.log.gz 2023-07-06T02:41:07.016 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.817144.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.341212.log 2023-07-06T02:41:07.016 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.817144.log.gz 2023-07-06T02:41:07.016 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.370422.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.467429.log 2023-07-06T02:41:07.017 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.370422.log.gz 2023-07-06T02:41:07.017 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.341212.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.238223.log 2023-07-06T02:41:07.017 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.341212.log.gz 2023-07-06T02:41:07.017 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.467429.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.647576.log 2023-07-06T02:41:07.017 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.467429.log.gz 2023-07-06T02:41:07.018 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.238223.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.631472.log 2023-07-06T02:41:07.018 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.238223.log.gz 2023-07-06T02:41:07.018 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.647576.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.407993.log 2023-07-06T02:41:07.018 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.647576.log.gz 2023-07-06T02:41:07.018 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.631472.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.618979.log 2023-07-06T02:41:07.019 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.631472.log.gz 2023-07-06T02:41:07.019 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.407993.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.201624.log 2023-07-06T02:41:07.019 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.407993.log.gz 2023-07-06T02:41:07.019 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.618979.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.116127.log 2023-07-06T02:41:07.019 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.618979.log.gz 2023-07-06T02:41:07.019 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.201624.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.416385.log 2023-07-06T02:41:07.020 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.201624.log.gz 2023-07-06T02:41:07.020 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.0.116127.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.655317.log 2023-07-06T02:41:07.020 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.0.116127.log.gz 2023-07-06T02:41:07.020 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.416385.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.377377.log 2023-07-06T02:41:07.020 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.416385.log.gz 2023-07-06T02:41:07.021 INFO:teuthology.orchestra.run.smithi046.stderr:gzip /var/log/ceph/ceph-client.admin.655317.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.185276.log 2023-07-06T02:41:07.021 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.655317.log.gz 2023-07-06T02:41:07.021 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.377377.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.620674.log 2023-07-06T02:41:07.021 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.377377.log.gz 2023-07-06T02:41:07.021 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.185276.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.384334.log 2023-07-06T02:41:07.022 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.185276.log.gz 2023-07-06T02:41:07.022 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.620674.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.294227.log 2023-07-06T02:41:07.022 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.620674.log.gz 2023-07-06T02:41:07.022 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.384334.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.614930.log 2023-07-06T02:41:07.022 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.384334.log.gz 2023-07-06T02:41:07.023 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.294227.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.648503.log 2023-07-06T02:41:07.023 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.294227.log.gz 2023-07-06T02:41:07.023 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.267154.log 2023-07-06T02:41:07.023 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.614930.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.614930.log.gz 2023-07-06T02:41:07.023 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.648503.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.267140.log 2023-07-06T02:41:07.024 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.648503.log.gz 2023-07-06T02:41:07.024 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.267154.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.286204.log 2023-07-06T02:41:07.024 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.267154.log.gz 2023-07-06T02:41:07.024 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.267140.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.448766.log 2023-07-06T02:41:07.025 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.267140.log.gz 2023-07-06T02:41:07.025 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.286204.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.157072.log 2023-07-06T02:41:07.025 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.286204.log.gz 2023-07-06T02:41:07.025 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.448766.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.668504.log 2023-07-06T02:41:07.025 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.448766.log.gz 2023-07-06T02:41:07.026 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose /var/log/ceph/ceph-client.admin.157072.log: -- /var/log/ceph/ceph-client.admin.796068.log 2023-07-06T02:41:07.026 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.157072.log.gz 2023-07-06T02:41:07.026 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.668504.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.793069.log 2023-07-06T02:41:07.026 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.668504.log.gz 2023-07-06T02:41:07.027 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.796068.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.793783.log 2023-07-06T02:41:07.027 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.796068.log.gz 2023-07-06T02:41:07.027 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.793069.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.665382.log 2023-07-06T02:41:07.027 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.793069.log.gz 2023-07-06T02:41:07.027 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.793783.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.932101.log 2023-07-06T02:41:07.028 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.793783.log.gz 2023-07-06T02:41:07.028 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.665382.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.272045.log 2023-07-06T02:41:07.028 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.665382.log.gz 2023-07-06T02:41:07.028 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.932101.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.323162.log 2023-07-06T02:41:07.028 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.272045.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.171190.log 88.4% 2023-07-06T02:41:07.029 INFO:teuthology.orchestra.run.smithi046.stderr: -- replaced with /var/log/ceph/ceph-client.admin.932101.log.gz 2023-07-06T02:41:07.029 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.272045.log.gz 2023-07-06T02:41:07.029 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.323162.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.654170.log 2023-07-06T02:41:07.029 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.323162.log.gz 2023-07-06T02:41:07.029 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.171190.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.299027.log 2023-07-06T02:41:07.030 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.171190.log.gz 2023-07-06T02:41:07.030 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.654170.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.361198.log 0.0% 2023-07-06T02:41:07.030 INFO:teuthology.orchestra.run.smithi046.stderr: -- replaced with /var/log/ceph/ceph-client.admin.654170.log.gz 2023-07-06T02:41:07.030 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.299027.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.757091.log 2023-07-06T02:41:07.030 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.299027.log.gz 2023-07-06T02:41:07.031 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.188336.log 2023-07-06T02:41:07.031 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.361198.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.361198.log.gz 2023-07-06T02:41:07.031 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.757091.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.174609.log 2023-07-06T02:41:07.031 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.757091.log.gz 2023-07-06T02:41:07.031 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.188336.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.195196.log 2023-07-06T02:41:07.032 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.188336.log.gz 2023-07-06T02:41:07.032 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.633859.log 2023-07-06T02:41:07.032 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.174609.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.174609.log.gz 2023-07-06T02:41:07.032 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.195196.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.342515.log 2023-07-06T02:41:07.032 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.195196.log.gz 2023-07-06T02:41:07.033 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.633859.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.377391.log 2023-07-06T02:41:07.033 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.633859.log.gz 2023-07-06T02:41:07.033 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.342515.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.190315.log 2023-07-06T02:41:07.033 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.342515.log.gz 2023-07-06T02:41:07.033 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.377391.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.300946.log 2023-07-06T02:41:07.034 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.377391.log.gz 2023-07-06T02:41:07.034 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.190315.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.338311.log 2023-07-06T02:41:07.034 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.190315.log.gz 2023-07-06T02:41:07.034 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.300946.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.357037.log 2023-07-06T02:41:07.034 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.300946.log.gz 2023-07-06T02:41:07.035 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.338311.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.629534.log 2023-07-06T02:41:07.035 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.338311.log.gz 2023-07-06T02:41:07.035 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.357037.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.690091.log 2023-07-06T02:41:07.035 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.357037.log.gz 2023-07-06T02:41:07.035 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 /var/log/ceph/ceph-client.admin.629534.log: --verbose -- /var/log/ceph/ceph-client.admin.173200.log 2023-07-06T02:41:07.036 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.629534.log.gz 2023-07-06T02:41:07.036 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.690091.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.306864.log 2023-07-06T02:41:07.036 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.690091.log.gz 2023-07-06T02:41:07.036 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.173200.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.264115.log 2023-07-06T02:41:07.036 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.173200.log.gz 2023-07-06T02:41:07.036 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.306864.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.672725.log 2023-07-06T02:41:07.037 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.306864.log.gz 2023-07-06T02:41:07.037 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.264115.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.201638.log 2023-07-06T02:41:07.037 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.264115.log.gz 2023-07-06T02:41:07.037 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.672725.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.755867.log 2023-07-06T02:41:07.037 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.672725.log.gz 2023-07-06T02:41:07.038 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.288139.log 2023-07-06T02:41:07.038 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.201638.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.201638.log.gz 2023-07-06T02:41:07.038 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.755867.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.796658.log 2023-07-06T02:41:07.038 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.755867.log.gz 2023-07-06T02:41:07.038 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.288139.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.790550.log 2023-07-06T02:41:07.039 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.288139.log.gz 2023-07-06T02:41:07.039 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.796658.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.695024.log 2023-07-06T02:41:07.039 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.796658.log.gz 2023-07-06T02:41:07.039 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.790550.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.326447.log 2023-07-06T02:41:07.040 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.790550.log.gz 2023-07-06T02:41:07.040 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.695024.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.256457.log 2023-07-06T02:41:07.040 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.695024.log.gz 2023-07-06T02:41:07.040 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.319988.log 2023-07-06T02:41:07.040 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.326447.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.326447.log.gz 2023-07-06T02:41:07.041 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.256457.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.394837.log 2023-07-06T02:41:07.041 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.256457.log.gz 2023-07-06T02:41:07.041 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.319988.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.286297.log 2023-07-06T02:41:07.041 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.319988.log.gz 2023-07-06T02:41:07.041 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.394837.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.683846.log 2023-07-06T02:41:07.042 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.394837.log.gz 2023-07-06T02:41:07.042 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.286297.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.117107.log 2023-07-06T02:41:07.042 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.286297.log.gz 2023-07-06T02:41:07.042 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.683846.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.283953.log 2023-07-06T02:41:07.042 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.683846.log.gz 2023-07-06T02:41:07.043 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.117107.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.361413.log 2023-07-06T02:41:07.043 INFO:teuthology.orchestra.run.smithi073.stderr: 93.5% -- replaced with /var/log/ceph/ceph.audit.log.gz 2023-07-06T02:41:07.097 INFO:teuthology.orchestra.run.smithi073.stderr: 94.1% -- replaced with /var/log/ceph/ceph-mds.d.log.gz 2023-07-06T02:41:07.215 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.283953.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.329736.log 2023-07-06T02:41:07.216 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.283953.log.gz 2023-07-06T02:41:07.216 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.361413.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.251970.log 2023-07-06T02:41:07.216 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.361413.log.gz 2023-07-06T02:41:07.216 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.637671.log 2023-07-06T02:41:07.217 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.329736.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.329736.log.gz 2023-07-06T02:41:07.217 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.251970.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.772512.log 2023-07-06T02:41:07.217 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.251970.log.gz 2023-07-06T02:41:07.217 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.637671.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.199713.log 2023-07-06T02:41:07.217 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.637671.log.gz 2023-07-06T02:41:07.218 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.772512.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.703580.log 2023-07-06T02:41:07.218 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.772512.log.gz 2023-07-06T02:41:07.218 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.199713.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.238209.log 2023-07-06T02:41:07.218 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.199713.log.gz 2023-07-06T02:41:07.219 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.703580.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.263624.log 2023-07-06T02:41:07.219 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.703580.log.gz 2023-07-06T02:41:07.219 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.238209.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.797183.log 2023-07-06T02:41:07.219 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.238209.log.gz 2023-07-06T02:41:07.219 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.263624.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.301536.log 2023-07-06T02:41:07.220 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.263624.log.gz 2023-07-06T02:41:07.220 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.797183.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.618285.log 2023-07-06T02:41:07.220 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.797183.log.gz 2023-07-06T02:41:07.220 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.301536.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.218487.log 2023-07-06T02:41:07.220 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.301536.log.gz 2023-07-06T02:41:07.220 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.618285.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.697781.log 2023-07-06T02:41:07.221 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.618285.log.gz 2023-07-06T02:41:07.221 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.218487.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.655037.log 2023-07-06T02:41:07.221 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.218487.log.gz 2023-07-06T02:41:07.221 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.697781.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.237753.log 2023-07-06T02:41:07.221 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.697781.log.gz 2023-07-06T02:41:07.222 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.655037.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.284742.log 2023-07-06T02:41:07.222 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.655037.log.gz 2023-07-06T02:41:07.222 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.237753.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.759449.log 2023-07-06T02:41:07.222 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.237753.log.gz 2023-07-06T02:41:07.222 INFO:teuthology.orchestra.run.smithi046.stderr:gzip /var/log/ceph/ceph-client.admin.284742.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.931261.log 2023-07-06T02:41:07.223 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.284742.log.gz 2023-07-06T02:41:07.223 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.759449.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.337092.log 2023-07-06T02:41:07.223 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.759449.log.gz 2023-07-06T02:41:07.223 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.931261.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.797911.log 2023-07-06T02:41:07.223 INFO:teuthology.orchestra.run.smithi046.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.931261.log.gz 2023-07-06T02:41:07.224 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.266172.log 2023-07-06T02:41:07.224 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.337092.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.337092.log.gz 2023-07-06T02:41:07.224 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.797911.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.411527.log 2023-07-06T02:41:07.224 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% 89.3% -- replaced with /var/log/ceph/ceph-client.admin.797911.log.gz -- replaced with /var/log/ceph/ceph-client.admin.117107.log.gz 2023-07-06T02:41:07.224 INFO:teuthology.orchestra.run.smithi046.stderr: 2023-07-06T02:41:07.225 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.266172.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.357263.log 2023-07-06T02:41:07.225 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.266172.log.gz 2023-07-06T02:41:07.225 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.411527.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.170799.log 2023-07-06T02:41:07.225 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.411527.log.gz 2023-07-06T02:41:07.225 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.357263.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.624971.log 2023-07-06T02:41:07.226 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.357263.log.gz 2023-07-06T02:41:07.226 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.170799.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.377173.log 2023-07-06T02:41:07.226 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.170799.log.gz 2023-07-06T02:41:07.226 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.624971.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.638991.log 2023-07-06T02:41:07.226 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.624971.log.gz 2023-07-06T02:41:07.227 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.377173.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.818312.log 2023-07-06T02:41:07.227 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.377173.log.gz 2023-07-06T02:41:07.227 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.638991.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.393595.log 2023-07-06T02:41:07.227 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.638991.log.gz 2023-07-06T02:41:07.227 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.818312.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.189530.log 2023-07-06T02:41:07.228 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.818312.log.gz 2023-07-06T02:41:07.228 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.393595.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.2.log 2023-07-06T02:41:07.228 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.393595.log.gz 2023-07-06T02:41:07.228 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.189530.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.276611.log 2023-07-06T02:41:07.228 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.189530.log.gz 2023-07-06T02:41:07.229 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-osd.2.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.674621.log 2023-07-06T02:41:07.229 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.276611.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.702278.log 2023-07-06T02:41:07.229 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.276611.log.gz 2023-07-06T02:41:07.229 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.674621.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.275666.log 2023-07-06T02:41:07.229 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.674621.log.gz 2023-07-06T02:41:07.230 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 /var/log/ceph/ceph-client.admin.702278.log: --verbose -- /var/log/ceph/ceph-client.admin.449746.log 2023-07-06T02:41:07.230 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.702278.log.gz 2023-07-06T02:41:07.230 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.275666.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.331579.log 2023-07-06T02:41:07.230 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.275666.log.gz 2023-07-06T02:41:07.230 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.449746.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.699804.log 2023-07-06T02:41:07.231 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.449746.log.gz 2023-07-06T02:41:07.231 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.768775.log 2023-07-06T02:41:07.231 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.331579.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.331579.log.gz 2023-07-06T02:41:07.231 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.699804.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.156603.log 2023-07-06T02:41:07.231 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.699804.log.gz 2023-07-06T02:41:07.232 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.768775.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.464251.log 2023-07-06T02:41:07.232 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.768775.log.gz 2023-07-06T02:41:07.232 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.156603.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.792558.log 2023-07-06T02:41:07.232 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.156603.log.gz 2023-07-06T02:41:07.232 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.464251.log: /var/log/ceph/ceph-client.admin.467730.log 2023-07-06T02:41:07.233 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.464251.log.gz 2023-07-06T02:41:07.233 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.792558.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.282734.log 2023-07-06T02:41:07.233 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.792558.log.gz 2023-07-06T02:41:07.233 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.467730.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.284153.log 2023-07-06T02:41:07.233 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.467730.log.gz 2023-07-06T02:41:07.233 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.282734.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.397403.log 2023-07-06T02:41:07.234 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.282734.log.gz 2023-07-06T02:41:07.234 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.284153.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.389245.log 2023-07-06T02:41:07.234 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.284153.log.gz 2023-07-06T02:41:07.234 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.811407.log 2023-07-06T02:41:07.234 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.397403.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.397403.log.gz 2023-07-06T02:41:07.235 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.389245.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.648432.log 2023-07-06T02:41:07.235 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.389245.log.gz 2023-07-06T02:41:07.235 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.811407.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.354616.log 2023-07-06T02:41:07.235 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.811407.log.gz 2023-07-06T02:41:07.235 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.648432.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.293018.log 2023-07-06T02:41:07.236 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.648432.log.gz 2023-07-06T02:41:07.236 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.354616.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.239547.log 2023-07-06T02:41:07.236 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.354616.log.gz 2023-07-06T02:41:07.236 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.293018.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.413533.log 2023-07-06T02:41:07.237 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.293018.log.gz 2023-07-06T02:41:07.237 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.802046.log 2023-07-06T02:41:07.237 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.239547.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.239547.log.gz 2023-07-06T02:41:07.237 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.413533.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.931650.log 2023-07-06T02:41:07.237 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.413533.log.gz 2023-07-06T02:41:07.238 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.802046.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.215723.log 2023-07-06T02:41:07.238 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.802046.log.gz 2023-07-06T02:41:07.238 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.931650.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.210800.log 2023-07-06T02:41:07.238 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.215723.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.416306.log 2023-07-06T02:41:07.238 INFO:teuthology.orchestra.run.smithi046.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.931650.log.gz 2023-07-06T02:41:07.238 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.215723.log.gz 2023-07-06T02:41:07.239 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.210800.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.329234.log 2023-07-06T02:41:07.239 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.210800.log.gz 2023-07-06T02:41:07.239 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.416306.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.440125.log 2023-07-06T02:41:07.239 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.416306.log.gz 2023-07-06T02:41:07.239 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.329234.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.357564.log 2023-07-06T02:41:07.240 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.329234.log.gz 2023-07-06T02:41:07.240 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.440125.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.463451.log 2023-07-06T02:41:07.240 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.440125.log.gz 2023-07-06T02:41:07.240 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.357564.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.680980.log 2023-07-06T02:41:07.240 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.357564.log.gz 2023-07-06T02:41:07.241 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.463451.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.204089.log 2023-07-06T02:41:07.241 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.463451.log.gz 2023-07-06T02:41:07.241 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.680980.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.648526.log 2023-07-06T02:41:07.241 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.680980.log.gz 2023-07-06T02:41:07.241 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.204089.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.378207.log 2023-07-06T02:41:07.242 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.204089.log.gz 2023-07-06T02:41:07.242 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.648526.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.648526.log.gz 2023-07-06T02:41:07.242 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.274604.log 2023-07-06T02:41:07.242 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.378207.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.295597.log 2023-07-06T02:41:07.242 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.378207.log.gz 2023-07-06T02:41:07.243 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.274604.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.384348.log 2023-07-06T02:41:07.243 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.274604.log.gz 2023-07-06T02:41:07.243 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.295597.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.113645.log 2023-07-06T02:41:07.243 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.295597.log.gz 2023-07-06T02:41:07.243 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.384348.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.927636.log 2023-07-06T02:41:07.244 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.384348.log.gz 2023-07-06T02:41:07.244 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.113645.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.108626.log 2023-07-06T02:41:07.244 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.927636.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.374005.log 2023-07-06T02:41:07.244 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.927636.log.gz 2023-07-06T02:41:07.244 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.108626.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.622567.log 2023-07-06T02:41:07.245 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.374005.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.114427.log 2023-07-06T02:41:07.245 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.374005.log.gz 2023-07-06T02:41:07.245 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.622567.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.302548.log 2023-07-06T02:41:07.245 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.622567.log.gz 2023-07-06T02:41:07.245 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.114427.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.107912.log 2023-07-06T02:41:07.245 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.302548.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.625464.log 2023-07-06T02:41:07.246 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.302548.log.gz 2023-07-06T02:41:07.246 INFO:teuthology.orchestra.run.smithi046.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.113645.log.gz 2023-07-06T02:41:07.246 INFO:teuthology.orchestra.run.smithi046.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.114427.log.gz 2023-07-06T02:41:07.246 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.107912.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.805442.log 2023-07-06T02:41:07.246 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.625464.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.107107.log 2023-07-06T02:41:07.247 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.625464.log.gz 2023-07-06T02:41:07.247 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.805442.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.812232.log 2023-07-06T02:41:07.247 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.805442.log.gz 2023-07-06T02:41:07.247 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.107107.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.206044.log 2023-07-06T02:41:07.247 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.812232.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.622177.log 2023-07-06T02:41:07.248 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.812232.log.gz 2023-07-06T02:41:07.248 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.206044.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.320513.log 2023-07-06T02:41:07.248 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.206044.log.gz 2023-07-06T02:41:07.248 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.622177.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.804055.log 2023-07-06T02:41:07.248 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.622177.log.gz 2023-07-06T02:41:07.249 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.320513.log: 0.0%gzip -- replaced with /var/log/ceph/ceph-client.admin.320513.log.gz-5 2023-07-06T02:41:07.249 INFO:teuthology.orchestra.run.smithi046.stderr:--verbose -- /var/log/ceph/ceph-client.admin.356198.log 2023-07-06T02:41:07.249 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.804055.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.689177.log 2023-07-06T02:41:07.249 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.804055.log.gz 2023-07-06T02:41:07.249 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.356198.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.401030.log 2023-07-06T02:41:07.250 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.356198.log.gz 2023-07-06T02:41:07.250 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.689177.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.689177.log.gz 2023-07-06T02:41:07.250 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.389803.log 2023-07-06T02:41:07.250 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.401030.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.665613.log 2023-07-06T02:41:07.250 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.401030.log.gz 2023-07-06T02:41:07.250 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.389803.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.274107.log 2023-07-06T02:41:07.251 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.389803.log.gz 2023-07-06T02:41:07.251 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.665613.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.699313.log 2023-07-06T02:41:07.251 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.665613.log.gz 2023-07-06T02:41:07.251 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.274107.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.174910.log 2023-07-06T02:41:07.251 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.274107.log.gz 2023-07-06T02:41:07.252 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.699313.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.313088.log 2023-07-06T02:41:07.252 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.699313.log.gz 2023-07-06T02:41:07.252 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.174910.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.288153.log 2023-07-06T02:41:07.252 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.174910.log.gz 2023-07-06T02:41:07.252 INFO:teuthology.orchestra.run.smithi046.stderr:gzip /var/log/ceph/ceph-client.admin.313088.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.931604.log 2023-07-06T02:41:07.253 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.313088.log.gz 2023-07-06T02:41:07.253 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.288153.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.799227.log 2023-07-06T02:41:07.253 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.288153.log.gz 2023-07-06T02:41:07.253 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.931604.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.111838.log 2023-07-06T02:41:07.254 INFO:teuthology.orchestra.run.smithi046.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.931604.log.gz 2023-07-06T02:41:07.254 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.799227.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.368822.log 2023-07-06T02:41:07.254 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.799227.log.gz 2023-07-06T02:41:07.254 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.111838.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.111515.log 2023-07-06T02:41:07.254 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.368822.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.655529.log 2023-07-06T02:41:07.254 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.368822.log.gz 2023-07-06T02:41:07.255 INFO:teuthology.orchestra.run.smithi046.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.111838.log.gz 2023-07-06T02:41:07.255 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.111515.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.416919.log 2023-07-06T02:41:07.255 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.655529.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.679497.log 2023-07-06T02:41:07.255 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.655529.log.gz 2023-07-06T02:41:07.256 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.416919.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.326230.log 2023-07-06T02:41:07.256 INFO:teuthology.orchestra.run.smithi046.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.111515.log.gz 2023-07-06T02:41:07.256 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.416919.log.gz 2023-07-06T02:41:07.256 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.679497.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.255677.log 2023-07-06T02:41:07.256 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.679497.log.gz 2023-07-06T02:41:07.257 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.326230.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.298059.log 2023-07-06T02:41:07.257 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.326230.log.gz 2023-07-06T02:41:07.257 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.752147.log 2023-07-06T02:41:07.257 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.255677.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.255677.log.gz 2023-07-06T02:41:07.257 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.692306.log 2023-07-06T02:41:07.258 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.298059.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.298059.log.gz 2023-07-06T02:41:07.258 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.752147.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.768081.log 2023-07-06T02:41:07.258 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.752147.log.gz 2023-07-06T02:41:07.258 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.692306.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.440363.log 2023-07-06T02:41:07.258 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.692306.log.gz 2023-07-06T02:41:07.258 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.768081.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.108626.log.gz 2023-07-06T02:41:07.259 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.319021.log 2023-07-06T02:41:07.259 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.768081.log.gz 2023-07-06T02:41:07.259 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.440363.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.791586.log 2023-07-06T02:41:07.259 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.440363.log.gz 2023-07-06T02:41:07.259 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.319021.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.766959.log 2023-07-06T02:41:07.260 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.319021.log.gz 2023-07-06T02:41:07.260 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.791586.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.318729.log 2023-07-06T02:41:07.260 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.791586.log.gz 2023-07-06T02:41:07.260 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.766959.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.437621.log 2023-07-06T02:41:07.260 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.766959.log.gz 2023-07-06T02:41:07.261 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.318729.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.630389.log 2023-07-06T02:41:07.261 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.318729.log.gz 2023-07-06T02:41:07.261 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.437621.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.372105.log 2023-07-06T02:41:07.261 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.437621.log.gz 2023-07-06T02:41:07.261 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.114013.log /var/log/ceph/ceph-client.admin.630389.log: 2023-07-06T02:41:07.262 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.630389.log.gz 2023-07-06T02:41:07.262 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.372105.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.327276.log 2023-07-06T02:41:07.262 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.372105.log.gz 2023-07-06T02:41:07.262 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.114013.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.280732.log 2023-07-06T02:41:07.262 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.327276.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.387088.log 2023-07-06T02:41:07.263 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.327276.log.gz 2023-07-06T02:41:07.263 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.280732.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.174896.log 2023-07-06T02:41:07.263 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.280732.log.gz 2023-07-06T02:41:07.263 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.387088.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.932055.log 2023-07-06T02:41:07.263 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.387088.log.gz 2023-07-06T02:41:07.263 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.108292.log 2023-07-06T02:41:07.264 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.174896.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.174896.log.gz 2023-07-06T02:41:07.264 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.932055.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.626412.log 2023-07-06T02:41:07.264 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.108292.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.932055.log.gz 2023-07-06T02:41:07.264 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.326977.log 2023-07-06T02:41:07.264 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.626412.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.398950.log 2023-07-06T02:41:07.265 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.626412.log.gz 2023-07-06T02:41:07.265 INFO:teuthology.orchestra.run.smithi046.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.107107.log.gz 2023-07-06T02:41:07.265 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.326977.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.109532.log 2023-07-06T02:41:07.265 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.326977.log.gz 2023-07-06T02:41:07.265 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.398950.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.388859.log 2023-07-06T02:41:07.266 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.398950.log.gz 2023-07-06T02:41:07.266 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.109532.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.367732.log 2023-07-06T02:41:07.266 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.388859.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.251499.log 2023-07-06T02:41:07.266 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.388859.log.gz 2023-07-06T02:41:07.266 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.367732.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.244579.log 2023-07-06T02:41:07.267 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.367732.log.gz 2023-07-06T02:41:07.267 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.405503.log 2023-07-06T02:41:07.267 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.251499.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.251499.log.gz 2023-07-06T02:41:07.267 INFO:teuthology.orchestra.run.smithi046.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.107912.log.gz/var/log/ceph/ceph-client.admin.244579.log: 2023-07-06T02:41:07.267 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.246524.log 2023-07-06T02:41:07.268 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.244579.log.gz 2023-07-06T02:41:07.268 INFO:teuthology.orchestra.run.smithi046.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.114013.log.gz 2023-07-06T02:41:07.268 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.405503.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.655130.log 2023-07-06T02:41:07.268 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.405503.log.gz 2023-07-06T02:41:07.268 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.246524.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.467415.log 2023-07-06T02:41:07.269 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.246524.log.gz 2023-07-06T02:41:07.269 INFO:teuthology.orchestra.run.smithi046.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.108292.log.gz 2023-07-06T02:41:07.269 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose /var/log/ceph/ceph-client.admin.655130.log: -- /var/log/ceph/ceph-client.admin.815885.log 2023-07-06T02:41:07.269 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.655130.log.gz 2023-07-06T02:41:07.269 INFO:teuthology.orchestra.run.smithi046.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.109532.log.gz 2023-07-06T02:41:07.270 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.467415.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.343041.log 2023-07-06T02:41:07.270 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.467415.log.gz 2023-07-06T02:41:07.270 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.815885.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.258769.log 2023-07-06T02:41:07.270 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.815885.log.gz 2023-07-06T02:41:07.270 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.343041.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.170017.log 2023-07-06T02:41:07.271 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.343041.log.gz 2023-07-06T02:41:07.271 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.258769.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.289161.log 2023-07-06T02:41:07.271 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.258769.log.gz 2023-07-06T02:41:07.271 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.170017.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.109432.log 2023-07-06T02:41:07.271 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.170017.log.gz 2023-07-06T02:41:07.271 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.289161.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.648202.log 2023-07-06T02:41:07.272 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.289161.log.gz 2023-07-06T02:41:07.272 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.109432.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.621237.log 2023-07-06T02:41:07.272 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.648202.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.800746.log 2023-07-06T02:41:07.272 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.648202.log.gz 2023-07-06T02:41:07.273 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.621237.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.752161.log 2023-07-06T02:41:07.273 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.621237.log.gz 2023-07-06T02:41:07.273 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.800746.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.449760.log 2023-07-06T02:41:07.273 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.800746.log.gz 2023-07-06T02:41:07.273 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.752161.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.759738.log 2023-07-06T02:41:07.274 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.752161.log.gz 2023-07-06T02:41:07.274 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.449760.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.805061.log 2023-07-06T02:41:07.274 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.449760.log.gz 2023-07-06T02:41:07.274 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.759738.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.793998.log 2023-07-06T02:41:07.274 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.759738.log.gz 2023-07-06T02:41:07.274 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.805061.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.678099.log 2023-07-06T02:41:07.275 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.805061.log.gz 2023-07-06T02:41:07.275 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.793998.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.923776.log 2023-07-06T02:41:07.275 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.793998.log.gz 2023-07-06T02:41:07.275 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.678099.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.250939.log 2023-07-06T02:41:07.275 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.678099.log.gz 2023-07-06T02:41:07.276 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.923776.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.405920.log 2023-07-06T02:41:07.276 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.923776.log.gz 2023-07-06T02:41:07.276 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.250939.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.631940.log 2023-07-06T02:41:07.276 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.250939.log.gz 2023-07-06T02:41:07.276 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.405920.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.171703.log 2023-07-06T02:41:07.277 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.405920.log.gz 2023-07-06T02:41:07.277 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.631940.log: gzip -5 --verbose -- /var/log/ceph/ceph.log 2023-07-06T02:41:07.277 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.631940.log.gz 2023-07-06T02:41:07.277 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.171703.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.621223.log 2023-07-06T02:41:07.277 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.171703.log.gz 2023-07-06T02:41:07.278 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.212745.log 2023-07-06T02:41:07.278 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.621223.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.680058.log 2023-07-06T02:41:07.278 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.621223.log.gz 2023-07-06T02:41:07.278 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.212745.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.212745.log.gz 2023-07-06T02:41:07.278 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.161784.log 2023-07-06T02:41:07.279 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.680058.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.681447.log 2023-07-06T02:41:07.279 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.680058.log.gz 2023-07-06T02:41:07.279 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.161784.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.667320.log 2023-07-06T02:41:07.279 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.161784.log.gz 2023-07-06T02:41:07.279 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.681447.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.806485.log 2023-07-06T02:41:07.280 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.681447.log.gz 2023-07-06T02:41:07.280 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.667320.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.393119.log 2023-07-06T02:41:07.280 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.667320.log.gz 2023-07-06T02:41:07.280 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.806485.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.806485.log.gz 2023-07-06T02:41:07.280 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.690656.log 2023-07-06T02:41:07.281 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.393119.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.112747.log 2023-07-06T02:41:07.281 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.393119.log.gz 2023-07-06T02:41:07.281 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.690656.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.337307.log 2023-07-06T02:41:07.281 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.690656.log.gz 2023-07-06T02:41:07.281 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.112747.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.630005.log 2023-07-06T02:41:07.282 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.337307.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.301944.log 2023-07-06T02:41:07.282 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.337307.log.gz 2023-07-06T02:41:07.282 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.630005.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.169059.log 2023-07-06T02:41:07.282 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.630005.log.gz 2023-07-06T02:41:07.282 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.301944.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.115389.log 2023-07-06T02:41:07.283 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.301944.log.gz 2023-07-06T02:41:07.283 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.169059.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.263212.log 2023-07-06T02:41:07.283 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.169059.log.gz 2023-07-06T02:41:07.283 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.115389.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.249606.log 2023-07-06T02:41:07.283 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.263212.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.649017.log 2023-07-06T02:41:07.284 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.263212.log.gz 2023-07-06T02:41:07.284 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.249606.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.675555.log 2023-07-06T02:41:07.284 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.249606.log.gz 2023-07-06T02:41:07.284 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.649017.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.248587.log 2023-07-06T02:41:07.284 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.649017.log.gz 2023-07-06T02:41:07.285 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.675555.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.789960.log 2023-07-06T02:41:07.285 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.675555.log.gz 2023-07-06T02:41:07.285 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.248587.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.348636.log 2023-07-06T02:41:07.285 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.248587.log.gz 2023-07-06T02:41:07.285 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.789960.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.241797.log 2023-07-06T02:41:07.286 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.789960.log.gz 2023-07-06T02:41:07.286 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.615692.log 2023-07-06T02:41:07.286 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.348636.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.348636.log.gz 2023-07-06T02:41:07.286 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.241797.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.241797.log.gzgzip 2023-07-06T02:41:07.287 INFO:teuthology.orchestra.run.smithi046.stderr:-5 --verbose -- /var/log/ceph/ceph-client.admin.313764.log 2023-07-06T02:41:07.287 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.615692.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.260260.log 2023-07-06T02:41:07.287 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.615692.log.gz 2023-07-06T02:41:07.287 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.313764.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.368808.log 2023-07-06T02:41:07.287 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.313764.log.gz 2023-07-06T02:41:07.287 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.260260.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.385370.log 2023-07-06T02:41:07.288 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.260260.log.gz 2023-07-06T02:41:07.288 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.368808.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.368808.log.gz 2023-07-06T02:41:07.288 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.189810.log 2023-07-06T02:41:07.288 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.385370.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.622646.log 2023-07-06T02:41:07.289 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.385370.log.gz 2023-07-06T02:41:07.289 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.189810.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.800988.log 2023-07-06T02:41:07.289 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.189810.log.gz 2023-07-06T02:41:07.289 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.622646.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.775349.log 2023-07-06T02:41:07.290 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.622646.log.gz 2023-07-06T02:41:07.290 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.800988.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.339412.log 2023-07-06T02:41:07.290 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.800988.log.gz 2023-07-06T02:41:07.290 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.775349.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.199727.log 2023-07-06T02:41:07.290 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.775349.log.gz 2023-07-06T02:41:07.291 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.339412.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.679965.log 2023-07-06T02:41:07.291 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.339412.log.gz 2023-07-06T02:41:07.291 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.199727.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.673138.log 2023-07-06T02:41:07.291 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.199727.log.gz 2023-07-06T02:41:07.291 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.679965.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.679965.log.gz 2023-07-06T02:41:07.292 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.380979.log 2023-07-06T02:41:07.292 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.673138.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.261739.log 2023-07-06T02:41:07.292 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.673138.log.gz 2023-07-06T02:41:07.292 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.380979.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.335392.log 2023-07-06T02:41:07.293 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.380979.log.gz 2023-07-06T02:41:07.293 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.261739.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.396232.log 2023-07-06T02:41:07.293 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.261739.log.gz 2023-07-06T02:41:07.293 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.335392.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.335392.log.gz 2023-07-06T02:41:07.293 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.245546.log 2023-07-06T02:41:07.294 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.396232.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.417516.log 2023-07-06T02:41:07.294 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.396232.log.gz 2023-07-06T02:41:07.294 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.245546.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.652106.log 2023-07-06T02:41:07.294 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.245546.log.gz 2023-07-06T02:41:07.295 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.417516.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.258450.log 2023-07-06T02:41:07.295 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.417516.log.gz 2023-07-06T02:41:07.295 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.652106.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.652106.log.gz 2023-07-06T02:41:07.295 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.386317.log 2023-07-06T02:41:07.296 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.258450.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.159345.log 2023-07-06T02:41:07.296 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.258450.log.gz 2023-07-06T02:41:07.296 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.386317.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.173590.log 2023-07-06T02:41:07.296 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.386317.log.gz 2023-07-06T02:41:07.297 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.159345.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.406740.log 2023-07-06T02:41:07.297 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.159345.log.gz 2023-07-06T02:41:07.297 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.173590.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.394791.log 2023-07-06T02:41:07.297 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.173590.log.gz 2023-07-06T02:41:07.297 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.406740.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.107479.log 2023-07-06T02:41:07.298 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.406740.log.gz 2023-07-06T02:41:07.298 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.394791.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.394791.log.gz 2023-07-06T02:41:07.298 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.356212.log 2023-07-06T02:41:07.298 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.107479.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.219608.log 2023-07-06T02:41:07.299 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.356212.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.399029.log 2023-07-06T02:41:07.299 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.356212.log.gz 2023-07-06T02:41:07.299 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.219608.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.640226.log 2023-07-06T02:41:07.299 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.219608.log.gz 2023-07-06T02:41:07.300 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.399029.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.406216.log 2023-07-06T02:41:07.300 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.399029.log.gz 2023-07-06T02:41:07.300 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.640226.log: gzip 0.0%-5 --verbose -- replaced with /var/log/ceph/ceph-client.admin.640226.log.gz-- 2023-07-06T02:41:07.300 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.636649.log 2023-07-06T02:41:07.300 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.406216.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.385573.log 2023-07-06T02:41:07.301 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.406216.log.gz 2023-07-06T02:41:07.301 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.636649.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.354695.log 2023-07-06T02:41:07.301 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.636649.log.gz 2023-07-06T02:41:07.301 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.385573.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.337587.log 2023-07-06T02:41:07.302 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.385573.log.gz 2023-07-06T02:41:07.302 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.808742.log 2023-07-06T02:41:07.302 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.354695.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.354695.log.gz 2023-07-06T02:41:07.302 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.337587.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.337587.log.gz 2023-07-06T02:41:07.302 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.704156.log 2023-07-06T02:41:07.303 INFO:teuthology.orchestra.run.smithi046.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.109432.log.gz 2023-07-06T02:41:07.303 INFO:teuthology.orchestra.run.smithi046.stderr:gzip 88.5%-5 --verbose -- replaced with /var/log/ceph/ceph-client.admin.112747.log.gz-- 2023-07-06T02:41:07.303 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.772321.log 2023-07-06T02:41:07.303 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.808742.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.808742.log.gz 2023-07-06T02:41:07.304 INFO:teuthology.orchestra.run.smithi046.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.115389.log.gz 2023-07-06T02:41:07.304 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.704156.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.107479.log.gz 2023-07-06T02:41:07.304 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.510271.log 2023-07-06T02:41:07.304 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.704156.log.gz 2023-07-06T02:41:07.305 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.772321.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.171176.log 2023-07-06T02:41:07.305 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.772321.log.gz 2023-07-06T02:41:07.305 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.510271.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.768267.log 2023-07-06T02:41:07.305 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.510271.log.gz 2023-07-06T02:41:07.306 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.171176.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.811701.log 2023-07-06T02:41:07.306 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.171176.log.gz 2023-07-06T02:41:07.306 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.768267.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.768267.log.gz 2023-07-06T02:41:07.306 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.299258.log 2023-07-06T02:41:07.306 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.811701.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.343896.log 2023-07-06T02:41:07.307 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.811701.log.gz 2023-07-06T02:41:07.307 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.299258.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.274821.log 2023-07-06T02:41:07.307 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.299258.log.gz 2023-07-06T02:41:07.307 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.343896.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.701057.log 2023-07-06T02:41:07.307 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.343896.log.gz 2023-07-06T02:41:07.308 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.274821.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.412101.log 2023-07-06T02:41:07.308 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.274821.log.gz 2023-07-06T02:41:07.308 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.701057.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.207073.log 2023-07-06T02:41:07.308 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.701057.log.gz 2023-07-06T02:41:07.309 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.412101.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.258425.log 2023-07-06T02:41:07.309 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.412101.log.gz 2023-07-06T02:41:07.309 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.207073.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.314829.log 2023-07-06T02:41:07.309 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.207073.log.gz 2023-07-06T02:41:07.310 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.258425.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.756143.log 2023-07-06T02:41:07.310 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.258425.log.gz 2023-07-06T02:41:07.310 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.314829.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.314829.log.gz 2023-07-06T02:41:07.310 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.241606.log 2023-07-06T02:41:07.310 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.756143.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.653059.log 2023-07-06T02:41:07.311 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.756143.log.gz 2023-07-06T02:41:07.311 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.241606.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.241606.log.gz 2023-07-06T02:41:07.311 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.758464.log 2023-07-06T02:41:07.311 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.653059.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.651008.log 2023-07-06T02:41:07.312 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.653059.log.gz 2023-07-06T02:41:07.312 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.758464.log: gzip 0.0%-5 -- replaced with /var/log/ceph/ceph-client.admin.758464.log.gz--verbose 2023-07-06T02:41:07.312 INFO:teuthology.orchestra.run.smithi046.stderr:-- /var/log/ceph/ceph-client.admin.113373.log 2023-07-06T02:41:07.312 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.651008.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.437406.log 2023-07-06T02:41:07.312 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.651008.log.gz 2023-07-06T02:41:07.313 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.113373.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.266649.log 2023-07-06T02:41:07.313 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.437406.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.813727.log 2023-07-06T02:41:07.313 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.437406.log.gz 2023-07-06T02:41:07.313 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.266649.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.219350.log 2023-07-06T02:41:07.314 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.266649.log.gz 2023-07-06T02:41:07.314 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.813727.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.813727.log.gz 2023-07-06T02:41:07.314 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.307701.log 2023-07-06T02:41:07.314 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.219350.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.219350.log.gz 2023-07-06T02:41:07.314 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.695608.log /var/log/ceph/ceph-client.admin.307701.log: 2023-07-06T02:41:07.315 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.307701.log.gz 2023-07-06T02:41:07.315 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.159013.log 2023-07-06T02:41:07.315 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.695608.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.633390.log 2023-07-06T02:41:07.315 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.695608.log.gz 2023-07-06T02:41:07.315 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.159013.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.665396.log 2023-07-06T02:41:07.316 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.159013.log.gz 2023-07-06T02:41:07.316 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.633390.log: 0.0%gzip -- replaced with /var/log/ceph/ceph-client.admin.633390.log.gz-5 2023-07-06T02:41:07.316 INFO:teuthology.orchestra.run.smithi046.stderr:--verbose -- /var/log/ceph/ceph-client.admin.114971.log 2023-07-06T02:41:07.316 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.665396.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.388394.log 2023-07-06T02:41:07.317 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.665396.log.gz 2023-07-06T02:41:07.317 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.114971.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.628032.log 2023-07-06T02:41:07.317 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.388394.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.198746.log 2023-07-06T02:41:07.317 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.388394.log.gz 2023-07-06T02:41:07.318 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.628032.log: 0.0%gzip -- replaced with /var/log/ceph/ceph-client.admin.628032.log.gz 2023-07-06T02:41:07.318 INFO:teuthology.orchestra.run.smithi046.stderr:-5 --verbose -- /var/log/ceph/ceph-client.admin.810653.log 2023-07-06T02:41:07.318 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.198746.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.297581.log 2023-07-06T02:41:07.318 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.198746.log.gz 2023-07-06T02:41:07.318 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.810653.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.111469.log 2023-07-06T02:41:07.319 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.810653.log.gz 2023-07-06T02:41:07.319 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.297581.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.258783.log 2023-07-06T02:41:07.319 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.297581.log.gz 2023-07-06T02:41:07.319 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.111469.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.417984.log 2023-07-06T02:41:07.319 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.258783.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.695103.log 2023-07-06T02:41:07.320 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.258783.log.gz 2023-07-06T02:41:07.320 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.417984.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.368729.log 2023-07-06T02:41:07.320 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.417984.log.gz 2023-07-06T02:41:07.320 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.695103.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.695103.log.gz 2023-07-06T02:41:07.320 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.650082.log 2023-07-06T02:41:07.321 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.368729.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.202070.log 2023-07-06T02:41:07.321 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.368729.log.gz 2023-07-06T02:41:07.321 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.650082.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.371763.log 2023-07-06T02:41:07.321 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.650082.log.gz 2023-07-06T02:41:07.321 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.202070.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.335607.log 2023-07-06T02:41:07.322 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.202070.log.gz 2023-07-06T02:41:07.322 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.371763.log: gzip -5 --verbose -- 0.0%/var/log/ceph/ceph-client.admin.114105.log 2023-07-06T02:41:07.322 INFO:teuthology.orchestra.run.smithi046.stderr: -- replaced with /var/log/ceph/ceph-client.admin.371763.log.gz 2023-07-06T02:41:07.322 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.335607.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.932239.log 2023-07-06T02:41:07.322 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.335607.log.gz 2023-07-06T02:41:07.323 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.114105.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.810639.log 2023-07-06T02:41:07.323 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.932239.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.931696.log 2023-07-06T02:41:07.323 INFO:teuthology.orchestra.run.smithi046.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.932239.log.gz 2023-07-06T02:41:07.323 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.810639.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.411126.log 2023-07-06T02:41:07.323 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.810639.log.gz 2023-07-06T02:41:07.324 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.931696.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.681461.log 2023-07-06T02:41:07.324 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.411126.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.931696.log.gz 2023-07-06T02:41:07.324 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.411126.log.gz 2023-07-06T02:41:07.324 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.620753.log 2023-07-06T02:41:07.324 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.256471.log 2023-07-06T02:41:07.325 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.681461.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.681461.log.gz 2023-07-06T02:41:07.325 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.620753.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.393581.log 2023-07-06T02:41:07.325 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.620753.log.gz 2023-07-06T02:41:07.325 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.256471.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.254997.log 2023-07-06T02:41:07.325 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.256471.log.gz 2023-07-06T02:41:07.326 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.393581.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.193449.log 2023-07-06T02:41:07.326 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.393581.log.gz 2023-07-06T02:41:07.326 INFO:teuthology.orchestra.run.smithi046.stderr: 88.7% -- replaced with /var/log/ceph/ceph.log.gz 2023-07-06T02:41:07.326 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.254997.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.254997.log.gz 2023-07-06T02:41:07.326 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.301025.log 2023-07-06T02:41:07.326 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.193449.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.759542.log 2023-07-06T02:41:07.327 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.193449.log.gz 2023-07-06T02:41:07.327 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.301025.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.209189.log 2023-07-06T02:41:07.327 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.301025.log.gz 2023-07-06T02:41:07.327 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.759542.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.688238.log 2023-07-06T02:41:07.327 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.759542.log.gz 2023-07-06T02:41:07.328 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.209189.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.412670.log 2023-07-06T02:41:07.328 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.209189.log.gz 2023-07-06T02:41:07.328 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.688238.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.700571.log 2023-07-06T02:41:07.328 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.688238.log.gz 2023-07-06T02:41:07.328 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.412670.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.696445.log 2023-07-06T02:41:07.329 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.412670.log.gz 2023-07-06T02:41:07.329 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.700571.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.255077.log 2023-07-06T02:41:07.329 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.700571.log.gz 2023-07-06T02:41:07.329 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.696445.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.353270.log 2023-07-06T02:41:07.329 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.696445.log.gz 2023-07-06T02:41:07.330 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.255077.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.264194.log 2023-07-06T02:41:07.330 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.255077.log.gz 2023-07-06T02:41:07.330 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.353270.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.615220.log 2023-07-06T02:41:07.330 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.353270.log.gz 2023-07-06T02:41:07.330 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.264194.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.621628.log 2023-07-06T02:41:07.330 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.264194.log.gz 2023-07-06T02:41:07.331 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.615220.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.753629.log 2023-07-06T02:41:07.331 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.615220.log.gz 2023-07-06T02:41:07.331 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.621628.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.298045.log 2023-07-06T02:41:07.331 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.621628.log.gz 2023-07-06T02:41:07.331 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.753629.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.754878.log 2023-07-06T02:41:07.332 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.753629.log.gz 2023-07-06T02:41:07.332 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.298045.log: gzip -5 --verbose -- /var/log/ceph/ceph.tmp-client.admin.94500.log 2023-07-06T02:41:07.332 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.298045.log.gz 2023-07-06T02:41:07.332 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.754878.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.772702.log 2023-07-06T02:41:07.333 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.754878.log.gz 2023-07-06T02:41:07.333 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph.tmp-client.admin.94500.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.812609.log 2023-07-06T02:41:07.333 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph.tmp-client.admin.94500.log.gz 2023-07-06T02:41:07.333 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.772702.log: 0.0%gzip -5 -- replaced with /var/log/ceph/ceph-client.admin.772702.log.gz--verbose 2023-07-06T02:41:07.333 INFO:teuthology.orchestra.run.smithi046.stderr:-- /var/log/ceph/ceph-client.admin.305409.log 2023-07-06T02:41:07.333 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.812609.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.415307.log 2023-07-06T02:41:07.334 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.812609.log.gz 2023-07-06T02:41:07.334 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.305409.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.238130.log 2023-07-06T02:41:07.334 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.305409.log.gz 2023-07-06T02:41:07.334 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.415307.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.113829.log 2023-07-06T02:41:07.334 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.415307.log.gz 2023-07-06T02:41:07.335 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.238130.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.667241.log 2023-07-06T02:41:07.335 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.238130.log.gz 2023-07-06T02:41:07.335 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.166273.log 2023-07-06T02:41:07.335 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.113829.log: /var/log/ceph/ceph-client.admin.667241.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.238674.log 2023-07-06T02:41:07.335 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.667241.log.gz 2023-07-06T02:41:07.336 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.166273.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.410144.log 2023-07-06T02:41:07.336 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.166273.log.gz 2023-07-06T02:41:07.336 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.680509.log 2023-07-06T02:41:07.336 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.238674.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.238674.log.gz 2023-07-06T02:41:07.336 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.410144.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.211755.log 2023-07-06T02:41:07.337 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.410144.log.gz 2023-07-06T02:41:07.337 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.680509.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.772716.log 2023-07-06T02:41:07.337 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.680509.log.gz 2023-07-06T02:41:07.337 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.211755.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.807679.log 2023-07-06T02:41:07.337 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.211755.log.gz 2023-07-06T02:41:07.338 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.772716.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.796579.log 2023-07-06T02:41:07.338 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.772716.log.gz 2023-07-06T02:41:07.338 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.807679.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.341924.log 2023-07-06T02:41:07.338 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.807679.log.gz 2023-07-06T02:41:07.338 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.796579.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.314750.log 2023-07-06T02:41:07.339 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.796579.log.gz 2023-07-06T02:41:07.339 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.341924.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.107249.log 2023-07-06T02:41:07.339 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.341924.log.gz 2023-07-06T02:41:07.339 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.314750.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.330690.log 2023-07-06T02:41:07.339 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.314750.log.gz 2023-07-06T02:41:07.340 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.107249.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.297965.log 2023-07-06T02:41:07.340 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.330690.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.419485.log 2023-07-06T02:41:07.340 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.330690.log.gz 2023-07-06T02:41:07.340 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.297965.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.277730.log 2023-07-06T02:41:07.340 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.297965.log.gz 2023-07-06T02:41:07.341 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.419485.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.371777.log 2023-07-06T02:41:07.341 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.419485.log.gz 2023-07-06T02:41:07.341 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.277730.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.932958.log 2023-07-06T02:41:07.341 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.277730.log.gz 2023-07-06T02:41:07.341 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.371777.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.685720.log 2023-07-06T02:41:07.342 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.371777.log.gz 2023-07-06T02:41:07.342 INFO:teuthology.orchestra.run.smithi046.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.113373.log.gz 2023-07-06T02:41:07.342 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.932958.log: /var/log/ceph/ceph-client.admin.416399.log 2023-07-06T02:41:07.342 INFO:teuthology.orchestra.run.smithi046.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.114971.log.gz 2023-07-06T02:41:07.342 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.685720.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.932958.log.gz 2023-07-06T02:41:07.343 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.250846.log 2023-07-06T02:41:07.343 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.685720.log.gz 2023-07-06T02:41:07.343 INFO:teuthology.orchestra.run.smithi046.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.111469.log.gz 2023-07-06T02:41:07.343 INFO:teuthology.orchestra.run.smithi046.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.114105.log.gz 2023-07-06T02:41:07.343 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.416399.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.190021.log 2023-07-06T02:41:07.343 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.416399.log.gz 2023-07-06T02:41:07.344 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.250846.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.408755.log 2023-07-06T02:41:07.344 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.250846.log.gz 2023-07-06T02:41:07.344 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.190021.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.437038.log 2023-07-06T02:41:07.344 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.190021.log.gz 2023-07-06T02:41:07.345 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.408755.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.242487.log 2023-07-06T02:41:07.345 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.408755.log.gz 2023-07-06T02:41:07.345 INFO:teuthology.orchestra.run.smithi046.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.113829.log.gz 2023-07-06T02:41:07.345 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.437038.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.329220.log 2023-07-06T02:41:07.345 INFO:teuthology.orchestra.run.smithi046.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.107249.log.gz 2023-07-06T02:41:07.345 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.437038.log.gz 2023-07-06T02:41:07.346 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.242487.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.358252.log 2023-07-06T02:41:07.346 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.242487.log.gz 2023-07-06T02:41:07.346 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.329220.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.328921.log 2023-07-06T02:41:07.346 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.329220.log.gz 2023-07-06T02:41:07.347 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.358252.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.243456.log 2023-07-06T02:41:07.347 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.358252.log.gz 2023-07-06T02:41:07.347 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.328921.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.312281.log 2023-07-06T02:41:07.347 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.328921.log.gz 2023-07-06T02:41:07.347 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.243456.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.160825.log 2023-07-06T02:41:07.347 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.243456.log.gz 2023-07-06T02:41:07.348 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.312281.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.247108.log 2023-07-06T02:41:07.348 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.312281.log.gz 2023-07-06T02:41:07.348 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.160825.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.685393.log 2023-07-06T02:41:07.348 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.160825.log.gz 2023-07-06T02:41:07.348 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.247108.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.263133.log 2023-07-06T02:41:07.349 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.247108.log.gz 2023-07-06T02:41:07.349 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.685393.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.685393.log.gzgzip 2023-07-06T02:41:07.349 INFO:teuthology.orchestra.run.smithi046.stderr:-5 --verbose -- /var/log/ceph/ceph-client.admin.440349.log 2023-07-06T02:41:07.349 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.263133.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.632434.log 2023-07-06T02:41:07.349 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.263133.log.gz 2023-07-06T02:41:07.350 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.440349.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.464707.log 2023-07-06T02:41:07.350 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.440349.log.gz 2023-07-06T02:41:07.350 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.632434.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.632434.log.gz 2023-07-06T02:41:07.350 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.773851.log 2023-07-06T02:41:07.350 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.464707.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.195103.log 2023-07-06T02:41:07.351 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.464707.log.gz 2023-07-06T02:41:07.351 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.773851.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.922237.log 2023-07-06T02:41:07.351 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.773851.log.gz 2023-07-06T02:41:07.351 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.195103.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.755853.log 2023-07-06T02:41:07.351 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.195103.log.gz 2023-07-06T02:41:07.352 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose /var/log/ceph/ceph-client.admin.922237.log: -- /var/log/ceph/xfstests-dev-results/results/check.log 2023-07-06T02:41:07.352 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.922237.log.gz 2023-07-06T02:41:07.352 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.755853.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.618685.log 2023-07-06T02:41:07.352 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.755853.log.gz 2023-07-06T02:41:07.352 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/xfstests-dev-results/results/check.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.406524.log 2023-07-06T02:41:07.353 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.618685.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.496006.log 2023-07-06T02:41:07.353 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.618685.log.gz 2023-07-06T02:41:07.353 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.406524.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.466756.log 2023-07-06T02:41:07.353 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.406524.log.gz 2023-07-06T02:41:07.353 INFO:teuthology.orchestra.run.smithi046.stderr: 89.6% -- replaced with /var/log/ceph/xfstests-dev-results/results/check.log.gz 2023-07-06T02:41:07.354 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.496006.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.393026.log 2023-07-06T02:41:07.354 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.496006.log.gz 2023-07-06T02:41:07.354 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.466756.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.319477.log 2023-07-06T02:41:07.354 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.466756.log.gz 2023-07-06T02:41:07.354 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.393026.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.375067.log 2023-07-06T02:41:07.355 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.393026.log.gz 2023-07-06T02:41:07.355 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.319477.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.359968.log 2023-07-06T02:41:07.355 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.319477.log.gz 2023-07-06T02:41:07.355 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.375067.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.411047.log 2023-07-06T02:41:07.355 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.375067.log.gz 2023-07-06T02:41:07.355 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.359968.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.354222.log 2023-07-06T02:41:07.356 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.359968.log.gz 2023-07-06T02:41:07.356 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.411047.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.814103.log 2023-07-06T02:41:07.356 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.411047.log.gz 2023-07-06T02:41:07.356 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.354222.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.337386.log 2023-07-06T02:41:07.356 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.354222.log.gz 2023-07-06T02:41:07.357 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.814103.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.372581.log 2023-07-06T02:41:07.357 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.814103.log.gz 2023-07-06T02:41:07.357 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.337386.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.193260.log 2023-07-06T02:41:07.357 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.337386.log.gz 2023-07-06T02:41:07.357 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.372581.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.192560.log 2023-07-06T02:41:07.358 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.372581.log.gz 2023-07-06T02:41:07.358 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.193260.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.676455.log 2023-07-06T02:41:07.358 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.193260.log.gz 2023-07-06T02:41:07.358 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.192560.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.648123.log 2023-07-06T02:41:07.358 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.192560.log.gz 2023-07-06T02:41:07.359 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.676455.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.791803.log 2023-07-06T02:41:07.359 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.676455.log.gz 2023-07-06T02:41:07.359 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.648123.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.465594.log 2023-07-06T02:41:07.359 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.648123.log.gz 2023-07-06T02:41:07.359 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.791803.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.631458.log 2023-07-06T02:41:07.360 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.791803.log.gz 2023-07-06T02:41:07.360 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.465594.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.405728.log 2023-07-06T02:41:07.360 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.465594.log.gz 2023-07-06T02:41:07.360 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.631458.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.753090.log 2023-07-06T02:41:07.360 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.631458.log.gz 2023-07-06T02:41:07.361 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.405728.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.664591.log 2023-07-06T02:41:07.361 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.405728.log.gz 2023-07-06T02:41:07.361 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.753090.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.392162.log 2023-07-06T02:41:07.361 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.753090.log.gz 2023-07-06T02:41:07.361 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.664591.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.309959.log 0.0% 2023-07-06T02:41:07.362 INFO:teuthology.orchestra.run.smithi046.stderr: -- replaced with /var/log/ceph/ceph-client.admin.664591.log.gz 2023-07-06T02:41:07.362 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.392162.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.187368.log 2023-07-06T02:41:07.362 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.392162.log.gz 2023-07-06T02:41:07.362 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.309959.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.392550.log 2023-07-06T02:41:07.362 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.309959.log.gz 2023-07-06T02:41:07.363 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.187368.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.377696.log 2023-07-06T02:41:07.363 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.187368.log.gz 2023-07-06T02:41:07.363 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.392550.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.218267.log 2023-07-06T02:41:07.363 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.392550.log.gz 2023-07-06T02:41:07.363 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.377696.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.811037.log 2023-07-06T02:41:07.363 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.377696.log.gz 2023-07-06T02:41:07.364 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.218267.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.758257.log 2023-07-06T02:41:07.364 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.218267.log.gz 2023-07-06T02:41:07.364 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.811037.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.818326.log 2023-07-06T02:41:07.364 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.811037.log.gz 2023-07-06T02:41:07.365 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.758257.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.269026.log 2023-07-06T02:41:07.365 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.758257.log.gz 2023-07-06T02:41:07.365 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.818326.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.675102.log 2023-07-06T02:41:07.365 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.818326.log.gz 2023-07-06T02:41:07.366 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.269026.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.371563.log 2023-07-06T02:41:07.366 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.269026.log.gz 2023-07-06T02:41:07.366 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.675102.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.313857.log 2023-07-06T02:41:07.366 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.675102.log.gz 2023-07-06T02:41:07.367 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.371563.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.384845.log 2023-07-06T02:41:07.367 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.371563.log.gz 2023-07-06T02:41:07.367 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.313857.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.525816.log 2023-07-06T02:41:07.367 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.313857.log.gz 2023-07-06T02:41:07.367 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.384845.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.611200.log 2023-07-06T02:41:07.368 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.384845.log.gz 2023-07-06T02:41:07.368 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.525816.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.404407.log 2023-07-06T02:41:07.368 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.525816.log.gz 2023-07-06T02:41:07.368 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.611200.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.282209.log 2023-07-06T02:41:07.369 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.611200.log.gz 2023-07-06T02:41:07.369 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.404407.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.654077.log 0.0% 2023-07-06T02:41:07.369 INFO:teuthology.orchestra.run.smithi046.stderr: -- replaced with /var/log/ceph/ceph-client.admin.404407.log.gz 2023-07-06T02:41:07.369 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.282209.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.282209.log.gz 2023-07-06T02:41:07.369 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.686876.log 2023-07-06T02:41:07.370 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.654077.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.331373.log 2023-07-06T02:41:07.370 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.654077.log.gz 2023-07-06T02:41:07.370 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.686876.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.0.log 2023-07-06T02:41:07.370 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.686876.log.gz 2023-07-06T02:41:07.370 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.331373.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.439141.log 2023-07-06T02:41:07.371 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.331373.log.gz 2023-07-06T02:41:07.371 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-osd.0.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.376868.log 2023-07-06T02:41:07.371 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.439141.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.271019.log 2023-07-06T02:41:07.371 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.439141.log.gz 2023-07-06T02:41:07.372 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.376868.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.789528.log 2023-07-06T02:41:07.372 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.376868.log.gz 2023-07-06T02:41:07.372 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.271019.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.106769.log 2023-07-06T02:41:07.372 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.271019.log.gz 2023-07-06T02:41:07.372 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.789528.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.649297.log 2023-07-06T02:41:07.373 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.789528.log.gz 2023-07-06T02:41:07.373 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.106769.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.756624.log 2023-07-06T02:41:07.373 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.649297.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.401985.log 2023-07-06T02:41:07.373 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.649297.log.gz 2023-07-06T02:41:07.374 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.756624.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.817330.log 2023-07-06T02:41:07.374 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.756624.log.gz 2023-07-06T02:41:07.374 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.401985.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.296579.log 2023-07-06T02:41:07.374 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.401985.log.gz 2023-07-06T02:41:07.374 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.817330.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.817330.log.gz 2023-07-06T02:41:07.375 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.332873.log 2023-07-06T02:41:07.375 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.296579.log: gzip 0.0%-5 -- replaced with /var/log/ceph/ceph-client.admin.296579.log.gz--verbose 2023-07-06T02:41:07.375 INFO:teuthology.orchestra.run.smithi046.stderr:-- /var/log/ceph/ceph-client.admin.920785.log 2023-07-06T02:41:07.375 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.332873.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.450282.log 2023-07-06T02:41:07.376 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.332873.log.gz 2023-07-06T02:41:07.376 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.920785.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.615895.log 2023-07-06T02:41:07.376 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.920785.log.gz 2023-07-06T02:41:07.376 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.450282.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.269518.log 2023-07-06T02:41:07.376 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.450282.log.gz 2023-07-06T02:41:07.377 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.615895.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.318715.log 2023-07-06T02:41:07.377 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.615895.log.gz 2023-07-06T02:41:07.377 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.269518.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.288944.log 2023-07-06T02:41:07.377 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.269518.log.gz 2023-07-06T02:41:07.378 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.318715.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.703379.log 2023-07-06T02:41:07.378 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.318715.log.gz 2023-07-06T02:41:07.378 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.288944.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.256776.log 2023-07-06T02:41:07.378 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.288944.log.gz 2023-07-06T02:41:07.378 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.703379.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.312577.log 2023-07-06T02:41:07.379 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.703379.log.gz 2023-07-06T02:41:07.379 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.256776.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.644859.log 2023-07-06T02:41:07.379 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.256776.log.gz 2023-07-06T02:41:07.379 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.312577.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.795335.log 2023-07-06T02:41:07.380 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.312577.log.gz 2023-07-06T02:41:07.380 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.644859.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.467651.log 2023-07-06T02:41:07.380 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.644859.log.gz 2023-07-06T02:41:07.380 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.795335.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.332656.log 2023-07-06T02:41:07.381 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.795335.log.gz 2023-07-06T02:41:07.381 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.467651.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.773391.log 2023-07-06T02:41:07.381 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.467651.log.gz 2023-07-06T02:41:07.381 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.332656.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.113599.log 2023-07-06T02:41:07.381 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.332656.log.gz 2023-07-06T02:41:07.382 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.773391.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.647881.log 2023-07-06T02:41:07.382 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.773391.log.gz 2023-07-06T02:41:07.382 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.113599.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.921755.log 2023-07-06T02:41:07.382 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.647881.log: gzip 0.0%-5 -- replaced with /var/log/ceph/ceph-client.admin.647881.log.gz 2023-07-06T02:41:07.383 INFO:teuthology.orchestra.run.smithi046.stderr:--verbose -- /var/log/ceph/ceph-client.admin.298948.log 2023-07-06T02:41:07.383 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.921755.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.307329.log 2023-07-06T02:41:07.383 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.921755.log.gz 2023-07-06T02:41:07.383 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.298948.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.172256.log 2023-07-06T02:41:07.383 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.298948.log.gz 2023-07-06T02:41:07.384 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.307329.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.816575.log 2023-07-06T02:41:07.384 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.307329.log.gz 2023-07-06T02:41:07.384 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.172256.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.408373.log 2023-07-06T02:41:07.384 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.172256.log.gz 2023-07-06T02:41:07.385 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.816575.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.799955.log 2023-07-06T02:41:07.385 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.816575.log.gz 2023-07-06T02:41:07.385 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.408373.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.107571.log 2023-07-06T02:41:07.385 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.408373.log.gz 2023-07-06T02:41:07.386 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.799955.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.378410.log 2023-07-06T02:41:07.386 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.799955.log.gz 2023-07-06T02:41:07.386 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.107571.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.325124.log 2023-07-06T02:41:07.386 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.378410.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.316985.log 2023-07-06T02:41:07.386 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.378410.log.gz 2023-07-06T02:41:07.387 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.325124.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.300280.log 2023-07-06T02:41:07.387 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.325124.log.gz 2023-07-06T02:41:07.387 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.316985.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.414195.log 2023-07-06T02:41:07.387 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.316985.log.gz 2023-07-06T02:41:07.388 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.300280.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.253625.log 2023-07-06T02:41:07.388 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.300280.log.gz 2023-07-06T02:41:07.388 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.414195.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.299970.log 2023-07-06T02:41:07.388 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.414195.log.gz 2023-07-06T02:41:07.388 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.253625.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.799645.log 2023-07-06T02:41:07.389 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.253625.log.gz 2023-07-06T02:41:07.389 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.299970.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.167351.log 2023-07-06T02:41:07.389 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.299970.log.gz 2023-07-06T02:41:07.389 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.799645.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.752617.log 2023-07-06T02:41:07.390 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.799645.log.gz 2023-07-06T02:41:07.390 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.167351.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.797680.log 2023-07-06T02:41:07.390 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.167351.log.gz 2023-07-06T02:41:07.390 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.752617.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.681835.log 2023-07-06T02:41:07.390 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.752617.log.gz 2023-07-06T02:41:07.391 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.797680.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.463256.log 2023-07-06T02:41:07.391 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.797680.log.gz 2023-07-06T02:41:07.391 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.681835.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.382368.log 2023-07-06T02:41:07.391 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.681835.log.gz 2023-07-06T02:41:07.392 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.463256.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.150488.log 2023-07-06T02:41:07.392 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.463256.log.gz 2023-07-06T02:41:07.392 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.382368.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.397706.log 2023-07-06T02:41:07.392 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.382368.log.gz 2023-07-06T02:41:07.392 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.150488.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.106769.log.gz 2023-07-06T02:41:07.393 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.150488.log.gz 2023-07-06T02:41:07.393 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.248078.log 2023-07-06T02:41:07.393 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.397706.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.924165.log 2023-07-06T02:41:07.393 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.397706.log.gz 2023-07-06T02:41:07.394 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.248078.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.112609.log 2023-07-06T02:41:07.394 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.248078.log.gz 2023-07-06T02:41:07.394 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.924165.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.930740.log 2023-07-06T02:41:07.394 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.924165.log.gz 2023-07-06T02:41:07.394 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.774420.log 2023-07-06T02:41:07.395 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.112609.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.113599.log.gz 2023-07-06T02:41:07.395 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.930740.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.794822.log 2023-07-06T02:41:07.395 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.774420.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.107571.log.gz 2023-07-06T02:41:07.395 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.774420.log.gz 88.8% 2023-07-06T02:41:07.396 INFO:teuthology.orchestra.run.smithi046.stderr: -- replaced with /var/log/ceph/ceph-client.admin.930740.log.gz 2023-07-06T02:41:07.396 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.366983.log 2023-07-06T02:41:07.396 INFO:teuthology.orchestra.run.smithi046.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.112609.log.gz 2023-07-06T02:41:07.396 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.794822.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.628528.log 2023-07-06T02:41:07.396 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.794822.log.gz 2023-07-06T02:41:07.397 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.366983.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.156047.log 2023-07-06T02:41:07.397 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.366983.log.gz 2023-07-06T02:41:07.397 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.628528.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.270477.log 2023-07-06T02:41:07.397 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.628528.log.gz 2023-07-06T02:41:07.398 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.156047.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.205144.log 2023-07-06T02:41:07.398 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.156047.log.gz 2023-07-06T02:41:07.398 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.270477.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.800156.log 2023-07-06T02:41:07.398 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.270477.log.gz 2023-07-06T02:41:07.398 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.205144.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.414762.log 2023-07-06T02:41:07.399 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.205144.log.gz 2023-07-06T02:41:07.399 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.800156.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.383783.log 2023-07-06T02:41:07.399 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.800156.log.gz 2023-07-06T02:41:07.399 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.414762.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.413046.log 2023-07-06T02:41:07.399 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.414762.log.gz 2023-07-06T02:41:07.400 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.383783.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.303871.log 2023-07-06T02:41:07.400 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.383783.log.gz 2023-07-06T02:41:07.400 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.413046.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.450203.log 2023-07-06T02:41:07.400 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.413046.log.gz 2023-07-06T02:41:07.400 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.303871.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.237739.log 2023-07-06T02:41:07.401 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.303871.log.gz 2023-07-06T02:41:07.401 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.450203.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.920370.log 2023-07-06T02:41:07.401 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.450203.log.gz 2023-07-06T02:41:07.401 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.237739.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.159027.log 2023-07-06T02:41:07.401 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.237739.log.gz 2023-07-06T02:41:07.402 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.920370.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.383392.log 2023-07-06T02:41:07.402 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.920370.log.gz 2023-07-06T02:41:07.402 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.159027.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.267061.log 2023-07-06T02:41:07.402 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.159027.log.gz 2023-07-06T02:41:07.402 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.383392.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.197049.log 2023-07-06T02:41:07.403 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.383392.log.gz 2023-07-06T02:41:07.403 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.267061.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.630468.log 2023-07-06T02:41:07.403 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.267061.log.gz 2023-07-06T02:41:07.403 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.197049.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.758935.log 2023-07-06T02:41:07.403 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.197049.log.gz 2023-07-06T02:41:07.403 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.630468.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.360980.log 2023-07-06T02:41:07.404 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.630468.log.gz 2023-07-06T02:41:07.404 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.758935.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.647672.log 2023-07-06T02:41:07.404 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.758935.log.gz 2023-07-06T02:41:07.404 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.360980.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.395952.log 2023-07-06T02:41:07.405 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.360980.log.gz 2023-07-06T02:41:07.405 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.647672.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.334580.log 2023-07-06T02:41:07.405 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.647672.log.gz 2023-07-06T02:41:07.405 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.395952.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.326461.log 2023-07-06T02:41:07.405 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.395952.log.gz 2023-07-06T02:41:07.406 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.334580.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.388873.log 2023-07-06T02:41:07.406 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.334580.log.gz 2023-07-06T02:41:07.406 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.326461.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.611186.log 2023-07-06T02:41:07.406 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.326461.log.gz 2023-07-06T02:41:07.406 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.388873.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.193167.log 2023-07-06T02:41:07.407 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.388873.log.gz 2023-07-06T02:41:07.407 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.611186.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.926186.log 2023-07-06T02:41:07.407 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.611186.log.gz 2023-07-06T02:41:07.407 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.193167.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.925704.log 2023-07-06T02:41:07.407 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.193167.log.gz 2023-07-06T02:41:07.407 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.926186.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.354129.log 2023-07-06T02:41:07.408 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.926186.log.gz 2023-07-06T02:41:07.408 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.925704.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.310253.log 2023-07-06T02:41:07.408 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.925704.log.gz 2023-07-06T02:41:07.408 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.354129.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.567181.log 2023-07-06T02:41:07.408 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.354129.log.gz 2023-07-06T02:41:07.409 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.310253.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.311250.log 2023-07-06T02:41:07.409 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.310253.log.gz 2023-07-06T02:41:07.409 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.567181.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.407488.log 2023-07-06T02:41:07.409 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.567181.log.gz 2023-07-06T02:41:07.409 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.311250.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.311250.log.gz 2023-07-06T02:41:07.410 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.381984.log 2023-07-06T02:41:07.410 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.407488.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.345489.log 2023-07-06T02:41:07.410 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.407488.log.gz 2023-07-06T02:41:07.410 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.381984.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.381984.log.gz 2023-07-06T02:41:07.410 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.158934.log 2023-07-06T02:41:07.411 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.345489.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.289175.log 2023-07-06T02:41:07.411 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.345489.log.gz 2023-07-06T02:41:07.411 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.158934.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.158934.log.gz 2023-07-06T02:41:07.411 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.682302.log 2023-07-06T02:41:07.411 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.289175.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.293702.log 2023-07-06T02:41:07.412 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.289175.log.gz 2023-07-06T02:41:07.412 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.682302.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.191284.log 0.0% 2023-07-06T02:41:07.412 INFO:teuthology.orchestra.run.smithi046.stderr: -- replaced with /var/log/ceph/ceph-client.admin.682302.log.gz 2023-07-06T02:41:07.412 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.293702.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.667611.log 2023-07-06T02:41:07.412 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.293702.log.gz 2023-07-06T02:41:07.412 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.191284.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.694445.log 2023-07-06T02:41:07.413 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.191284.log.gz 2023-07-06T02:41:07.413 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.667611.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.270556.log 2023-07-06T02:41:07.413 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.667611.log.gz 2023-07-06T02:41:07.413 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.694445.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.694445.log.gz 2023-07-06T02:41:07.413 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.375298.log 2023-07-06T02:41:07.414 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.270556.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.695980.log 2023-07-06T02:41:07.414 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.270556.log.gz 2023-07-06T02:41:07.414 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.375298.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.407979.log 2023-07-06T02:41:07.414 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.375298.log.gz 2023-07-06T02:41:07.414 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.695980.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.928132.log 2023-07-06T02:41:07.415 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.695980.log.gz 2023-07-06T02:41:07.415 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.407979.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.407979.log.gz 2023-07-06T02:41:07.415 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.614715.log 2023-07-06T02:41:07.415 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.928132.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.187354.log 2023-07-06T02:41:07.415 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.928132.log.gz 2023-07-06T02:41:07.416 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.614715.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.614715.log.gz 2023-07-06T02:41:07.416 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.172727.log 2023-07-06T02:41:07.416 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.187354.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.305640.log 2023-07-06T02:41:07.416 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.187354.log.gz 2023-07-06T02:41:07.416 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.172727.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.172727.log.gz 2023-07-06T02:41:07.417 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.417502.log 2023-07-06T02:41:07.417 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.305640.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.265681.log 2023-07-06T02:41:07.417 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.305640.log.gz 2023-07-06T02:41:07.417 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.417502.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.931169.log 2023-07-06T02:41:07.417 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.417502.log.gz 2023-07-06T02:41:07.417 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.265681.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.204549.log 2023-07-06T02:41:07.418 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.265681.log.gz 2023-07-06T02:41:07.418 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.931169.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.368119.log 2023-07-06T02:41:07.418 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.204549.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.931169.log.gz 2023-07-06T02:41:07.418 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.256177.log 2023-07-06T02:41:07.418 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.204549.log.gz 2023-07-06T02:41:07.419 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.368119.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.195182.log 2023-07-06T02:41:07.419 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.368119.log.gz 2023-07-06T02:41:07.419 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.256177.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.277217.log 2023-07-06T02:41:07.419 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.256177.log.gz 2023-07-06T02:41:07.419 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.195182.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.285786.log 2023-07-06T02:41:07.420 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.195182.log.gz 2023-07-06T02:41:07.420 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.277217.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.632925.log 2023-07-06T02:41:07.420 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.277217.log.gz 2023-07-06T02:41:07.420 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.285786.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.410130.log 2023-07-06T02:41:07.420 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.285786.log.gz 2023-07-06T02:41:07.421 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.632925.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.815668.log 2023-07-06T02:41:07.421 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.632925.log.gz 2023-07-06T02:41:07.421 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.410130.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.273085.log 2023-07-06T02:41:07.421 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.410130.log.gz 2023-07-06T02:41:07.421 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.815668.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.697501.log 2023-07-06T02:41:07.422 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.815668.log.gz 2023-07-06T02:41:07.422 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mds.a.log /var/log/ceph/ceph-client.admin.273085.log: 2023-07-06T02:41:07.422 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.273085.log.gz 2023-07-06T02:41:07.422 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.697501.log: 0.0%gzip -5 -- replaced with /var/log/ceph/ceph-client.admin.697501.log.gz--verbose 2023-07-06T02:41:07.422 INFO:teuthology.orchestra.run.smithi046.stderr:-- /var/log/ceph/ceph-client.admin.274310.log 2023-07-06T02:41:07.423 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-mds.a.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.162741.log 2023-07-06T02:41:07.423 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.274310.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.157448.log 2023-07-06T02:41:07.423 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.274310.log.gz 2023-07-06T02:41:07.423 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.162741.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.356779.log 2023-07-06T02:41:07.423 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.162741.log.gz 2023-07-06T02:41:07.424 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.157448.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.792761.log 2023-07-06T02:41:07.424 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.157448.log.gz 2023-07-06T02:41:07.424 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.356779.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.217804.log 2023-07-06T02:41:07.424 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.356779.log.gz 2023-07-06T02:41:07.424 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.792761.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.635283.log 2023-07-06T02:41:07.425 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.792761.log.gz 2023-07-06T02:41:07.425 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.217804.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.395649.log 2023-07-06T02:41:07.425 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.217804.log.gz 2023-07-06T02:41:07.425 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.635283.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.815129.log 2023-07-06T02:41:07.425 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.635283.log.gz 2023-07-06T02:41:07.426 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.395649.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.221131.log 2023-07-06T02:41:07.426 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.395649.log.gz 2023-07-06T02:41:07.426 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.815129.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.614214.log 2023-07-06T02:41:07.426 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.815129.log.gz 2023-07-06T02:41:07.426 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.221131.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.299552.log 2023-07-06T02:41:07.427 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.221131.log.gz 2023-07-06T02:41:07.427 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.614214.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.634720.log 2023-07-06T02:41:07.427 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.614214.log.gz 2023-07-06T02:41:07.427 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.299552.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.293996.log 2023-07-06T02:41:07.427 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.299552.log.gz 2023-07-06T02:41:07.427 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.634720.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.298525.log 2023-07-06T02:41:07.428 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.634720.log.gz 2023-07-06T02:41:07.428 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.293996.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.264699.log 2023-07-06T02:41:07.428 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.293996.log.gz 2023-07-06T02:41:07.428 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.298525.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.203061.log 2023-07-06T02:41:07.429 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.298525.log.gz 2023-07-06T02:41:07.429 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.264699.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.160360.log 2023-07-06T02:41:07.429 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.264699.log.gz 2023-07-06T02:41:07.429 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.203061.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.932837.log 2023-07-06T02:41:07.429 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.203061.log.gz 2023-07-06T02:41:07.430 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.160360.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.302534.log 2023-07-06T02:41:07.430 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.160360.log.gz 2023-07-06T02:41:07.430 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.932837.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.614228.log 2023-07-06T02:41:07.430 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.302534.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.932837.log.gz 2023-07-06T02:41:07.430 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.249831.log 2023-07-06T02:41:07.431 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.302534.log.gz 2023-07-06T02:41:07.431 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.614228.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.409547.log 2023-07-06T02:41:07.431 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.614228.log.gz 2023-07-06T02:41:07.431 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.249831.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.404500.log 2023-07-06T02:41:07.432 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.249831.log.gz 2023-07-06T02:41:07.432 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.327493.log 2023-07-06T02:41:07.432 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.409547.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.409547.log.gz 2023-07-06T02:41:07.432 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.404500.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.249527.log 2023-07-06T02:41:07.432 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.404500.log.gz 2023-07-06T02:41:07.433 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.327493.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.396153.log 2023-07-06T02:41:07.433 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.327493.log.gz 2023-07-06T02:41:07.433 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.249527.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.624114.log 2023-07-06T02:41:07.433 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.249527.log.gz 2023-07-06T02:41:07.434 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.396153.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.217154.log 2023-07-06T02:41:07.434 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.396153.log.gz 2023-07-06T02:41:07.434 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.624114.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.387926.log 2023-07-06T02:41:07.434 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.624114.log.gz 2023-07-06T02:41:07.434 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.217154.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.328244.log 2023-07-06T02:41:07.435 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.217154.log.gz 2023-07-06T02:41:07.435 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.387926.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.347079.log 2023-07-06T02:41:07.435 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.387926.log.gz 2023-07-06T02:41:07.435 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.328244.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.258690.log 2023-07-06T02:41:07.436 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.328244.log.gz 2023-07-06T02:41:07.436 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.347079.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.417998.log 2023-07-06T02:41:07.436 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.347079.log.gz 2023-07-06T02:41:07.436 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.258690.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.317551.log 2023-07-06T02:41:07.436 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.258690.log.gz 2023-07-06T02:41:07.437 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.417998.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.794078.log 2023-07-06T02:41:07.437 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.417998.log.gz 2023-07-06T02:41:07.437 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.317551.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.386866.log 2023-07-06T02:41:07.437 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.317551.log.gz 2023-07-06T02:41:07.438 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.794078.log: 0.0%gzip -5 -- replaced with /var/log/ceph/ceph-client.admin.794078.log.gz--verbose 2023-07-06T02:41:07.438 INFO:teuthology.orchestra.run.smithi046.stderr:-- /var/log/ceph/ceph-client.admin.290458.log 2023-07-06T02:41:07.438 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.386866.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.438640.log 2023-07-06T02:41:07.438 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.386866.log.gz 2023-07-06T02:41:07.438 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.290458.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.794309.log 2023-07-06T02:41:07.439 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.290458.log.gz 2023-07-06T02:41:07.439 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.438640.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.247620.log 2023-07-06T02:41:07.439 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.438640.log.gz 2023-07-06T02:41:07.439 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.794309.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.683767.log 2023-07-06T02:41:07.439 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.794309.log.gz 2023-07-06T02:41:07.440 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.618900.log 2023-07-06T02:41:07.440 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.247620.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.247620.log.gz 2023-07-06T02:41:07.440 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.683767.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.639757.log 2023-07-06T02:41:07.440 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.683767.log.gz 2023-07-06T02:41:07.441 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.618900.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.796889.log 2023-07-06T02:41:07.441 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.618900.log.gz 2023-07-06T02:41:07.441 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.639757.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.691152.log 2023-07-06T02:41:07.441 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.639757.log.gz 2023-07-06T02:41:07.442 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.796889.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.931031.log 2023-07-06T02:41:07.442 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.796889.log.gz 2023-07-06T02:41:07.443 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.691152.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.812139.log 2023-07-06T02:41:07.443 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.691152.log.gz 2023-07-06T02:41:07.443 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.931031.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.216756.log 2023-07-06T02:41:07.444 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.812139.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.665102.log 2023-07-06T02:41:07.444 INFO:teuthology.orchestra.run.smithi046.stderr: 88.7% 0.0% -- replaced with /var/log/ceph/ceph-client.admin.931031.log.gz -- replaced with /var/log/ceph/ceph-client.admin.812139.log.gz 2023-07-06T02:41:07.444 INFO:teuthology.orchestra.run.smithi046.stderr: 2023-07-06T02:41:07.445 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.216756.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.931917.log 2023-07-06T02:41:07.445 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.216756.log.gz 2023-07-06T02:41:07.445 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.665102.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.113086.log 2023-07-06T02:41:07.446 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.665102.log.gz 2023-07-06T02:41:07.446 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.796161.log /var/log/ceph/ceph-client.admin.931917.log: 2023-07-06T02:41:07.446 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.113086.log: gzip 87.3%-5 --verbose -- -- replaced with /var/log/ceph/ceph-client.admin.931917.log.gz/var/log/ceph/ceph-client.admin.625064.log 2023-07-06T02:41:07.446 INFO:teuthology.orchestra.run.smithi046.stderr: 2023-07-06T02:41:07.447 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.796161.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.367062.log 2023-07-06T02:41:07.447 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.796161.log.gz 2023-07-06T02:41:07.447 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.625064.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.627523.log 2023-07-06T02:41:07.448 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.625064.log.gz 2023-07-06T02:41:07.448 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.367062.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.318527.log 2023-07-06T02:41:07.448 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.367062.log.gz 2023-07-06T02:41:07.448 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.627523.log: 0.0%gzip -- replaced with /var/log/ceph/ceph-client.admin.627523.log.gz-5 2023-07-06T02:41:07.449 INFO:teuthology.orchestra.run.smithi046.stderr:--verbose -- /var/log/ceph/ceph-client.admin.395169.log 2023-07-06T02:41:07.449 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.318527.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.270107.log 2023-07-06T02:41:07.449 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.318527.log.gz 2023-07-06T02:41:07.449 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.395169.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.801824.log 2023-07-06T02:41:07.449 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.395169.log.gz 2023-07-06T02:41:07.450 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.270107.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.678484.log 2023-07-06T02:41:07.450 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.270107.log.gz 2023-07-06T02:41:07.450 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.801824.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.194629.log 2023-07-06T02:41:07.450 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.801824.log.gz 2023-07-06T02:41:07.451 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.678484.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.464158.log 2023-07-06T02:41:07.451 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.678484.log.gz 2023-07-06T02:41:07.451 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.630998.log 2023-07-06T02:41:07.451 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.194629.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.194629.log.gz 2023-07-06T02:41:07.451 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.464158.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.393105.log 2023-07-06T02:41:07.452 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.464158.log.gz 2023-07-06T02:41:07.452 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.630998.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.276396.log 2023-07-06T02:41:07.452 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.630998.log.gz 2023-07-06T02:41:07.452 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.208030.log 2023-07-06T02:41:07.453 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.393105.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.393105.log.gz 2023-07-06T02:41:07.453 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.276396.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.467228.log 2023-07-06T02:41:07.453 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.276396.log.gz 2023-07-06T02:41:07.453 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.208030.log: /var/log/ceph/ceph-client.admin.263717.log 2023-07-06T02:41:07.454 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.208030.log.gz 2023-07-06T02:41:07.454 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.467228.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.170598.log 2023-07-06T02:41:07.454 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.467228.log.gz 2023-07-06T02:41:07.454 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.263717.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.638681.log 2023-07-06T02:41:07.455 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.263717.log.gz 2023-07-06T02:41:07.455 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.170598.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.403930.log 2023-07-06T02:41:07.455 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.170598.log.gz 2023-07-06T02:41:07.455 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.638681.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.651294.log 2023-07-06T02:41:07.456 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.638681.log.gz 2023-07-06T02:41:07.456 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.403930.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.112655.log 2023-07-06T02:41:07.456 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.403930.log.gz 2023-07-06T02:41:07.456 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.651294.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.273799.log 2023-07-06T02:41:07.456 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.651294.log.gz 2023-07-06T02:41:07.457 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.112655.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.289455.log 2023-07-06T02:41:07.457 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.273799.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.162196.log 2023-07-06T02:41:07.457 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.273799.log.gz 2023-07-06T02:41:07.458 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.206980.log 2023-07-06T02:41:07.458 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.289455.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.289455.log.gz 2023-07-06T02:41:07.458 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.162196.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.338390.log 2023-07-06T02:41:07.458 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.162196.log.gz 2023-07-06T02:41:07.459 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.206980.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.793487.log 2023-07-06T02:41:07.459 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.206980.log.gz 2023-07-06T02:41:07.459 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.338390.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.771127.log 2023-07-06T02:41:07.459 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.338390.log.gz 2023-07-06T02:41:07.459 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.793487.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.173121.log 2023-07-06T02:41:07.460 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.793487.log.gz 2023-07-06T02:41:07.460 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.771127.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.372091.log 2023-07-06T02:41:07.460 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.771127.log.gz 2023-07-06T02:41:07.460 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.173121.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.639285.log 2023-07-06T02:41:07.461 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.173121.log.gz 2023-07-06T02:41:07.461 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.372091.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.280255.log 2023-07-06T02:41:07.461 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.372091.log.gz 2023-07-06T02:41:07.461 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.639285.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.355238.log 2023-07-06T02:41:07.461 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.639285.log.gz 2023-07-06T02:41:07.462 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.280255.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.261228.log 2023-07-06T02:41:07.462 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.280255.log.gz 2023-07-06T02:41:07.462 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.355238.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.644780.log 2023-07-06T02:41:07.462 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.355238.log.gz 2023-07-06T02:41:07.462 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.261228.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.768557.log 2023-07-06T02:41:07.463 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.261228.log.gz 2023-07-06T02:41:07.463 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.644780.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.198760.log 2023-07-06T02:41:07.463 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.644780.log.gz 2023-07-06T02:41:07.463 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.768557.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.383862.log 2023-07-06T02:41:07.463 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.768557.log.gz 2023-07-06T02:41:07.464 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.198760.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.291480.log 2023-07-06T02:41:07.464 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.198760.log.gz 2023-07-06T02:41:07.464 INFO:teuthology.orchestra.run.smithi046.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.113086.log.gz 2023-07-06T02:41:07.464 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.383862.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.636728.log 2023-07-06T02:41:07.464 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.383862.log.gz 2023-07-06T02:41:07.465 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.291480.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.331658.log 2023-07-06T02:41:07.465 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.291480.log.gz 2023-07-06T02:41:07.465 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.636728.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.929003.log 2023-07-06T02:41:07.465 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.636728.log.gz 2023-07-06T02:41:07.465 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.331658.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.331658.log.gz 2023-07-06T02:41:07.466 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.403546.log 2023-07-06T02:41:07.466 INFO:teuthology.orchestra.run.smithi046.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.112655.log.gz 2023-07-06T02:41:07.466 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.190513.log 2023-07-06T02:41:07.466 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.929003.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.929003.log.gz 2023-07-06T02:41:07.467 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.403546.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.170505.log 2023-07-06T02:41:07.467 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.403546.log.gz 2023-07-06T02:41:07.467 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.330597.log 2023-07-06T02:41:07.467 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.190513.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.190513.log.gz 2023-07-06T02:41:07.467 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.170505.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.327700.log 0.0% 2023-07-06T02:41:07.467 INFO:teuthology.orchestra.run.smithi046.stderr: -- replaced with /var/log/ceph/ceph-client.admin.170505.log.gz 2023-07-06T02:41:07.468 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.330597.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.319909.log 2023-07-06T02:41:07.468 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.330597.log.gz 2023-07-06T02:41:07.468 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.327700.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.612675.log 2023-07-06T02:41:07.468 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.327700.log.gz 2023-07-06T02:41:07.468 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.319909.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.342003.log 2023-07-06T02:41:07.469 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.319909.log.gz 2023-07-06T02:41:07.469 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.612675.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.320499.log 2023-07-06T02:41:07.469 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.612675.log.gz 2023-07-06T02:41:07.469 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.342003.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.271761.log 2023-07-06T02:41:07.469 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.342003.log.gz 2023-07-06T02:41:07.470 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.320499.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.682769.log 2023-07-06T02:41:07.470 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.320499.log.gz 2023-07-06T02:41:07.470 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.271761.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.688145.log 2023-07-06T02:41:07.470 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.271761.log.gz 2023-07-06T02:41:07.470 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.682769.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.385871.log 2023-07-06T02:41:07.471 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.682769.log.gz 2023-07-06T02:41:07.471 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.688145.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.170882.log 2023-07-06T02:41:07.471 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.688145.log.gz 2023-07-06T02:41:07.471 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.385871.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.112436.log 2023-07-06T02:41:07.471 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.385871.log.gz 2023-07-06T02:41:07.472 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.170882.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.310174.log 2023-07-06T02:41:07.472 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.170882.log.gz 2023-07-06T02:41:07.472 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.112436.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.463788.log 2023-07-06T02:41:07.472 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.310174.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.205611.log 2023-07-06T02:41:07.472 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.310174.log.gz 2023-07-06T02:41:07.473 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.463788.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.341413.log 2023-07-06T02:41:07.473 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.463788.log.gz 2023-07-06T02:41:07.473 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.205611.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.794591.log 2023-07-06T02:41:07.473 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.205611.log.gz 2023-07-06T02:41:07.473 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.341413.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.187859.log 2023-07-06T02:41:07.473 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.341413.log.gz 2023-07-06T02:41:07.474 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.794591.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.767988.log 2023-07-06T02:41:07.474 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.794591.log.gz 2023-07-06T02:41:07.474 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.187859.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.278973.log 2023-07-06T02:41:07.474 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.187859.log.gz 2023-07-06T02:41:07.474 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.767988.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.108623.log 2023-07-06T02:41:07.475 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.767988.log.gz 2023-07-06T02:41:07.475 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.278973.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.333548.log 2023-07-06T02:41:07.475 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.278973.log.gz 2023-07-06T02:41:07.475 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.108623.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.752068.log 2023-07-06T02:41:07.475 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.333548.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.615881.log 2023-07-06T02:41:07.476 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.333548.log.gz 2023-07-06T02:41:07.476 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.752068.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.621144.log 2023-07-06T02:41:07.476 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.752068.log.gz 2023-07-06T02:41:07.476 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.611800.log 2023-07-06T02:41:07.476 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.615881.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.615881.log.gz 2023-07-06T02:41:07.477 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.621144.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.621144.log.gzgzip 2023-07-06T02:41:07.477 INFO:teuthology.orchestra.run.smithi046.stderr:-5 --verbose -- /var/log/ceph/ceph-client.admin.691059.log 2023-07-06T02:41:07.477 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.611800.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.610722.log 2023-07-06T02:41:07.477 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.611800.log.gz 2023-07-06T02:41:07.477 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.691059.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.687755.log 2023-07-06T02:41:07.478 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.691059.log.gz 2023-07-06T02:41:07.478 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.610722.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.109018.log 2023-07-06T02:41:07.478 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.610722.log.gz 2023-07-06T02:41:07.478 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.687755.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.669280.log 2023-07-06T02:41:07.478 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.687755.log.gz 2023-07-06T02:41:07.479 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.109018.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.293716.log 2023-07-06T02:41:07.479 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.669280.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.260751.log 2023-07-06T02:41:07.479 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.669280.log.gz 2023-07-06T02:41:07.479 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.293716.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.277203.log 2023-07-06T02:41:07.479 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.293716.log.gz 2023-07-06T02:41:07.480 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.260751.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.361724.log 2023-07-06T02:41:07.480 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.260751.log.gz 2023-07-06T02:41:07.480 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.277203.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.243893.log 2023-07-06T02:41:07.480 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.277203.log.gz 2023-07-06T02:41:07.480 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.361724.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.366062.log 2023-07-06T02:41:07.481 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.361724.log.gz 2023-07-06T02:41:07.481 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.243893.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.196151.log 2023-07-06T02:41:07.481 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.243893.log.gz 2023-07-06T02:41:07.481 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.366062.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.273302.log 2023-07-06T02:41:07.481 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.366062.log.gz 2023-07-06T02:41:07.481 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.196151.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.201069.log 2023-07-06T02:41:07.482 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.196151.log.gz 2023-07-06T02:41:07.482 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.273302.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.285989.log 2023-07-06T02:41:07.482 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.273302.log.gz 2023-07-06T02:41:07.482 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.201069.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.365513.log 2023-07-06T02:41:07.483 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.201069.log.gz 2023-07-06T02:41:07.483 INFO:teuthology.orchestra.run.smithi046.stderr:gzip /var/log/ceph/ceph-client.admin.285989.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.702496.log 2023-07-06T02:41:07.483 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.285989.log.gz 2023-07-06T02:41:07.483 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.365513.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.212666.log 2023-07-06T02:41:07.483 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.365513.log.gz 2023-07-06T02:41:07.483 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.702496.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.770363.log 2023-07-06T02:41:07.484 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.702496.log.gz 2023-07-06T02:41:07.484 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.212666.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.404977.log 2023-07-06T02:41:07.484 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.212666.log.gz 2023-07-06T02:41:07.484 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.770363.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.114243.log 2023-07-06T02:41:07.485 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.770363.log.gz 2023-07-06T02:41:07.485 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.404977.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.289672.log 2023-07-06T02:41:07.485 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.404977.log.gz 2023-07-06T02:41:07.485 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.114243.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.293917.log 2023-07-06T02:41:07.485 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.289672.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.771655.log 2023-07-06T02:41:07.485 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.289672.log.gz 2023-07-06T02:41:07.486 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.293917.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.293499.log 2023-07-06T02:41:07.486 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.293917.log.gz 2023-07-06T02:41:07.486 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.771655.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.311840.log 2023-07-06T02:41:07.486 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.771655.log.gz 2023-07-06T02:41:07.486 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.293499.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.3.log 2023-07-06T02:41:07.487 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.293499.log.gz 2023-07-06T02:41:07.487 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.311840.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.391665.log 2023-07-06T02:41:07.487 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.311840.log.gz 2023-07-06T02:41:07.487 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-osd.3.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.811715.log 2023-07-06T02:41:07.487 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.391665.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.200187.log 2023-07-06T02:41:07.488 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.391665.log.gz 2023-07-06T02:41:07.488 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.811715.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.638245.log 2023-07-06T02:41:07.488 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.811715.log.gz 2023-07-06T02:41:07.489 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.200187.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.326963.log 2023-07-06T02:41:07.489 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.200187.log.gz 2023-07-06T02:41:07.489 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.638245.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.615127.log 2023-07-06T02:41:07.489 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.638245.log.gz 2023-07-06T02:41:07.490 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.326963.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.689191.log 2023-07-06T02:41:07.490 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.326963.log.gz 2023-07-06T02:41:07.490 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.615127.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.344703.log 2023-07-06T02:41:07.490 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.615127.log.gz 2023-07-06T02:41:07.490 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.689191.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.108512.log 2023-07-06T02:41:07.491 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.689191.log.gz 2023-07-06T02:41:07.491 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.344703.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.344703.log.gz 2023-07-06T02:41:07.491 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.407689.log 2023-07-06T02:41:07.491 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.108512.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.804982.log 2023-07-06T02:41:07.492 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.407689.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.111377.log 2023-07-06T02:41:07.492 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.407689.log.gz 2023-07-06T02:41:07.492 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.804982.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.298446.log 2023-07-06T02:41:07.492 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.804982.log.gz 2023-07-06T02:41:07.493 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.111377.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.289966.log 2023-07-06T02:41:07.493 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.298446.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.677544.log 2023-07-06T02:41:07.493 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.298446.log.gz 2023-07-06T02:41:07.493 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.289966.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.289966.log.gz 2023-07-06T02:41:07.494 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.773944.log 2023-07-06T02:41:07.494 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.677544.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.797169.log 2023-07-06T02:41:07.494 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.677544.log.gz 2023-07-06T02:41:07.494 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.773944.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.773944.log.gz 2023-07-06T02:41:07.495 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.755159.log 2023-07-06T02:41:07.495 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.797169.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.189824.log 2023-07-06T02:41:07.495 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.797169.log.gz 2023-07-06T02:41:07.495 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.755159.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.755159.log.gz 2023-07-06T02:41:07.495 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.189333.log 2023-07-06T02:41:07.496 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.189824.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.630984.log 2023-07-06T02:41:07.496 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.189824.log.gz 2023-07-06T02:41:07.496 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.189333.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.189333.log.gz 2023-07-06T02:41:07.496 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.308280.log 2023-07-06T02:41:07.497 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.630984.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.699120.log 2023-07-06T02:41:07.497 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.630984.log.gz 2023-07-06T02:41:07.497 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.308280.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.466441.log 2023-07-06T02:41:07.497 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.308280.log.gz 2023-07-06T02:41:07.497 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.699120.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.689707.log 2023-07-06T02:41:07.498 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.699120.log.gz 2023-07-06T02:41:07.498 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.466441.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.466441.log.gz 2023-07-06T02:41:07.498 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.304419.log 2023-07-06T02:41:07.498 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.689707.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.174702.log 2023-07-06T02:41:07.499 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.689707.log.gz 2023-07-06T02:41:07.499 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.304419.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.332642.log 2023-07-06T02:41:07.499 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.304419.log.gz 2023-07-06T02:41:07.499 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.174702.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.305934.log 2023-07-06T02:41:07.500 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.174702.log.gz 2023-07-06T02:41:07.500 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.332642.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.332642.log.gz 2023-07-06T02:41:07.500 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.287271.log 2023-07-06T02:41:07.500 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.305934.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.153970.log 2023-07-06T02:41:07.501 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.305934.log.gz 2023-07-06T02:41:07.501 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.287271.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.682395.log 2023-07-06T02:41:07.501 INFO:teuthology.orchestra.run.smithi046.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.112436.log.gz 2023-07-06T02:41:07.501 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.287271.log.gz 2023-07-06T02:41:07.501 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.153970.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.927557.log 2023-07-06T02:41:07.502 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.153970.log.gz 2023-07-06T02:41:07.502 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.682395.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.188149.log 2023-07-06T02:41:07.502 INFO:teuthology.orchestra.run.smithi046.stderr: 88.1% 0.0% -- replaced with /var/log/ceph/ceph-client.admin.109018.log.gz 2023-07-06T02:41:07.502 INFO:teuthology.orchestra.run.smithi046.stderr: -- replaced with /var/log/ceph/ceph-client.admin.682395.log.gz 2023-07-06T02:41:07.503 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.927557.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.344206.log 2023-07-06T02:41:07.503 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.927557.log.gz 2023-07-06T02:41:07.503 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.188149.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.188149.log.gz 2023-07-06T02:41:07.503 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.611707.log 2023-07-06T02:41:07.504 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.344206.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.290675.log 2023-07-06T02:41:07.504 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.344206.log.gz 2023-07-06T02:41:07.504 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.611707.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.611707.log.gz 2023-07-06T02:41:07.504 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.306399.log 2023-07-06T02:41:07.505 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.290675.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.335096.log 2023-07-06T02:41:07.505 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.290675.log.gz 2023-07-06T02:41:07.505 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.306399.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.306399.log.gz 2023-07-06T02:41:07.505 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.206596.log 2023-07-06T02:41:07.506 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.335096.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.391112.log 2023-07-06T02:41:07.506 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.335096.log.gz 2023-07-06T02:41:07.506 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.206596.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.206596.log.gz 2023-07-06T02:41:07.506 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.114879.log 2023-07-06T02:41:07.506 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.366536.log 2023-07-06T02:41:07.507 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.391112.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.391112.log.gz 2023-07-06T02:41:07.507 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.114879.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.933004.log 2023-07-06T02:41:07.507 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.366536.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.220416.log 2023-07-06T02:41:07.507 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.366536.log.gz 2023-07-06T02:41:07.508 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.933004.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.436552.log 2023-07-06T02:41:07.508 INFO:teuthology.orchestra.run.smithi046.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.933004.log.gz 2023-07-06T02:41:07.508 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.220416.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.220416.log.gz 2023-07-06T02:41:07.508 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.674635.log 2023-07-06T02:41:07.509 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.929510.log 2023-07-06T02:41:07.509 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.436552.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.436552.log.gz 2023-07-06T02:41:07.509 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.674635.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.767369.log 2023-07-06T02:41:07.509 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.674635.log.gz 2023-07-06T02:41:07.509 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.929510.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.293032.log 2023-07-06T02:41:07.510 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.929510.log.gz 2023-07-06T02:41:07.510 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.767369.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.767369.log.gz 2023-07-06T02:41:07.510 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.252063.log 2023-07-06T02:41:07.510 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.293032.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.391205.log 2023-07-06T02:41:07.511 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.293032.log.gz 2023-07-06T02:41:07.511 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.252063.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.252063.log.gz 2023-07-06T02:41:07.511 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.272059.log 2023-07-06T02:41:07.511 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.391205.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.410051.log 2023-07-06T02:41:07.512 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.391205.log.gz 2023-07-06T02:41:07.512 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.272059.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.272059.log.gz 2023-07-06T02:41:07.512 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.362953.log 2023-07-06T02:41:07.512 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.410051.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.615678.log 2023-07-06T02:41:07.512 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.410051.log.gz 2023-07-06T02:41:07.513 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.362953.log: 0.0%gzip -- replaced with /var/log/ceph/ceph-client.admin.362953.log.gz-5 2023-07-06T02:41:07.513 INFO:teuthology.orchestra.run.smithi046.stderr:--verbose -- /var/log/ceph/ceph-client.admin.270570.log 2023-07-06T02:41:07.513 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.615678.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.370236.log 2023-07-06T02:41:07.513 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.615678.log.gz 2023-07-06T02:41:07.514 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.270570.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.270570.log.gz 2023-07-06T02:41:07.514 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.208044.log 2023-07-06T02:41:07.514 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.370236.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.626505.log 2023-07-06T02:41:07.514 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.370236.log.gz 2023-07-06T02:41:07.514 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.208044.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.208044.log.gz 2023-07-06T02:41:07.515 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.807280.log 2023-07-06T02:41:07.515 INFO:teuthology.orchestra.run.smithi046.stderr:gzip /var/log/ceph/ceph-client.admin.626505.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.335406.log 2023-07-06T02:41:07.515 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.626505.log.gz 2023-07-06T02:41:07.515 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.807280.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.807280.log.gz 2023-07-06T02:41:07.516 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.664281.log 2023-07-06T02:41:07.516 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.335406.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.679122.log 2023-07-06T02:41:07.516 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.335406.log.gz 2023-07-06T02:41:07.516 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.664281.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.664281.log.gz 2023-07-06T02:41:07.517 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.413612.log 2023-07-06T02:41:07.517 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.679122.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.669089.log 2023-07-06T02:41:07.517 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.679122.log.gz 2023-07-06T02:41:07.517 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.413612.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.413612.log.gz 2023-07-06T02:41:07.518 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.107663.log 2023-07-06T02:41:07.518 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.669089.log: gzip -5 --verbose 0.0%-- /var/log/ceph/ceph-client.admin.609686.log -- replaced with /var/log/ceph/ceph-client.admin.669089.log.gz 2023-07-06T02:41:07.518 INFO:teuthology.orchestra.run.smithi046.stderr: 2023-07-06T02:41:07.518 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.107663.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.357342.log 2023-07-06T02:41:07.518 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.609686.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.689098.log 2023-07-06T02:41:07.519 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.609686.log.gz 2023-07-06T02:41:07.519 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.357342.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.699603.log 2023-07-06T02:41:07.519 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.357342.log.gz 2023-07-06T02:41:07.519 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.689098.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.689098.log.gz 2023-07-06T02:41:07.519 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.810187.log 2023-07-06T02:41:07.520 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.287922.log 2023-07-06T02:41:07.520 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.699603.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.699603.log.gz 2023-07-06T02:41:07.520 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.810187.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.810187.log.gz 2023-07-06T02:41:07.520 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.276909.log 2023-07-06T02:41:07.521 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.244976.log 2023-07-06T02:41:07.521 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.287922.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.287922.log.gz 2023-07-06T02:41:07.521 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.276909.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.668490.log 2023-07-06T02:41:07.521 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.276909.log.gz 2023-07-06T02:41:07.521 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.244976.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.285261.log 2023-07-06T02:41:07.522 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.244976.log.gz 2023-07-06T02:41:07.522 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.668490.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.668490.log.gz 2023-07-06T02:41:07.522 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.799941.log 2023-07-06T02:41:07.522 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.682848.log 2023-07-06T02:41:07.523 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.285261.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.285261.log.gz 2023-07-06T02:41:07.523 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.799941.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.637456.log 2023-07-06T02:41:07.523 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.799941.log.gz 2023-07-06T02:41:07.523 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.682848.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.369748.log 2023-07-06T02:41:07.524 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.682848.log.gz 2023-07-06T02:41:07.524 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.637456.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.637456.log.gz 2023-07-06T02:41:07.524 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.112206.log 2023-07-06T02:41:07.524 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.369748.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.379682.log 2023-07-06T02:41:07.524 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.369748.log.gz 2023-07-06T02:41:07.525 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.112206.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.440111.log 2023-07-06T02:41:07.525 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.171097.log 2023-07-06T02:41:07.525 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.379682.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.379682.log.gz 2023-07-06T02:41:07.525 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.440111.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.348543.log 2023-07-06T02:41:07.525 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.440111.log.gz 2023-07-06T02:41:07.526 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.171097.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.648733.log 2023-07-06T02:41:07.526 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.171097.log.gz 2023-07-06T02:41:07.526 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.348543.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.348140.log 2023-07-06T02:41:07.526 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.348543.log.gz 2023-07-06T02:41:07.526 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.648733.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.371004.log 2023-07-06T02:41:07.527 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.648733.log.gz 2023-07-06T02:41:07.527 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.348140.log: gzip 0.0%-5 --verbose -- replaced with /var/log/ceph/ceph-client.admin.348140.log.gz-- 2023-07-06T02:41:07.527 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.649311.log 2023-07-06T02:41:07.527 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.371004.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.244500.log 2023-07-06T02:41:07.527 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.371004.log.gz 2023-07-06T02:41:07.528 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.649311.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.377899.log 2023-07-06T02:41:07.528 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.649311.log.gz 2023-07-06T02:41:07.528 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.244500.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.925222.log 2023-07-06T02:41:07.528 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.244500.log.gz 2023-07-06T02:41:07.528 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.377899.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.296500.log 2023-07-06T02:41:07.529 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.377899.log.gz 2023-07-06T02:41:07.529 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.925222.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.789449.log 2023-07-06T02:41:07.529 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.925222.log.gz 2023-07-06T02:41:07.529 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.296500.log: 0.0%gzip -5 -- replaced with /var/log/ceph/ceph-client.admin.296500.log.gz--verbose 2023-07-06T02:41:07.529 INFO:teuthology.orchestra.run.smithi046.stderr:-- /var/log/ceph/ceph-client.admin.162289.log 2023-07-06T02:41:07.530 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.789449.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.630482.log 2023-07-06T02:41:07.530 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.789449.log.gz 2023-07-06T02:41:07.530 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.162289.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.108295.log 2023-07-06T02:41:07.530 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.162289.log.gz 2023-07-06T02:41:07.530 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.630482.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.169645.log 2023-07-06T02:41:07.531 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.630482.log.gz 2023-07-06T02:41:07.531 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.108295.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.790039.log 2023-07-06T02:41:07.531 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.770155.log 2023-07-06T02:41:07.531 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.169645.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.169645.log.gz 2023-07-06T02:41:07.531 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.790039.log: gzip 0.0%-5 --verbose -- replaced with /var/log/ceph/ceph-client.admin.790039.log.gz-- 2023-07-06T02:41:07.531 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.394555.log 2023-07-06T02:41:07.532 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.770155.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.174688.log 2023-07-06T02:41:07.532 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.770155.log.gz 2023-07-06T02:41:07.532 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.394555.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.415847.log 2023-07-06T02:41:07.532 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.394555.log.gz 2023-07-06T02:41:07.532 INFO:teuthology.orchestra.run.smithi046.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.114243.log.gz 2023-07-06T02:41:07.533 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.174688.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.272777.log 2023-07-06T02:41:07.533 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.174688.log.gz 2023-07-06T02:41:07.533 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.191789.log 2023-07-06T02:41:07.533 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.415847.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.415847.log.gz 2023-07-06T02:41:07.533 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.272777.log: gzip 0.0%-5 --verbose -- replaced with /var/log/ceph/ceph-client.admin.272777.log.gz-- 2023-07-06T02:41:07.534 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.329657.log 2023-07-06T02:41:07.534 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.191789.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.664577.log 2023-07-06T02:41:07.534 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.191789.log.gz 2023-07-06T02:41:07.534 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.329657.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.773484.log 2023-07-06T02:41:07.534 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.329657.log.gz 2023-07-06T02:41:07.535 INFO:teuthology.orchestra.run.smithi046.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.111377.log.gz 2023-07-06T02:41:07.535 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.664577.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.768761.log 2023-07-06T02:41:07.535 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.664577.log.gz 2023-07-06T02:41:07.535 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.677774.log 2023-07-06T02:41:07.535 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.773484.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.773484.log.gz 2023-07-06T02:41:07.535 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.768761.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.768761.log.gz 2023-07-06T02:41:07.536 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.219949.log 2023-07-06T02:41:07.536 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.677774.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.628449.log 2023-07-06T02:41:07.536 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.677774.log.gz 2023-07-06T02:41:07.536 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.219949.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.219949.log.gz 2023-07-06T02:41:07.537 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.157541.log 2023-07-06T02:41:07.537 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.628449.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.465900.log 2023-07-06T02:41:07.537 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.628449.log.gz 2023-07-06T02:41:07.537 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.157541.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.679029.log 2023-07-06T02:41:07.537 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.157541.log.gz 2023-07-06T02:41:07.537 INFO:teuthology.orchestra.run.smithi046.stderr:gzip /var/log/ceph/ceph-client.admin.465900.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.343989.log 2023-07-06T02:41:07.538 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.465900.log.gz 2023-07-06T02:41:07.538 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.679029.log: 0.0%gzip -- replaced with /var/log/ceph/ceph-client.admin.679029.log.gz-5 2023-07-06T02:41:07.538 INFO:teuthology.orchestra.run.smithi046.stderr:--verbose -- /var/log/ceph/ceph-client.admin.369762.log 2023-07-06T02:41:07.538 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.757947.log 2023-07-06T02:41:07.538 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.343989.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.343989.log.gz 2023-07-06T02:41:07.539 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.369762.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.924258.log 2023-07-06T02:41:07.539 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.369762.log.gz 2023-07-06T02:41:07.539 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.757947.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.924244.log 2023-07-06T02:41:07.539 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.757947.log.gz 2023-07-06T02:41:07.539 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.924258.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.632846.log 2023-07-06T02:41:07.540 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.924258.log.gz 2023-07-06T02:41:07.540 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.924244.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.106969.log 2023-07-06T02:41:07.540 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.924244.log.gz 2023-07-06T02:41:07.540 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.632846.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.114879.log.gz 2023-07-06T02:41:07.540 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.769586.log 2023-07-06T02:41:07.541 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.632846.log.gz 2023-07-06T02:41:07.541 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.106969.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.335686.log 2023-07-06T02:41:07.541 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.769586.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.769586.log.gz 2023-07-06T02:41:07.541 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.396736.log 2023-07-06T02:41:07.541 INFO:teuthology.orchestra.run.smithi046.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.107663.log.gz 2023-07-06T02:41:07.542 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.791075.log 2023-07-06T02:41:07.542 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.335686.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.335686.log.gz 2023-07-06T02:41:07.542 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.396736.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.396736.log.gz 2023-07-06T02:41:07.542 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.817344.log 2023-07-06T02:41:07.542 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.683300.log 2023-07-06T02:41:07.543 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.791075.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.791075.log.gz 2023-07-06T02:41:07.543 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.817344.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.463242.log 2023-07-06T02:41:07.543 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.817344.log.gz 2023-07-06T02:41:07.543 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.683300.log: gzip -5 0.0%--verbose -- replaced with /var/log/ceph/ceph-client.admin.683300.log.gz-- 2023-07-06T02:41:07.543 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.652575.log 2023-07-06T02:41:07.544 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.920881.log 2023-07-06T02:41:07.544 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.463242.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.463242.log.gz 2023-07-06T02:41:07.544 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.652575.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.191005.log 2023-07-06T02:41:07.544 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.652575.log.gz 2023-07-06T02:41:07.544 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.920881.log: gzip -5 --verbose -- 0.0%/var/log/ceph/ceph-client.admin.114741.log -- replaced with /var/log/ceph/ceph-client.admin.920881.log.gz 2023-07-06T02:41:07.545 INFO:teuthology.orchestra.run.smithi046.stderr: 2023-07-06T02:41:07.545 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.649594.log 2023-07-06T02:41:07.545 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.191005.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.191005.log.gz 2023-07-06T02:41:07.545 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.114741.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.690170.log 2023-07-06T02:41:07.545 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.649594.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.649594.log.gz 2023-07-06T02:41:07.546 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.262244.log 2023-07-06T02:41:07.546 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.614135.log 2023-07-06T02:41:07.546 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.690170.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.690170.log.gz 2023-07-06T02:41:07.546 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.262244.log: gzip -5 --verbose -- 0.0%/var/log/ceph/ceph-client.admin.703863.log 2023-07-06T02:41:07.546 INFO:teuthology.orchestra.run.smithi046.stderr: -- replaced with /var/log/ceph/ceph-client.admin.262244.log.gz 2023-07-06T02:41:07.546 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.677558.log 2023-07-06T02:41:07.547 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.614135.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.614135.log.gz 2023-07-06T02:41:07.547 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.703863.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.703863.log.gzgzip 2023-07-06T02:41:07.547 INFO:teuthology.orchestra.run.smithi046.stderr:-5 --verbose -- /var/log/ceph/ceph-client.admin.172741.log 2023-07-06T02:41:07.547 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.341506.log 2023-07-06T02:41:07.547 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.677558.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.677558.log.gz 2023-07-06T02:41:07.548 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.172741.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.630905.log 2023-07-06T02:41:07.548 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.172741.log.gz 2023-07-06T02:41:07.548 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.341506.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.218890.log 2023-07-06T02:41:07.548 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.341506.log.gz 2023-07-06T02:41:07.548 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.630905.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.383876.log 2023-07-06T02:41:07.549 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.630905.log.gz 2023-07-06T02:41:07.549 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.218890.log: 0.0%gzip -5 -- replaced with /var/log/ceph/ceph-client.admin.218890.log.gz--verbose 2023-07-06T02:41:07.549 INFO:teuthology.orchestra.run.smithi046.stderr:-- /var/log/ceph/ceph-client.admin.799724.log 2023-07-06T02:41:07.549 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.374787.log 2023-07-06T02:41:07.549 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.383876.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.383876.log.gz 2023-07-06T02:41:07.550 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.799724.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.805995.log 2023-07-06T02:41:07.550 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.799724.log.gz 2023-07-06T02:41:07.550 INFO:teuthology.orchestra.run.smithi046.stderr:gzip /var/log/ceph/ceph-client.admin.374787.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.319708.log 2023-07-06T02:41:07.550 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.374787.log.gz 2023-07-06T02:41:07.550 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.805995.log: gzip 0.0%-5 -- replaced with /var/log/ceph/ceph-client.admin.805995.log.gz--verbose 2023-07-06T02:41:07.550 INFO:teuthology.orchestra.run.smithi046.stderr:-- /var/log/ceph/ceph-client.admin.107915.log 2023-07-06T02:41:07.551 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.283722.log 2023-07-06T02:41:07.551 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.319708.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.319708.log.gz 2023-07-06T02:41:07.551 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.107915.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.758026.log 2023-07-06T02:41:07.551 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.283722.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.797601.log 2023-07-06T02:41:07.551 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.283722.log.gz 2023-07-06T02:41:07.552 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.758026.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.687461.log 2023-07-06T02:41:07.552 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.758026.log.gz 2023-07-06T02:41:07.552 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.797601.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.290689.log 2023-07-06T02:41:07.552 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.797601.log.gz 2023-07-06T02:41:07.552 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.687461.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.687461.log.gz 2023-07-06T02:41:07.553 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.284246.log 2023-07-06T02:41:07.553 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.300266.log 2023-07-06T02:41:07.553 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.290689.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.290689.log.gz 2023-07-06T02:41:07.553 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.284246.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.338915.log 2023-07-06T02:41:07.553 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.284246.log.gz 2023-07-06T02:41:07.554 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.300266.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.794808.log 2023-07-06T02:41:07.554 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.300266.log.gz 2023-07-06T02:41:07.554 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.338915.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.338915.log.gzgzip 2023-07-06T02:41:07.554 INFO:teuthology.orchestra.run.smithi046.stderr:-5 --verbose -- /var/log/ceph/ceph-client.admin.256869.log 2023-07-06T02:41:07.554 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.794808.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.648457.log 2023-07-06T02:41:07.555 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.794808.log.gz 2023-07-06T02:41:07.555 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.256869.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.108672.log 2023-07-06T02:41:07.555 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.256869.log.gz 2023-07-06T02:41:07.555 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.648457.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.300481.log 2023-07-06T02:41:07.555 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.648457.log.gz 2023-07-06T02:41:07.556 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.108672.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.756610.log 2023-07-06T02:41:07.556 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.340434.log 2023-07-06T02:41:07.556 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.300481.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.300481.log.gz 2023-07-06T02:41:07.556 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.756610.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.284756.log 2023-07-06T02:41:07.556 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.756610.log.gz 2023-07-06T02:41:07.557 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.387409.log 2023-07-06T02:41:07.557 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.340434.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.340434.log.gz 2023-07-06T02:41:07.557 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.284756.log: gzip 0.0%-5 -- replaced with /var/log/ceph/ceph-client.admin.284756.log.gz--verbose 2023-07-06T02:41:07.557 INFO:teuthology.orchestra.run.smithi046.stderr:-- /var/log/ceph/ceph-client.admin.197142.log 2023-07-06T02:41:07.558 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.387409.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.334374.log 2023-07-06T02:41:07.558 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.387409.log.gz 2023-07-06T02:41:07.558 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.197142.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.405714.log 2023-07-06T02:41:07.558 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.197142.log.gz 2023-07-06T02:41:07.559 INFO:teuthology.orchestra.run.smithi073.stderr: 94.1% -- replaced with /var/log/ceph/ceph.log.gz 2023-07-06T02:41:07.974 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.334374.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.357880.log 2023-07-06T02:41:07.975 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.334374.log.gz 2023-07-06T02:41:07.975 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.405714.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.688224.log 2023-07-06T02:41:07.975 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.405714.log.gz 2023-07-06T02:41:07.975 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.357880.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.375284.log 2023-07-06T02:41:07.975 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.357880.log.gz 2023-07-06T02:41:07.976 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.688224.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.259755.log 2023-07-06T02:41:07.976 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.688224.log.gz 2023-07-06T02:41:07.976 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.375284.log: gzip 0.0%-5 --verbose -- replaced with /var/log/ceph/ceph-client.admin.375284.log.gz-- 2023-07-06T02:41:07.977 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.771141.log 2023-07-06T02:41:07.977 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.108880.log 2023-07-06T02:41:07.977 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.259755.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.259755.log.gz 2023-07-06T02:41:07.977 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.771141.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.409049.log 2023-07-06T02:41:07.977 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.771141.log.gz 2023-07-06T02:41:07.977 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.108880.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.157908.log 2023-07-06T02:41:07.978 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.409049.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.193660.log 2023-07-06T02:41:07.978 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.409049.log.gz 2023-07-06T02:41:07.978 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.157908.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.107914.log 2023-07-06T02:41:07.978 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.157908.log.gz 2023-07-06T02:41:07.978 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.193660.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.193660.log.gz 2023-07-06T02:41:07.979 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.702575.log 2023-07-06T02:41:07.979 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.107914.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.931077.log 2023-07-06T02:41:07.979 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.702575.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.626921.log 2023-07-06T02:41:07.979 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.702575.log.gz 2023-07-06T02:41:07.979 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.931077.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.108676.log 2023-07-06T02:41:07.980 INFO:teuthology.orchestra.run.smithi046.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.931077.log.gz 2023-07-06T02:41:07.980 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.626921.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.775842.log 2023-07-06T02:41:07.980 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.626921.log.gz 2023-07-06T02:41:07.980 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.108676.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.342948.log 2023-07-06T02:41:07.981 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.775842.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.792976.log 2023-07-06T02:41:07.981 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.775842.log.gz 2023-07-06T02:41:07.981 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.342948.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.438561.log 2023-07-06T02:41:07.981 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.342948.log.gz 2023-07-06T02:41:07.982 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.792976.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.818033.log 2023-07-06T02:41:07.982 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.792976.log.gz 2023-07-06T02:41:07.982 INFO:teuthology.orchestra.run.smithi046.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.112206.log.gz 2023-07-06T02:41:07.982 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.438561.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.438561.log.gz 2023-07-06T02:41:07.982 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.413626.log 2023-07-06T02:41:07.982 INFO:teuthology.orchestra.run.smithi046.stderr:gzip /var/log/ceph/ceph-client.admin.818033.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.167272.log 2023-07-06T02:41:07.983 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.818033.log.gz 2023-07-06T02:41:07.983 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.413626.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.405517.log 2023-07-06T02:41:07.983 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.413626.log.gz 2023-07-06T02:41:07.983 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.167272.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.108295.log.gz 2023-07-06T02:41:07.983 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.190301.log 2023-07-06T02:41:07.984 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.167272.log.gz 2023-07-06T02:41:07.984 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.405517.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.467744.log 2023-07-06T02:41:07.984 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.405517.log.gz 2023-07-06T02:41:07.984 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.190301.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.190301.log.gz 2023-07-06T02:41:07.984 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.387847.log 2023-07-06T02:41:07.985 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.467744.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.201148.log 2023-07-06T02:41:07.985 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.467744.log.gz 2023-07-06T02:41:07.985 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.387847.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.816179.log 2023-07-06T02:41:07.985 INFO:teuthology.orchestra.run.smithi046.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.106969.log.gz 2023-07-06T02:41:07.985 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.387847.log.gz 2023-07-06T02:41:07.986 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.201148.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.380594.log 2023-07-06T02:41:07.986 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.201148.log.gz 2023-07-06T02:41:07.986 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.816179.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.816179.log.gz 2023-07-06T02:41:07.986 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.674151.log 2023-07-06T02:41:07.986 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.277949.log 2023-07-06T02:41:07.987 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.380594.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.380594.log.gz 2023-07-06T02:41:07.987 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.674151.log: gzip -5 --verbose -- 0.0%/var/log/ceph/ceph-client.admin.220174.log 2023-07-06T02:41:07.987 INFO:teuthology.orchestra.run.smithi046.stderr: -- replaced with /var/log/ceph/ceph-client.admin.674151.log.gz 2023-07-06T02:41:07.987 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.397692.log 2023-07-06T02:41:07.987 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.277949.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.277949.log.gz 2023-07-06T02:41:07.987 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.220174.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.413139.log 2023-07-06T02:41:07.988 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.220174.log.gz 2023-07-06T02:41:07.988 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.397692.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.355715.log 2023-07-06T02:41:07.988 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.397692.log.gz 2023-07-06T02:41:07.988 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.413139.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.413139.log.gz 2023-07-06T02:41:07.989 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.612754.log 2023-07-06T02:41:07.989 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.355715.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.417222.log 2023-07-06T02:41:07.989 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.355715.log.gz 2023-07-06T02:41:07.989 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.612754.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.272560.log 2023-07-06T02:41:07.989 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.612754.log.gz 2023-07-06T02:41:07.989 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.417222.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.340656.log 2023-07-06T02:41:07.990 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.417222.log.gz 2023-07-06T02:41:07.990 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.272560.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.272560.log.gzgzip 2023-07-06T02:41:07.990 INFO:teuthology.orchestra.run.smithi046.stderr:-5 --verbose -- /var/log/ceph/ceph-client.admin.185734.log 2023-07-06T02:41:07.990 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.340656.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.334143.log 2023-07-06T02:41:07.990 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.340656.log.gz 2023-07-06T02:41:07.991 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.185734.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.185734.log.gz 2023-07-06T02:41:07.991 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.390646.log 2023-07-06T02:41:07.991 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.334143.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.266158.log 2023-07-06T02:41:07.991 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.334143.log.gz 2023-07-06T02:41:07.991 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.390646.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.408956.log 2023-07-06T02:41:07.992 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.390646.log.gz 2023-07-06T02:41:07.992 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.266158.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.664080.log 2023-07-06T02:41:07.992 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.266158.log.gz 2023-07-06T02:41:07.992 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.408956.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.242979.log 2023-07-06T02:41:07.992 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.408956.log.gz 2023-07-06T02:41:07.993 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.664080.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.664080.log.gz 2023-07-06T02:41:07.993 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.931512.log 2023-07-06T02:41:07.993 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.242979.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.613236.log 2023-07-06T02:41:07.993 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.242979.log.gz 2023-07-06T02:41:07.994 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.931512.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.106923.log 2023-07-06T02:41:07.994 INFO:teuthology.orchestra.run.smithi046.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.931512.log.gz 2023-07-06T02:41:07.994 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.613236.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.613236.log.gz 2023-07-06T02:41:07.994 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.192481.log 2023-07-06T02:41:07.994 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.930985.log 2023-07-06T02:41:07.995 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.106923.log: /var/log/ceph/ceph-client.admin.192481.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.189609.log 2023-07-06T02:41:07.995 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.192481.log.gz 2023-07-06T02:41:07.995 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.930985.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.775428.log 2023-07-06T02:41:07.995 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.189609.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.930985.log.gz 2023-07-06T02:41:07.995 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.189609.log.gz 2023-07-06T02:41:07.996 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.634813.log 2023-07-06T02:41:07.996 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.775428.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.928521.log 2023-07-06T02:41:07.996 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.775428.log.gz 2023-07-06T02:41:07.996 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.634813.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.398000.log 2023-07-06T02:41:07.996 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.634813.log.gz 2023-07-06T02:41:07.997 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.928521.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.378424.log 2023-07-06T02:41:07.997 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.928521.log.gz 2023-07-06T02:41:07.997 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.398000.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.813215.log 2023-07-06T02:41:07.997 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.398000.log.gz 2023-07-06T02:41:07.998 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.378424.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.208426.log 2023-07-06T02:41:07.998 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.378424.log.gz 2023-07-06T02:41:07.998 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.813215.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.107916.log 2023-07-06T02:41:07.998 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.813215.log.gz 2023-07-06T02:41:07.999 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.208426.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.768281.log 2023-07-06T02:41:07.999 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.208426.log.gz 2023-07-06T02:41:07.999 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.107916.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.237660.log 2023-07-06T02:41:07.999 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.768281.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.387940.log 2023-07-06T02:41:07.999 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.768281.log.gz 2023-07-06T02:41:08.000 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.237660.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.170584.log 2023-07-06T02:41:08.000 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.237660.log.gz 2023-07-06T02:41:08.000 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.387940.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.926654.log 2023-07-06T02:41:08.000 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.387940.log.gz 2023-07-06T02:41:08.001 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.170584.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.311826.log 2023-07-06T02:41:08.001 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.170584.log.gz 2023-07-06T02:41:08.001 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.926654.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.111423.log 2023-07-06T02:41:08.001 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.926654.log.gz 2023-07-06T02:41:08.001 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.311826.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.627000.log 2023-07-06T02:41:08.002 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.311826.log.gz 2023-07-06T02:41:08.002 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.111423.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.390268.log 2023-07-06T02:41:08.002 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.627000.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.411140.log 2023-07-06T02:41:08.002 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.627000.log.gz 2023-07-06T02:41:08.002 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.390268.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.325420.log 2023-07-06T02:41:08.003 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.390268.log.gz 2023-07-06T02:41:08.003 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.411140.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.815899.log 2023-07-06T02:41:08.003 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.411140.log.gz 2023-07-06T02:41:08.003 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.325420.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.294521.log 2023-07-06T02:41:08.003 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.325420.log.gz 2023-07-06T02:41:08.003 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.815899.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.191574.log 2023-07-06T02:41:08.004 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.815899.log.gz 2023-07-06T02:41:08.004 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.294521.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.207476.log 2023-07-06T02:41:08.004 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.294521.log.gz 2023-07-06T02:41:08.004 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.191574.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.358720.log 2023-07-06T02:41:08.005 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.191574.log.gz 2023-07-06T02:41:08.005 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.207476.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.192080.log 2023-07-06T02:41:08.005 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.207476.log.gz 2023-07-06T02:41:08.005 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.358720.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.628746.log 2023-07-06T02:41:08.005 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.358720.log.gz 2023-07-06T02:41:08.006 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.192080.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.192080.log.gz 2023-07-06T02:41:08.006 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.345503.log 2023-07-06T02:41:08.006 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.628746.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.814182.log 2023-07-06T02:41:08.006 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.628746.log.gz 2023-07-06T02:41:08.007 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.345503.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.240564.log 2023-07-06T02:41:08.007 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.345503.log.gz 2023-07-06T02:41:08.007 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.814182.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.170785.log 2023-07-06T02:41:08.007 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.814182.log.gz 2023-07-06T02:41:08.007 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.240564.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.801731.log 2023-07-06T02:41:08.008 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.240564.log.gz 2023-07-06T02:41:08.008 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.170785.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.805521.log 2023-07-06T02:41:08.008 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.170785.log.gz 2023-07-06T02:41:08.008 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.801731.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.795615.log 2023-07-06T02:41:08.008 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.801731.log.gz 2023-07-06T02:41:08.009 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.805521.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.294923.log 2023-07-06T02:41:08.009 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.805521.log.gz 2023-07-06T02:41:08.009 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.795615.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.795615.log.gz 2023-07-06T02:41:08.009 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.265588.log 2023-07-06T02:41:08.009 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.294923.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.326151.log 2023-07-06T02:41:08.010 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.294923.log.gz 2023-07-06T02:41:08.010 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.265588.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.812702.log 2023-07-06T02:41:08.010 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.265588.log.gz 2023-07-06T02:41:08.010 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.326151.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.369278.log 2023-07-06T02:41:08.010 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.326151.log.gz 2023-07-06T02:41:08.011 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.812702.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.795118.log 2023-07-06T02:41:08.011 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.812702.log.gz 2023-07-06T02:41:08.011 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.369278.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.929589.log 2023-07-06T02:41:08.011 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.369278.log.gz 2023-07-06T02:41:08.011 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.795118.log: gzip 0.0%-5 -- replaced with /var/log/ceph/ceph-client.admin.795118.log.gz--verbose 2023-07-06T02:41:08.011 INFO:teuthology.orchestra.run.smithi046.stderr:-- /var/log/ceph/ceph-client.admin.377094.log 2023-07-06T02:41:08.012 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.929589.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.701071.log 2023-07-06T02:41:08.012 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.929589.log.gz 2023-07-06T02:41:08.012 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.377094.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.805535.log 2023-07-06T02:41:08.012 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.377094.log.gz 2023-07-06T02:41:08.013 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.701071.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.701071.log.gz 2023-07-06T02:41:08.013 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.190808.log 2023-07-06T02:41:08.013 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.805535.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.219856.log 2023-07-06T02:41:08.013 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.805535.log.gz 2023-07-06T02:41:08.013 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.190808.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.285275.log 2023-07-06T02:41:08.014 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.190808.log.gz 2023-07-06T02:41:08.014 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.219856.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.391651.log 2023-07-06T02:41:08.014 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.219856.log.gz 2023-07-06T02:41:08.014 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.285275.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.212759.log 2023-07-06T02:41:08.014 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.285275.log.gz 2023-07-06T02:41:08.015 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.391651.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.811116.log 2023-07-06T02:41:08.015 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.391651.log.gz 2023-07-06T02:41:08.015 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.212759.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.417905.log 2023-07-06T02:41:08.015 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.212759.log.gz 2023-07-06T02:41:08.015 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.811116.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.680044.log 2023-07-06T02:41:08.016 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.811116.log.gz 2023-07-06T02:41:08.016 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.417905.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.417905.log.gz 2023-07-06T02:41:08.016 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.411620.log 2023-07-06T02:41:08.016 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.680044.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.655116.log 2023-07-06T02:41:08.016 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.680044.log.gz 2023-07-06T02:41:08.017 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.411620.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.921848.log 2023-07-06T02:41:08.017 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.411620.log.gz 2023-07-06T02:41:08.017 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.655116.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.676555.log 2023-07-06T02:41:08.017 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.655116.log.gz 2023-07-06T02:41:08.017 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.921848.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.921848.log.gz 2023-07-06T02:41:08.018 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.809242.log 2023-07-06T02:41:08.018 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.322651.log 2023-07-06T02:41:08.018 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.676555.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.676555.log.gz 2023-07-06T02:41:08.018 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.809242.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.409561.log 2023-07-06T02:41:08.018 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.809242.log.gz 2023-07-06T02:41:08.019 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.322651.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.362018.log 2023-07-06T02:41:08.019 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.322651.log.gz 2023-07-06T02:41:08.019 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.409561.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.648641.log 2023-07-06T02:41:08.019 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.409561.log.gz 2023-07-06T02:41:08.019 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.362018.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.326244.log 2023-07-06T02:41:08.019 INFO:teuthology.orchestra.run.smithi046.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.114741.log.gz 2023-07-06T02:41:08.020 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.362018.log.gz 2023-07-06T02:41:08.020 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.648641.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.332047.log 2023-07-06T02:41:08.020 INFO:teuthology.orchestra.run.smithi046.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.107915.log.gz 2023-07-06T02:41:08.020 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.648641.log.gz 2023-07-06T02:41:08.020 INFO:teuthology.orchestra.run.smithi046.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.108672.log.gz 2023-07-06T02:41:08.021 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.326244.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.346497.log 2023-07-06T02:41:08.021 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.326244.log.gz 2023-07-06T02:41:08.021 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.332047.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.245055.log 2023-07-06T02:41:08.021 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.332047.log.gz 2023-07-06T02:41:08.021 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.346497.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.346497.log.gz 2023-07-06T02:41:08.022 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.414116.log 2023-07-06T02:41:08.022 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.245055.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.326667.log 2023-07-06T02:41:08.022 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.245055.log.gz 2023-07-06T02:41:08.022 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.414116.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.107061.log 2023-07-06T02:41:08.022 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.414116.log.gz 2023-07-06T02:41:08.023 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.326667.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.172648.log 2023-07-06T02:41:08.023 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.326667.log.gz 2023-07-06T02:41:08.023 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.107061.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.111608.log 2023-07-06T02:41:08.023 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.172648.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.798112.log 2023-07-06T02:41:08.023 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.172648.log.gz 2023-07-06T02:41:08.024 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.111608.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.687170.log 2023-07-06T02:41:08.024 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.798112.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.696815.log 2023-07-06T02:41:08.024 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.798112.log.gz 2023-07-06T02:41:08.024 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.687170.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.247606.log 2023-07-06T02:41:08.024 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.687170.log.gz 2023-07-06T02:41:08.025 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.696815.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.618423.log 2023-07-06T02:41:08.025 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.696815.log.gz 2023-07-06T02:41:08.025 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.247606.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.309147.log 2023-07-06T02:41:08.025 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.247606.log.gz 2023-07-06T02:41:08.025 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.618423.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.468221.log 2023-07-06T02:41:08.026 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.618423.log.gz 2023-07-06T02:41:08.026 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.309147.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.662828.log 2023-07-06T02:41:08.026 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.309147.log.gz 2023-07-06T02:41:08.026 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.468221.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.468221.log.gz 2023-07-06T02:41:08.026 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.298539.log 2023-07-06T02:41:08.027 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.662828.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.364491.log 2023-07-06T02:41:08.027 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.662828.log.gz 2023-07-06T02:41:08.027 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.298539.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.328718.log 2023-07-06T02:41:08.027 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.298539.log.gz 2023-07-06T02:41:08.027 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.364491.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.636231.log 2023-07-06T02:41:08.028 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.364491.log.gz 2023-07-06T02:41:08.028 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.328718.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.367452.log 2023-07-06T02:41:08.028 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.328718.log.gz 2023-07-06T02:41:08.028 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.636231.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.793055.log 2023-07-06T02:41:08.028 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.636231.log.gz 2023-07-06T02:41:08.029 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.367452.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.367452.log.gz 2023-07-06T02:41:08.029 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.291697.log 2023-07-06T02:41:08.029 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.793055.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.246268.log 2023-07-06T02:41:08.029 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.793055.log.gz 2023-07-06T02:41:08.029 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.291697.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.439629.log 2023-07-06T02:41:08.030 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.291697.log.gz 2023-07-06T02:41:08.030 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.246268.log: /var/log/ceph/ceph-client.admin.194248.log 2023-07-06T02:41:08.030 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.246268.log.gz 2023-07-06T02:41:08.030 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.439629.log: gzip -5 --verbose -- 0.0%/var/log/ceph/ceph-mds.c.log 2023-07-06T02:41:08.031 INFO:teuthology.orchestra.run.smithi046.stderr: -- replaced with /var/log/ceph/ceph-client.admin.439629.log.gz 2023-07-06T02:41:08.031 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.194248.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.406230.log 2023-07-06T02:41:08.031 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.194248.log.gz 2023-07-06T02:41:08.031 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-mds.c.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.797694.log 2023-07-06T02:41:08.031 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.406230.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.287285.log 2023-07-06T02:41:08.032 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.406230.log.gz 2023-07-06T02:41:08.032 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.797694.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.662749.log 2023-07-06T02:41:08.032 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.797694.log.gz 2023-07-06T02:41:08.032 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.287285.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.931307.log 2023-07-06T02:41:08.032 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.287285.log.gz 2023-07-06T02:41:08.033 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.662749.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.391882.log 2023-07-06T02:41:08.033 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.662749.log.gz 2023-07-06T02:41:08.033 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.931307.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.768478.log 2023-07-06T02:41:08.033 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.391882.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.931307.log.gz 2023-07-06T02:41:08.033 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.278741.log 2023-07-06T02:41:08.034 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.391882.log.gz 2023-07-06T02:41:08.034 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.337893.log 2023-07-06T02:41:08.034 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.768478.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.768478.log.gz 2023-07-06T02:41:08.034 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.278741.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.376882.log 2023-07-06T02:41:08.034 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.278741.log.gz 2023-07-06T02:41:08.035 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.337893.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.366076.log 2023-07-06T02:41:08.035 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.337893.log.gz 2023-07-06T02:41:08.035 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.376882.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.238595.log 2023-07-06T02:41:08.035 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.376882.log.gz 2023-07-06T02:41:08.036 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.366076.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.366076.log.gz 2023-07-06T02:41:08.036 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.268136.log 2023-07-06T02:41:08.036 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.792098.log 2023-07-06T02:41:08.036 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.238595.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.238595.log.gz 2023-07-06T02:41:08.036 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.268136.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.115155.log 2023-07-06T02:41:08.037 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.268136.log.gz 2023-07-06T02:41:08.037 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.792098.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.384551.log 2023-07-06T02:41:08.037 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.792098.log.gz 2023-07-06T02:41:08.037 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.115155.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.772402.log 2023-07-06T02:41:08.037 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.384551.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.816654.log 2023-07-06T02:41:08.037 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.384551.log.gz 2023-07-06T02:41:08.038 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.772402.log: gzip -5 --verbose 0.0%-- /var/log/ceph/ceph-client.admin.673602.log -- replaced with /var/log/ceph/ceph-client.admin.772402.log.gz 2023-07-06T02:41:08.038 INFO:teuthology.orchestra.run.smithi046.stderr: 2023-07-06T02:41:08.038 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.816654.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.756531.log 2023-07-06T02:41:08.038 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.816654.log.gz 2023-07-06T02:41:08.038 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.673602.log: gzip -5 0.0%--verbose -- -- replaced with /var/log/ceph/ceph-client.admin.673602.log.gz/var/log/ceph/ceph-client.admin.401429.log 2023-07-06T02:41:08.039 INFO:teuthology.orchestra.run.smithi046.stderr: 2023-07-06T02:41:08.039 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.756531.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.319694.log 2023-07-06T02:41:08.039 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.756531.log.gz 2023-07-06T02:41:08.039 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.401429.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.285182.log 2023-07-06T02:41:08.039 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.401429.log.gz 2023-07-06T02:41:08.040 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.319694.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.379668.log 2023-07-06T02:41:08.040 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.319694.log.gz 2023-07-06T02:41:08.040 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.285182.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.392643.log 2023-07-06T02:41:08.040 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.285182.log.gz 2023-07-06T02:41:08.040 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.379668.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.168185.log 2023-07-06T02:41:08.041 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.379668.log.gz 2023-07-06T02:41:08.041 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.392643.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.113783.log 2023-07-06T02:41:08.041 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.392643.log.gz 2023-07-06T02:41:08.041 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.168185.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.668795.log 2023-07-06T02:41:08.041 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.168185.log.gz 2023-07-06T02:41:08.042 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.113783.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.627713.log 2023-07-06T02:41:08.042 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.668795.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.931353.log 2023-07-06T02:41:08.042 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.668795.log.gz 2023-07-06T02:41:08.042 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.627713.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.627713.log.gz 2023-07-06T02:41:08.042 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.328625.log 2023-07-06T02:41:08.042 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.931353.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.114197.log 2023-07-06T02:41:08.043 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.328625.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.931353.log.gz 2023-07-06T02:41:08.043 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.328625.log.gz 2023-07-06T02:41:08.043 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.389789.log 2023-07-06T02:41:08.043 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.221210.log 2023-07-06T02:41:08.043 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.114197.log: /var/log/ceph/ceph-client.admin.389789.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.107015.log 2023-07-06T02:41:08.044 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.389789.log.gz 2023-07-06T02:41:08.044 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.221210.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.687769.log 2023-07-06T02:41:08.044 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.221210.log.gz 2023-07-06T02:41:08.044 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.107015.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.111746.log 2023-07-06T02:41:08.044 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.687769.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.292939.log 2023-07-06T02:41:08.045 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.687769.log.gz 2023-07-06T02:41:08.045 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.111746.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.387316.log 2023-07-06T02:41:08.045 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.292939.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.770169.log 2023-07-06T02:41:08.045 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.292939.log.gz 2023-07-06T02:41:08.045 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.387316.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.649110.log 2023-07-06T02:41:08.046 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.387316.log.gz 2023-07-06T02:41:08.046 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.770169.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.692328.log 2023-07-06T02:41:08.046 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.770169.log.gz 2023-07-06T02:41:08.046 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.649110.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.296007.log 2023-07-06T02:41:08.046 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.649110.log.gz 2023-07-06T02:41:08.047 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.692328.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.343027.log 2023-07-06T02:41:08.047 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.692328.log.gz 2023-07-06T02:41:08.047 INFO:teuthology.orchestra.run.smithi046.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.108676.log.gz 2023-07-06T02:41:08.047 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.296007.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.212249.log 2023-07-06T02:41:08.047 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.296007.log.gz 2023-07-06T02:41:08.048 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.343027.log: gzip -5 0.0%--verbose -- -- replaced with /var/log/ceph/ceph-client.admin.343027.log.gz/var/log/ceph/ceph-client.admin.668781.log 2023-07-06T02:41:08.048 INFO:teuthology.orchestra.run.smithi046.stderr: 2023-07-06T02:41:08.048 INFO:teuthology.orchestra.run.smithi046.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.108880.log.gz 2023-07-06T02:41:08.048 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.212249.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.921834.log 2023-07-06T02:41:08.049 INFO:teuthology.orchestra.run.smithi046.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.107914.log.gz 2023-07-06T02:41:08.049 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.212249.log.gz 2023-07-06T02:41:08.049 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.668781.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.682862.log 2023-07-06T02:41:08.049 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.668781.log.gz 2023-07-06T02:41:08.049 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.921834.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.662842.log 2023-07-06T02:41:08.050 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.921834.log.gz 2023-07-06T02:41:08.050 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.682862.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.386410.log 2023-07-06T02:41:08.050 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.682862.log.gz 2023-07-06T02:41:08.050 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.662842.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.755363.log 2023-07-06T02:41:08.050 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.662842.log.gz 2023-07-06T02:41:08.050 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.386410.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.309663.log 2023-07-06T02:41:08.051 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.386410.log.gz 2023-07-06T02:41:08.051 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.755363.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.345011.log 2023-07-06T02:41:08.051 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.755363.log.gz 2023-07-06T02:41:08.051 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.309663.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.364570.log 2023-07-06T02:41:08.051 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.309663.log.gz 2023-07-06T02:41:08.052 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.345011.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.449272.log 2023-07-06T02:41:08.052 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.345011.log.gz 2023-07-06T02:41:08.052 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.364570.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.753104.log 2023-07-06T02:41:08.052 INFO:teuthology.orchestra.run.smithi046.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.106923.log.gz 2023-07-06T02:41:08.053 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.364570.log.gz 2023-07-06T02:41:08.053 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.449272.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.209175.log 2023-07-06T02:41:08.053 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.449272.log.gz 2023-07-06T02:41:08.053 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.753104.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.448687.log 2023-07-06T02:41:08.053 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.753104.log.gz 2023-07-06T02:41:08.054 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.209175.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.932561.log 2023-07-06T02:41:08.054 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.209175.log.gz 2023-07-06T02:41:08.054 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.448687.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.333858.log 2023-07-06T02:41:08.054 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.448687.log.gz 2023-07-06T02:41:08.054 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.932561.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.174172.log 2023-07-06T02:41:08.055 INFO:teuthology.orchestra.run.smithi046.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.932561.log.gz 2023-07-06T02:41:08.055 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.333858.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.926668.log 2023-07-06T02:41:08.055 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.333858.log.gz 2023-07-06T02:41:08.055 INFO:teuthology.orchestra.run.smithi046.stderr:gzip /var/log/ceph/ceph-client.admin.174172.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.155464.log 2023-07-06T02:41:08.055 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.174172.log.gz 2023-07-06T02:41:08.055 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.926668.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.623331.log 2023-07-06T02:41:08.056 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.926668.log.gz 2023-07-06T02:41:08.056 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.155464.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.302023.log 2023-07-06T02:41:08.056 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.155464.log.gz 2023-07-06T02:41:08.056 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.623331.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.704170.log 2023-07-06T02:41:08.057 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.623331.log.gz 2023-07-06T02:41:08.057 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.302023.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.685407.log 2023-07-06T02:41:08.057 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.302023.log.gz 2023-07-06T02:41:08.057 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.704170.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.694431.log 2023-07-06T02:41:08.057 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.704170.log.gz 2023-07-06T02:41:08.058 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.685407.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.253038.log 2023-07-06T02:41:08.058 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.685407.log.gz 2023-07-06T02:41:08.058 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.694431.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.611987.log 2023-07-06T02:41:08.058 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.694431.log.gz 2023-07-06T02:41:08.058 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.253038.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.216770.log 2023-07-06T02:41:08.058 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.253038.log.gz 2023-07-06T02:41:08.059 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.611987.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.408452.log 2023-07-06T02:41:08.059 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.611987.log.gz 2023-07-06T02:41:08.059 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.216770.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.202149.log 2023-07-06T02:41:08.059 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.216770.log.gz 2023-07-06T02:41:08.059 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.408452.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.634338.log 2023-07-06T02:41:08.060 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.408452.log.gz 2023-07-06T02:41:08.060 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.202149.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.363557.log 2023-07-06T02:41:08.060 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.202149.log.gz 2023-07-06T02:41:08.060 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.634338.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.338607.log 2023-07-06T02:41:08.060 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.634338.log.gz 2023-07-06T02:41:08.061 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.363557.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.363557.log.gz 2023-07-06T02:41:08.061 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.205532.log 2023-07-06T02:41:08.061 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.338607.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.689614.log 2023-07-06T02:41:08.061 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.338607.log.gz 2023-07-06T02:41:08.061 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.205532.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.648664.log 2023-07-06T02:41:08.062 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.205532.log.gz 2023-07-06T02:41:08.062 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.689614.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.347093.log 2023-07-06T02:41:08.062 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.689614.log.gz 2023-07-06T02:41:08.062 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.648664.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.216676.log 2023-07-06T02:41:08.062 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.648664.log.gz 2023-07-06T02:41:08.063 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.347093.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.250925.log 2023-07-06T02:41:08.063 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.347093.log.gz 2023-07-06T02:41:08.063 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.216676.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.448254.log 2023-07-06T02:41:08.063 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.216676.log.gz 2023-07-06T02:41:08.063 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.250925.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.797897.log 2023-07-06T02:41:08.064 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.250925.log.gz 2023-07-06T02:41:08.064 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.448254.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.283736.log 2023-07-06T02:41:08.064 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.448254.log.gz 2023-07-06T02:41:08.064 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.797897.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.652013.log 2023-07-06T02:41:08.064 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.797897.log.gz 2023-07-06T02:41:08.065 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.283736.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.374988.log 2023-07-06T02:41:08.065 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.283736.log.gz 2023-07-06T02:41:08.065 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.652013.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.187167.log 2023-07-06T02:41:08.065 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.652013.log.gz 2023-07-06T02:41:08.065 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.374988.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.154535.log 2023-07-06T02:41:08.066 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.374988.log.gz 2023-07-06T02:41:08.066 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.187167.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.385792.log 2023-07-06T02:41:08.066 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.187167.log.gz 2023-07-06T02:41:08.066 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.154535.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.381905.log 2023-07-06T02:41:08.066 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.154535.log.gz 2023-07-06T02:41:08.067 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.385792.log: gzip 0.0%-5 -- replaced with /var/log/ceph/ceph-client.admin.385792.log.gz--verbose 2023-07-06T02:41:08.067 INFO:teuthology.orchestra.run.smithi046.stderr:-- /var/log/ceph/ceph-client.admin.174093.log 2023-07-06T02:41:08.067 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.381905.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.112994.log 2023-07-06T02:41:08.067 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.381905.log.gz 2023-07-06T02:41:08.067 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.174093.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.798919.log 2023-07-06T02:41:08.068 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.174093.log.gz 2023-07-06T02:41:08.068 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.112994.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.217233.log 2023-07-06T02:41:08.068 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.798919.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.374570.log 2023-07-06T02:41:08.068 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.798919.log.gz 2023-07-06T02:41:08.068 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.217233.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.757468.log 2023-07-06T02:41:08.069 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.217233.log.gz 2023-07-06T02:41:08.069 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.374570.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.336889.log 2023-07-06T02:41:08.069 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.374570.log.gz 2023-07-06T02:41:08.069 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.757468.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.109478.log 2023-07-06T02:41:08.069 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.757468.log.gz 2023-07-06T02:41:08.070 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.336889.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.274835.log 2023-07-06T02:41:08.070 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.336889.log.gz 2023-07-06T02:41:08.070 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.109478.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.296593.log 2023-07-06T02:41:08.070 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.274835.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.115665.log 2023-07-06T02:41:08.070 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.274835.log.gz 2023-07-06T02:41:08.071 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.775141.log 2023-07-06T02:41:08.071 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.296593.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.296593.log.gz 2023-07-06T02:41:08.071 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.115665.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.192785.log 2023-07-06T02:41:08.071 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.775141.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.186221.log 2023-07-06T02:41:08.071 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.775141.log.gz 2023-07-06T02:41:08.072 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.192785.log: gzip 0.0%-5 --verbose -- replaced with /var/log/ceph/ceph-client.admin.192785.log.gz-- 2023-07-06T02:41:08.072 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.686014.log 2023-07-06T02:41:08.072 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.186221.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.404963.log 2023-07-06T02:41:08.072 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.186221.log.gz 2023-07-06T02:41:08.073 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.686014.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.686014.log.gz 2023-07-06T02:41:08.073 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.791292.log 2023-07-06T02:41:08.073 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.404963.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.402445.log 2023-07-06T02:41:08.073 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.404963.log.gz 2023-07-06T02:41:08.073 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.791292.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.676254.log 2023-07-06T02:41:08.074 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.791292.log.gz 2023-07-06T02:41:08.074 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.402445.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.928614.log 2023-07-06T02:41:08.074 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.402445.log.gz 2023-07-06T02:41:08.074 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.676254.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.676254.log.gz 2023-07-06T02:41:08.075 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.114151.log 2023-07-06T02:41:08.075 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.928614.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.789542.log 2023-07-06T02:41:08.075 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.928614.log.gz 2023-07-06T02:41:08.075 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.114151.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.385277.log 2023-07-06T02:41:08.075 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.789542.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.202668.log 2023-07-06T02:41:08.076 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.789542.log.gz 2023-07-06T02:41:08.076 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.385277.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.362530.log 2023-07-06T02:41:08.076 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.385277.log.gz 2023-07-06T02:41:08.076 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.202668.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.202668.log.gz 2023-07-06T02:41:08.076 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.925611.log 2023-07-06T02:41:08.077 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.362530.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.113178.log 2023-07-06T02:41:08.077 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.362530.log.gz 2023-07-06T02:41:08.077 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.925611.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.201826.log 2023-07-06T02:41:08.077 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.925611.log.gz 2023-07-06T02:41:08.077 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.113178.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.108301.log 2023-07-06T02:41:08.078 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.201826.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.464237.log 2023-07-06T02:41:08.078 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.201826.log.gz 2023-07-06T02:41:08.078 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.108301.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.373437.log 2023-07-06T02:41:08.078 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.464237.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.440032.log 2023-07-06T02:41:08.079 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.464237.log.gz 2023-07-06T02:41:08.079 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.373437.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.448268.log 2023-07-06T02:41:08.079 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.373437.log.gz 2023-07-06T02:41:08.079 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.440032.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.612001.log 2023-07-06T02:41:08.079 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.440032.log.gz 2023-07-06T02:41:08.079 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.448268.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.360994.log 2023-07-06T02:41:08.080 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.448268.log.gz 2023-07-06T02:41:08.080 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.612001.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.700492.log 2023-07-06T02:41:08.080 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.612001.log.gz 2023-07-06T02:41:08.080 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.360994.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.683379.log 2023-07-06T02:41:08.081 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.360994.log.gz 2023-07-06T02:41:08.081 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.700492.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.318057.log 2023-07-06T02:41:08.081 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.700492.log.gz 2023-07-06T02:41:08.081 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.683379.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.628967.log 2023-07-06T02:41:08.081 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.683379.log.gz 2023-07-06T02:41:08.082 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.318057.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.168665.log 2023-07-06T02:41:08.082 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.318057.log.gz 2023-07-06T02:41:08.082 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.628967.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.628967.log.gz 2023-07-06T02:41:08.082 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.150568.log 2023-07-06T02:41:08.082 INFO:teuthology.orchestra.run.smithi046.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.107916.log.gz 2023-07-06T02:41:08.083 INFO:teuthology.orchestra.run.smithi046.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.111423.log.gz 2023-07-06T02:41:08.083 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.168665.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.168665.log.gz 2023-07-06T02:41:08.083 INFO:teuthology.orchestra.run.smithi046.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.107061.log.gz 2023-07-06T02:41:08.083 INFO:teuthology.orchestra.run.smithi046.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.111608.log.gz 2023-07-06T02:41:08.083 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.150568.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.150568.log.gz 2023-07-06T02:41:08.084 INFO:teuthology.orchestra.run.smithi046.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.115155.log.gz 2023-07-06T02:41:08.084 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.701567.log 2023-07-06T02:41:08.084 INFO:teuthology.orchestra.run.smithi046.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.113783.log.gz 2023-07-06T02:41:08.084 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose 89.3%-- /var/log/ceph/ceph-client.admin.369199.log -- replaced with /var/log/ceph/ceph-client.admin.114197.log.gz 2023-07-06T02:41:08.084 INFO:teuthology.orchestra.run.smithi046.stderr: 2023-07-06T02:41:08.085 INFO:teuthology.orchestra.run.smithi046.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.107015.log.gz 2023-07-06T02:41:08.085 INFO:teuthology.orchestra.run.smithi046.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.111746.log.gz 2023-07-06T02:41:08.085 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.701567.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.292724.log 2023-07-06T02:41:08.085 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.701567.log.gz 2023-07-06T02:41:08.085 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.369199.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.339937.log 2023-07-06T02:41:08.086 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.369199.log.gz 2023-07-06T02:41:08.086 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.292724.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.261443.log 2023-07-06T02:41:08.086 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.292724.log.gz 2023-07-06T02:41:08.086 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.339937.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.802060.log 2023-07-06T02:41:08.086 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.339937.log.gz 2023-07-06T02:41:08.087 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.261443.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.246617.log 2023-07-06T02:41:08.087 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.261443.log.gz 2023-07-06T02:41:08.087 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.802060.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.241117.log 2023-07-06T02:41:08.087 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.802060.log.gz 2023-07-06T02:41:08.087 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.246617.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.171436.log 2023-07-06T02:41:08.088 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.246617.log.gz 2023-07-06T02:41:08.088 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.241117.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.675476.log 2023-07-06T02:41:08.088 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.241117.log.gz 2023-07-06T02:41:08.088 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.171436.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.307801.log 2023-07-06T02:41:08.088 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.171436.log.gz 2023-07-06T02:41:08.089 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.675476.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.675476.log.gz 2023-07-06T02:41:08.089 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.539736.log 2023-07-06T02:41:08.089 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.307801.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.359281.log 2023-07-06T02:41:08.089 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.307801.log.gz 2023-07-06T02:41:08.089 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.539736.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.539736.log.gzgzip 2023-07-06T02:41:08.090 INFO:teuthology.orchestra.run.smithi046.stderr:-5 --verbose -- /var/log/ceph/ceph-client.admin.297072.log 2023-07-06T02:41:08.090 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.359281.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.812899.log 2023-07-06T02:41:08.090 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.359281.log.gz 2023-07-06T02:41:08.090 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.297072.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.268534.log 2023-07-06T02:41:08.091 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.297072.log.gz 2023-07-06T02:41:08.091 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.812899.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.361492.log 2023-07-06T02:41:08.091 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.812899.log.gz 2023-07-06T02:41:08.092 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.268534.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.297567.log 2023-07-06T02:41:08.092 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.268534.log.gz 2023-07-06T02:41:08.092 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.361492.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.665814.log 2023-07-06T02:41:08.093 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.361492.log.gz 2023-07-06T02:41:08.093 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.297567.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.188841.log 2023-07-06T02:41:08.093 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.297567.log.gz 2023-07-06T02:41:08.093 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.665814.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.339643.log 2023-07-06T02:41:08.093 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.665814.log.gz 2023-07-06T02:41:08.094 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.188841.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.794511.log 2023-07-06T02:41:08.094 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.188841.log.gz 2023-07-06T02:41:08.094 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.339643.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.314340.log 2023-07-06T02:41:08.094 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.339643.log.gz 2023-07-06T02:41:08.095 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.794511.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.106659.log 2023-07-06T02:41:08.095 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.794511.log.gz 2023-07-06T02:41:08.095 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.314340.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.925690.log 2023-07-06T02:41:08.095 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.314340.log.gz 2023-07-06T02:41:08.095 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.106659.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.341723.log 2023-07-06T02:41:08.096 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.925690.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.631379.log 2023-07-06T02:41:08.096 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.925690.log.gz 2023-07-06T02:41:08.096 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.341723.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.150582.log 2023-07-06T02:41:08.096 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.341723.log.gz 2023-07-06T02:41:08.097 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.631379.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.347547.log 2023-07-06T02:41:08.097 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.631379.log.gz 2023-07-06T02:41:08.097 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.150582.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.159557.log 2023-07-06T02:41:08.098 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.150582.log.gz 2023-07-06T02:41:08.098 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.347547.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.386880.log 2023-07-06T02:41:08.098 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.347547.log.gz 2023-07-06T02:41:08.098 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.159557.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.248092.log 2023-07-06T02:41:08.099 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.159557.log.gz 2023-07-06T02:41:08.099 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.386880.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.274093.log 2023-07-06T02:41:08.099 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.386880.log.gz 2023-07-06T02:41:08.099 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.248092.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.619801.log 2023-07-06T02:41:08.099 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.248092.log.gz 2023-07-06T02:41:08.100 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.274093.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.436767.log 2023-07-06T02:41:08.100 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.274093.log.gz 2023-07-06T02:41:08.100 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.619801.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.308745.log 2023-07-06T02:41:08.101 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.619801.log.gz 2023-07-06T02:41:08.101 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.436767.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.311747.log 2023-07-06T02:41:08.101 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.436767.log.gz 2023-07-06T02:41:08.102 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.308745.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.318434.log 2023-07-06T02:41:08.102 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.308745.log.gz 2023-07-06T02:41:08.102 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.311747.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.310267.log 2023-07-06T02:41:08.102 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.311747.log.gz 2023-07-06T02:41:08.102 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.318434.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.282426.log 2023-07-06T02:41:08.103 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.318434.log.gz 2023-07-06T02:41:08.103 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.310267.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.108303.log 2023-07-06T02:41:08.103 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.310267.log.gz 2023-07-06T02:41:08.103 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.282426.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.384255.log 2023-07-06T02:41:08.103 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.282426.log.gz 2023-07-06T02:41:08.104 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.108303.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.363046.log 2023-07-06T02:41:08.104 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.384255.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.439127.log 2023-07-06T02:41:08.104 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.384255.log.gz 2023-07-06T02:41:08.104 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.363046.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.309756.log 2023-07-06T02:41:08.105 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.363046.log.gz 2023-07-06T02:41:08.105 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.439127.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.112860.log 2023-07-06T02:41:08.105 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.439127.log.gz 2023-07-06T02:41:08.105 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.309756.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.272791.log 2023-07-06T02:41:08.105 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.309756.log.gz 2023-07-06T02:41:08.106 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.112860.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.466427.log 2023-07-06T02:41:08.106 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.272791.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.338822.log 2023-07-06T02:41:08.106 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.272791.log.gz 2023-07-06T02:41:08.106 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.466427.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.345999.log 2023-07-06T02:41:08.106 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.466427.log.gz 2023-07-06T02:41:08.107 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.338822.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.579920.log 2023-07-06T02:41:08.107 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.338822.log.gz 2023-07-06T02:41:08.107 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.345999.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.325728.log 2023-07-06T02:41:08.107 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.345999.log.gz 2023-07-06T02:41:08.107 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.579920.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.579920.log.gz 2023-07-06T02:41:08.108 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.697111.log 2023-07-06T02:41:08.108 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.325728.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.332563.log 2023-07-06T02:41:08.108 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.325728.log.gz 2023-07-06T02:41:08.108 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.697111.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.697111.log.gz 2023-07-06T02:41:08.109 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.115803.log 2023-07-06T02:41:08.109 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.332563.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.108297.log 2023-07-06T02:41:08.109 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.332563.log.gz 2023-07-06T02:41:08.109 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.115803.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.419392.log 2023-07-06T02:41:08.109 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.108297.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.772928.log 2023-07-06T02:41:08.110 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.419392.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.795629.log 2023-07-06T02:41:08.110 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.419392.log.gz 2023-07-06T02:41:08.110 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.772928.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.112160.log 2023-07-06T02:41:08.110 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.772928.log.gz 2023-07-06T02:41:08.110 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.795629.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.795629.log.gzgzip 2023-07-06T02:41:08.111 INFO:teuthology.orchestra.run.smithi046.stderr:-5 --verbose -- /var/log/ceph/ceph-client.admin.248989.log 2023-07-06T02:41:08.111 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.112160.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.333172.log 2023-07-06T02:41:08.111 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.248989.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.637253.log 2023-07-06T02:41:08.112 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.248989.log.gz 2023-07-06T02:41:08.112 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.333172.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.168679.log 2023-07-06T02:41:08.113 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.333172.log.gz 2023-07-06T02:41:08.113 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.637253.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.381998.log 2023-07-06T02:41:08.113 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.637253.log.gz 2023-07-06T02:41:08.113 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.168679.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.413901.log 2023-07-06T02:41:08.114 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.168679.log.gz 2023-07-06T02:41:08.114 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.381998.log: gzip -5 --verbose -- 0.0%/var/log/ceph/ceph-client.admin.655622.log -- replaced with /var/log/ceph/ceph-client.admin.381998.log.gz 2023-07-06T02:41:08.114 INFO:teuthology.orchestra.run.smithi046.stderr: 2023-07-06T02:41:08.114 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.413901.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.467135.log 2023-07-06T02:41:08.115 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.413901.log.gz 2023-07-06T02:41:08.115 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.655622.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.655622.log.gz 2023-07-06T02:41:08.115 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.929603.log 2023-07-06T02:41:08.115 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.467135.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.802340.log 2023-07-06T02:41:08.115 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.467135.log.gz 2023-07-06T02:41:08.116 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.929603.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.929603.log.gz 2023-07-06T02:41:08.116 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.378625.log 2023-07-06T02:41:08.116 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.802340.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.771844.log 2023-07-06T02:41:08.116 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.802340.log.gz 2023-07-06T02:41:08.117 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.378625.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.153393.log 0.0% 2023-07-06T02:41:08.117 INFO:teuthology.orchestra.run.smithi046.stderr: -- replaced with /var/log/ceph/ceph-client.admin.378625.log.gz 2023-07-06T02:41:08.117 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.771844.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.331359.log 2023-07-06T02:41:08.117 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.771844.log.gz 2023-07-06T02:41:08.117 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.153393.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.330217.log 2023-07-06T02:41:08.118 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.153393.log.gz 2023-07-06T02:41:08.118 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.331359.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.809149.log 2023-07-06T02:41:08.118 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.331359.log.gz 2023-07-06T02:41:08.118 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.330217.log: gzip -5 0.0%--verbose -- -- replaced with /var/log/ceph/ceph-client.admin.330217.log.gz/var/log/ceph/ceph-client.admin.378704.log 2023-07-06T02:41:08.118 INFO:teuthology.orchestra.run.smithi046.stderr: 2023-07-06T02:41:08.119 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.809149.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.439550.log 2023-07-06T02:41:08.119 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.809149.log.gz 2023-07-06T02:41:08.119 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.378704.log: gzip -5 --verbose -- 0.0%/var/log/ceph/ceph-client.admin.699617.log -- replaced with /var/log/ceph/ceph-client.admin.378704.log.gz 2023-07-06T02:41:08.119 INFO:teuthology.orchestra.run.smithi046.stderr: 2023-07-06T02:41:08.119 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.439550.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.325945.log 2023-07-06T02:41:08.120 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.439550.log.gz 2023-07-06T02:41:08.120 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.699617.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.686000.log 2023-07-06T02:41:08.120 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.699617.log.gz 2023-07-06T02:41:08.120 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.325945.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.665907.log 2023-07-06T02:41:08.121 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.325945.log.gz 2023-07-06T02:41:08.121 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.686000.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.680523.log 2023-07-06T02:41:08.121 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.686000.log.gz 2023-07-06T02:41:08.121 INFO:teuthology.orchestra.run.smithi046.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.112994.log.gz 2023-07-06T02:41:08.121 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.665907.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.665907.log.gz 2023-07-06T02:41:08.122 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.663863.log 2023-07-06T02:41:08.122 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.632649.log 2023-07-06T02:41:08.122 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.680523.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.113178.log.gz 2023-07-06T02:41:08.122 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.680523.log.gz 2023-07-06T02:41:08.122 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.663863.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.205065.log 2023-07-06T02:41:08.123 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.663863.log.gz 2023-07-06T02:41:08.123 INFO:teuthology.orchestra.run.smithi046.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.114151.log.gz 2023-07-06T02:41:08.123 INFO:teuthology.orchestra.run.smithi046.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.115665.log.gz 2023-07-06T02:41:08.124 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.632649.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.260658.log 2023-07-06T02:41:08.124 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.632649.log.gz 2023-07-06T02:41:08.124 INFO:teuthology.orchestra.run.smithi046.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.109478.log.gz 2023-07-06T02:41:08.125 INFO:teuthology.orchestra.run.smithi046.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.106659.log.gz 2023-07-06T02:41:08.125 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.205065.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.112860.log.gz 2023-07-06T02:41:08.125 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.205065.log.gz 2023-07-06T02:41:08.125 INFO:teuthology.orchestra.run.smithi046.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.108301.log.gz 2023-07-06T02:41:08.126 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.260658.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.108297.log.gz 2023-07-06T02:41:08.126 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.260658.log.gz 2023-07-06T02:41:08.126 INFO:teuthology.orchestra.run.smithi046.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.112160.log.gz 2023-07-06T02:41:08.126 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.809619.log 2023-07-06T02:41:08.127 INFO:teuthology.orchestra.run.smithi046.stderr: 90.9% -- replaced with /var/log/ceph/ceph-client.admin.115803.log.gz 2023-07-06T02:41:08.127 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.276923.log 2023-07-06T02:41:08.127 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.809619.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.622098.log 2023-07-06T02:41:08.127 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.809619.log.gz 2023-07-06T02:41:08.127 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.276923.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.268627.log 2023-07-06T02:41:08.128 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.276923.log.gz 2023-07-06T02:41:08.128 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.622098.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.279267.log 2023-07-06T02:41:08.128 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.622098.log.gz 2023-07-06T02:41:08.128 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.268627.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.205158.log 2023-07-06T02:41:08.129 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.268627.log.gz 2023-07-06T02:41:08.129 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.279267.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.932147.log 2023-07-06T02:41:08.129 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.279267.log.gz 2023-07-06T02:41:08.129 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.205158.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.155010.log 2023-07-06T02:41:08.129 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.205158.log.gz 2023-07-06T02:41:08.130 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.932147.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.353284.log 2023-07-06T02:41:08.130 INFO:teuthology.orchestra.run.smithi046.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.932147.log.gz 2023-07-06T02:41:08.130 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.155010.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.677788.log 2023-07-06T02:41:08.130 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.155010.log.gz 2023-07-06T02:41:08.130 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.353284.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.759230.log 2023-07-06T02:41:08.131 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.353284.log.gz 2023-07-06T02:41:08.131 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.677788.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.928600.log 2023-07-06T02:41:08.131 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.677788.log.gz 2023-07-06T02:41:08.131 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.759230.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.386396.log 2023-07-06T02:41:08.132 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.759230.log.gz 2023-07-06T02:41:08.132 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.928600.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.261660.log 2023-07-06T02:41:08.132 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.928600.log.gz 2023-07-06T02:41:08.132 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.386396.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.792775.log 2023-07-06T02:41:08.133 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.386396.log.gz 2023-07-06T02:41:08.133 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.261660.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.931466.log 2023-07-06T02:41:08.133 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.261660.log.gz 2023-07-06T02:41:08.133 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.792775.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.114609.log 2023-07-06T02:41:08.133 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.792775.log.gz 2023-07-06T02:41:08.134 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.931466.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.625543.log 2023-07-06T02:41:08.134 INFO:teuthology.orchestra.run.smithi046.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.931466.log.gz 2023-07-06T02:41:08.134 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.114609.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.334659.log 2023-07-06T02:41:08.134 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.625543.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.932745.log 2023-07-06T02:41:08.135 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.625543.log.gz 2023-07-06T02:41:08.135 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.334659.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.326760.log 2023-07-06T02:41:08.135 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.334659.log.gz 2023-07-06T02:41:08.136 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.932745.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.344918.log 2023-07-06T02:41:08.136 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.326760.log: gzip -5 89.0%--verbose -- -- replaced with /var/log/ceph/ceph-client.admin.932745.log.gz 2023-07-06T02:41:08.136 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.273288.log 2023-07-06T02:41:08.137 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.326760.log.gz 2023-07-06T02:41:08.137 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.344918.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.400286.log 2023-07-06T02:41:08.137 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.344918.log.gz 2023-07-06T02:41:08.137 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.273288.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.360511.log 2023-07-06T02:41:08.138 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.273288.log.gz 2023-07-06T02:41:08.138 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.400286.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.803501.log 2023-07-06T02:41:08.138 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.400286.log.gz 2023-07-06T02:41:08.138 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.360511.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.357550.log 2023-07-06T02:41:08.138 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.360511.log.gz 2023-07-06T02:41:08.139 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.803501.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.354208.log 2023-07-06T02:41:08.139 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.803501.log.gz 2023-07-06T02:41:08.139 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.357550.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.676569.log 2023-07-06T02:41:08.139 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.357550.log.gz 2023-07-06T02:41:08.140 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.354208.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.651602.log 2023-07-06T02:41:08.140 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.354208.log.gz 2023-07-06T02:41:08.140 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.676569.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.689408.log 2023-07-06T02:41:08.140 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.676569.log.gz 2023-07-06T02:41:08.140 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.651602.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.115711.log 2023-07-06T02:41:08.141 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.651602.log.gz 2023-07-06T02:41:08.141 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.689408.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.693084.log 2023-07-06T02:41:08.141 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.689408.log.gz 2023-07-06T02:41:08.141 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.115711.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.304636.log 2023-07-06T02:41:08.141 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.693084.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.448472.log 2023-07-06T02:41:08.142 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.693084.log.gz 2023-07-06T02:41:08.142 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.304636.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.923201.log 2023-07-06T02:41:08.142 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.304636.log.gz 2023-07-06T02:41:08.142 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.448472.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.448472.log.gz 2023-07-06T02:41:08.143 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.393502.log 2023-07-06T02:41:08.143 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.923201.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.343975.log 2023-07-06T02:41:08.143 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.923201.log.gz 2023-07-06T02:41:08.143 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.393502.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.622660.log 2023-07-06T02:41:08.144 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.393502.log.gz 2023-07-06T02:41:08.144 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.343975.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.793286.log 2023-07-06T02:41:08.144 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.343975.log.gz 2023-07-06T02:41:08.144 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.622660.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.405424.log 2023-07-06T02:41:08.144 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.622660.log.gz 2023-07-06T02:41:08.145 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.793286.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.280746.log 2023-07-06T02:41:08.145 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.793286.log.gz 2023-07-06T02:41:08.145 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.405424.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.271544.log 2023-07-06T02:41:08.145 INFO:teuthology.orchestra.run.smithi046.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.114609.log.gz 2023-07-06T02:41:08.145 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.405424.log.gz 2023-07-06T02:41:08.146 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.280746.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.691723.log 2023-07-06T02:41:08.146 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.280746.log.gz 2023-07-06T02:41:08.146 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.271544.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.813634.log 2023-07-06T02:41:08.146 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.271544.log.gz 2023-07-06T02:41:08.147 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.691723.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.327779.log 2023-07-06T02:41:08.147 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.691723.log.gz 2023-07-06T02:41:08.147 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.813634.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.701581.log 2023-07-06T02:41:08.148 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.813634.log.gz 2023-07-06T02:41:08.148 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.327779.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.678020.log 2023-07-06T02:41:08.148 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.327779.log.gz 2023-07-06T02:41:08.149 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.701581.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.415861.log 2023-07-06T02:41:08.149 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.701581.log.gz 2023-07-06T02:41:08.149 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.200579.log 2023-07-06T02:41:08.149 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.678020.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.678020.log.gz 2023-07-06T02:41:08.149 INFO:teuthology.orchestra.run.smithi046.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.115711.log.gz 2023-07-06T02:41:08.150 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.415861.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.410533.log 2023-07-06T02:41:08.150 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.415861.log.gz 2023-07-06T02:41:08.150 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.200579.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.390254.log 2023-07-06T02:41:08.150 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.200579.log.gz 2023-07-06T02:41:08.151 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.410533.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.107910.log 2023-07-06T02:41:08.151 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.410533.log.gz 2023-07-06T02:41:08.151 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.390254.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.373056.log 2023-07-06T02:41:08.151 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.390254.log.gz 2023-07-06T02:41:08.151 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.107910.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.241513.log 2023-07-06T02:41:08.152 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.373056.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.201162.log 2023-07-06T02:41:08.152 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.373056.log.gz 2023-07-06T02:41:08.152 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.241513.log: gzip -5 --verbose 88.9%-- /var/log/ceph/ceph-client.admin.774434.log -- replaced with /var/log/ceph/ceph-client.admin.107910.log.gz 2023-07-06T02:41:08.152 INFO:teuthology.orchestra.run.smithi046.stderr: 2023-07-06T02:41:08.152 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.241513.log.gz 2023-07-06T02:41:08.153 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.201162.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.399563.log 2023-07-06T02:41:08.153 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.201162.log.gz 2023-07-06T02:41:08.153 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.774434.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.257716.log 2023-07-06T02:41:08.153 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.774434.log.gz 2023-07-06T02:41:08.154 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.399563.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.317565.log 2023-07-06T02:41:08.154 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.399563.log.gz 2023-07-06T02:41:08.154 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.257716.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.678782.log 2023-07-06T02:41:08.154 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.257716.log.gz 2023-07-06T02:41:08.154 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.317565.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.672206.log 2023-07-06T02:41:08.155 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.317565.log.gz 2023-07-06T02:41:08.155 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.678782.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.285492.log 2023-07-06T02:41:08.155 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.678782.log.gz 2023-07-06T02:41:08.155 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.672206.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.622191.log 2023-07-06T02:41:08.155 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.672206.log.gz 2023-07-06T02:41:08.156 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.285492.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.754101.log 2023-07-06T02:41:08.156 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.285492.log.gz 2023-07-06T02:41:08.156 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.622191.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.300560.log 2023-07-06T02:41:08.156 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.622191.log.gz 2023-07-06T02:41:08.156 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.754101.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.196564.log 2023-07-06T02:41:08.157 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.754101.log.gz 2023-07-06T02:41:08.157 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.300560.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.166870.log 2023-07-06T02:41:08.157 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.300560.log.gz 2023-07-06T02:41:08.157 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.196564.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.693379.log 2023-07-06T02:41:08.158 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.196564.log.gz 2023-07-06T02:41:08.158 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.166870.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.800667.log 2023-07-06T02:41:08.158 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.166870.log.gz 2023-07-06T02:41:08.159 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.693379.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.640133.log 2023-07-06T02:41:08.159 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.693379.log.gz 2023-07-06T02:41:08.159 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.800667.log: 0.0%gzip -5 -- replaced with /var/log/ceph/ceph-client.admin.800667.log.gz--verbose 2023-07-06T02:41:08.160 INFO:teuthology.orchestra.run.smithi046.stderr:-- /var/log/ceph/ceph-client.admin.395155.log 2023-07-06T02:41:08.160 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.640133.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.396535.log 2023-07-06T02:41:08.160 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.640133.log.gz 2023-07-06T02:41:08.161 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.395155.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.323069.log 2023-07-06T02:41:08.161 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.395155.log.gz 2023-07-06T02:41:08.161 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.396535.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.309973.log 2023-07-06T02:41:08.161 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.396535.log.gz 2023-07-06T02:41:08.161 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.323069.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.287192.log 2023-07-06T02:41:08.162 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.323069.log.gz 2023-07-06T02:41:08.162 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.309973.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.246051.log 2023-07-06T02:41:08.162 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.309973.log.gz 2023-07-06T02:41:08.162 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.287192.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.287192.log.gz 2023-07-06T02:41:08.162 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.623137.log 2023-07-06T02:41:08.163 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.629441.log 2023-07-06T02:41:08.163 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.246051.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.246051.log.gz 2023-07-06T02:41:08.163 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.623137.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.623137.log.gz 2023-07-06T02:41:08.163 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.793797.log 2023-07-06T02:41:08.163 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.629441.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.635740.log 2023-07-06T02:41:08.164 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.629441.log.gz 2023-07-06T02:41:08.164 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.793797.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.210707.log 2023-07-06T02:41:08.164 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.793797.log.gz 2023-07-06T02:41:08.164 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.635740.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.688704.log 2023-07-06T02:41:08.165 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.635740.log.gz 2023-07-06T02:41:08.165 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.210707.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.382836.log 2023-07-06T02:41:08.165 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.210707.log.gz 2023-07-06T02:41:08.165 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.688704.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.814654.log 2023-07-06T02:41:08.165 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.688704.log.gz 2023-07-06T02:41:08.166 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.382836.log: 0.0%gzip -- replaced with /var/log/ceph/ceph-client.admin.382836.log.gz-5 2023-07-06T02:41:08.166 INFO:teuthology.orchestra.run.smithi046.stderr:--verbose -- /var/log/ceph/ceph-client.admin.678577.log 2023-07-06T02:41:08.166 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.814654.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.242885.log 2023-07-06T02:41:08.166 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.814654.log.gz 2023-07-06T02:41:08.166 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.678577.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.255756.log 2023-07-06T02:41:08.167 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.678577.log.gz 2023-07-06T02:41:08.167 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.242885.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.401522.log 2023-07-06T02:41:08.167 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.242885.log.gz 2023-07-06T02:41:08.167 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.255756.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.159650.log 2023-07-06T02:41:08.168 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.255756.log.gz 2023-07-06T02:41:08.168 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.401522.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.309226.log 2023-07-06T02:41:08.168 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.401522.log.gz 2023-07-06T02:41:08.168 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.159650.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.381072.log 2023-07-06T02:41:08.169 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.159650.log.gz 2023-07-06T02:41:08.169 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.309226.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.303473.log 2023-07-06T02:41:08.169 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.309226.log.gz 2023-07-06T02:41:08.169 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.381072.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.793566.log 2023-07-06T02:41:08.169 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.381072.log.gz 2023-07-06T02:41:08.170 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.303473.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.2.110971.log 2023-07-06T02:41:08.170 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.303473.log.gz 2023-07-06T02:41:08.170 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.793566.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.410612.log 2023-07-06T02:41:08.171 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.793566.log.gz 2023-07-06T02:41:08.171 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.2.110971.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.648618.log 2023-07-06T02:41:08.171 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.2.110971.log.gz 2023-07-06T02:41:08.172 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.410612.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.774832.log 2023-07-06T02:41:08.172 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.410612.log.gz 2023-07-06T02:41:08.172 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.648618.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.932377.log 2023-07-06T02:41:08.172 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.648618.log.gz 2023-07-06T02:41:08.173 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.774832.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.375578.log 2023-07-06T02:41:08.173 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.774832.log.gz 2023-07-06T02:41:08.173 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.932377.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.669294.log 2023-07-06T02:41:08.173 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.375578.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.932377.log.gz 2023-07-06T02:41:08.174 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.255770.log 2023-07-06T02:41:08.174 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.375578.log.gz 2023-07-06T02:41:08.174 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.669294.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.188827.log 2023-07-06T02:41:08.174 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.669294.log.gz 2023-07-06T02:41:08.174 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.255770.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.188626.log 2023-07-06T02:41:08.175 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.255770.log.gz 2023-07-06T02:41:08.175 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.188827.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.154917.log 2023-07-06T02:41:08.175 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.188827.log.gz 2023-07-06T02:41:08.175 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.188626.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.360901.log 2023-07-06T02:41:08.175 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.188626.log.gz 2023-07-06T02:41:08.176 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.154917.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.665599.log 2023-07-06T02:41:08.176 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.154917.log.gz 2023-07-06T02:41:08.176 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.360901.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.922719.log 2023-07-06T02:41:08.176 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.360901.log.gz 2023-07-06T02:41:08.177 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.665599.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.398289.log 2023-07-06T02:41:08.177 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.665599.log.gz 2023-07-06T02:41:08.177 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.922719.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.922719.log.gz 2023-07-06T02:41:08.177 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.465673.log 2023-07-06T02:41:08.177 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.398289.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.398289.log.gz 2023-07-06T02:41:08.178 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.636945.log 2023-07-06T02:41:08.178 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.465673.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.695304.log 2023-07-06T02:41:08.178 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.465673.log.gz 2023-07-06T02:41:08.178 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.636945.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.274618.log 2023-07-06T02:41:08.179 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.636945.log.gz 2023-07-06T02:41:08.179 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.695304.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.356686.log 2023-07-06T02:41:08.179 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.695304.log.gz 2023-07-06T02:41:08.179 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.274618.log: gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2023-07-06T02:41:08.179 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.274618.log.gz 2023-07-06T02:41:08.180 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.356686.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.334890.log 2023-07-06T02:41:08.180 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.356686.log.gz 2023-07-06T02:41:08.180 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.464721.log 2023-07-06T02:41:08.180 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.334890.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.684354.log 2023-07-06T02:41:08.180 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.334890.log.gz 2023-07-06T02:41:08.181 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.464721.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.299459.log 2023-07-06T02:41:08.181 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.464721.log.gz 2023-07-06T02:41:08.181 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.684354.log: gzip -5 0.0%--verbose -- -- replaced with /var/log/ceph/ceph-client.admin.684354.log.gz/var/log/ceph/ceph-client.admin.111792.log 2023-07-06T02:41:08.181 INFO:teuthology.orchestra.run.smithi046.stderr: 2023-07-06T02:41:08.182 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.299459.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.367746.log 2023-07-06T02:41:08.182 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.299459.log.gz 2023-07-06T02:41:08.183 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.111792.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.278150.log 2023-07-06T02:41:08.183 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.367746.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.328704.log 2023-07-06T02:41:08.183 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.367746.log.gz 2023-07-06T02:41:08.183 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.278150.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.618198.log 2023-07-06T02:41:08.183 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.278150.log.gz 2023-07-06T02:41:08.184 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.798422.log 2023-07-06T02:41:08.184 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.328704.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.328704.log.gz 2023-07-06T02:41:08.184 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.618198.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.618198.log.gz 2023-07-06T02:41:08.184 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.652561.log 2023-07-06T02:41:08.185 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.798422.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.348047.log 2023-07-06T02:41:08.185 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.798422.log.gz 2023-07-06T02:41:08.185 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.652561.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.795024.log 2023-07-06T02:41:08.185 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.652561.log.gz 2023-07-06T02:41:08.185 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.348047.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.385587.log 2023-07-06T02:41:08.186 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.348047.log.gz 2023-07-06T02:41:08.186 INFO:teuthology.orchestra.run.smithi046.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.108303.log.gz 2023-07-06T02:41:08.186 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.795024.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.795024.log.gz 2023-07-06T02:41:08.186 INFO:teuthology.orchestra.run.smithi046.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.108512.log.gz 2023-07-06T02:41:08.186 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.756064.log 2023-07-06T02:41:08.187 INFO:teuthology.orchestra.run.smithi046.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.108623.log.gz 2023-07-06T02:41:08.187 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.385587.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.676023.log 2023-07-06T02:41:08.187 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.385587.log.gz 2023-07-06T02:41:08.187 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.756064.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.111792.log.gz 2023-07-06T02:41:08.187 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.696829.log 2023-07-06T02:41:08.188 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.756064.log.gz 2023-07-06T02:41:08.188 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.676023.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.449258.log 2023-07-06T02:41:08.188 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.676023.log.gz 2023-07-06T02:41:08.188 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.696829.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.245069.log 2023-07-06T02:41:08.189 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.696829.log.gz 2023-07-06T02:41:08.189 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.449258.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.241811.log 2023-07-06T02:41:08.189 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.449258.log.gz 2023-07-06T02:41:08.189 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.245069.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.692795.log 2023-07-06T02:41:08.189 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.245069.log.gz 2023-07-06T02:41:08.190 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.241811.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.674072.log 2023-07-06T02:41:08.190 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.241811.log.gz 2023-07-06T02:41:08.190 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.692795.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.818112.log 2023-07-06T02:41:08.190 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.692795.log.gz 2023-07-06T02:41:08.190 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.674072.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.695117.log 2023-07-06T02:41:08.191 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.674072.log.gz 2023-07-06T02:41:08.191 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.818112.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.108304.log 2023-07-06T02:41:08.191 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.818112.log.gz 2023-07-06T02:41:08.192 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.695117.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.695117.log.gz 2023-07-06T02:41:08.192 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.334360.log 2023-07-06T02:41:08.192 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.108304.log: /var/log/ceph/ceph-client.admin.291996.log 2023-07-06T02:41:08.193 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.334360.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.192803.log 2023-07-06T02:41:08.193 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.334360.log.gz 2023-07-06T02:41:08.194 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.448486.log 2023-07-06T02:41:08.194 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.291996.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.291996.log.gz 2023-07-06T02:41:08.194 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.192803.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.797386.log 2023-07-06T02:41:08.194 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.192803.log.gz 2023-07-06T02:41:08.195 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.448486.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.448486.log.gz 2023-07-06T02:41:08.195 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.281223.log 2023-07-06T02:41:08.195 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.797386.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.323363.log 2023-07-06T02:41:08.195 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.797386.log.gz 2023-07-06T02:41:08.195 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.281223.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.281223.log.gz 2023-07-06T02:41:08.196 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.113132.log 2023-07-06T02:41:08.196 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.323363.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.791572.log 2023-07-06T02:41:08.196 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.323363.log.gz 2023-07-06T02:41:08.196 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.113132.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.392176.log 2023-07-06T02:41:08.197 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.791572.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.771562.log 2023-07-06T02:41:08.197 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.791572.log.gz 2023-07-06T02:41:08.197 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.392176.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.115757.log 2023-07-06T02:41:08.197 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.392176.log.gz 2023-07-06T02:41:08.197 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.771562.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.277422.log 2023-07-06T02:41:08.198 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.771562.log.gz 2023-07-06T02:41:08.198 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.115757.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.771350.log 2023-07-06T02:41:08.198 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.288447.log 2023-07-06T02:41:08.199 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.277422.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.277422.log.gz 2023-07-06T02:41:08.199 INFO:teuthology.orchestra.run.smithi046.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.108304.log.gz 2023-07-06T02:41:08.200 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.771350.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.771350.log.gz 2023-07-06T02:41:08.200 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.261429.log 2023-07-06T02:41:08.200 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.930602.log 2023-07-06T02:41:08.200 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.288447.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.288447.log.gz 2023-07-06T02:41:08.201 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.261429.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.364276.log 2023-07-06T02:41:08.201 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.261429.log.gz 2023-07-06T02:41:08.201 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.930602.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.638166.log 2023-07-06T02:41:08.201 INFO:teuthology.orchestra.run.smithi046.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.113132.log.gz 2023-07-06T02:41:08.202 INFO:teuthology.orchestra.run.smithi046.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.115757.log.gz 2023-07-06T02:41:08.202 INFO:teuthology.orchestra.run.smithi046.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.930602.log.gz 2023-07-06T02:41:08.202 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.364276.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.639192.log 2023-07-06T02:41:08.202 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.364276.log.gz 2023-07-06T02:41:08.202 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.802354.log 2023-07-06T02:41:08.203 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.638166.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.638166.log.gz 2023-07-06T02:41:08.203 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.639192.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.319398.log 2023-07-06T02:41:08.203 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.639192.log.gz 2023-07-06T02:41:08.203 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.802354.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.260737.log 2023-07-06T02:41:08.203 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.802354.log.gz 2023-07-06T02:41:08.204 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.319398.log: gzip -5 --verbose 0.0%-- -- replaced with /var/log/ceph/ceph-client.admin.319398.log.gz/var/log/ceph/ceph-client.admin.638259.log 2023-07-06T02:41:08.204 INFO:teuthology.orchestra.run.smithi046.stderr: 2023-07-06T02:41:08.204 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.260737.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.115343.log 2023-07-06T02:41:08.204 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.260737.log.gz 2023-07-06T02:41:08.205 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.638259.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.398583.log 2023-07-06T02:41:08.205 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.638259.log.gz 2023-07-06T02:41:08.205 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.115343.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.927139.log 2023-07-06T02:41:08.205 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.380608.log 2023-07-06T02:41:08.205 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.398583.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.398583.log.gz 2023-07-06T02:41:08.206 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.927139.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.261242.log 2023-07-06T02:41:08.206 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.927139.log.gz 2023-07-06T02:41:08.206 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.380608.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.204642.log 2023-07-06T02:41:08.206 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.380608.log.gz 2023-07-06T02:41:08.206 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.261242.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.320994.log 2023-07-06T02:41:08.207 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.261242.log.gz 2023-07-06T02:41:08.207 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.265667.log 2023-07-06T02:41:08.207 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.204642.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.204642.log.gz 2023-07-06T02:41:08.207 INFO:teuthology.orchestra.run.smithi046.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.115343.log.gz 2023-07-06T02:41:08.207 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.320994.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.320994.log.gz 2023-07-06T02:41:08.208 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.166366.log 2023-07-06T02:41:08.208 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.112701.log 2023-07-06T02:41:08.208 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.265667.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.265667.log.gz 2023-07-06T02:41:08.208 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.166366.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.101230.log 2023-07-06T02:41:08.209 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.166366.log.gz 2023-07-06T02:41:08.209 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.112701.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.174186.log 2023-07-06T02:41:08.209 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.101230.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.629912.log 2023-07-06T02:41:08.209 INFO:teuthology.orchestra.run.smithi046.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.112701.log.gz 2023-07-06T02:41:08.209 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.174186.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.330676.log 2023-07-06T02:41:08.210 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.174186.log.gz 2023-07-06T02:41:08.210 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.629912.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.794295.log 2023-07-06T02:41:08.210 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.629912.log.gz 2023-07-06T02:41:08.211 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.330676.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.185183.log 2023-07-06T02:41:08.211 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.330676.log.gz 2023-07-06T02:41:08.211 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.794295.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.111562.log 2023-07-06T02:41:08.212 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.794295.log.gz 2023-07-06T02:41:08.212 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.185183.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.389324.log 2023-07-06T02:41:08.212 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.185183.log.gz 2023-07-06T02:41:08.212 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.111562.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.322169.log 2023-07-06T02:41:08.213 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.389324.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.344192.log 2023-07-06T02:41:08.213 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.389324.log.gz 2023-07-06T02:41:08.213 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.322169.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.324152.log 2023-07-06T02:41:08.214 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.322169.log.gz 2023-07-06T02:41:08.214 INFO:teuthology.orchestra.run.smithi046.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.111562.log.gz 2023-07-06T02:41:08.214 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.344192.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.770671.log 2023-07-06T02:41:08.215 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.344192.log.gz 2023-07-06T02:41:08.215 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.324152.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.208987.log 0.0% 2023-07-06T02:41:08.215 INFO:teuthology.orchestra.run.smithi046.stderr: -- replaced with /var/log/ceph/ceph-client.admin.324152.log.gz 2023-07-06T02:41:08.215 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.770671.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.301242.log 2023-07-06T02:41:08.215 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.770671.log.gz 2023-07-06T02:41:08.216 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.208987.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.667826.log 2023-07-06T02:41:08.216 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.208987.log.gz 2023-07-06T02:41:08.216 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.301242.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.371204.log 2023-07-06T02:41:08.216 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.301242.log.gz 2023-07-06T02:41:08.217 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.667826.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.324584.log 2023-07-06T02:41:08.217 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.667826.log.gz 2023-07-06T02:41:08.217 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.371204.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.753312.log 2023-07-06T02:41:08.217 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.371204.log.gz 2023-07-06T02:41:08.218 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.324584.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.194708.log 2023-07-06T02:41:08.218 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.324584.log.gz 2023-07-06T02:41:08.218 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.753312.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.387395.log 2023-07-06T02:41:08.219 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.753312.log.gz 2023-07-06T02:41:08.219 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.308652.log 2023-07-06T02:41:08.219 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.194708.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.194708.log.gz 2023-07-06T02:41:08.220 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.387395.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.323349.log 2023-07-06T02:41:08.220 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.387395.log.gz 2023-07-06T02:41:08.221 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.308652.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.282641.log 2023-07-06T02:41:08.221 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.308652.log.gz 2023-07-06T02:41:08.221 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.323349.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.920290.log 2023-07-06T02:41:08.221 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.323349.log.gz 2023-07-06T02:41:08.222 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.282641.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.302254.log 2023-07-06T02:41:08.222 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.282641.log.gz 2023-07-06T02:41:08.222 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.920290.log: 87.4%gzip -5 -- replaced with /var/log/ceph/ceph-client.admin.101230.log.gz--verbose 2023-07-06T02:41:08.223 INFO:teuthology.orchestra.run.smithi046.stderr:-- /var/log/ceph/ceph-client.admin.346203.log 2023-07-06T02:41:08.223 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.920290.log.gz 2023-07-06T02:41:08.223 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.302254.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.653686.log 2023-07-06T02:41:08.224 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.302254.log.gz 2023-07-06T02:41:08.224 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.346203.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.301457.log 2023-07-06T02:41:08.224 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.346203.log.gz 2023-07-06T02:41:08.224 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.653686.log: 0.0%gzip -5 -- replaced with /var/log/ceph/ceph-client.admin.653686.log.gz--verbose 2023-07-06T02:41:08.225 INFO:teuthology.orchestra.run.smithi046.stderr:-- /var/log/ceph/ceph-client.admin.648802.log 2023-07-06T02:41:08.225 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.301457.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.932699.log 2023-07-06T02:41:08.225 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.301457.log.gz 2023-07-06T02:41:08.225 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.648802.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.684340.log 2023-07-06T02:41:08.225 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.648802.log.gz 2023-07-06T02:41:08.226 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.932699.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.702041.log 2023-07-06T02:41:08.226 INFO:teuthology.orchestra.run.smithi046.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.932699.log.gz 2023-07-06T02:41:08.226 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.684340.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.364801.log 2023-07-06T02:41:08.227 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.684340.log.gz 2023-07-06T02:41:08.227 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.702041.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.197358.log 2023-07-06T02:41:08.227 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.702041.log.gz 2023-07-06T02:41:08.228 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.364801.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.275036.log 2023-07-06T02:41:08.228 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.364801.log.gz 2023-07-06T02:41:08.229 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.197358.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.341492.log 2023-07-06T02:41:08.229 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.197358.log.gz 2023-07-06T02:41:08.229 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.275036.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.108300.log 2023-07-06T02:41:08.230 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.275036.log.gz 2023-07-06T02:41:08.230 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.341492.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.288865.log 2023-07-06T02:41:08.230 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.341492.log.gz 2023-07-06T02:41:08.231 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.108300.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.113281.log 2023-07-06T02:41:08.231 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.288865.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.157058.log 2023-07-06T02:41:08.231 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.288865.log.gz 2023-07-06T02:41:08.232 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.113281.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.808264.log 2023-07-06T02:41:08.232 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.157058.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.801203.log 2023-07-06T02:41:08.232 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.157058.log.gz 2023-07-06T02:41:08.232 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.808264.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.271250.log 2023-07-06T02:41:08.233 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.808264.log.gz 2023-07-06T02:41:08.233 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.801203.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.280653.log 2023-07-06T02:41:08.233 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.801203.log.gz 2023-07-06T02:41:08.233 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.271250.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.930694.log 2023-07-06T02:41:08.234 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.271250.log.gz 2023-07-06T02:41:08.234 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.280653.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.109064.log 2023-07-06T02:41:08.234 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.280653.log.gz 2023-07-06T02:41:08.234 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.930694.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.663770.log 2023-07-06T02:41:08.235 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.109064.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.930694.log.gz 2023-07-06T02:41:08.235 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.331142.log 2023-07-06T02:41:08.235 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.663770.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.769080.log 2023-07-06T02:41:08.236 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.663770.log.gz 2023-07-06T02:41:08.236 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.331142.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.930939.log 2023-07-06T02:41:08.236 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.331142.log.gz 2023-07-06T02:41:08.237 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.769080.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.774925.log 2023-07-06T02:41:08.237 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.769080.log.gz 2023-07-06T02:41:08.237 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.930939.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.338621.log 2023-07-06T02:41:08.237 INFO:teuthology.orchestra.run.smithi046.stderr: 88.2%/var/log/ceph/ceph-client.admin.774925.log: -- replaced with /var/log/ceph/ceph-client.admin.930939.log.gz 2023-07-06T02:41:08.237 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.774925.log.gz 2023-07-06T02:41:08.238 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.324166.log 2023-07-06T02:41:08.238 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.338621.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.211270.log 2023-07-06T02:41:08.238 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.338621.log.gz 2023-07-06T02:41:08.238 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.324166.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.192574.log 2023-07-06T02:41:08.239 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.324166.log.gz 2023-07-06T02:41:08.239 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.211270.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.653073.log 2023-07-06T02:41:08.239 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.211270.log.gz 2023-07-06T02:41:08.239 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.192574.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.192574.log.gz 2023-07-06T02:41:08.239 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.678814.log 2023-07-06T02:41:08.240 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.653073.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.115527.log 2023-07-06T02:41:08.240 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.653073.log.gz 2023-07-06T02:41:08.240 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.678814.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.678814.log.gz 2023-07-06T02:41:08.240 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.161322.log 2023-07-06T02:41:08.241 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.115527.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.283643.log 2023-07-06T02:41:08.241 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.161322.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.666368.log 2023-07-06T02:41:08.241 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.161322.log.gz 2023-07-06T02:41:08.241 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.283643.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.108926.log 2023-07-06T02:41:08.241 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.283643.log.gz 2023-07-06T02:41:08.242 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.666368.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.330124.log 2023-07-06T02:41:08.242 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.666368.log.gz 2023-07-06T02:41:08.242 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.108926.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.276191.log 2023-07-06T02:41:08.242 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.330124.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.368105.log 2023-07-06T02:41:08.243 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.330124.log.gz 2023-07-06T02:41:08.243 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.276191.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.378193.log 2023-07-06T02:41:08.243 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.276191.log.gz 2023-07-06T02:41:08.243 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.368105.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.930104.log 2023-07-06T02:41:08.243 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.368105.log.gz 2023-07-06T02:41:08.244 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.378193.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.114519.log 2023-07-06T02:41:08.244 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.378193.log.gz 2023-07-06T02:41:08.244 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.930104.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.930104.log.gz 2023-07-06T02:41:08.244 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.699818.log 2023-07-06T02:41:08.245 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.114519.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.691737.log 2023-07-06T02:41:08.245 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.699818.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.285693.log 2023-07-06T02:41:08.245 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.699818.log.gz 2023-07-06T02:41:08.245 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.691737.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.362236.log 2023-07-06T02:41:08.245 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.691737.log.gz 2023-07-06T02:41:08.246 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.285693.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.681928.log 2023-07-06T02:41:08.246 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.285693.log.gz 2023-07-06T02:41:08.246 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.362236.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.612768.log 2023-07-06T02:41:08.246 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.362236.log.gz 2023-07-06T02:41:08.247 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.681928.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.375081.log 2023-07-06T02:41:08.247 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.681928.log.gz 2023-07-06T02:41:08.247 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.612768.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.307815.log 2023-07-06T02:41:08.247 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.612768.log.gz 2023-07-06T02:41:08.248 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.375081.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.367790.log 2023-07-06T02:41:08.248 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.375081.log.gz 2023-07-06T02:41:08.248 INFO:teuthology.orchestra.run.smithi046.stderr:gzip /var/log/ceph/ceph-client.admin.307815.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.339118.log 2023-07-06T02:41:08.248 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.307815.log.gz 2023-07-06T02:41:08.249 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.367790.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.345906.log 2023-07-06T02:41:08.249 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.367790.log.gz 2023-07-06T02:41:08.249 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.339118.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.353662.log 2023-07-06T02:41:08.249 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.339118.log.gz 2023-07-06T02:41:08.249 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.345906.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.364787.log 2023-07-06T02:41:08.250 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.345906.log.gz 2023-07-06T02:41:08.250 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.353662.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.654840.log 2023-07-06T02:41:08.250 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.353662.log.gz 2023-07-06T02:41:08.250 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.364787.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.364787.log.gz 2023-07-06T02:41:08.250 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.394860.log 2023-07-06T02:41:08.251 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.654840.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.192270.log 2023-07-06T02:41:08.251 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.654840.log.gz 2023-07-06T02:41:08.251 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.394860.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.394860.log.gz 2023-07-06T02:41:08.251 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.323562.log 2023-07-06T02:41:08.251 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.192270.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.406726.log 2023-07-06T02:41:08.252 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.192270.log.gz 2023-07-06T02:41:08.252 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.323562.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.348622.log 2023-07-06T02:41:08.253 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.323562.log.gz 2023-07-06T02:41:08.253 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.406726.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.665088.log 2023-07-06T02:41:08.254 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.406726.log.gz 2023-07-06T02:41:08.254 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.348622.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.804542.log 2023-07-06T02:41:08.254 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.348622.log.gz 2023-07-06T02:41:08.254 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.665088.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.386787.log 2023-07-06T02:41:08.255 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.665088.log.gz 2023-07-06T02:41:08.255 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.804542.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.108300.log.gz 2023-07-06T02:41:08.255 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.804542.log.gz 2023-07-06T02:41:08.256 INFO:teuthology.orchestra.run.smithi046.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.113281.log.gz 2023-07-06T02:41:08.256 INFO:teuthology.orchestra.run.smithi046.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.109064.log.gz 2023-07-06T02:41:08.256 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.386787.log: 87.6% 0.0% -- replaced with /var/log/ceph/ceph-client.admin.115527.log.gz -- replaced with /var/log/ceph/ceph-client.admin.386787.log.gz 2023-07-06T02:41:08.257 INFO:teuthology.orchestra.run.smithi046.stderr: 2023-07-06T02:41:08.257 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.111193.log 2023-07-06T02:41:08.257 INFO:teuthology.orchestra.run.smithi046.stderr: 89.1% 88.7% -- replaced with /var/log/ceph/ceph-client.admin.114519.log.gz 2023-07-06T02:41:08.257 INFO:teuthology.orchestra.run.smithi046.stderr: -- replaced with /var/log/ceph/ceph-client.admin.108926.log.gz 2023-07-06T02:41:08.257 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.355622.log 2023-07-06T02:41:08.258 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.111193.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.107203.log 2023-07-06T02:41:08.258 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.355622.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.817634.log 2023-07-06T02:41:08.258 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.355622.log.gz 2023-07-06T02:41:08.258 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.107203.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.290890.log 2023-07-06T02:41:08.259 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.817634.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.266570.log 2023-07-06T02:41:08.259 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.817634.log.gz 2023-07-06T02:41:08.259 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.290890.log: gzip 0.0%-5 -- replaced with /var/log/ceph/ceph-client.admin.290890.log.gz--verbose 2023-07-06T02:41:08.259 INFO:teuthology.orchestra.run.smithi046.stderr:-- /var/log/ceph/ceph-client.admin.338096.log 2023-07-06T02:41:08.260 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.266570.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.106458.log 2023-07-06T02:41:08.260 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.266570.log.gz 2023-07-06T02:41:08.260 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.338096.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.338096.log.gz 2023-07-06T02:41:08.260 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.469435.log 2023-07-06T02:41:08.261 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.106458.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.637160.log 2023-07-06T02:41:08.261 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.469435.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.699524.log 2023-07-06T02:41:08.262 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.469435.log.gz 2023-07-06T02:41:08.262 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.637160.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.255091.log 2023-07-06T02:41:08.263 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.637160.log.gz 2023-07-06T02:41:08.263 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.699524.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.398490.log 2023-07-06T02:41:08.264 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.699524.log.gz 2023-07-06T02:41:08.264 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.255091.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.185748.log 2023-07-06T02:41:08.265 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.255091.log.gz 2023-07-06T02:41:08.265 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.398490.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.398490.log.gz 2023-07-06T02:41:08.266 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.619721.log 2023-07-06T02:41:08.266 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.185748.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.467930.log 2023-07-06T02:41:08.267 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.185748.log.gz 2023-07-06T02:41:08.267 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.619721.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.619721.log.gz 2023-07-06T02:41:08.268 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.376678.log 2023-07-06T02:41:08.268 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.467930.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.636448.log 2023-07-06T02:41:08.269 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.467930.log.gz 2023-07-06T02:41:08.269 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.376678.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.376678.log.gz 2023-07-06T02:41:08.269 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.397417.log 2023-07-06T02:41:08.270 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.636448.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.288664.log 2023-07-06T02:41:08.270 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.636448.log.gz 2023-07-06T02:41:08.270 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.397417.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.397417.log.gz 2023-07-06T02:41:08.271 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.808756.log 2023-07-06T02:41:08.271 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.288664.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.276098.log 2023-07-06T02:41:08.272 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.288664.log.gz 2023-07-06T02:41:08.272 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.808756.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.808756.log.gz 2023-07-06T02:41:08.272 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.218188.log 2023-07-06T02:41:08.272 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.276098.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.613625.log 2023-07-06T02:41:08.273 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.276098.log.gz 2023-07-06T02:41:08.273 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.218188.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.218188.log.gz 2023-07-06T02:41:08.273 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.654826.log 2023-07-06T02:41:08.273 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.613625.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.339426.log 2023-07-06T02:41:08.274 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.613625.log.gz 2023-07-06T02:41:08.274 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.654826.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.654826.log.gz 2023-07-06T02:41:08.274 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.364584.log 2023-07-06T02:41:08.274 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.339426.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.773010.log 2023-07-06T02:41:08.274 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.339426.log.gz 2023-07-06T02:41:08.275 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.364584.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.364584.log.gz 2023-07-06T02:41:08.275 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.636434.log 2023-07-06T02:41:08.275 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.773010.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.465914.log 2023-07-06T02:41:08.275 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.773010.log.gz 2023-07-06T02:41:08.275 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.636434.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.636434.log.gz 2023-07-06T02:41:08.276 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.107909.log 2023-07-06T02:41:08.276 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.465914.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.754496.log 2023-07-06T02:41:08.276 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.465914.log.gz 2023-07-06T02:41:08.276 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.107909.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.365983.log 2023-07-06T02:41:08.277 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.754496.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.629520.log 2023-07-06T02:41:08.277 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.754496.log.gz 2023-07-06T02:41:08.277 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.365983.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.365983.log.gz 2023-07-06T02:41:08.277 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.334157.log 2023-07-06T02:41:08.277 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.629520.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.329451.log 2023-07-06T02:41:08.278 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.629520.log.gz 2023-07-06T02:41:08.278 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.334157.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.334157.log.gz 2023-07-06T02:41:08.278 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.160267.log 2023-07-06T02:41:08.278 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose /var/log/ceph/ceph-client.admin.329451.log: -- /var/log/ceph/ceph-client.admin.343427.log 2023-07-06T02:41:08.278 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.329451.log.gz 2023-07-06T02:41:08.279 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.160267.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.160267.log.gz 2023-07-06T02:41:08.279 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.666382.log 2023-07-06T02:41:08.279 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.343427.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.332357.log 2023-07-06T02:41:08.279 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.343427.log.gz 2023-07-06T02:41:08.279 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.666382.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.666382.log.gz 2023-07-06T02:41:08.280 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.109340.log 2023-07-06T02:41:08.280 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.332357.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.385356.log 2023-07-06T02:41:08.280 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.332357.log.gz 2023-07-06T02:41:08.280 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.109340.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.260167.log 2023-07-06T02:41:08.281 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.385356.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.808663.log 2023-07-06T02:41:08.281 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.385356.log.gz 2023-07-06T02:41:08.281 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.260167.log: 0.0%gzip -- replaced with /var/log/ceph/ceph-client.admin.260167.log.gz-5 2023-07-06T02:41:08.281 INFO:teuthology.orchestra.run.smithi046.stderr:--verbose -- /var/log/ceph/ceph-client.admin.313102.log 2023-07-06T02:41:08.282 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.808663.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.698811.log 2023-07-06T02:41:08.282 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.808663.log.gz 2023-07-06T02:41:08.282 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.313102.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.313102.log.gz 2023-07-06T02:41:08.282 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.449179.log 2023-07-06T02:41:08.282 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.698811.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.759528.log 2023-07-06T02:41:08.283 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.698811.log.gz 2023-07-06T02:41:08.283 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.449179.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.449179.log.gz 2023-07-06T02:41:08.283 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.211256.log 2023-07-06T02:41:08.283 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.759528.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.279174.log 2023-07-06T02:41:08.284 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.759528.log.gz 2023-07-06T02:41:08.284 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.211256.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.211256.log.gz 2023-07-06T02:41:08.284 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.437714.log 2023-07-06T02:41:08.284 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.279174.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.312885.log 2023-07-06T02:41:08.284 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.279174.log.gz 2023-07-06T02:41:08.285 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.437714.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.381442.log 2023-07-06T02:41:08.285 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.437714.log.gz 2023-07-06T02:41:08.285 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.312885.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.312885.log.gz 2023-07-06T02:41:08.285 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.402538.log 2023-07-06T02:41:08.286 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.381442.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.790982.log 2023-07-06T02:41:08.286 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.381442.log.gz 2023-07-06T02:41:08.286 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.402538.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.305841.log 2023-07-06T02:41:08.286 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.402538.log.gz 2023-07-06T02:41:08.286 INFO:teuthology.orchestra.run.smithi046.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.107203.log.gz 2023-07-06T02:41:08.287 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.790982.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.111193.log.gz 2023-07-06T02:41:08.287 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.790982.log.gz 2023-07-06T02:41:08.287 INFO:teuthology.orchestra.run.smithi046.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.106458.log.gz 2023-07-06T02:41:08.287 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.305841.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.305841.log.gz 2023-07-06T02:41:08.287 INFO:teuthology.orchestra.run.smithi046.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.107909.log.gz 2023-07-06T02:41:08.288 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 88.2%--verbose -- -- replaced with /var/log/ceph/ceph-client.admin.109340.log.gz/var/log/ceph/ceph-client.admin.380515.log 2023-07-06T02:41:08.288 INFO:teuthology.orchestra.run.smithi046.stderr: 2023-07-06T02:41:08.288 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.108624.log 2023-07-06T02:41:08.288 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.380515.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.192066.log 2023-07-06T02:41:08.289 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.380515.log.gz 2023-07-06T02:41:08.289 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.108624.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.931399.log 2023-07-06T02:41:08.289 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.192066.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.633311.log 2023-07-06T02:41:08.289 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.192066.log.gz 2023-07-06T02:41:08.289 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.931399.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.251419.log 2023-07-06T02:41:08.290 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.633311.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.931399.log.gz 2023-07-06T02:41:08.290 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.375778.log 2023-07-06T02:41:08.290 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.633311.log.gz 2023-07-06T02:41:08.291 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.251419.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.212170.log 2023-07-06T02:41:08.291 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.251419.log.gz 2023-07-06T02:41:08.291 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.375778.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.207555.log 2023-07-06T02:41:08.291 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.375778.log.gz 2023-07-06T02:41:08.292 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.212170.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.212170.log.gz 2023-07-06T02:41:08.292 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.322637.log 2023-07-06T02:41:08.292 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.207555.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.365312.log 2023-07-06T02:41:08.292 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.207555.log.gz 2023-07-06T02:41:08.292 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.322637.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.110306.log 2023-07-06T02:41:08.293 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.322637.log.gz 2023-07-06T02:41:08.293 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.365312.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.363464.log 2023-07-06T02:41:08.293 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.365312.log.gz 2023-07-06T02:41:08.293 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.0.110306.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.796672.log 2023-07-06T02:41:08.294 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.0.110306.log.gz 2023-07-06T02:41:08.294 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 /var/log/ceph/ceph-client.admin.363464.log: --verbose -- /var/log/ceph/ceph-client.admin.612277.log 2023-07-06T02:41:08.294 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.363464.log.gz 2023-07-06T02:41:08.294 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.796672.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.930786.log 2023-07-06T02:41:08.295 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.796672.log.gz 2023-07-06T02:41:08.295 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.612277.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.655332.log 2023-07-06T02:41:08.295 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.612277.log.gz 2023-07-06T02:41:08.295 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.930786.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.199253.log 2023-07-06T02:41:08.295 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.655332.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.930786.log.gz 2023-07-06T02:41:08.296 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.449667.log 2023-07-06T02:41:08.296 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.655332.log.gz 2023-07-06T02:41:08.296 INFO:teuthology.orchestra.run.smithi046.stderr:gzip /var/log/ceph/ceph-client.admin.199253.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.638476.log 2023-07-06T02:41:08.296 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.199253.log.gz 2023-07-06T02:41:08.296 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.449667.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.112793.log 2023-07-06T02:41:08.297 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.449667.log.gz 2023-07-06T02:41:08.297 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.638476.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.337400.log 2023-07-06T02:41:08.297 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.638476.log.gz 2023-07-06T02:41:08.297 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.112793.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.203140.log 2023-07-06T02:41:08.298 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.337400.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.169552.log 2023-07-06T02:41:08.298 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.337400.log.gz 2023-07-06T02:41:08.298 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.203140.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.701962.log 2023-07-06T02:41:08.298 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.203140.log.gz 2023-07-06T02:41:08.298 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.169552.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.169552.log.gz 2023-07-06T02:41:08.299 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.798191.log 2023-07-06T02:41:08.299 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.701962.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.702055.log 2023-07-06T02:41:08.299 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.701962.log.gz 2023-07-06T02:41:08.299 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.798191.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.378114.log 2023-07-06T02:41:08.300 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.798191.log.gz 2023-07-06T02:41:08.300 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.702055.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.303964.log 2023-07-06T02:41:08.300 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.702055.log.gz 2023-07-06T02:41:08.300 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.378114.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.388315.log 2023-07-06T02:41:08.301 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.378114.log.gz 2023-07-06T02:41:08.301 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.303964.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.303964.log.gz 2023-07-06T02:41:08.301 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.623345.log 2023-07-06T02:41:08.301 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.628236.log 2023-07-06T02:41:08.301 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.388315.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.388315.log.gz 2023-07-06T02:41:08.302 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.623345.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.331156.log 2023-07-06T02:41:08.302 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.623345.log.gz 2023-07-06T02:41:08.302 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.628236.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.628236.log.gz 2023-07-06T02:41:08.302 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.803581.log 2023-07-06T02:41:08.302 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.437420.log 2023-07-06T02:41:08.303 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.331156.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.331156.log.gz 2023-07-06T02:41:08.303 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.803581.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.219271.log 2023-07-06T02:41:08.303 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.803581.log.gz 2023-07-06T02:41:08.303 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.437420.log: gzip -5 --verbose -- 0.0%/var/log/ceph/ceph-client.admin.305330.log 2023-07-06T02:41:08.303 INFO:teuthology.orchestra.run.smithi046.stderr: -- replaced with /var/log/ceph/ceph-client.admin.437420.log.gz 2023-07-06T02:41:08.304 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.412008.log 2023-07-06T02:41:08.304 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.219271.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.219271.log.gz 2023-07-06T02:41:08.304 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.305330.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.367076.log 2023-07-06T02:41:08.304 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.305330.log.gz 2023-07-06T02:41:08.305 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.412008.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.300063.log 2023-07-06T02:41:08.305 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.412008.log.gz 2023-07-06T02:41:08.305 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.677025.log 2023-07-06T02:41:08.305 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.367076.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.367076.log.gz 2023-07-06T02:41:08.306 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.300063.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.668196.log 2023-07-06T02:41:08.306 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.300063.log.gz 2023-07-06T02:41:08.308 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.677025.log: gzip 0.0%-5 --verbose -- replaced with /var/log/ceph/ceph-client.admin.677025.log.gz-- 2023-07-06T02:41:08.308 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.264208.log 2023-07-06T02:41:08.308 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.775935.log 2023-07-06T02:41:08.308 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.668196.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.668196.log.gz 2023-07-06T02:41:08.309 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.264208.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.615598.log 2023-07-06T02:41:08.309 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.264208.log.gz 2023-07-06T02:41:08.309 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.775935.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.203154.log 0.0% 2023-07-06T02:41:08.309 INFO:teuthology.orchestra.run.smithi046.stderr: -- replaced with /var/log/ceph/ceph-client.admin.775935.log.gz 2023-07-06T02:41:08.309 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.615598.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.306771.log 2023-07-06T02:41:08.310 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.615598.log.gz 2023-07-06T02:41:08.310 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.203154.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.815682.log 2023-07-06T02:41:08.310 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.203154.log.gz 2023-07-06T02:41:08.310 INFO:teuthology.orchestra.run.smithi046.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.108624.log.gz 2023-07-06T02:41:08.310 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.306771.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.800466.log 2023-07-06T02:41:08.311 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.306771.log.gz 2023-07-06T02:41:08.311 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.815682.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.790270.log 2023-07-06T02:41:08.311 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.815682.log.gz 2023-07-06T02:41:08.311 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.800466.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.112793.log.gz 2023-07-06T02:41:08.311 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.800466.log.gzgzip 2023-07-06T02:41:08.312 INFO:teuthology.orchestra.run.smithi046.stderr:-5 --verbose -- /var/log/ceph/ceph-client.admin.269119.log 2023-07-06T02:41:08.312 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.397123.log 2023-07-06T02:41:08.312 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.790270.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.790270.log.gz 2023-07-06T02:41:08.312 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.269119.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.337106.log 2023-07-06T02:41:08.313 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.269119.log.gz 2023-07-06T02:41:08.313 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.397123.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.625050.log 2023-07-06T02:41:08.313 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.397123.log.gz 2023-07-06T02:41:08.313 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.281635.log 2023-07-06T02:41:08.314 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.337106.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.337106.log.gz 2023-07-06T02:41:08.314 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.625050.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.113511.log 2023-07-06T02:41:08.314 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.625050.log.gz 2023-07-06T02:41:08.314 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.281635.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.247527.log 2023-07-06T02:41:08.314 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.281635.log.gz 2023-07-06T02:41:08.315 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.113511.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.292507.log 2023-07-06T02:41:08.315 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.247527.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.247527.log.gz 2023-07-06T02:41:08.315 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.340448.log 2023-07-06T02:41:08.315 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.215737.log 2023-07-06T02:41:08.315 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.292507.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.292507.log.gz 2023-07-06T02:41:08.316 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.340448.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.818126.log 2023-07-06T02:41:08.316 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.340448.log.gz 2023-07-06T02:41:08.316 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.215737.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.247015.log 2023-07-06T02:41:08.316 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.215737.log.gz 2023-07-06T02:41:08.317 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.923280.log 2023-07-06T02:41:08.317 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.818126.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.818126.log.gz 2023-07-06T02:41:08.317 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.247015.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.685314.log 2023-07-06T02:41:08.317 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.247015.log.gz 2023-07-06T02:41:08.317 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.923280.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.923280.log.gz 2023-07-06T02:41:08.318 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.664885.log 2023-07-06T02:41:08.318 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.667625.log 2023-07-06T02:41:08.318 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.685314.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.685314.log.gz 2023-07-06T02:41:08.318 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.664885.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.664885.log.gz 2023-07-06T02:41:08.318 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.771858.log 2023-07-06T02:41:08.319 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.667625.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.2.110967.log 2023-07-06T02:41:08.319 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.667625.log.gz 2023-07-06T02:41:08.319 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.771858.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.381535.log 2023-07-06T02:41:08.319 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.771858.log.gz 2023-07-06T02:41:08.319 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.628018.log 2023-07-06T02:41:08.320 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.2.110967.log: 0.0% -- replaced with /var/log/ceph/ceph-client.2.110967.log.gz 2023-07-06T02:41:08.320 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.381535.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.931558.log 2023-07-06T02:41:08.320 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.381535.log.gz 2023-07-06T02:41:08.320 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.628018.log: gzip -5 0.0%--verbose -- -- replaced with /var/log/ceph/ceph-client.admin.628018.log.gz 2023-07-06T02:41:08.321 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.320002.log 2023-07-06T02:41:08.321 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.340140.log 2023-07-06T02:41:08.321 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.931558.log: /var/log/ceph/ceph-client.admin.320002.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.671698.log 2023-07-06T02:41:08.321 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.320002.log.gz 2023-07-06T02:41:08.321 INFO:teuthology.orchestra.run.smithi046.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.931558.log.gz 2023-07-06T02:41:08.322 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.340140.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.290969.log 2023-07-06T02:41:08.322 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.340140.log.gz 2023-07-06T02:41:08.322 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.671698.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.189132.log 2023-07-06T02:41:08.322 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.671698.log.gz 2023-07-06T02:41:08.323 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.290969.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.290969.log.gz 2023-07-06T02:41:08.323 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.200201.log 2023-07-06T02:41:08.323 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.243993.log 2023-07-06T02:41:08.323 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.189132.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.189132.log.gz 2023-07-06T02:41:08.323 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.200201.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.376034.log 2023-07-06T02:41:08.324 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.200201.log.gz 2023-07-06T02:41:08.324 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.243993.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.372012.log 2023-07-06T02:41:08.324 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.243993.log.gz 2023-07-06T02:41:08.324 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.468446.log 2023-07-06T02:41:08.324 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.376034.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.376034.log.gz 2023-07-06T02:41:08.325 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.372012.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.801526.log 2023-07-06T02:41:08.325 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.372012.log.gz 2023-07-06T02:41:08.325 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.468446.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.807187.log 2023-07-06T02:41:08.325 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.468446.log.gz 2023-07-06T02:41:08.325 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.801526.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.208505.log 2023-07-06T02:41:08.326 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.801526.log.gz 2023-07-06T02:41:08.326 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.807187.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.391868.log 2023-07-06T02:41:08.326 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.807187.log.gz 2023-07-06T02:41:08.327 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.208505.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.117061.log 2023-07-06T02:41:08.327 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.208505.log.gz 2023-07-06T02:41:08.327 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.391868.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.625940.log 2023-07-06T02:41:08.327 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.391868.log.gz 2023-07-06T02:41:08.327 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.117061.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.376585.log 2023-07-06T02:41:08.328 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.625940.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.272992.log 2023-07-06T02:41:08.328 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.625940.log.gz 2023-07-06T02:41:08.328 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.376585.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.346746.log 2023-07-06T02:41:08.328 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.376585.log.gz 2023-07-06T02:41:08.329 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.272992.log: gzip 0.0%-5 -- replaced with /var/log/ceph/ceph-client.admin.272992.log.gz--verbose 2023-07-06T02:41:08.329 INFO:teuthology.orchestra.run.smithi046.stderr:-- /var/log/ceph/ceph-client.admin.275680.log 2023-07-06T02:41:08.329 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.346746.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.798623.log 2023-07-06T02:41:08.329 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.346746.log.gz 2023-07-06T02:41:08.330 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.275680.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.390175.log 2023-07-06T02:41:08.330 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.275680.log.gz 2023-07-06T02:41:08.330 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.798623.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.290379.log 2023-07-06T02:41:08.330 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.798623.log.gz 2023-07-06T02:41:08.330 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.390175.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.406941.log 2023-07-06T02:41:08.331 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.390175.log.gz 2023-07-06T02:41:08.331 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.290379.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.465196.log 2023-07-06T02:41:08.331 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.290379.log.gz 2023-07-06T02:41:08.331 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.406941.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.406941.log.gz 2023-07-06T02:41:08.331 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.271530.log 2023-07-06T02:41:08.332 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.465196.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.811130.log 2023-07-06T02:41:08.332 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.465196.log.gz 2023-07-06T02:41:08.332 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.271530.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.312792.log 2023-07-06T02:41:08.332 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.271530.log.gz 2023-07-06T02:41:08.333 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.811130.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.301256.log 2023-07-06T02:41:08.333 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.811130.log.gz 2023-07-06T02:41:08.333 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.312792.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.693070.log 2023-07-06T02:41:08.333 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.312792.log.gz 2023-07-06T02:41:08.334 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.301256.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.305626.log 2023-07-06T02:41:08.334 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.301256.log.gz 2023-07-06T02:41:08.334 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.693070.log: gzip 0.0%-5 -- replaced with /var/log/ceph/ceph-client.admin.693070.log.gz--verbose 2023-07-06T02:41:08.334 INFO:teuthology.orchestra.run.smithi046.stderr:-- /var/log/ceph/ceph-client.admin.341198.log 2023-07-06T02:41:08.334 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.305626.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.612291.log 2023-07-06T02:41:08.335 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.305626.log.gz 2023-07-06T02:41:08.335 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.341198.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.341198.log.gz 2023-07-06T02:41:08.335 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.927125.log 2023-07-06T02:41:08.335 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.689394.log 2023-07-06T02:41:08.335 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.612291.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.612291.log.gz 2023-07-06T02:41:08.336 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.927125.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.286003.log 2023-07-06T02:41:08.336 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.927125.log.gz 2023-07-06T02:41:08.336 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.692702.log 2023-07-06T02:41:08.336 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.689394.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.689394.log.gz 2023-07-06T02:41:08.337 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.286003.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.286003.log.gz 2023-07-06T02:41:08.337 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.644874.log 2023-07-06T02:41:08.337 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose /var/log/ceph/ceph-client.admin.692702.log: -- /var/log/ceph/ceph-client.admin.390739.log 2023-07-06T02:41:08.337 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.692702.log.gz 2023-07-06T02:41:08.338 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.644874.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.303394.log 2023-07-06T02:41:08.338 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.644874.log.gz 2023-07-06T02:41:08.338 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.390739.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.296993.log 2023-07-06T02:41:08.338 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.390739.log.gz 2023-07-06T02:41:08.339 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.798205.log 2023-07-06T02:41:08.339 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.303394.log: /var/log/ceph/ceph-client.admin.296993.log: gzip -5 --verbose 0.0%-- /var/log/ceph/ceph-client.admin.463465.log 2023-07-06T02:41:08.339 INFO:teuthology.orchestra.run.smithi046.stderr: -- replaced with /var/log/ceph/ceph-client.admin.303394.log.gz 2023-07-06T02:41:08.339 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.296993.log.gz 2023-07-06T02:41:08.340 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.798205.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.362222.log 2023-07-06T02:41:08.340 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.798205.log.gz 2023-07-06T02:41:08.340 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.217247.log 2023-07-06T02:41:08.340 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.463465.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.463465.log.gz 2023-07-06T02:41:08.341 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.362222.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.362222.log.gz 2023-07-06T02:41:08.341 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.207059.log 2023-07-06T02:41:08.341 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.376113.log 2023-07-06T02:41:08.341 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.217247.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.217247.log.gz 2023-07-06T02:41:08.341 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.207059.log: gzip 0.0%-5 -- replaced with /var/log/ceph/ceph-client.admin.207059.log.gz--verbose 2023-07-06T02:41:08.342 INFO:teuthology.orchestra.run.smithi046.stderr:-- /var/log/ceph/ceph-client.admin.294010.log 2023-07-06T02:41:08.342 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.376113.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.341709.log 2023-07-06T02:41:08.342 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.376113.log.gz 2023-07-06T02:41:08.342 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.294010.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.618647.log 2023-07-06T02:41:08.342 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.294010.log.gz 2023-07-06T02:41:08.343 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.341709.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.319007.log 2023-07-06T02:41:08.343 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.341709.log.gz 2023-07-06T02:41:08.343 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.618647.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.794092.log 2023-07-06T02:41:08.343 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.618647.log.gz 2023-07-06T02:41:08.343 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.798933.log 2023-07-06T02:41:08.344 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.319007.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.319007.log.gz 2023-07-06T02:41:08.344 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.794092.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.412656.log 2023-07-06T02:41:08.344 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.794092.log.gz 2023-07-06T02:41:08.345 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.798933.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.650068.log 2023-07-06T02:41:08.345 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.798933.log.gz 2023-07-06T02:41:08.345 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.412656.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.111331.log 2023-07-06T02:41:08.345 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.412656.log.gz 2023-07-06T02:41:08.345 INFO:teuthology.orchestra.run.smithi046.stderr: 94.1% -- replaced with /var/log/ceph/ceph-mds.c.log.gz 2023-07-06T02:41:08.346 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.650068.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.393980.log 2023-07-06T02:41:08.346 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.650068.log.gz 2023-07-06T02:41:08.346 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.111331.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.806392.log 2023-07-06T02:41:08.346 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.393980.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.171407.log 2023-07-06T02:41:08.346 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.393980.log.gz 2023-07-06T02:41:08.347 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.806392.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.398569.log 2023-07-06T02:41:08.347 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.806392.log.gz 2023-07-06T02:41:08.347 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.171407.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.115297.log 2023-07-06T02:41:08.347 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.171407.log.gz 2023-07-06T02:41:08.348 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.220495.log 2023-07-06T02:41:08.348 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.398569.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.398569.log.gz 2023-07-06T02:41:08.348 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.115297.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.356119.log 2023-07-06T02:41:08.348 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.220495.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.161307.log 2023-07-06T02:41:08.349 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.220495.log.gz 2023-07-06T02:41:08.349 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.356119.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.259278.log 2023-07-06T02:41:08.349 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.356119.log.gz 2023-07-06T02:41:08.349 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.161307.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.191084.log 2023-07-06T02:41:08.349 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.161307.log.gz 2023-07-06T02:41:08.350 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.259278.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.324073.log 2023-07-06T02:41:08.350 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.259278.log.gz 2023-07-06T02:41:08.350 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.191084.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.112068.log 2023-07-06T02:41:08.350 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.191084.log.gz 2023-07-06T02:41:08.350 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.324073.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.324073.log.gz 2023-07-06T02:41:08.351 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.401906.log 2023-07-06T02:41:08.351 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.112068.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.687475.log 2023-07-06T02:41:08.351 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.401906.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.329750.log 2023-07-06T02:41:08.351 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.401906.log.gz 2023-07-06T02:41:08.351 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.687475.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.336398.log 2023-07-06T02:41:08.352 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.687475.log.gz 2023-07-06T02:41:08.352 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.329750.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.329750.log.gz 2023-07-06T02:41:08.352 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.405207.log 2023-07-06T02:41:08.352 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.336398.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.107341.log 2023-07-06T02:41:08.353 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.336398.log.gz 2023-07-06T02:41:08.353 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.405207.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.405207.log.gz 2023-07-06T02:41:08.353 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.613718.log 2023-07-06T02:41:08.353 INFO:teuthology.orchestra.run.smithi046.stderr:gzip /var/log/ceph/ceph-client.admin.107341.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.931123.log 2023-07-06T02:41:08.353 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.613718.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.166855.log 2023-07-06T02:41:08.354 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.613718.log.gz 2023-07-06T02:41:08.354 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.931123.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.618666.log 2023-07-06T02:41:08.354 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.166855.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.931123.log.gz 2023-07-06T02:41:08.354 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.166855.log.gz 2023-07-06T02:41:08.354 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.366758.log 2023-07-06T02:41:08.355 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.107907.log 2023-07-06T02:41:08.355 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.618666.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.618666.log.gz 2023-07-06T02:41:08.355 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.366758.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.275316.log 2023-07-06T02:41:08.355 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.366758.log.gz 2023-07-06T02:41:08.355 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.107907.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.202163.log 2023-07-06T02:41:08.356 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.275316.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.313396.log 2023-07-06T02:41:08.356 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.275316.log.gz 2023-07-06T02:41:08.356 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.202163.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.193463.log 2023-07-06T02:41:08.356 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.202163.log.gz 2023-07-06T02:41:08.357 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.313396.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.313396.log.gz 2023-07-06T02:41:08.357 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.292010.log 2023-07-06T02:41:08.357 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.193463.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.112252.log 2023-07-06T02:41:08.357 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.193463.log.gz 2023-07-06T02:41:08.357 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.292010.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.196137.log 2023-07-06T02:41:08.358 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.292010.log.gz 2023-07-06T02:41:08.358 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.112252.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.377682.log 2023-07-06T02:41:08.358 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.196137.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.215644.log 2023-07-06T02:41:08.358 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.196137.log.gz 2023-07-06T02:41:08.358 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.377682.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.400300.log 2023-07-06T02:41:08.359 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.377682.log.gz 2023-07-06T02:41:08.359 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.215644.log: gzip 0.0%-5 -- replaced with /var/log/ceph/ceph-client.admin.215644.log.gz 2023-07-06T02:41:08.359 INFO:teuthology.orchestra.run.smithi046.stderr:--verbose -- /var/log/ceph/ceph-client.admin.702249.log 2023-07-06T02:41:08.359 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.400300.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.313382.log 2023-07-06T02:41:08.359 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.400300.log.gz 2023-07-06T02:41:08.360 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.702249.log: gzip 0.0%-5 -- replaced with /var/log/ceph/ceph-client.admin.702249.log.gz 2023-07-06T02:41:08.360 INFO:teuthology.orchestra.run.smithi046.stderr:--verbose -- /var/log/ceph/ceph-client.admin.704360.log 2023-07-06T02:41:08.360 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.313382.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.929082.log 2023-07-06T02:41:08.360 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.313382.log.gz 2023-07-06T02:41:08.361 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.704360.log: gzip 0.0%-5 -- replaced with /var/log/ceph/ceph-client.admin.704360.log.gz--verbose 2023-07-06T02:41:08.361 INFO:teuthology.orchestra.run.smithi046.stderr:-- /var/log/ceph/ceph-client.admin.356462.log 2023-07-06T02:41:08.361 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.929082.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.691429.log 2023-07-06T02:41:08.361 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.929082.log.gz 2023-07-06T02:41:08.362 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.356462.log: gzip -5 --verbose -- 0.0%/var/log/ceph/ceph-client.admin.649096.log 2023-07-06T02:41:08.362 INFO:teuthology.orchestra.run.smithi046.stderr: -- replaced with /var/log/ceph/ceph-client.admin.356462.log.gz 2023-07-06T02:41:08.362 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.691429.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.791061.log 2023-07-06T02:41:08.362 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.691429.log.gz 2023-07-06T02:41:08.362 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.649096.log: gzip -5 0.0%--verbose -- replaced with /var/log/ceph/ceph-client.admin.649096.log.gz-- 2023-07-06T02:41:08.363 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.360432.log 2023-07-06T02:41:08.363 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.791061.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.159636.log 2023-07-06T02:41:08.363 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.791061.log.gz 2023-07-06T02:41:08.363 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.360432.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.681368.log 2023-07-06T02:41:08.363 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.360432.log.gz 2023-07-06T02:41:08.364 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.159636.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.755653.log 2023-07-06T02:41:08.364 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.159636.log.gz 2023-07-06T02:41:08.364 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.681368.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.681368.log.gz 2023-07-06T02:41:08.364 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.302455.log 2023-07-06T02:41:08.364 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.755653.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.344486.log 2023-07-06T02:41:08.365 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.755653.log.gz 2023-07-06T02:41:08.365 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.302455.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.108628.log 2023-07-06T02:41:08.365 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.302455.log.gz 2023-07-06T02:41:08.365 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.344486.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.255282.log 2023-07-06T02:41:08.365 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.344486.log.gz 2023-07-06T02:41:08.366 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.108628.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.324383.log 2023-07-06T02:41:08.366 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.186694.log 2023-07-06T02:41:08.366 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.255282.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.255282.log.gz 2023-07-06T02:41:08.366 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.324383.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.628732.log 2023-07-06T02:41:08.367 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.324383.log.gz 2023-07-06T02:41:08.367 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.186694.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.347332.log 2023-07-06T02:41:08.367 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.186694.log.gz 2023-07-06T02:41:08.367 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.628732.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.628732.log.gz 2023-07-06T02:41:08.367 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.466742.log 2023-07-06T02:41:08.368 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.347332.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.663555.log 2023-07-06T02:41:08.368 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.347332.log.gz 2023-07-06T02:41:08.368 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.466742.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.466742.log.gz 2023-07-06T02:41:08.368 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.654640.log 2023-07-06T02:41:08.369 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.663555.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.403040.log 2023-07-06T02:41:08.369 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.663555.log.gz 2023-07-06T02:41:08.369 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.654640.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.654640.log.gz 2023-07-06T02:41:08.369 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.396521.log 2023-07-06T02:41:08.369 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.403040.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.299538.log 2023-07-06T02:41:08.370 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.403040.log.gz 2023-07-06T02:41:08.370 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.396521.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.396521.log.gz 2023-07-06T02:41:08.370 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.697125.log 2023-07-06T02:41:08.370 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.299538.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.278959.log 2023-07-06T02:41:08.370 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.299538.log.gz 2023-07-06T02:41:08.371 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.697125.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.317472.log 2023-07-06T02:41:08.371 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.697125.log.gz 2023-07-06T02:41:08.371 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.278959.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.283225.log 2023-07-06T02:41:08.371 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.278959.log.gz 2023-07-06T02:41:08.371 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.317472.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.317472.log.gz 2023-07-06T02:41:08.372 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.691443.log 2023-07-06T02:41:08.372 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.283225.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.438654.log 2023-07-06T02:41:08.372 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.283225.log.gz 2023-07-06T02:41:08.372 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.691443.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.691443.log.gz 2023-07-06T02:41:08.373 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.402224.log 2023-07-06T02:41:08.373 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.438654.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.816668.log 2023-07-06T02:41:08.373 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.438654.log.gz 2023-07-06T02:41:08.373 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.402224.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.402224.log.gz 2023-07-06T02:41:08.374 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.318513.log 2023-07-06T02:41:08.374 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.816668.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.116131.log 2023-07-06T02:41:08.374 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.816668.log.gz 2023-07-06T02:41:08.374 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.318513.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.356993.log 2023-07-06T02:41:08.374 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.318513.log.gz 2023-07-06T02:41:08.375 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.0.116131.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.342221.log 2023-07-06T02:41:08.375 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.0.116131.log.gz 2023-07-06T02:41:08.375 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.356993.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.356993.log.gz 2023-07-06T02:41:08.375 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.463695.log 2023-07-06T02:41:08.375 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.342221.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.766945.log 2023-07-06T02:41:08.376 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.342221.log.gz 2023-07-06T02:41:08.376 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.463695.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.463695.log.gz 2023-07-06T02:41:08.376 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.272262.log 2023-07-06T02:41:08.376 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.766945.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.292428.log 2023-07-06T02:41:08.377 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.766945.log.gz 2023-07-06T02:41:08.377 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.272262.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.272262.log.gz 2023-07-06T02:41:08.377 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.815589.log 2023-07-06T02:41:08.377 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.292428.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.289469.log 2023-07-06T02:41:08.377 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.292428.log.gz 2023-07-06T02:41:08.378 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.815589.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.815589.log.gz 2023-07-06T02:41:08.378 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.678113.log 2023-07-06T02:41:08.378 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.289469.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.305920.log 2023-07-06T02:41:08.378 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.289469.log.gz 2023-07-06T02:41:08.378 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.678113.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.678113.log.gz 2023-07-06T02:41:08.379 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.312871.log 2023-07-06T02:41:08.379 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.305920.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.281714.log 2023-07-06T02:41:08.379 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.305920.log.gz 2023-07-06T02:41:08.379 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.312871.log: 0.0%gzip -5 --verbose -- replaced with /var/log/ceph/ceph-client.admin.312871.log.gz-- 2023-07-06T02:41:08.379 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.304340.log 2023-07-06T02:41:08.380 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.281714.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.312360.log 2023-07-06T02:41:08.380 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.281714.log.gz 2023-07-06T02:41:08.380 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.304340.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.187845.log 2023-07-06T02:41:08.380 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.304340.log.gz 2023-07-06T02:41:08.381 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.312360.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.259264.log 2023-07-06T02:41:08.381 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.312360.log.gz 2023-07-06T02:41:08.381 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.187845.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.394471.log 2023-07-06T02:41:08.381 INFO:teuthology.orchestra.run.smithi046.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.113511.log.gz 2023-07-06T02:41:08.381 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.187845.log.gz 2023-07-06T02:41:08.382 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.259264.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.755173.log 2023-07-06T02:41:08.382 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.259264.log.gz 2023-07-06T02:41:08.382 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.394471.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.791278.log 2023-07-06T02:41:08.382 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.394471.log.gz 2023-07-06T02:41:08.383 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.755173.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.651802.log 2023-07-06T02:41:08.383 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.755173.log.gz 2023-07-06T02:41:08.383 INFO:teuthology.orchestra.run.smithi046.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.117061.log.gz 2023-07-06T02:41:08.383 INFO:teuthology.orchestra.run.smithi046.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.111331.log.gz 2023-07-06T02:41:08.383 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.791278.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.791278.log.gz 2023-07-06T02:41:08.384 INFO:teuthology.orchestra.run.smithi046.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.115297.log.gz 2023-07-06T02:41:08.384 INFO:teuthology.orchestra.run.smithi046.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.112068.log.gz 2023-07-06T02:41:08.384 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.932193.log 2023-07-06T02:41:08.384 INFO:teuthology.orchestra.run.smithi046.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.107341.log.gz/var/log/ceph/ceph-client.admin.651802.log: 2023-07-06T02:41:08.384 INFO:teuthology.orchestra.run.smithi046.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.107907.log.gz 2023-07-06T02:41:08.385 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.651802.log.gz 2023-07-06T02:41:08.385 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.410626.log 2023-07-06T02:41:08.385 INFO:teuthology.orchestra.run.smithi046.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.112252.log.gz 2023-07-06T02:41:08.385 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.932193.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.652482.log 2023-07-06T02:41:08.386 INFO:teuthology.orchestra.run.smithi046.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.932193.log.gz 2023-07-06T02:41:08.386 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.410626.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.115201.log 2023-07-06T02:41:08.386 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.410626.log.gz 2023-07-06T02:41:08.386 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.652482.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.364290.log 2023-07-06T02:41:08.386 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.652482.log.gz 2023-07-06T02:41:08.387 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.115201.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.275883.log 2023-07-06T02:41:08.387 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.364290.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.107525.log 2023-07-06T02:41:08.387 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.364290.log.gz 2023-07-06T02:41:08.387 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.275883.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.115201.log.gz 2023-07-06T02:41:08.387 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.161704.log 2023-07-06T02:41:08.388 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.275883.log.gz 2023-07-06T02:41:08.388 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.273503.log 2023-07-06T02:41:08.388 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.107525.log: /var/log/ceph/ceph-client.admin.161704.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.191298.log 2023-07-06T02:41:08.388 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.161704.log.gz 2023-07-06T02:41:08.388 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.273503.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.114473.log 2023-07-06T02:41:08.389 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.273503.log.gz 2023-07-06T02:41:08.389 INFO:teuthology.orchestra.run.smithi046.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.107525.log.gz 2023-07-06T02:41:08.389 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.191298.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.356765.log 2023-07-06T02:41:08.389 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.191298.log.gz 2023-07-06T02:41:08.389 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.114473.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.288354.log 2023-07-06T02:41:08.390 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.356765.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.798408.log 2023-07-06T02:41:08.390 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.356765.log.gz 2023-07-06T02:41:08.390 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.288354.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.771641.log 2023-07-06T02:41:08.390 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.288354.log.gz 2023-07-06T02:41:08.390 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.798408.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.651101.log 2023-07-06T02:41:08.391 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.798408.log.gz 2023-07-06T02:41:08.391 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.771641.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.667905.log 2023-07-06T02:41:08.391 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.771641.log.gz 2023-07-06T02:41:08.391 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.651101.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.111976.log 2023-07-06T02:41:08.392 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.651101.log.gz 2023-07-06T02:41:08.392 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.667905.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.436538.log 2023-07-06T02:41:08.392 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.667905.log.gz 2023-07-06T02:41:08.392 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.111976.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.377603.log 2023-07-06T02:41:08.393 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.436538.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.681914.log 2023-07-06T02:41:08.393 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.436538.log.gz 2023-07-06T02:41:08.393 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.377603.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.399043.log 2023-07-06T02:41:08.393 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.377603.log.gz 2023-07-06T02:41:08.393 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.681914.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.220150.log 2023-07-06T02:41:08.394 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.681914.log.gz 2023-07-06T02:41:08.394 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.399043.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.399043.log.gz 2023-07-06T02:41:08.394 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.264685.log 2023-07-06T02:41:08.394 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.220150.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.115619.log 2023-07-06T02:41:08.394 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.220150.log.gz 2023-07-06T02:41:08.395 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.264685.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.264685.log.gz 2023-07-06T02:41:08.395 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.268043.log 2023-07-06T02:41:08.395 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.115619.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.281728.log 2023-07-06T02:41:08.395 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.268043.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.758040.log 2023-07-06T02:41:08.396 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.268043.log.gz 2023-07-06T02:41:08.396 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.281728.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.632355.log 2023-07-06T02:41:08.396 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.281728.log.gz 2023-07-06T02:41:08.396 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.758040.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.758040.log.gz 2023-07-06T02:41:08.396 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.926575.log 2023-07-06T02:41:08.397 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.632355.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.279764.log 2023-07-06T02:41:08.397 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.632355.log.gz 2023-07-06T02:41:08.397 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.926575.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.926575.log.gz 2023-07-06T02:41:08.397 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.632635.log 2023-07-06T02:41:08.397 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.279764.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.618993.log 2023-07-06T02:41:08.398 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.279764.log.gz 2023-07-06T02:41:08.398 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.632635.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.632635.log.gz 2023-07-06T02:41:08.398 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.194722.log 2023-07-06T02:41:08.398 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.618993.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.331672.log 2023-07-06T02:41:08.398 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.618993.log.gz 2023-07-06T02:41:08.399 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.194722.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.815050.log 2023-07-06T02:41:08.399 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.194722.log.gz 2023-07-06T02:41:08.399 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.331672.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.295583.log 2023-07-06T02:41:08.400 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.331672.log.gz 2023-07-06T02:41:08.400 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.815050.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.815050.log.gz 2023-07-06T02:41:08.400 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.279671.log 2023-07-06T02:41:08.400 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.295583.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.265176.log 2023-07-06T02:41:08.400 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.295583.log.gz 2023-07-06T02:41:08.401 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.279671.log: gzip 0.0% -- replaced with /var/log/ceph/ceph-client.admin.279671.log.gz-5 2023-07-06T02:41:08.401 INFO:teuthology.orchestra.run.smithi046.stderr:--verbose -- /var/log/ceph/ceph-client.admin.639743.log 2023-07-06T02:41:08.401 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.265176.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.467214.log 2023-07-06T02:41:08.401 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.265176.log.gz 2023-07-06T02:41:08.401 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.639743.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.639743.log.gz 2023-07-06T02:41:08.402 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.1.log 2023-07-06T02:41:08.402 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.467214.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.336875.log 2023-07-06T02:41:08.402 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.467214.log.gz 2023-07-06T02:41:08.402 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-osd.1.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.690184.log 2023-07-06T02:41:08.402 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.336875.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.402524.log 2023-07-06T02:41:08.403 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.336875.log.gz 2023-07-06T02:41:08.403 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.690184.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.690184.log.gz 2023-07-06T02:41:08.403 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.703877.log 2023-07-06T02:41:08.403 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.402524.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.162275.log 2023-07-06T02:41:08.403 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.402524.log.gz 2023-07-06T02:41:08.404 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.703877.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.363543.log 2023-07-06T02:41:08.404 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.703877.log.gz 2023-07-06T02:41:08.404 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.162275.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.400078.log 2023-07-06T02:41:08.404 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.162275.log.gz 2023-07-06T02:41:08.405 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.363543.log: gzip 0.0%-5 --verbose -- replaced with /var/log/ceph/ceph-client.admin.363543.log.gz 2023-07-06T02:41:08.405 INFO:teuthology.orchestra.run.smithi046.stderr:-- /var/log/ceph/ceph-client.admin.699327.log 2023-07-06T02:41:08.405 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.400078.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.202589.log 2023-07-06T02:41:08.405 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.400078.log.gz 2023-07-06T02:41:08.405 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.699327.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.699327.log.gz 2023-07-06T02:41:08.406 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.624035.log 2023-07-06T02:41:08.406 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.202589.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.672646.log 2023-07-06T02:41:08.406 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.202589.log.gz 2023-07-06T02:41:08.406 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.624035.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.624035.log.gz 2023-07-06T02:41:08.407 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.260246.log 2023-07-06T02:41:08.407 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.672646.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.304650.log 2023-07-06T02:41:08.407 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.672646.log.gz 2023-07-06T02:41:08.407 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.260246.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.260246.log.gz 2023-07-06T02:41:08.408 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.261753.log 2023-07-06T02:41:08.408 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.304650.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.395076.log 2023-07-06T02:41:08.408 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.304650.log.gz 2023-07-06T02:41:08.408 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.261753.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.261753.log.gz 2023-07-06T02:41:08.408 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.357787.log 2023-07-06T02:41:08.409 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.395076.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.703659.log 2023-07-06T02:41:08.409 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.395076.log.gz 2023-07-06T02:41:08.409 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.357787.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.673217.log 2023-07-06T02:41:08.409 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.357787.log.gz 2023-07-06T02:41:08.409 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.703659.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.407703.log 2023-07-06T02:41:08.410 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.703659.log.gz 2023-07-06T02:41:08.410 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.673217.log: gzip -5 0.0%--verbose -- -- replaced with /var/log/ceph/ceph-client.admin.673217.log.gz 2023-07-06T02:41:08.410 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.390725.log 2023-07-06T02:41:08.410 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.407703.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.188350.log 2023-07-06T02:41:08.410 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.407703.log.gz 2023-07-06T02:41:08.411 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.390725.log: 0.0%gzip -- replaced with /var/log/ceph/ceph-client.admin.390725.log.gz 2023-07-06T02:41:08.411 INFO:teuthology.orchestra.run.smithi046.stderr:-5 --verbose -- /var/log/ceph/ceph-client.admin.253826.log 2023-07-06T02:41:08.411 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.188350.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.610736.log 2023-07-06T02:41:08.411 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.188350.log.gz 2023-07-06T02:41:08.412 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.253826.log: 0.0%gzip -- replaced with /var/log/ceph/ceph-client.admin.253826.log.gz-5 2023-07-06T02:41:08.412 INFO:teuthology.orchestra.run.smithi046.stderr:--verbose -- /var/log/ceph/ceph-client.admin.334673.log 2023-07-06T02:41:08.412 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.610736.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.652980.log 2023-07-06T02:41:08.412 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.610736.log.gz 2023-07-06T02:41:08.413 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.334673.log: 0.0%gzip -- replaced with /var/log/ceph/ceph-client.admin.334673.log.gz-5 2023-07-06T02:41:08.413 INFO:teuthology.orchestra.run.smithi046.stderr:--verbose -- /var/log/ceph/ceph-client.admin.407900.log 2023-07-06T02:41:08.413 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.652980.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.610643.log 2023-07-06T02:41:08.413 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.652980.log.gz 2023-07-06T02:41:08.413 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.407900.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.407900.log.gz 2023-07-06T02:41:08.414 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.397324.log 2023-07-06T02:41:08.414 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.610643.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.415214.log 2023-07-06T02:41:08.414 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.610643.log.gz 2023-07-06T02:41:08.414 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.397324.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.397324.log.gz 2023-07-06T02:41:08.414 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.195667.log 2023-07-06T02:41:08.415 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.415214.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.677039.log 2023-07-06T02:41:08.415 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.415214.log.gz 2023-07-06T02:41:08.415 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.195667.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.339629.log 2023-07-06T02:41:08.415 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.195667.log.gz 2023-07-06T02:41:08.415 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.677039.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.623646.log 2023-07-06T02:41:08.416 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.677039.log.gz 2023-07-06T02:41:08.416 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.339629.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.365298.log 2023-07-06T02:41:08.416 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.339629.log.gz 2023-07-06T02:41:08.416 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.623646.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.399781.log 2023-07-06T02:41:08.417 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.623646.log.gz 2023-07-06T02:41:08.417 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.365298.log: gzip -5 --verbose -- 0.0%/var/log/ceph/ceph-client.admin.322868.log -- replaced with /var/log/ceph/ceph-client.admin.365298.log.gz 2023-07-06T02:41:08.417 INFO:teuthology.orchestra.run.smithi046.stderr: 2023-07-06T02:41:08.417 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.201545.log 2023-07-06T02:41:08.417 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.399781.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.399781.log.gz 2023-07-06T02:41:08.418 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.322868.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.322868.log.gz 2023-07-06T02:41:08.418 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.335189.log 2023-07-06T02:41:08.418 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.201545.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.208894.log 2023-07-06T02:41:08.418 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.201545.log.gz 2023-07-06T02:41:08.418 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.335189.log: gzip 0.0%-5 -- replaced with /var/log/ceph/ceph-client.admin.335189.log.gz 2023-07-06T02:41:08.419 INFO:teuthology.orchestra.run.smithi046.stderr:--verbose -- /var/log/ceph/ceph-client.admin.346511.log 2023-07-06T02:41:08.419 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.208894.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.614916.log 2023-07-06T02:41:08.419 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.208894.log.gz 2023-07-06T02:41:08.419 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.346511.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.346511.log.gz 2023-07-06T02:41:08.419 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.320205.log 2023-07-06T02:41:08.420 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.614916.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.397986.log 2023-07-06T02:41:08.420 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.614916.log.gz 2023-07-06T02:41:08.420 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.320205.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.677464.log 2023-07-06T02:41:08.420 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.320205.log.gz 2023-07-06T02:41:08.421 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.397986.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.292521.log 2023-07-06T02:41:08.421 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.397986.log.gz 2023-07-06T02:41:08.421 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.677464.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.677464.log.gz 2023-07-06T02:41:08.421 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.676240.log 2023-07-06T02:41:08.421 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.292521.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.283428.log 2023-07-06T02:41:08.422 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.292521.log.gz 2023-07-06T02:41:08.422 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.676240.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.200673.log 2023-07-06T02:41:08.422 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.676240.log.gz 2023-07-06T02:41:08.422 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.283428.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.384859.log 2023-07-06T02:41:08.422 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.283428.log.gz 2023-07-06T02:41:08.423 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.200673.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.267631.log 2023-07-06T02:41:08.423 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.200673.log.gz 2023-07-06T02:41:08.423 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.384859.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.258221.log 2023-07-06T02:41:08.423 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.384859.log.gz 2023-07-06T02:41:08.423 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.267631.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.267631.log.gz 2023-07-06T02:41:08.424 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.650556.log 2023-07-06T02:41:08.424 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.258221.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.680430.log 2023-07-06T02:41:08.424 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.258221.log.gz 2023-07-06T02:41:08.424 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.650556.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.650556.log.gz 2023-07-06T02:41:08.425 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.695318.log 2023-07-06T02:41:08.425 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.680430.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.789759.log 2023-07-06T02:41:08.425 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.680430.log.gz 2023-07-06T02:41:08.425 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.695318.log: 0.0%gzip -- replaced with /var/log/ceph/ceph-client.admin.695318.log.gz 2023-07-06T02:41:08.425 INFO:teuthology.orchestra.run.smithi046.stderr:-5 --verbose -- /var/log/ceph/ceph-client.admin.403532.log 2023-07-06T02:41:08.426 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.789759.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.789759.log.gz 2023-07-06T02:41:08.426 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.276177.log 2023-07-06T02:41:08.426 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.403532.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.637239.log 2023-07-06T02:41:08.426 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.403532.log.gz 2023-07-06T02:41:08.426 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.276177.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.930648.log 2023-07-06T02:41:08.427 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.276177.log.gz 2023-07-06T02:41:08.427 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.637239.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.367545.log 2023-07-06T02:41:08.427 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.637239.log.gz 2023-07-06T02:41:08.427 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.930648.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.366457.log 2023-07-06T02:41:08.427 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.367545.log: 87.5% 88.8% -- replaced with /var/log/ceph/ceph-client.admin.930648.log.gz -- replaced with /var/log/ceph/ceph-client.admin.114473.log.gz 2023-07-06T02:41:08.428 INFO:teuthology.orchestra.run.smithi046.stderr: 2023-07-06T02:41:08.428 INFO:teuthology.orchestra.run.smithi046.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.111976.log.gz 2023-07-06T02:41:08.428 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.367545.log.gz 2023-07-06T02:41:08.428 INFO:teuthology.orchestra.run.smithi046.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.115619.log.gz 2023-07-06T02:41:08.429 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.366457.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.366457.log.gz 2023-07-06T02:41:08.429 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.275115.log 2023-07-06T02:41:08.429 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.398275.log 2023-07-06T02:41:08.429 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.275115.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.803029.log 2023-07-06T02:41:08.429 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.275115.log.gz 2023-07-06T02:41:08.430 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.398275.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.465687.log 2023-07-06T02:41:08.430 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.398275.log.gz 2023-07-06T02:41:08.430 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.803029.log: gzip -5 0.0%--verbose -- -- replaced with /var/log/ceph/ceph-client.admin.803029.log.gz/var/log/ceph/ceph-client.admin.336319.log 2023-07-06T02:41:08.430 INFO:teuthology.orchestra.run.smithi046.stderr: 2023-07-06T02:41:08.430 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.158518.log 2023-07-06T02:41:08.431 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.465687.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.465687.log.gz 2023-07-06T02:41:08.431 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.336319.log: gzip -5 0.0%--verbose -- -- replaced with /var/log/ceph/ceph-client.admin.336319.log.gz/var/log/ceph/ceph-client.admin.262735.log 2023-07-06T02:41:08.431 INFO:teuthology.orchestra.run.smithi046.stderr: 2023-07-06T02:41:08.431 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.158518.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.613222.log 2023-07-06T02:41:08.432 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.158518.log.gz 2023-07-06T02:41:08.432 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.262735.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.364073.log 2023-07-06T02:41:08.432 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.262735.log.gz 2023-07-06T02:41:08.432 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.613222.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.653298.log 2023-07-06T02:41:08.433 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.613222.log.gz 2023-07-06T02:41:08.433 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.364073.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.360047.log 2023-07-06T02:41:08.433 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.364073.log.gz 2023-07-06T02:41:08.433 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.653298.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.195588.log 2023-07-06T02:41:08.434 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.653298.log.gz 2023-07-06T02:41:08.434 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.360047.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.161227.log 2023-07-06T02:41:08.434 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.360047.log.gz 2023-07-06T02:41:08.434 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.195588.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.371577.log 2023-07-06T02:41:08.434 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.195588.log.gz 2023-07-06T02:41:08.435 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.161227.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.361212.log 2023-07-06T02:41:08.435 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.161227.log.gz 2023-07-06T02:41:08.435 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.371577.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.387074.log 2023-07-06T02:41:08.435 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.371577.log.gz 2023-07-06T02:41:08.435 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.361212.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.358799.log 2023-07-06T02:41:08.436 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.361212.log.gz 2023-07-06T02:41:08.436 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.387074.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.768571.log 2023-07-06T02:41:08.436 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.387074.log.gz 2023-07-06T02:41:08.436 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.358799.log: gzip -5 0.0%--verbose -- replaced with /var/log/ceph/ceph-client.admin.358799.log.gz-- 2023-07-06T02:41:08.437 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.340355.log 2023-07-06T02:41:08.437 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.768571.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.809228.log 2023-07-06T02:41:08.438 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.768571.log.gz 2023-07-06T02:41:08.438 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.340355.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.674165.log 2023-07-06T02:41:08.439 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.340355.log.gz 2023-07-06T02:41:08.439 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.809228.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.248573.log 2023-07-06T02:41:08.439 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.809228.log.gz 2023-07-06T02:41:08.440 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.674165.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.769665.log 0.0% 2023-07-06T02:41:08.440 INFO:teuthology.orchestra.run.smithi046.stderr: -- replaced with /var/log/ceph/ceph-client.admin.674165.log.gz 2023-07-06T02:41:08.441 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.248573.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.297486.log 2023-07-06T02:41:08.441 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.248573.log.gz 2023-07-06T02:41:08.442 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.769665.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.211177.log 2023-07-06T02:41:08.442 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.769665.log.gz 2023-07-06T02:41:08.443 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.297486.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.162662.log 2023-07-06T02:41:08.443 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.297486.log.gz 2023-07-06T02:41:08.443 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.211177.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.685113.log 2023-07-06T02:41:08.443 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.211177.log.gz 2023-07-06T02:41:08.444 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.162662.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.636959.log 2023-07-06T02:41:08.444 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.162662.log.gz 2023-07-06T02:41:08.444 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.685113.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.685113.log.gz 2023-07-06T02:41:08.444 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.304851.log 2023-07-06T02:41:08.444 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.636959.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.664360.log 2023-07-06T02:41:08.445 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.636959.log.gz 2023-07-06T02:41:08.445 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.304851.log: gzip -5 --verbose 0.0%-- -- replaced with /var/log/ceph/ceph-client.admin.304851.log.gz/var/log/ceph/ceph-client.admin.296100.log 2023-07-06T02:41:08.445 INFO:teuthology.orchestra.run.smithi046.stderr: 2023-07-06T02:41:08.446 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.664360.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.294507.log 2023-07-06T02:41:08.446 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.664360.log.gz 2023-07-06T02:41:08.446 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.296100.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.173669.log 2023-07-06T02:41:08.446 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.296100.log.gz 2023-07-06T02:41:08.446 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.294507.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.638774.log 2023-07-06T02:41:08.447 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.294507.log.gz 2023-07-06T02:41:08.447 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.173669.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.766414.log 2023-07-06T02:41:08.447 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.173669.log.gz 2023-07-06T02:41:08.447 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.638774.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.648687.log 2023-07-06T02:41:08.447 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.638774.log.gz 2023-07-06T02:41:08.448 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.196058.log 2023-07-06T02:41:08.448 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.766414.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.766414.log.gz 2023-07-06T02:41:08.448 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.648687.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.301550.log 2023-07-06T02:41:08.448 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.648687.log.gz 2023-07-06T02:41:08.449 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.196058.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.239073.log 2023-07-06T02:41:08.449 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.196058.log.gz 2023-07-06T02:41:08.449 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.204628.log 2023-07-06T02:41:08.449 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.301550.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.301550.log.gz 2023-07-06T02:41:08.449 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.239073.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.239073.log.gz 2023-07-06T02:41:08.450 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.924740.log 2023-07-06T02:41:08.450 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.204628.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.329141.log 2023-07-06T02:41:08.450 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.204628.log.gz 2023-07-06T02:41:08.450 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.924740.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.283132.log 2023-07-06T02:41:08.451 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.924740.log.gz 2023-07-06T02:41:08.451 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.329141.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.795104.log 2023-07-06T02:41:08.451 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.329141.log.gz 2023-07-06T02:41:08.451 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.283132.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.283132.log.gz 2023-07-06T02:41:08.451 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.392629.log 2023-07-06T02:41:08.452 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.795104.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.437700.log 2023-07-06T02:41:08.452 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.795104.log.gz 2023-07-06T02:41:08.452 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.392629.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.704077.log 2023-07-06T02:41:08.452 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.392629.log.gz 2023-07-06T02:41:08.452 INFO:teuthology.orchestra.run.smithi046.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.108628.log.gz 2023-07-06T02:41:08.453 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.437700.log: /var/log/ceph/ceph-client.admin.406431.log 2023-07-06T02:41:08.453 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.437700.log.gz 2023-07-06T02:41:08.453 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.704077.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.704077.log.gz 2023-07-06T02:41:08.453 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.191987.log 2023-07-06T02:41:08.453 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.406431.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.321434.log 2023-07-06T02:41:08.454 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.406431.log.gz 2023-07-06T02:41:08.454 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.191987.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.191987.log.gz 2023-07-06T02:41:08.454 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.280241.log 2023-07-06T02:41:08.454 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.321434.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.686599.log 2023-07-06T02:41:08.454 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.321434.log.gz 2023-07-06T02:41:08.455 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.280241.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.280241.log.gz 2023-07-06T02:41:08.455 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.680901.log 2023-07-06T02:41:08.455 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.686599.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.322854.log 2023-07-06T02:41:08.455 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.686599.log.gz 2023-07-06T02:41:08.456 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.680901.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.799213.log 2023-07-06T02:41:08.456 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.680901.log.gz 2023-07-06T02:41:08.456 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.322854.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.921350.log 2023-07-06T02:41:08.456 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.322854.log.gz 2023-07-06T02:41:08.456 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.799213.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.799213.log.gz 2023-07-06T02:41:08.457 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.166352.log 2023-07-06T02:41:08.457 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.921350.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.304944.log 2023-07-06T02:41:08.457 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.921350.log.gz 2023-07-06T02:41:08.457 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.166352.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.166352.log.gz 2023-07-06T02:41:08.458 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.624128.log 2023-07-06T02:41:08.458 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.304944.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.696538.log 2023-07-06T02:41:08.458 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.304944.log.gz 2023-07-06T02:41:08.458 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.624128.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.624128.log.gz 2023-07-06T02:41:08.458 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.419471.log 2023-07-06T02:41:08.459 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.696538.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.663352.log 2023-07-06T02:41:08.459 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.696538.log.gz 2023-07-06T02:41:08.459 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.419471.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.419471.log.gz 2023-07-06T02:41:08.459 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.401508.log 2023-07-06T02:41:08.459 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.663352.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.156061.log 2023-07-06T02:41:08.460 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.663352.log.gz 2023-07-06T02:41:08.460 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.401508.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.401508.log.gz 2023-07-06T02:41:08.460 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.626695.log 2023-07-06T02:41:08.460 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.156061.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.323858.log 2023-07-06T02:41:08.461 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.156061.log.gz 2023-07-06T02:41:08.461 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.626695.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.626695.log.gz 2023-07-06T02:41:08.461 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.344717.log 2023-07-06T02:41:08.461 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.323858.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.206123.log 2023-07-06T02:41:08.461 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.323858.log.gz 2023-07-06T02:41:08.462 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.344717.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.363263.log 2023-07-06T02:41:08.462 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.344717.log.gz 2023-07-06T02:41:08.462 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.206123.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.245560.log 2023-07-06T02:41:08.462 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.206123.log.gz 2023-07-06T02:41:08.462 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.363263.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.363263.log.gz 2023-07-06T02:41:08.463 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.792004.log 2023-07-06T02:41:08.463 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.245560.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.396815.log 2023-07-06T02:41:08.463 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.245560.log.gz 2023-07-06T02:41:08.463 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.792004.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.792004.log.gz 2023-07-06T02:41:08.463 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.384565.log 2023-07-06T02:41:08.464 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.396815.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.412577.log 2023-07-06T02:41:08.464 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.396815.log.gz 2023-07-06T02:41:08.464 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.384565.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.193739.log 2023-07-06T02:41:08.464 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.384565.log.gz 2023-07-06T02:41:08.465 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.412577.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.800760.log 2023-07-06T02:41:08.465 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.412577.log.gz 2023-07-06T02:41:08.465 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.193739.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.193739.log.gz 2023-07-06T02:41:08.465 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.928039.log 2023-07-06T02:41:08.465 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.800760.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.291711.log 2023-07-06T02:41:08.466 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.800760.log.gz 2023-07-06T02:41:08.466 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.928039.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.928039.log.gz 2023-07-06T02:41:08.466 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.170855.log 2023-07-06T02:41:08.466 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.291711.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.291494.log 2023-07-06T02:41:08.466 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.291711.log.gz 2023-07-06T02:41:08.467 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.170855.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.193943.log 2023-07-06T02:41:08.467 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.170855.log.gz 2023-07-06T02:41:08.467 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.291494.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.112390.log 2023-07-06T02:41:08.467 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.291494.log.gz 2023-07-06T02:41:08.467 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.193943.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.632939.log 2023-07-06T02:41:08.468 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.193943.log.gz 2023-07-06T02:41:08.468 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.112390.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.199239.log 2023-07-06T02:41:08.468 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.632939.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.339923.log 2023-07-06T02:41:08.468 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.632939.log.gz 2023-07-06T02:41:08.469 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.199239.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.220201.log 2023-07-06T02:41:08.469 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.199239.log.gz 2023-07-06T02:41:08.469 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.339923.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.339923.log.gz 2023-07-06T02:41:08.469 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.169631.log 2023-07-06T02:41:08.469 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.220201.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.686890.log 2023-07-06T02:41:08.470 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.220201.log.gz 2023-07-06T02:41:08.470 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.169631.log: gzip -5 --verbose -- 0.0%/var/log/ceph/ceph-client.admin.405999.log 2023-07-06T02:41:08.470 INFO:teuthology.orchestra.run.smithi046.stderr: -- replaced with /var/log/ceph/ceph-client.admin.169631.log.gz 2023-07-06T02:41:08.470 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.686890.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.212263.log 2023-07-06T02:41:08.471 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.686890.log.gz 2023-07-06T02:41:08.471 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.405999.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.405999.log.gz 2023-07-06T02:41:08.471 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.154063.log 2023-07-06T02:41:08.471 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.212263.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.171393.log 2023-07-06T02:41:08.471 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.212263.log.gz 2023-07-06T02:41:08.472 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.154063.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.154063.log.gz 2023-07-06T02:41:08.472 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.651308.log 2023-07-06T02:41:08.472 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.171393.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.240643.log 2023-07-06T02:41:08.472 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.171393.log.gz 2023-07-06T02:41:08.473 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.651308.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.377187.log 2023-07-06T02:41:08.473 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.651308.log.gz 2023-07-06T02:41:08.473 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.240643.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.262230.log 2023-07-06T02:41:08.473 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.240643.log.gz 2023-07-06T02:41:08.473 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.377187.log: 0.0%gzip -- replaced with /var/log/ceph/ceph-client.admin.377187.log.gz-5 2023-07-06T02:41:08.474 INFO:teuthology.orchestra.run.smithi046.stderr:--verbose -- /var/log/ceph/ceph-client.admin.246037.log 2023-07-06T02:41:08.474 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.262230.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.807266.log 2023-07-06T02:41:08.474 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.262230.log.gz 2023-07-06T02:41:08.474 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.246037.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.246037.log.gz 2023-07-06T02:41:08.474 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.672113.log 2023-07-06T02:41:08.475 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.807266.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.247999.log 2023-07-06T02:41:08.475 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.807266.log.gz 2023-07-06T02:41:08.475 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.672113.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.753550.log 2023-07-06T02:41:08.475 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.672113.log.gz 2023-07-06T02:41:08.475 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.247999.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.259676.log 2023-07-06T02:41:08.476 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.247999.log.gz 2023-07-06T02:41:08.476 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.753550.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.753550.log.gz 2023-07-06T02:41:08.476 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.240090.log 2023-07-06T02:41:08.476 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.259676.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.796875.log 2023-07-06T02:41:08.477 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.259676.log.gz 2023-07-06T02:41:08.477 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.240090.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.240090.log.gz 2023-07-06T02:41:08.477 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.413915.log 2023-07-06T02:41:08.477 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.796875.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.278243.log 2023-07-06T02:41:08.477 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.796875.log.gz 2023-07-06T02:41:08.478 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.413915.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.789745.log 2023-07-06T02:41:08.478 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.413915.log.gz 2023-07-06T02:41:08.478 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.278243.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.340154.log 2023-07-06T02:41:08.478 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.278243.log.gz 2023-07-06T02:41:08.478 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.789745.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.789745.log.gz 2023-07-06T02:41:08.479 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.346715.log 2023-07-06T02:41:08.479 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.340154.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.768067.log 2023-07-06T02:41:08.479 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.340154.log.gz 2023-07-06T02:41:08.479 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.346715.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.703076.log 2023-07-06T02:41:08.479 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.346715.log.gz 2023-07-06T02:41:08.480 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.768067.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.358331.log 2023-07-06T02:41:08.480 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.768067.log.gz 2023-07-06T02:41:08.480 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.703076.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.703076.log.gz 2023-07-06T02:41:08.480 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.651523.log 2023-07-06T02:41:08.481 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.358331.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.651816.log 2023-07-06T02:41:08.481 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.358331.log.gz 2023-07-06T02:41:08.481 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.651523.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.651523.log.gz 2023-07-06T02:41:08.481 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.335700.log 2023-07-06T02:41:08.481 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.651816.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.363760.log 2023-07-06T02:41:08.482 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.651816.log.gz 2023-07-06T02:41:08.482 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.335700.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.335700.log.gz 2023-07-06T02:41:08.482 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.204010.log 2023-07-06T02:41:08.482 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.363760.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.388780.log 2023-07-06T02:41:08.483 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.363760.log.gz 2023-07-06T02:41:08.483 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.204010.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.204010.log.gz 2023-07-06T02:41:08.483 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.168586.log 2023-07-06T02:41:08.483 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.388780.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.922798.log 2023-07-06T02:41:08.483 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.388780.log.gz 2023-07-06T02:41:08.484 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.168586.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.268122.log 2023-07-06T02:41:08.484 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.168586.log.gz 2023-07-06T02:41:08.484 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.922798.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.922812.log 2023-07-06T02:41:08.484 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.922798.log.gz 2023-07-06T02:41:08.484 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.268122.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.268122.log.gz 2023-07-06T02:41:08.485 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.666840.log 2023-07-06T02:41:08.485 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.922812.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.635269.log 2023-07-06T02:41:08.485 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.922812.log.gz 2023-07-06T02:41:08.485 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.666840.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.666840.log.gz 2023-07-06T02:41:08.486 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.816193.log 2023-07-06T02:41:08.486 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.635269.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.253052.log 2023-07-06T02:41:08.486 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.635269.log.gz 2023-07-06T02:41:08.486 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.816193.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.816193.log.gz 2023-07-06T02:41:08.486 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.695515.log 2023-07-06T02:41:08.487 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.253052.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.929096.log 2023-07-06T02:41:08.487 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.253052.log.gz 2023-07-06T02:41:08.487 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.695515.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.695515.log.gz 2023-07-06T02:41:08.487 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.692026.log 2023-07-06T02:41:08.487 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.929096.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.323148.log 2023-07-06T02:41:08.488 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.929096.log.gz 2023-07-06T02:41:08.488 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.692026.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.692026.log.gz 2023-07-06T02:41:08.488 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.800452.log 2023-07-06T02:41:08.488 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.323148.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.396246.log 2023-07-06T02:41:08.488 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.323148.log.gz 2023-07-06T02:41:08.489 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.800452.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.798702.log 2023-07-06T02:41:08.489 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.800452.log.gz 2023-07-06T02:41:08.489 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.396246.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.272481.log 2023-07-06T02:41:08.489 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.396246.log.gz 2023-07-06T02:41:08.489 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.798702.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.267645.log 2023-07-06T02:41:08.490 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.798702.log.gz 2023-07-06T02:41:08.490 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.272481.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.327183.log 2023-07-06T02:41:08.490 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.272481.log.gz 2023-07-06T02:41:08.490 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.267645.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.240183.log 2023-07-06T02:41:08.490 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.267645.log.gz 2023-07-06T02:41:08.491 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.327183.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.769066.log 2023-07-06T02:41:08.491 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.327183.log.gz 2023-07-06T02:41:08.491 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.240183.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.240183.log.gz 2023-07-06T02:41:08.491 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.361506.log 2023-07-06T02:41:08.492 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.769066.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.290983.log 2023-07-06T02:41:08.492 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.769066.log.gz 2023-07-06T02:41:08.492 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.361506.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.286500.log 2023-07-06T02:41:08.492 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.361506.log.gz 2023-07-06T02:41:08.492 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.290983.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.262642.log 2023-07-06T02:41:08.493 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.290983.log.gz 2023-07-06T02:41:08.493 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.286500.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.286500.log.gz 2023-07-06T02:41:08.493 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.219935.log 2023-07-06T02:41:08.493 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.262642.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.111654.log 2023-07-06T02:41:08.493 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.262642.log.gz 2023-07-06T02:41:08.494 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.219935.log: gzip 0.0%-5 -- replaced with /var/log/ceph/ceph-client.admin.219935.log.gz--verbose 2023-07-06T02:41:08.494 INFO:teuthology.orchestra.run.smithi046.stderr:-- /var/log/ceph/ceph-client.admin.623567.log 2023-07-06T02:41:08.494 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.111654.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.648756.log 2023-07-06T02:41:08.494 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.623567.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.618628.log 2023-07-06T02:41:08.495 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.623567.log.gz 2023-07-06T02:41:08.495 INFO:teuthology.orchestra.run.smithi046.stderr:gzip /var/log/ceph/ceph-client.admin.648756.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.468638.log 2023-07-06T02:41:08.495 INFO:teuthology.orchestra.run.smithi046.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.112390.log.gz 2023-07-06T02:41:08.495 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.648756.log.gz 2023-07-06T02:41:08.495 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.618628.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.404009.log 2023-07-06T02:41:08.496 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.618628.log.gz 2023-07-06T02:41:08.496 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.468638.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.468638.log.gz 2023-07-06T02:41:08.496 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.755667.log 2023-07-06T02:41:08.496 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.404009.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.111654.log.gz 2023-07-06T02:41:08.496 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.276410.log 2023-07-06T02:41:08.497 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.404009.log.gz 2023-07-06T02:41:08.497 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.382447.log 2023-07-06T02:41:08.497 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.755667.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.755667.log.gz 2023-07-06T02:41:08.497 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.276410.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.630699.log 2023-07-06T02:41:08.497 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.276410.log.gz 2023-07-06T02:41:08.498 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.382447.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.759014.log 2023-07-06T02:41:08.498 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.382447.log.gz 2023-07-06T02:41:08.498 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.630699.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.630699.log.gz 2023-07-06T02:41:08.498 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.757561.log 2023-07-06T02:41:08.498 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.759014.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.684810.log 2023-07-06T02:41:08.499 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.759014.log.gz 2023-07-06T02:41:08.499 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.757561.log: gzip -5 --verbose -- 0.0%/var/log/ceph/ceph-client.admin.289376.log 2023-07-06T02:41:08.499 INFO:teuthology.orchestra.run.smithi046.stderr: -- replaced with /var/log/ceph/ceph-client.admin.757561.log.gz 2023-07-06T02:41:08.499 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.684810.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.627509.log 2023-07-06T02:41:08.500 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.684810.log.gz 2023-07-06T02:41:08.500 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.289376.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.289376.log.gz 2023-07-06T02:41:08.500 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.276690.log 2023-07-06T02:41:08.500 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.627509.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.283211.log 2023-07-06T02:41:08.501 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.627509.log.gz 2023-07-06T02:41:08.501 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.276690.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.302240.log 2023-07-06T02:41:08.501 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.276690.log.gz 2023-07-06T02:41:08.501 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.283211.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.611786.log 2023-07-06T02:41:08.501 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.283211.log.gz 2023-07-06T02:41:08.502 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.302240.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.374084.log 2023-07-06T02:41:08.502 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.302240.log.gz 2023-07-06T02:41:08.502 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.611786.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.328258.log 2023-07-06T02:41:08.502 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.611786.log.gz 2023-07-06T02:41:08.503 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.374084.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.650542.log 2023-07-06T02:41:08.503 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.374084.log.gz 2023-07-06T02:41:08.503 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.328258.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.109156.log 2023-07-06T02:41:08.503 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.328258.log.gz 2023-07-06T02:41:08.503 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.650542.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.113691.log 2023-07-06T02:41:08.504 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.650542.log.gz 2023-07-06T02:41:08.504 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.109156.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.275897.log 2023-07-06T02:41:08.504 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.113691.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.636138.log 2023-07-06T02:41:08.504 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.275897.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.252957.log 2023-07-06T02:41:08.504 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.275897.log.gz 2023-07-06T02:41:08.505 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.636138.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.799738.log 2023-07-06T02:41:08.505 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.636138.log.gz 2023-07-06T02:41:08.505 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.252957.log: 0.0%gzip -- replaced with /var/log/ceph/ceph-client.admin.252957.log.gz 2023-07-06T02:41:08.505 INFO:teuthology.orchestra.run.smithi046.stderr:-5 --verbose -- /var/log/ceph/ceph-client.admin.361925.log 2023-07-06T02:41:08.505 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.799738.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.296086.log 2023-07-06T02:41:08.506 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.799738.log.gz 2023-07-06T02:41:08.506 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.361925.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.294428.log 2023-07-06T02:41:08.506 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.361925.log.gz 2023-07-06T02:41:08.506 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.296086.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.624500.log 2023-07-06T02:41:08.506 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.296086.log.gz 2023-07-06T02:41:08.507 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.294428.log: gzip 0.0%-5 -- replaced with /var/log/ceph/ceph-client.admin.294428.log.gz--verbose 2023-07-06T02:41:08.507 INFO:teuthology.orchestra.run.smithi046.stderr:-- /var/log/ceph/ceph-client.admin.759752.log 2023-07-06T02:41:08.507 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.624500.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.328165.log 2023-07-06T02:41:08.507 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.624500.log.gz 2023-07-06T02:41:08.508 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.759752.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.925129.log 2023-07-06T02:41:08.508 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.759752.log.gz 2023-07-06T02:41:08.508 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.328165.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.106822.log 2023-07-06T02:41:08.508 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.328165.log.gz 2023-07-06T02:41:08.508 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.925129.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.796147.log 2023-07-06T02:41:08.509 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.925129.log.gz 2023-07-06T02:41:08.509 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.106822.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.244593.log 2023-07-06T02:41:08.509 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.796147.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.115481.log 2023-07-06T02:41:08.509 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.796147.log.gz 2023-07-06T02:41:08.509 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.244593.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.817541.log 2023-07-06T02:41:08.510 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.244593.log.gz 2023-07-06T02:41:08.510 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.115481.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.187565.log 2023-07-06T02:41:08.510 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.817541.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.469219.log 2023-07-06T02:41:08.510 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.817541.log.gz 2023-07-06T02:41:08.510 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.187565.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.187565.log.gz 2023-07-06T02:41:08.511 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.217711.log 2023-07-06T02:41:08.511 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.469219.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.671222.log 2023-07-06T02:41:08.511 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.469219.log.gz 2023-07-06T02:41:08.511 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.217711.log: 0.0%gzip -- replaced with /var/log/ceph/ceph-client.admin.217711.log.gz-5 2023-07-06T02:41:08.511 INFO:teuthology.orchestra.run.smithi046.stderr:--verbose -- /var/log/ceph/ceph-client.admin.363980.log 2023-07-06T02:41:08.512 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.671222.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.246254.log 2023-07-06T02:41:08.512 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.671222.log.gz 2023-07-06T02:41:08.512 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.363980.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.113327.log 2023-07-06T02:41:08.512 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.363980.log.gz 2023-07-06T02:41:08.513 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.246254.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.207951.log 2023-07-06T02:41:08.513 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.246254.log.gz 2023-07-06T02:41:08.513 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.113327.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.278229.log 2023-07-06T02:41:08.513 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.207951.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.666761.log 2023-07-06T02:41:08.513 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.207951.log.gz 2023-07-06T02:41:08.514 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.278229.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.361710.log 2023-07-06T02:41:08.514 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.278229.log.gz 2023-07-06T02:41:08.514 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.666761.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.359267.log 2023-07-06T02:41:08.514 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.666761.log.gz 2023-07-06T02:41:08.514 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.361710.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.792544.log 2023-07-06T02:41:08.515 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.361710.log.gz 2023-07-06T02:41:08.515 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.359267.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.359267.log.gz 2023-07-06T02:41:08.515 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.336796.log 2023-07-06T02:41:08.515 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.389338.log 2023-07-06T02:41:08.516 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.792544.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.792544.log.gz 2023-07-06T02:41:08.516 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.336796.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.336796.log.gz 2023-07-06T02:41:08.516 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.154521.log 2023-07-06T02:41:08.516 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.238688.log 2023-07-06T02:41:08.516 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.389338.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.389338.log.gz 2023-07-06T02:41:08.517 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.154521.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.154521.log.gz 2023-07-06T02:41:08.517 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.171796.log 2023-07-06T02:41:08.517 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.207569.log 2023-07-06T02:41:08.517 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.238688.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.238688.log.gz 2023-07-06T02:41:08.517 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.171796.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.648418.log 2023-07-06T02:41:08.518 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.171796.log.gz 2023-07-06T02:41:08.518 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.107709.log 2023-07-06T02:41:08.518 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.207569.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.207569.log.gz 2023-07-06T02:41:08.518 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.648418.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.671129.log 2023-07-06T02:41:08.518 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.648418.log.gz 2023-07-06T02:41:08.519 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.338110.log 2023-07-06T02:41:08.519 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.107709.log: /var/log/ceph/ceph-client.admin.671129.log: gzip -5 0.0%--verbose -- -- replaced with /var/log/ceph/ceph-client.admin.671129.log.gz/var/log/ceph/ceph-client.admin.353741.log 2023-07-06T02:41:08.519 INFO:teuthology.orchestra.run.smithi046.stderr: 2023-07-06T02:41:08.519 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.112344.log 2023-07-06T02:41:08.519 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.338110.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.338110.log.gz 2023-07-06T02:41:08.520 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.353741.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.700585.log 2023-07-06T02:41:08.520 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.353741.log.gz 2023-07-06T02:41:08.520 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.112344.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.796364.log 2023-07-06T02:41:08.520 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.347301.log 2023-07-06T02:41:08.521 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.700585.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.700585.log.gz 2023-07-06T02:41:08.521 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.796364.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.412087.log 2023-07-06T02:41:08.521 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.796364.log.gz 2023-07-06T02:41:08.521 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.347301.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.219364.log 2023-07-06T02:41:08.521 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.347301.log.gz 2023-07-06T02:41:08.522 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.810173.log 2023-07-06T02:41:08.522 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.412087.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.412087.log.gz 2023-07-06T02:41:08.522 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.219364.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.801002.log 2023-07-06T02:41:08.522 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.219364.log.gz 2023-07-06T02:41:08.522 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.810173.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.790256.log 2023-07-06T02:41:08.523 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.810173.log.gz 2023-07-06T02:41:08.523 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.314261.log 2023-07-06T02:41:08.523 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.801002.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.801002.log.gz 2023-07-06T02:41:08.523 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.790256.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.407409.log 2023-07-06T02:41:08.523 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.790256.log.gz 2023-07-06T02:41:08.524 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.314261.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.246603.log 2023-07-06T02:41:08.524 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.314261.log.gz 2023-07-06T02:41:08.524 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.654547.log 2023-07-06T02:41:08.524 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.407409.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.407409.log.gz 2023-07-06T02:41:08.524 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.246603.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.695594.log 2023-07-06T02:41:08.525 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.246603.log.gz 2023-07-06T02:41:08.525 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.654547.log: 94.1% -- replaced with /var/log/ceph/ceph-mds.a.log.gz 2023-07-06T02:41:08.525 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.406013.log 2023-07-06T02:41:08.525 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.654547.log.gz 2023-07-06T02:41:08.525 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.198667.log 2023-07-06T02:41:08.526 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.695594.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.695594.log.gz 2023-07-06T02:41:08.526 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.406013.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.613908.log 2023-07-06T02:41:08.526 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.406013.log.gz 2023-07-06T02:41:08.526 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.198667.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.303020.log 2023-07-06T02:41:08.527 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.198667.log.gz 2023-07-06T02:41:08.527 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.613908.log: gzip -5 --verbose 0.0%-- -- replaced with /var/log/ceph/ceph-client.admin.613908.log.gz/var/log/ceph/ceph-client.admin.793272.log 2023-07-06T02:41:08.527 INFO:teuthology.orchestra.run.smithi046.stderr: 2023-07-06T02:41:08.527 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.303020.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.239640.log 2023-07-06T02:41:08.527 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.303020.log.gz 2023-07-06T02:41:08.528 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.793272.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.793272.log.gz 2023-07-06T02:41:08.528 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.379200.log 2023-07-06T02:41:08.528 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.239640.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.668210.log 2023-07-06T02:41:08.528 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.239640.log.gz 2023-07-06T02:41:08.528 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.379200.log: 0.0%gzip -- replaced with /var/log/ceph/ceph-client.admin.379200.log.gz-5 2023-07-06T02:41:08.529 INFO:teuthology.orchestra.run.smithi046.stderr:--verbose -- /var/log/ceph/ceph-client.admin.663338.log 2023-07-06T02:41:08.529 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.668210.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.414748.log 2023-07-06T02:41:08.529 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.668210.log.gz 2023-07-06T02:41:08.529 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.663338.log: gzip -5 --verbose 0.0%-- /var/log/ceph/ceph-client.admin.774911.log -- replaced with /var/log/ceph/ceph-client.admin.663338.log.gz 2023-07-06T02:41:08.530 INFO:teuthology.orchestra.run.smithi046.stderr: 2023-07-06T02:41:08.530 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.414748.log: 0.0%gzip -5 -- replaced with /var/log/ceph/ceph-client.admin.414748.log.gz--verbose 2023-07-06T02:41:08.530 INFO:teuthology.orchestra.run.smithi046.stderr:-- /var/log/ceph/ceph-client.admin.245958.log 2023-07-06T02:41:08.530 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.774911.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.774911.log.gz 2023-07-06T02:41:08.531 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.932331.log 2023-07-06T02:41:08.531 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.245958.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.156510.log 2023-07-06T02:41:08.531 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.245958.log.gz 2023-07-06T02:41:08.531 INFO:teuthology.orchestra.run.smithi046.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.113691.log.gz 2023-07-06T02:41:08.531 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.683860.log 2023-07-06T02:41:08.532 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.932331.log: /var/log/ceph/ceph-client.admin.156510.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.303950.log 2023-07-06T02:41:08.532 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% 88.3% -- replaced with /var/log/ceph/ceph-client.admin.156510.log.gz 2023-07-06T02:41:08.532 INFO:teuthology.orchestra.run.smithi046.stderr: -- replaced with /var/log/ceph/ceph-client.admin.932331.log.gz 2023-07-06T02:41:08.532 INFO:teuthology.orchestra.run.smithi046.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.109156.log.gz 2023-07-06T02:41:08.532 INFO:teuthology.orchestra.run.smithi046.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.106822.log.gz 2023-07-06T02:41:08.533 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.683860.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.693835.log 2023-07-06T02:41:08.533 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.683860.log.gz 2023-07-06T02:41:08.533 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.258128.log 2023-07-06T02:41:08.533 INFO:teuthology.orchestra.run.smithi046.stderr: 87.6%/var/log/ceph/ceph-client.admin.303950.log: -- replaced with /var/log/ceph/ceph-client.admin.113327.log.gz 2023-07-06T02:41:08.534 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.303950.log.gz 2023-07-06T02:41:08.534 INFO:teuthology.orchestra.run.smithi046.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.115481.log.gz 2023-07-06T02:41:08.534 INFO:teuthology.orchestra.run.smithi046.stderr: 88.7%/var/log/ceph/ceph-client.admin.693835.log: -- replaced with /var/log/ceph/ceph-client.admin.112344.log.gz 2023-07-06T02:41:08.534 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.795321.log 2023-07-06T02:41:08.534 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.693835.log.gz 2023-07-06T02:41:08.535 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.258128.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.107709.log.gz 2023-07-06T02:41:08.535 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.808250.log 2023-07-06T02:41:08.535 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.258128.log.gz 2023-07-06T02:41:08.535 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.795321.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.406510.log 2023-07-06T02:41:08.535 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.795321.log.gz 2023-07-06T02:41:08.536 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.808250.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.808250.log.gz 2023-07-06T02:41:08.536 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.110536.log 2023-07-06T02:41:08.536 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.406510.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.672420.log 2023-07-06T02:41:08.536 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.406510.log.gz 2023-07-06T02:41:08.537 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.110536.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.671684.log 2023-07-06T02:41:08.537 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.672420.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.242965.log 2023-07-06T02:41:08.537 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.672420.log.gz 2023-07-06T02:41:08.537 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.671684.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.370911.log 2023-07-06T02:41:08.537 INFO:teuthology.orchestra.run.smithi046.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.110536.log.gz 2023-07-06T02:41:08.538 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.671684.log.gz 2023-07-06T02:41:08.538 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.242965.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.337800.log 2023-07-06T02:41:08.538 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.242965.log.gz 2023-07-06T02:41:08.538 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.370911.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.687091.log 2023-07-06T02:41:08.538 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.370911.log.gz 2023-07-06T02:41:08.539 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.337800.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.664792.log 2023-07-06T02:41:08.539 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.337800.log.gz 2023-07-06T02:41:08.539 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.687091.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.154996.log 2023-07-06T02:41:08.539 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.687091.log.gz 2023-07-06T02:41:08.539 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.664792.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.771048.log 2023-07-06T02:41:08.540 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.664792.log.gz 2023-07-06T02:41:08.540 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.154996.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.280162.log 2023-07-06T02:41:08.540 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.154996.log.gz 2023-07-06T02:41:08.540 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.771048.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.253284.log 2023-07-06T02:41:08.541 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.771048.log.gz 2023-07-06T02:41:08.541 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.280162.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.632448.log 2023-07-06T02:41:08.541 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.280162.log.gz 2023-07-06T02:41:08.541 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.253284.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.266079.log 2023-07-06T02:41:08.541 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.253284.log.gz 2023-07-06T02:41:08.542 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.632448.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.281144.log 2023-07-06T02:41:08.542 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.632448.log.gz 2023-07-06T02:41:08.542 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.266079.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.325434.log 2023-07-06T02:41:08.542 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.266079.log.gz 2023-07-06T02:41:08.542 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.281144.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.108305.log 2023-07-06T02:41:08.543 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.281144.log.gz 2023-07-06T02:41:08.543 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.325434.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.812688.log 2023-07-06T02:41:08.543 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.325434.log.gz 2023-07-06T02:41:08.543 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.108305.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.704374.log 2023-07-06T02:41:08.543 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.812688.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.279750.log 2023-07-06T02:41:08.544 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.812688.log.gz 2023-07-06T02:41:08.544 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.704374.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.376127.log 2023-07-06T02:41:08.544 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.704374.log.gz 2023-07-06T02:41:08.544 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.279750.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.931215.log 2023-07-06T02:41:08.545 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.279750.log.gz 2023-07-06T02:41:08.545 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.376127.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.651087.log 2023-07-06T02:41:08.545 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.376127.log.gz 2023-07-06T02:41:08.546 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.931215.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.286514.log 2023-07-06T02:41:08.546 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.651087.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.931215.log.gz 2023-07-06T02:41:08.546 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.651087.log.gz 2023-07-06T02:41:08.546 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.324369.log 2023-07-06T02:41:08.546 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.402947.log 2023-07-06T02:41:08.547 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.286514.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.286514.log.gz 2023-07-06T02:41:08.547 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.324369.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.211662.log 2023-07-06T02:41:08.547 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.324369.log.gz 2023-07-06T02:41:08.547 INFO:teuthology.orchestra.run.smithi046.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.108305.log.gz 2023-07-06T02:41:08.547 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.402947.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.303006.log 2023-07-06T02:41:08.548 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.402947.log.gz 2023-07-06T02:41:08.548 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.211662.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.340680.log 2023-07-06T02:41:08.548 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.211662.log.gz 2023-07-06T02:41:08.548 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.346729.log 2023-07-06T02:41:08.549 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.303006.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.303006.log.gz 2023-07-06T02:41:08.549 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.340680.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.676037.log 2023-07-06T02:41:08.549 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.340680.log.gz 2023-07-06T02:41:08.549 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.346729.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.629060.log 2023-07-06T02:41:08.550 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.346729.log.gz 2023-07-06T02:41:08.550 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.312374.log 2023-07-06T02:41:08.550 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.676037.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.676037.log.gz 2023-07-06T02:41:08.550 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.629060.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.304930.log 2023-07-06T02:41:08.550 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.629060.log.gz 2023-07-06T02:41:08.551 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.312374.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.314354.log 2023-07-06T02:41:08.551 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.312374.log.gz 2023-07-06T02:41:08.551 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.700089.log 2023-07-06T02:41:08.551 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.304930.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.304930.log.gz 2023-07-06T02:41:08.551 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.314354.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.417208.log 2023-07-06T02:41:08.552 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.314354.log.gz 2023-07-06T02:41:08.552 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.700089.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.154442.log 2023-07-06T02:41:08.552 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.700089.log.gz 2023-07-06T02:41:08.552 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.221224.log 2023-07-06T02:41:08.553 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.417208.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.417208.log.gz 2023-07-06T02:41:08.553 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.154442.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.247094.log 2023-07-06T02:41:08.553 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.154442.log.gz 2023-07-06T02:41:08.553 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.221224.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.466663.log 2023-07-06T02:41:08.554 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.221224.log.gz 2023-07-06T02:41:08.554 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.247094.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.619815.log 2023-07-06T02:41:08.554 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.247094.log.gz 2023-07-06T02:41:08.554 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.173214.log 2023-07-06T02:41:08.554 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.466663.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.466663.log.gz 2023-07-06T02:41:08.555 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.619815.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.157987.log 2023-07-06T02:41:08.555 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.619815.log.gz 2023-07-06T02:41:08.555 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.173214.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.275129.log 2023-07-06T02:41:08.555 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.173214.log.gz 2023-07-06T02:41:08.556 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.672739.log 2023-07-06T02:41:08.556 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.157987.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.157987.log.gz 2023-07-06T02:41:08.556 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.275129.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.286715.log 2023-07-06T02:41:08.556 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.275129.log.gz 2023-07-06T02:41:08.556 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.672739.log: gzip -5 0.0%--verbose -- replaced with /var/log/ceph/ceph-client.admin.672739.log.gz-- 2023-07-06T02:41:08.557 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.399577.log 2023-07-06T02:41:08.557 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.401044.log 2023-07-06T02:41:08.557 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.286715.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.286715.log.gz 2023-07-06T02:41:08.557 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.399577.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.342436.log 2023-07-06T02:41:08.558 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.399577.log.gz 2023-07-06T02:41:08.558 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.401044.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.342733.log 2023-07-06T02:41:08.558 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.401044.log.gz 2023-07-06T02:41:08.558 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.155557.log 2023-07-06T02:41:08.558 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.342436.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.342436.log.gz 2023-07-06T02:41:08.559 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.342733.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.790781.log 2023-07-06T02:41:08.559 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.342733.log.gz 2023-07-06T02:41:08.559 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.155557.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.648572.log 2023-07-06T02:41:08.559 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.155557.log.gz 2023-07-06T02:41:08.559 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.790781.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.271033.log 2023-07-06T02:41:08.560 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.790781.log.gz 2023-07-06T02:41:08.560 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.648572.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.675944.log 2023-07-06T02:41:08.560 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.648572.log.gz 2023-07-06T02:41:08.560 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.271033.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.439048.log 2023-07-06T02:41:08.560 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.271033.log.gz 2023-07-06T02:41:08.561 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.675944.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.627430.log 2023-07-06T02:41:08.561 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.675944.log.gz 2023-07-06T02:41:08.561 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.439048.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.396829.log 2023-07-06T02:41:08.561 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.439048.log.gz 2023-07-06T02:41:08.561 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.627430.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.239166.log 2023-07-06T02:41:08.562 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.627430.log.gz 2023-07-06T02:41:08.562 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.396829.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.156589.log 2023-07-06T02:41:08.562 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.396829.log.gz 2023-07-06T02:41:08.562 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.239166.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.663569.log 2023-07-06T02:41:08.562 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.239166.log.gz 2023-07-06T02:41:08.563 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.156589.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.208973.log 2023-07-06T02:41:08.563 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.156589.log.gz 2023-07-06T02:41:08.563 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.614635.log 2023-07-06T02:41:08.563 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.663569.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.663569.log.gz 2023-07-06T02:41:08.563 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.208973.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.338901.log 2023-07-06T02:41:08.564 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.208973.log.gz 2023-07-06T02:41:08.564 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.614635.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.801296.log 2023-07-06T02:41:08.564 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.614635.log.gz 2023-07-06T02:41:08.564 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.199634.log 2023-07-06T02:41:08.564 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.338901.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.338901.log.gz 2023-07-06T02:41:08.565 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.801296.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.392083.log 2023-07-06T02:41:08.565 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.801296.log.gz 2023-07-06T02:41:08.565 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.199634.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.790767.log 2023-07-06T02:41:08.565 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.199634.log.gz 2023-07-06T02:41:08.565 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.253610.log 2023-07-06T02:41:08.566 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.392083.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.392083.log.gz 2023-07-06T02:41:08.566 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.790767.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.200108.log 2023-07-06T02:41:08.566 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.790767.log.gz 2023-07-06T02:41:08.566 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.253610.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.114925.log 2023-07-06T02:41:08.566 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.253610.log.gz 2023-07-06T02:41:08.567 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.114833.log 2023-07-06T02:41:08.567 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.200108.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.200108.log.gz 2023-07-06T02:41:08.567 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.114925.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.416840.log 2023-07-06T02:41:08.567 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.295002.log 2023-07-06T02:41:08.568 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.114833.log: /var/log/ceph/ceph-client.admin.416840.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.385885.log 2023-07-06T02:41:08.568 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.416840.log.gz 2023-07-06T02:41:08.568 INFO:teuthology.orchestra.run.smithi046.stderr: 88.8% -- replaced with /var/log/ceph/ceph.audit.log.gz 2023-07-06T02:41:08.568 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.271236.log 2023-07-06T02:41:08.568 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.295002.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.295002.log.gz 2023-07-06T02:41:08.569 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.385885.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.385076.log 2023-07-06T02:41:08.569 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.385885.log.gz 2023-07-06T02:41:08.569 INFO:teuthology.orchestra.run.smithi046.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.114925.log.gz 2023-07-06T02:41:08.569 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.271236.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.463774.log 2023-07-06T02:41:08.569 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.271236.log.gz 2023-07-06T02:41:08.570 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.385076.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.679576.log 2023-07-06T02:41:08.570 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.385076.log.gz 2023-07-06T02:41:08.570 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.463774.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.684824.log 2023-07-06T02:41:08.570 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.463774.log.gz 2023-07-06T02:41:08.570 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.170096.log 2023-07-06T02:41:08.571 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.679576.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.679576.log.gz 2023-07-06T02:41:08.571 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.684824.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.273813.log 2023-07-06T02:41:08.571 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.684824.log.gz 2023-07-06T02:41:08.571 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.170096.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.170096.log.gz 2023-07-06T02:41:08.571 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.773470.log 2023-07-06T02:41:08.572 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.362733.log 2023-07-06T02:41:08.572 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.273813.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.273813.log.gz 2023-07-06T02:41:08.572 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.773470.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.773470.log.gz 2023-07-06T02:41:08.573 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.108625.log 2023-07-06T02:41:08.573 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.634245.log 2023-07-06T02:41:08.573 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.362733.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.362733.log.gz 2023-07-06T02:41:08.573 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.108625.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.158001.log 2023-07-06T02:41:08.573 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.634245.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.166776.log 2023-07-06T02:41:08.574 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.634245.log.gz 2023-07-06T02:41:08.574 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.158001.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.791493.log 2023-07-06T02:41:08.574 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.158001.log.gz 2023-07-06T02:41:08.574 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.273071.log 2023-07-06T02:41:08.574 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.166776.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.166776.log.gz 2023-07-06T02:41:08.575 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.791493.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.924726.log 2023-07-06T02:41:08.575 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.791493.log.gz 2023-07-06T02:41:08.575 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.273071.log: gzip 0.0%-5 -- replaced with /var/log/ceph/ceph-client.admin.273071.log.gz--verbose 2023-07-06T02:41:08.575 INFO:teuthology.orchestra.run.smithi046.stderr:-- /var/log/ceph/ceph-client.admin.638462.log 2023-07-06T02:41:08.576 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.792083.log 2023-07-06T02:41:08.576 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.924726.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.924726.log.gz 2023-07-06T02:41:08.576 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.638462.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.932914.log 2023-07-06T02:41:08.576 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.638462.log.gz 2023-07-06T02:41:08.576 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.792083.log: gzip 0.0%-5 -- replaced with /var/log/ceph/ceph-client.admin.792083.log.gz--verbose 2023-07-06T02:41:08.577 INFO:teuthology.orchestra.run.smithi046.stderr:-- /var/log/ceph/ceph-client.admin.395663.log 2023-07-06T02:41:08.577 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.109110.log 2023-07-06T02:41:08.577 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.932914.log: /var/log/ceph/ceph-client.admin.395663.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.409035.log 2023-07-06T02:41:08.577 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% 88.0% -- replaced with /var/log/ceph/ceph-client.admin.395663.log.gz -- replaced with /var/log/ceph/ceph-client.admin.932914.log.gz 2023-07-06T02:41:08.577 INFO:teuthology.orchestra.run.smithi046.stderr: 2023-07-06T02:41:08.578 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.109110.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.370990.log 2023-07-06T02:41:08.578 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.595379.log 2023-07-06T02:41:08.578 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.409035.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.409035.log.gz 2023-07-06T02:41:08.578 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.370990.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.615206.log 2023-07-06T02:41:08.579 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.370990.log.gz 2023-07-06T02:41:08.579 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.595379.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.926172.log 2023-07-06T02:41:08.579 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.595379.log.gz 2023-07-06T02:41:08.579 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.114381.log 2023-07-06T02:41:08.579 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.615206.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.615206.log.gz 2023-07-06T02:41:08.580 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.926172.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.678796.log 2023-07-06T02:41:08.580 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.926172.log.gz 2023-07-06T02:41:08.580 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.114381.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.326746.log 2023-07-06T02:41:08.580 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.678796.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.329437.log 2023-07-06T02:41:08.580 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.678796.log.gz 2023-07-06T02:41:08.581 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.326746.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.249068.log 2023-07-06T02:41:08.581 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.326746.log.gz 2023-07-06T02:41:08.581 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.329437.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.637470.log 2023-07-06T02:41:08.581 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.329437.log.gz 2023-07-06T02:41:08.581 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.249068.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.107295.log 2023-07-06T02:41:08.582 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.249068.log.gz 2023-07-06T02:41:08.582 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.637470.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.637470.log.gz 2023-07-06T02:41:08.582 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.678563.log 2023-07-06T02:41:08.582 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.107295.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.773930.log 2023-07-06T02:41:08.582 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.920384.log 2023-07-06T02:41:08.583 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.678563.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.678563.log.gz 2023-07-06T02:41:08.583 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.773930.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.773930.log.gz 2023-07-06T02:41:08.583 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.206610.log 2023-07-06T02:41:08.583 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.920384.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.621707.log 2023-07-06T02:41:08.583 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.920384.log.gz 2023-07-06T02:41:08.584 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.206610.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.218501.log 2023-07-06T02:41:08.584 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.206610.log.gz 2023-07-06T02:41:08.584 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.621707.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.767448.log 2023-07-06T02:41:08.584 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.621707.log.gz 2023-07-06T02:41:08.585 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.218501.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.333158.log 2023-07-06T02:41:08.585 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.218501.log.gz 2023-07-06T02:41:08.585 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.767448.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.688625.log 2023-07-06T02:41:08.585 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.767448.log.gz 2023-07-06T02:41:08.585 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.333158.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.206517.log 2023-07-06T02:41:08.586 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.333158.log.gz 2023-07-06T02:41:08.586 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.688625.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.674542.log 2023-07-06T02:41:08.586 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.688625.log.gz 2023-07-06T02:41:08.586 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.337879.log 2023-07-06T02:41:08.586 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.206517.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.206517.log.gz 2023-07-06T02:41:08.587 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.674542.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.801810.log 2023-07-06T02:41:08.587 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.674542.log.gz 2023-07-06T02:41:08.587 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.337879.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.337879.log.gz 2023-07-06T02:41:08.587 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.648710.log 2023-07-06T02:41:08.587 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.801810.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.113967.log 2023-07-06T02:41:08.588 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.801810.log.gz 2023-07-06T02:41:08.588 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.648710.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.308731.log 2023-07-06T02:41:08.588 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.648710.log.gz 2023-07-06T02:41:08.588 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.113967.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.258207.log 2023-07-06T02:41:08.588 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.308731.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.679590.log 2023-07-06T02:41:08.589 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.308731.log.gz 2023-07-06T02:41:08.589 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.258207.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.348126.log 2023-07-06T02:41:08.589 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.258207.log.gz 2023-07-06T02:41:08.589 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.679590.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.688718.log 2023-07-06T02:41:08.589 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.679590.log.gz 2023-07-06T02:41:08.590 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.348126.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.612198.log 2023-07-06T02:41:08.590 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.348126.log.gz 2023-07-06T02:41:08.590 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.688718.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.199160.log 2023-07-06T02:41:08.590 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.688718.log.gz 2023-07-06T02:41:08.591 INFO:teuthology.orchestra.run.smithi046.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.114833.log.gz 2023-07-06T02:41:08.591 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.612198.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.612198.log.gz 2023-07-06T02:41:08.591 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.115573.log 2023-07-06T02:41:08.591 INFO:teuthology.orchestra.run.smithi046.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.108625.log.gz 2023-07-06T02:41:08.591 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.199160.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.277637.log 2023-07-06T02:41:08.592 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.199160.log.gz 2023-07-06T02:41:08.592 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.626019.log 2023-07-06T02:41:08.592 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.115573.log: /var/log/ceph/ceph-client.admin.277637.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.339844.log 2023-07-06T02:41:08.592 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.277637.log.gz 2023-07-06T02:41:08.592 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.626019.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.770657.log 2023-07-06T02:41:08.593 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.626019.log.gz 2023-07-06T02:41:08.593 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.339844.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.381058.log 2023-07-06T02:41:08.593 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.339844.log.gz 2023-07-06T02:41:08.593 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.770657.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.109578.log 2023-07-06T02:41:08.594 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.770657.log.gz 2023-07-06T02:41:08.594 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.381058.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.702997.log 2023-07-06T02:41:08.594 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.381058.log.gz 2023-07-06T02:41:08.594 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.109578.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.243377.log 2023-07-06T02:41:08.594 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.702997.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.270093.log 2023-07-06T02:41:08.595 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.702997.log.gz 2023-07-06T02:41:08.595 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.243377.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.654156.log 2023-07-06T02:41:08.595 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.243377.log.gz 2023-07-06T02:41:08.595 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.270093.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.754575.log 2023-07-06T02:41:08.595 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.270093.log.gz 2023-07-06T02:41:08.596 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.654156.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.327793.log 2023-07-06T02:41:08.596 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.654156.log.gz 2023-07-06T02:41:08.596 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.754575.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.397109.log 2023-07-06T02:41:08.596 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.754575.log.gz 2023-07-06T02:41:08.596 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.327793.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.686291.log 2023-07-06T02:41:08.597 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.327793.log.gz 2023-07-06T02:41:08.597 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.397109.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.397109.log.gz 2023-07-06T02:41:08.597 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.317064.log 2023-07-06T02:41:08.597 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.686291.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.758557.log 2023-07-06T02:41:08.598 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.686291.log.gz 2023-07-06T02:41:08.598 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.317064.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.806471.log 2023-07-06T02:41:08.598 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.317064.log.gz 2023-07-06T02:41:08.598 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.366550.log 2023-07-06T02:41:08.598 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.758557.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.758557.log.gz 2023-07-06T02:41:08.599 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.806471.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.804528.log 2023-07-06T02:41:08.599 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.806471.log.gz 2023-07-06T02:41:08.599 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.366550.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.696073.log 0.0% 2023-07-06T02:41:08.599 INFO:teuthology.orchestra.run.smithi046.stderr: -- replaced with /var/log/ceph/ceph-client.admin.366550.log.gz 2023-07-06T02:41:08.599 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.468432.log 2023-07-06T02:41:08.600 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.804528.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.804528.log.gz 2023-07-06T02:41:08.600 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.696073.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.379214.log 2023-07-06T02:41:08.600 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.696073.log.gz 2023-07-06T02:41:08.600 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.468432.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.333079.log 2023-07-06T02:41:08.601 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.468432.log.gz 2023-07-06T02:41:08.601 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.173683.log 2023-07-06T02:41:08.601 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.379214.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.379214.log.gz 2023-07-06T02:41:08.601 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.333079.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.652092.log 2023-07-06T02:41:08.601 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.333079.log.gz 2023-07-06T02:41:08.602 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.173683.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.239626.log 2023-07-06T02:41:08.602 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.173683.log.gz 2023-07-06T02:41:08.602 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.109294.log 2023-07-06T02:41:08.602 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.652092.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.652092.log.gz 2023-07-06T02:41:08.602 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.293485.log /var/log/ceph/ceph-client.admin.239626.log: 2023-07-06T02:41:08.603 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.239626.log.gz 2023-07-06T02:41:08.603 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.109294.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.463481.log 2023-07-06T02:41:08.603 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.633873.log 2023-07-06T02:41:08.603 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.293485.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.293485.log.gz 2023-07-06T02:41:08.603 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.463481.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.374477.log 2023-07-06T02:41:08.604 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.463481.log.gz 2023-07-06T02:41:08.604 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.633873.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.189623.log 2023-07-06T02:41:08.604 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.633873.log.gz 2023-07-06T02:41:08.604 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.469233.log 2023-07-06T02:41:08.604 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.374477.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.374477.log.gz 2023-07-06T02:41:08.605 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.189623.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.303487.log 2023-07-06T02:41:08.605 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.189623.log.gz 2023-07-06T02:41:08.605 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.469233.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.469233.log.gz 2023-07-06T02:41:08.605 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.467944.log 2023-07-06T02:41:08.605 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.407502.log 2023-07-06T02:41:08.606 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.303487.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.303487.log.gz 2023-07-06T02:41:08.606 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.467944.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.358345.log 2023-07-06T02:41:08.606 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.467944.log.gz 2023-07-06T02:41:08.606 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.407502.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.321527.log 0.0% 2023-07-06T02:41:08.607 INFO:teuthology.orchestra.run.smithi046.stderr: -- replaced with /var/log/ceph/ceph-client.admin.407502.log.gz 2023-07-06T02:41:08.607 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.696524.log 2023-07-06T02:41:08.607 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.358345.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.358345.log.gz 2023-07-06T02:41:08.607 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.321527.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.188056.log 2023-07-06T02:41:08.607 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.321527.log.gz 2023-07-06T02:41:08.608 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.696524.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.637764.log 2023-07-06T02:41:08.608 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.696524.log.gz 2023-07-06T02:41:08.608 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.113465.log 2023-07-06T02:41:08.608 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.188056.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.188056.log.gz 2023-07-06T02:41:08.608 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.637764.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.627204.log 2023-07-06T02:41:08.609 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.637764.log.gz 2023-07-06T02:41:08.609 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.113465.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.275348.log 2023-07-06T02:41:08.609 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.304433.log 2023-07-06T02:41:08.609 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.627204.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.627204.log.gz 2023-07-06T02:41:08.609 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.275348.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.275348.log.gz 2023-07-06T02:41:08.610 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.797090.log 2023-07-06T02:41:08.610 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.194155.log 2023-07-06T02:41:08.610 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.304433.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.304433.log.gz 2023-07-06T02:41:08.610 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.797090.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.797090.log.gz 2023-07-06T02:41:08.611 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.109248.log 2023-07-06T02:41:08.611 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 /var/log/ceph/ceph-client.admin.194155.log: --verbose -- /var/log/ceph/ceph-client.admin.620293.log 2023-07-06T02:41:08.611 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.194155.log.gz 2023-07-06T02:41:08.611 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.109248.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.271451.log 2023-07-06T02:41:08.611 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.620293.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.620293.log.gz 2023-07-06T02:41:08.612 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.649989.log 2023-07-06T02:41:08.612 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.286794.log 2023-07-06T02:41:08.612 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.271451.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.271451.log.gz 2023-07-06T02:41:08.612 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.649989.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.675088.log 2023-07-06T02:41:08.612 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.649989.log.gz 2023-07-06T02:41:08.613 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.286794.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.673695.log 2023-07-06T02:41:08.613 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.286794.log.gz 2023-07-06T02:41:08.613 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.380145.log 2023-07-06T02:41:08.613 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.675088.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.675088.log.gz 2023-07-06T02:41:08.613 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.673695.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.673695.log.gz 2023-07-06T02:41:08.614 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.627939.log 2023-07-06T02:41:08.614 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.394274.log 2023-07-06T02:41:08.614 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.380145.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.380145.log.gz 2023-07-06T02:41:08.614 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.627939.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.922316.log 2023-07-06T02:41:08.615 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.627939.log.gz 2023-07-06T02:41:08.615 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.394274.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.553561.log 2023-07-06T02:41:08.615 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.394274.log.gz 2023-07-06T02:41:08.615 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.922316.log: gzip 0.0%-5 --verbose -- replaced with /var/log/ceph/ceph-client.admin.922316.log.gz-- 2023-07-06T02:41:08.615 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.309742.log 2023-07-06T02:41:08.616 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.553561.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.415293.log 2023-07-06T02:41:08.616 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.553561.log.gz 2023-07-06T02:41:08.616 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.309742.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.346217.log 2023-07-06T02:41:08.616 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.309742.log.gz 2023-07-06T02:41:08.616 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.415293.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.269597.log 2023-07-06T02:41:08.617 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.415293.log.gz 2023-07-06T02:41:08.617 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.346217.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.689693.log 2023-07-06T02:41:08.617 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.346217.log.gz 2023-07-06T02:41:08.617 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.269597.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.319491.log 2023-07-06T02:41:08.618 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.269597.log.gz 2023-07-06T02:41:08.618 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.689693.log: gzip 0.0%-5 --verbose -- replaced with /var/log/ceph/ceph-client.admin.689693.log.gz-- 2023-07-06T02:41:08.618 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.932423.log 2023-07-06T02:41:08.618 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.319491.log: /var/log/ceph/ceph-client.admin.805981.log 2023-07-06T02:41:08.618 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.319491.log.gz 2023-07-06T02:41:08.619 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.932423.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.665303.log 2023-07-06T02:41:08.619 INFO:teuthology.orchestra.run.smithi046.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.932423.log.gz 2023-07-06T02:41:08.619 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.805981.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.275587.log 2023-07-06T02:41:08.619 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.805981.log.gz 2023-07-06T02:41:08.619 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose /var/log/ceph/ceph-client.admin.665303.log: -- /var/log/ceph/ceph-client.admin.324663.log 2023-07-06T02:41:08.620 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.665303.log.gz 2023-07-06T02:41:08.620 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.275587.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.343506.log 2023-07-06T02:41:08.620 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.275587.log.gz 2023-07-06T02:41:08.620 INFO:teuthology.orchestra.run.smithi046.stderr:gzip /var/log/ceph/ceph-client.admin.324663.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.816100.log 2023-07-06T02:41:08.621 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.324663.log.gz 2023-07-06T02:41:08.621 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.343506.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.921271.log 2023-07-06T02:41:08.621 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.343506.log.gz 2023-07-06T02:41:08.621 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.816100.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.191098.log 2023-07-06T02:41:08.621 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.816100.log.gz 2023-07-06T02:41:08.622 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.921271.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.404884.log 2023-07-06T02:41:08.622 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.921271.log.gz 2023-07-06T02:41:08.622 INFO:teuthology.orchestra.run.smithi046.stderr:gzip /var/log/ceph/ceph-client.admin.191098.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.240169.log 2023-07-06T02:41:08.622 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.191098.log.gz 2023-07-06T02:41:08.623 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.404884.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.160346.log 2023-07-06T02:41:08.623 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.404884.log.gz 2023-07-06T02:41:08.623 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.172270.log 2023-07-06T02:41:08.623 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.240169.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.240169.log.gz 2023-07-06T02:41:08.623 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.160346.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.648480.log 2023-07-06T02:41:08.624 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.160346.log.gz 2023-07-06T02:41:08.624 INFO:teuthology.orchestra.run.smithi046.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.109110.log.gz 2023-07-06T02:41:08.624 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.172270.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.774341.log 2023-07-06T02:41:08.624 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.172270.log.gz 2023-07-06T02:41:08.624 INFO:teuthology.orchestra.run.smithi046.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.107295.log.gz 2023-07-06T02:41:08.625 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.648480.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.372963.log 2023-07-06T02:41:08.625 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.648480.log.gz 2023-07-06T02:41:08.625 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.774341.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.774341.log.gz 2023-07-06T02:41:08.625 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.311344.log 2023-07-06T02:41:08.625 INFO:teuthology.orchestra.run.smithi046.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.114381.log.gz 2023-07-06T02:41:08.626 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.684261.log 2023-07-06T02:41:08.626 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.372963.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.372963.log.gz 2023-07-06T02:41:08.626 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.311344.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.340902.log 2023-07-06T02:41:08.626 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.311344.log.gz 2023-07-06T02:41:08.626 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.684261.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.624593.log 2023-07-06T02:41:08.627 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.684261.log.gz 2023-07-06T02:41:08.627 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.755080.log 2023-07-06T02:41:08.627 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.340902.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.340902.log.gz 2023-07-06T02:41:08.627 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.624593.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.753011.log 2023-07-06T02:41:08.628 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.624593.log.gz 2023-07-06T02:41:08.628 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.755080.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.755080.log.gz 2023-07-06T02:41:08.628 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.282223.log 2023-07-06T02:41:08.628 INFO:teuthology.orchestra.run.smithi046.stderr:gzip /var/log/ceph/ceph-client.admin.753011.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.370143.log 2023-07-06T02:41:08.629 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.753011.log.gz 2023-07-06T02:41:08.629 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.282223.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.648549.log 2023-07-06T02:41:08.629 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.282223.log.gz 2023-07-06T02:41:08.629 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.370143.log: gzip 0.0% -- replaced with /var/log/ceph/ceph-client.admin.370143.log.gz-5 2023-07-06T02:41:08.629 INFO:teuthology.orchestra.run.smithi046.stderr:--verbose -- /var/log/ceph/ceph-client.admin.336412.log 2023-07-06T02:41:08.630 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.611107.log 2023-07-06T02:41:08.630 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.648549.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.648549.log.gz 2023-07-06T02:41:08.630 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.336412.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.810560.log 2023-07-06T02:41:08.630 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.336412.log.gz 2023-07-06T02:41:08.630 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.611107.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.793580.log 2023-07-06T02:41:08.631 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.611107.log.gz 2023-07-06T02:41:08.631 INFO:teuthology.orchestra.run.smithi046.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.113967.log.gz 2023-07-06T02:41:08.631 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.810560.log: /var/log/ceph/ceph-client.admin.925208.log 2023-07-06T02:41:08.631 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.810560.log.gz 2023-07-06T02:41:08.631 INFO:teuthology.orchestra.run.smithi046.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.115573.log.gz 2023-07-06T02:41:08.632 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.793580.log: gzip -5 --verbose 0.0%-- /var/log/ceph/ceph-client.admin.797400.log -- replaced with /var/log/ceph/ceph-client.admin.793580.log.gz 2023-07-06T02:41:08.632 INFO:teuthology.orchestra.run.smithi046.stderr: 2023-07-06T02:41:08.632 INFO:teuthology.orchestra.run.smithi046.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.109578.log.gz 2023-07-06T02:41:08.632 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.925208.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.344997.log 2023-07-06T02:41:08.633 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.925208.log.gz 2023-07-06T02:41:08.633 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.797400.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.797400.log.gz 2023-07-06T02:41:08.633 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.317078.log 2023-07-06T02:41:08.633 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.636742.log 2023-07-06T02:41:08.633 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.344997.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.344997.log.gz 2023-07-06T02:41:08.634 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.317078.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.203619.log 2023-07-06T02:41:08.634 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.317078.log.gz 2023-07-06T02:41:08.634 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.636742.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.636742.log.gz 2023-07-06T02:41:08.634 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.921365.log 2023-07-06T02:41:08.634 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.300049.log 2023-07-06T02:41:08.635 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.203619.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.203619.log.gz 2023-07-06T02:41:08.635 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.921365.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.629046.log 2023-07-06T02:41:08.635 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.921365.log.gz 2023-07-06T02:41:08.635 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.300049.log: gzip 0.0%-5 -- replaced with /var/log/ceph/ceph-client.admin.300049.log.gz--verbose 2023-07-06T02:41:08.635 INFO:teuthology.orchestra.run.smithi046.stderr:-- /var/log/ceph/ceph-client.admin.923683.log 2023-07-06T02:41:08.636 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.626033.log 2023-07-06T02:41:08.636 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.629046.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.629046.log.gz 2023-07-06T02:41:08.636 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.923683.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.161798.log 2023-07-06T02:41:08.636 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.923683.log.gz 2023-07-06T02:41:08.636 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.626033.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.114335.log 2023-07-06T02:41:08.637 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.626033.log.gz 2023-07-06T02:41:08.637 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.407034.log 2023-07-06T02:41:08.637 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.161798.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.161798.log.gz 2023-07-06T02:41:08.637 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.114335.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.239864.log 2023-07-06T02:41:08.638 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.407034.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.407034.log.gz 2023-07-06T02:41:08.638 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.400093.log 2023-07-06T02:41:08.638 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.807772.log 2023-07-06T02:41:08.638 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.239864.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.239864.log.gz 2023-07-06T02:41:08.638 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.400093.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.185262.log 2023-07-06T02:41:08.639 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.400093.log.gz 2023-07-06T02:41:08.639 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.807772.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.807772.log.gz 2023-07-06T02:41:08.639 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.281237.log 2023-07-06T02:41:08.639 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.627014.log 2023-07-06T02:41:08.639 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.185262.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.185262.log.gz 2023-07-06T02:41:08.640 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.281237.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.697594.log 2023-07-06T02:41:08.640 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.281237.log.gz 2023-07-06T02:41:08.640 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.627014.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.758543.log 2023-07-06T02:41:08.640 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.627014.log.gz 2023-07-06T02:41:08.641 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.697594.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.767662.log 2023-07-06T02:41:08.641 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.697594.log.gz 2023-07-06T02:41:08.641 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.758543.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.758543.log.gz 2023-07-06T02:41:08.641 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.773024.log 2023-07-06T02:41:08.641 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.800249.log 2023-07-06T02:41:08.642 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.767662.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.767662.log.gz 2023-07-06T02:41:08.642 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.773024.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.262151.log 2023-07-06T02:41:08.642 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.773024.log.gz 2023-07-06T02:41:08.642 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.800249.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.365592.log 2023-07-06T02:41:08.642 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.800249.log.gz 2023-07-06T02:41:08.643 INFO:teuthology.orchestra.run.smithi046.stderr:gzip /var/log/ceph/ceph-client.admin.262151.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.366744.log 2023-07-06T02:41:08.643 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.262151.log.gz 2023-07-06T02:41:08.643 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.365592.log: 0.0%gzip -- replaced with /var/log/ceph/ceph-client.admin.365592.log.gz-5 2023-07-06T02:41:08.643 INFO:teuthology.orchestra.run.smithi046.stderr:--verbose -- /var/log/ceph/ceph-client.admin.253531.log 2023-07-06T02:41:08.643 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.771336.log 2023-07-06T02:41:08.644 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.366744.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.366744.log.gz 2023-07-06T02:41:08.644 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.253531.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.274525.log 2023-07-06T02:41:08.644 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.253531.log.gz 2023-07-06T02:41:08.644 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.771336.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.109294.log.gz 2023-07-06T02:41:08.644 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.171469.log 2023-07-06T02:41:08.645 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.771336.log.gz 2023-07-06T02:41:08.645 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.327262.log 2023-07-06T02:41:08.645 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.274525.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.274525.log.gz 2023-07-06T02:41:08.645 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.171469.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.767462.log 2023-07-06T02:41:08.645 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.171469.log.gz 2023-07-06T02:41:08.646 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.327262.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.633780.log 2023-07-06T02:41:08.646 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.327262.log.gz 2023-07-06T02:41:08.646 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.767462.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.628542.log 2023-07-06T02:41:08.646 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.767462.log.gz 2023-07-06T02:41:08.646 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.633780.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.649515.log 2023-07-06T02:41:08.647 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.633780.log.gz 2023-07-06T02:41:08.647 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.628542.log: gzip 0.0%-5 -- replaced with /var/log/ceph/ceph-client.admin.628542.log.gz--verbose 2023-07-06T02:41:08.647 INFO:teuthology.orchestra.run.smithi046.stderr:-- /var/log/ceph/ceph-client.admin.257634.log 2023-07-06T02:41:08.647 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.113040.log 2023-07-06T02:41:08.648 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.649515.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.649515.log.gz 2023-07-06T02:41:08.648 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.257634.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.648779.log 2023-07-06T02:41:08.648 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.257634.log.gz 2023-07-06T02:41:08.648 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.450296.log 2023-07-06T02:41:08.648 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.113040.log: /var/log/ceph/ceph-client.admin.648779.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.648779.log.gz 2023-07-06T02:41:08.649 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.267552.log 2023-07-06T02:41:08.649 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.343520.log 2023-07-06T02:41:08.649 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.450296.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.450296.log.gz 2023-07-06T02:41:08.649 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.267552.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.673231.log 2023-07-06T02:41:08.649 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.267552.log.gz 2023-07-06T02:41:08.650 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.158439.log 2023-07-06T02:41:08.650 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.343520.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.343520.log.gz 2023-07-06T02:41:08.650 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.673231.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.242452.log 2023-07-06T02:41:08.650 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.673231.log.gz 2023-07-06T02:41:08.650 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.158439.log: gzip -5 0.0%--verbose -- -- replaced with /var/log/ceph/ceph-client.admin.158439.log.gz 2023-07-06T02:41:08.651 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.813136.log 2023-07-06T02:41:08.651 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.691138.log 2023-07-06T02:41:08.651 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.242452.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.242452.log.gz 2023-07-06T02:41:08.651 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.813136.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.807758.log 2023-07-06T02:41:08.651 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.813136.log.gz 2023-07-06T02:41:08.652 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.691138.log: gzip 0.0%-5 -- replaced with /var/log/ceph/ceph-client.admin.691138.log.gz--verbose 2023-07-06T02:41:08.652 INFO:teuthology.orchestra.run.smithi046.stderr:-- /var/log/ceph/ceph-client.admin.107617.log 2023-07-06T02:41:08.652 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.110314.log 2023-07-06T02:41:08.652 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.807758.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.807758.log.gz 2023-07-06T02:41:08.652 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.107617.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.639664.log 2023-07-06T02:41:08.653 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.0.110314.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.191775.log 2023-07-06T02:41:08.653 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.0.110314.log.gz 2023-07-06T02:41:08.653 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.639664.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.405167.log 2023-07-06T02:41:08.653 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.639664.log.gz 2023-07-06T02:41:08.654 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.191775.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.817051.log 2023-07-06T02:41:08.654 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.191775.log.gz 2023-07-06T02:41:08.654 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.405167.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.397907.log 2023-07-06T02:41:08.654 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.405167.log.gz 2023-07-06T02:41:08.654 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.817051.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.364059.log 2023-07-06T02:41:08.655 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.817051.log.gz 2023-07-06T02:41:08.655 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.397907.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.109670.log 2023-07-06T02:41:08.655 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.397907.log.gz 2023-07-06T02:41:08.655 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.364059.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.362004.log 2023-07-06T02:41:08.655 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.364059.log.gz 2023-07-06T02:41:08.656 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.109670.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.189118.log 2023-07-06T02:41:08.656 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.362004.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.272276.log 2023-07-06T02:41:08.656 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.362004.log.gz 2023-07-06T02:41:08.656 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.189118.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.156979.log 2023-07-06T02:41:08.656 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.189118.log.gz 2023-07-06T02:41:08.657 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.272276.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.671208.log 2023-07-06T02:41:08.657 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.272276.log.gz 2023-07-06T02:41:08.657 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.156979.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.190607.log 2023-07-06T02:41:08.657 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.156979.log.gz 2023-07-06T02:41:08.657 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.671208.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.687676.log 2023-07-06T02:41:08.658 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.671208.log.gz 2023-07-06T02:41:08.658 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.190607.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.700978.log 2023-07-06T02:41:08.658 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.190607.log.gz 2023-07-06T02:41:08.658 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.687676.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.687676.log.gz 2023-07-06T02:41:08.658 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.262721.log 2023-07-06T02:41:08.659 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.700978.log: 0.0%gzip -- replaced with /var/log/ceph/ceph-client.admin.700978.log.gz-5 2023-07-06T02:41:08.659 INFO:teuthology.orchestra.run.smithi046.stderr:--verbose -- /var/log/ceph/ceph-client.admin.774144.log 2023-07-06T02:41:08.659 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.262721.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.613143.log 2023-07-06T02:41:08.659 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.262721.log.gz 2023-07-06T02:41:08.660 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.774144.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.774144.log.gz 2023-07-06T02:41:08.660 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.437117.log 2023-07-06T02:41:08.660 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.438091.log 2023-07-06T02:41:08.660 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.613143.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.613143.log.gz 2023-07-06T02:41:08.660 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.437117.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.448780.log 2023-07-06T02:41:08.661 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.437117.log.gz 2023-07-06T02:41:08.661 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.438091.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.438091.log.gz 2023-07-06T02:41:08.661 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.372567.log 2023-07-06T02:41:08.661 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.269105.log 2023-07-06T02:41:08.661 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.448780.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.448780.log.gz 2023-07-06T02:41:08.662 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.372567.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.468731.log 2023-07-06T02:41:08.662 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.372567.log.gz 2023-07-06T02:41:08.662 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.269105.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.367531.log 2023-07-06T02:41:08.662 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.269105.log.gz 2023-07-06T02:41:08.662 INFO:teuthology.orchestra.run.smithi046.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.113465.log.gz 2023-07-06T02:41:08.663 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.468731.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.623123.log 2023-07-06T02:41:08.663 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.468731.log.gz 2023-07-06T02:41:08.663 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.666854.log 2023-07-06T02:41:08.663 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.367531.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.367531.log.gz 2023-07-06T02:41:08.663 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.623123.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.339333.log 2023-07-06T02:41:08.664 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.623123.log.gz 2023-07-06T02:41:08.664 INFO:teuthology.orchestra.run.smithi046.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.109248.log.gz 2023-07-06T02:41:08.664 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.666854.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.775442.log 2023-07-06T02:41:08.664 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.666854.log.gz 2023-07-06T02:41:08.664 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.339333.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.621721.log 2023-07-06T02:41:08.665 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.339333.log.gz 2023-07-06T02:41:08.665 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.775442.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.775442.log.gz 2023-07-06T02:41:08.665 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.675569.log 2023-07-06T02:41:08.665 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.680994.log 2023-07-06T02:41:08.665 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.621721.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.621721.log.gz 2023-07-06T02:41:08.666 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.675569.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.193246.log 2023-07-06T02:41:08.666 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.675569.log.gz 2023-07-06T02:41:08.666 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.680994.log: gzip 0.0%-5 -- replaced with /var/log/ceph/ceph-client.admin.680994.log.gz--verbose 2023-07-06T02:41:08.666 INFO:teuthology.orchestra.run.smithi046.stderr:-- /var/log/ceph/ceph-client.admin.790564.log 2023-07-06T02:41:08.667 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.667919.log 2023-07-06T02:41:08.667 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.193246.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.193246.log.gz 2023-07-06T02:41:08.667 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.790564.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.378718.log 2023-07-06T02:41:08.667 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.790564.log.gz 2023-07-06T02:41:08.667 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.667919.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.667919.log.gz 2023-07-06T02:41:08.668 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.197344.log 2023-07-06T02:41:08.668 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.189319.log 2023-07-06T02:41:08.668 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.378718.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.378718.log.gz 2023-07-06T02:41:08.668 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.197344.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.468235.log 2023-07-06T02:41:08.668 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.197344.log.gz 2023-07-06T02:41:08.669 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.189319.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.694352.log 2023-07-06T02:41:08.669 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.189319.log.gz 2023-07-06T02:41:08.669 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.255296.log 2023-07-06T02:41:08.669 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.468235.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.468235.log.gz 2023-07-06T02:41:08.670 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.694352.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.333844.log 2023-07-06T02:41:08.670 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.694352.log.gz 2023-07-06T02:41:08.670 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.255296.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.365002.log 2023-07-06T02:41:08.670 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.255296.log.gz 2023-07-06T02:41:08.670 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.382929.log 2023-07-06T02:41:08.671 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.333844.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.333844.log.gz 2023-07-06T02:41:08.671 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.365002.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.107387.log 2023-07-06T02:41:08.671 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.365002.log.gz 2023-07-06T02:41:08.671 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.382929.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.323641.log 2023-07-06T02:41:08.671 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.382929.log.gz 2023-07-06T02:41:08.672 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.325714.log 2023-07-06T02:41:08.672 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.107387.log: /var/log/ceph/ceph-client.admin.323641.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.256855.log 2023-07-06T02:41:08.672 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.323641.log.gz 2023-07-06T02:41:08.672 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.325714.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.382461.log 2023-07-06T02:41:08.672 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.325714.log.gz 2023-07-06T02:41:08.673 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.256855.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.663259.log 2023-07-06T02:41:08.673 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.256855.log.gz 2023-07-06T02:41:08.673 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.382461.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.322183.log 2023-07-06T02:41:08.673 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.382461.log.gz 2023-07-06T02:41:08.674 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.663259.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.699106.log 2023-07-06T02:41:08.674 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.663259.log.gz 2023-07-06T02:41:08.674 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.322183.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.322183.log.gz 2023-07-06T02:41:08.674 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.609979.log 2023-07-06T02:41:08.674 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.699106.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.437131.log 2023-07-06T02:41:08.675 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.699106.log.gz 2023-07-06T02:41:08.675 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.609979.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.190593.log 2023-07-06T02:41:08.675 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.609979.log.gz 2023-07-06T02:41:08.675 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.437131.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.437131.log.gzgzip 2023-07-06T02:41:08.675 INFO:teuthology.orchestra.run.smithi046.stderr:-5 --verbose -- /var/log/ceph/ceph-client.admin.465117.log 2023-07-06T02:41:08.676 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100794.log 2023-07-06T02:41:08.676 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.190593.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.190593.log.gz 2023-07-06T02:41:08.676 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.465117.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.275330.log 2023-07-06T02:41:08.676 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.465117.log.gz 2023-07-06T02:41:08.676 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.100794.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.624579.log 2023-07-06T02:41:08.677 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.115109.log 2023-07-06T02:41:08.677 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.275330.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.275330.log.gz 2023-07-06T02:41:08.677 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.624579.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.239152.log 2023-07-06T02:41:08.677 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.624579.log.gz 2023-07-06T02:41:08.678 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.115109.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.469449.log 2023-07-06T02:41:08.678 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.649608.log 2023-07-06T02:41:08.678 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.239152.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.239152.log.gz 2023-07-06T02:41:08.678 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.469449.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.333641.log 2023-07-06T02:41:08.678 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.469449.log.gz 2023-07-06T02:41:08.679 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.649608.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.649608.log.gz 2023-07-06T02:41:08.679 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.438184.log 2023-07-06T02:41:08.679 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.700010.log 2023-07-06T02:41:08.679 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.333641.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.333641.log.gz 2023-07-06T02:41:08.679 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.438184.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.282720.log 2023-07-06T02:41:08.680 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.438184.log.gz 2023-07-06T02:41:08.680 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.700010.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.278447.log 2023-07-06T02:41:08.680 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.700010.log.gz 2023-07-06T02:41:08.680 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.282720.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.282720.log.gz 2023-07-06T02:41:08.680 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.804070.log 2023-07-06T02:41:08.681 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.278447.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.613704.log 2023-07-06T02:41:08.681 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.278447.log.gz 2023-07-06T02:41:08.681 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.804070.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.389710.log 2023-07-06T02:41:08.681 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.804070.log.gz 2023-07-06T02:41:08.681 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.613704.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.613704.log.gz 2023-07-06T02:41:08.682 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.344500.log 2023-07-06T02:41:08.682 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.389710.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.697031.log 2023-07-06T02:41:08.682 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.389710.log.gz 2023-07-06T02:41:08.682 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.344500.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.282440.log 2023-07-06T02:41:08.682 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.344500.log.gz 2023-07-06T02:41:08.683 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.697031.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.697031.log.gz 2023-07-06T02:41:08.683 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.192284.log 2023-07-06T02:41:08.683 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.282440.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.803123.log 2023-07-06T02:41:08.683 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.282440.log.gz 2023-07-06T02:41:08.683 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.192284.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.192284.log.gz 2023-07-06T02:41:08.684 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.299755.log 2023-07-06T02:41:08.684 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.803123.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.106877.log 2023-07-06T02:41:08.684 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.803123.log.gz 2023-07-06T02:41:08.684 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.299755.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.299755.log.gz 2023-07-06T02:41:08.684 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.754115.log 2023-07-06T02:41:08.685 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.106877.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.112948.log 2023-07-06T02:41:08.685 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.754115.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.752538.log 2023-07-06T02:41:08.685 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.754115.log.gz 2023-07-06T02:41:08.685 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.112948.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.373042.log 2023-07-06T02:41:08.685 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.752538.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.377913.log 2023-07-06T02:41:08.686 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.752538.log.gz 2023-07-06T02:41:08.686 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.373042.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.809712.log 2023-07-06T02:41:08.686 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.373042.log.gz 2023-07-06T02:41:08.686 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.377913.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.795832.log 2023-07-06T02:41:08.687 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.377913.log.gz 2023-07-06T02:41:08.687 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.809712.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.155543.log 2023-07-06T02:41:08.687 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.809712.log.gz 2023-07-06T02:41:08.687 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.795832.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.795832.log.gz 2023-07-06T02:41:08.687 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.638760.log 2023-07-06T02:41:08.688 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.155543.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.669075.log 2023-07-06T02:41:08.688 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.155543.log.gz 2023-07-06T02:41:08.688 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.638760.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.638760.log.gz 2023-07-06T02:41:08.688 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.158532.log 2023-07-06T02:41:08.688 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.669075.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.365606.log 2023-07-06T02:41:08.689 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.669075.log.gz 2023-07-06T02:41:08.689 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.158532.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.158532.log.gz 2023-07-06T02:41:08.689 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.193957.log 2023-07-06T02:41:08.689 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.365606.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.814575.log 2023-07-06T02:41:08.690 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.365606.log.gz 2023-07-06T02:41:08.690 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.193957.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.193957.log.gz 2023-07-06T02:41:08.690 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.757547.log 2023-07-06T02:41:08.690 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.814575.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.271966.log 2023-07-06T02:41:08.690 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.814575.log.gz 2023-07-06T02:41:08.691 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.757547.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.757547.log.gz 2023-07-06T02:41:08.691 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.253812.log 2023-07-06T02:41:08.691 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.271966.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.635661.log 2023-07-06T02:41:08.691 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.271966.log.gz 2023-07-06T02:41:08.692 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.253812.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.253812.log.gz 2023-07-06T02:41:08.692 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.703365.log 2023-07-06T02:41:08.692 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.635661.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.374556.log 2023-07-06T02:41:08.692 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.635661.log.gz 2023-07-06T02:41:08.692 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.703365.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.703365.log.gz 2023-07-06T02:41:08.693 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.404486.log 2023-07-06T02:41:08.693 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.374556.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.373530.log 2023-07-06T02:41:08.693 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.374556.log.gz 2023-07-06T02:41:08.693 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.404486.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.404486.log.gz 2023-07-06T02:41:08.693 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.334876.log 2023-07-06T02:41:08.694 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.373530.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.191495.log 2023-07-06T02:41:08.694 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.373530.log.gz 2023-07-06T02:41:08.694 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.334876.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.374773.log 2023-07-06T02:41:08.694 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.334876.log.gz 2023-07-06T02:41:08.694 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.191495.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.664066.log 2023-07-06T02:41:08.695 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.191495.log.gz 2023-07-06T02:41:08.695 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.374773.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.300574.log 2023-07-06T02:41:08.695 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.374773.log.gz 2023-07-06T02:41:08.695 INFO:teuthology.orchestra.run.smithi046.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.114335.log.gz 2023-07-06T02:41:08.695 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.664066.log: gzip -5 0.0%--verbose -- -- replaced with /var/log/ceph/ceph-client.admin.664066.log.gz/var/log/ceph/ceph-client.admin.768987.log 2023-07-06T02:41:08.696 INFO:teuthology.orchestra.run.smithi046.stderr: 2023-07-06T02:41:08.696 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.300574.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.113040.log.gz 2023-07-06T02:41:08.696 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.630685.log 2023-07-06T02:41:08.696 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.300574.log.gz 2023-07-06T02:41:08.697 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.768987.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.108972.log 2023-07-06T02:41:08.697 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.768987.log.gz 2023-07-06T02:41:08.697 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.630685.log: gzip 0.0%-5 -- replaced with /var/log/ceph/ceph-client.admin.630685.log.gz--verbose 2023-07-06T02:41:08.697 INFO:teuthology.orchestra.run.smithi046.stderr:-- /var/log/ceph/ceph-client.admin.385062.log 2023-07-06T02:41:08.697 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.108972.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.922330.log 2023-07-06T02:41:08.698 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.385062.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.790053.log 2023-07-06T02:41:08.698 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.385062.log.gz 2023-07-06T02:41:08.698 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.922330.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.357356.log 2023-07-06T02:41:08.698 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.922330.log.gz 2023-07-06T02:41:08.698 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.790053.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.465210.log 2023-07-06T02:41:08.699 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.790053.log.gz 2023-07-06T02:41:08.699 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.357356.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.357356.log.gz 2023-07-06T02:41:08.699 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.685099.log 2023-07-06T02:41:08.699 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.465210.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.790471.log 2023-07-06T02:41:08.699 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.465210.log.gz 2023-07-06T02:41:08.700 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.685099.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.638977.log 2023-07-06T02:41:08.700 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.685099.log.gz 2023-07-06T02:41:08.700 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.790471.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.284663.log 2023-07-06T02:41:08.700 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.790471.log.gz 2023-07-06T02:41:08.700 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.638977.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.249620.log 2023-07-06T02:41:08.701 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.638977.log.gz 2023-07-06T02:41:08.701 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.284663.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.614729.log 2023-07-06T02:41:08.701 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.284663.log.gz 2023-07-06T02:41:08.701 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.249620.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.295504.log 2023-07-06T02:41:08.701 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.249620.log.gz 2023-07-06T02:41:08.702 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.614729.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.216213.log 2023-07-06T02:41:08.702 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.614729.log.gz 2023-07-06T02:41:08.702 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.295504.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.347287.log 2023-07-06T02:41:08.702 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.295504.log.gz 2023-07-06T02:41:08.702 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.216213.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.107433.log 2023-07-06T02:41:08.703 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.216213.log.gz 2023-07-06T02:41:08.703 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.347287.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.805902.log 2023-07-06T02:41:08.703 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.347287.log.gz 2023-07-06T02:41:08.703 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.107433.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.770578.log 2023-07-06T02:41:08.703 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.805902.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.804449.log 2023-07-06T02:41:08.704 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.805902.log.gz 2023-07-06T02:41:08.704 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.770578.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.687184.log 2023-07-06T02:41:08.704 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.770578.log.gz 2023-07-06T02:41:08.704 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.804449.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.155968.log 2023-07-06T02:41:08.705 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.804449.log.gz 2023-07-06T02:41:08.705 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.687184.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.384766.log 2023-07-06T02:41:08.705 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.687184.log.gz 2023-07-06T02:41:08.705 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.155968.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.672434.log 2023-07-06T02:41:08.705 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.155968.log.gz 2023-07-06T02:41:08.706 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.384766.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.282130.log 2023-07-06T02:41:08.706 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.384766.log.gz 2023-07-06T02:41:08.706 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.672434.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.191588.log 2023-07-06T02:41:08.706 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.672434.log.gz 2023-07-06T02:41:08.706 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.282130.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.380131.log 2023-07-06T02:41:08.707 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.282130.log.gz 2023-07-06T02:41:08.707 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.191588.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.308187.log 2023-07-06T02:41:08.707 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.191588.log.gz 2023-07-06T02:41:08.707 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.380131.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.382915.log 2023-07-06T02:41:08.708 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.380131.log.gz 2023-07-06T02:41:08.708 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.308187.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.356422.log 2023-07-06T02:41:08.708 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.308187.log.gz 2023-07-06T02:41:08.708 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.382915.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.671603.log 2023-07-06T02:41:08.708 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.382915.log.gz 2023-07-06T02:41:08.709 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.356422.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.394569.log 2023-07-06T02:41:08.709 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.356422.log.gz 2023-07-06T02:41:08.709 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.671603.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.693365.log 2023-07-06T02:41:08.709 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.671603.log.gz 2023-07-06T02:41:08.710 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.394569.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.332126.log 2023-07-06T02:41:08.710 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.394569.log.gz 2023-07-06T02:41:08.710 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.693365.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.700103.log 2023-07-06T02:41:08.710 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.693365.log.gz 2023-07-06T02:41:08.710 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.332126.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.239850.log 2023-07-06T02:41:08.711 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.332126.log.gz 2023-07-06T02:41:08.711 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.700103.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.682381.log 2023-07-06T02:41:08.711 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.700103.log.gz 2023-07-06T02:41:08.711 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.239850.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.101100.log 2023-07-06T02:41:08.711 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.239850.log.gz 2023-07-06T02:41:08.712 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.682381.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.682381.log.gz 2023-07-06T02:41:08.712 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.109202.log 2023-07-06T02:41:08.712 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.101100.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.321008.log 2023-07-06T02:41:08.712 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.109202.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.800235.log 2023-07-06T02:41:08.712 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.321008.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.271747.log 2023-07-06T02:41:08.713 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.321008.log.gz 2023-07-06T02:41:08.713 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.800235.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.653700.log 2023-07-06T02:41:08.713 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.800235.log.gz 2023-07-06T02:41:08.713 INFO:teuthology.orchestra.run.smithi046.stderr:gzip /var/log/ceph/ceph-client.admin.271747.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.111239.log 2023-07-06T02:41:08.713 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.271747.log.gz 2023-07-06T02:41:08.714 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.653700.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.653700.log.gzgzip 2023-07-06T02:41:08.714 INFO:teuthology.orchestra.run.smithi046.stderr:-5 --verbose -- 89.1%/var/log/ceph/ceph-client.admin.368026.log 2023-07-06T02:41:08.714 INFO:teuthology.orchestra.run.smithi046.stderr: -- replaced with /var/log/ceph/ceph-client.admin.107617.log.gz 2023-07-06T02:41:08.714 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.111239.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.628222.log 2023-07-06T02:41:08.715 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.368026.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.664374.log 2023-07-06T02:41:08.715 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.368026.log.gz 2023-07-06T02:41:08.715 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.628222.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.284463.log 2023-07-06T02:41:08.715 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.628222.log.gz 2023-07-06T02:41:08.715 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.664374.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.438170.log 2023-07-06T02:41:08.716 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.664374.log.gz 2023-07-06T02:41:08.716 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.284463.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.188640.log 2023-07-06T02:41:08.716 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.284463.log.gz 2023-07-06T02:41:08.716 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.438170.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.394073.log 2023-07-06T02:41:08.716 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.438170.log.gz 2023-07-06T02:41:08.717 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.188640.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.114787.log 2023-07-06T02:41:08.717 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.188640.log.gz 2023-07-06T02:41:08.717 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.394073.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.775921.log 2023-07-06T02:41:08.717 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.394073.log.gz 2023-07-06T02:41:08.718 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.114787.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.920866.log 2023-07-06T02:41:08.718 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.775921.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.372488.log 2023-07-06T02:41:08.718 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.775921.log.gz 2023-07-06T02:41:08.718 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.920866.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.402210.log 2023-07-06T02:41:08.718 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.920866.log.gz 2023-07-06T02:41:08.719 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.372488.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.775127.log 2023-07-06T02:41:08.719 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.372488.log.gz 2023-07-06T02:41:08.719 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.402210.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.379589.log 2023-07-06T02:41:08.719 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.402210.log.gz 2023-07-06T02:41:08.719 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.775127.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.189039.log 2023-07-06T02:41:08.720 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.775127.log.gz 2023-07-06T02:41:08.720 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.379589.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.647867.log 2023-07-06T02:41:08.720 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.379589.log.gz 2023-07-06T02:41:08.720 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.189039.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.211741.log 2023-07-06T02:41:08.720 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.189039.log.gz 2023-07-06T02:41:08.721 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.647867.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.272574.log 2023-07-06T02:41:08.721 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.647867.log.gz 2023-07-06T02:41:08.721 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.211741.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.208519.log 2023-07-06T02:41:08.721 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.211741.log.gz 2023-07-06T02:41:08.722 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.272574.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.340642.log 2023-07-06T02:41:08.722 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.272574.log.gz 2023-07-06T02:41:08.722 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.208519.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.379121.log 2023-07-06T02:41:08.722 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.208519.log.gz 2023-07-06T02:41:08.722 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.340642.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.792465.log 2023-07-06T02:41:08.723 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.340642.log.gz 2023-07-06T02:41:08.723 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.379121.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.263703.log 2023-07-06T02:41:08.723 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.379121.log.gz 2023-07-06T02:41:08.723 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.792465.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.774130.log 2023-07-06T02:41:08.723 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.792465.log.gz 2023-07-06T02:41:08.724 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.263703.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.767648.log 2023-07-06T02:41:08.724 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.263703.log.gz 2023-07-06T02:41:08.724 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.774130.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.690563.log 2023-07-06T02:41:08.724 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.774130.log.gz 2023-07-06T02:41:08.724 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.767648.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.399251.log 2023-07-06T02:41:08.725 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.767648.log.gz 2023-07-06T02:41:08.725 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.690563.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.216199.log 2023-07-06T02:41:08.725 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.690563.log.gz 2023-07-06T02:41:08.725 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.399251.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.339132.log 2023-07-06T02:41:08.725 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.399251.log.gz 2023-07-06T02:41:08.726 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.216199.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.294213.log 2023-07-06T02:41:08.726 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.216199.log.gz 2023-07-06T02:41:08.726 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.339132.log: gzip -5 --verbose -- 0.0%/var/log/ceph/ceph-client.admin.284973.log 2023-07-06T02:41:08.726 INFO:teuthology.orchestra.run.smithi046.stderr: -- replaced with /var/log/ceph/ceph-client.admin.339132.log.gz 2023-07-06T02:41:08.727 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.294213.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.286283.log 2023-07-06T02:41:08.727 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.294213.log.gz 2023-07-06T02:41:08.727 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.284973.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.932469.log 2023-07-06T02:41:08.727 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.284973.log.gz 2023-07-06T02:41:08.727 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.286283.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.306850.log 2023-07-06T02:41:08.728 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.286283.log.gz 2023-07-06T02:41:08.728 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.932469.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.752631.log 2023-07-06T02:41:08.728 INFO:teuthology.orchestra.run.smithi046.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.932469.log.gz 2023-07-06T02:41:08.728 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.306850.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.288433.log 2023-07-06T02:41:08.728 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.306850.log.gz 2023-07-06T02:41:08.729 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.752631.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.113419.log 2023-07-06T02:41:08.729 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.752631.log.gz 2023-07-06T02:41:08.729 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.288433.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.482336.log 2023-07-06T02:41:08.729 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.288433.log.gz 2023-07-06T02:41:08.729 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.113419.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.368319.log 2023-07-06T02:41:08.730 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.482336.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.675009.log 2023-07-06T02:41:08.730 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.482336.log.gz 2023-07-06T02:41:08.730 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.368319.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.115873.log 2023-07-06T02:41:08.730 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.368319.log.gz 2023-07-06T02:41:08.730 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.675009.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.186601.log 2023-07-06T02:41:08.731 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.675009.log.gz 2023-07-06T02:41:08.731 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.115873.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.757077.log 2023-07-06T02:41:08.731 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.186601.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.241131.log 2023-07-06T02:41:08.731 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.186601.log.gz 2023-07-06T02:41:08.731 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.757077.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.374098.log 2023-07-06T02:41:08.732 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.757077.log.gz 2023-07-06T02:41:08.732 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.241131.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.932285.log 2023-07-06T02:41:08.732 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.241131.log.gz 2023-07-06T02:41:08.732 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.374098.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.328935.log 2023-07-06T02:41:08.732 INFO:teuthology.orchestra.run.smithi046.stderr: 91.3% 0.0% -- replaced with /var/log/ceph/ceph-client.admin.109670.log.gz 2023-07-06T02:41:08.733 INFO:teuthology.orchestra.run.smithi046.stderr: -- replaced with /var/log/ceph/ceph-client.admin.374098.log.gz 2023-07-06T02:41:08.733 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.932285.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.171488.log 2023-07-06T02:41:08.733 INFO:teuthology.orchestra.run.smithi046.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.107387.log.gz 88.0% 2023-07-06T02:41:08.733 INFO:teuthology.orchestra.run.smithi046.stderr: -- replaced with /var/log/ceph/ceph-client.admin.932285.log.gz 2023-07-06T02:41:08.733 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.328935.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.408466.log 2023-07-06T02:41:08.734 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.328935.log.gz 2023-07-06T02:41:08.734 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.171488.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.655608.log 2023-07-06T02:41:08.734 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.171488.log.gz 2023-07-06T02:41:08.734 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.408466.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.408466.log.gz 2023-07-06T02:41:08.734 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.408741.log 2023-07-06T02:41:08.735 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.655608.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.795846.log 2023-07-06T02:41:08.735 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.655608.log.gz 2023-07-06T02:41:08.735 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.408741.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.196657.log 2023-07-06T02:41:08.735 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.408741.log.gz 2023-07-06T02:41:08.735 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.795846.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.417423.log 2023-07-06T02:41:08.736 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.795846.log.gz 2023-07-06T02:41:08.736 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.196657.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.190114.log 2023-07-06T02:41:08.736 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.196657.log.gz 2023-07-06T02:41:08.736 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.417423.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.754589.log 2023-07-06T02:41:08.737 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.417423.log.gz 2023-07-06T02:41:08.737 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.190114.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.692781.log 2023-07-06T02:41:08.737 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.190114.log.gz 2023-07-06T02:41:08.737 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.754589.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.394770.log 2023-07-06T02:41:08.737 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.754589.log.gz 2023-07-06T02:41:08.738 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.692781.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.335175.log 2023-07-06T02:41:08.738 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.692781.log.gz 2023-07-06T02:41:08.738 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.394770.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.375592.log 2023-07-06T02:41:08.738 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.394770.log.gz 2023-07-06T02:41:08.738 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.335175.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.265190.log 2023-07-06T02:41:08.739 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.335175.log.gz 2023-07-06T02:41:08.739 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.375592.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.647657.log 2023-07-06T02:41:08.739 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.375592.log.gz 2023-07-06T02:41:08.739 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.265190.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.756998.log 2023-07-06T02:41:08.739 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.265190.log.gz 2023-07-06T02:41:08.740 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.647657.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.702589.log 2023-07-06T02:41:08.740 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.647657.log.gz 2023-07-06T02:41:08.740 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.756998.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.676946.log 2023-07-06T02:41:08.740 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.756998.log.gz 2023-07-06T02:41:08.741 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.702589.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.353191.log 2023-07-06T02:41:08.741 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.702589.log.gz 2023-07-06T02:41:08.741 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.676946.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.161999.log 2023-07-06T02:41:08.741 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.676946.log.gz 2023-07-06T02:41:08.741 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 /var/log/ceph/ceph-client.admin.353191.log: --verbose -- /var/log/ceph/ceph-client.admin.463163.log 2023-07-06T02:41:08.742 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.353191.log.gz 2023-07-06T02:41:08.742 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.161999.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.252049.log 2023-07-06T02:41:08.742 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.161999.log.gz 2023-07-06T02:41:08.742 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.463163.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.276704.log 2023-07-06T02:41:08.742 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.463163.log.gz 2023-07-06T02:41:08.743 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.252049.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.634324.log 2023-07-06T02:41:08.743 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.252049.log.gz 2023-07-06T02:41:08.743 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.276704.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.620279.log 2023-07-06T02:41:08.743 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.276704.log.gz 2023-07-06T02:41:08.743 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.634324.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.291186.log 2023-07-06T02:41:08.744 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.634324.log.gz 2023-07-06T02:41:08.744 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.620279.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.801282.log 2023-07-06T02:41:08.744 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.620279.log.gz 2023-07-06T02:41:08.744 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.291186.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.187074.log 2023-07-06T02:41:08.744 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.291186.log.gz 2023-07-06T02:41:08.745 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.801282.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.672192.log 2023-07-06T02:41:08.745 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.801282.log.gz 2023-07-06T02:41:08.745 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.187074.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.273596.log 2023-07-06T02:41:08.745 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.187074.log.gz 2023-07-06T02:41:08.746 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose /var/log/ceph/ceph-client.admin.672192.log: -- /var/log/ceph/ceph-client.admin.466224.log 2023-07-06T02:41:08.746 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.672192.log.gz 2023-07-06T02:41:08.746 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.273596.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.413125.log 2023-07-06T02:41:08.746 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.273596.log.gz 2023-07-06T02:41:08.746 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.466224.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.383299.log 2023-07-06T02:41:08.747 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.466224.log.gz 2023-07-06T02:41:08.747 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.413125.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.112298.log 2023-07-06T02:41:08.747 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.413125.log.gz 2023-07-06T02:41:08.747 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.383299.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.190100.log 2023-07-06T02:41:08.747 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.383299.log.gz 2023-07-06T02:41:08.748 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.112298.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.291200.log 2023-07-06T02:41:08.748 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.190100.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.109624.log 2023-07-06T02:41:08.748 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.190100.log.gz 2023-07-06T02:41:08.748 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.291200.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.668411.log 2023-07-06T02:41:08.748 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.291200.log.gz 2023-07-06T02:41:08.749 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.109624.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.701488.log 2023-07-06T02:41:08.749 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.668411.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.648595.log 2023-07-06T02:41:08.749 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.668411.log.gz 2023-07-06T02:41:08.749 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.701488.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.269611.log 2023-07-06T02:41:08.749 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.701488.log.gz 2023-07-06T02:41:08.750 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.648595.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.930011.log 2023-07-06T02:41:08.750 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.648595.log.gz 2023-07-06T02:41:08.750 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.269611.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.196643.log 2023-07-06T02:41:08.750 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.269611.log.gz 2023-07-06T02:41:08.750 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.930011.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.290472.log 2023-07-06T02:41:08.751 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.930011.log.gz 2023-07-06T02:41:08.751 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.196643.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.679108.log 2023-07-06T02:41:08.751 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.196643.log.gz 2023-07-06T02:41:08.751 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.290472.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.399484.log 2023-07-06T02:41:08.751 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.290472.log.gz 2023-07-06T02:41:08.752 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.679108.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.466131.log 2023-07-06T02:41:08.752 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.679108.log.gz 2023-07-06T02:41:08.752 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.399484.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.245467.log 2023-07-06T02:41:08.752 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.399484.log.gz 2023-07-06T02:41:08.753 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.220136.log 2023-07-06T02:41:08.753 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.466131.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.466131.log.gz 2023-07-06T02:41:08.753 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.245467.log: 0.0%gzip -- replaced with /var/log/ceph/ceph-client.admin.245467.log.gz-5 2023-07-06T02:41:08.753 INFO:teuthology.orchestra.run.smithi046.stderr:--verbose -- /var/log/ceph/ceph-client.admin.650463.log 2023-07-06T02:41:08.753 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.220136.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.265097.log 2023-07-06T02:41:08.754 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.220136.log.gz 2023-07-06T02:41:08.754 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.650463.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.391572.log 2023-07-06T02:41:08.754 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.650463.log.gz 2023-07-06T02:41:08.754 INFO:teuthology.orchestra.run.smithi046.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.115109.log.gz 2023-07-06T02:41:08.754 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.265097.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.265097.log.gz 2023-07-06T02:41:08.755 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.268613.log 2023-07-06T02:41:08.755 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.391572.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.439643.log 2023-07-06T02:41:08.755 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.391572.log.gz 2023-07-06T02:41:08.755 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.268613.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.268613.log.gz 2023-07-06T02:41:08.755 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.394260.log 2023-07-06T02:41:08.756 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.439643.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.287936.log 2023-07-06T02:41:08.756 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.439643.log.gz 2023-07-06T02:41:08.756 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.394260.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.394260.log.gz 2023-07-06T02:41:08.756 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.292227.log 2023-07-06T02:41:08.756 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.287936.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.664871.log 2023-07-06T02:41:08.757 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.287936.log.gz 2023-07-06T02:41:08.757 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.292227.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.292227.log.gz 2023-07-06T02:41:08.757 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.755377.log 2023-07-06T02:41:08.757 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.664871.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.302927.log 2023-07-06T02:41:08.757 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.664871.log.gz 2023-07-06T02:41:08.758 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.755377.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.755377.log.gz 2023-07-06T02:41:08.758 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mon.a.log 2023-07-06T02:41:08.758 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.302927.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.160811.log 2023-07-06T02:41:08.758 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.302927.log.gz 2023-07-06T02:41:08.758 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-mon.a.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.758243.log 2023-07-06T02:41:08.759 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.160811.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.332343.log 2023-07-06T02:41:08.759 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.160811.log.gz 2023-07-06T02:41:08.759 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.758243.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.758243.log.gz 2023-07-06T02:41:08.759 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.266663.log 2023-07-06T02:41:08.759 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.332343.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.291401.log 2023-07-06T02:41:08.760 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.332343.log.gz 2023-07-06T02:41:08.760 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.266663.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.932607.log 2023-07-06T02:41:08.760 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.266663.log.gz 2023-07-06T02:41:08.760 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.291401.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.436781.log 2023-07-06T02:41:08.761 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.291401.log.gz 2023-07-06T02:41:08.761 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.932607.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.360061.log 2023-07-06T02:41:08.761 INFO:teuthology.orchestra.run.smithi046.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.932607.log.gz 2023-07-06T02:41:08.761 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.436781.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.362516.log 2023-07-06T02:41:08.761 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.436781.log.gz 2023-07-06T02:41:08.762 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.609993.log 2023-07-06T02:41:08.762 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.360061.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.360061.log.gz 2023-07-06T02:41:08.762 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.362516.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.371190.log 2023-07-06T02:41:08.762 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.362516.log.gz 2023-07-06T02:41:08.762 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.609993.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.468717.log 2023-07-06T02:41:08.763 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.609993.log.gz 2023-07-06T02:41:08.763 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.371190.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.371190.log.gz 2023-07-06T02:41:08.763 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.815144.log 2023-07-06T02:41:08.763 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.468717.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.115017.log 2023-07-06T02:41:08.764 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.468717.log.gz 2023-07-06T02:41:08.764 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.815144.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.334064.log 0.0% 2023-07-06T02:41:08.764 INFO:teuthology.orchestra.run.smithi046.stderr: -- replaced with /var/log/ceph/ceph-client.admin.815144.log.gz 2023-07-06T02:41:08.764 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.115017.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.399237.log 2023-07-06T02:41:08.764 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.334064.log: gzip -5 --verbose 0.0%-- -- replaced with /var/log/ceph/ceph-client.admin.334064.log.gz/var/log/ceph/ceph-client.admin.325931.log 2023-07-06T02:41:08.765 INFO:teuthology.orchestra.run.smithi046.stderr: 2023-07-06T02:41:08.765 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.399237.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.284232.log 2023-07-06T02:41:08.765 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.399237.log.gz 2023-07-06T02:41:08.765 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.325931.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.346418.log 2023-07-06T02:41:08.766 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.325931.log.gz 2023-07-06T02:41:08.766 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.284232.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.371484.log 2023-07-06T02:41:08.766 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.284232.log.gz 2023-07-06T02:41:08.766 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.346418.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.346418.log.gz 2023-07-06T02:41:08.766 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.686506.log 2023-07-06T02:41:08.767 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.371484.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.358813.log 2023-07-06T02:41:08.767 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.371484.log.gz 2023-07-06T02:41:08.767 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.686506.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.686506.log.gz 2023-07-06T02:41:08.767 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.683393.log 2023-07-06T02:41:08.767 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.358813.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.261149.log 2023-07-06T02:41:08.768 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.358813.log.gz 2023-07-06T02:41:08.768 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.683393.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.683393.log.gz 2023-07-06T02:41:08.768 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.697795.log 2023-07-06T02:41:08.768 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.261149.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.273582.log 2023-07-06T02:41:08.768 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.261149.log.gz 2023-07-06T02:41:08.769 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.697795.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.697795.log.gz 2023-07-06T02:41:08.769 INFO:teuthology.orchestra.run.smithi046.stderr:gzip 88.3%-5 --verbose -- replaced with /var/log/ceph/ceph-client.admin.106877.log.gz-- 2023-07-06T02:41:08.769 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.359188.log 2023-07-06T02:41:08.769 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.273582.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.168199.log 2023-07-06T02:41:08.769 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.273582.log.gz 2023-07-06T02:41:08.770 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.359188.log: gzip -5 0.0% -- replaced with /var/log/ceph/ceph-client.admin.359188.log.gz 2023-07-06T02:41:08.770 INFO:teuthology.orchestra.run.smithi046.stderr:--verbose -- /var/log/ceph/ceph-client.admin.257730.log 2023-07-06T02:41:08.770 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.168199.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.932009.log 2023-07-06T02:41:08.770 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.168199.log.gz 2023-07-06T02:41:08.771 INFO:teuthology.orchestra.run.smithi046.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.107433.log.gz 2023-07-06T02:41:08.771 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.257730.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.210786.log 2023-07-06T02:41:08.771 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.257730.log.gz 2023-07-06T02:41:08.771 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.932009.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.114059.log 2023-07-06T02:41:08.771 INFO:teuthology.orchestra.run.smithi046.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.932009.log.gz 2023-07-06T02:41:08.772 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.210786.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.395570.log 2023-07-06T02:41:08.772 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.210786.log.gz 2023-07-06T02:41:08.772 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.801512.log 2023-07-06T02:41:08.772 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.114059.log: /var/log/ceph/ceph-client.admin.395570.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.277124.log 2023-07-06T02:41:08.773 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.395570.log.gz 2023-07-06T02:41:08.773 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.801512.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.801512.log.gz 2023-07-06T02:41:08.773 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.693756.log 2023-07-06T02:41:08.773 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.277124.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.188547.log 2023-07-06T02:41:08.773 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.277124.log.gz 2023-07-06T02:41:08.774 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.693756.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.693756.log.gz 2023-07-06T02:41:08.774 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.699027.log 2023-07-06T02:41:08.774 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.188547.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.753643.log 2023-07-06T02:41:08.774 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.188547.log.gz 2023-07-06T02:41:08.774 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.699027.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.699027.log.gz 2023-07-06T02:41:08.775 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.363032.log 2023-07-06T02:41:08.775 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.753643.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.766865.log 2023-07-06T02:41:08.775 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.753643.log.gz 2023-07-06T02:41:08.775 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.363032.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.363032.log.gz 2023-07-06T02:41:08.775 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.344407.log 2023-07-06T02:41:08.776 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.766865.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.249082.log 2023-07-06T02:41:08.776 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.766865.log.gz 2023-07-06T02:41:08.776 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.344407.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.344407.log.gz 2023-07-06T02:41:08.776 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.185655.log 2023-07-06T02:41:08.777 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.249082.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.665893.log 2023-07-06T02:41:08.777 INFO:teuthology.orchestra.run.smithi046.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.108972.log.gz 2023-07-06T02:41:08.777 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.249082.log.gz 2023-07-06T02:41:08.777 INFO:teuthology.orchestra.run.smithi046.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.109202.log.gz 2023-07-06T02:41:08.777 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.185655.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.106569.log 2023-07-06T02:41:08.778 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.185655.log.gz 2023-07-06T02:41:08.778 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.665893.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.190794.log 2023-07-06T02:41:08.778 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.665893.log.gz 2023-07-06T02:41:08.778 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.106569.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.466210.log 2023-07-06T02:41:08.779 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.190794.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.810094.log 2023-07-06T02:41:08.779 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.190794.log.gz 2023-07-06T02:41:08.779 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.466210.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.195681.log 2023-07-06T02:41:08.779 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.466210.log.gz 2023-07-06T02:41:08.779 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.810094.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.810094.log.gz 2023-07-06T02:41:08.780 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.368305.log 2023-07-06T02:41:08.780 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.195681.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.291917.log 2023-07-06T02:41:08.780 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.195681.log.gz 2023-07-06T02:41:08.780 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.368305.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.186128.log 2023-07-06T02:41:08.781 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.368305.log.gz 2023-07-06T02:41:08.781 INFO:teuthology.orchestra.run.smithi046.stderr:gzip /var/log/ceph/ceph-client.admin.291917.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.114289.log 2023-07-06T02:41:08.781 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.291917.log.gz 2023-07-06T02:41:08.781 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.186128.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.107913.log 2023-07-06T02:41:08.781 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.186128.log.gz 2023-07-06T02:41:08.782 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.114289.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.357007.log 2023-07-06T02:41:08.782 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.107913.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.203633.log 2023-07-06T02:41:08.782 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.357007.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.373516.log 2023-07-06T02:41:08.782 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.357007.log.gz 2023-07-06T02:41:08.782 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.203633.log: gzip 0.0%-5 -- replaced with /var/log/ceph/ceph-client.admin.203633.log.gz--verbose 2023-07-06T02:41:08.783 INFO:teuthology.orchestra.run.smithi046.stderr:-- /var/log/ceph/ceph-client.admin.924647.log 2023-07-06T02:41:08.783 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.373516.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.286808.log 2023-07-06T02:41:08.783 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.373516.log.gz 2023-07-06T02:41:08.783 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.924647.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.162755.log 2023-07-06T02:41:08.784 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.924647.log.gz 2023-07-06T02:41:08.784 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.286808.log: gzip -5 0.0%--verbose -- replaced with /var/log/ceph/ceph-client.admin.286808.log.gz-- 2023-07-06T02:41:08.784 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.803976.log 2023-07-06T02:41:08.784 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.162755.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.375499.log 2023-07-06T02:41:08.784 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.162755.log.gz 2023-07-06T02:41:08.785 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.803976.log: gzip -5 --verbose -- 0.0%/var/log/ceph/ceph-client.admin.275369.log -- replaced with /var/log/ceph/ceph-client.admin.803976.log.gz 2023-07-06T02:41:08.785 INFO:teuthology.orchestra.run.smithi046.stderr: 2023-07-06T02:41:08.785 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.342017.log 2023-07-06T02:41:08.785 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.375499.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.375499.log.gz 2023-07-06T02:41:08.785 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.275369.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.275369.log.gz 2023-07-06T02:41:08.786 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.468142.log 2023-07-06T02:41:08.786 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.469140.log 2023-07-06T02:41:08.786 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.342017.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.342017.log.gz 2023-07-06T02:41:08.786 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.468142.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.307236.log 2023-07-06T02:41:08.786 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.468142.log.gz 2023-07-06T02:41:08.787 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.469140.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.220509.log 2023-07-06T02:41:08.787 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.469140.log.gz 2023-07-06T02:41:08.787 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.307236.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.766400.log 2023-07-06T02:41:08.787 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.307236.log.gz 2023-07-06T02:41:08.787 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.220509.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.161985.log 2023-07-06T02:41:08.788 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.220509.log.gz 2023-07-06T02:41:08.788 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.766400.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.206137.log 2023-07-06T02:41:08.788 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.766400.log.gz 2023-07-06T02:41:08.788 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.161985.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.667334.log 2023-07-06T02:41:08.788 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.161985.log.gz 2023-07-06T02:41:08.789 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.206137.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.201840.log 2023-07-06T02:41:08.789 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.206137.log.gz 2023-07-06T02:41:08.789 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.667334.log: 0.0%gzip -- replaced with /var/log/ceph/ceph-client.admin.667334.log.gz-5 2023-07-06T02:41:08.789 INFO:teuthology.orchestra.run.smithi046.stderr:--verbose -- /var/log/ceph/ceph-client.admin.769679.log 2023-07-06T02:41:08.790 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.201840.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.283442.log 2023-07-06T02:41:08.790 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.201840.log.gz 2023-07-06T02:41:08.790 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.769679.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.627727.log 2023-07-06T02:41:08.790 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.769679.log.gz 2023-07-06T02:41:08.790 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.283442.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.170110.log 2023-07-06T02:41:08.791 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.283442.log.gz 2023-07-06T02:41:08.791 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.627727.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.811421.log 2023-07-06T02:41:08.791 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.627727.log.gz 2023-07-06T02:41:08.791 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.170110.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.620200.log 2023-07-06T02:41:08.791 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.170110.log.gz 2023-07-06T02:41:08.792 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.811421.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.811421.log.gz 2023-07-06T02:41:08.792 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.324677.log 2023-07-06T02:41:08.792 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.620200.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.376664.log 2023-07-06T02:41:08.792 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.620200.log.gz 2023-07-06T02:41:08.792 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.324677.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.342235.log 2023-07-06T02:41:08.793 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.324677.log.gz 2023-07-06T02:41:08.793 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.376664.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.613922.log 2023-07-06T02:41:08.793 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.376664.log.gz 2023-07-06T02:41:08.793 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.342235.log: 0.0%gzip -- replaced with /var/log/ceph/ceph-client.admin.342235.log.gz-5 2023-07-06T02:41:08.794 INFO:teuthology.orchestra.run.smithi046.stderr:--verbose -- /var/log/ceph/ceph-client.admin.160732.log 2023-07-06T02:41:08.794 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.613922.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.812218.log 2023-07-06T02:41:08.794 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.613922.log.gz 2023-07-06T02:41:08.794 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.160732.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.313843.log 2023-07-06T02:41:08.794 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.160732.log.gz 2023-07-06T02:41:08.795 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.812218.log: 0.0%gzip -5 -- replaced with /var/log/ceph/ceph-client.admin.812218.log.gz--verbose 2023-07-06T02:41:08.795 INFO:teuthology.orchestra.run.smithi046.stderr:-- /var/log/ceph/ceph-client.admin.693849.log 2023-07-06T02:41:08.795 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.313843.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.187153.log 2023-07-06T02:41:08.795 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.313843.log.gz 2023-07-06T02:41:08.795 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.693849.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.113921.log 2023-07-06T02:41:08.796 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.693849.log.gz 2023-07-06T02:41:08.796 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.187153.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.154049.log 2023-07-06T02:41:08.796 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.187153.log.gz 2023-07-06T02:41:08.796 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.113921.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.923294.log 2023-07-06T02:41:08.796 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.154049.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.805075.log 2023-07-06T02:41:08.797 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.154049.log.gz 2023-07-06T02:41:08.797 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.923294.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.302037.log 2023-07-06T02:41:08.797 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.923294.log.gz 2023-07-06T02:41:08.797 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.805075.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.805075.log.gz 2023-07-06T02:41:08.798 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.256256.log 2023-07-06T02:41:08.798 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.302037.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.405181.log 2023-07-06T02:41:08.798 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.302037.log.gz 2023-07-06T02:41:08.798 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.256256.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.289686.log 2023-07-06T02:41:08.798 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.256256.log.gz 2023-07-06T02:41:08.799 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.405181.log: 0.0%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.112482.log 2023-07-06T02:41:08.799 INFO:teuthology.orchestra.run.smithi046.stderr: -- replaced with /var/log/ceph/ceph-client.admin.405181.log.gz 2023-07-06T02:41:08.799 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.289686.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.289686.log.gz 2023-07-06T02:41:08.799 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.332859.log 2023-07-06T02:41:08.799 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.112482.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.107155.log 2023-07-06T02:41:08.800 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.332859.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.403026.log 2023-07-06T02:41:08.800 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.332859.log.gz 2023-07-06T02:41:08.800 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.107155.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.690642.log 2023-07-06T02:41:08.800 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.403026.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.218797.log 2023-07-06T02:41:08.801 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.403026.log.gz 2023-07-06T02:41:08.801 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.690642.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.690642.log.gz 2023-07-06T02:41:08.801 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.301039.log 2023-07-06T02:41:08.801 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.218797.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.112948.log.gz 2023-07-06T02:41:08.801 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.360525.log 2023-07-06T02:41:08.802 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.218797.log.gz 2023-07-06T02:41:08.802 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.325635.log 2023-07-06T02:41:08.802 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.301039.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.301039.log.gz 2023-07-06T02:41:08.802 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.360525.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.814668.log 2023-07-06T02:41:08.802 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.360525.log.gz 2023-07-06T02:41:08.803 INFO:teuthology.orchestra.run.smithi046.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.113419.log.gz 2023-07-06T02:41:08.803 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.325635.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.153300.log 2023-07-06T02:41:08.803 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.325635.log.gz 2023-07-06T02:41:08.803 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.814668.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.106521.log 2023-07-06T02:41:08.803 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.814668.log.gz 2023-07-06T02:41:08.804 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.153300.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.153300.log.gz 2023-07-06T02:41:08.804 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.287843.log 2023-07-06T02:41:08.804 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.106521.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.353755.log 2023-07-06T02:41:08.804 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.287843.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.691644.log 2023-07-06T02:41:08.805 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.287843.log.gz 2023-07-06T02:41:08.805 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.353755.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.153379.log 2023-07-06T02:41:08.805 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.353755.log.gz 2023-07-06T02:41:08.805 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.691644.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.691644.log.gz 2023-07-06T02:41:08.805 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.168106.log 2023-07-06T02:41:08.806 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.153379.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.686585.log 2023-07-06T02:41:08.806 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.153379.log.gz 2023-07-06T02:41:08.806 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.168106.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.365095.log 2023-07-06T02:41:08.806 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.168106.log.gz 2023-07-06T02:41:08.807 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.686585.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.277935.log 2023-07-06T02:41:08.807 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.686585.log.gz 2023-07-06T02:41:08.807 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.365095.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.755574.log 2023-07-06T02:41:08.807 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.365095.log.gz 2023-07-06T02:41:08.808 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.277935.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.802261.log 2023-07-06T02:41:08.808 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.277935.log.gz 2023-07-06T02:41:08.808 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.755574.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.755574.log.gz 2023-07-06T02:41:08.808 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.345985.log 2023-07-06T02:41:08.808 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.802261.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.436459.log 2023-07-06T02:41:08.809 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.802261.log.gz 2023-07-06T02:41:08.809 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.345985.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.240657.log 2023-07-06T02:41:08.809 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.345985.log.gz 2023-07-06T02:41:08.809 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.436459.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.289980.log 2023-07-06T02:41:08.810 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.436459.log.gz 2023-07-06T02:41:08.810 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.240657.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.240657.log.gz 2023-07-06T02:41:08.810 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.767732.log 2023-07-06T02:41:08.810 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.289980.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.654626.log 2023-07-06T02:41:08.810 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.289980.log.gz 2023-07-06T02:41:08.811 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.767732.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.193753.log 2023-07-06T02:41:08.811 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.767732.log.gz 2023-07-06T02:41:08.811 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.654626.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.216118.log 2023-07-06T02:41:08.811 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.654626.log.gz 2023-07-06T02:41:08.812 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.193753.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.370222.log 2023-07-06T02:41:08.812 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.193753.log.gz 2023-07-06T02:41:08.812 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.216118.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.278662.log 2023-07-06T02:41:08.812 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.216118.log.gz 2023-07-06T02:41:08.812 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.370222.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.370222.log.gz 2023-07-06T02:41:08.813 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.113737.log 2023-07-06T02:41:08.813 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.278662.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.274014.log 2023-07-06T02:41:08.813 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.278662.log.gz 2023-07-06T02:41:08.813 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.113737.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.342529.log 2023-07-06T02:41:08.813 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.274014.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.799430.log 2023-07-06T02:41:08.814 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.274014.log.gz 2023-07-06T02:41:08.814 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.342529.log: 0.0%gzip -- replaced with /var/log/ceph/ceph-client.admin.342529.log.gz-5 2023-07-06T02:41:08.814 INFO:teuthology.orchestra.run.smithi046.stderr:--verbose -- /var/log/ceph/ceph-client.admin.113875.log 2023-07-06T02:41:08.814 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.799430.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.627218.log 2023-07-06T02:41:08.815 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.799430.log.gz 2023-07-06T02:41:08.815 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.113875.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.274324.log 2023-07-06T02:41:08.815 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.627218.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.798716.log 2023-07-06T02:41:08.815 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.627218.log.gz 2023-07-06T02:41:08.816 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.274324.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.274324.log.gz 2023-07-06T02:41:08.816 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.753298.log 2023-07-06T02:41:08.816 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.798716.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.325203.log 2023-07-06T02:41:08.816 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.798716.log.gz 2023-07-06T02:41:08.817 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.753298.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.375792.log 2023-07-06T02:41:08.817 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.753298.log.gz 2023-07-06T02:41:08.817 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.325203.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.270940.log 2023-07-06T02:41:08.817 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.325203.log.gz 2023-07-06T02:41:08.817 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.375792.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.375792.log.gz 2023-07-06T02:41:08.818 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mgr.y.log 2023-07-06T02:41:08.818 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.270940.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.241038.log 2023-07-06T02:41:08.818 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.270940.log.gz 2023-07-06T02:41:08.818 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-mgr.y.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.817620.log 2023-07-06T02:41:08.818 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.241038.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.259185.log 2023-07-06T02:41:08.819 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.241038.log.gz 2023-07-06T02:41:08.819 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.817620.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.817620.log.gz 2023-07-06T02:41:08.819 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.363774.log 2023-07-06T02:41:08.819 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.259185.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.362747.log 2023-07-06T02:41:08.819 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.259185.log.gz 2023-07-06T02:41:08.820 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.363774.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.363774.log.gz 2023-07-06T02:41:08.820 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.347626.log 2023-07-06T02:41:08.820 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.362747.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.204103.log 2023-07-06T02:41:08.820 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.362747.log.gz 2023-07-06T02:41:08.821 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.347626.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.347626.log.gz 2023-07-06T02:41:08.821 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.685921.log 2023-07-06T02:41:08.821 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.204103.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.115435.log 2023-07-06T02:41:08.821 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.204103.log.gz 2023-07-06T02:41:08.821 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.685921.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.685921.log.gz 2023-07-06T02:41:08.822 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.692012.log 2023-07-06T02:41:08.822 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.115435.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.637750.log 2023-07-06T02:41:08.822 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.692012.log: gzip 0.0%-5 --verbose -- replaced with /var/log/ceph/ceph-client.admin.692012.log.gz-- 2023-07-06T02:41:08.822 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.293406.log 2023-07-06T02:41:08.823 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.637750.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.188135.log 2023-07-06T02:41:08.823 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.637750.log.gz 2023-07-06T02:41:08.823 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.293406.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.293406.log.gz 2023-07-06T02:41:08.823 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.305423.log 2023-07-06T02:41:08.823 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.188135.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.629991.log 2023-07-06T02:41:08.824 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.188135.log.gz 2023-07-06T02:41:08.824 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.305423.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.288650.log 2023-07-06T02:41:08.824 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.305423.log.gz 2023-07-06T02:41:08.824 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.629991.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.811622.log 2023-07-06T02:41:08.824 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.629991.log.gz 2023-07-06T02:41:08.825 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.288650.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.288650.log.gz 2023-07-06T02:41:08.825 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.172177.log 2023-07-06T02:41:08.825 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.811622.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.345410.log 2023-07-06T02:41:08.825 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.811622.log.gz 2023-07-06T02:41:08.826 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.172177.log: gzip -5 --verbose -- 0.0%/var/log/ceph/ceph-client.admin.186680.log 2023-07-06T02:41:08.826 INFO:teuthology.orchestra.run.smithi046.stderr: -- replaced with /var/log/ceph/ceph-client.admin.172177.log.gz 2023-07-06T02:41:08.826 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.345410.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.794605.log 2023-07-06T02:41:08.826 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.345410.log.gz 2023-07-06T02:41:08.826 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.186680.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.186680.log.gz 2023-07-06T02:41:08.827 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.309240.log 2023-07-06T02:41:08.827 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.794605.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.187644.log 2023-07-06T02:41:08.827 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.794605.log.gz 2023-07-06T02:41:08.827 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.309240.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.309240.log.gz 2023-07-06T02:41:08.827 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.114695.log 2023-07-06T02:41:08.828 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.187644.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.399992.log 2023-07-06T02:41:08.828 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.187644.log.gz 2023-07-06T02:41:08.828 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.114695.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.363249.log 2023-07-06T02:41:08.828 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.399992.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.322090.log 2023-07-06T02:41:08.828 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.399992.log.gz 2023-07-06T02:41:08.829 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.363249.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.363249.log.gz 2023-07-06T02:41:08.829 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.932653.log 2023-07-06T02:41:08.829 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.322090.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.320915.log 2023-07-06T02:41:08.829 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.322090.log.gz 2023-07-06T02:41:08.829 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.932653.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.395938.log 2023-07-06T02:41:08.830 INFO:teuthology.orchestra.run.smithi046.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.932653.log.gz 2023-07-06T02:41:08.830 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.320915.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.320915.log.gz 2023-07-06T02:41:08.830 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.814196.log 2023-07-06T02:41:08.830 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.759244.log 2023-07-06T02:41:08.830 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.395938.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.395938.log.gz 2023-07-06T02:41:08.831 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.814196.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.814196.log.gz 2023-07-06T02:41:08.831 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.337601.log 2023-07-06T02:41:08.831 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.759244.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.620767.log 2023-07-06T02:41:08.831 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.759244.log.gz 2023-07-06T02:41:08.832 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.337601.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.357866.log 2023-07-06T02:41:08.832 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.337601.log.gz 2023-07-06T02:41:08.832 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.620767.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.322558.log 2023-07-06T02:41:08.832 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.620767.log.gz 2023-07-06T02:41:08.832 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.357866.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.253270.log 2023-07-06T02:41:08.833 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.357866.log.gz 2023-07-06T02:41:08.833 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.322558.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.464628.log 2023-07-06T02:41:08.833 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.322558.log.gz 2023-07-06T02:41:08.833 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.253270.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.325217.log 2023-07-06T02:41:08.834 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.253270.log.gz 2023-07-06T02:41:08.834 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.464628.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.464628.log.gz 2023-07-06T02:41:08.834 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.685706.log 2023-07-06T02:41:08.834 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.325217.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.355701.log 2023-07-06T02:41:08.834 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.325217.log.gz 2023-07-06T02:41:08.835 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.685706.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.270014.log 2023-07-06T02:41:08.835 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.685706.log.gz 2023-07-06T02:41:08.835 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.355701.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.702263.log 2023-07-06T02:41:08.835 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.355701.log.gz 2023-07-06T02:41:08.835 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.270014.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.270014.log.gz 2023-07-06T02:41:08.836 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.347640.log 2023-07-06T02:41:08.836 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.702263.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.112022.log 2023-07-06T02:41:08.836 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.702263.log.gz 2023-07-06T02:41:08.836 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.347640.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.347640.log.gz 2023-07-06T02:41:08.836 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.333627.log 2023-07-06T02:41:08.837 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.112022.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.157527.log 2023-07-06T02:41:08.837 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.333627.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.391191.log 2023-07-06T02:41:08.837 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.333627.log.gz 2023-07-06T02:41:08.837 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.157527.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.263226.log 2023-07-06T02:41:08.837 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.157527.log.gz 2023-07-06T02:41:08.838 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.391191.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.391191.log.gz 2023-07-06T02:41:08.838 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.320420.log 2023-07-06T02:41:08.838 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.263226.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.356436.log 2023-07-06T02:41:08.838 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.263226.log.gz 2023-07-06T02:41:08.839 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.320420.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.928118.log 2023-07-06T02:41:08.839 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.320420.log.gz 2023-07-06T02:41:08.839 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.356436.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.109386.log 2023-07-06T02:41:08.839 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.356436.log.gz 2023-07-06T02:41:08.839 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.928118.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.928118.log.gz 2023-07-06T02:41:08.840 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.317964.log 2023-07-06T02:41:08.840 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.109386.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.703090.log 2023-07-06T02:41:08.840 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.317964.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.673681.log 2023-07-06T02:41:08.840 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.317964.log.gz 2023-07-06T02:41:08.840 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.703090.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.633404.log 2023-07-06T02:41:08.841 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.703090.log.gz 2023-07-06T02:41:08.841 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.673681.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.673681.log.gz 2023-07-06T02:41:08.841 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.409850.log 2023-07-06T02:41:08.841 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.278461.log 2023-07-06T02:41:08.842 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.633404.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.633404.log.gz 2023-07-06T02:41:08.842 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.409850.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.394756.log 2023-07-06T02:41:08.842 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.409850.log.gz 2023-07-06T02:41:08.842 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.278461.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.332140.log 2023-07-06T02:41:08.842 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.278461.log.gz 2023-07-06T02:41:08.843 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.394756.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.362437.log 2023-07-06T02:41:08.843 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.394756.log.gz 2023-07-06T02:41:08.843 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.332140.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.381521.log 2023-07-06T02:41:08.843 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.332140.log.gz 2023-07-06T02:41:08.843 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.362437.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.416933.log 2023-07-06T02:41:08.844 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.362437.log.gz 2023-07-06T02:41:08.844 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.381521.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.355145.log 2023-07-06T02:41:08.844 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.381521.log.gz 2023-07-06T02:41:08.844 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.416933.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.416933.log.gz 2023-07-06T02:41:08.845 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.369292.log 2023-07-06T02:41:08.845 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.355145.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.817130.log 2023-07-06T02:41:08.845 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.355145.log.gz 2023-07-06T02:41:08.845 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.369292.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.369292.log.gz 2023-07-06T02:41:08.845 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.112114.log 2023-07-06T02:41:08.846 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.817130.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.217790.log 2023-07-06T02:41:08.846 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.817130.log.gz 2023-07-06T02:41:08.846 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.112114.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.926093.log 2023-07-06T02:41:08.846 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.217790.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.700772.log 2023-07-06T02:41:08.846 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.217790.log.gz 2023-07-06T02:41:08.847 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.926093.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.926093.log.gz 2023-07-06T02:41:08.847 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.218281.log 2023-07-06T02:41:08.847 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.700772.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.338404.log 2023-07-06T02:41:08.847 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.700772.log.gz 2023-07-06T02:41:08.847 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.218281.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.218281.log.gz 2023-07-06T02:41:08.848 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.318043.log 2023-07-06T02:41:08.848 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.338404.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.409468.log 2023-07-06T02:41:08.848 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.338404.log.gz 2023-07-06T02:41:08.848 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.318043.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.318043.log.gz 2023-07-06T02:41:08.848 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.407020.log 2023-07-06T02:41:08.849 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.409468.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.321513.log 2023-07-06T02:41:08.849 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.409468.log.gz 2023-07-06T02:41:08.849 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.407020.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.407020.log.gz 2023-07-06T02:41:08.849 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.636217.log 2023-07-06T02:41:08.849 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.321513.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.285772.log 2023-07-06T02:41:08.850 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.321513.log.gz 2023-07-06T02:41:08.850 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.636217.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.636217.log.gz 2023-07-06T02:41:08.850 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.696059.log 2023-07-06T02:41:08.850 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.285772.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.383378.log 2023-07-06T02:41:08.850 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.285772.log.gz 2023-07-06T02:41:08.851 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.696059.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.696059.log.gz 2023-07-06T02:41:08.851 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.383378.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.383378.log.gz 2023-07-06T02:41:08.851 INFO:teuthology.orchestra.run.smithi046.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.114787.log.gz 2023-07-06T02:41:08.851 INFO:teuthology.orchestra.run.smithi046.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.115017.log.gz 2023-07-06T02:41:08.851 INFO:teuthology.orchestra.run.smithi046.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.115873.log.gz 2023-07-06T02:41:08.852 INFO:teuthology.orchestra.run.smithi046.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.111239.log.gz 2023-07-06T02:41:08.852 INFO:teuthology.orchestra.run.smithi046.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.109624.log.gz 2023-07-06T02:41:08.852 INFO:teuthology.orchestra.run.smithi046.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.112298.log.gz 2023-07-06T02:41:08.852 INFO:teuthology.orchestra.run.smithi046.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.114059.log.gz 2023-07-06T02:41:08.852 INFO:teuthology.orchestra.run.smithi046.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.114289.log.gz 2023-07-06T02:41:08.853 INFO:teuthology.orchestra.run.smithi046.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.106569.log.gz 2023-07-06T02:41:08.853 INFO:teuthology.orchestra.run.smithi046.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.107913.log.gz 2023-07-06T02:41:08.853 INFO:teuthology.orchestra.run.smithi046.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.113921.log.gz 2023-07-06T02:41:08.853 INFO:teuthology.orchestra.run.smithi046.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.112482.log.gz 2023-07-06T02:41:08.854 INFO:teuthology.orchestra.run.smithi046.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.107155.log.gz 2023-07-06T02:41:08.854 INFO:teuthology.orchestra.run.smithi046.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.106521.log.gz 2023-07-06T02:41:08.854 INFO:teuthology.orchestra.run.smithi046.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.113737.log.gz 2023-07-06T02:41:08.854 INFO:teuthology.orchestra.run.smithi046.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.113875.log.gz 2023-07-06T02:41:08.854 INFO:teuthology.orchestra.run.smithi046.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.114695.log.gz 2023-07-06T02:41:08.855 INFO:teuthology.orchestra.run.smithi046.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.115435.log.gz 2023-07-06T02:41:08.855 INFO:teuthology.orchestra.run.smithi046.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.109386.log.gz 2023-07-06T02:41:08.855 INFO:teuthology.orchestra.run.smithi046.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.112114.log.gz 2023-07-06T02:41:08.855 INFO:teuthology.orchestra.run.smithi046.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.112022.log.gz 2023-07-06T02:41:08.856 INFO:teuthology.orchestra.run.smithi046.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.100794.log.gz 2023-07-06T02:41:08.856 INFO:teuthology.orchestra.run.smithi046.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.101100.log.gz 2023-07-06T02:41:09.519 INFO:teuthology.orchestra.run.smithi046.stderr: 95.2% -- replaced with /var/log/ceph/ceph-mgr.y.log.gz 2023-07-06T02:41:19.121 INFO:teuthology.orchestra.run.smithi073.stderr: 91.7% -- replaced with /var/log/ceph/ceph-mgr.x.log.gz 2023-07-06T02:41:21.153 INFO:teuthology.orchestra.run.smithi046.stderr: 93.7% -- replaced with /var/log/ceph/ceph-osd.3.log.gz 2023-07-06T02:41:24.832 INFO:teuthology.orchestra.run.smithi073.stderr: 93.6% -- replaced with /var/log/ceph/ceph-osd.6.log.gz 2023-07-06T02:41:28.078 INFO:teuthology.orchestra.run.smithi073.stderr: 92.5% -- replaced with /var/log/ceph/ceph-mon.b.log.gz 2023-07-06T02:41:34.361 INFO:teuthology.orchestra.run.smithi073.stderr: 92.1% -- replaced with /var/log/ceph/ceph-mon.c.log.gz 2023-07-06T02:41:59.896 INFO:teuthology.orchestra.run.smithi073.stderr: 93.7% -- replaced with /var/log/ceph/ceph-osd.7.log.gz 2023-07-06T02:42:04.131 INFO:teuthology.orchestra.run.smithi073.stderr: 93.7% -- replaced with /var/log/ceph/ceph-osd.4.log.gz 2023-07-06T02:42:12.922 INFO:teuthology.orchestra.run.smithi046.stderr: 91.9% -- replaced with /var/log/ceph/ceph-mon.a.log.gz 2023-07-06T02:42:14.112 INFO:teuthology.orchestra.run.smithi046.stderr: 93.8% -- replaced with /var/log/ceph/ceph-osd.0.log.gz 2023-07-06T02:42:33.126 INFO:teuthology.orchestra.run.smithi073.stderr: 93.6% -- replaced with /var/log/ceph/ceph-osd.5.log.gz 2023-07-06T02:42:45.554 INFO:teuthology.orchestra.run.smithi073.stderr: 93.2% -- replaced with /var/log/ceph/ceph-mds.b.log.gz 2023-07-06T02:42:45.555 INFO:teuthology.orchestra.run.smithi073.stderr: 2023-07-06T02:42:45.556 INFO:teuthology.orchestra.run.smithi073.stderr:real 1m38.647s 2023-07-06T02:42:45.556 INFO:teuthology.orchestra.run.smithi073.stderr:user 3m53.556s 2023-07-06T02:42:45.556 INFO:teuthology.orchestra.run.smithi073.stderr:sys 0m9.903s 2023-07-06T02:43:00.552 INFO:teuthology.orchestra.run.smithi046.stderr: 93.6% -- replaced with /var/log/ceph/ceph-osd.2.log.gz 2023-07-06T02:43:09.156 INFO:teuthology.orchestra.run.smithi046.stderr: 93.7% -- replaced with /var/log/ceph/ceph-osd.1.log.gz 2023-07-06T02:43:09.158 INFO:teuthology.orchestra.run.smithi046.stderr: 2023-07-06T02:43:09.158 INFO:teuthology.orchestra.run.smithi046.stderr:real 2m2.284s 2023-07-06T02:43:09.158 INFO:teuthology.orchestra.run.smithi046.stderr:user 3m56.455s 2023-07-06T02:43:09.159 INFO:teuthology.orchestra.run.smithi046.stderr:sys 0m11.423s 2023-07-06T02:43:09.160 INFO:tasks.ceph:Archiving logs... 2023-07-06T02:43:09.160 DEBUG:teuthology.misc:Transferring archived files from smithi046:/var/log/ceph to /home/teuthworker/archive/rishabh-2023-07-05_18:32:52-fs-wip-rishabh-CephManager-in-CephFSTestCase-testing-default-smithi/7327386/remote/smithi046/log 2023-07-06T02:43:09.161 DEBUG:teuthology.orchestra.run.smithi046:> sudo tar c -f - -C /var/log/ceph -- . 2023-07-06T02:47:45.228 DEBUG:teuthology.misc:Transferring archived files from smithi073:/var/log/ceph to /home/teuthworker/archive/rishabh-2023-07-05_18:32:52-fs-wip-rishabh-CephManager-in-CephFSTestCase-testing-default-smithi/7327386/remote/smithi073/log 2023-07-06T02:47:45.229 DEBUG:teuthology.orchestra.run.smithi073:> sudo tar c -f - -C /var/log/ceph -- . 2023-07-06T02:57:50.230 DEBUG:teuthology.run_tasks:Unwinding manager install 2023-07-06T02:57:50.291 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2023-07-06T02:57:50.292 DEBUG:teuthology.orchestra.run.smithi046:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2023-07-06T02:57:50.296 DEBUG:teuthology.orchestra.run.smithi073:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2023-07-06T02:58:05.427 DEBUG:teuthology.run_tasks:Unwinding manager clock 2023-07-06T02:58:05.438 INFO:teuthology.task.clock:Checking final clock skew... 2023-07-06T02:58:05.438 DEBUG:teuthology.orchestra.run.smithi046:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-07-06T02:58:05.441 DEBUG:teuthology.orchestra.run.smithi073:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-07-06T02:58:05.459 INFO:teuthology.orchestra.run.smithi046.stderr:bash: ntpq: command not found 2023-07-06T02:58:05.460 INFO:teuthology.orchestra.run.smithi073.stderr:bash: ntpq: command not found 2023-07-06T02:58:05.465 INFO:teuthology.orchestra.run.smithi046.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-07-06T02:58:05.465 INFO:teuthology.orchestra.run.smithi046.stdout:=============================================================================== 2023-07-06T02:58:05.466 INFO:teuthology.orchestra.run.smithi046.stdout:^+ hv01.front.sepia.ceph.com 2 6 377 55 -417us[ -405us] +/- 93ms 2023-07-06T02:58:05.466 INFO:teuthology.orchestra.run.smithi046.stdout:^* hv02.front.sepia.ceph.com 3 6 377 7 -836us[ -820us] +/- 58ms 2023-07-06T02:58:05.466 INFO:teuthology.orchestra.run.smithi046.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 51 +1306us[+1319us] +/- 69ms 2023-07-06T02:58:05.466 INFO:teuthology.orchestra.run.smithi046.stdout:^? hv04.front.sepia.ceph.com 0 10 0 - +0ns[ +0ns] +/- 0ns 2023-07-06T02:58:05.655 INFO:teuthology.orchestra.run.smithi073.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-07-06T02:58:05.655 INFO:teuthology.orchestra.run.smithi073.stdout:=============================================================================== 2023-07-06T02:58:05.655 INFO:teuthology.orchestra.run.smithi073.stdout:^+ hv01.front.sepia.ceph.com 2 6 377 32 -428us[ -434us] +/- 93ms 2023-07-06T02:58:05.656 INFO:teuthology.orchestra.run.smithi073.stdout:^* hv02.front.sepia.ceph.com 3 6 377 6 -853us[ -860us] +/- 58ms 2023-07-06T02:58:05.656 INFO:teuthology.orchestra.run.smithi073.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 12 +1299us[+1293us] +/- 69ms 2023-07-06T02:58:05.656 INFO:teuthology.orchestra.run.smithi073.stdout:^? hv04.front.sepia.ceph.com 0 10 0 - +0ns[ +0ns] +/- 0ns 2023-07-06T02:58:05.657 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2023-07-06T02:58:05.667 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2023-07-06T02:58:05.668 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2023-07-06T02:58:05.684 DEBUG:teuthology.orchestra.run.smithi046:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2023-07-06T02:58:05.761 DEBUG:teuthology.orchestra.run.smithi073:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2023-07-06T02:58:05.963 DEBUG:teuthology.orchestra.run.smithi046:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-07-06T02:58:05.999 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-07-06T02:58:06.000 DEBUG:teuthology.orchestra.run.smithi073:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-07-06T02:58:06.034 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-07-06T02:58:06.035 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2023-07-06T02:58:06.045 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2023-07-06T02:58:06.068 INFO:teuthology.task.internal:Duration was 29623.653575 seconds 2023-07-06T02:58:06.069 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2023-07-06T02:58:06.101 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2023-07-06T02:58:06.102 DEBUG:teuthology.orchestra.run.smithi046:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2023-07-06T02:58:06.105 DEBUG:teuthology.orchestra.run.smithi073:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2023-07-06T02:58:06.193 INFO:teuthology.orchestra.run.smithi046.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-07-06T02:58:06.204 INFO:teuthology.orchestra.run.smithi073.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-07-06T02:58:06.417 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2023-07-06T02:58:06.417 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi046.front.sepia.ceph.com 2023-07-06T02:58:06.418 DEBUG:teuthology.orchestra.run.smithi046:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2023-07-06T02:58:06.493 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi073.front.sepia.ceph.com 2023-07-06T02:58:06.493 DEBUG:teuthology.orchestra.run.smithi073:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2023-07-06T02:58:06.528 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2023-07-06T02:58:06.528 DEBUG:teuthology.orchestra.run.smithi046:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2023-07-06T02:58:06.531 DEBUG:teuthology.orchestra.run.smithi073:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2023-07-06T02:58:06.668 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2023-07-06T02:58:06.668 DEBUG:teuthology.orchestra.run.smithi046:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2023-07-06T02:58:06.671 DEBUG:teuthology.orchestra.run.smithi073:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2023-07-06T02:58:06.900 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2023-07-06T02:58:06.913 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2023-07-06T02:58:06.914 DEBUG:teuthology.orchestra.run.smithi046:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2023-07-06T02:58:06.944 DEBUG:teuthology.orchestra.run.smithi073:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2023-07-06T02:58:06.971 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2023-07-06T02:58:06.984 DEBUG:teuthology.orchestra.run.smithi046:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2023-07-06T02:58:06.987 DEBUG:teuthology.orchestra.run.smithi073:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2023-07-06T02:58:07.028 INFO:teuthology.orchestra.run.smithi046.stdout:kernel.core_pattern = core 2023-07-06T02:58:07.055 INFO:teuthology.orchestra.run.smithi073.stdout:kernel.core_pattern = core 2023-07-06T02:58:07.070 DEBUG:teuthology.orchestra.run.smithi046:> test -e /home/ubuntu/cephtest/archive/coredump 2023-07-06T02:58:07.089 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-07-06T02:58:07.090 DEBUG:teuthology.orchestra.run.smithi073:> test -e /home/ubuntu/cephtest/archive/coredump 2023-07-06T02:58:07.105 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-07-06T02:58:07.106 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2023-07-06T02:58:07.123 INFO:teuthology.task.internal:Transferring archived files... 2023-07-06T02:58:07.124 DEBUG:teuthology.misc:Transferring archived files from smithi046:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/rishabh-2023-07-05_18:32:52-fs-wip-rishabh-CephManager-in-CephFSTestCase-testing-default-smithi/7327386/remote/smithi046 2023-07-06T02:58:07.124 DEBUG:teuthology.orchestra.run.smithi046:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2023-07-06T02:58:07.177 DEBUG:teuthology.misc:Transferring archived files from smithi073:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/rishabh-2023-07-05_18:32:52-fs-wip-rishabh-CephManager-in-CephFSTestCase-testing-default-smithi/7327386/remote/smithi073 2023-07-06T02:58:07.178 DEBUG:teuthology.orchestra.run.smithi073:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2023-07-06T02:58:07.223 INFO:teuthology.task.internal:Removing archive directory... 2023-07-06T02:58:07.224 DEBUG:teuthology.orchestra.run.smithi046:> rm -rf -- /home/ubuntu/cephtest/archive 2023-07-06T02:58:07.226 DEBUG:teuthology.orchestra.run.smithi073:> rm -rf -- /home/ubuntu/cephtest/archive 2023-07-06T02:58:07.275 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2023-07-06T02:58:07.287 INFO:teuthology.task.internal:Not uploading archives. 2023-07-06T02:58:07.288 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2023-07-06T02:58:07.311 INFO:teuthology.task.internal:Tidying up after the test... 2023-07-06T02:58:07.311 DEBUG:teuthology.orchestra.run.smithi046:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2023-07-06T02:58:07.314 DEBUG:teuthology.orchestra.run.smithi073:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2023-07-06T02:58:07.331 INFO:teuthology.orchestra.run.smithi073.stdout: 262307 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Jul 6 02:58 /home/ubuntu/cephtest 2023-07-06T02:58:07.332 INFO:teuthology.orchestra.run.smithi046.stdout: 262307 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Jul 6 02:58 /home/ubuntu/cephtest 2023-07-06T02:58:07.334 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2023-07-06T02:58:07.343 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2023-07-06T02:58:07.414 INFO:teuthology.nuke:Checking targets against current locks 2023-07-06T02:58:12.451 DEBUG:teuthology.nuke:shortname: smithi046 2023-07-06T02:58:12.452 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-07-06T02:58:15.740 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi046.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/rishabh-2023-07-05_18:32:52-fs-wip-rishabh-CephManager-in-CephFSTestCase-testing-default-smithi/7327386', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-07-05 18:34:17.702604', 'locked_by': 'scheduled_rishabh@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCpUxo5ay/ucdkX9rleNMm8Ofp24XRXUtJPOK3Ji3XBpTiUgmmwneaY6316+3CG+k4K0p3IebanuyTvZApjm02/dNCvu8yD3rjEpWVgIuqYH8O3lEdN9DXcCX+7xHJE0m18+ZPsJQVsNrNJxY+5zqyNnBc8jpZq2LStsWwPOKPWhauANRkOBFSGDoLppWZbLx/yJs+R0qoNLLK9LpKQTUnqsapXvbD27OpPahzj/qbNxFPPyY6XrrldZ6qEO+EjJOujFLH3gzv0kJu10DCuzxrpz6ston4RPi1O3GgcHnF4Mqr/W9VwZ94UTMh+k4dIFRVqJEKrcwRHa5kFsvH/WhVx0Ygr/MiV/Q86mmV7JT+/MpzIRTtWyei5L9IBeZIE9cwzj+mOk6SD/t1roIVEGVV/uF2AyFDVBPr6F8oZ822OGpUyyaDsWTitPNdTX4TC3zdSrLc9tyDa1P74eH/ZLeTSf+C6pM/cepOhQaa6XzpDiPSuJUm9HOQxUlEAvcqa7Ac='} 2023-07-06T02:58:15.743 DEBUG:teuthology.nuke:shortname: smithi073 2023-07-06T02:58:15.743 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-07-06T02:58:15.764 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi073.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/rishabh-2023-07-05_18:32:52-fs-wip-rishabh-CephManager-in-CephFSTestCase-testing-default-smithi/7327386', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-07-05 18:34:17.704380', 'locked_by': 'scheduled_rishabh@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCpUxo5ay/ucdkX9rleNMm8Ofp24XRXUtJPOK3Ji3XBpTiUgmmwneaY6316+3CG+k4K0p3IebanuyTvZApjm02/dNCvu8yD3rjEpWVgIuqYH8O3lEdN9DXcCX+7xHJE0m18+ZPsJQVsNrNJxY+5zqyNnBc8jpZq2LStsWwPOKPWhauANRkOBFSGDoLppWZbLx/yJs+R0qoNLLK9LpKQTUnqsapXvbD27OpPahzj/qbNxFPPyY6XrrldZ6qEO+EjJOujFLH3gzv0kJu10DCuzxrpz6ston4RPi1O3GgcHnF4Mqr/W9VwZ94UTMh+k4dIFRVqJEKrcwRHa5kFsvH/WhVx0Ygr/MiV/Q86mmV7JT+/MpzIRTtWyei5L9IBeZIE9cwzj+mOk6SD/t1roIVEGVV/uF2AyFDVBPr6F8oZ822OGpUyyaDsWTitPNdTX4TC3zdSrLc9tyDa1P74eH/ZLeTSf+C6pM/cepOhQaa6XzpDiPSuJUm9HOQxUlEAvcqa7Ac='} 2023-07-06T02:58:15.797 INFO:teuthology.orchestra.console:Power off smithi046 2023-07-06T02:58:15.798 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi046.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-07-06T02:58:15.823 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi046.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-06T02:58:15.843 INFO:teuthology.orchestra.console:Power off smithi073 2023-07-06T02:58:15.844 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi073.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-07-06T02:58:15.867 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi073.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-06T02:58:19.856 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi046.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-06T02:58:19.893 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi073.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-06T02:58:24.972 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi046.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-06T02:58:25.009 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi073.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-06T02:58:25.184 INFO:teuthology.orchestra.console:Power off for smithi046 completed 2023-07-06T02:58:30.124 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi073.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-06T02:58:35.238 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi073.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-06T02:58:40.352 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi073.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-06T02:58:45.464 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi073.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-06T02:58:50.576 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi073.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-06T02:58:55.692 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi073.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-06T02:59:00.805 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi073.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-06T02:59:01.017 INFO:teuthology.orchestra.console:Power off for smithi073 completed 2023-07-06T02:59:01.123 INFO:teuthology.run:Summary data: description: fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/xfstests-dev} duration: 29623.653574943542 failure_reason: 'Test failure: test_generic (tasks.cephfs.tests_from_xfstests_dev.TestXFSTestsDev)' flavor: default owner: scheduled_rishabh@teuthology sentry_event: https://sentry.ceph.com/organizations/ceph/?query=ac67f2f3a2ad4b9093b435b7d8f7ac01 status: fail success: false 2023-07-06T02:59:01.123 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-06T02:59:06.217 INFO:teuthology.run:FAIL